Metering Data

Introducing our Clients: Carson City and South Bend

By: Sabrina Strauss, Office Manager

Xylem-Digital Solutions kicked off Hidden Revenue Locator projects with a number of new clients in 2019. Two of the recent deployments include  City of Carson City and the City of South Bend. We will introduce both of these innovative utilities in this post. 


Introducing Carson City Water Division

Carson City is located in an arid region of Northern Nevada. Carson City’s water distribution system consists of 250 miles of water mains, 4,200 fire hydrants, 32 groundwater wells, 15 storage tanks, and 16 pressure zones, according to the local Water Division. “The distribution division maintains the system’s water mains, valves and hydrants, and the City's portion of the service line, [...] including the water meter.” Carson City’s Water Division oversees the city’s water production, distribution and metering, as well as maintaining the fire hydrants and infrastructure. 

The city’s overall goal in working with Xylem is to locate revenue deficiency across its commercial and industrial meter fleet. In addition, Xylem  will help the city with meter asset management through data driven insights and recommendations specifically on the systematic replacement of its under-performing meters. Furthermore, another goal is to also determine the potential missing revenue from each of the under-performing meters, which is estimated to be worth 1% of Carson City's 2017 water and sewer gross operating revenue.

The Xylem’s Revenue Assurance group recommended their award-winning solution Hidden Revenue Locator (HRL) to Carson City to use to work towards these goals of the Water Division. HRL is a tool which delivers improved predictions for utility meter issue identification through utility gathered data and as ongoing and automated  data integration which is easy to scale across multiple meters. The HRL optimizes operational workflows for the City due to its easy to access online platform and ongoing, regular reports for prioritizing field activities, as well as helping with meter asset management. 

Xylem also provides program guidance and insights on total revenue and volume gains, which will be delivered by the Revenue Assurance team throughout a 12-month long program, with a dataset of 1,700 meters, and including a pre/post revenue impact report. The dashboard for this project will be launched in Fall 2019. 


Introducing South Bend Water Works

Located in southern Indiana, South Bend Water Works ‘solely utilizes groundwater to serve more than 112,000 customers. There are nine well fields which can produce water to be treated before making its way to homes and businesses via 550+ miles of water main’. 

The City’s goal is it to gain a better understanding of the performance of its water meters using a performance-based approach. For this purpose, identifying and addressing water and revenue loss at and behind the customer meter, and closely tracking each meters’ revenue impact, is necessary. Furthermore, the City plans to use the Hidden Revenue Locator to better understand where its system water losses are coming from by better estimating its apparent water losses. Currently, the City has a regular replacement program for all of its meters and by using HRL, the goal is instead to focus these replacements on only meters with issues which will save both time and effort while also recovering revenue in the future. 

Similar to the Carson City project, South Bend is planning to use the Hidden Revenue Locator to achieve their goals. South Bend will receive a one-time, Hidden Revenue Locator report of meter issues for 10,000 manual and AMR meters. Xylem’s San Francisco team will conduct  a one-time data integration and analysis for all provided data back to 2013. The dashboard is targeted to launch in November 2019.

Large Meter Testing: Where are utilities today? AWWA CA-NV Meter Committee Workshop; August 20, 2019

By: Kristine Gali, Technical Program Manager, and Heidi Smith, Global Product Manager

The American Water Works Association nonprofit was founded in 1881 with a focus on providing education and training opportunities for drinking water professionals. Since its inception, the association has grown to roughly 50,000 members, multiple sections across the US, and multiple committee’s within each section. The California-Nevada Section of AWWA held its Summer Meeting and Workshop on August 20, 2019 with a focus on large meter testing, the importance of regular testing, methods of conducting field and bench tests, and a panel on how to develop a testing program.

 With emerging water regulations across the US, utilities are becoming increasingly focused on annual water audits. Even more importantly, utilities are focusing on how to gather sufficient data to most accurately complete these water audits. The water that enters the water distribution system should equal the amount of water either consumed, lost, or exported. On the other hand, without accurate metering, it is impossible to confirm how much water is associated with each of these variables of the equation. Having a regular testing program for large meters helps utilities monitor not only production meters, but some of their highest revenue generating meters as well and ultimately hone in on accurate water audit inputs.

Reasons and consequences for large meter failures

Michael Simpson from M.E. Simpson Co. shared 7 reasons for large meter failures and their consequences:

-       age,

-       mechanical wear and tear,

-       corrosion,

-       mineral buildup,

-       fouling due to debris,

-       misuse or operation outside of the meters range, and

-       inadequate plumbing before and/or after the meter

The consequences of these potential failures include inaccurate billing of customers, lost revenue, over and under feeding of chemicals (in plant meters only), inaccurate annual reports and usage estimates, and an overall loss of control.

Meters will naturally age and experience wear and tear. Depending on water quality, other factors such as corrosion, mineral buildup, and fouling may ultimately affect meters as well. Finally, the installation configuration and operation of the meter itself can compromise the accuracy of meter reads. Due to the variety of issue types, the life expectancy of large meters can be difficult to predict without closely monitoring the meters as well as the quality of water running through them over their lifetime.

Simpson recommends that utilities test and calibrate their large meters annually. A survey of the largest US utilities also found that testing of large meters occurred on an annual basis (AWWA, M6, pg 58). Testing should be conducted using a certified test meter or a pitot rod. It should be noted that testing of the 4 to 20 mA signal between a meter head and the SCADA system is not considered a valid test. 

What is a Pitot Test?

The pitot test is a common field testing method which measures differential flow pressure to determine flow velocity and ultimately flow volume (i.e. Q=VA) within a pipe. The pitot tube is inserted into the live pipe to determine the flow profile across the entire inner diameter of the pipe. Since the flow equation depends on the cross sectional area of flow, it is important to carefully measure the inner diameter of the pipe such as with a Polcon Pipe Caliper. It should also be noted that various pipe obstructions such as valves and elbows can alter the flow profile, therefore it is important to take pitot measurements on a straight line of pipe and at multiple depths within the pipe to ensure the most accurate flow volume can be determined. Furthermore, since flows may vary throughout the day, a 24-hour test is also recommended. 

Ultrasonic strap-on test meter

Strap-on ultrasonic test meters can also be used to field testing large meters in-place. The meters are minimally intrusive and similar to a pitot tube, do not disrupt flow. Measurements are calculated based on the transit-time difference method. It should be noted that the test meter should be certified and calibrated prior to use and that the manufacturer specifications for installing the test meter are followed as most require a specified amount of straight pipe both up-stream and down-stream of the test location. Furthermore, it should be noted that “once the testing begins, the testing order is from the low flows to the higher flows. Experience has shown that when most meters begin to wear or lose accuracy, it occurs at the lower flows rather than the higher” (AWWA, M6 pg 85). An advantage of ultrasonic strap-on meters is their ability to measure low flows therefore covering most, if not all flow ranges within the large meter. 

Contracted-out services

Utilities may opt to contract out services to companies such as Mars Company or to organizations such as Utah Water Research Laboratory (UWRL) for their testing and calibration of large meters. Mars Company has been offering water meter testing and technology services since 1986. At UWRL, meters and even volumes of water, can be shipped for testing in a laboratory which simulates the field piping installation. 

Large Meter Testing Practices

Portable large meter tester

Portable large meter tester

Overall, both field testing methods, pitot and ultrasonic, have their own advantages and disadvantages that should be weighed by the utility. Utilities should ensure that proper training is conducted for all personnel responsible for large meter testing. Contracted-out services offer another alternative for utilities. As stated in the AWWA M6 manual, “no phase of water-utility operation has been handled in so many different ways as the testing of water meters...The confusion and wide variance in testing procedures result from the fact that the testing of water meters in ordinary shop practice is primarily concerned with meters that are not new but that have been removed from service and repaired. Each individual has had to begin with the information available and develop testing procedures” (AWWA, M6 pg 59). Each utility much test analyze their own system and large meter individually. A panel of utility personnel from Las Vegas, San Jose Water Company, Walnut Valley, Golden State Water, and MWD revealed the following:

  • Utilities are using a mix of in-house and contracted-out large meter testing services

  • Testing programs vary from 180 days to 4 years. Some vary the testing frequency based on the amount of revenue that the meter generates

  • For utilities with large quantities of large meters, a statistical calculator such as Roasoft, is used to determine how many of its new meters to test. 

  • Utilities are currently managing test data on spreadsheets but are looking for software to better manage their data in a central location while also allowing for integration with their customer care portals, MDM systems, and other analytics software platforms

Overall, more and more utilities are proactively testing and replacing their large meters and are uncovering significant savings. Methods for developing these programs still vary today, but new testing services, research, and analytics are continuing to be developed to help utilities uncover significant savings through more proactive approaches to meter maintenance

Why Eliminating Ambiguity in Your Data Matters

By David Wegman, CTO @ Valor

The next time you strike up a conversation with your friendly neighborhood computer, take note of how long it takes before you get frustrated.  Despite the advances in artificial intelligence over the past decades -- and despite the incredible capacity humans have for adaptation -- human-computer interaction is unnatural (from the human perspective, anyway).  Every touch point where people provide input to computers, or receive output from computers, is an opportunity for misunderstanding.


Even as our systems are getting smarter all the time, there are some simple steps we can take to eliminate ambiguity.  Data architects serve an important role, helping to ensure that information is not lost or garbled in translation.  These techniques are essentially an investment.  Every minute spent on avoiding problems up front can save much more time down the road when things aren't working properly.


Date formats


Which came first, 3/7/2017 or 5/4/2017?  The answer depends on where you are in the world when asking the question.  In the United States, dates are commonly represented as month/day/year, so these dates would usually be interpreted as March 7 and May 4, respectively.  In many other countries, dates are represented as day/month/year, so they would be interpreted as July 3 and April 5, respectively.


This becomes problematic when a data file, which includes date information, is read by a computer system.  Each time the system encounters a field known to be a date, it must decide how to interpret the information.  Fortunately, most modern systems allow us to choose the format of the date for inputting and outputting dates.  However, if the date format is not chosen carefully, it can result in one of the most pernicious types of errors in computer systems: one which does not raise a flag immediately and lays dormant for some time.  A date which is incorrectly interpreted can result in a myriad of problems, as was widely publicized at the end of the last century.


Given enough data points, it may eventually become clear whether dates have been written starting with the month or day (e.g. if one of the values is 3/15/2017, the format cannot be day/month/year because 15 cannot refer to the month, so the format is probably month/day/year).  This approach is suboptimal because it requires an additional step which is not guaranteed to work properly in all cases.  A better approach is to avoid the problem altogether by taking care when choosing a date format.


To eliminate ambiguity when working with dates, when possible, use the format YYYY/MM/DD.  This represents a four-digit year, followed by a two-digit month, followed by a two-digit day.  March 7, 2017 would be represented as 2017/03/07.  This format is widely understood and eliminates the ambiguity that can occur when the year appears at the end.


Field delimiters


A common method for storing tabular data is in CSV (comma-separated values) format.  In a CSV file, each line contains one row of a table.  Within each line, a delimiter character appears in between each value, demarcating the columns.  The delimiter character is usually a comma or a tab.


A problem can arise when one of the values that needs to be stored contains the delimiter character.  For example, a person's name may contain a comma (e.g. "Martin Luther King, Jr.").  In this situation, a line containing this value will contain an extra delimiter character.  Software which treats each occurrence of the delimiter as a new column may be confused by the fact that the number of columns is inconsistent from one line to another.


One strategy is to choose a delimiter character which does not appear in any of the values.  This technique can help minimize problems, however it is not guaranteed to completely avoid them as new data files are created in the future.  A better approach is to wrap values that may contain delimiter characters in double quotes, and to ensure that literal double quote characters are specifically labeled (or "escaped," in programmer speak) using a backslash character.  This ensures that the data file will be parseable regardless of the data that needs to be stored.




Units of measure


Sally's water meter recorded 350 gallons of water used.  John's recorded 200 cubic feet of water used.  Who used more water?  This is a question with a simple answer (John did).  But what if the units were not specified?  If all we know is that Sally used 350 and John used 200, we might decide that Sally used more, but only if we first assume that their meters record water using the same units.  Even if that assumption is correct, if we don't know the units, we won't be able to bill properly for the water or compare the quantity to an amount stored in other systems.


Quantitative values (i.e., measurements) should always have units specified.  When preparing a data file, you can provide information about units as a separate field.  For example:


Alternatively, units can be provided in documentation which accompanies the data.  One advantage of including units information inline in the data is that anyone with the data will automatically have units information, even if the documentation is not accessible.  Another benefit is that the units can vary from one record to another, as in the earlier example of two different people whose water meters recorded in different units.  However, in some cases it may not be practical to provide units inline, and good documentation can help fill this gap.


Keep clear and carry on


Data parsing errors are not unusual.  However, with a small investment they can be minimized.  By avoiding common data pitfalls and making the right choices at the outset, you will eliminate unnecessary troubleshooting and set yourself up for success.

Broken Meter Beater

Broken Meter Beater

By Steve Birndorf

So, I’ve been thinking about broken meters quite a bit lately (and, when I say “broken meter,” I’m referring to all sorts of different issues--under-registration, non-registration, decay, stuck meters, zero reads, etc.). Every day, as I talk to municipalities and water agencies around California and around the country, broken meters are a topic of universal importance and concern. Everyone’s got ‘em, and everyone is trying to get rid of ‘em. And, broken meters don’t just go away when you fix them...they are a recurring problem which occur year after year after year...


Broken meters, significantly impact water utilities. They leave revenue uncollected, they impact revenue stability, they make compliance difficult, they result in truck rolls, they impact conservation efforts. The list goes on.

Zero visibility: Issues in Water Use Data Resolution


In the beginning -- that is, before HD television -- there was standard definition television.  Back then, nobody complained much about the quality of the image.  In reality, the reason why people didn't make a fuss was that they didn't know what they were missing out on.  The same goes for the transition from cassette tapes to CDs and a host of other evolutionary enhancements in audio/visual quality over the years.  Ignorance is bliss.

Doing the Right Thing: Ending Water Cutoffs

By Janani Mohanakrishnan, PhD


“What keeps you up at night?” This was a question posed to George Hawkins (GM at DC Water), at a recent water conference. He promptly replied “Figuring out how to keep providing water to my growing population of low-income customers”. Later that week, a colleague mentioned her displeasure at having her water cutoff because of a system error. She had paid her active utility service deposit, had no history of nonpayment and was still cutoff without notice. Guilty until proven innocent!

Utility Data Management BMPs v1.0

Utility Data Management BMPs v1.0

Here in California, the mention of BMPs (Best Management Practices) to any water utility practitioner brings a look of frustration, and perhaps fear.  This may be due to the use of BMPs by the state to promote certain practices in water conservation, rate making, and more.  This may explain why while attending a water utility data conference at Stanford a few weeks ago, a wholesale water engineer proposed the idea of Water Utility Data BMPs, and this got a chuckle from the audience.

Mind The Data Gap

There is a lot of talk about Big Data these days, and if you are anywhere near Silicon Valley, it is more like a deafening roar. As important and difficult as Big Data is, we are also working to solve challenges of a different sort that gets relatively little attention: what we call Diverse Data. The key distinction between Big Data and Diverse Data is how structurally similar one piece of data is to another.