Sparking change: How analytics is helping global communities improve water security


Sparking change: How analytics is helping global communities improve water security
  1. Sparking change: How analytics is helping global communities improve water security
    ibmbigdatahub.com
    Most of us are privileged enough to live in societies where clean water is a given. When our physicians and the media advise us to stay hydrated, it’s a simple health consideration. But in many countries, access to water is a huge issue – approximately one third of the world’s population does not have access to safe drinking water…
    Technology

Most of us are privileged enough to live in societies where clean water is a given. When our physicians and the media advise us to stay hydrated, it’s a simple health consideration. But in many countries, access to water is a huge issue – approximately one third of the world’s population does not have access to safe drinking water.

According to the World Health Organization, 1.8 billion people lack access to safe water, 2.4 billion live without adequate sanitation, and 842,000 die each year from conditions related to inadequate water supplies – that’s over 2,000 people every day.

http://www.ibmbigdatahub.com/sites/default/files/watermission_embed.jpgThankfully, organizations like Water Mission are working to give thousands of communities the help they need to build and maintain safe, sustainable water supplies for themselves. Water Mission provides water treatment and chlorination equipment, water pumps and distribution points, and even solar panels and card payment systems. They are also expanding their operations to use technologies like Apache Spark, sensors and data to help them manage the challenges they face in helping remote communities.

Water Mission’s work involves social change and incenting new behaviors, which is a tricky endeavor. Water Mission needs a good understanding not only of the systems it installs, but also – and more importantly – of the behaviors of the people who use it.

To this end, the organization uses a system called PUMP to manage a huge amount of detailed information about each of its projects. The data is captured from technicians’ reports, financial transactions, and even IoT sensors embedded in the pumps and water dispensers themselves which transmit data by satellite connection. Much of this data exists in unstructured or semi-structured formats, such as PDFs.

Until recently, Water Mission was struggling to find the best way to turn this data into actionable insight. The organization turned to IBM® jStart®, who are technical champions of emerging technologies, and who work with IBM clients and others to drive rapid business transformation.

I presented the jStart Water Mission story at Strata Hadoop San Jose 2017, and this blog is about what I learned in preparation to tell their story. 

Their first step wasn’t necessarily to find answers – it was to decide which questions to ask. This is a critical starting-point for any analytics initiative, and it’s particularly challenging when your data is as complex and multi-faceted as Water Mission’s. To help explore these varied, semi-structured datasets and identify the most fruitful areas for further investigation, the jStart team recommended using a combination of IBM Analytics for Apache Spark and Jupyter Notebooks.

http://www.ibmbigdatahub.com/sites/default/files/fig_2_ab.png

By providing an ability to process large volumes of data almost instantaneously, and perform rapid exploratory analysis, Spark allows Water Mission and jStart to dive into even the largest and most complex datasets in the PUMP system. Spark’s distributed computing model empowered the jStart team to load the PUMP data into the cloud and divide it across as many computational nodes as necessary to transform, parse and analyze it quickly.

Meanwhile, Jupyter Notebooks gave the data scientists on the team a powerful interface that they used to code sophisticated Spark jobs, test hypotheses, visualize the results, and share them with decision-makers in a way that is easy to understand and act upon.

On that point, at Strata Hadoop I saw a quote in the expo hall that O’Reilly Media had picked out from Mike Barlow’s book, The Changing Role of the CIO. He wrote: “Things get done only if the data we gather can inform and inspire those in a position to make a difference.”

That’s a lesson that Water Mission has really taken to heart. The results of its analytics projects are not confined to data scientists – they’re used by everyone from the program evaluation team up to the President and COO.

One good example is an analysis that revealed an unsuspected relationship between water usage and the way people were paying for their water – using prepaid cards that need to be scanned to activate the water dispenser.

The use of Spark and Jupyter Notebooks had uncovered a puzzling pattern in several communities. Although individual customers’ water consumption tended to gradually increase over time, the community’s overall usage of the water system was declining. This was a problematic trend, because to remain sustainable, each system needs to generate enough revenue to pay for its own maintenance.

According to Program Evaluation Coordinator Kristen Check: “When we analyzed the data, we realized that some of the prepaid water cards – often with several dollars of credit remaining on them – were no longer being used.”

Having just a few dollars on a water card is very significant because water refills cost just one to three pennies each. A few dollars of credit could supply a family’s water n…

  1. T-Mobile will cover your iPhone if you bring it from Verizon - CNET

    CNET - News
    05.24 / 13:32 cnet.com
    The limited promotional offer will give you a payment in the form of a digital prepaid…
  2. My first lightsaber combat lesson as a new Padawan - CNET

    CNET - News
    05.24 / 13:32 cnet.com
    As Star Wars turns 40, CNET's Christine Cain decides it's time to apply her martial arts training to Jedi academy. Will her lightsaber…
  3. Serena Williams accepts a new challenge - in Silicon Valley

    SFgate.com-Tech
    05.24 / 13:32 sfgate.com
    SAN FRANCISCO (AP) — Tennis star Serena Williams has 39 Grand Slam titles, four Olympic medals, major endorsement deals and her own line of clothing and accessories. Williams didn't offer specifics about her goals as a corporate director, implying that her very presence can help push the company — and, by extension, the industry as a whole — in a more diverse direction. Silicon Valley's lack of diversity has become a recurring source of embarrassment in a region that has long sought to po…
  4. Serena Williams accepts a new challenge - in Silicon Valley

    WashingtonTimes-Technology
    05.24 / 13:31 washingtontimes.com
    SAN FRANCISCO (AP) - Tennis star Serena Williams has 39 Grand Slam titles, four Olympic medals, major endorsement deals and her own line of clothing and accessories. Now she is embarking on a new mission: She says wants to help tech companies diversify their workforces and solve one of the…
  5. Technology elevates new theme park experiences in Orlando

    WashingtonTimes-Technology
    05.24 / 13:31 washingtontimes.com
    ORLANDO, Fla. (AP) - Florida's theme parks are taking advantage of new simulated technology with attractions they are introducing this year. But as good as they all are, the Flight of Passage ride at Disney World's new Pandora-World of Avatar does the best job by far. It's designed to make…
  6. Serena Williams accepts a new challenge - in Silicon Valley

    KansasCityStar-Tech
    05.24 / 13:30 kansascity.com
    Tennis star Serena Williams has 39 Grand Slam titles, four Olympic medals, major endorsement deals and her own line of clothing and accessories. Now she is embarking on a new … Click to Continue…
  7. Technology elevates new theme park experiences in Orlando

    KansasCityStar-Tech
    05.24 / 13:30 kansascity.com
    For more than a moment, you feel the way "Avatar" hero Jake Sully felt plunging down the side of a floating mountain and coming just close enough to a giant … Click to Continue…
  8. Sleep Safe On Cloud 9 With OpusDivine Hypoallergenic Waterproof Mattress Protector

    Thefirstdispatch.com - Technology
    05.24 / 13:26 thefirstdispatch.com
    OpusDivine assures a peaceful and healthy good night sleep with its state of the art Hypoallergenic Waterproof Vinyl Free Mattress Protector that comes with a 10 year warranty. New…
  9. Marine Propulsion Engine Market to exceed $13bn by 2024

    Thefirstdispatch.com - Technology
    05.24 / 13:26 thefirstdispatch.com
    “Key industry players contributing to marine propulsion engine market share include MAN Diesel & Turbo, Wärtsilä, Mitsubishi and Caterpillar. “ “Marine Propulsion Engine Market Size By Product (Diesel, Wind &…
  10. Secure VPN Services With Lifetime Subscription (Save up to 95%) - Limited Time Deal

    Thehackernews.com - Technology
    05.24 / 13:25 thehackernews.com
    PRIVACY – a bit of an Internet buzzword nowadays, because the business model of the Internet has now shifted towards data collection. Today, most users surf the web unaware of the fact that websites and online services collect their personal information, including search histories, location, and buying habits and make millions by sharing your data with advertisers and marketers. If this i…
  11. Накопительные пакеты обновлений для System Center 2012 R2 и System Center 2016

    Blogs.technet.com - Technology
    05.24 / 13:24 blogs.technet.com
    Компания Microsoft в рамках сопровождения семейства продуктов System Center выпустила очередные пакеты накопительных исправлений. KB4020917 Тринадцатый накопительный пакет обновлений для System Center 2012 R2 (Update Rollup 12 for System Center 2012 R2) содержит исправление для Data Protection Manager, Operations Manager и Virtual Machine Manager. . KB4020906 Третий накопительный пакет для System Center 2016 (Update Rollup 3 for System Center 2016) …
  12. Excerpt from Analytics: The Agile Way

    Philsimon.com - Technology
    05.24 / 13:24 philsimon.com
    Read the Preface and Introduction from my new book. The post Excerpt from Analytics: The Agile Way appeared first on Phil…
  13. Graham Hancock Apologizes for His Temper But Still Sees Everyone As Out to Get Him

    Jasoncolavito.com - Technology
    05.24 / 13:23 jasoncolavito.com
    ​Last week, Graham Hancock and Michael Shermer debated the existence of a lost Ice Age civilization on the Joe Rogan Experience, and as I noted at the time, it did not make either man look good. Shermer was at times unprepared and often uninspiring, while Hancock was emotional instead of logical and far too quick to anger over every moment of disagreement. Similar anger issues emerged when Hancock attacked skeptic Marc Defant, the author of a harsh forthcoming review of Hancock’s Magicians …
  14. Amazon's One-Day Logitech Sale Is Perfect For Gamers and Office Dwellers Alike

    Toyland.gizmodo.com - Technology
    05.24 / 13:22 toyland.gizmodo.com
    Amazon’s back at it again with a ton of great deals on Logitech PC peripherals, today only.Read m…
  15. Lecture at Los Alamos in 1992: 'The End of the Soviet Union is the End of Who We Thought We Were'

    Toyland.gizmodo.com - Technology
    05.24 / 13:22 toyland.gizmodo.com
    “Do not buy maps, buy stock in companies that print maps,” Dr. Paul Goble told a group at Los Alamos National Laboratory in November of 1992.Read mor…
  16. The Next X-Men Movie Could Take the Franchise to Space

    Toyland.gizmodo.com - Technology
    05.24 / 13:22 toyland.gizmodo.com
    John Boyega discusses Finn’s new place in the Resistance in The Last Jedi. The stars of Game of Thrones say there’ll be a quicker pace to the next season. Plus, early rumors for the next Justice League Dark director, and new Wonder Woman posters. To me, my Spoilers!Read mor…
  17. The Most Mysterious TRAPPIST-1 Planet Finally Reveals Some Secrets

    Toyland.gizmodo.com - Technology
    05.24 / 13:22 toyland.gizmodo.com
    Now that TRAPPIST-1 is the trendiest star system in the galaxy, astronomers and nerds alike are clamoring to learn more about it. We know that the seven-planet system contains three planets in the habitable zone, which means they could hypothetically support liquid water, and even life. We also know that the…Read m…
  18. The Moment That Inspired A Global Movement To Destroy Workplace Burnout [VIDEO]

    Digitalistmag.com - Technology
    05.24 / 13:21 digitalistmag.com
    As workplace burnout reaches epidemic proportions, more companies are starting to actively address the problem as they realize its effect on the bottom…
  19. New STORServer offering delivers FedRAMP, FIPS-compliant cloud backup for government agencies

    Wwpi.com - Technology
    05.24 / 13:21 wwpi.com
    STORServer, enterprise data backup solutions company, announced Tuesday that it is now offering FIPS-compliant cloud backup for the government market. This cloud backup solution also meets security controls for FedRAMP. With IBM Spectrum Protect, formerly known as Tivoli Storage Manager or TSM, government agencies can now simply and securely embrace the advantages of the cloud for their data backup needs. With STORServer’s cloud backup, government agencies can eliminate their reliance on [&…
  20. IBM boosts open database-as-a-service on Power Systems to deliver integration and support

    Wwpi.com - Technology
    05.24 / 13:21 wwpi.com
    IBM announced Wednesday a new Database-as-a-Service (DBaaS) toolkit on Power Systems optimized for open source databases, including MongoDB, EDB PostgreSQL, MySQL, MariaDB, Redis, Neo4j, and Apache Cassandra to help deliver more speed, control, and efficiency for enterprise developers and IT departments. The new turnkey open source DBaaS toolkit available, called Open Platform for DBaaS on IBM Power Systems, runs on IBM’s OpenPOWER LC servers designed specifically for big data and de…