Our website makes use of cookies like most of the websites. In order to deliver a personalised, responsive and improved experience, we remember and store information about how you use it. This is done using simple text files called cookies which sit on your computer. These cookies are completely safe and secure and will never contain any sensitive information. By clicking continue here, you give your consent to the use of cookies by our website.

Monday, 02 December 2013 12:45

Temetra scales to manage billions of data points with Basho’s Riak

Posted By  Marcus Austin

Irish-based utility meter management company, Temetra, had developed a wireless meter reading system, however due to the volume of critical data created by readings they were unable to get the most out of their system, without conceding significant data management and analysis costs on proprietary big data solutions. The answer was to look at open source big data cloud solutions, and after reviewing a range of solutions including Cassandra and Hadoop, Temetra chose Basho’s open source distributed database, Riak.

 operates in the UK, Ireland and Australia and offers a data collection infrastructure that provides homes and businesses in with intelligent metering for utility usage.  This means that instead of manually checking meters periodically throughout each year, Temetra works from a wireless network that automatically collects and analyses usage data.  This is done by simply driving past the meter whereas traditionally, meter readers had to visually copy the data index by hand.  This new method allows the company to better predict usage and deliver more accurate results and pricing – saving Temetra time and the customer money.

The wireless system can collect 300-400 reads per year for the average household, as opposed to the normal yearly rate of two reads.  As many as 35,000 reads per year are now collected by fixed networks for larger consumers such as hotels and hospitals. This approach has been fundamental to Temetra’s competitive differentiation; however, with such a high volume of data, Temetra faced the challenge of finding a simple, scalable solution to store and access its data easily.  “We needed a reliable solution that would allow us to support more and more meters on a fixed networks,” said Paul Barry, Temetra’s Managing Director. “Our relational SQL database just could not cope with the quickly rising levels of revenue critical data.”       

Billions of data points

Temetra has thousands of users and millions of meters that create billions of data points.  The massive influx of data that was being generated quickly became difficult to manage with the company’s legacy SQL database.  When considering how this structured database could be overhauled, Temetra conducted evaluations with Cassandra  and Hadoop  but ultimately chose Basho’s Riak due to its high availability, relatively self-maintaining and easy to deploy infrastructure. 

It is essential that the data collected from the meters is always available as it is relied on to determine correct billing for Temetra’s customers, a point stressed by Barry, “As a small company managing a lot of revenue critical data, it is really important for us to have a reliable and easily accessible database.  For example, during our development and testing phase, a Riak node went down for a day and it was only through monitoring that we spotted it. The ability to lose a node and not affect our service in any way is a huge advantage for us.”

The move from a relational database to a non-relational solution

The move from a relational database to the non-relational Riak was a big step for Temetra.  The shift required an adjustment to treat the database as a low maintenance, high performance, and high availability key value store. For Temetra, the biggest change was de-normalising the data or, in other words, allowing for several copies to be stored.  Riak provided the best performance by allowing the company to store data in different ways. For example, data comes in from meters as a single data point that needs to be loaded and turned into compute data. In Riak, Temetra is able to store the meter data in multiple ways, allowing it to come out pre-calculated in the quick and ready form of consumption data.  Once they were comfortable with Riak’s replication technology, Temetra was able to load its data from the legacy file store and use Riak as a limitless data store across its multiple sites.

The benefits of Riak for Temetra

As a growing company with 3.5 million meters currently collecting revenue critical data, Riak’s ability to easily support additional nodes is a key benefit for the company as it continues to scale up.  With Riak, Temetra can continue to expand without huge amounts of additional costs and hardware and is able to bring another server online within 20 minutes, allowing the business to prepare for big, new customers very quickly.  This flexibility reflects and underpins Temetra’s own fast growing innovative nature.

Another benefit is the pricing. Temetra’s competitors operate in SQL mode and are unable to scale as easily and quickly.  Working with Riak has allowed Temetra to break away from those limitations which is reflected in the pricing for customers, giving the company a significant competitive edge.   Additionally, Riak was very easy for Temetra to introduce.  As a small company, Temetra doesn’t want a large administration staff dedicated to looking after the IT infrastructure; therefore Riak’s relatively self-maintaining nature, alongside Basho’s expert support, was a definite advantage.

“Most of our competitors still operate in SQL mode,” noted Barry. “By working with a distributed database which, from a flexibility and resiliency perspective puts us more in line with the way Google or Twitter work, we can disrupt the way that data is stored traditionally to scale faster and easier.  This is reflected in our prices and our ability to rapidly introduce new functionality.  I think our customers definitely see that benefit.”

Leave a comment

Make sure you enter the (*) required information where indicated. HTML code is not allowed.

IBM skyscraper2

datazen side

Most Read Articles