Our website makes use of cookies like most of the websites. In order to deliver a personalised, responsive and improved experience, we remember and store information about how you use it. This is done using simple text files called cookies which sit on your computer. These cookies are completely safe and secure and will never contain any sensitive information. By clicking continue here, you give your consent to the use of cookies by our website.

CCI

KPMG launches its new Insights Labs, a virtual R&D centre that will serve as a global innovation hub, designed to incubate and develop data-driven business solutions for KPMG member firms’ clients

Cloud computing, mobile technologies, and social media are the most disruptive technologies today, but these are not the fastest growing; A new survey reveals the next disruptive technologies for the next three to five years.

Friday, 16 May 2014 17:09

Hortonworks Acquires XA Secure

The acquisition of XA Secure should provide Hortonworks Data Platform customers with the industry’s broadest security capabilities for Enterprise Hadoop

IBM has unveiled a portfolio of software defined storage products designed for businesses looking to access and process any type of data, on any type of storage device, anywhere in the world.

 

Some of the World's leading technology firms including AT&T, Cisco, GE, IBM have joined forces to form the Industrial Internet Consortium to speed up take up of Big Data and the Internet of Things

Intel commits to accelerate and transform how enterprises use big data with a significant equity investment in Cloudera


Google have announced a plethora of new products and services to their Google Cloud Platform including bringing together their PaaS and IaaS platforms, Managed Virtual Machines for App Engine, real-time Big Data analytics with Google BigQuery, Google Cloud DNS and some heavy price cutting across the board.

 

A MarketsandMarkets study on the cloud based business analytics market shows the business analytics market is expected to triple over the next three to four years with fast growth expected from Eastern Europe.

 

Under a new partnership with MapR Technologies Jaspersoft’s business intelligence solution will be integrated with the MapR Distribution for Apache Hadoop either en-premise or through Amazon Web Services.

 

Microsoft will deliver its hybrid–cloud friendly version of its database software SQL Server 2014 and adds new updated Hadoop functionality aimed at big data users.

Tuesday, 18 March 2014 14:57

Putting business analytics in the Cloud

Nuno Godinho, Director of Cloud Services, Europe for Aditi Technologies discusses how cloud technologies can enable business analytics and big data.

Ever heard of data scientists?  Well the Harvard Business Review named it the sexiest job of the 21st Century and it is has quickly risen to prominence in a number of industries including retail, oil and gas, telecommunications and financial services.  So what has this got to do with cloud?  Should we all be packing up our RESTful APIs and retraining? Not at all.  Before looking at what the cloud has to offer the data scientist and IT departments that work with them, lets have a quick dash through history and give an explanation of the role.

Analysing data with computers has gone through a number of significant changes over the years, from looking at raw numbers by hand, to spreadsheets, Business Intelligence and, more recently, visualisations and complex real-time predictive analytics.  One thing that has largely been consistent throughout that period has been the data and analysis taking place on-premise.  For a long time this was down to technical reasons, but now that has been overcome with many vendors offering PaaS and SaaS versions of their tools and platforms, which means most of the barrier can be put down to the commercial sensitivity of data and it going outside the firewall.  Will the service be reliable, safe from hackers, and adequately protected with encryption etc?

Extracting deep meaning from your cloud data

In terms of the data scientists themselves, in truth this role has been around for a long time.  Essentially it boils down to extracting deep meaning from data.  However, the key to doing it is understanding the data itself – not just the results – the raw data, its sources, formats and relationships and then combining this with strategies to analyse the data, from descriptive and prescriptive to predictive perspectives.  The data scientist has to have a mind that combines analytic, business and IT skills.  Previously representatives from these departments would (read might) have worked to generate the required analysis normally leveraging some kind of data warehouse tool.

Traditional business intelligence, reviews and presents historic data, whether that is two-seconds or two-years old.  For years analysts have been taking those same datasets and using them to built prescriptive models that describe the relationships between the data elements and how the numbers interact together.  But the latest frontier is real-time predictive analytics: using those models to predict (for example) an action, value or preference.  Usually an event, such as an attempted credit card transaction, triggers a model to be run against the transaction details to determine the chances of whether it could be fraudulent, or to make recommendations for other products an online shopper might like.  In financial services trading floor systems make thousands of these predictions a second to assess stock movements.

Using raw cloud compute for big data analytics

So where can the cloud fit into all this, and should it? The answer is, the cloud can be of benefit throughout the process of collecting and getting data to the point that it can be used in predictive analytics.  Firstly, it can be an aggregation point.  If your data sources are sensors distributed across an oil field, or even mobile such as truck geo-location data, the cloud can be the point where all those resources are brought together into a single data source for further processing.

Raw compute power from the cloud can also be used to process the big data associated with predictive analytics.  Creating models can be an intensive task depending on the size of the data sets, if you don’t actually need to do this often, why make the capital investment when you can just buy the machine time?

The cloud can also be used to enrich your data sets, by providing additional data sources for your models.  There are hundreds if not thousands of sources that can enhance your data, whether you need traffic data, government information, or simply temperature data.  These sources are validated, reliable and can substantially improve the quality of your models, whilst reducing the costs.

Does your cloud infrastructure match your needs?

The cloud can of course be responsible for the predictive analysis itself and it is at this point more than any other that you have to consider how quickly you need the results and whether speed and reliability demand you have the infrastructure on-site.  For example if you are making thousands of transactions a second that rely on predictive analytics, and the internet connection to your cloud provider is lost – what happens?  You may be able to switch to a back-up line, but how long does it take and what is the impact?

Data Scientists and IT departments alike should not ignore the role that the cloud can play in any analytics scenario.  That is not to say that it right for all of them, but as we have explained above, there are a number of ways that cloud computing can play a role, it doesn’t have to be all or nothing.  It can enhance models, lower costs and give smaller companies access to intelligence that they would otherwise not be able to afford.  Basically in order to do these kinds of activities and analysis we require huge amounts of compute power and storage space. This is why the cloud is the perfect partner for big data.

So, to say ‘No’ outright is to deny yourself the possibility of improving or simplifying the way in which analytics is executed in your company.

About Nuno

Nuno Godinho @NunoGodinho is a Windows Azure MVP and Director of Cloud Services, Europe for Aditi Technologies.

He has been an MVP for the last six years, first as an MVP in ASP.NET and the last three years as a Windows Azure MVP.  His is also a speaker at some of Microsoft's key events such as TechEd North America, TechEd Europe, Tech Days Worldwide Online, TechDays Netherlands and at other community events such as GASP - Grupo de Arquitectura de Software Português, Windows Azure UK User Group, Azure BE UG and so on. He is a prolific blogger and community creator.

The term ‘Big Data’ is increasingly dismissed as simply the tech industry’s latest buzzword. But any organisation that naively ignores the business benefits of big data risks potentially missing out on both improving efficiency and adding to revenue streams. Richard Flanders investigates.

Page 4 of 4

IBM skyscraper2

datazen side

Most Read Articles