How is fault tolerance handled in Spark streaming?

Spark Streaming components Data model All data is modeled as RDDs, built by design with lineage of deterministic operations, i.e. any re-computation always leads to the same result. Essentially the same process (however with a different mechanism) as in Hadoop's fault-tolerance for ...

10 coolest big data products of 2015

The big data technology market remains one of the fastest growing segments of the IT industry. In November, market research firm IDC said the market for big data-related infrastructure, software and services will grow at a compound annual growth rate ...

5 most in-demand skills for Big Data jobs

As the Big Data market grows, so does the demand for skilled workers - are your skills in-demand? The Big Data market is growing as businesses realise the important of making data driven decisions. The market is predicted to be worth ...

Could Microsoft Cosmos Challenge Hadoop?

A new Microsoft data crunching framework is set to launch on the company’s Azure cloud, according to a report from Redmond pundit Mary Jo Foley on ZDNet. Dubbed Cosmos, it’s a potential competitor to both Hadoop and eventually Google’s homegrown ...

Actian Brings Graph Analysis To Big Data

Actian announced that it's adding a graph-analysis engine to its big data portfolio, which already includes a SQL-on-Hadoop offering as well as several relational databases and data-integration software. Graph analysis is applied to uncover networked relationships among people, places, things, and ...