5 things you need to know about Hadoop Vs Apache Spark
Listen in on any conversation about big data, and you'll probably hear mention of Hadoop or Apache Spark. Here's a brief look at what they do and how they compare.
1: They do different things. Hadoop and Apache Spark are both ...
How is fault tolerance handled in Spark streaming?
Spark Streaming components
Data model
All data is modeled as RDDs, built by design with lineage of deterministic operations, i.e. any re-computation always leads to the same result. Essentially the same process (however with a different mechanism) as in Hadoop's fault-tolerance for ...
5 Reasons to Choose Parquet for Spark SQL
It is well-known that columnar storage saves both time and space when it comes to big data processing. Parquet, for example, is shown to boost Spark SQL performance by 10X on average compared to using text, thanks to low-level reader ...
5 most in-demand skills for Big Data jobs
As the Big Data market grows, so does the demand for skilled workers - are your skills in-demand?
The Big Data market is growing as businesses realise the important of making data driven decisions. The market is predicted to be worth ...
Could Microsoft Cosmos Challenge Hadoop?
A new Microsoft data crunching framework is set to launch on the company’s Azure cloud, according to a report from Redmond pundit Mary Jo Foley on ZDNet. Dubbed Cosmos, it’s a potential competitor to both Hadoop and eventually Google’s homegrown ...
Actian Brings Graph Analysis To Big Data
Actian announced that it's adding a graph-analysis engine to its big data portfolio, which already includes a SQL-on-Hadoop offering as well as several relational databases and data-integration software.
Graph analysis is applied to uncover networked relationships among people, places, things, and ...