A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

As a poster child for big data, Hadoop is continually brought out as the reference architecture for big data analytics. But what exactly is Hadoop and what are the key points of Hadoop storage ...

What are some of the cool things in the 2.0 release of Hadoop? To start, how about a revamped MapReduce? And what would you think of a high availability (HA) implementation of the Hadoop Distributed ...

Apache Hadoop has been the driving force behind the growth of the big data industry. You'll hear it mentioned often, along with associated technologies such as Hive and Pig. But what does it do, and ...

In a world where new technologies are often presented to the industry as rainbows and unicorns, there is always someone in a cubicle trying to figure out how to solve business problems and just make ...

HDFS (Hadoop Distributed File System) is a distributed user level file system which stores, processes, retrieves and manages data in a Hadoop cluster. HDFS infrastructure that Hadoop provides, include ...

As my colleague Toby Wolpe wrote about earlier today, Gartner released a survey of its Research Circle members today showing that corporate adoption of Hadoop hasn't kept up with the hype. First of ...

LinkedIn today released an open source project called Dynamometer to help businesses stress-test large-scale Hadoop big data processing systems without using a massive amount of infrastructure. The ...

Quantcast, an internet audience measurement and ad targeting service, processes over 20 petabytes of data per day using Apache Hadoop and its own custom file system called Quantcast File System (QFS).

Did you know that 90% of the world’s data has been created in the last two years alone? With such an overwhelming influx of information, businesses are constantly seeking efficient ways to manage and ...