silikonjazz.blogg.se - Sql transaction processing system case study mckinsey 2015

#Sql transaction processing system case study mckinsey 2015 how to#

Business drivers – High-value projects that require use of more data Gartner predicts 800% data growth – Belief that there is great ROI in mastering big data over next 5 years.The Future of Big Data © Hortonworks Inc. What drives Hadoop adoption? Architecting.Yahoo! embraced Apache Hadoop, an open source platform, to crunch epic amounts of data using an army of dirt-cheap servers 2006 Hadoop at Yahoo! 40K+ Servers 170PB Storage 5M+ Monthly Jobs 1000+ Active Users 2011 Yahoo! spun off 22+ engineers into Hortonworks, a company focused on advancing open source Apache Hadoop for the broader market © Hortonworks Inc. 2011Ĭases data analyzing web logs analytics advertising optimization machine learning mail anti-spam text mining web search content optimization customer trend analysis ad selection video & audio processing data mining user interest prediction social media © Hortonworks Inc.

System Management Pig Hive (Data Flow) (SQL) (Columnar NoSQL Store) HBase MapReduce Zookeeper (Coordination) (Distributed Programing Framework) HCatalog (Table & Schema Management) HDFS (Hadoop Distributed File System) © Hortonworks Inc.

2011Ĭomponents of “Standard Hadoop” Open Source Stack Core Apache Hadoop Related Hadoop Projects Open APIs for:

Key attributes: – Redundant and reliable (no data loss) One of the best examples of – Extremely powerful open source driving innovation – Batch processing centric and creating a market – Easy to program distributed apps – Runs on commodity hardware © Hortonworks Inc.

Transforms commodity hardware into a service that: – Stores petabytes of data reliably – Allows huge distributed computations.

Solution for big data – Deals with complexities of high volume, velocity & variety of data

#Sql transaction processing system case study mckinsey 2015 how to#

2011īy 2015, more than half the world's data will be processed by Apache Hadoop How to achieve that vision? Enable ecosystem around enterprise-viable platform.

Observed Trends Architecting the Future of Big Data © Hortonworks Inc.Hadoop Eric Baldeschwieler CEO Hortonworks Twitter: January 2012 © Hortonworks Inc.