strata + hadoop world 2014 レポート #cwt2014

37
Strata + Hadoop World 2014 レポート Cloudera 嶋内 翔

Upload: cloudera-japan

Post on 19-Jun-2015

1.043 views

Category:

Technology


0 download

DESCRIPTION

Cloudera World Tokyo 2014 で発表した、 Strata + Hadoop World 2014 のレポートです。Cloudera 会長 Mike Olson のキーノートや、保険会社の事例、ソーシャルグラフ作成、ETLの課題、HBase のアーキテクチャなどについて紹介しています。

TRANSCRIPT

  • 1. Strata + Hadoop World2014 Cloudera

2. 20114Cloudera Cloudera email: [email protected] twitter: @shiumachi 2014 Cloudera, Inc. All rights reserved. 2 3. 2014 Cloudera and/or its affiliates. All rights reserved. 3 4. 2014 Cloudera, Inc. All rights reserved. 4 5. 2014 Cloudera and/or its affiliates. All rights reserved. 5 6. 2014 Cloudera and/or its affiliates. All rights reserved. 6 7. Strata + Hadoop World () Hadoop 2014 Cloudera, Inc. All rights reserved. 7 8. 2014 Cloudera, Inc. All rights reserved. 8Strata + Hadoop World 2014 Hadoop World 6 201410151017 5500 1(2009)400 9. 2014 Cloudera, Inc. All rights reserved. 9 10. 2014 Cloudera, Inc. All rights reserved. 10 11. 2014 Cloudera, Inc. All rights reserved. 11 12. 2014 Cloudera, Inc. All rights reserved. 12: Mike Olson (Cloudera) Hadoop World C5.2 13. Strata + Hadoop World : Hadoop (geeky project)PigHiveSqoop Hadoop Hadoop 2013: (EDH) EDH 2014 Cloudera, Inc. All rights reserved. 13 14. Hadoop Hadoop (dissapear) TeradataOracle HadoopMike Olson Strata + Hadoop World We should all together build it! CWT 2014 Cloudera, Inc. All rights reserved. 14 15. Spark () 2014 Cloudera, Inc. All rights reserved. 15 16. : Transamerica Life and Protection Transamerica Life and Protection: 360 2014 Cloudera, Inc. All rights reserved. 16 17. 2014 Cloudera, Inc. All rights reserved. 17http://strataconf.com/stratany2014/public/schedule/detail/36763 18. 2014 Cloudera, Inc. All rights reserved. 18 : Cloudera HBase Cloudera Navigator ETL: Informatica Big Data Edition BI: Datameer 19. 2014 Cloudera, Inc. All rights reserved. 19 Cloudera 2Informatica Informatica / Transamerica 2Informatica / Transamerica 4PMMLDatameer / Transamerica 2SAS Transamerica 1 -- 1 20. 2014 Cloudera, Inc. All rights reserved. 20 () IT(6) (3) 21. : LinkedIn LinkedIn(Economic Graph) http://www.slideshare.net/VitalyGordon/computing-professional-identity-for-the-economic- 2014 Cloudera, Inc. All rights reserved. 21graph 22. 2014 Cloudera, Inc. All rights reserved. 22Identity Standardization OR : Helpdesk OR Technical Support OR : ( Architect ) 23. 2014 Cloudera, Inc. All rights reserved. 23 Hadoop 24. tf-idf 2014 Cloudera, Inc. All rights reserved. 24 25. Tamr TamrTamr (ETL) 2014 Cloudera, Inc. All rights reserved. 25 26. CEOIT COBOL : 2014 Cloudera, Inc. All rights reserved. 26 27. :DWHETL 90DWH (ETL) 2323 () 2014 Cloudera, Inc. All rights reserved. 27 28. ETL () 2014 Cloudera, Inc. All rights reserved. 28 29. Tamr: 2014 Cloudera, Inc. All rights reserved. 29 30. 2014 Cloudera, Inc. All rights reserved. 30Apache HBase Application Archetypes HBase HBaseCon HBaseCon :http://www.slideshare.net/HBaseCon/case-studies-session-7 31. HBase : : 2014 Cloudera, Inc. All rights reserved. 31 32. Short scanHBase Replication HBase Replication 2014 Cloudera, Inc. All rights reserved. 32How does data get in and out of HBase?Put, Incr, AppendHBase ClientGetsHBase ClientFull Scan, MapReduceHBase ScannerBulk ImportHBase Clienthttp://www.slideshare.net/HBaseCon/case-studies-session-7/15 33. HBase BLOB 2014 Cloudera, Inc. All rights reserved. 33 3MB (10MB) RDBMS DB 34. 2014 Cloudera and/or its affiliates. All rights reserved. 34 35. Hadoop Hadoop 2014 Cloudera, Inc. All rights reserved. 35 Meetup 36. () Hadoop Hadoop Hadoop Cloudera 2014 Cloudera, Inc. All rights reserved. 36 37. Strata+Hadoop World