ramunas urbonas. the journey

Download Ramunas Urbonas. The Journey

Post on 10-May-2015

2.559 views

Category:

Software

1 download

Embed Size (px)

DESCRIPTION

#BigDataBY

TRANSCRIPT

  • 1.The JOURNEY Adform explores Hadoop

2. Ramunas Urbonas @ Adform 3. Developer first 4. Development as a journey 5. High perspective talk 6. 3 aspects 7. The JOURNEY Direction / Planning / Equipment 8. It starts with a goal 9. Vision 10. Born of need 11. Maintenance costs 12. Time to market 13. Licensing costs 14. Hadoop 15. main data storage alternative reporting 16. Attack your vision 17. why storage? 18. HDFS 19. Distributed 20. x 3 21. Auto-balancing 22. Can store big files 23. Resilient 24. 50% 3% 25. Files vs Database 26. Multiple engines on same data 27. that brings us to... 28. Alternative reporting 29. Rich eco-system 30. HDFS map-reduce hive pig hbase yarn & mr2 spark shark impala druid etc 31. Different purpose 32. Different SLAs 33. Emerging tools 34. Big community 35. Beta products 36. UI 37. Automation 38. Confident in vision 39. main data storage alternative reporting 40. Building vision vs Maintaining 41. When left unattended 42. Narrow focus 43. Keep it fresh 44. The JOURNEY Direction / Planning / Equipment 45. Travelling light 46. Climbing a mountain 47. Even harder for Adform 48. Linux courses 49. Java 50. Java backend administration 51. Memory management 52. Profiling 53. Garbage collection 54. Know Hadoop principles 55. More climbing ahead 56. Test everything 57. Consultants 58. Abstract 59. Technical calls 60. Time consuming 61. How > What 62. POC vs Production 63. The JOURNEY Direction / Planning / Equipment 64. Commodity hardware 65. Commodity hardware 66. No SSD / Raids 67. Desktop cluster? 68. Our cluster - leftovers 69. 6-7 years old 70. Still server machines 71. Electricity 72. Burning fuses 73. Outdated notion? 74. Tricky question 75. Best sport shoes? 76. Basketball? 77. Football / Jogging / Climbing 78. Common hardware 79. 8Gb vs 300Gb 80. Our bottlenecks 81. Common bottlenecks 82. The JOURNEY Continues... 83. Releasing products 84. Data imports 85. Growing team 86. Upgrading cluster 87. Impala / Shark 88. More business areas 89. Clear vision Plan your learning Careful hardware decissions Thanks!

View more >