big data: a 2013 horizonwatching trend report
Post on 12-Sep-2014
6.647 views
DESCRIPTION
The slides provide an overview on the Big Data trend for HorizonWatching Community members. Summary information about the Big Data trend is provided along with many links to additional resources. The slides are meant to be read/studied and the links are there for you to continue your learning. You may want to view the slides in slideshow mode so you can easily follow the links. Other HorizonWatching Trend Reports are available here on Slideshare. Follow my blog at www.billchamberlin.com for more information on emerging trends and technologies. Note: This presentation represents my thoughts and ideas….not those of my employer. - Bill Chamberlin, My LinkedIn Profile: : www.linkedin.com/in/whchamb My Website: http://www.billchamberlin.comTRANSCRIPT
Contact: Bill Chamberlin, HorizonWatching Community Leader
January 17, 2013
Big Data A 2013 HorizonWatching Trend Report
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
About This Trend Report
Purpose: The slides provide an overview on the Analytics trend for HorizonWatching Community members
Content: Summary information about the Analytics trend is provided along with many links to additional resources. The slides are meant to be read/studied and the links are there for you to continue your learning. You may want to view the slides in slideshow mode so you can easily follow the links
Other HorizonWatching Trend Reports: Are announced/discussed on the HorizonWatching blog and slide decks are posted on the Horizonwatching channel on Slideshare
HorizonWatching Community: For more on the HorizonWatching community please see the appendix
2 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
Note: This presentation represents my thoughts and ideas….not those of my employer. - Bill Chamberlin, [email protected]
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
Big Data refers to how to collect, store, and manage information that comes into an enterprise so that it can be harvested for decision making
3 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
“Big data is a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications. The challenges include capture, curation, storage, search, sharing, analysis, and visualization.” – Wikipedia (Big Data)
“Every day, we create 2.5 quintillion bytes of data — so much that 90% of the data in the world today has been created in the last two years alone. This data comes from everywhere: sensors used to gather climate information, posts to social media sites, digital pictures and videos, purchase transaction records, and cell phone GPS signals to name a few. This data is big data.” – IBM (Big Data)
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
Trends in Big Data for 2013
1. Definition Does Not Matter: The focus turns towards implementation and value
2. Cost as a Big Data Benefit: Case studies demonstrate ROI of Big Data. It is leaner, significantly reduces data integration costs, and opens the door for data exploration
3. Analytics and Visualizaton: For those implementing Big Data, there will be an increased interest in Analytics and Visualization capablities.
4. Data Scientists: There will be a rush to hire skilled Big Data Scientists, often via services like Kaggle, who are specialist in designing how a firm collects, stores, and manages big data.
5. Increased Competition: IBM, EMC, SAP, SAS, and Oracle all increase competitive efforts, leading to better solutions and services
6. Big Data as a Service: Service Providers emerge to handle the whole stack.
7. Data Protection: CIOs implement automated systems to handle all replication, deduplication, backup, and restoration.
8. Followers Left in Dust: Organizations that do not implement Big Data solutions risk loosing their competitive edge.
9. CMOs overwhelmed: CMOs are not prepared to handle all the big data. In 2013 marketing needs to learn to work better with IT
10. Education and Training: Big Data Services firms will offer extensive training and certification programs to try to help fill the shortages of skilled Data Scientists.
4 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
Like the Cloud term in 2008-9, everyone is trying to define exactly what Big Data is….
5 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
“Big data in general is defined as high volume, velocity and variety information assets that demand cost-effective, innovative forms of information processing for enhanced insight and decision making.” – Gartner (link)
“Big data is the frontier of a firm’s ability to store, process, and access (SPA) all of the data it needs to operate effectively, make decisions, reduce risks, and create better customer experiences.” – Forrester Research (link)
“IDC defines Big Data technologies as a new generation of technologies and architectures designed to extract value economically from very large volumes of a wide variety of data by enabling high-velocity capture, discovery, and/or analysis.” – IDC (Big Data)
What is Big Data? Part 1 – IBM Video
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
Big Data – Trend Drivers, Challenges, and Implications
6 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
Drivers • Volume, variety, velocity, and complexity of incoming data streams• Growth of “Internet of Things” results in explosion of new data • Low cost Storage ….so why not store it?• Non-traditional and unstructured data • Desire to integrate all the data into a single source
Challenges• Different sources of data (enterprise apps, web, search, video,
mobile, social conversations and sensors) • Traditional relational databases / data warehouses not designed
for new types of data• Unstructured or semi-structured text is difficult to query. • Culture, skills, and business processes
Implications• Emerging capabilities to store and process vast quantities of
structured and unstructured data are bringing about changes in technology and business landscapes
• Big data is driving need for advanced analytics and visualization capabilities to help organizations glean the insights and make decisions
“Most organizations are ill prepared to address both the technical and management challenges posed by big data; as a direct result, few will be able to effectively exploit this trend for competitive advantage.” – Gartner (link)
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
There’s a lot of growth associated with the Big Data Trend
7 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
“The "digital universe" will grow to 2.7ZB in 2012, up 48% from 2011 and rocketing toward nearly 8ZB by 2015.” – IDC (link)
Growth in Data
“Worldwide information volume is growing annually at a minimum rate of 59 percent annually.” – Gartner (link)
"By 2015, 4.4 million IT jobs globally will be created to support big data.“ – Gartner (link)
"IDC expects the Big Data technology and services market to grow at a 39.4% compound annual growth rate through 2015.“ – IDC (link)
Growth in Spending
Growth in Jobs
Peter Sondergaard, Gartner, Says Big Data Creates Big Jobs – A Gartner Video
"IDC expects the Big Data technology and services market to grow from $3.2 billion in 2010 to $16.9 billion in 2015. “ – IDC (link)
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
The Big Data trend presents a huge challenge (and opportunity) for Information Management professionals
8 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
“The volume, velocity and variety of data that is relevant to mainstream enterprise IT has grown to the point that it has pushed many applications to the limits of their capacity. Old application architecture principles can no longer satisfy the new business requirements”. – Gartner (link)
“Clearly, the big data revolution is fostering a powerful new type of data science. Having more comprehensive data sets at our disposal will enable more fine-grained long-tail analysis, microsegmentation, next best action, customer experience optimization, and digital marketing applications” – Forrester (link)
A New Era of Information Management Getting Value from Big Data Gartner Webinar (registration required)
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
Big Data – Selected Analyst Websites and Resources
9 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
• Forrester: Big Data and Big Data Blog Posts
• Frost & Sullivan: Search for Big Data
• Gartner: Big Data Research and Big Data Blog Posts
• IDC: Big Data Research and Big Data Blog Posts
Excerpt: Worldwide Big Data Technology and Services 2012–2015 Forecast – IDC (link)
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
Big Data – Selected Media Websites and Resources
10 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
• Businessweek: Search for Big Data, Big Data
• CIO.com: Search for Big Data
• ComputerWorld: Big Data
• Economist: Search for Big Data
• eWeek: Search for Big Data
• Forbes: Data Driven
• Harvard Business Review: Big Data
• InformationWeek: Big Data
• InfoWorld: Big Data Channel and Big Data Blog posts
• MIT Sloan Management Review: Data & Analytics
• NY Times: Big Data
2012 Big Data Research Report, by IDG Enterprise
32 Big Data Trends and Predictions Lists for 2013 - HorizonWatching
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
Big Data – Selected IT Vendor / Consultant Websites and Resources
11 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
• Accenture: Big Data and Technology & Information Management
• Booz Allen: Big Data
• Deloitte: Analytics
• EMC: Big Data, Big Data 2020
• HP: Information Optimization Solutions
• IBM: Big Data Resource List
• Infosys: Search for Big Data
• Intel: Big Data
• Microsoft: Big Data
• NewVantage Partners: Big Data Survey
• Oracle: Big Data
• SAP: Enterprise Information Management
• SAS: Information Management
• Tata Consultancy Services: Big Data
• Wipro: Information ManagementIBM Big Data Portal
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
Big Data – Selected Social Media Sites and Searches
12 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
• Google Blog Search: Big Data
• Technorati Blog Search: Big Data
• Facebook Search: Big Data
• Google+ Communities Search: Big Data
• LinkedIn Group Search: Big Data
• Pinterest Search: Big Data
• Slideshare search: Big Data
• Twitter hashtag searches: #bigdata
• Tumblr Search: Big Data
• YouTube: Big Data Playlists and Big Data Channels
• Wikipedia: Big Data
Pinterest Search: Big Data
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
Big Data – Selected IBM Resources and Links
13 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
ibm.com links• Big Data Hub: The Big Data Hub• Big Data Portal: Bringing Big Data To The Enterprise• IBM Software: Data Management,
Data Warehousing, Enterprise Content Management,• DeveloperWorks: Big Data Portal • IBM Systems: Big Data• IBM Education: Big Data Education• Events: Big Data, Integration & Governance
Social Media• Blog: Big Data Hub Blog• Twitter: @IBMbigdata and Twitter Hashtag: #bigdata• Facebook: IBM-Big-Data• LinkedIn: IBM big data • YouTube: IBM Big Data• Google+: IBM big data• DeveloperWorks:
Information Management Community
IBM: The Big Data Hub
IBM Big Data Resources
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
Big Data – Selected Other Selected Reports and Resources
14 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013
• 7 Things You Need to Do About Big Data in 2013, by Brett Sheppard, Senior Product Marketing Manager, Tableau Software, published December 2012, 6 pages
• Big Data Survey, A research report by GigaSpaces, published December 2012, 5 pages
• Big Data Executive Survey – Themes & Trends, a research report by New Vantage Partners, published December 2012, 12 pages
• The insight economy: Big data matters — except when it doesn’t, a white paper report by Deloitte Consulting, published October 2012, 24 pages
• What is Big Data? Part 1 and What is Big Data? Part 2 videos featuring Paul Zikopoulos of IBM, posted on IBM’s Big Data channel on YouTube, posted March 2012
• Strategic Implications of the Big Data Era, an MIT / Sloan Management Review Webcast featuring Andrew McAfee, posted May 2012 (note: video loads slowly)
• Living with Big Data: Challenges and Opportunities, a presentation deck by Jeff Dean and Sanjay Ghemawat of Google, published September 2012, 132 slides
• Big Data is the Future of Healthcare, a white paper report by Cognizant, published September 2012, 7 pages
• Big Data for Education: Data Mining, Data Analytics, and Web Dashboards, by Darrell West director of the Center for Technology Innovation at Brookings. published August 2012, 11 pages
• The 3 I's Of Big Data, an article appearing in Forbes, written by Dave Feinleib, posted on July 9, 2012
© 2013 HorizonWatchingCreative Commons Attribution License
HorizonWatching Community
Appendix: About The HorizonWatching Community
Launched 2006: About HorizonWatching
Blog: Horizonwatching – Thought Leadership Blog
Tumblr Quote Blog = HorizonWatching
Twitter = HorizonWatching
Slideshare = HorizonWatching (an external version of this deck will be posted here)
Facebook = HorizonWatching
LinkedIn Community = HorizonWatching
15 Big Data: A 2013 HorizonWatching Trend ReportJanuary 17, 2013