big data from idea to service provider from a consulting perspective - a quickstart

Big Dataa Quickstart

Big Data from idea to service provider from a Consulting perspective Edzo BotjesBusiness Analyst BT Consultant @ Sogeti Consulting Services

Vianen 2014 05 13

3

Titel | Onderwerp | Plaats | Datum |

DATA is the NEW OIL

4Big Data a Start | Sogeti Road | Vianen | 2014 05 13 |

Context of the oilS = SocialM = MobileA = AnalyticsC = CloudT = Thing

Network Organization(Management 3.0)

Technology Trends

https://www.flickr.com/photos/jurgenappelo/5201353461/ http://www.es.sogeti.com/PageFiles/88/Presentacion-corporativa-Grupo-Sogeti.pdf http://de.wikipedia.org/wiki/Social_Mobile_Analytics_Cloud

Testing and Quality AssuranceBusiness Information ManagementInfrastructure TransformationMobilitySecurity

Sogeti Focus

5Big Data a Start | Sogeti Road | Vianen | 2014 05 13 |

Context


Technology Trends

https://www.flickr.com/photos/jurgenappelo/5201353461/

Data Age

+

+

Context of

Big DataAt

Your Client

=

6Big Data a Start | People Consulted | Vianen | 2014 05 13 |

People Consulted (1/2)

Big Data expertsIT

Data ExpertsBusiness

InformationArchitects

Big Data expertsBusiness

Data Experts Information

Management

ArchitectsBusiness

Big Data expertsVINT

Big Data expertR20

Desk Research

7Big Data a Start | People Consulted | Vianen | 2013 05 13 |

People Consulted (2/2)

Big Data expertsIT

Data ExpertsBusiness

InformationArchitects

Big Data expertsBusiness

Data Experts Information

Management

ArchitectsBusiness

Big Data expertsVINT

Big Data expertR20 Desk Research

The INTERNET &

Meetups! :)

8Big Data a Start | Content | Vianen | 2013 05 13 |

What are questions fromthe management

Content

What is Big Data (meaning, definition examples)

Big Data at your client

9Big Data a Start | What are the MT questions | Vianen | 2013 05 13 |

What are the MT questions

• Question 1 - What is Big Data?

• Question 2 - Big Data in current organization?

• Question 3 - What should we do to offer added value to the company?

10Big Data a Start | What is Big Data? | Vianen | 2013 05 13 |

What is Big Data ?




11Big Data a Start | What is Big Data | Vianen | 2013 05 13 |

Why Big Data is a MT subject (2013,2014)

Source: http://www.myforrester.net/big-data-webinar ; http://www.airlineleader.com/pdfs/Airline%20Leader%20Issue%2014.pdf


Big Data is a MT subject in 2013

Source: https://www.bmelv.de/SharedDocs/Downloads/Verbraucherschutz/Internet-Telekommunikation/SaferInternetDay2013Ksker.pdf?__blob=publicationFile page 14“Big Data, was ist das?", Dr. Holger Kisker, VP and Research Director Forrester. February 2013


Classic BI Subjectdata VS information

(Big) Data


From data to wisdom (a BI Story)

Source: http://blog.vint.sogeti.com/wp-content/uploads/2012/07/VINT-Sogeti-on-Big-Data-1-of-4-Creating-Clarity.pdf page 6"Creating clarity with Big Data", ViNT research report 1 of 4 by Jaap Bloem. et al. June 2012


Effect of data insight on performance (2012)

Source: http://blog.vint.sogeti.com/wp-content/uploads/2012/07/VINT-Sogeti-on-Big-Data-1-of-4-Creating-Clarity.pdf page 8"Creating clarity with Big Data", ViNT research report 1 of 4 by Jaap Bloem. et al. June 2012Source: http://cci.uncc.edu/sites/cci.uncc.edu/files/media/pdf_files/MIT-SMR-IBM-Analytics-The-New-Path-to-Value-Fall-2010.pdf page 4"Analytics: The new path to Value" by IBM and MIT


Big (Data)

http://www.dailyhoops.nl/wp-content/uploads/cartman.jpg http://www.rottenecards.com/ecards/Rottenecards_90881418_rf74456gnt.png


The Attack of the exponentials

Source: http://www.slideshare.net/medriscoll/driscoll-strata-buildingdatastartups25may2011clean slide 4"Building Data Start-ups: Fast, Big and Focused" by Michael E. Driscoll CTO Metamarkets, May 2011


3 V’s that define Big Data (or 4?)

VALUE

Source: http://www.slideshare.net/multiscope/data-pioneers-sander-duivestein-vint-future-of-data slide 9“The future of data” by Sander Duivestein , June 2012

Definition 1/3


Big Data definition at Goldman Sachs et al.

BIG DATA ==

Transaction+

Interaction+

Observation

Source: http://hortonworks.com/blog/7-key-drivers-for-the-big-data-market/"7 Key Drivers for the Big Data Market" by Shaun Connolly at the Goldman Sachs Cloud Conference May 2012

Definition 2/3


Big Data Definition by Edzo

BIG DATA ==

Real time data+

Real time analysis(graph data)

+Real time reaction

(feedback loop)

Source: Edzo Botjes

Definition 3/3


Examples of the 3 V's


Examples of Size and Source

Source: http://hortonworks.com/blog/7-key-drivers-for-the-big-data-market/Source: http://blog.vint.sogeti.com/wp-content/uploads/2012/07/VINT-Sogeti-on-Big-Data-1-of-4-Creating-Clarity.pdf


Examples of Big Data Analytics

Source: http://blog.vint.sogeti.com/wp-content/uploads/2012/07/VINT-Sogeti-on-Big-Data-1-of-4-Creating-Clarity.pdf page 18"Creating clarity with Big Data", ViNT research report 1 of 4 by Jaap Bloem et al.. June 2012


Examples of Big Data in the real life

Source:http://www.computerworld.com/s/article/9233587/Barack_Obama_39_s_Big_Data_won_the_US_election http://www.infoworld.com/d/big-data/the-real-story-of-how-big-data-analytics-helped-obama-win-212862 http://www.forbes.com/sites/kashmirhill/2012/02/16/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did/ http://commons.wikimedia.org/wiki/File:Target_logo.svg http://www.rfgen.com/blog/bid/285148/Tesco-Improves-Supply-Chain-with-Big-Data-Automated-Data-Collection http://www.computerweekly.com/news/2240184482/Tesco-uses-big-data-to-cut-cooling-costs-by-up-to-20m http://img.dooyoo.co.uk/GB_EN/orig/0/7/7/7/3/777389.jpg http://www.computing.co.uk/IMG/120/257120/amazon-box-question-mark-370x229.jpg?1368697646

25Big Data a Start | Big Data at your Client | Vianen | 2013 05 13 |

Big Data at your Client





Jump or not to Jump ?

Big Data is concerned with exceptionally large, often widespread bundles of semi structured or unstructured data. In addition, they are often incomplete and not readily accessible.

“Exceptionally large” means the following, measured against theextreme boundaries of current standard it and relational databases: petabytes of data or more, millions of people or more, billions of records or more, and a complex combination of all these.

With fewer data and greater complexity, you will encounter a serious Big Data challenge, certainly if your tools, knowledge and expertise are not fully up to date. Moreover, if this is the case, you are not prepared for future data developments. Semi-structured or unstructured means that the connections between data elements are not clear, and probabilities will have to be determined.

Further to read:B. Ten Big Data management challenges: what are your issues?C. Five requirements for your Big Data project: are you ready?

Source: http://blog.vint.sogeti.com/wp-content/uploads/2012/07/VINT-Sogeti-on-Big-Data-1-of-4-Creating-Clarity.pdf page 18"Creating clarity with Big Data", ViNT research report 1 of 4 by Jaap Bloem et al. June 2012

Are you Big

Data ready?

Or to big a

leap?

“Big”


Starting Tips

• Never, Ever, start without a Business Case and thus not without a business sponsor.

• Added value of Big Data is combination of “External” Sources. Think outside the box, outside your silo.

• Maturity is key. - Start with identifying - then go optimizing, scale to BI, BI++ and - then to real time added value Big Data feedback loops


Big data in a existing organizations

CRM

R&D

Social MediaApplication

Management

(E-Mail)Marketing

Sales/RevenueAccounting

DataGovernance

BI


----------------------------------

CRM

Internal R&DInternal BI

Social MediaApplication

Management

(E-Mail)Marketing

Sales/RevenueAccounting

DataVirtualization

data driven operations

data driven operations


Information Management / Business Development Role (1/2)

Facilitate Execute

Source: http://www.alfredoartist.com/Optimized%20Images/Rodriguez-InSearchOfGold.jpghttp://resources1.news.com.au/images/2011/07/27/1226102/848013-gold-prospecting.jpghttp://www.refinedinvestments.com/wp-content/uploads/2012/10/gold-mining400x282.jpghttp://en.rockscrusher.com/wp-content/uploads/2011/04/gold-mining-plant.jpg

Be a leader

Bring together

Create innovation

environment

Bring success to production


Information Management / Business Development Role (2/2)

Not the Information Management Role

1.Employ Data scientists2.Develop new data analyses technique’s3.Be a business sponsor

Information Management Role1.Facilitate the gold finding process (POCs)

Bring data scientist in touch with business

2.Be owner of the gold mining process (projects)

3.Have and Execute a vision on data governance and data virtualization. (reduce future costs on projects, POCs and changes etc.)


Possible Partners

Be InspiredBy Gartner

Magic Quadrant


Example Possible Partners• Neo4J - Big Data on your laptop DIY graph database

• SAS Visual Analytics - Big Data on your own hardware Business controlled self service BI (Big Data)

• Target Holding - Big Data Analysts and Big Data provider partner of RuG, research companies etc.

• Gooddata & Keboola - Big Data in the Cloud incl the analysis

So in a Nutshell ..

35Big Data a Start | From Buzz to Business | Vianen | 2013 05 13 |

From Buzz to Business• Discover your data - Sogeti Business Intelligence & Analytics

• Think creative - Agile, cogs of creativity, Enterprise Agility

• Partner up! - Sogeti Partners, Universities, Big Data Partners

• Start learning by doing - Start small, iterate, scale up, Business Model Generation (BMG)


The Network will win


Big Datafrom Buzz to Business

Meetup.com

Management 3.0