r case study from ebay ddi 李忠 潘佳鸣 [email protected],[email protected]
TRANSCRIPT
![Page 2: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/2.jpg)
R Case Study from EBAY DDI李忠 潘佳鸣 [email protected] [email protected]
![Page 3: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/3.jpg)
3
Agenda
• eBay DDI Introduction
• eBay Mobile Buyer Purchase Behavior Analysis Case Study
• ETL Failure Message Classification Case Study
• Q&A
![Page 4: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/4.jpg)
![Page 5: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/5.jpg)
5
![Page 6: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/6.jpg)
6
Analytics Platform Architecture
EDW
Singularity
Hadoop
![Page 7: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/7.jpg)
Data Platforms
Data Warehouse + Behavioral
SingularityData Warehouse
Semi-structured/ SQL++
Structured/ SQL
Low End Enterprise-class System
Contextual-Complex AnalyticsDeep, Seasonal, Consumable Data Sets
Production Data WarehousingLarge Concurrent User-base
Discover & Explore
Analyze & Report
150+concurrent users
500+concurrent users
Enterprise-class System
5-10concurrent users
Unstructured / JAVA&C
Structure the UnstructuredDetect Patterns
Hadoop
Commodity Hardware System
6+PB 40+PB 20+PB
EDW
Ab Initio UC4 SOA
Data Integration
Informatica
![Page 8: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/8.jpg)
Cyber Monday: By the Numbers
Thanks to the growth of smartphones and tablets, which allow for “anytime, anywhere” shopping, eBay Inc. saw a surge in mobile commerce this past Cyber Monday across all divisions.
On a year-over-year basis, mobile transacted volume more than doubled in the U.S. for eBay Marketplaces and nearly tripled for PayPal on a global basis. In addition, GSI saw a 287% increase in mobile sales in the U.S., compared to 2011.
PayPal research also noted that consumers around the world shopped on mobile most frequently from 1:00 p.m. to 2:00 p.m., PST, on Cyber Monday — slightly later in the day than on Thanksgiving and Black Friday.
![Page 9: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/9.jpg)
Global Mobile Phones Geographical Distribution
Data Source comes from wiki page:http://en.wikipedia.org/wiki/List_of_countries_by_number_of_mobile_phones_in_use
![Page 10: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/10.jpg)
2012 Q4 EBAY Mobile Buyers Geological Distribution
![Page 11: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/11.jpg)
2012 Q4 US Mobile Buyers Geological Distribution
![Page 12: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/12.jpg)
2012 Q4 Mobile Buyer Distribution on GE
![Page 13: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/13.jpg)
2012 Q4 # of US Mobile Buyer Count by Gender
![Page 14: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/14.jpg)
2012 Q4 Mobile Buyer Count by Age Group
![Page 15: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/15.jpg)
2012 Q4 Mobile Buyer Order Size by Age Group
![Page 16: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/16.jpg)
2012 Q4 Mobile Buyer Purchase Frequency by AG
![Page 17: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/17.jpg)
2012 Q4 Mobile Buyer Purchase Amt by Age Group
![Page 18: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/18.jpg)
2012 Q4 Mobile Buyer Category Keyword
Mobile Female likes mobile and clothing
Mobile male likes Mobile and Car
![Page 19: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/19.jpg)
2012 Q4 Mobile Buyer Feedback by Age Group
![Page 20: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/20.jpg)
2012 Mobile Buyer Retention Rate
![Page 21: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/21.jpg)
2012 Mobile Buyer Retention Cycle Plot
![Page 22: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/22.jpg)
2012 Q4 Mobile Buyer Analysis Summary
We can see that the top 5 eBay big market places are US,UK,DE,AU and CA, but it is clearly that BRIC countries (Brazil, Russia, India and China) have a big potential business opportunity for EBAY mobile marketplace.
Most mobile buyers came from CA, TX, NY and FL in 2012 Q4. Mobile male like mobile and car but mobile female like mobile
and women’s clothing. Order size, purchase frequency are nearly the same between
mobile male and mobile female, but looks like mobile male spend more GMB per transaction than mobile female.
Age 20~34 and Age 35~49 are the two most active mobile feedback groups and they are satisfied with eBay items.
Retention rate converge to 20%
![Page 23: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/23.jpg)
Data Platforms
Data Warehouse + Behavioral
SingularityData Warehouse
Semi-structured/ SQL++
Structured/ SQL
Low End Enterprise-class System
Contextual-Complex AnalyticsDeep, Seasonal, Consumable Data Sets
Production Data WarehousingLarge Concurrent User-base
Discover & Explore
Analyze & Report
150+concurrent users
500+concurrent users
Enterprise-class System
5-10concurrent users
Unstructured / JAVA&C
Structure the UnstructuredDetect Patterns
Hadoop
Commodity Hardware System
6+PB 40+PB 20+PB
EDW
Ab Initio UC4 SOA
Data Integration
Informatica
Batches LOG
Batches LOG
Batches LOG
Batches LOG
Batches LOG
Batches LOG
Batches LOG
![Page 24: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/24.jpg)
eBay Data Platform Batch Support
Batches LOG
Batches LOG Batche
s LOG
Batches LOG
Batches LOG Batche
s LOG
Batches LOG
Batches LOG
?Failure Type
![Page 25: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/25.jpg)
eBay Data Platform Batch Support
The Business Problem
• How many types of Batch Failure• How to describe each type of Batch
Failure• How to automatically detect Batch
Failure
![Page 26: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/26.jpg)
eBay Data Platform Batch Support
![Page 27: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/27.jpg)
eBay Data Platform Batch Monitoring Center
1st Cycle Nth Cycle
![Page 28: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/28.jpg)
eBay Data Platform Batch Monitoring Center
![Page 29: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/29.jpg)
eBay Data Platform Batch Monitoring Center
![Page 30: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/30.jpg)
Thank You
![Page 31: R Case Study from EBAY DDI 李忠 潘佳鸣 zholi@ebay.com,jipan@ebay.com](https://reader037.vdocuments.net/reader037/viewer/2022102416/56649c785503460f9492cf56/html5/thumbnails/31.jpg)
Q &A