Market Idea

Consider, we have a client who wants to increase their sales and target its customers with promotional offers. We would provide

them with twitter analytics to find 10 most influential people within a range that can influence the target customers.

Tools Used

Data Extraction and Visualization

Data Extraction and Visualization

Data Extraction and Visualization

Pre-processing

Visualizations

Cluster Dendogram

Influential Users

Sentimental Analysis

Machine Learning

• Experimenting Twitter based Sentimental

Analysis

• A lexicon based approach has high precision

but low coverage

• A data-driven machine learning approach

• Learns from a corpus of annotated tweets

Step 1: Collect data

Step 2: Preprocessing text data in R

Step 3: Feature hashing and Filtered based feature selection

Step 4: Split the data into train and test

Step 5: Train model for prediction

Step 6: Evaluate model performance

Machine Learning Steps

Boosting Decision Tree

Logistic Regression

Support Vector Machine

Validation Score

Screen Name

RedEyeInc alexmaxha.. SchadenJ.. burritojust.. MikeIsaac treyturner.. FoodPorn.. beastlyBE.. harrisj ayooocam0K

10K

20K

30K

40K

50K

60K

70K

80K

Followers Count

32,545

76,388

13,719

61,953

37,113

14,183

19,334

16,364

66,022

74,091

Top 10 By Number of FollowersScreen Name

RedEyeInc

alexmaxham

SchadenJake

burritojustice

MikeIsaac

treyturnerband

FoodPorn_MX

beastlyBETCH19

harrisj

ayooocam

Sum of Followers Count for each Screen Name. Color shows details about Screen Name. The data is filtered on Action (ScreenName), which keeps 855 members. The view is filtered on Screen Name, which keeps 10 of 855 members.

Top Influential People

0K 5K 10K 15K 20K 25K 30K 35K 40K 45K 50K 55K 60K 65K 70K 75K 80KFollowers Count

0K

200K

400K

600K

800K

1000K

1200K

Statuses Count

All Followers vs Statuses

0K 5K 10K 15K 20K 25K 30K 35K 40K 45K 50K 55K 60K 65K 70K 75K 80KNumber of Followers

0K

200K

400K

600K

800K

1000K

1200K

Statuses Count

Top 10 Followers vs Statuses

Screen NameRedEyeInc

alexmaxham

SchadenJake

burritojustice

MikeIsaac

treyturnerband

FoodPorn_MX

beastlyBETCH19

harrisj

ayooocam

Screen Name

Top 10 by SUM([FollowersCount])

Limit

All

Followers vs Status Count

Created

23 24 25 26 27 28 29

ChipotleCompany

QdobaCompany

ChipotleCompany

QdobaCompany

ChipotleCompany

QdobaCompany

ChipotleCompany

QdobaCompany

ChipotleCompany

QdobaCompany

ChipotleCompany

QdobaCompany

ChipotleCompany

QdobaCompany

0

200

400

600

800

1000

1200

1400

1600

1800

2000

2200

2400

Value

2,156

217

365

528

635

744

1,021

198

2,245

487

1,242

266

1,827

700

Qdoba vs Chipotle Weekly Tweets

Measure NamesChipotle Company

Qdoba Company

Chipotle Company and Qdoba Company for each Created Day. Color shows details about Chipotle Company and Qdoba Company.

vs

Created

23 24 25 26 27 28 29

0K

2K

4K

6K

8K

10K

12K

14K

16K

18K

Retweet Count

Weekly Tweet BoxPlot

Retweet Count for each Created Day. Color shows details about Screen Name. De-tails are shown for Screen Name.

Retweet Analysis

Implementation Using

Amazon Cloud Formation Stack

Amazon EMR Clusters

Mapper in Python

Master Slave

ReduceOutput

Implementation Using

OUTPUT:

Power of Sentiments

Power of Sentiments

#ThankYou