carnegie mellon school of computer science › ~msakr › 15619-s18 › ... · task4: put...

26

Upload: others

Post on 26-Jun-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and
Page 2: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

○○○

○○○

■★

○■

Page 3: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

○★

○■■■■

Page 4: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

○■■■■

Page 5: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

●○○○

●○○

Page 6: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

Page 7: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and
Page 8: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and
Page 9: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

○●

●○

Page 10: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

Page 11: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and
Page 12: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

Page 13: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and
Page 14: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

Page 15: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and
Page 16: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

●●●

Page 17: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

●◆

Page 18: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

●◆

● AmazonRDSFullAccess● AmazonEC2FullAccess● AmazonElasticMapReduceFullAccess

◆ Recommend to use Spot Instances● Manual Tagging

Page 19: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

➔◆

●◆

➔◆

●◆

Page 20: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

Page 21: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

tWITTER DATA ANALYTICS:TEAM PROJECT

Page 22: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

Team Project System Architecture

● Web server architectures● Dealing with large scale real world tweet data● HBase and MySQL optimization 35

GCP Dataproc, Azure HDInsight, or Amazon EMR

Page 23: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

Team Project Phase-1 Deadlines● Writeup and queries were released on

Monday, Feb 26th, 2018.● Phase 1 milestones:

○ Checkpoint 1:■ Report, due on Sunday, 3/11

○ Checkpoint 2:■ Q1 on scoreboard, due on Sunday, 3/25

○ Phase 1 Deadline:■ Q2 on scoreboard, due on Sunday, 4/1

○ Phase 1, code and report:■ due on Tuesday, 4/3 36

Page 24: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

24

Phase (and query due) Start Deadlines Code and Report Due

Page 25: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and

Page 26: Carnegie Mellon School of Computer Science › ~msakr › 15619-s18 › ... · Task4: Put Everything Together Dataset Name Login Information User Profile Relation Posts Profile and