parsing real-time data using twitter streaming api
DESCRIPTION
TRANSCRIPT
![Page 1: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/1.jpg)
Parsing Real-time Tweets
Ramanujam ParthasarathyMonetate
@ramanujamhttp://github.com/ramanujam
Wednesday, May 30, 12
![Page 2: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/2.jpg)
Why?
• Freely available public intelligence
• News reaches twitter super fast and spreads
• 250 million tweets per day (Oct ‘11)
• Track keywords, sentiment analysis, data mining
• Because you can!
Wednesday, May 30, 12
![Page 3: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/3.jpg)
Twitter Streaming APIhttps://stream.twitter.com/1/statuses/filter.json
Wednesday, May 30, 12
![Page 4: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/4.jpg)
Twitter Streaming API
curl https://stream.twitter.com/1/statuses/filter.json?track=SEARCH_PARAMETER -uUSERNAME:PASSWORD
Wednesday, May 30, 12
![Page 5: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/5.jpg)
Twitter Python Libraries
• Tweepy• Python Oauth2• Python Twitter• Twython• Twitty Twister• Tweetstream
Use a library that has support for Oauth
Wednesday, May 30, 12
![Page 6: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/6.jpg)
Get your auth keys
Wednesday, May 30, 12
![Page 7: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/7.jpg)
Basic keyword/hashtag tracking
Print the status
Set the keywords to track
File: tracker.py
Wednesday, May 30, 12
![Page 8: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/8.jpg)
Save to MongoDB
Pymongo (http://api.mongodb.org/python/2.2/index.html) is a recommended way to work with MongoDB from Python
Wednesday, May 30, 12
![Page 9: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/9.jpg)
Plot some dataPie chart of the devices used by people who tweet about Obama and Romney
File: plotapps.py
Wednesday, May 30, 12
![Page 10: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/10.jpg)
Play some music#pugmusic
http:\/\/tinysong.com\/6OAB
Wednesday, May 30, 12
![Page 11: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/11.jpg)
Play some music
File: playmusic.py
Wednesday, May 30, 12
![Page 12: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/12.jpg)
Enqueue more songs
• Grooveshark javascript api
• addSongsByID
• window.Grooveshark.addSongsByID(13766524)
Wednesday, May 30, 12
![Page 13: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/13.jpg)
NotifyTwilio API to send a text or make a call based on an event trigger (eg: > 10 statuses in a 10 second window)
setTerms = ['$AAPL', 'down', '530']setTerms = [‘aws’, ‘down’]setTerms = [‘phillies’, ‘win’]
File: sendtext.pyWednesday, May 30, 12
![Page 14: Parsing real-time data using Twitter Streaming API](https://reader033.vdocuments.net/reader033/viewer/2022061211/549295b9ac7959292e8b4650/html5/thumbnails/14.jpg)
Thank You!
http://github.com/ramanujam/pugtalk
Wednesday, May 30, 12