twitter-scraper alternatives and similar packages
Based on the "Third-party APIs" category
-
geo-golang
Go Library to access Google Maps, MapQuest, Nominatim, OpenCage, HERE, Bing, and Mapbox geocoding / reverse geocoding APIs. -
gostorm
GoStorm is a Go library that implements the communications protocol required to write Storm spouts and Bolts in Go that communicate with the Storm shells. -
hipchat (xmpp)
A golang package to communicate with HipChat over XMPP. -
go-tgbot
Pure Golang Telegram Bot API wrapper, generated from swagger file, session-based router and middleware. -
mixpanel
Mixpanel is a library for tracking events and sending Mixpanel profile updates to Mixpanel from your go applications.
Do you think we are missing an alternative of twitter-scraper or a related project?
README
Twitter Scraper
Golang implementation of python library https://github.com/kennethreitz/twitter-scraper
Twitter's API is annoying to work with, and has lots of limitations — luckily their frontend (JavaScript) has it's own API, which I reverse-engineered. No API rate limits. No tokens needed. No restrictions. Extremely fast.
You can use this library to get the text of any user's Tweets trivially.
Usage
Get user tweets
package main
import (
"fmt"
twitterscraper "github.com/n0madic/twitter-scraper"
)
func main() {
for tweet := range twitterscraper.GetTweets("kennethreitz", 25) {
if tweet.Error != nil {
panic(tweet.Error)
}
fmt.Println(tweet.HTML)
}
}
It appears you can ask for up to 25 pages of tweets reliably (~486 tweets).
Search tweets by query standard operators
Tweets containing “twitter” and “scraper” and “data“, filtering out retweets:
package main
import (
"fmt"
twitterscraper "github.com/n0madic/twitter-scraper"
)
func main() {
for tweet := range twitterscraper.SearchTweets("twitter scraper data -filter:retweets", 50) {
if tweet.Error != nil {
panic(tweet.Error)
}
fmt.Println(tweet.HTML)
}
}
The search ends if we have 50 tweets.
See https://developer.twitter.com/en/docs/tweets/rules-and-filtering/overview/standard-operators for build standard queries.
Get profile
package main
import (
"fmt"
twitterscraper "github.com/n0madic/twitter-scraper"
)
func main() {
profile, err := twitterscraper.GetProfile("kennethreitz")
if err != nil {
panic(err)
}
fmt.Printf("%+v\n", profile)
}
Get trends
package main
import (
"fmt"
twitterscraper "github.com/n0madic/twitter-scraper"
)
func main() {
trends, err := twitterscraper.GetTrends()
if err != nil {
panic(err)
}
fmt.Println(trends)
}
Installation
go get -u github.com/n0madic/twitter-scraper