Full archive search of twitter

Sep 14 at 6:41 PM
Hi I am wondering if nodexl has a product that allows full archive search of twitter instead of limiting it to only few days worth of data?
Coordinator
Sep 14 at 7:49 PM
Hello!

Thanks for the interest in NodeXL!

Twitter's public free API has many limits. Data is available only for 7-8 days. Queries cannot return more than 18,000 tweets.

The follower network is further restricted: the rate at which queries about who follows who can be asked is low.

NodeXL Pro does not enable the collection of data beyond these limits.

Twitter imposes many rate limits via its data API. NodeXL Basic and Pro are both effected by these limits.

That said, NodeXL can process data from commercial data providers (like Crimson Hexagon or Radian6 - now SalesForce Marketing Cloud). While these are expensive options, they may be the only way to get historical data from Twitter.

Please see:

https://nodexl.codeplex.com/discussions/650609
and:

https://nodexl.codeplex.com/discussions/649987

You may be able to get a little bit more data from the public Twitter API by using the SINCE: and UNTIL: operators - example:

QUERYTERM since:2016-09-12 until:2016-09-14

Since: and Until: operators scope the time frame of the query.

Twitter controls its API and throttles it based on unknowable parameters. We notice that the greater the volume of tweets == less tweets delivered.

One alternative is to do day-long slices and append them in order to maximize the data available from Twitter.

You may also be interested in this: http://graphserverimporter.codeplex.com which enables NodeXL to connect to the "STREAM" API from Twitter (which sometimes delivers larger volumes of data).
Marked as answer by MarcSmith on 9/14/2016 at 12:49 PM