Scheduling Twitter Searches

Jul 20, 2012 at 11:30 PM

Does anyone know how to schedule automatic Twitter searches so that new data is imported into NodeXL on a scheduled basis?  

Thanks, 

Dom

Coordinator
Jul 21, 2012 at 5:11 PM

Dom:

The following is from the "NodeXL Network Server" topic at NodeXL, Help, Help in the Excel ribbon:

NodeXL includes a separate program called the NodeXL Network Server. This is a command-line program that can be used to download Twitter networks on a periodic basis—a twice-daily download of the network of people who tweeted a specified hashtag, for example—and store the graph data in GraphML files or NodeXL workbooks. It's an alternative to manually using the Twitter import features built into the NodeXL workbook, and it's ideal for researchers who wish to observe how Twitter networks change over time.

The NodeXL Network Server is meant for use by people with moderate system administration skills. It is not difficult to use, but it is not intended for the same audience as the NodeXL workbook, where ease of use is of high priority.

To learn more about the NodeXL Network Server:

1. Navigate to the NodeXL program folder. In Windows 7, an easy way to do this is to select Start, All Programs, Microsoft NodeXL; right-click the NodeXL Excel Template menu item; and select Open File Location from the right-click menu.

2. Open the NodeXLNetworkServerFAQ.docx document in the NodeXL program folder.

Coordinator
Jul 21, 2012 at 5:29 PM

Hello! Thank you for the interest in the NodeXL project.

Two articles on the Connected Action blog may be of interest:

How to schedule the creation of a network with NodeXL and Windows Task Scheduler

Fully automatic: NodeXL can build your network graphs hands free 

Regards,

Marc

Sep 5, 2013 at 8:46 PM
Hi tcap479 and marcsmith,

I have a question about the automatic, scheduled creation of Twitter graphs using NodeXL.

I have gone through your tutorial at the following link for scheduling the collection of Twitter graphs using Windows Task Scheduler: http://www.connectedaction.net/2010/08/23/how-to-schedule-the-creation-of-a-network-with-nodexl-and-windows-task-scheduler/

I understand that when doing manual collection of Twitter data, there is a way to manually collect data from multiple Twitter requests into one NodeXL edgelist spreadsheet and other data by unclicking the "Clear the NodeXL workbook before the data is imported." But is there also an automatic way, using the method through Windows Task Scheduler, to collect all of the edgelists for a particular search term into a single NodeXL spreadsheet?

Thanks in advance for your help.

Thomas
Coordinator
Sep 5, 2013 at 9:03 PM
NodeXL does not have an automated method for appending two or more network workbooks.

However, we are working on a component that will allow users to run their own "NodeXL Graph Database Servers" which will collect and store network data from Twitter in a database. We hope to ship that component in the coming month or so. With that database, multiple days of the same query can be aggregated into a single workbook (within various limits like RAM, CPU, file size, Excel row count limits, and practical processing limits (say ~150K edges)).

-- Marc