r _Web.log

Archives: 2011-03


tweetarchive: Archive your Twitter feed to CSV

K https://github.com/ideoforms/tweetarchive

I've long wanted a method of exporting Twitter posts to a text-based format -- partly for the joy associated with being able to access my feed with standard text tools (twitter grep, anyone?), and partly for the peace of mind that's difficult to associate with a third-party content host. Their API also provides a limit of 3200 historical tweets per timeline, meaning that, eventually, your past posts will be inaccessible.

So, in a spare moment, I created tweetarchive, a lightweight Python-based tool to export complete timelines in CSV.

Features:

  • uses the tweepy library with oauth for protected accounts
  • only archives tweets created since your previous export
  • writes CSV output with user-specified format - so select what fields you'd like to archive
  • uses time delays to avoid hitting load throttling
  • client-side, meaning no need to give third-party apps access to your auth tokens

Download it here (requires git).