Commit Graph

17 Commits

Author SHA1 Message Date
Joshua Tauberer
f619d59b5d add wikipedia page names to the ID field, by scanning for pages using the CongBio and CongLinks templates and keying off of bioguide IDs 2013-04-06 17:50:32 -04:00
Eric Mill
5e0c72df45 Increased rate limit, NYT's rate limiter auto-emailed me to complain 2013-03-20 16:38:27 -04:00
Joshua Tauberer
7c8f489f84 updating committees-historical (mostly just indicating some committees present in 113th Congress, but also THOMAS made some name corrections) 2013-03-19 13:38:10 -04:00
Joshua Tauberer
2292033318 update our YAML dumper to use tildes for nulls, so our one tilde doesnt get changed on output from a script 2013-03-19 13:28:21 -04:00
Eric Mill
b22e973791 Use the SafeLoader to avoid crazy serialization security issues 2013-02-01 15:10:28 -05:00
Joshua Tauberer
99518273d7 use the faster libyaml parser if it is available 2013-01-29 13:34:46 -05:00
GovTrack.us
2de1484d8a ensure all strings that look like integers are quoted (only needed for zero-lead octal-integer-like strings with '8' or '9' in the value which would previously omit quotes) 2013-01-15 11:28:32 -05:00
Eric Mill
0853617624 Beginnings of a bioguide parser 2013-01-04 16:14:41 -05:00
GovTrack.us
e1e528db07 add retire.py script to make it easier to dead with moving legislators into the historical file 2012-12-17 19:05:27 -05:00
Joshua Tauberer
48d5514d80 make loading YAML faster (it is so slow) by caching it in pickle'd format 2012-12-01 17:16:45 -05:00
Eric Mill
7c94e7afc3 Fixed up some weird top level fields, probably my mistake 2012-11-27 13:57:59 -05:00
Eric Mill
4955831411 Using same utils stuff in committee membership script 2012-11-08 23:15:35 -05:00
Eric Mill
f203857c43 Merged changes 2012-11-08 22:24:01 -05:00
Eric Mill
88813f318e Default to not caching, allow override 2012-11-08 22:19:38 -05:00
Eric Mill
44206eb09c Borrowed some utils functions from the THOMAS scraper, updated README about running scripts with virtualenv 2012-11-08 22:00:07 -05:00
GovTrack.us
bd8a3c6444 update current House committee metadata from House Clerk pages using a new committee membership scraper (House only so far) 2012-11-06 17:53:21 -05:00
Eric Mill
1d2d1b5afb Moving scripts from congress-legislators-scripts in 2012-11-06 11:28:01 -05:00