Joshua Tauberer
8d56a630dd
drop THOMAS IDs from output, replace with bioguide in XML outputs
2016-12-03 14:12:53 -05:00
Joshua Tauberer
c458e71e5b
amendment's introduced_at has been a date, so lopping off the time portion
2016-07-03 10:40:23 -04:00
Joshua Tauberer
d58df048d3
replace THOMAS scraper with USGPO bill status XML importer
...
There is no longer a separate amendments scraper. Amendments are saved as a part of importing bills. Amendments to treaties are no longer available.
some of this work was done by @crdunwel
2016-07-01 08:47:57 -04:00
Jonathan Strong
e14c8eda45
improved House amendment action regex in parse_amendment_action to catch three edge cases.
2014-10-24 11:29:11 -04:00
Will Van Wazer
04d494856f
Automated PEP8 refactoring with autopep8.
2014-04-28 22:39:50 -04:00
Joshua Tauberer
a590fa60e4
fix amendment to treaty detection for exactly one case: samdt3-100
2013-07-17 08:21:05 -04:00
Joshua Tauberer
882206cb90
A-style House amendment numbering is only listed on amendment pages starting with the 101st Congress
2013-07-17 07:48:46 -04:00
Drew Vogel
f2cd162521
Made comma optional in amendment vote regex in order to handle samdt813-113.
2013-07-15 13:35:22 -04:00
Eric Mill
12612f96ba
Removing offered_order, moving that value to house_number (restoring original pattern)
2013-07-08 18:27:29 -04:00
Eric Mill
e339c7dff4
Fixed a missed kind of amendment vote, identified by @jasonab
2013-06-20 16:38:14 -04:00
Eric Mill
b07fab6839
Add 'where' and 'vote_type' fields, like how bill actions do
2013-06-17 19:31:01 -04:00
Eric Mill
8682a07589
Strip tags out of amendment purposes and descriptions
2013-06-17 10:53:27 -04:00
Joshua Tauberer
8389c8c7d2
parsing House amendment action lines, allow vote type to be by the Yeas and Nays and treat as same as recorded vote
2013-06-09 06:04:54 -04:00
Joshua Tauberer
2d21421848
parsing House amendment action lines, allow 'as amended' to appear
2013-06-09 05:56:46 -04:00
Eric Mill
a5ff82c745
Remove title field, fix bug in purpose/description detection
2013-05-28 15:09:56 -04:00
Eric Mill
891f6a1a56
Centralize amendment introduction date on one field, ditch offered_at and submitted_at fields (keep proposed_at field, optional for Senate amendments)
2013-05-28 12:06:48 -04:00
Joshua Tauberer
46aa70d355
Scrape amendment "house_number" so it corresponds with House roll call vote XML
...
As disovered in issue #68 , the A___ numbering found on THOMAS (and entered by
House floor staff) does not correspond to the amendment-num field in House
roll call vote XML --- mostly when there is a House Rules report that has
an amendment in the nature of a substitute, which shifts the numbering of
Member amendments made in order by the rule.
The number used in vote XML is more or less scrapable from the purpose
(and if not purpose then sometimes description) field of the amendment. It
looks like "An amendment numbered XXX printed in (a report|the CR)."
This commit replaces the "house_number" field in our output (and the "sequence"
attribute in GovTrack-style XML output) with the scraped number as I've
just described so that the field now corresponds with House vote output.
The house_number field previously stored the A___ number, which is now
stored in a new field named "offered_order," since the A___ number is
consecutive in the order in which an amendment was offered.
2013-05-24 18:51:15 -04:00
Eric Mill
ccd27d89c2
Refactored 'amended' detection entirely, to better support finding amendments, bills, and treaties - with specific URL detection and allowing the amendment to be listed first or second
2013-05-13 17:25:10 -04:00
Eric Mill
d272448686
More specific targeting of orphaned amendments
2013-05-10 11:57:06 -04:00
Joshua Tauberer
36c04d2cbd
when amendment purpose says "Purpose will be available..." don't skip the amendment entirely but instead write null for that field
...
reverts 3678065d7e#67
2013-05-10 09:32:23 -04:00
Joshua Tauberer
08cd774193
amendment GovTrack-style XML: dont repeat the 'purpose' as both the 'description' and 'purpose'
2013-05-10 09:14:49 -04:00
Eric Mill
3678065d7e
Handle orphaned amendment
2013-05-08 18:09:13 -04:00
Eric Mill
1e9391a239
Allow for fetching senate unprinted amendments
2013-05-08 17:56:32 -04:00
Eric Mill
4ca76e4f89
Rename amends to amends_amendment, remove document_type, add bill_id and amendment_id fields
2013-05-08 17:32:51 -04:00
Eric Mill
ff6f72409a
Lose the A on house amendment numbers and store as an integer, store regular number as an integer
2013-05-07 19:37:26 -04:00
Eric Mill
2bd11b12f5
Some slight rearrangements and comments, made a lack of house number a choke-able offense
2013-05-07 18:40:10 -04:00
Joshua Tauberer
07b5f45485
now that we store thomas IDs in a consistent format, no need to reformat for GovTrack output
2013-01-25 08:09:03 -05:00
Joshua Tauberer
1984f86034
handle committee sponsors of amendments --- affects bills by adding type=person to all sponsors (as it does for amendments sponsored by individuals)
2013-01-25 07:36:03 -05:00
Eric Mill
782af88e85
Refactored download helper to have all extra options go through options hash, documented each option
2013-01-20 15:16:54 -05:00
Joshua Tauberer
73c843f585
amendments: handle case where there are no actions
2013-01-17 09:17:05 -05:00
Joshua Tauberer
fe80e32822
amendments: XML output, parse actions, current status
2013-01-17 09:09:35 -05:00
GovTrack.us
51a143d8d8
parsing amendments (hopefully)
2013-01-06 10:43:48 -05:00
