hyperreal/eot2024
1
0
Fork 0
mirror of https://github.com/end-of-term/eot2024 synced 2024-11-25 07:43:42 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity
99460625a9
eot2024/seed-lists
History
Lauren Ko 99460625a9 Add usagov.csv seed list
2024-09-23 11:10:35 -05:00
..
2_govt_urls_federal_only.csv Add more files from web resources 2024-09-12 15:54:23 -05:00
117th_House_Seeds.xlsx Adding seed lists from NARA and in-scope non gov/mil PURL target domain csv 2024-09-06 16:10:50 -05:00
117th_Senate_Seeds.xlsx Adding seed lists from NARA and in-scope non gov/mil PURL target domain csv 2024-09-06 16:10:50 -05:00
118th_House_Seed_List.xlsx Add NARA's 118th House Seeds 2024-09-09 16:24:56 -05:00
118th_Senate.xlsx Adding seed lists from NARA and in-scope non gov/mil PURL target domain csv 2024-09-06 16:10:50 -05:00
ccf-gov-federal-web-graph-2024-jun-jul-aug.txt Common Crawl seeds (#3) 2024-09-16 09:33:58 -05:00
ccf-mil-web-graph-2024-jun-jul-aug.txt Common Crawl seeds (#3) 2024-09-16 09:33:58 -05:00
CRS_ReportsList.csv Nominated URLs for CRS Reports 2024-05-29 21:05:02 -05:00
current-federal.csv Add more files from web resources 2024-09-12 15:54:23 -05:00
dotmil_websites.csv Add more files from web resources 2024-09-12 15:54:23 -05:00
FDLP_WEb_Archiveseed_list_20240212.csv Add seed lists from GPO 2024-02-16 14:13:29 -06:00
FOIA_Libraries_Dataset_Oct_3_2023_Final.xlsx Add spreadsheet for James Jacobs 2024-05-08 16:37:50 -05:00
govspeakeot080124.xlsx Add GovSpeak seeds 2024-08-01 11:59:00 -05:00
LOC-seeds-for-eot-20240712.xlsx Add Library of Congress bulk seed list 2024-08-01 09:50:06 -05:00
Military-Departments-A-Z-List.csv Add more files from web resources 2024-09-12 15:54:23 -05:00
PURL_server_domains_20240214_non_gov_mil.csv Adding seed lists from NARA and in-scope non gov/mil PURL target domain csv 2024-09-06 16:10:50 -05:00
PURL_server_domains_20240214.csv Add seed lists from GPO 2024-02-16 14:13:29 -06:00
README.md Add usagov.csv seed list 2024-09-23 11:10:35 -05:00
site-scanning-target-url-list.csv Add more files from web resources 2024-09-12 15:54:23 -05:00
US_Digital_Registry.csv Add seeds from https://touchpoints.app.cloud.gov/registry 2024-09-12 12:19:09 -05:00
us-government-website-directory.csv Add more files from web resources 2024-09-12 15:54:23 -05:00
usagov.csv Add usagov.csv seed list 2024-09-23 11:10:35 -05:00

README.md

End of Term 2024 Seed Lists

Posted here are seed lists used in the 2024 End of Term Web Archive project. Provenance notes are included below. These lists will be uploaded into the End of Term Bulk Nomination Tool.

Common Crawl Foundation seeds

See commoncrawl/ccf-eot-seeds-2024 for details.

  • ccf-gov-federal-web-graph-2024-jun-jul-aug.txt -- all .gov federal hostnames from current-federal.csv domains in CCF's 2024 June/July/August web graph
  • ccf-mil-web-graph-2024-jun-jul-aug.txt -- all .mil hostnames from CCF's 2024 June/July/August web graph

GPO seeds

Seeds supplied by Dorothy Bower of the U.S. Government Publishing Office:

  • FDLP_WEb_Archiveseed_list_20240212.csv - list of seeds from the FDLP Web Archive with one page only seeds deleted, that were mainly embedded youtube videos.
  • PURL_server_domains_20240214.csv - report of all target domains from the PURL server; some determined to be out of scope were not included in the Nomination Tool.
    • PURL_server_domains_20240214_non_gov_mil.csv - non .gov/.mil seeds from the PURL_server_domains_20240214.csv list that were determined to be in scope by Mark Phillips of UNT.

Internet Archive seeds

Seeds supplied by Antoine McGrath of Internet Archive:

  • CRS_ReportsList.csv - nominated URLs to government hosted CRS Reports from Daniel Schuman with the American Governance Institute.

Library of Congress seeds

  • LOC-seeds-for-eot-20240712.xlsx

National Archives and Records Administration seeds

Seeds supplied by Elizabeth England of the U.S. National Archives and Records Administration (NARA):

  • 117th_House_Seeds.xlsx - contains five sheets, one each for: House members, majority committees, minority committees, caucuses, and leadership/support/other.
  • 117th_Senate_Seeds.xlsx
  • 118th_House_Seed_List.xlsx - contains five sheets, one each for: House members, majority committees, minority committees, caucuses, and leadership/support/other.
  • 118th_Senate.xlsx

Stanford seeds

Seeds supplied by James Jacobs of Stanford University Libraries:

  • FOIA_Libraries_Dataset_Oct_3_2023_Final.xlsx - spreadsheet with seeds for all of the federal FOIA libraries. Lisa DeLuca, who collated the list, said it would be fine to use her spreadsheet from https://works.bepress.com/lisa_deluca/59/.

UC San Diego

Seeds supplied by Kelly L. Smith, Government Information Librarian and Librarian for Urban Studies & Planning / Environmental Studies at UC San Diego Library (via James Jacobs):

Seeds sourced from Web resources

The End of Term Web Archive team compiled a list of sources on the Web from which to source seeds: