hyperreal/eot2024
1
0
Fork 0
mirror of https://github.com/end-of-term/eot2024 synced 2025-01-18 21:13:45 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #3 from end-of-term/main

Browse Source 
update
This commit is contained in:
Bentley Hensel 2024-12-10 20:33:49 -05:00 committed by GitHub
commit e2054da35c
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
4 changed files with 47062 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -27,6 +27,6 @@ The project has two phases: A broad, comprehensive baseline crawl of identified
* 2013-02-01: "[Classification of the End of Term Archive: Extending Collection Development Practices to Web Archives](http://digital.library.unt.edu/ark:/67531/metadc152437/m2/1/high_res_d/LG-06-09-0174-09_UNT_Feb2013_FINAL.pdf)" [IMLS Final Project Report for Award LG-06-09-0174-09] (https://www.imls.gov/grants/awarded/lg-06-09-0174-09). * 2013-02-01: "[Classification of the End of Term Archive: Extending Collection Development Practices to Web Archives](http://digital.library.unt.edu/ark:/67531/metadc152437/m2/1/high_res_d/LG-06-09-0174-09_UNT_Feb2013_FINAL.pdf)" [IMLS Final Project Report for Award LG-06-09-0174-09] (https://www.imls.gov/grants/awarded/lg-06-09-0174-09).
## How to connect ## How to connect
* Join the [End of Term listserv](mailto:eot2016@archive.org). * Contact the [End of Term team](mailto:eot-info@archive.org).
* Follow the [End of Term Twitter account](https://twitter.com/eotarchive). * Follow the [End of Term Twitter account](https://twitter.com/eotarchive).
* Follow the [End of Term Bluesky account](https://bsky.app/profile/eotarchive.org). * Follow the [End of Term Bluesky account](https://bsky.app/profile/eotarchive.org).

46874
seed-lists/CDC found PDFs 20241209 cleaned single file.csv Normal file
View File

File diff suppressed because it is too large Load Diff

185
seed-lists/Hermann-Wu-nps-20241209.txt Normal file
View File

@ -0,0 +1,185 @@
https://nps.gov/subjects/tellingallamericansstories/index.htm
https://nps.gov/subjects/tellingallamericansstories/whoweare.htm
https://nps.gov/subjects/tellingallamericansstories/africanamericanheritage.htm
https://nps.gov/subjects/tellingallamericansstories/africanfeaturedplaces.htm
https://nps.gov/subjects/tellingallamericansstories/africaneducationresources.htm
https://nps.gov/subjects/tellingallamericansstories/africanamericantheme.htm
https://nps.gov/subjects/tellingallamericansstories/americanlatinoheritage.htm
https://nps.gov/subjects/tellingallamericansstories/latinointroduction.htm
https://nps.gov/subjects/tellingallamericansstories/latinofeaturedparks.htm
https://nps.gov/subjects/tellingallamericansstories/latinofeaturedplaces.htm
https://nps.gov/subjects/tellingallamericansstories/latino-featured-people.htm
https://nps.gov/subjects/tellingallamericansstories/latinoeducationresources.htm
https://nps.gov/subjects/tellingallamericansstories/latinothemestudy.htm
https://nps.gov/subjects/tellingallamericansstories/espanollatinothemestudy.htm
https://nps.gov/subjects/tellingallamericansstories/latinoadditionalresources.htm
https://nps.gov/subjects/tellingallamericansstories/asianpacificislanderheritage.htm
https://nps.gov/subjects/tellingallamericansstories/asianpacificislanderthemestudy.htm
https://nps.gov/subjects/tellingallamericansstories/disabilityhistory.htm
https://nps.gov/subjects/tellingallamericansstories/disability-history-theme-study.htm
https://nps.gov/subjects/tellingallamericansstories/disability-history-places.htm
https://nps.gov/subjects/tellingallamericansstories/disability-history-people.htm
https://nps.gov/subjects/tellingallamericansstories/disability-history-education-resources.htm
https://nps.gov/subjects/tellingallamericansstories/europeanheritage.htm
https://nps.gov/subjects/tellingallamericansstories/europeanheritageparks.htm
https://nps.gov/subjects/tellingallamericansstories/europeanheritageplaces.htm
https://nps.gov/subjects/tellingallamericansstories/europeople.htm
https://nps.gov/subjects/tellingallamericansstories/europeanheritageedresources.htm
https://nps.gov/subjects/tellingallamericansstories/europeanheritagethemestudy.htm
https://nps.gov/subjects/tellingallamericansstories/europeanheritageresources.htm
https://nps.gov/subjects/tellingallamericansstories/indigenousheritage.htm
https://nps.gov/subjects/tellingallamericansstories/indigenousparks.htm
https://nps.gov/subjects/tellingallamericansstories/indigenouspeople.htm
https://nps.gov/subjects/tellingallamericansstories/indigenousplaces.htm
https://nps.gov/subjects/tellingallamericansstories/indigenouseducation.htm
https://nps.gov/subjects/tellingallamericansstories/indigenousstudy.htm
https://nps.gov/subjects/tellingallamericansstories/indigenousresources.htm
https://nps.gov/subjects/tellingallamericansstories/lgbtqheritage.htm
https://nps.gov/subjects/tellingallamericansstories/lgbtqpeople.htm
https://nps.gov/subjects/tellingallamericansstories/lgbtqintroduction.htm
https://nps.gov/subjects/tellingallamericansstories/lgbtqparks.htm
https://nps.gov/subjects/tellingallamericansstories/lgbtqplaces.htm
https://nps.gov/subjects/tellingallamericansstories/lgbtqresources.htm
https://nps.gov/subjects/tellingallamericansstories/lgbtqthemestudy.htm
https://nps.gov/subjects/tellingallamericansstories/pride-guide.htm
https://nps.gov/subjects/tellingallamericansstories/lgbtqadditionalresources.htm
https://www.nps.gov/articles/lgbtqheritageadminhist.htm
https://nps.gov/subjects/tellingallamericansstories/womenshistory.htm
https://nps.gov/subjects/tellingallamericansstories/americanheroes.htm
https://nps.gov/subjects/tellingallamericansstories/strugglestriumphs.htm
https://nps.gov/subjects/tellingallamericansstories/migrationimmigration.htm
https://nps.gov/subjects/tellingallamericansstories/migrationparks.htm
https://nps.gov/subjects/tellingallamericansstories/migrationplaces.htm
https://nps.gov/subjects/tellingallamericansstories/migration-and-immigration-people.htm
https://nps.gov/subjects/tellingallamericansstories/migrationresources.htm
https://nps.gov/subjects/tellingallamericansstories/migrationstudy.htm
https://nps.gov/subjects/tellingallamericansstories/migrationadditionalresources.htm
https://nps.gov/subjects/tellingallamericansstories/transformingenvironment.htm
https://nps.gov/subjects/tellingallamericansstories/transformingparks.htm
https://nps.gov/subjects/tellingallamericansstories/transformingplaces.htm
https://nps.gov/subjects/tellingallamericansstories/engaging-with-the-environment-people.htm
https://nps.gov/subjects/tellingallamericansstories/transformingresources.htm
https://nps.gov/subjects/tellingallamericansstories/transformingstudy.htm
https://nps.gov/subjects/tellingallamericansstories/transformingadditionalresources.htm
https://nps.gov/subjects/tellingallamericansstories/developingeconomy.htm
https://nps.gov/subjects/tellingallamericansstories/developingamericaneconomyparks.htm
https://nps.gov/subjects/tellingallamericansstories/developingamericanplaces.htm
https://nps.gov/subjects/tellingallamericansstories/developing-the-american-economy-people.htm
https://nps.gov/subjects/tellingallamericansstories/developingamericanresources.htm
https://nps.gov/subjects/tellingallamericansstories/developingamericanstudy.htm
https://nps.gov/subjects/tellingallamericansstories/labor-history.htm
https://nps.gov/subjects/tellingallamericansstories/shapingpoliticallandscape.htm
https://nps.gov/subjects/tellingallamericansstories/shapingpoliticalparks.htm
https://nps.gov/subjects/tellingallamericansstories/shapingpoliticalplaces.htm
https://nps.gov/subjects/tellingallamericansstories/shaping-political-landscape-people.htm
https://nps.gov/subjects/tellingallamericansstories/shapingpoliticalresources.htm
https://nps.gov/subjects/tellingallamericansstories/shapingpoliticalstudy.htm
https://nps.gov/subjects/tellingallamericansstories/shapingpoliticaladditionalresources.htm
https://nps.gov/subjects/tellingallamericansstories/artscultureeducation.htm
https://nps.gov/subjects/tellingallamericansstories/artscultureparks.htm
https://nps.gov/subjects/tellingallamericansstories/artscultureplaces.htm
https://nps.gov/subjects/tellingallamericansstories/artscultureandeducation.htm
https://nps.gov/subjects/tellingallamericansstories/artscultureresources.htm
https://nps.gov/subjects/tellingallamericansstories/artsculturethemestudy.htm
https://nps.gov/subjects/tellingallamericansstories/artscultureadditionalresources.htm
https://nps.gov/subjects/tellingallamericansstories/sciencetechnology.htm
https://nps.gov/subjects/tellingallamericansstories/sciencetechnologyplaces.htm
https://nps.gov/subjects/tellingallamericansstories/scienceandtechnologypeople.htm
https://nps.gov/subjects/tellingallamericansstories/sciencetechnologyparks.htm
https://nps.gov/subjects/tellingallamericansstories/sciencetechnologyresources.htm
https://nps.gov/subjects/tellingallamericansstories/sciencetechnologythemestudy.htm
https://nps.gov/subjects/tellingallamericansstories/sciencetechnologyadditionalresources.htm
https://nps.gov/subjects/tellingallamericansstories/roleofunited-states.htm
https://nps.gov/subjects/tellingallamericansstories/unitedstatesworldparks.htm
https://nps.gov/subjects/tellingallamericansstories/unitedstatesworldplaces.htm
https://nps.gov/subjects/tellingallamericansstories/us-and-world-community-people.htm
https://nps.gov/subjects/tellingallamericansstories/unitedstatesworldresources.htm
https://nps.gov/subjects/tellingallamericansstories/unitedstatesworldstudy.htm
https://nps.gov/subjects/tellingallamericansstories/unitedstatesworldadditionalresources.htm
https://nps.gov/subjects/tellingallamericansstories/adventures-in-history.htm
https://nps.gov/subjects/tellingallamericansstories/about-us.htm
https://nps.gov/subjects/tellingallamericansstories/join-us.htm
https://nps.gov/subjects/tellingallamericansstories/pathways-through-american-history.htm
https://nps.gov/articles/000/making-a-democracy.htm
https://nps.gov/articles/000/making-a-living-and-making-a-life.htm
https://nps.gov/articles/000/every-place-has-a-history.htm
https://nps.gov/articles/000/everyone-has-a-history.htm
https://nps.gov/learnandexplore/plants-animals-more.htm
https://nps.gov/learnandexplore/forces-of-nature.htm
https://nps.gov/learnandexplore/outdoor-adventure.htm
https://nps.gov/learnandexplore/great-american-landscapes.htm
https://nps.gov/learnandexplore/americas-places.htm
https://nps.gov/learnandexplore/arts-culture.htm
https://nps.gov/learnandexplore/economy-discovery-innovation.htm
https://nps.gov/learnandexplore/american-people-government.htm
https://www.nps.gov/subjects/archeology/index.htm
https://www.nps.gov/subjects/africanamericanheritage/index.htm
https://www.nps.gov/subjects/military/index.htm
https://www.nps.gov/subjects/americanrevolution/index.htm
https://www.nps.gov/subjects/aapiheritage/index.htm
https://www.nps.gov/subjects/civilrights/index.htm
https://www.nps.gov/subjects/immigration/index.htm
https://www.nps.gov/subjects/japaneseamericanconfinement/index.htm
https://www.nps.gov/subjects/labor/index.htm
https://www.nps.gov/subjects/inauguration/index.htm
https://www.nps.gov/subjects/reconstruction/index.htm
https://www.nps.gov/subjects/enslavement/index.htm
https://www.nps.gov/subjects/urban/index.htm
https://www.nps.gov/subjects/womenshistory/index.htm
https://www.nps.gov/subjects/teachingwithhistoricplaces/index.htm
https://www.nps.gov/state/al/index.htm
https://www.nps.gov/state/ak/index.htm
https://www.nps.gov/state/as/index.htm
https://www.nps.gov/state/az/index.htm
https://www.nps.gov/state/ar/index.htm
https://www.nps.gov/state/ca/index.htm
https://www.nps.gov/state/co/index.htm
https://www.nps.gov/state/ct/index.htm
https://www.nps.gov/state/de/index.htm
https://www.nps.gov/state/dc/index.htm
https://www.nps.gov/state/fl/index.htm
https://www.nps.gov/state/ga/index.htm
https://www.nps.gov/state/gu/index.htm
https://www.nps.gov/state/hi/index.htm
https://www.nps.gov/state/id/index.htm
https://www.nps.gov/state/il/index.htm
https://www.nps.gov/state/in/index.htm
https://www.nps.gov/state/ia/index.htm
https://www.nps.gov/state/ks/index.htm
https://www.nps.gov/state/ky/index.htm
https://www.nps.gov/state/la/index.htm
https://www.nps.gov/state/me/index.htm
https://www.nps.gov/state/md/index.htm
https://www.nps.gov/state/ma/index.htm
https://www.nps.gov/state/mi/index.htm
https://www.nps.gov/state/mn/index.htm
https://www.nps.gov/state/ms/index.htm
https://www.nps.gov/state/mo/index.htm
https://www.nps.gov/state/mt/index.htm
https://www.nps.gov/state/ne/index.htm
https://www.nps.gov/state/nv/index.htm
https://www.nps.gov/state/nh/index.htm
https://www.nps.gov/state/nj/index.htm
https://www.nps.gov/state/nm/index.htm
https://www.nps.gov/state/ny/index.htm
https://www.nps.gov/state/nc/index.htm
https://www.nps.gov/state/nd/index.htm
https://www.nps.gov/state/mp/index.htm
https://www.nps.gov/state/oh/index.htm
https://www.nps.gov/state/ok/index.htm
https://www.nps.gov/state/or/index.htm
https://www.nps.gov/state/pa/index.htm
https://www.nps.gov/state/pr/index.htm
https://www.nps.gov/state/ri/index.htm
https://www.nps.gov/state/sc/index.htm
https://www.nps.gov/state/sd/index.htm
https://www.nps.gov/state/tn/index.htm
https://www.nps.gov/state/tx/index.htm
https://www.nps.gov/state/ut/index.htm
https://www.nps.gov/state/vt/index.htm
https://www.nps.gov/state/vi/index.htm
https://www.nps.gov/state/va/index.htm
https://www.nps.gov/state/wa/index.htm
https://www.nps.gov/state/wv/index.htm
https://www.nps.gov/state/wi/index.htm
https://www.nps.gov/state/wy/index.htm

2
seed-lists/README.md
View File

@ -76,6 +76,7 @@ Seeds supplied by Kelly L. Smith, Government Information Librarian and Librarian
### Seeds submitted to eot-info@archive.org ### Seeds submitted to eot-info@archive.org
* Federal URLs linked to on EnergyFundsForAll.org.xlsx - Submitted by Sally Robertson, EnergyFundsForAll.org * Federal URLs linked to on EnergyFundsForAll.org.xlsx - Submitted by Sally Robertson, EnergyFundsForAll.org
* Hermann-Wu-nps-20241209.txt - NPS seeds submitted by Hermann-Wu
### Seeds sourced from Web resources ### Seeds sourced from Web resources
The End of Term Web Archive team compiled a list of sources on the Web from which to source seeds: The End of Term Web Archive team compiled a list of sources on the Web from which to source seeds:
@ -89,3 +90,4 @@ The End of Term Web Archive team compiled a list of sources on the Web from whic
* 2_govt_urls_federal_only.csv - Pulled from [GSA's govt-urls repo](https://github.com/GSA/govt-urls/) (via https://raw.githubusercontent.com/GSA/govt-urls/main/2_govt_urls_federal_only.csv on 9/12/2024). The README indicates the repo "contains the list of public government managed domains that exist outside of the top-level .gov and .mil domains." * 2_govt_urls_federal_only.csv - Pulled from [GSA's govt-urls repo](https://github.com/GSA/govt-urls/) (via https://raw.githubusercontent.com/GSA/govt-urls/main/2_govt_urls_federal_only.csv on 9/12/2024). The README indicates the repo "contains the list of public government managed domains that exist outside of the top-level .gov and .mil domains."
* usagov.csv - Seeds scraped from https://www.usa.gov/agency-index/ by Jake Abrams, Founder, CivicsUS, LLC. * usagov.csv - Seeds scraped from https://www.usa.gov/agency-index/ by Jake Abrams, Founder, CivicsUS, LLC.
* CDC html URLs from sitemap data - 20241201.csv - file of about 46,000 .html URLs created by parsing the CDC's sitemap file at https://www.cdc.gov/wcms-auto-sitemap-index.xml, which then pointed to other sitemaps, which pointed to .html files. * CDC html URLs from sitemap data - 20241201.csv - file of about 46,000 .html URLs created by parsing the CDC's sitemap file at https://www.cdc.gov/wcms-auto-sitemap-index.xml, which then pointed to other sitemaps, which pointed to .html files.
* CDC found PDFs 20241209 cleaned single file.csv - .gov PDF links obtained from webpages found on the US CDC website. It contains 46,873 links, with the format: the source HTML file containing the PDF link; the time in UTC in which the accessibility of the PDF file was confirmed; and a URL pointing to the PDF file itself. PDF links are deduped when multiple pages point to the same PDF, and link fragments are removed. All the PDF files have had their accessibility and content type verified with a HTTP HEAD request on Dec. 09 2024.