hyperreal/eot2024
1
0
Fork 0
mirror of https://github.com/end-of-term/eot2024 synced 2025-01-18 05:03:44 +01:00
Code Issues Actions Packages Projects Releases Wiki Activity

Add cdc-dataset-urls.csv to README

Browse Source
This commit is contained in:
Lauren Ko 2025-01-06 10:07:15 -06:00
parent 5a83e824d4
commit c35eb3240e
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
seed-lists/README.md
View File

@ -115,3 +115,4 @@ The End of Term Web Archive team and other contributors compiled a list of sourc
* fda-no-downloads-no-warning-letters.csv - URLs derived from the FDA's sitemap.xml file. It has URLs of the form /media/\*/download and the warning-letters filtered out, so in theory everything in this file is HTML. The format of this CSV file is: sitemap file the URL is sourced from,the URL.
* fda-warnings-letters.csv - URLs derived from the FDA's sitemap.xml file with warning letters content in HTML. The format of this CSV file is: sitemap file the URL is sourced from,the URL.
* nih-urls.csv - URLs derived from three NIH sitemap files: https://www.nih.gov/sitemap.xml, https://newsinhealth.nih.gov/sitemap.xml and https://nihrecord.nih.gov/sitemap.xml. The format of this CSV file is: sitemap file the URL is sourced from,the URL.
* cdc-dataset-urls.csv - CDC dataset URLs derived from this sitemap file: https://s3.amazonaws.com/sa-socrata-sitemaps-us-east-1-fedramp-prod/sitemaps/sitemap-datasets-data.cdc.gov0.xml. The format of this CSV file is: sitemap file the URL is sourced from,the URL.