* Update README.md
USIP-20250319.xlsx. 4500 seeds from US Institute for Peace, Congressionally funded quasi-governmental org.
* Add files via upload
USIP-20250319.xlsx. 4500 seeds from US Institute for Peace, Congressionally funded quasi-governmental org.
Added Infordocket bulk list StudentAidDOTgov-20250314.xlsx. 3300 seeds from StudentAid.gov.
* Add files via upload
Added Infodocket bulk list StudentAidDOTgov-20250314.xlsx. 3300 seeds from StudentAid.gov.
* Update README.md
another bulk list from Gary Price. DOD PDF-20250314.xlsx. 411 DOD pdfs (and a few other formats).
* Add files via upload
DOD PDF-20250314.xlsx. 411 DOD pdfs (and a few other formats).
* Update README.md
bulk list submitted by James Jacobs. NOAA voices oral histories. NOAA-Voices-oral-history-archive-20250311.xlsx
* Add files via upload
bulk list submitted by James Jacobs. NOAA voices oral histories. NOAA-Voices-oral-history-archive-20250311.xlsx
* Update README.md
2 new bulk lists from Gary Price: DOD_photos_20250310.xlsx and NASA-SCIENCE-20250310.xlsx.
* Add files via upload
2 new bulk lists from Gary Price: DOD_photos_20250310.xlsx and NASA-SCIENCE-20250310.xlsx.
* Update README.md
bulk list added by info docket NIH_record-20250307.xlsx.
* Add files via upload
bulk list added by info docket NIH_record-20250307.xlsx.
* Update README.md
Infodocket bulk list seeds from the Office of Gov Ethics.
* Add files via upload
Infodocket bulk list seeds from the Office of Gov Ethics.
* Update README.md
4 new bulk lists from Gary Price @ Infodocket.
* Add files via upload
4 new bulk lists from Gary Price.
* Update README.md
bulk list from LiL of data.gov catalog records
* Add files via upload
bulk list from Harvard LiL
* Update README.md
added 2 new bulk lists to readme from Gary Price/Infodocket and Campaign for Tobacco-Free Kids
* Add files via upload
added 2 new bulk lists from Gary Price/Infodocket and Campaign for Tobacco-Free Kids
* Update README.md
added MIT spreadsheet
* Add files via upload
added MIT spreadsheet
* Update README.md
new bulk list by EdTrust
* Add files via upload
new bulk list by EdTrust
* Update README.md
another Gary Price bulk list
* Add files via upload
another Gary Price bulk list
* Create gov_sitemaps.csv
Gov_Domain Sitemap URLs and the contents of those sitemaps
* Update gov_sitemaps.csv
These URLs are the compilation of various gov sitemaps. The references to non government content and standards have been removed.
URLs found in gov sitemaps (including ones that link to gov social media profiles) remain.
* Update README.md
added MIT spreadsheet
* Add files via upload
added MIT spreadsheet
* Update README.md
new bulk list by EdTrust
* Add files via upload
new bulk list by EdTrust
* Update README.md
Several new bulk lists added from Infodocket and eot-info submissions.
* Add files via upload
7 new bulk lists from Infodocket and eot-info submissions.
CDC dataset URLs derived from this sitemap file: https://s3.amazonaws.com/sa-socrata-sitemaps-us-east-1-fedramp-prod/sitemaps/sitemap-datasets-data.cdc.gov0.xml. The format of this CSV file is: sitemap file the URL is sourced from,the URL.
Note that the pages pointed to by these URLs usually include a download button to get a CSV of the dataset, but the CSVs themselves aren't included in this seed file and won't be retrieved in the crawl. But at least the existence of the dataset and links to its metadata will be documented in the archive.
* FDA HTML urls for seed list
This is a file of URLs derived from the FDA's sitemap.xml file. It has URLs of the form /media/*/download and the warning-letters filtered out, so in theory everything in this file is an HTML link. I plan on submitting the PDF content separately.
The format of this CSV file is: <sitemap file the URL is sourced from>,<the URL>
* FDA warning letters from sitemap.xml
This is a file of URLs derived from the FDA's sitemap.xml file with warning letters content. I thought this was going to be PDF content, but it turns out to be HTML content.
The format of this CSV file is: sitemap file the URL is sourced from,the URL
* FDA download links from sitemaps
This is a file of URLs derived from the FDA's sitemap.xml file, where the link is of the form /media/id/download. These resolve to a PDF file rendered in a HTML wrapper using Mozilla's pdfjs library -- so the download in the path name is a little misleading.
The format of this CSV file is: sitemap file the URL is sourced from,the URL
* NIH urls from three sitemaps.
This is a file of URLs derived from three NIH sitemap files: https://www.nih.gov/sitemap.xml, https://newsinhealth.nih.gov/sitemap.xml and https://nihrecord.nih.gov/sitemap.xml.
The format of this CSV file is: sitemap file the URL is sourced from,the URL
* Update README.md
2 new lists from EDGI and Hermann-Wu submitted via dot-info@archive.org
* Add files via upload
2 new lists from EDGI and Hermann-Wu submitted via dot-info@archive.org
* Update README.md
bulk list re USDA seeds submitted by AWI 20241222
* Add files via upload
bulk list re USDA seeds submitted by AWI 20241222
* Update README.md
3 bulk lists added: 1 from Gary Price and 2 from eot-info submissions: AWI-XL-4-20241224.xlsx, AWI-USDA-FSIS-20241222.xlsx, NSF-20241224.xlsx
* Add files via upload
3 bulk lists added: 1 from Gary Price and 2 from eot-info submissions: AWI-XL-4-20241224.xlsx, AWI-USDA-FSIS-20241222.xlsx, NSF-20241224.xlsx
* Update README.md
list submitted by Natl Indian Law Library Natl-Indian-Law-Library-bulk-seeds-20241224.xlsx
* Add files via upload
list submitted by Natl Indian Law Library Natl-Indian-Law-Library-bulk-seeds-20241224.xlsx
* Update README.md
bulk list on performance.gov by Ailsa Hermann-Wu
* Add files via upload
Bulk list submitted by Ailsa Hermann-Wu re performance.gov 20241219
* Update README.md
added another bulk list from Gary Price/Infodocket. File is USDA_FIS_ERS.xlsx
* Add files via upload
USDA_FIS_ERS.xlsx from Gary Price/infodocket. 1700 or so urls from the USDA. Specifically, the Food Inspection Service and Economic Research Service.
* Update README.md
3 more bulk lists from Gary Price sent on 12/14/2024
* Add files via upload
3 new bulk lists from Gary Price submitted 12/14/2024
* Update README.md
added another bulk list from Gary Price/Infodocket. File is USDA_FIS_ERS.xlsx
* Add files via upload
USDA_FIS_ERS.xlsx from Gary Price/infodocket. 1700 or so urls from the USDA. Specifically, the Food Inspection Service and Economic Research Service.
