First Commit

.gitignore

@@ -0,0 +1 @@
+annastorrents.exe

README.md

@@ -0,0 +1,112 @@
+# Anna's Archive Mirror
+
+This Go application creates a mirror of the [Anna's Archive torrent page](https://annas-archive.org/torrents), providing an up-to-date list of torrents and their statistics. It includes features for tracking seeder history, generating custom torrent lists, and visualizing seeder statistics.
+
+## How It Works
+
+1. **Data Collection**: The application scrapes the full torrent list from Anna's Archive every 24 hours.
+2. **Database**: It stores the torrent information in a SQLite database.
+3. **Stat Tracking**: Every 30 minutes, it updates the seeder, leecher, and completion statistics for each torrent.
+4. **Web Interface**: It provides a web interface to view the torrent list, individual torrent statistics, and seeder history.
+5. **Custom List Generation**: Users can generate custom torrent lists based on size and type preferences.
+
+## Features
+
+- Display torrent list with group categorization
+- Show detailed statistics for individual torrents
+- Track and display seeder history
+- Generate custom torrent lists (magnet links, torrent files, or both)
+- Visualize daily seeder statistics across all torrents
+
+## Installation
+You can just go to the releases and download the binary and skip the installation / building. Obviously use your own judgement on the OpSec of downloading pre-compiled binaries. Luckily building in Go is very easy. 
+
+1. Clone the repository:
+   ```
+   git clone https://github.com/yourusername/annas-archive-mirror.git
+   ```
+
+2. Navigate to the project directory:
+   ```
+   cd annas-archive-mirror
+   ```
+
+3. Build the application (see Building section below).
+
+4. Run the application:
+   ```
+   ./annas-archive-mirror
+   ```
+
+5. Access the web interface by opening a browser and navigating to `http://localhost:8080`
+
+## Building
+
+This application uses CGO and requires GCC to be installed on your system. Follow these steps to build the application:
+
+1. Install Go (version 1.16 or later) from [golang.org](https://golang.org/)
+
+2. Install GCC:
+   - On Ubuntu/Debian: `sudo apt-get install build-essentials`
+   - On macOS: Install Xcode Command Line Tools
+   - On Windows: Install MinGW-w64 (I didn't need to do this but other guides say you do)
+
+3. Install the required Go packages:
+   ```
+   go get github.com/mattn/go-sqlite3
+   go get github.com/etix/goscrape
+   ```
+
+4. Build the application:
+   ```
+   go build -o annas-archive-mirror
+   ```
+
+## Configuration
+
+You can configure the application using command-line flags:
+
+- `-port`: Set the port for the web server (default: 8080)
+- `-directory`: Set the directory to store the SQLite database (default: current directory)
+
+Example:
+```
+./annas-archive-mirror -port 9000 -directory /path/to/data
+```
+
+## How It Works in Detail
+
+1. **Initialization**:
+   - The application sets up a SQLite database to store torrent information.
+   - It creates necessary tables for torrents, torrent updates, and daily seeder statistics.
+
+2. **Data Collection**:
+   - Every 24 hours, it fetches the latest torrent list from Anna's Archive.
+   - New torrents are added to the database, and existing ones are updated.
+
+3. **Stat Tracking**:
+   - Every 30 minutes, it updates the seeder, leecher, and completion statistics for each torrent.
+   - It uses the `github.com/etix/goscrape` library to scrape tracker information.
+
+4. **Web Server**:
+   - The application runs a web server that provides various endpoints:
+     - `/`: Main page with grouped torrent list
+     - `/full/{groupName}`: Full list of torrents for a specific group
+     - `/stats/{btih}`: Detailed statistics for a specific torrent
+     - `/json`: Full torrent list in JSON format
+     - `/generate-torrent-list`: Endpoint for generating custom torrent lists
+
+5. **Visualization**:
+   - It uses Chart.js to create visual representations of seeder statistics.
+
+6. **Custom List Generation**:
+   - Users can specify maximum size, list type (magnet links, torrent files, or both), and output format (JSON, XML, or TXT).
+   - The application generates the list based on these criteria, prioritizing torrents with fewer seeders.
+
+## Contributing
+
+Contributions are welcome! Please feel free to submit a Pull Request.
+
+## License
+
+This project is open source and available under the [MIT License](LICENSE).

go.mod

@@ -0,0 +1,8 @@
+module annastorrents
+
+go 1.21.6
+
+require (
+	github.com/etix/goscrape v0.0.0-20180731120256-0265a7239aef
+	github.com/mattn/go-sqlite3 v1.14.22
+)

go.sum

@@ -0,0 +1,4 @@
+github.com/etix/goscrape v0.0.0-20180731120256-0265a7239aef h1:9JK9zOFcMiv7ZGTjwLMqP+HtPIBxKQAc6d7FkZl+DzA=
+github.com/etix/goscrape v0.0.0-20180731120256-0265a7239aef/go.mod h1:kAgResQP1iYTrEi40ehz9KQMDv/14kzYQu1WXzEbf/8=
+github.com/mattn/go-sqlite3 v1.14.22 h1:2gZY6PC6kBnID23Tichd1K+Z0oS6nE/XwU+Vz/5o4kU=
+github.com/mattn/go-sqlite3 v1.14.22/go.mod h1:Uh1q+B4BYcTPb+yiD3kU8Ct7aC0hY9fxUwlHK0RXw+Y=