dht

Full-featured BitTorrent client package and utilities

Programming language: Go

License: Mozilla Public License 2.0

Tags: Distributed Systems     Torrent    

Latest version: v1.15.2

README

torrent

This repository implements BitTorrent-related packages and command-line utilities in Go. The emphasis is on use as a library from other projects. It's been used 24/7 in production by downstream services since late 2014. The implementation was specifically created to explore Go's concurrency capabilities, and to include the ability to stream data directly from the BitTorrent network. To this end it supports seeking, readaheads and other features exposing torrents and their files with the various Go idiomatic io package interfaces. This is also demonstrated through torrentfs.

There is support for protocol encryption, DHT, PEX, uTP, and various extensions. There are several data storage backends provided: blob, file, bolt, mmap, and sqlite, to name a few. You can write your own to store data for example on S3, or in a database.

Some noteworthy package dependencies that can be used for other purposes include:

• go-libutp
• dht
• bencode
• tracker

Installation

Install the library package with go get github.com/anacrolix/torrent, or the provided cmds with go install github.com/anacrolix/torrent/cmd/...@latest.

Library examples

There are some small examples in the package documentation.

Mentions

• @anacrolix is interviewed about this repo in Console 32.

Downstream projects

There are several web-frontends, sites, Android clients and supporting services among the known public projects:

• confluence: torrent client as a HTTP service <!-- Well of course I know him... He's me -->
• exatorrent: Elegant self-hostable torrent client <!-- 1.5k stars -->
• Simple Torrent: self-hosted HTTP remote torrent client <!-- 876 stars -->
• TorrServ: Torrent streaming server over http <!-- 543 stars -->
• mabel: Fancy BitTorrent client for the terminal <!-- 237 stars -->
• webtor.io: free cloud BitTorrent-client <!-- not exclusively anacrolix/torrent maybe? 40-200 stars? -->
• Android Torrent Client: Android torrent client <!-- 29 stars -->
• libtorrent: gomobile wrapper <!-- 15 stars -->
• Go-PeersToHTTP: Simple torrent proxy to http stream controlled over REST-like api <!-- 28 stars -->
• CortexFoundation/torrentfs: Independent HTTP service for file seeding and P2P file system of cortex full node <!-- 21 stars -->
• goTorrent: torrenting server with a React web frontend <!-- 156 stars, inactive since 2020 -->
• Go Peerflix: Start watching the movie while your torrent is still downloading! <!-- 449 stars, inactive since 2019 -->
• Remote-Torrent: Download Remotely and Retrieve Files Over HTTP <!-- 57 stars, inactive since 2019 -->
• Trickl: torrent client for android <!-- 48 stars, inactive since 2018 -->
• ANT-Downloader: ANT Downloader is a BitTorrent Client developed by golang, angular 7, and electron <!-- archived -->
• Elementum (up to version 0.0.71)

Help

Communication about the project is primarily through Discussions and the issue tracker.

Command packages

Here I'll describe what some of the packages in ./cmd do. See installation to make them available.

torrent

torrent download

Downloads torrents from the command-line.

$ torrent download 'magnet:?xt=urn:btih:KRWPCX3SJUM4IMM4YF5RPHL6ANPYTQPU'
... lots of jibba jabber ...
downloading "ubuntu-14.04.2-desktop-amd64.iso": 1.0 GB/1.0 GB, 1989/1992 pieces completed (1 partial)
2015/04/01 02:08:20 main.go:137: downloaded ALL the torrents
$ md5sum ubuntu-14.04.2-desktop-amd64.iso
1b305d585b1918f297164add46784116  ubuntu-14.04.2-desktop-amd64.iso
$ echo such amaze
wow

torrent metainfo magnet

Creates a magnet link from a torrent file. Note the extracted trackers, display name, and info hash.

$ torrent metainfo testdata/debian-10.8.0-amd64-netinst.iso.torrent magnet
magnet:?xt=urn:btih:4090c3c2a394a49974dfbbf2ce7ad0db3cdeddd7&dn=debian-10.8.0-amd64-netinst.iso&tr=http%3A%2F%2Fbttracker.debian.org%3A6969%2Fannounce

See torrent metainfo --help for other metainfo related commands.

torrentfs

torrentfs mounts a FUSE filesystem at -mountDir. The contents are the torrents described by the torrent files and magnet links at -metainfoDir. Data for read requests is fetched only as required from the torrent network, and stored at -downloadDir.

$ mkdir mnt torrents
$ torrentfs -mountDir=mnt -metainfoDir=torrents &
$ cd torrents
$ wget http://releases.ubuntu.com/14.04.2/ubuntu-14.04.2-desktop-amd64.iso.torrent
$ cd ..
$ ls mnt
ubuntu-14.04.2-desktop-amd64.iso
$ pv mnt/ubuntu-14.04.2-desktop-amd64.iso | md5sum
996MB 0:04:40 [3.55MB/s] [========================================>] 100%
1b305d585b1918f297164add46784116  -