Artists Collections Other

The mirrors are currently offline.

mirrordl.py

This is a simple script designed to help download entire directories from our Directory Lister based mirrors, such as 5ur3kg.gq and vc.5ur3kg.gq. Unlike wget, it can handle non-Latin characters in file and directory names out of the box without any extra configuration.

NOTE: mirror.5ur3kg.gq is not supported.

View on GitHub

Upd. 2022-02-04

Installation

To use this script one needs a copy of Python 3 interpreter and an extra package, requests. Python 3.5 is the oldest version we're targeting, however newer is better (we've also tested it on 3.7 and 3.9).

If you don't yet have Python 3, for Windows 10+ the best option to get it from is the Windows Store. Windows 7/8 users can get it from the official site, and most Linux variants come with Python pre-installed or it is easily obtainable using the distribution's default package manager. Note that if you are using Windows 10+ but have chosen the non-Store version anyway, you might need to disable the builtin python/python3 app execution aliases (see here).

Once you have Python 3.5+ installed, run the following command in your command line of choice to install the dependencies the script needs:

pip3 install requests

(On some installations you might need to replace pip3 with pip, or even such monstrosity as py -3 -m pip)

Usage (vc.)

To download a directory from the mirror, just open the command line, powershell, or Windows Terminal in the directory you want to save downloaded files to and run a command like:

python3 C:\Users\Someone\Downloads\vcmirrordl.py "https://vc.5ur3kg.gq/Beater/Doujins"

(Just like with pip3 before that, some users may need to type python or py -3 instead of python3)

If, for example, the command above is launched from K:\mirrordl\ the resulting files will be placed in K:\mirrordl\Beater\Doujins\. Files already existing on disk are skipped.

The script is tested on vc.5ur3kg.gq. It may work for other websites using the same frontend, but this is in no way guaranteed.

Advanced options

  • --regex RegexExpression
    Only process URLs for which RegexExpression has a match.

  • --condition PythonExpression
    Allows complex conditions based on the results of the RegEx match. Requires --regex. Match object is exposed via the match variable. When omitted, the condition assumed to be the equivalent to bool(match).

Examples:

  • python3 vcmirrordl.py --regex "Briefs" https://vc.5ur3kg.gq/Beater/Fantia
  • python3 vcmirrordl.py --regex "Fantia/([0-9]+)" --condition "int(match[1])>750000" https://vc.5ur3kg.gq/Beater/Fantia

Note that --condition is limited by your Python version. Most notably, match[idx] syntax will only work on Python 3.6 and newer, for 3.5 you'll have to be more verbose (match.group(idx)).

Demo

tba

Changelog

  • 2022.02.04b. Fixed url escaping when downloading from vc. mirror
  • 2022.01.26a. Added vcmirrordl.py to enable downloads from the vc. mirror
  • 2021.08.30. Added support for complex RegEx-based filters
  • 2021.08.03. Public release. No code changes compared to 2021.08.02b
  • 2021.08.02b. Public beta. Fixed some of the error handling
  • 2021.08.02a. Initial alpha build. Fixed running in memory-constrained environments (< 256 MiB RAM)
  • 2021.08.01a. Development started