Skip to content

A Reasonably fast pixiv fanbox.cc downloader and indexer

License

Notifications You must be signed in to change notification settings

Ristellise/garnet

Repository files navigation

Garnet

Internal Project name: Erossmann

What?

Garnet is a simple and fast pixiv fanbox.cc downloader.

Why?

The previous downloader had 2 glaring issues:

  • Uses requests. Although it's possible to do with threads, asyncio & aiohttp can achieve greater speeds.
  • The code looked overly complicated for a simple fanbox.cc downloader.

The script is split into 2 parts. Theindexer.pyanddownloader.py.For Inde xing and Downloading.

Requirements

Requires Python 3.7 or greater. Personally I used Python 3.10.

You may install via:
pip install -r requirements.txt

or install it manually by:
pip install tqdm aiohttp aiofiles orjson PyYAML

Usage

Figure it out yourself. Should be rather simple though:

  1. Set your fanbox.cc cookie, set the users you want to scrape.
  2. Rename theConfig.sample.yamlto justConfig.yaml.Remove the.samplewould do.
  3. Install required dependencies.
  4. RunIndexer.py
  5. RunDownloader.py
  6. See your results inwork-pathspecified in the YAML config.

Other notes

  • The script does script page and attempts to convert to Markdown. But it does not do style text as of now. I do eventually want to relook at it. But for now it works.

License

As you can tell from the side, it's LGPL 3.0.