Download all games from a public Itch.io Game Jam

Last update: Dec 07, 2022

Related tags

Downloader itch-dl

Overview

Itch Jam Downloader

Downloads all games from a public Itch.io Game Jam.

What you'll need:

Python 3.8+
pip install -r requirements.txt
For site mirroring, wget in your PATH.

On Arch, pacman -S wget python python-requests python-slugify works.

How to use this:

Go to your jam's page, ex. https://itch.io/jam/gbcompo21 and right-click -> View Source.
Ctrl-F for "id": - it should find that text once, followed by a number. Write it down.
(It you found it multiple times, grab the one after ViewJam something something.)
Download https://itch.io/jam/NUMBER/entries.json (replacing NUMBER with what you wrote down)
Generate a new API key on your user account page: https://itch.io/user/settings/api-keys
Run the downloader: python downloader.py --api-key entries.json
Wait. This is going to take a while.

The downloader is able to grab more or less everything you can download via the itch app.

It's expected that the downloader output will not be complete - logs are stupidly verbose and it prints a report on successful/failed downloads, so you must manually grab whatever was not handled for you automatically for some reason.

The downloader also grabs the entry page HTML, which usually comes with controls and such. It does not download images, external assets and so on, just the text - if the Itch page dies, so will most elements on those downloaded pages. Controls should survive, though.

(There's a pedantic mirroring toggle in the script, if you know what you're doing though.)

You might also like...

You Can download any video/image in all social medias very easy and High Speed.

All-Downloader You Can download any video/image in all social medias very easy and High Speed. also you can easily download videos from web browsers s

14 Dec 16, 2022

Python module to download all media from a CyberDrop gallery.

CyberDrop Downloader Intro Let's suppose you found out the Eva G (bby_gee) leak on https://cyberdrop.me/a/aWAt4TWY. You wish you could download the en

1 Dec 12, 2021

Python module to download all media from a GoFile gallery.

GoFile Downloader Setup First of all, clone this repository : ~$ git clone https://github.com/quatrecentquatre-404/gofile-downloader Second, oh wait..

61 Jan 1, 2023

👻🟡 Download all Snapchat video & photo memories from a data export.

Snapchat "Memories" Fetcher In compliance with the California Consumer Privacy Act of 2018 (“CCPA”), businesses which collect and store user data must

18 Dec 26, 2022

Heroic-gogdl - GOG Downloading module for Heroic Games Launcher

heroic-gogdl GOG download module for Heroic Games Launcher Purpose This will tak

36 Dec 23, 2022

Simple tool downloads public PoC (refer from nomi-sec)

PoC Collection This is the little script to collect the proof-of-concept which is refered from nomi-sec. The repository now is only develop for linux-

2 Aug 17, 2022

A modern CLI to download animes automatically from Twist

Kurby Kurby is a nice and simple CLI that use Twist website, and their huge collection to download animes for free and automatically Animes from Twist

48 Dec 22, 2022

Download courses from khanacademy.org

khan-dl A python script to download courses from Khan Academy using youtube-dl and beautifulsoup4.

806 Jan 3, 2023

1Fichier Download Manager.

1fichier-dl 1Fichier Download Manager. Features ⭐ Manage your downloads ⭐ Bypass time limits Credits All icons, including the app icon, were provided

470 Oct 8, 2022

Comments

NotImplementedError: Unknown infobox block name 'Category'

Hi!

INFO:root:Downloading https://andreipasynkov.itch.io/upandown
Traceback (most recent call last):
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
    exec(code, run_globals)
  File "/tmp/itch-dl/itch_dl/__main__.py", line 3, in <module>
    run()
  File "/tmp/itch-dl/itch_dl/cli.py", line 68, in run
    return drive_downloads(jobs, download_to, args.mirror_web, args.api_key, keys, parallel=args.parallel)
  File "/tmp/itch-dl/itch_dl/downloader.py", line 350, in drive_downloads
    results = [downloader.download(job) for job in tqdm(jobs, **tqdm_args)]
  File "/tmp/itch-dl/itch_dl/downloader.py", line 350, in <listcomp>
    results = [downloader.download(job) for job in tqdm(jobs, **tqdm_args)]
  File "/tmp/itch-dl/itch_dl/downloader.py", line 240, in download
    metadata = self.extract_metadata(game_id, url, site)
  File "/tmp/itch-dl/itch_dl/downloader.py", line 149, in extract_metadata
    infobox = parse_infobox(infobox_div)
  File "/tmp/itch-dl/itch_dl/infobox.py", line 116, in parse_infobox
    parsed_block = parse_tr(name, content_td)
  File "/tmp/itch-dl/itch_dl/infobox.py", line 100, in parse_tr
    raise NotImplementedError(f"Unknown infobox block name '{name}' - please file a new itch-dl issue.")
NotImplementedError: Unknown infobox block name 'Category' - please file a new itch-dl issue.

...so I did! Got this from https://itch.io/jam/game-boy-showdown.

opened by ISSOtm 2

Open JSON files in binary mode

This avoids any encoding errors caused by JSON files containing non-ASCII characters (e.g. emojis).

I'm not sure if this encoding issue occurs just on Windows (the corresponding stack trace stems from CP-1252), but I think opening the file in binary mode is the right way to go anyway.

For reference, here's the traceback logged when trying to load a file which has some emojis in the JSON:

Traceback (most recent call last):
  File "itch-dl\venv\Scripts\itch-dl", line 5, in <module>
    run()
  File "itch-dl\itch_dl\cli.py", line 60, in run
    jobs = get_jobs_for_url_or_path(args.url_or_path, settings)
  File "itch-dl\itch_dl\handlers.py", line 191, in get_jobs_for_url_or_path
    return get_jobs_for_path(path_or_url)
  File "itch-dl\itch_dl\handlers.py", line 154, in get_jobs_for_path
    json_data = json.load(f)
  File "C:\Python310\lib\json\__init__.py", line 293, in load
    return loads(fp.read(),
  File "C:\Python310\lib\encodings\cp1252.py", line 23, in decode
    return codecs.charmap_decode(input,self.errors,decoding_table)[0]
UnicodeDecodeError: 'charmap' codec can't decode byte 0x8f in position 22612: character maps to <undefined>

opened by jackwilsdon 1

Allow toggling Download Key caching

It's possible to query the API for any available Download Keys directly for a Game ID, instead of downloading them all before the fact. This would be faster for a small amount of titles to download, especially if the user has a ton of purchased/claimed games.

opened by DragoonAethis 0

Releases(0.3.2)

0.3.2(Nov 1, 2022)
Add support for infobox "Code license" entries (closes #6)

Open game jam JSON files in binary mode (thanks to @jackwilsdon)

Source code(tar.gz)
Source code(zip)
0.3.1(Jun 12, 2022)

Forgot to git add a new source file to 0.3.0, this one's a bit more functional.
Source code(tar.gz)
Source code(zip)
0.3.0(Jun 12, 2022)
Added Settings - it's now possible to permanently set an API key instead of providing it every single time on the command line. (Using the config file is not mandatory.)

itch-dl now depends on Pydantic for config file validation.

The User Agent is now being set to python-requests/{version} itch-dl/{version} by default. This is configurable.

Misc cleanups, typing fixes and more descriptive error messages with wiki links.

Source code(tar.gz)
Source code(zip)
0.2.1(May 30, 2022)
Fixed handling Categories in title infoboxes. (Fixes #1.)

Fixed downloading files with no size specified in their upload metadata.

Source code(tar.gz)
Source code(zip)
0.2.0(May 15, 2022)

First release that isn't a hack! It should work pretty well for basic scenarios (browse pages, game jams) now.
Source code(tar.gz)
Source code(zip)

Owner

Dragoon Aethis

GitHub Repository

Python code to crawl computer vision papers from top CV conferences. Currently it supports CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, SIGGRAPH

Python code to crawl computer vision papers from top CV conferences. Currently it supports CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, SIGGRAPH. It leverages selenium, a website testing framework to crawl

39 Nov 21, 2022

A simple python script and it's used for mp4 type video downloading from youtube.

This is a simple python script and it's used for mp4 type video downloading from youtube. also, it's used inbuilt python module pytube. Furthermore, I know we have so many apps and online websites to

1 Jan 10, 2022

Bulk Downloader for Reddit

saveddit is a bulk media downloader for reddit pip3 install saveddit Setting up authorization Register an application with Reddit Write down your clie

136 Jan 03, 2023

Python youtube playlist downloader

Youtube-Playlist-Downloader-python 👍 This program is a simple Youtube playlist downloader where you input the playlist link, and then the desired pat

2 Dec 25, 2021

A Spotify downloader needing only a python interpreter and ffmpeg.

ZSpotify A Spotify downloader needing only a python interpreter and ffmpeg. Discord Server - Matrix Server - Gitea Mirror - Main Site Requirements: B

2.4k Dec 14, 2021

Archivist - Easily archive 📦 Download folder to Google Drive ☁️

Archivist Script for archiving Download folder by uploading unmodified files to a Google Drive folder. Modified files will remain in the Download fold

3 Sep 30, 2022

Download candlestick data fast & easy for analysis

crypto-candlesticks 📈 The goal behind this project is to facilitate downloading cryptocurrency candlestick data fast & simple. Currently only the Bit

31 Dec 11, 2022

A simple kemono.party downloader using python.

kemono-dl This is a simple kemono.party downloader. How to use Install python Download source code from releases and extract it Then install requireme

318 Dec 27, 2022

This is a tool to allow downloading any links from r/Roms Magethread

ILYFPR This is a tool to allow downloading any links from r/Roms Magethread Limitations: It downloads ALL roms of the system you choose. This will be

4 Nov 04, 2021

Um projeto modesto para baixar vídeos do youtube usando tkinter como gui

Youtube Downloader Um projeto modesto para baixar vídeos do youtube usando tkinter como gui Instalação dos requirements: python3 setup.py ou python se

2 Nov 25, 2021

Python based YouTube video Downloader GUI Application.

Youtube video Downloader Python based Youtube video Downloader GUI Application. Installation Python Dependencies Import pytube pip install pytube Im

1 Jan 03, 2022

Ebook downloader built using python

ebook-downloader Getting Started Open a terminal and run the following commands. git clone github.com/georgemunyoro/ebook-downloader cd ./ebook-downlo

1 Oct 19, 2021

Download all your URI Online Judge source codes and upload to GitHub with simple steps.

URI-Code-Downloader Download all your URI Online Judge source codes and upload to GitHub with simple steps. Prerequisites Python 3.x Installing Downlo

9 Mar 23, 2022

Tkinter based YouTube video downloader works on pytube 11.0.2. Can download YouTube videos in 720p(HD), 144p and even only audio.

YouTube-Downloader Tkinter based YouTube video downloader works on pytube 11.0.2. Can download YouTube videos in 720p(HD), 144p and even only audio. G

2 Dec 27, 2021

Download YouTube videos that are available in the given playlist

Youtube-Playlist-Downloader Download YouTube videos that are available in the given playlist Project assets: music downloaded music folder. (will be g

1 Dec 22, 2021

Parallels Desktop dmg downloader

parallelsdesktop-dl Parallels Desktop dmg file downloader Usage usage: pd-dl [-h] [--dlv [DLV]] [-v] Parallels Desktop downloader optional arguments

2 Sep 13, 2022

A collection of modules I have created to programmatically search for/download imagery from live cam feeds across the state of California.

A collection of modules that I have created to programmatically search for/download imagery from all publicly available live cam feeds across the state of California. In no way am I affiliated with a

5 Nov 21, 2022