Updates redisearch instance with igdb data used for kimosabe

Last update: Jul 30, 2021

Related tags

Overview

igdb-pdt

Update RediSearch with IGDB games data in the following Format:

{
  "game_slug": {
    "name": "game_name",
    "cover": "igdb_coverart_url",
    "thumb": "igdb_thumbart_url",
    "summary": "summary text",
    "alt_names_%i": "alt_name_i"
  }
}

The only games that are pulled in by this script have the following properties:

lan, offline, or online co-op
category of 0 (base game) or 9 (remaster)

Note: Only the name, alt_names, and summary are used as fields that impact the search, with weights 10, 10, and 1 respectively.

Usage

CLIENT_ID=client_id; CLIENT_SECRET=client_secret; ./populate_db.py

Flags

--mock: gets data from data.json file instead of IGDB.
--persist: save to RediSearch.
--output: display data from IGDB to console. (used for creating mock data.json via ./populate_db.py --output > data.json)

Environment Variables

CLIENT_ID: Client ID for IGDB. Required if not using mock file.
CLIENT_SECRET: Client Secret for IGDB. Required if not using mock file.
REDIS_HOSTNAME: Hostname for Redis instance. Required.
REDIS_PORT: Port of Redis. Defaults to 6379.

Docker image

Runs script every day at 2:30 AM via cronjob.

TODO

add support for caching authorization token, and only refreshing if expired, otherwise keep it
seperate logging and output

Comments

[Snyk] Security upgrade python from 3.8.8-slim to 3.8.10-slim
Keeping your Docker base image up-to-date means you’ll benefit from security fixes in the latest version of your chosen image.

Changes included in this PR

Dockerfile

We recommend upgrading to python:3.8.10-slim, as this image has only 68 known vulnerabilities. To do this, merge this pull request, then verify your application still works as expected.

Some of the most important vulnerabilities in your base image include:

| Severity | Priority Score / 1000 | Issue | Exploit Maturity | | :------: | :-------------------- | :---- | :--------------- | | | 714 | Information Exposure
SNYK-DEBIAN10-LIBGCRYPT20-1297893 | No Known Exploit | | | 500 | Privilege Chaining
SNYK-DEBIAN10-SYSTEMD-345386 | No Known Exploit | | | 500 | Privilege Chaining
SNYK-DEBIAN10-SYSTEMD-345386 | No Known Exploit | | | 500 | Incorrect Privilege Assignment
SNYK-DEBIAN10-SYSTEMD-345391 | No Known Exploit | | | 500 | Incorrect Privilege Assignment
SNYK-DEBIAN10-SYSTEMD-345391 | No Known Exploit |

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information: 🧐 View latest project report

🛠 Adjust project settings
opened by snyk-bot 1
[Snyk] Security upgrade python from 3.8.8-slim to 3.9.5-slim
Keeping your Docker base image up-to-date means you’ll benefit from security fixes in the latest version of your chosen image.

Changes included in this PR

Dockerfile

We recommend upgrading to python:3.9.5-slim, as this image has only 68 known vulnerabilities. To do this, merge this pull request, then verify your application still works as expected.

Some of the most important vulnerabilities in your base image include:

| Severity | Priority Score / 1000 | Issue | Exploit Maturity | | :------: | :-------------------- | :---- | :--------------- | | | 714 | Information Exposure
SNYK-DEBIAN10-LIBGCRYPT20-1297893 | No Known Exploit | | | 500 | Privilege Chaining
SNYK-DEBIAN10-SYSTEMD-345386 | No Known Exploit | | | 500 | Privilege Chaining
SNYK-DEBIAN10-SYSTEMD-345386 | No Known Exploit | | | 500 | Incorrect Privilege Assignment
SNYK-DEBIAN10-SYSTEMD-345391 | No Known Exploit | | | 500 | Incorrect Privilege Assignment
SNYK-DEBIAN10-SYSTEMD-345391 | No Known Exploit |

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information: 🧐 View latest project report

🛠 Adjust project settings
opened by snyk-bot 0
[Snyk] Security upgrade python from 3.8.8-slim to 3-slim
Keeping your Docker base image up-to-date means you’ll benefit from security fixes in the latest version of your chosen image.

Changes included in this PR

Dockerfile

We recommend upgrading to python:3-slim, as this image has only 68 known vulnerabilities. To do this, merge this pull request, then verify your application still works as expected.

Some of the most important vulnerabilities in your base image include:

| Severity | Priority Score / 1000 | Issue | Exploit Maturity | | :------: | :-------------------- | :---- | :--------------- | | | 714 | Information Exposure
SNYK-DEBIAN10-LIBGCRYPT20-1297893 | No Known Exploit | | | 500 | Privilege Chaining
SNYK-DEBIAN10-SYSTEMD-345386 | No Known Exploit | | | 500 | Privilege Chaining
SNYK-DEBIAN10-SYSTEMD-345386 | No Known Exploit | | | 500 | Incorrect Privilege Assignment
SNYK-DEBIAN10-SYSTEMD-345391 | No Known Exploit | | | 500 | Incorrect Privilege Assignment
SNYK-DEBIAN10-SYSTEMD-345391 | No Known Exploit |

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information: 🧐 View latest project report

🛠 Adjust project settings
opened by snyk-bot 0
[Snyk] Security upgrade python from 3.8.5-slim to 3.8.8-slim
Keeping your Docker base image up-to-date means you’ll benefit from security fixes in the latest version of your chosen image.

Changes included in this PR

Dockerfile

We recommend upgrading to python:3.8.8-slim, as this image has only 64 known vulnerabilities. To do this, merge this pull request, then verify your application still works as expected.

Some of the most important vulnerabilities in your base image include:

| Severity | Priority Score / 1000 | Issue | Exploit Maturity | | :------: | :-------------------- | :---- | :--------------- | | | 571 | Use After Free
SNYK-DEBIAN10-GNUTLS28-1085094 | No Known Exploit | | | 571 | Use After Free
SNYK-DEBIAN10-GNUTLS28-1085097 | No Known Exploit | | | 571 | Incorrect Default Permissions
SNYK-DEBIAN10-LIBZSTD-1080893 | No Known Exploit | | | 571 | Incorrect Default Permissions
SNYK-DEBIAN10-LIBZSTD-1080899 | No Known Exploit | | | 714 | Integer Overflow or Wraparound
SNYK-DEBIAN10-OPENSSL-1075326 | No Known Exploit |

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information: ?? View latest project report

🛠 Adjust project settings
opened by snyk-bot 0
[Snyk] Security upgrade aiohttp from 3.6.2 to 3.7.4
Snyk has created this PR to fix one or more vulnerable packages in the `pip` dependencies of this project.

Changes included in this PR

Changes to the following files to upgrade the vulnerable dependencies to a fixed version:

requirements.txt

Vulnerabilities that will be fixed

By pinning:

Severity | Priority Score (*) | Issue | Upgrade | Breaking Change | Exploit Maturity :-------------------------:|-------------------------|:-------------------------|:-------------------------|:-------------------------|:------------------------- | 435/1000
Why? Has a fix available, CVSS 4.2 | Open Redirect
SNYK-PYTHON-AIOHTTP-1079232 | aiohttp:
3.6.2 -> 3.7.4
| No | No Known Exploit

(*) Note that the real score may have changed since the PR was raised.

Some vulnerabilities couldn't be fully fixed and so Snyk will still find them when the project is tested again. This may be because the vulnerability existed within more than one direct dependency, but not all of the effected dependencies could be upgraded.

Check the changes in this PR to ensure they won't cause issues with your project.

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information: 🧐 View latest project report

🛠 Adjust project settings

📚 Read more about Snyk's upgrade and patch logic
opened by snyk-bot 0
[Snyk] Security upgrade python from 3.9.5 to 3.12.0a3
Keeping your Docker base image up-to-date means you’ll benefit from security fixes in the latest version of your chosen image.

Changes included in this PR

Dockerfile

We recommend upgrading to python:3.12.0a3, as this image has only 272 known vulnerabilities. To do this, merge this pull request, then verify your application still works as expected.

Some of the most important vulnerabilities in your base image include:

| Severity | Priority Score / 1000 | Issue | Exploit Maturity | | :------: | :-------------------- | :---- | :--------------- | | | 714 | Directory Traversal
SNYK-DEBIAN10-DPKG-2847944 | No Known Exploit | | | 714 | Buffer Overflow
SNYK-DEBIAN10-OPENSSL-1569403 | No Known Exploit | | | 714 | OS Command Injection
SNYK-DEBIAN10-OPENSSL-2807585 | No Known Exploit | | | 714 | OS Command Injection
SNYK-DEBIAN10-OPENSSL-2933515 | No Known Exploit | | | 714 | Integer Overflow or Wraparound
SNYK-DEBIAN10-PYTHON37-3090928 | No Known Exploit |

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information: 🧐 View latest project report

🛠 Adjust project settings

Learn how to fix vulnerabilities with free interactive lessons:

🦉 Learn about vulnerability in an interactive lesson of Snyk Learn.
opened by snyk-bot 0
[Snyk] Security upgrade python from 3.9.5 to 3.9.15
Keeping your Docker base image up-to-date means you’ll benefit from security fixes in the latest version of your chosen image.

Changes included in this PR

Dockerfile

We recommend upgrading to python:3.9.15, as this image has only 295 known vulnerabilities. To do this, merge this pull request, then verify your application still works as expected.

Some of the most important vulnerabilities in your base image include:

| Severity | Priority Score / 1000 | Issue | Exploit Maturity | | :------: | :-------------------- | :---- | :--------------- | | | 714 | Directory Traversal
SNYK-DEBIAN10-DPKG-2847944 | No Known Exploit | | | 714 | Buffer Overflow
SNYK-DEBIAN10-OPENSSL-1569403 | No Known Exploit | | | 714 | OS Command Injection
SNYK-DEBIAN10-OPENSSL-2807585 | No Known Exploit | | | 714 | OS Command Injection
SNYK-DEBIAN10-OPENSSL-2933515 | No Known Exploit | | | 614 | Improper Input Validation
SNYK-DEBIAN10-XZUTILS-2444279 | No Known Exploit |

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information: 🧐 View latest project report

🛠 Adjust project settings

Learn how to fix vulnerabilities with free interactive lessons:

🦉 Learn about vulnerability in an interactive lesson of Snyk Learn.
opened by snyk-bot 0
[Snyk] Security upgrade python from 3.9.5 to 3.10.7
Keeping your Docker base image up-to-date means you’ll benefit from security fixes in the latest version of your chosen image.

Changes included in this PR

Dockerfile

We recommend upgrading to python:3.10.7, as this image has only 281 known vulnerabilities. To do this, merge this pull request, then verify your application still works as expected.

Some of the most important vulnerabilities in your base image include:

| Severity | Priority Score / 1000 | Issue | Exploit Maturity | | :------: | :-------------------- | :---- | :--------------- | | | 714 | Directory Traversal
SNYK-DEBIAN10-DPKG-2847944 | No Known Exploit | | | 714 | Buffer Overflow
SNYK-DEBIAN10-OPENSSL-1569403 | No Known Exploit | | | 714 | OS Command Injection
SNYK-DEBIAN10-OPENSSL-2807585 | No Known Exploit | | | 714 | OS Command Injection
SNYK-DEBIAN10-OPENSSL-2933515 | No Known Exploit | | | 614 | Improper Input Validation
SNYK-DEBIAN10-XZUTILS-2444279 | No Known Exploit |

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information: 🧐 View latest project report

🛠 Adjust project settings

Learn how to fix vulnerabilities with free interactive lessons:

🦉 Learn about vulnerability in an interactive lesson of Snyk Learn.
opened by snyk-bot 0
[Snyk] Security upgrade aiohttp from 3.7.4 to 3.8.0
This PR was automatically created by Snyk using the credentials of a real user.

Snyk has created this PR to fix one or more vulnerable packages in the `pip` dependencies of this project.

Changes included in this PR

Changes to the following files to upgrade the vulnerable dependencies to a fixed version:

requirements.txt

Vulnerabilities that will be fixed

By pinning:

Severity | Priority Score (*) | Issue | Upgrade | Breaking Change | Exploit Maturity :-------------------------:|-------------------------|:-------------------------|:-------------------------|:-------------------------|:------------------------- | 686/1000
Why? Proof of Concept exploit, Has a fix available, CVSS 7.3 | HTTP Header Injection
SNYK-PYTHON-AIOHTTP-1584144 | aiohttp:
3.7.4 -> 3.8.0
| No | Proof of Concept

(*) Note that the real score may have changed since the PR was raised.

Some vulnerabilities couldn't be fully fixed and so Snyk will still find them when the project is tested again. This may be because the vulnerability existed within more than one direct dependency, but not all of the affected dependencies could be upgraded.

Check the changes in this PR to ensure they won't cause issues with your project.

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information: 🧐 View latest project report

🛠 Adjust project settings

📚 Read more about Snyk's upgrade and patch logic

Learn how to fix vulnerabilities with free interactive lessons:

🦉 Learn about vulnerability in an interactive lesson of Snyk Learn.
opened by ZRui98 0
[Snyk] Security upgrade python from 3.9.5 to 3.9.13
Keeping your Docker base image up-to-date means you’ll benefit from security fixes in the latest version of your chosen image.

Changes included in this PR

Dockerfile

We recommend upgrading to python:3.9.13, as this image has only 289 known vulnerabilities. To do this, merge this pull request, then verify your application still works as expected.

Some of the most important vulnerabilities in your base image include:

| Severity | Priority Score / 1000 | Issue | Exploit Maturity | | :------: | :-------------------- | :---- | :--------------- | | | 714 | Directory Traversal
SNYK-DEBIAN10-DPKG-2847944 | No Known Exploit | | | 714 | Buffer Overflow
SNYK-DEBIAN10-OPENSSL-1569403 | No Known Exploit | | | 714 | OS Command Injection
SNYK-DEBIAN10-OPENSSL-2807585 | No Known Exploit | | | 714 | OS Command Injection
SNYK-DEBIAN10-OPENSSL-2933515 | No Known Exploit | | | 614 | Improper Input Validation
SNYK-DEBIAN10-XZUTILS-2444279 | No Known Exploit |

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information: 🧐 View latest project report

🛠 Adjust project settings

Learn how to fix vulnerabilities with free interactive lessons:

🦉 Learn about vulnerability in an interactive lesson of Snyk Learn.
opened by snyk-bot 0
[Snyk] Security upgrade python from 3.9.5 to 3.11.0rc2
Keeping your Docker base image up-to-date means you’ll benefit from security fixes in the latest version of your chosen image.

Changes included in this PR

Dockerfile

We recommend upgrading to python:3.11.0rc2, as this image has only 278 known vulnerabilities. To do this, merge this pull request, then verify your application still works as expected.

Some of the most important vulnerabilities in your base image include:

| Severity | Priority Score / 1000 | Issue | Exploit Maturity | | :------: | :-------------------- | :---- | :--------------- | | | 714 | Directory Traversal
SNYK-DEBIAN10-DPKG-2847944 | No Known Exploit | | | 714 | Buffer Overflow
SNYK-DEBIAN10-OPENSSL-1569403 | No Known Exploit | | | 714 | OS Command Injection
SNYK-DEBIAN10-OPENSSL-2807585 | No Known Exploit | | | 714 | OS Command Injection
SNYK-DEBIAN10-OPENSSL-2933515 | No Known Exploit | | | 614 | Improper Input Validation
SNYK-DEBIAN10-XZUTILS-2444279 | No Known Exploit |

Note: You are seeing this because you or someone else with access to this repository has authorized Snyk to open fix PRs.

For more information: 🧐 View latest project report

🛠 Adjust project settings

Learn how to fix vulnerabilities with free interactive lessons:

🦉 Learn about vulnerability in an interactive lesson of Snyk Learn.
opened by snyk-bot 0

Releases(v0.5.3)

v0.5.3(Jul 30, 2021)
upgrade to python-3.9.5 docker image

Source code(tar.gz)
Source code(zip)
v0.5.2(Apr 25, 2021)
Fix broken data.json file

Source code(tar.gz)
Source code(zip)
v0.5.1(Apr 8, 2021)
Add remasters to the games pulled from IGDB

Source code(tar.gz)
Source code(zip)
v0.5.0(Apr 3, 2021)
Add alternative_names to search

Each alternative name is weighted 10

Source code(tar.gz)
Source code(zip)
v0.4.4(Apr 2, 2021)
Bumped aiohttp version

Update python docker image

Source code(tar.gz)
Source code(zip)
v0.4.3(Mar 7, 2021)
fix errors caused by api rate limit of 4 reqs/s through sleep

filter out dlcs through category option, where 0 = base game

Source code(tar.gz)
Source code(zip)
v0.4.2(Oct 10, 2020)
fix bad spacing in yaml cfg

Source code(tar.gz)
Source code(zip)
v0.4.1(Oct 10, 2020)
fix gh action config

Source code(tar.gz)
Source code(zip)
v0.4(Oct 10, 2020)
migrate from IGDB v3 to v4

Source code(tar.gz)
Source code(zip)
v0.3.2(Oct 10, 2020)
fix minor issue with github action

Source code(tar.gz)
Source code(zip)
v0.3.1(Oct 10, 2020)
fix bugs introduced in last release around environment variables

Source code(tar.gz)
Source code(zip)
v0.3.0(Sep 11, 2020)
Changes:

igdb id -> game slug for id

add summary string

add thumbnail coverart

Source code(tar.gz)
Source code(zip)
v0.2.0(Aug 24, 2020)
Add support for offset > 5000

Include game_mode in query

Source code(tar.gz)
Source code(zip)
v0.1.0(Aug 23, 2020)

Initial Release. Support for caching name and cover art for co-op games.
Source code(tar.gz)
Source code(zip)

Owner

6rotoms

GitHub Repository

Updates redisearch instance with igdb data used for kimosabe

Related tags

Overview

igdb-pdt

Usage

Flags

Environment Variables

Docker image

TODO

Comments

Changes included in this PR

Changes included in this PR

Changes included in this PR

Changes included in this PR

Snyk has created this PR to fix one or more vulnerable packages in the `pip` dependencies of this project.

Changes included in this PR

Vulnerabilities that will be fixed

By pinning:

Changes included in this PR

Changes included in this PR

Changes included in this PR

Snyk has created this PR to fix one or more vulnerable packages in the `pip` dependencies of this project.

Changes included in this PR

Vulnerabilities that will be fixed

By pinning:

Changes included in this PR

Changes included in this PR

Releases(v0.5.3)

v0.5.3(Jul 30, 2021)

v0.5.2(Apr 25, 2021)

v0.5.1(Apr 8, 2021)

v0.5.0(Apr 3, 2021)

v0.4.4(Apr 2, 2021)

v0.4.3(Mar 7, 2021)

v0.4.2(Oct 10, 2020)

v0.4.1(Oct 10, 2020)

v0.4(Oct 10, 2020)

v0.3.2(Oct 10, 2020)

v0.3.1(Oct 10, 2020)

v0.3.0(Sep 11, 2020)

v0.2.0(Aug 24, 2020)

v0.1.0(Aug 23, 2020)

Owner

6rotoms

It takes time to start a Django Project and make it almost production-ready.

Django backend of Helium's planner application

Store events and publish to Kafka

Py-instant-search-redis - Source code example for how to build an instant search with redis in python

The new Python SDK for Sentry.io

A blog app powered by python-django

Custom Django field for using enumerations of named constants

Awesome Django Blog App

Django server-side adapter for Inertia.js

Comprehensive Markdown plugin built for Django

Easily share data across your company via SQL queries. From Grove Collab.

Helps working with singletons - things like global settings that you want to edit from the admin site.

Redia Cache implementation in django.

Simple XML-RPC and JSON-RPC server for modern Django

Django friendly finite state machine support

Fast / fuzzy PostgreSQL counts for Django

Store model history and view/revert changes from admin site.

Utilities for implementing a modified pre-order traversal tree in django.

Rosetta is a Django application that eases the translation process of your Django projects

PEP-484 type hints bindings for the Django web framework