Webservice wrapper for hhursev/recipe-scrapers (python library to scrape recipes from websites)

Overview

recipe-scrapers-webservice

This is a wrapper for hhursev/recipe-scrapers which provides the api as a webservice, to be consumed as a microservice by other languages.

Usage

docker compose

version: "2.1"
services:
  recipe-scrapers-webservice:
    image: ghcr.io/steve192/recipe-scrapers-webservice
    container_name: recipe-scrapers-webservice
    ports:
      - 9090:9090
    restart: unless-stopped

docker cli

    docker run -d \
        --name=recipe-scrapers-webservice \
        -p 9090:9090 \
        --restart unless-stopped \
        ghcr.io/steve192/recipe-scrapers-webservice

Routes

/api/v1/scrape-recipe?url=
responds with

{
	"author": "AuthorHere",
	"category": "CategoryHere",
	"cook_time": "100",
	"cuisine": "French",
	"host": "recipehost.com",
	"imgage": "https://recipehost.com/image-for-recipe.jpg",
	"ingredients": ["10 g Ingredients1", "20g Ingredients2"],
	"instructions": "Instructions to the recipe\nSeparated by newlines",
	"language": "de",
	"links": [],
	"nutrients": {
		"calories": "631 kcal",
		"carbohydrateContent": "69 g",
		"fatContent": "26 g",
		"proteinContent": "14 g",
		"saturatedFatContent": "6 g",
		"servingSize": "504",
		"sodiumContent": "2 g",
		"sugarContent": "5 g"
	},
	"prep_time": "",
	"ratings": "",
	"title": "Title to a delicious recipe",
	"total_time": 30,
	"yields": "2 serving(s)"
}
Comments
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.25

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.25

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.25.0

    Adds support for:

    Thank you, @​brett @​NijeboerFrank!

    Commits
    • baf3403 Bump version to 14.25.0
    • 607ab04 Add Project Gezond scraper (Dutch Website) (#691)
    • 05a04a8 add sunset.com (#690)
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • b95290c Add handletheheat.com (#680)
    • 3594e02 Add southerncastiron (#679)
    • d6e0fe7 pre-commit configuration: migrate source of flake8 from gitlab.com (no-longer...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.24

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.24

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.24.0

    Adds support for:

    • #679 - southerncastiron.com
    • #680 - handletheheat.com

    Fixes:

    • #661 - TypeError on mob.co.uk
    • #687 - Site updates for amazingribs.com

    Credits: @​brett @​jayaddison

    Commits
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • b95290c Add handletheheat.com (#680)
    • 3594e02 Add southerncastiron (#679)
    • d6e0fe7 pre-commit configuration: migrate source of flake8 from gitlab.com (no-longer...
    • c954e1a Bump version to 14.23.0
    • 05d51d7 Address the lecker and simplycookit scrapers issues.
    • 9a798ee added simplycookit scraper (#618)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): bump alpine from 3.15 to 3.17.0

    build(deps): bump alpine from 3.15 to 3.17.0

    Bumps alpine from 3.15 to 3.17.0.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 1
  • build(deps): bump alpine from 3.15 to 3.16.3

    build(deps): bump alpine from 3.15 to 3.16.3

    Bumps alpine from 3.15 to 3.16.3.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.23

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.23

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.23.0

    Adds support for:

    • creativecanning.com
    • lecker.de
    • simply-cookit.com

    Removes support for:

    • sallys-blog.de

    Updates a bunch of preexisting scrapers with #676.

    Creds @​vabene1111 @​hhursev

    Commits
    • c954e1a Bump version to 14.23.0
    • 05d51d7 Address the lecker and simplycookit scrapers issues.
    • 9a798ee added simplycookit scraper (#618)
    • 2e58592 Fix lecker.de articles (#611)
    • fa31236 Reduce the amount of wording in the GitHub 'new issue' templates (#651)
    • fa61cf2 System health. Scrapers needed polishing (#676)
    • 1582886 Exclude macos and win py 3.11 from matrix again
    • 628b375 Use Python 3.11 in CI. Run macos and win w/ python 3.11 - don't mark whole jo...
    • 1d07ae9 Update README and bump version
    • 954c5c6 Issue 646/scraper weightwatchers (#657)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.21

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.21

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.21.0

    Housekeeping / development / maintenance release :broom:

    • Introduce tox as a standard mechanism to run isolated unit tests and linting workflows (#650)
    • Introduce pyproject.toml for project metadata (#655)
    • Remove the test_settings_module (#663)
    • Remove pytest and unittest-parallel development-time dependencies (#659, #660, 991b1d1784711bf1276ab74763e4e11c46649ee1)
    • Switch unit test scraper setup from per-test-method to per-test-case (#668)
    • Refactor the SchemaOrg parser (#671)
    • Fixup: incorrect start-URL in scraper test (b5f84adc0cfd2da2d645e43a321b39c7da10d4e8)

    This release should have little-to-no effect on usage of the library (it's intended to be backwards compatible) - however, bug / issue reports appreciated, as always!

    Commits
    • e23154a Bump version to 14.21.0
    • e7f7a90 Refactor: schema.org parser (#671)
    • 743d7cd Revert "Fixup: remove overwrite of schema.org data with 'mainEntity' contents...
    • aacd321 Modernization: introduce pyproject.toml for setuptools configuration (#655)
    • 2c3e0e8 Unit tests: move scraper construction from setUp (per-method) to setUpClass (...
    • b5f84ad Fixup: test-mode startURL for test_gousto
    • 557cfd9 Fixup: remove overwrite of schema.org data with 'mainEntity' contents during ...
    • d839b76 Cleanup: remove test_settings_module (#663)
    • 1526b32 Consolidate linting configuration (#662)
    • 991b1d1 Fixup / cleanup: remove unittest-parallel from tox.ini (related to f986c6ed6a...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.20

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.20

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.20.0

    • Remove META_HTTP_EQUIV setting (#644)
    • Remove TEST_MODE setting (#645)
    • Remove 'v12-like' settings module (#653)
    • Add omnivores cookbook (#647)
    • Add maangchi (#656)
    • Fix justonecookbook (#649)

    Thank you, @​wengtad!

    Commits
    • 93de8af Bump version to 14.20.0
    • 90a507a feat: add maangchi (#656)
    • df71ec3 fix: incomplete justonecookbook (#649)
    • cc913ac feat: add omnivores cookbook (#647)
    • 89a0a67 Cleanup: remove 'v12-like' settings module (#653)
    • 9321d9a Cleanup: remove TEST_MODE setting (#645)
    • cf7870f Cleanup: remove META_HTTP_EQUIV setting (#644)
    • c250e06 Bump version to 14.19.0
    • 8553024 Continuous integration: re-enable coveralls test coverage upload (#637)
    • c074623 Ad-hoc solution for wrong ingredients amount in hellofresh when serving size ...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.19

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.19

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.19.0

    Fixes Recipe-scraper does not return the correct amount of ingredients for Hellofresh

    Commits
    • c250e06 Bump version to 14.19.0
    • 8553024 Continuous integration: re-enable coveralls test coverage upload (#637)
    • c074623 Ad-hoc solution for wrong ingredients amount in hellofresh when serving size ...
    • f0d45d0 Bump version to 14.18.0
    • b02a25a Bump version to 14.17.2
    • 6093969 import from dataclasses (#642)
    • 4326635 Add LeanAndGreenRecipes (#636)
    • e1bfb74 feat: add rosanna pansino (#639)
    • f55e235 Maintenance: update bs4 string searches to use 'string' parameter instead of ...
    • 860fb89 Bump version to 14.17.1
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.17

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.17

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.17.0

    This probably should've been 14.16.1 now that I think about it (bugfixes only, no new scrapers) - oops. We've not always adhered to that I suppose.

    • reishunger.de: bugfixes and add support for multi-method recipes (#616)
    • Use isodate library to attempt ISO 8601 duration parsing in get_minutes (#610)
    • Fixup to run unit tests on MacOS and Windows in GitHub Actions (#629)
    • mypy: ignore type union-attr errors in scraper modules, to deal with false positives from BeautifulSoup's find return type (e33181aef48f0aac6740edbf96055f2fec6c8eb2)

    Thanks @​vabene1111 for the reishunger improvements!

    Commits
    • a95d8ac Bump version to 14.17.0
    • 753c054 Refactor: remove use of 'while' loop (#634)
    • 5c033fb reishunger.de: bugfixes and add support for multi-method recipes (#616)
    • f5c5ec1 Maintenance: update bs4 string searches to use 'string' parameter instead of ...
    • 401070d Workaround: install lxml from binary wheel when unit tests run on MacOS (#629)
    • e33181a Ignore union-attr mypy errors in scraper modules
    • 39fa50b Use isodate library to attempt ISO 8601 duration parsing in get_minutes (#610)
    • 754a316 Fixup for OS selection in GitHub Actions unittests workflow (#628)
    • 7d1cfad Bump version to 14.16.0
    • c477678 Fix ingredients for simplyrecipes.com scraper (#623)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.16

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.16

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.16.0

    • Fix ingredients for simplyrecipes.com scraper (#623)
    • Simple Veganista scraper added (#626)

    Thanks, @​thomaspinder @​puradox!

    Commits

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.14

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.14

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.14.0

    Adds support for:

    • owen-han.com (#599)

    Includes fixes for:

    • greatbritishchefs - ingredients in subheadings (#598)
    • mobkitchen - domain name matching (#600)

    Thanks @​ptoczko @​ephemer4l!

    Commits
    • 3a3d2fd Bump version to 14.14.0
    • 3a57112 Added owen-han.com (#599)
    • a52e91e Add updated domain name for MobKitchen scraper (#600)
    • 9ecaec3 greatbritishchefs: handle case where ingredients are in subheaders (#598)
    • 348abb2 Bump version to 14.13.0. Food.com updates
    • a97807b removed unused imports in food.com scraper (#591)
    • 998a3ad Run tests against python 3.11 too and bump setup-python version (#586)
    • 4b5a51f Bump version to 14.12.0
    • 908c8f2 Add support for ica.se (#584)
    • 796a35a Add support for coop.se (#583)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.26

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.26

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.26.0

    Adds support for:

    • briceletbaklava.ch (#697)

    With credit to @​lacliq

    Commits
    • d673cae Bump version to 14.26.0
    • 472114b added briceletbaklava.ch (#697)
    • d882d1f GitHub Actions workflows: version-constrain 'tox' to less-than v4 (#702)
    • baf3403 Bump version to 14.25.0
    • 607ab04 Add Project Gezond scraper (Dutch Website) (#691)
    • 05a04a8 add sunset.com (#690)
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 0
  • build(deps): bump alpine from 3.15 to 3.17

    build(deps): bump alpine from 3.15 to 3.17

    Bumps alpine from 3.15 to 3.17.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 0
  • build(deps): update flask requirement from ~=2.1 to ~=2.2

    build(deps): update flask requirement from ~=2.1 to ~=2.2

    Updates the requirements on flask to permit the latest version.

    Release notes

    Sourced from flask's releases.

    2.2.0

    This is a feature release, which includes new features and removes previously deprecated code. The 2.2.x branch is now the supported bug fix branch, the 2.1.x branch will become a tag marking the end of support for that branch. We encourage everyone to upgrade, and to use a tool such as pip-tools to pin all dependencies and control upgrades.

    Changelog

    Sourced from flask's changelog.

    Version 2.2.0

    Released 2022-08-01

    • Remove previously deprecated code. :pr:4337

      • Old names for some send_file parameters have been removed. download_name replaces attachment_filename, max_age replaces cache_timeout, and etag replaces add_etags. Additionally, path replaces filename in send_from_directory.
      • The RequestContext.g property returning AppContext.g is removed.
    • Update Werkzeug dependency to >= 2.2.

    • The app and request contexts are managed using Python context vars directly rather than Werkzeug's LocalStack. This should result in better performance and memory use. :pr:4682

      • Extension maintainers, be aware that _app_ctx_stack.top and _request_ctx_stack.top are deprecated. Store data on g instead using a unique prefix, like g._extension_name_attr.
    • The FLASK_ENV environment variable and app.env attribute are deprecated, removing the distinction between development and debug mode. Debug mode should be controlled directly using the --debug option or app.run(debug=True). :issue:4714

    • Some attributes that proxied config keys on app are deprecated: session_cookie_name, send_file_max_age_default, use_x_sendfile, propagate_exceptions, and templates_auto_reload. Use the relevant config keys instead. :issue:4716

    • Add new customization points to the Flask app object for many previously global behaviors.

      • flask.url_for will call app.url_for. :issue:4568
      • flask.abort will call app.aborter. Flask.aborter_class and Flask.make_aborter can be used to customize this aborter. :issue:4567
      • flask.redirect will call app.redirect. :issue:4569
      • flask.json is an instance of JSONProvider. A different provider can be set to use a different JSON library. flask.jsonify will call app.json.response, other functions in flask.json will call corresponding functions in app.json. :pr:4688
    • JSON configuration is moved to attributes on the default app.json provider. JSON_AS_ASCII, JSON_SORT_KEYS,

    ... (truncated)

    Commits
    • b17bb9e Merge pull request #4710 from pallets/release-2.2.0
    • 292c7e5 release version 2.2.0
    • f3bb9b2 Merge branch '2.1.x'
    • ac1bb97 Merge pull request #4721 from pallets/pre-commit-ci-update-config
    • cfd5783 Merge pull request #4722 from pallets/deprecate-config-attrs
    • bfdd371 deprecate config attributes
    • 6f9ef11 [pre-commit.ci] pre-commit autoupdate
    • 98ca00d Merge pull request #4720 from pallets/deprecate-env
    • 30427a2 remove FLASK_ENV from docs
    • ef95998 deprecate FLASK_ENV
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 0
Releases(v1.6.0)
An arxiv spider

An Arxiv Spider 做为一个cser,杰出男孩深知内核对连接到计算机上的硬件设备进行管理的高效方式是中断而不是轮询。每当小伙伴发来一篇刚挂在arxiv上的”热乎“好文章时,杰出男孩都会感叹道:”师兄这是每天都挂在arxiv上呀,跑的好快~“。于是杰出男孩找了找 github,借鉴了一下其

Jie Liu 11 Sep 09, 2022
Telegram Group Scrapper

this programe is make your work so much easy on telegrame. do you want to send messages on everyone to your group or others group. use this script it will do your work automatically with one click. a

HackArrOw 3 Dec 03, 2022
Introduction to WebScraping Workshop - Semcomp 24 Beta

Extrair informações da internet de forma automatizada. Existem diversas maneiras de fazer isso, nesse tutorial vamos ver algumas delas, por meio de bibliotecas de python.

Luísa Moura 19 Sep 11, 2022
script to scrape direct download links (ddls) from google drive index.

bhadoo Google Personal/Shared Drive Index scraper. A small script to scrape direct download links (ddls) of downloadable files from bhadoo google driv

sαɴᴊɪᴛ sɪɴʜα 53 Dec 16, 2022
Scraping followers of an instagram account

ScrapInsta A script to scraping data from Instagram Install First of all you can run: pip install scrapinsta After that you need to install these requ

Matheus Kolln 1 Sep 05, 2021
Deep Web Miner Python | Spyder Crawler

Webcrawler written in Python. This crawler does dig in till the 3 level of inside addressed and mine the respective data accordingly

Karan Arora 17 Jan 24, 2022
Scrapping the data from each page of biocides listed on the BAUA website into a csv file

Scrapping the data from each page of biocides listed on the BAUA website into a csv file

Eric DE MARIA 1 Nov 30, 2021
A module for CME that spiders hashes across the domain with a given hash.

hash_spider A module for CME that spiders hashes across the domain with a given hash. Installation Simply copy hash_spider.py to your CME module folde

37 Sep 08, 2022
CreamySoup - a helper script for automated SourceMod plugin updates management.

CreamySoup/"Creamy SourceMod Updater" (or just soup for short), a helper script for automated SourceMod plugin updates management.

3 Jan 03, 2022
Pseudo API for Google Trends

pytrends Introduction Unofficial API for Google Trends Allows simple interface for automating downloading of reports from Google Trends. Only good unt

General Mills 2.6k Dec 28, 2022
A Python web scraper to scrape latest posts from official Coinbase's Blog.

Coinbase Blog Scraper A Python web scraper to scrape latest posts from official Coinbase's Blog. IDEA It scrapes up latest blog posts from https://blo

Lucas Villela 3 Feb 18, 2022
中国大学生在线 四史自动答题刷分(现仅支持英雄篇)

中国大学生在线 “四史”学习教育竞答 自动答题 刷分 (现仅支持英雄篇,已更新可用) 若对您有所帮助,记得点个Star 🌟 !!! 中国大学生在线 “四史”学习教育竞答 自动答题 刷分 (现仅支持英雄篇,已更新可用) 🥰 🥰 🥰 依赖 本项目依赖的第三方库: requests 在终端执行以下

XWhite 229 Dec 12, 2022
Quick Project made to help scrape Lexile and Atos(AR) levels from ISBN

Lexile-Atos-Scraper Quick Project made to help scrape Lexile and Atos(AR) levels from ISBN You will need to install the chrome webdriver if you have n

1 Feb 11, 2022
This tool can be used to extract information from any website

WEB-INFO- This tool can be used to extract information from any website Install Termux and run the command --- $ apt-get update $ apt-get upgrade $ pk

1 Oct 24, 2021
Simple python tool for the purpose of swapping latinic letters with cirilic ones and vice versa in txt, docx and pdf files in Serbian language

Alpha Swap English This is a simple python tool for the purpose of swapping latinic letters with cirylic ones and vice versa, in txt, docx and pdf fil

Aleksandar Damnjanovic 3 May 31, 2022
An utility library to scrape data from TikTok, Instagram, Twitch, Youtube, Twitter or Reddit in one line!

Social Media Scraper An utility library to scrape data from TikTok, Instagram, Twitch, Youtube, Twitter or Reddit in one line! Go to the website » Vie

2 Aug 03, 2022
对于有验证码的站点爆破,用于安全合法测试

使用方法 python3 main.py + 配置好的文件 python3 main.py Verify.json python3 main.py NoVerify.json 以上分别对应有验证码的demo和无验证码的demo Tips: 你可以以域名作为配置文件名字加载:python3 main

47 Nov 09, 2022
京东秒杀商品抢购Python脚本

Jd_Seckill 非常感谢原作者 https://github.com/zhou-xiaojun/jd_mask 提供的代码 也非常感谢 https://github.com/wlwwu/jd_maotai 进行的优化 主要功能 登陆京东商城(www.jd.com) cookies登录 (需要自

Andy Zou 1.5k Jan 03, 2023
SmartScraper: 简单、自动、快捷的Python网络爬虫

SmartScraper: 简单、自动、快捷的Python网络爬虫 Note: The origin developer of SmartScraper is Alireza Mika, I only change a little code of AutoScraper. SmartScraper

DaDeng 9 Apr 16, 2022
Command line program to download documents from web portals.

command line document download made easy Highlights list available documents in json format or download them filter documents using string matching re

16 Dec 26, 2022