Webservice wrapper for hhursev/recipe-scrapers (python library to scrape recipes from websites)

Overview

recipe-scrapers-webservice

This is a wrapper for hhursev/recipe-scrapers which provides the api as a webservice, to be consumed as a microservice by other languages.

Usage

docker compose

version: "2.1"
services:
  recipe-scrapers-webservice:
    image: ghcr.io/steve192/recipe-scrapers-webservice
    container_name: recipe-scrapers-webservice
    ports:
      - 9090:9090
    restart: unless-stopped

docker cli

    docker run -d \
        --name=recipe-scrapers-webservice \
        -p 9090:9090 \
        --restart unless-stopped \
        ghcr.io/steve192/recipe-scrapers-webservice

Routes

/api/v1/scrape-recipe?url=
responds with

{
	"author": "AuthorHere",
	"category": "CategoryHere",
	"cook_time": "100",
	"cuisine": "French",
	"host": "recipehost.com",
	"imgage": "https://recipehost.com/image-for-recipe.jpg",
	"ingredients": ["10 g Ingredients1", "20g Ingredients2"],
	"instructions": "Instructions to the recipe\nSeparated by newlines",
	"language": "de",
	"links": [],
	"nutrients": {
		"calories": "631 kcal",
		"carbohydrateContent": "69 g",
		"fatContent": "26 g",
		"proteinContent": "14 g",
		"saturatedFatContent": "6 g",
		"servingSize": "504",
		"sodiumContent": "2 g",
		"sugarContent": "5 g"
	},
	"prep_time": "",
	"ratings": "",
	"title": "Title to a delicious recipe",
	"total_time": 30,
	"yields": "2 serving(s)"
}
Comments
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.25

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.25

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.25.0

    Adds support for:

    Thank you, @​brett @​NijeboerFrank!

    Commits
    • baf3403 Bump version to 14.25.0
    • 607ab04 Add Project Gezond scraper (Dutch Website) (#691)
    • 05a04a8 add sunset.com (#690)
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • b95290c Add handletheheat.com (#680)
    • 3594e02 Add southerncastiron (#679)
    • d6e0fe7 pre-commit configuration: migrate source of flake8 from gitlab.com (no-longer...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.24

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.24

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.24.0

    Adds support for:

    • #679 - southerncastiron.com
    • #680 - handletheheat.com

    Fixes:

    • #661 - TypeError on mob.co.uk
    • #687 - Site updates for amazingribs.com

    Credits: @​brett @​jayaddison

    Commits
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • b95290c Add handletheheat.com (#680)
    • 3594e02 Add southerncastiron (#679)
    • d6e0fe7 pre-commit configuration: migrate source of flake8 from gitlab.com (no-longer...
    • c954e1a Bump version to 14.23.0
    • 05d51d7 Address the lecker and simplycookit scrapers issues.
    • 9a798ee added simplycookit scraper (#618)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): bump alpine from 3.15 to 3.17.0

    build(deps): bump alpine from 3.15 to 3.17.0

    Bumps alpine from 3.15 to 3.17.0.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 1
  • build(deps): bump alpine from 3.15 to 3.16.3

    build(deps): bump alpine from 3.15 to 3.16.3

    Bumps alpine from 3.15 to 3.16.3.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.23

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.23

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.23.0

    Adds support for:

    • creativecanning.com
    • lecker.de
    • simply-cookit.com

    Removes support for:

    • sallys-blog.de

    Updates a bunch of preexisting scrapers with #676.

    Creds @​vabene1111 @​hhursev

    Commits
    • c954e1a Bump version to 14.23.0
    • 05d51d7 Address the lecker and simplycookit scrapers issues.
    • 9a798ee added simplycookit scraper (#618)
    • 2e58592 Fix lecker.de articles (#611)
    • fa31236 Reduce the amount of wording in the GitHub 'new issue' templates (#651)
    • fa61cf2 System health. Scrapers needed polishing (#676)
    • 1582886 Exclude macos and win py 3.11 from matrix again
    • 628b375 Use Python 3.11 in CI. Run macos and win w/ python 3.11 - don't mark whole jo...
    • 1d07ae9 Update README and bump version
    • 954c5c6 Issue 646/scraper weightwatchers (#657)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.21

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.21

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.21.0

    Housekeeping / development / maintenance release :broom:

    • Introduce tox as a standard mechanism to run isolated unit tests and linting workflows (#650)
    • Introduce pyproject.toml for project metadata (#655)
    • Remove the test_settings_module (#663)
    • Remove pytest and unittest-parallel development-time dependencies (#659, #660, 991b1d1784711bf1276ab74763e4e11c46649ee1)
    • Switch unit test scraper setup from per-test-method to per-test-case (#668)
    • Refactor the SchemaOrg parser (#671)
    • Fixup: incorrect start-URL in scraper test (b5f84adc0cfd2da2d645e43a321b39c7da10d4e8)

    This release should have little-to-no effect on usage of the library (it's intended to be backwards compatible) - however, bug / issue reports appreciated, as always!

    Commits
    • e23154a Bump version to 14.21.0
    • e7f7a90 Refactor: schema.org parser (#671)
    • 743d7cd Revert "Fixup: remove overwrite of schema.org data with 'mainEntity' contents...
    • aacd321 Modernization: introduce pyproject.toml for setuptools configuration (#655)
    • 2c3e0e8 Unit tests: move scraper construction from setUp (per-method) to setUpClass (...
    • b5f84ad Fixup: test-mode startURL for test_gousto
    • 557cfd9 Fixup: remove overwrite of schema.org data with 'mainEntity' contents during ...
    • d839b76 Cleanup: remove test_settings_module (#663)
    • 1526b32 Consolidate linting configuration (#662)
    • 991b1d1 Fixup / cleanup: remove unittest-parallel from tox.ini (related to f986c6ed6a...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.20

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.20

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.20.0

    • Remove META_HTTP_EQUIV setting (#644)
    • Remove TEST_MODE setting (#645)
    • Remove 'v12-like' settings module (#653)
    • Add omnivores cookbook (#647)
    • Add maangchi (#656)
    • Fix justonecookbook (#649)

    Thank you, @​wengtad!

    Commits
    • 93de8af Bump version to 14.20.0
    • 90a507a feat: add maangchi (#656)
    • df71ec3 fix: incomplete justonecookbook (#649)
    • cc913ac feat: add omnivores cookbook (#647)
    • 89a0a67 Cleanup: remove 'v12-like' settings module (#653)
    • 9321d9a Cleanup: remove TEST_MODE setting (#645)
    • cf7870f Cleanup: remove META_HTTP_EQUIV setting (#644)
    • c250e06 Bump version to 14.19.0
    • 8553024 Continuous integration: re-enable coveralls test coverage upload (#637)
    • c074623 Ad-hoc solution for wrong ingredients amount in hellofresh when serving size ...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.19

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.19

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.19.0

    Fixes Recipe-scraper does not return the correct amount of ingredients for Hellofresh

    Commits
    • c250e06 Bump version to 14.19.0
    • 8553024 Continuous integration: re-enable coveralls test coverage upload (#637)
    • c074623 Ad-hoc solution for wrong ingredients amount in hellofresh when serving size ...
    • f0d45d0 Bump version to 14.18.0
    • b02a25a Bump version to 14.17.2
    • 6093969 import from dataclasses (#642)
    • 4326635 Add LeanAndGreenRecipes (#636)
    • e1bfb74 feat: add rosanna pansino (#639)
    • f55e235 Maintenance: update bs4 string searches to use 'string' parameter instead of ...
    • 860fb89 Bump version to 14.17.1
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.17

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.17

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.17.0

    This probably should've been 14.16.1 now that I think about it (bugfixes only, no new scrapers) - oops. We've not always adhered to that I suppose.

    • reishunger.de: bugfixes and add support for multi-method recipes (#616)
    • Use isodate library to attempt ISO 8601 duration parsing in get_minutes (#610)
    • Fixup to run unit tests on MacOS and Windows in GitHub Actions (#629)
    • mypy: ignore type union-attr errors in scraper modules, to deal with false positives from BeautifulSoup's find return type (e33181aef48f0aac6740edbf96055f2fec6c8eb2)

    Thanks @​vabene1111 for the reishunger improvements!

    Commits
    • a95d8ac Bump version to 14.17.0
    • 753c054 Refactor: remove use of 'while' loop (#634)
    • 5c033fb reishunger.de: bugfixes and add support for multi-method recipes (#616)
    • f5c5ec1 Maintenance: update bs4 string searches to use 'string' parameter instead of ...
    • 401070d Workaround: install lxml from binary wheel when unit tests run on MacOS (#629)
    • e33181a Ignore union-attr mypy errors in scraper modules
    • 39fa50b Use isodate library to attempt ISO 8601 duration parsing in get_minutes (#610)
    • 754a316 Fixup for OS selection in GitHub Actions unittests workflow (#628)
    • 7d1cfad Bump version to 14.16.0
    • c477678 Fix ingredients for simplyrecipes.com scraper (#623)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.16

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.16

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.16.0

    • Fix ingredients for simplyrecipes.com scraper (#623)
    • Simple Veganista scraper added (#626)

    Thanks, @​thomaspinder @​puradox!

    Commits

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.14

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.14

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.14.0

    Adds support for:

    • owen-han.com (#599)

    Includes fixes for:

    • greatbritishchefs - ingredients in subheadings (#598)
    • mobkitchen - domain name matching (#600)

    Thanks @​ptoczko @​ephemer4l!

    Commits
    • 3a3d2fd Bump version to 14.14.0
    • 3a57112 Added owen-han.com (#599)
    • a52e91e Add updated domain name for MobKitchen scraper (#600)
    • 9ecaec3 greatbritishchefs: handle case where ingredients are in subheaders (#598)
    • 348abb2 Bump version to 14.13.0. Food.com updates
    • a97807b removed unused imports in food.com scraper (#591)
    • 998a3ad Run tests against python 3.11 too and bump setup-python version (#586)
    • 4b5a51f Bump version to 14.12.0
    • 908c8f2 Add support for ica.se (#584)
    • 796a35a Add support for coop.se (#583)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.26

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.26

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.26.0

    Adds support for:

    • briceletbaklava.ch (#697)

    With credit to @​lacliq

    Commits
    • d673cae Bump version to 14.26.0
    • 472114b added briceletbaklava.ch (#697)
    • d882d1f GitHub Actions workflows: version-constrain 'tox' to less-than v4 (#702)
    • baf3403 Bump version to 14.25.0
    • 607ab04 Add Project Gezond scraper (Dutch Website) (#691)
    • 05a04a8 add sunset.com (#690)
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 0
  • build(deps): bump alpine from 3.15 to 3.17

    build(deps): bump alpine from 3.15 to 3.17

    Bumps alpine from 3.15 to 3.17.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 0
  • build(deps): update flask requirement from ~=2.1 to ~=2.2

    build(deps): update flask requirement from ~=2.1 to ~=2.2

    Updates the requirements on flask to permit the latest version.

    Release notes

    Sourced from flask's releases.

    2.2.0

    This is a feature release, which includes new features and removes previously deprecated code. The 2.2.x branch is now the supported bug fix branch, the 2.1.x branch will become a tag marking the end of support for that branch. We encourage everyone to upgrade, and to use a tool such as pip-tools to pin all dependencies and control upgrades.

    Changelog

    Sourced from flask's changelog.

    Version 2.2.0

    Released 2022-08-01

    • Remove previously deprecated code. :pr:4337

      • Old names for some send_file parameters have been removed. download_name replaces attachment_filename, max_age replaces cache_timeout, and etag replaces add_etags. Additionally, path replaces filename in send_from_directory.
      • The RequestContext.g property returning AppContext.g is removed.
    • Update Werkzeug dependency to >= 2.2.

    • The app and request contexts are managed using Python context vars directly rather than Werkzeug's LocalStack. This should result in better performance and memory use. :pr:4682

      • Extension maintainers, be aware that _app_ctx_stack.top and _request_ctx_stack.top are deprecated. Store data on g instead using a unique prefix, like g._extension_name_attr.
    • The FLASK_ENV environment variable and app.env attribute are deprecated, removing the distinction between development and debug mode. Debug mode should be controlled directly using the --debug option or app.run(debug=True). :issue:4714

    • Some attributes that proxied config keys on app are deprecated: session_cookie_name, send_file_max_age_default, use_x_sendfile, propagate_exceptions, and templates_auto_reload. Use the relevant config keys instead. :issue:4716

    • Add new customization points to the Flask app object for many previously global behaviors.

      • flask.url_for will call app.url_for. :issue:4568
      • flask.abort will call app.aborter. Flask.aborter_class and Flask.make_aborter can be used to customize this aborter. :issue:4567
      • flask.redirect will call app.redirect. :issue:4569
      • flask.json is an instance of JSONProvider. A different provider can be set to use a different JSON library. flask.jsonify will call app.json.response, other functions in flask.json will call corresponding functions in app.json. :pr:4688
    • JSON configuration is moved to attributes on the default app.json provider. JSON_AS_ASCII, JSON_SORT_KEYS,

    ... (truncated)

    Commits
    • b17bb9e Merge pull request #4710 from pallets/release-2.2.0
    • 292c7e5 release version 2.2.0
    • f3bb9b2 Merge branch '2.1.x'
    • ac1bb97 Merge pull request #4721 from pallets/pre-commit-ci-update-config
    • cfd5783 Merge pull request #4722 from pallets/deprecate-config-attrs
    • bfdd371 deprecate config attributes
    • 6f9ef11 [pre-commit.ci] pre-commit autoupdate
    • 98ca00d Merge pull request #4720 from pallets/deprecate-env
    • 30427a2 remove FLASK_ENV from docs
    • ef95998 deprecate FLASK_ENV
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 0
Releases(v1.6.0)
A leetcode scraper to compile all questions in leetcode free tier to text file. pdf also available.

A leetcode scraper to compile all questions in leetcode free tier to text file, pdf also available. if new questions get added, run again to get new questions.

3 Dec 07, 2021
WebScraping - Scrapes Job website for python developer jobs and exports the data to a csv file

WebScraping Web scraping Pyton program that scrapes Job website for python devel

Michelle 2 Jul 22, 2022
A web scraper for nomadlist.com, made to avoid website restrictions.

Gypsylist gypsylist.py is a web scraper for nomadlist.com, made to avoid website restrictions. nomadlist.com is a website with a lot of information fo

Alessio Greggi 5 Nov 24, 2022
A training task for web scraping using python multithreading and a real-time-updated list of available proxy servers.

Parallel web scraping The project is a training task for web scraping using python multithreading and a real-time-updated list of available proxy serv

Kushal Shingote 1 Feb 10, 2022
Scrapy-soccer-games - Scraping information about soccer games from a few websites

scrapy-soccer-games Esse projeto tem por finalidade pegar informação de tabela d

Caio Alves 2 Jul 20, 2022
A simple code to fetch comments below an Instagram post and save them to a csv file

fetch_comments A simple code to fetch comments below an Instagram post and save them to a csv file usage First you have to enter your username and pas

2 Jul 14, 2022
Scrapes proxies and saves them to a text file

Proxy Scraper Scrapes proxies from https://proxyscrape.com and saves them to a file. Also has a customizable theme system Made by nell and Lamp

nell 2 Dec 22, 2021
热搜榜-python爬虫+正则re+beautifulsoup+xpath

仓库简介 微博热搜榜, 参数wb 百度热搜榜, 参数bd 360热点榜, 参数360 csdn热榜接口, 下方查看 其他热搜待加入 如何使用? 注册vercel fork到你的仓库, 右上角 点击这里完成部署(一键部署) 请求参数 vercel配置好的地址+api?tit=+参数(仓库简介有参数信息

Harry 3 Jul 08, 2022
Script for scrape user data like "id,username,fullname,followers,tweets .. etc" by Twitter's search engine .

TwitterScraper Script for scrape user data like "id,username,fullname,followers,tweets .. etc" by Twitter's search engine . Screenshot Data Users Only

Remax Alghamdi 19 Nov 17, 2022
Linkedin webscraping - Linkedin web scraping with python

linkedin_webscraping This is the first step of a full project called "LinkedIn J

Pedro Dib 4 Apr 24, 2022
Command line program to download documents from web portals.

command line document download made easy Highlights list available documents in json format or download them filter documents using string matching re

16 Dec 26, 2022
A Smart, Automatic, Fast and Lightweight Web Scraper for Python

AutoScraper: A Smart, Automatic, Fast and Lightweight Web Scraper for Python This project is made for automatic web scraping to make scraping easy. It

Mika 4.8k Jan 04, 2023
Scrapes the Sun Life of Canada Philippines web site for historical prices of their investment funds and then saves them as CSV files.

slocpi-scraper Sun Life of Canada Philippines Inc Investment Funds Scraper Install dependencies pip install -r requirements.txt Usage General format:

Daryl Yu 2 Jan 07, 2022
Web Scraping COVID 19 Meta Portal with Python

Web-Scraping-COVID-19-Meta-Portal-with-Python - Requests API and Beautiful Soup to scrape real-time COVID statistics from worldometer website and perform data cleaning and visual analysis in Jupyter

Aarif Munwar Jahan 1 Jan 04, 2022
🤖 Threaded Scraper to get discord servers from disboard.org written in python3

Disboard-Scraper Threaded Scraper to get discord servers from disboard.org written in python3. Setup. One thread / tag If you whant to look for multip

Ѵιcнч 11 Nov 01, 2022
薅薅乐 - JD 测试脚本

薅薅乐 安裝 使用docker docker一键安装: docker run -d --name jd classmatelin/hhl:latest. 使用 进入容器: docker exec -it jd bash 获取JD_COOKIES: python get_jd_cookies.py,

ClassmateLin 575 Dec 28, 2022
Raspi-scraper is a configurable python webscraper that checks raspberry pi stocks from verified sellers

Raspi-scraper is a configurable python webscraper that checks raspberry pi stocks from verified sellers.

Louie Cai 13 Oct 15, 2022
This is a module that I had created along with my friend. It's a basic web scraping module

QuickInfo PYPI link : https://pypi.org/project/quickinfo/ This is the library that you've all been searching for, it's built for developers and allows

OneBit 2 Dec 13, 2021
京东云无线宝积分推送,支持查看多设备积分使用情况

JDRouterPush 项目简介 本项目调用京东云无线宝API,可每天定时推送积分收益情况,帮助你更好的观察主要信息 更新日志 2021-03-02: 查询绑定的京东账户 通知排版优化 脚本检测更新 支持Server酱Turbo版 2021-02-25: 实现多设备查询 查询今

雷疯 199 Dec 12, 2022
Comment Webpage Screenshot is a GitHub Action that captures screenshots of web pages and HTML files located in the repository

Comment Webpage Screenshot is a GitHub Action that helps maintainers visually review HTML file changes introduced on a Pull Request by adding comments with the screenshots of the latest HTML file cha

Maksudul Haque 21 Sep 29, 2022