a database scraper created with mechanical soup and sqlite
author: Mariya Sha
This repository was created to support a YouTube tutorial:
https://youtu.be/MkGQmZoMuRM
scraper.py
is designed to webscrape a table from Wikipedia and store it in an SQlite database.
selector.py
is designed to test wether our database from scraper.py was properly created.
Data Scraping for Glassdoor This is python to scrape overview and reviews of companies from Glassdoor. Please use it carefully and follow the Terms of
Extract Facebook group posts that are related to a specific topic and write them to a .json file.
TwitterScraper Script for scrape user data like "id,username,fullname,followers,tweets .. etc" by Twitter's search engine . Screenshot Data Users Only
pytrends Introduction Unofficial API for Google Trends Allows simple interface for automating downloading of reports from Google Trends. Only good unt
VG-Scraper VG-Scraper is a convinient program where you can find all the news articles instead of finding one yourself. Installing [Linux] Open a term
crawler-banimode create crawler and get some new products with maximum discount in banimode website. این پروژه کوچک جهت یادگیری و کار با ابزار سلنیوم
A Python package which scrapes weather data from google and sends umbrella reminders to specified email at specified time daily.
Amazon-Web-Scarper Created a web scraper using simple functions to check price of a product on amazon (can be duplicated to check price at other marke
Autoscraper-n-blogger An Automated udemy coupons scraper which scrapes coupons and autopost the result in blogspot post and notifies via Telegram bot
poolbooru_gelscraper a simple python script for scraping images off gelbooru pools. modules required:requests_html, and os by default saves files with
snscrape snscrape is a scraper for social networking services (SNS). It scrapes things like user profiles, hashtags, or searches and returns the disco
豆瓣电影 A crawler of doubamovie 一个小小的入门级scrapy框架的应用，选取豆瓣电影对排行榜前1000的电影数据进行爬取。 spider.py start_requests方法为scrapy的方法，我们对它进行重写。 def start_requests(self):
Libextract is a statistics-enabled data extraction library that works on HTML and XML documents and written in Python
42intra_scraper Scrap the 42 Intranet's elearning videos in a single click. Why you would want to use it ? Adjust speed at your convenience. (The intr
🤖 Scrape data from HTML websites automatically with Machine Learning
release-notes-scraper This simple script can be used to grab the release notes for projects from github that do not keep a CHANGELOG, but publish thei
My-Actions 个人收集并适配Github Actions的各类签到大杂烩 不要fork了 ⭐️ star就行 使用方式 新建仓库并同步代码 点击Settings - Secrets - 点击绿色按钮 (如无绿色按钮说明已激活。直接到下一步。) 新增 new secret 并设置 Secr
What is Moon? Moon is a lightweight and fast proxy scraper made by using ProxyScrape's api. What can i do with this? You can use proxies for varietys
Ruia 🕸️ Async Python 3.6+ web scraping micro-framework based on asyncio. ⚡ Write less, run faster. Overview Ruia is an async web scraping micro-frame
LuniBot for Discord Displays market info for the LUNI/LUNA token on the Terra Blockchain (Webscrape method currently scraping CoinMarketCap). Will evo
5 Jun 23, 2022
14 Aug 12, 2022
19 Nov 17, 2022
2.6k Dec 28, 2022
3 Feb 13, 2022
2 Feb 17, 2022
1 Aug 23, 2022
1 Jan 17, 2022
13 Dec 21, 2022
1 Jan 02, 2022
2.4k Jan 01, 2023
1 Oct 05, 2021
499 Dec 09, 2022
5 Oct 27, 2022
798 Dec 29, 2022
4 Apr 01, 2022
280 Dec 30, 2022
1 Jul 04, 2022
1.6k Jan 01, 2023
0 Jan 22, 2022