a database scraper created with mechanical soup and sqlite
author: Mariya Sha
This repository was created to support a YouTube tutorial:
https://youtu.be/MkGQmZoMuRM
scraper.py
is designed to webscrape a table from Wikipedia and store it in an SQlite database.
selector.py
is designed to test wether our database from scraper.py was properly created.
GNews 🚩 A Happy and lightweight Python Package that searches Google News RSS Feed and returns a usable JSON response 🚩 As well as you can fetch full
Search: A Plugin for Pelican This plugin generates an index for searching content on a Pelican-powered site. Why would you want this? Static sites are
Iceberg Locations Antarctic large iceberg positions derived from ASCAT and OSCAT-2. All data collected here are from the NASA SCP website Overview Thi
Web-Scraping using Selenium What is the need of Selenium? Some websites don't like to be scrapped and in that case you need to disguise your webscrapi
LSpider LSpider - 一个为被动扫描器定制的前端爬虫 什么是LSpider? 一款为被动扫描器而生的前端爬虫~ 由Chrome Headless、LSpider主控、Mysql数据库、RabbitMQ、被动扫描器5部分组合而成。
extruct extruct is a library for extracting embedded metadata from HTML markup. Currently, extruct supports: W3C's HTML Microdata embedded JSON-LD Mic
Google Developer Profile Badge Scraper It is a Google Developer Profile Web Scraper which scrapes for specific badges in a user's Google Developer Pro
OnTimeHacker V1.0 OnTimeHacker 是一个爬取各大SRC当日公告，并通过微信通知的小工具 OnTimeHacker目前版本为1.0，已支持24家SRC，列表如下 360、爱奇艺、阿里、百度、哔哩哔哩、贝壳、Boss、58、菜鸟、滴滴、斗鱼、 饿了么、瓜子、合合、享道、京东、
snallygaster Finds file leaks and other security problems on HTTP servers. what? snallygaster is a tool that looks for files accessible on web servers
Google Developer Profile Badge Scraper GDev Profile Badge Scraper is a Google Developer Profile Web Scraper which scrapes for specific badges in a use
Video Games Web Scraper Video Games Web Scraper is a project that crawls websites and APIs and extracts video game related data from their pages. This
Cola: high-level distributed crawling framework Overview Cola is a high-level distributed crawling framework, used to crawl pages and extract structur
iptvcrawl a scrapy project for crawl IPTV playlist. Dependency Python3 pip insta
茅台抢购最新优化版本，茅台秒杀，优化了抢购协程队列
image retrieval This is a python code to retrieve an image from the internet, a
WebScraping Web scraping Pyton program that scrapes Job website for python devel
Jobinja.ir Dataset Introduction This project is a simple web scraper that scraps pages of jobinja.ir concurrently and writes and update (if file gets
torrent-scrapper Python scrapper scrapping torrent website and download new movies Automatically. If you like it Put a ⭐ on this repo 😇 Run this git
TDTV2-Direct Version 1.00.1 • A Simple Web Scraper made to Extract Download Links from Todaytvseries2.com :) How to Works?? install all dependancies v
wallstreetbets-tracker Using Python and Pushshift.io to Track stocks on the WallStreetBets subreddit.
273 Dec 31, 2022
22 Nov 21, 2022
5 Jul 27, 2022
1 Oct 26, 2021
321 Dec 12, 2022
725 Jan 03, 2023
2 Feb 22, 2022
95 Jan 07, 2023
2k Dec 28, 2022
7 Jan 10, 2022
1 Jan 12, 2022
1.5k Jan 04, 2023
18 May 05, 2022
33 Sep 03, 2022
1 Dec 30, 2021
2 Jul 22, 2022
3 Apr 15, 2022
1 Jan 08, 2022
1 Nov 28, 2021
91 Dec 08, 2022