mescrappy - Python + Selenium Youtube scraper

Overview

mescrappy - Python + Selenium Youtube scraper


image

Youtube Sraping With Python (Selenium)

Table of Contents

  1. About The Project
  2. Getting Started
  3. Usage
  4. Roadmap
  5. Test
  6. License
  7. Contact
  8. Acknowledgements

About The Project

Built With

Getting Started

Installation

  1. To use this package first install it: package

pip install mescrappy

  1. import sraper to your project

from mescrappy.srappy import scrapper scrapper.youtube_video_data_scrapper(url='', driver='')

You can also run it directly using terminal:

python mescrappy "https://www.youtube.com/watch?v=rMO7APyBiMI" "C:\Users\ME\projects\for_github\chromedriver_win32\chromedriver.exe"

1'st argument is video url and 2'nd argument is browser driver location

Usage

You can use this package to scrap youtube video's:

  1. title
  2. view count
  3. description
  4. like
  5. dislike
  6. post date
  7. owner

EX:

` python mescrappy "https://www.youtube.com/watch?v=rMO7APyBiMI" "C:\Users\ME\projects\for_github\chromedriver_win32\chromedriver.exe"

{

'title': 'Şeker (Cover)',

'description': 'Aýdymyň sazy : Soprano - Скорее забудь (ft. Ka-Re)\n\nLyrics:\n\nÖňler diýýärdim Aşgabat\nGerek däl başga zat\nIndi bolsa maşgalam\nGerek däl Aşgabat\n\nYanyñda oýanmak iñ uly keýp\nBaşymyz aýlanýar gerek däl meý,\nSeret! günem eýýäm günorta\nOýanmaly hiç, bulambujar otag\nBize name?! bolsun bulambujar dünýä,\nSamsyk pikirlem, şonda-da gülyäñ\n\nÝüregiñ aşagynda ýürejik urýar\nKime meñzeýärkä?, pikirlenip durýan,\nBilýäňmi näme?!, dakjak adyna Emin,\nMeñzesin ejesine, bolmasyn kemi\n\nGowy hasiyetleñ hemmesi geçmez belki,\nGeçse bolýa ejesiniñ göz reñki,\nYaşyl, öñem diýýärdim men yaşyla aşyk,\nMillet pula diýýärmikam diýýärdi, daşda...\n\nÇalyşman sizi hiç kime, \nGaraşyañ maňa giç gelsem\nUgradýañ meni ir gitsem,\nÝeke söýgimiñ biri sen,\nSöýülýänçämem diri men.\n\nDiñle! Sen meni söýýärdiñ hiçkimkäm,\nDurmuşyma geleliñ bäri men hiçkim däl.\nIşlisyraýanmy ýa çyndanam işim kän\nJaň edeýin, ýa söýýan diýmäne giçmikä?\n\nGaty seýrek hem söýmek hem söýülmek\nYüregiñ ýarysy garaşyp duranda öýüňde,\nGaýdasyñ gelýär oturan ýeriñden\nAýdasyñ gelýär oglanlara, gelenok diliñden,\nÝaýdanyp durýan, çykañok pikirden\nAýlanyp durýaň sen bedenimiñ içinde\nSaýlanyp durýar, gözelligiñ maña aýan,\nBerildi sadalyk, berildi haýa\n\nBu dünýäň oýnuny oýnasam\nMenemä ölmerin sen söýmäni goýmasañ\nGark bolman men söýgimiz meni boýlasa,\nPikire batýan sen barada oýlansam\n\nNädip saýladyñ meni hemem näme üçin,\nErbet hasiýetlem köp kemçiliklem näçe,\nBilyän, söygi şeýlerak bolaýýar nätjek\nÝüregiñ päkje özüne gatyrak çek meni\n\nJemi dört ýyldan gowrak bile eýýäm\nÖzümden gaçsamam ýene öýümize gelýän,\nHawa söýan sözi ýönekey söz däl\nSeniň ýaly tapylmaz başlasamam gözläp\n\nDaşymyzda göz kän\nÖzümede dözmän, seni bermen özgä\nYnan, muny ýazamda-da tolgunýan,\nAýlanýan ýaly depesinde tolkunlañ\n \nGerek däl bize hiçkim,\nÝyldyzlary sanamana äkideýin giçlik\nBolaly biraz işsiz\nUklap galaly asmany ýapynyp üstümize\nBir zat bor galany\n\nArzuw etmegem gowy zat\nDuýýan özümi sana zar, ýöne men azat\nGoşulmasyn duýgularymyza gazap\nAýyrmasyn biribar, degmesin nazar..\n\nDiñle! Sen meni söýýardiñ hiçkimkäm,\nDurmuşyma geleliñ bäri men hiçkim dal.\nMenema ölmerin bu söýgimiz dirika,\nDañama atdy söýýän diýmäne irmika\n\nSen men söýgülim, joram, hakyky dostum\nSen maňa hossar ýekelikden dolsam\nMeni ýumşadyañ aladalar üstüme gonsa\nSöýýän sözi ýaly gerek ýene on söz\n\nHarplar ýerini alýar, setirler dolýar\nPikirlerimi saña ýetiren bolsam bolýar,\nBar iki göz - diňe seni görýän\nBar diýjegim iki söz - Seni söýýän.\n\nBar diýjek bolanym - Seni söýýän!\nDiňe sen hakyky meni görýäň...',

'owner': 'Dali Dade',

'date': 'Premiered Jul 1, 2021',

'views': '29,392',

'like': '888',

'dislike': '5'

}`

Roadmap

See the open issues for a list of proposed features (and known issues).

Test

for testing :

python mescrappy\test.py

License

Distributed under the MIT License. See LICENSE for more information.

Contact

Merdan Chariyarov - @merlinemris96 - [email protected]

Project Link: https://github.com/MerlinEmris/youtube_srapping_with_python

Acknowledgements

You might also like...
DYA ( Ditch YouTube API ) is a package created to power the user with YouTube Data API functionality without any API Key

Ditch YouTubeAPI (BETA) DYA ( Ditch YouTube API ) is a package created to power the user with YouTube Data API functionality without any API Key Detai

Youtube Downloader is a Graphic User Interface(GUI) that lets users download a Youtube Video or Audio through a URL
Youtube Downloader is a Graphic User Interface(GUI) that lets users download a Youtube Video or Audio through a URL

Youtube Downloader This Python and Tkinter based GUI allows users to directly download the Best Resolution Videos and Audios from Youtube. Pa-fy Insta

Tkinter based YouTube video downloader works on pytube 11.0.2. Can download YouTube videos in 720p(HD), 144p and even only audio.

YouTube-Downloader Tkinter based YouTube video downloader works on pytube 11.0.2. Can download YouTube videos in 720p(HD), 144p and even only audio. G

YouTube-Video-Downloader - Download Youtube Videos for free.

YouTube-Video-Downloader Download Youtube Videos for free. Installing Dependencies:- Windows pip install pytube Mac/Linux pip3 install pytube Clonin

PyQt5 simple files , youtube videos and youtube playlist downloader

PyQt5 simple files , youtube videos and youtube playlist downloader

YouTube Video publisher using youtube-dl & ROS2🐢
YouTube Video publisher using youtube-dl & ROS2🐢

YouTube-publisher-ROS2 Publish sensor_msgs/Image by "YouTube" 🤗 🤗 🤗 ! You don't have to use webcamera or your video to check demos. Purpose Quick d

Youtube list to mp3 - Youtube list to mp3 downloader

Youtube list to mp3 downloader Tiny script to convert a list of youtube videos t

Python/Selenium script to scrape data about university courses

university-courses Python/Selenium script to scrape data about university courses. Script first extracts URLs of each courses homepage, then trawls ea

 Animoo - Python scraper made with BeautifulSoup4 that scrapes images from /c/.
Animoo - Python scraper made with BeautifulSoup4 that scrapes images from /c/.

Animoo - Python scraper made with BeautifulSoup4 that scrapes images from /c/. Features Scrapes 10 pages Scrapes each thread Downloads all the images

Comments
  • Test is not working

    Test is not working

    when running test raise expectation

    ` ERROR: test_scrap (main.TestScrapper)

    Traceback (most recent call last): File "mescrappy\test.py", line 10, in test_scrap youtube_video_data_scrapper(url=url, driver=driver), {}) File "c:\users\me\appdata\local\programs\python\python37\lib\unittest\case.py", line 883, in assertAlmostEqual diff = abs(first - second) TypeError: unsupported operand type(s) for -: 'dict' and 'dict' `

    opened by MerlinEmris 0
Releases(1.0.0)
Owner
Merdan Chariyarov
WEB Developer
Merdan Chariyarov
Google Art Image Downloader Tkinter

Google-Art-Image-Downloader-Tkinter 由 google-art-downloader 整改的批量 Google 艺术展平台高清图片下载 ⭐ It works perfectly from 2018 year till today, thanks for stars!

PY-GZKY 1 Jan 05, 2022
Application Updater using an download link

Application-Updater This tool will update your app using an storage link

ExtremeDev 1 Dec 20, 2021
Terminal based YouTube player and downloader

termitube NOTE: THIS REPOSITORY IS A FORK OF mps-youtube as mps-youtube has been unmaintained for almost a year now. Features Search and play audio/vi

Otis/Jacob Root 27 Dec 23, 2022
PyQt5 simple files , youtube videos and youtube playlist downloader

PyQt5 simple files , youtube videos and youtube playlist downloader

AmirHossein Mohammadi 7 Jul 25, 2022
Twayback: Downloading deleted Tweets from the Wayback Machine, made easy

Finding and downloading deleted Tweets takes a lot of time. Thankfully, with this tool, it becomes a piece of cake! 🎂

126 Dec 27, 2022
This is Yt Downloader. Coded with Python (my first repository)

Get Started Download & install Python first before using this software. Download Python Installing Python and Pytube Library (IMPORTANT) Installing Py

Qi 2 Oct 25, 2021
Source code of paper: "HRegNet: A Hierarchical Network for Efficient and Accurate Outdoor LiDAR Point Cloud Registration".

HRegNet: A Hierarchical Network for Efficient and Accurate Outdoor LiDAR Point Cloud Registration Environments The code mainly requires the following

Intelligent Sensing, Perception and Computing Group 3 Oct 06, 2022
Pantheon - The fastest YouTube downloader.

A Youtube downloader written in Python3, using HTTP requests and an API.

Billy 38 Nov 21, 2022
Tool To download 4KHDR DV SDR from AppleTV

# APPLE-TV 4K Downloader Tool To download 4K HDR DV SDR from AppleTV Hello Fellow Developers/ ! Hi! My name is WVDUMP. I am Leaking the scripts to

5 Dec 25, 2021
DYA ( Ditch YouTube API ) is a package created to power the user with YouTube Data API functionality without any API Key

Ditch YouTubeAPI (BETA) DYA ( Ditch YouTube API ) is a package created to power the user with YouTube Data API functionality without any API Key Detai

Sougata Jana 23 Dec 22, 2022
A python script that discovers hidden YouTube API clients. Just a research project.

YouTube-Internal-Clients A script that discovers hidden internal clients of the YouTube (Innertube) API using bruteforce methods. The script tries cli

David 97 Jan 02, 2023
Download minecraft head or skin, allows TLauncher accounts

Download minecraft head or skin, allows TLauncher accounts

1 Dec 30, 2021
Desktop utility to download images/videos/music/text from various websites, and more

Desktop utility to download images/videos/music/text from various websites, and more

Kurt Bestor 11.2k Jan 08, 2023
Youtube Video Downloader Using Python Gui Appliction with progress Bar

Youtube-Video-Downloader Youtube Video Downloader Using Python Gui Appliction with progress Bar Module Used Pytube Tkinter Pil Urllib Bytes Io LICENSE

Community Programmer 6 Dec 19, 2022
🔥 A Bot To Telegram For Download High Qulity Videos & Songs From Youtube

🔥 A Bot To Telegram For Download High Qulity Videos & Songs From Youtube 🎗 Fast And Free Bot No Need To Pay ✅ By SL-Alpha-X-Team ⚡

Official Alpha-X-Team Account 7 Aug 31, 2022
YT-Downloader is a Tool to download youtube video.

YT-Downloader YT-Downloader is a Tool to download youtube video.If you are looking for a simple video downloader tool Than This YT-Downloader may be u

Pradip Thapa 7 May 11, 2022
Automatically download multiple papers by keywords in CVPR

Automatically download multiple papers by keywords in CVPR

46 Jun 08, 2022
命令行版本的HLS/DASH流下载器,支持标准AES-128-CBC解密

XstreamDL-CLI 基于python 3.7.4+的,命令行版本的,HLS/DASH流下载器,支持标准AES-128-CBC解密 使用 首先安装必要的库

xhlove 239 Dec 31, 2022
Python code to crawl computer vision papers from top CV conferences. Currently it supports CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, SIGGRAPH

Python code to crawl computer vision papers from top CV conferences. Currently it supports CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, SIGGRAPH. It leverages selenium, a website testing framework to crawl

Xiaoyang Huang 39 Nov 21, 2022
A bot to download songs from YouTube to telegram.

Song-Downloader-Bot A BOT TO DOWNLOAD SONGS FROM YOUTUBE. Mandatory variables API_ID - Get It From my.telegram.org API_HASH - Get It From my.telegram.

Ashik Muhammed 38 Dec 11, 2022