The open-source web scrapers that feed the Los Angeles Times California coronavirus tracker.

The open-source web scrapers that feed the Los Angeles Times' California coronavirus tracker.

Processed data ready for analysis is available at datadesk/california-coronavirus-data.

Scrapers

The scrapers are written using Python and Jupyter notebooks, scheduled and run via GitHub Actions and then archived using git.

module	status	maintainer
bed-surges		Ben Welsh
cases-deaths-demographics		Ben Welsh
cases-deaths-tests		Sean Greene
demographics-age		Sean Greene
demographics-race-by-county		Rahul Mukherjee
demographics-race-statewide		Aida Ylanan
federal-prisons		Iris Lee
homeless-impact		Jennifer Lu
hopkins		Ben Welsh
hospital-patients		Ben Welsh
hospital-capacity		Ben Welsh
hospital-locations		Ben Welsh
ice-detainees		Iris Lee
icu-capacity		Sean Greene
local-adult-detention-facilities		Iris Lee
local-juvenile-detention-facilities		Iris Lee
places		Et al.
probable-cases		Ben Welsh
reopening-tiers	Retired	Ben Welsh
school-reopenings	Retired	Iris Lee
skilled-nursing-facilities		Ben Welsh
skilled-nursing-totals		Ben Welsh
state-prisons		Iris Lee
vaccine-breakthrough-cases		Sean Greene
vaccine-cdc-state-totals		Ben Welsh
vaccine-doses-on-hand		Sean Greene
vaccine-progress		Sean Greene
vaccine-hpi		Sean Greene
vaccine-demographics-by-county		Sean Greene
vaccine-demographics-statewide		Sean Greene
vaccine-shipped-delivered		Sean Greene
variant-proportions-states		Matt Stiles
variant-toplines-ca		Matt Stiles
vaccine-zip-codes		Sean Greene, Matt Stiles

Installation

Clone the repository and install the Python dependencies.

pipenv install

Run all of the scraper commands.

make

Run one of the scraper commands.

make -f vaccine-hpi/Makefile