A library for generating fake data and populating database tables.

Last update: Sep 23, 2022

Related tags

Testing knockoff-factory

Overview

Knockoff Factory

A library for generating mock data and creating database fixtures that can be used for unit testing.

Table of content

Installation
Changelog
Documentation
Unit Tests
Future Work
Legacy YAML Based CLI

Installation

pip install knockoff

Changelog

See the changelog for a history of notable changes to knockoff.

Documentation

We are working on adding more documentation and examples!

Knockoff SDK
- KnockoffTable
- KnockoffDB
TempDatabaseService
Knockoff CLI
Unit Testing Example: Sample App

Unit Tests

Prerequisites

docker
poetry (curl -sSL https://raw.githubusercontent.com/python-poetry/poetry/master/get-poetry.py | python)

Some of the unit tests depend on a database instance. Knockoff will create ephemeral databases within that instance and clean them up when tests have completed. By default it will attempt to connect to an existing instance at postgresql://[email protected]:5432/postgres and will create and destroy databases per test. This postgres location can be overridden with the KNOCKOFF_TEST_DB_URI environment variable.

If no external postgres instance is available for testing, but postgresql is installed, the TEST_USE_EXTERNAL_DB environment variable can be set to 0. The fixtures will then rely on the testing.postgresql library to create ephemeral postgres instances per fixture.

If postgres is not available, dependent tests can be disabled with the following: export TEST_POSTGRES_ENABLED=0.

Create the database instance using docker:

docker run --rm  --name pg-docker -e POSTGRES_HOST_AUTH_METHOD=trust -d -p 5432:5432  postgres:11.9

Install poetry:

poetry install

Run unit test:

poetry run pytest

Future work

Further documentation and examples for SDK
Add yaml based configuration for SDK
Make extensible generic output for KnockffDB.insert (csv, parquet, etc)
Enable append option for KnockoffDB.insert
Autodiscover and populate all tables by using reflection and building dependency graph with foreign key relationships
Parallelize execution of dag. (e.g. https://ipython.org/ipython-doc/stable/parallel/dag_dependencies.html)

A Python Selenium library inspired by the Testing Library

Selenium Testing Library Slenium Testing Library (STL) is a Python library for Selenium inspired by Testing-Library. Dependencies Python 3.6, 3.7, 3.8

12 Dec 26, 2022

A command-line tool and Python library and Pytest plugin for automated testing of RESTful APIs, with a simple, concise and flexible YAML-based syntax

1.0 Release See here for details about breaking changes with the upcoming 1.0 release: https://github.com/taverntesting/tavern/issues/495 Easier API t

909 Dec 15, 2022

Test django schema and data migrations, including migrations' order and best practices.

django-test-migrations Features Allows to test django schema and data migrations Allows to test both forward and rollback migrations Allows to test th

382 Dec 27, 2022

Hypothesis is a powerful, flexible, and easy to use library for property-based testing.

Hypothesis Hypothesis is a family of testing libraries which let you write tests parametrized by a source of examples. A Hypothesis implementation the

6.4k Jan 5, 2023

Python version of the Playwright testing and automation library.

🎭 Playwright for Python Docs | API Playwright is a Python library to automate Chromium, Firefox and WebKit browsers with a single API. Playwright del

7.8k Jan 2, 2023

A library to make concurrent selenium tests that automatically download and setup webdrivers

AutoParaSelenium A library to make parallel selenium tests that automatically download and setup webdrivers Usage Installation pip install autoparasel

8 Mar 13, 2022

pytest plugin for manipulating test data directories and files

pytest-datadir pytest plugin for manipulating test data directories and files. Usage pytest-datadir will look up for a directory with the name of your

191 Dec 21, 2022

A mocking library for requests

httmock A mocking library for requests for Python 2.7 and 3.4+. Installation pip install httmock Or, if you are a Gentoo user: emerge dev-python/httm

452 Dec 28, 2022

A utility for mocking out the Python Requests library.

Responses A utility library for mocking out the requests Python library. Note Responses requires Python 2.7 or newer, and requests = 2.0 Installing p

3.8k Jan 3, 2023

Releases(v4.3.2)

v4.3.2(Aug 3, 2022)
Removed dependency on six which was required for py23 compatibility.

Updated dependency-injector version to resolve poetry lock issue with six <=1.15.0.

Additional information about the changes can be found here.
Source code(tar.gz)
Source code(zip)
v4.3.1(Aug 3, 2022)

Fixed backwards compatibility issue in KnockoffContainer with sqlalchemy breaking change for create_engine's positional arg changing into a kwarg, url. Fix KnockoffDB class so that it actually skips inserts where insert=False for a node Fix KnockoffTableFactory so that if you pass next_strategy_factory it won't complain about also providing next_strategy_callable

Additional information about the changes can be found here.
Source code(tar.gz)
Source code(zip)
v4.3.0(Jul 27, 2021)
Added io utilities for parallelizing writes to sql with joblib

Added rename and drop parameters for KnockoffTable

Added support for MySQL to TempDatabaseService (knockoff.tempdb.setup_teardown:mysql_setup_teardown)

Added reflect_schema method to KnockoffDatabaseService

Moved knockoff.testing_postgresql modules to knockoff.utilities.testing.postgresql

Parallelized DefaultDatabaseService inserts

Renamed KnockoffTable.build_record method to KnockoffTable._build_record declaring it as private by convention

Fixed DefaultDatabaseService's reflect_table method for MySql

Additional information about changes can be found here.
Source code(tar.gz)
Source code(zip)
v4.2.1(Jul 27, 2021)
Added default configurations for knockoff run CLI with environment variable override options

Moved clear_env_vars from knockoff.orm to knockoff.utilities.environ

Fixed issue where knockoff run CLI was not using the temp db created with the --ephemeral flag

Source code(tar.gz)
Source code(zip)
v4.2.0(Jul 19, 2021)
Add --ephemeral flag for knockoff run CLI to create temp database for loading knockoff configuration from sdk

Add unit tests for KnockoffDB.build and knockoff run CLI

Add Documentation and jupyter notebook for TempDatabaseService

Add Documentation and jupyter notebook for KnockoffDB

Moved legacy YAML based knockoff cli from README.md to legacy.MD

Source code(tar.gz)
Source code(zip)
v4.1.0(Jul 19, 2021)
Add CollectionsFactory for providing factory functions that return multiple columns

Documentation and jupyter notebook for KnockoffTable

Source code(tar.gz)
Source code(zip)
v4.0.0(Jul 15, 2021)
Added ColumnFactory for providing factory functions instead of requiring as a tuple (column, factory)

Added build method for KnockoffDB to enable building dataframes without inserting into DB

Added run CLI command for loading data into database from sdk configuration

Added Blueprint class to sdk for more composable configuration

Added tempdb module and TempDatabaseService class

Made CLI extensible with injectable subcommands

Moved previous CLI to legacy subcommand for loading data into database using yaml configuration

Renamed knockoff.utilities.mixin:FactoryMixin to knockoff.utilities.mixin:ResourceLocatorMixin

Updated internal knockoff fixtures to use TempDatabaseService

Additional changes can be found here.
Source code(tar.gz)
Source code(zip)

Owner

Nike Inc.

GitHub Repository

FakeDataGen is a Full Valid Fake Data Generator.

FakeDataGen is a Full Valid Fake Data Generator. This tool helps you to create fake accounts (in Spanish format) with fully valid data. Within this in

64 Dec 12, 2022

HTTP client mocking tool for Python - inspired by Fakeweb for Ruby

HTTPretty 1.0.5 HTTP Client mocking tool for Python created by Gabriel Falcão . It provides a full fake TCP socket module. Inspired by FakeWeb Github

2k Jan 06, 2023

Instagram unfollowing bot. If this script is executed that specific accounts following will be reduced

Instagram-Unfollower-Bot Instagram unfollowing bot. If this script is executed that specific accounts following will be reduced.

1 Dec 24, 2021

Nokia SR OS automation

Nokia SR OS automation Nokia is one of the biggest vendors of the telecommunication equipment, which is very popular in the Service Provider segment.

7 Jul 23, 2022

Local continuous test runner with pytest and watchdog.

pytest-watch -- Continuous pytest runner pytest-watch a zero-config CLI tool that runs pytest, and re-runs it when a file in your project changes. It

675 Dec 23, 2022

pytest plugin for a better developer experience when working with the PyTorch test suite

pytest-pytorch What is it? pytest-pytorch is a lightweight pytest-plugin that enhances the developer experience when working with the PyTorch test sui

39 Nov 18, 2022

模仿 USTC CAS 的程序，用于开发校内网站应用的本地调试。

ustc-cas-mock 模仿 USTC CAS 的程序，用于开发校内网站应用阶段调试。请勿在生产环境部署！只测试了最常用的三个 CAS route： /login /serviceValidate（验证 CAS ticket） /logout 没有测试过 proxy ticket。（因为我

4 Jan 27, 2022

Mimesis is a high-performance fake data generator for Python, which provides data for a variety of purposes in a variety of languages.

Mimesis - Fake Data Generator Description Mimesis is a high-performance fake data generator for Python, which provides data for a variety of purposes

3.8k Dec 29, 2022

Tutorial for integrating Oxylabs' Residential Proxies with Selenium

Oxylabs’ Residential Proxies integration with Selenium Requirements For the integration to work, you'll need to install Selenium on your system. You c

8 Dec 08, 2022

Hamcrest matchers for Python

PyHamcrest Introduction PyHamcrest is a framework for writing matcher objects, allowing you to declaratively define "match" rules. There are a number

684 Dec 29, 2022

Generic automation framework for acceptance testing and RPA

Robot Framework Introduction Installation Example Usage Documentation Support and contact Contributing License Introduction Robot Framework is a gener

7.7k Jan 07, 2023

Fills out the container extension form automatically. (Specific to IIT Ropar)

automated_container_extension Fills out the container extension form automatically. (Specific to IIT Ropar) Download the chrome driver from the websit

1 Dec 24, 2021

This is a Python script for Github Bot which uses Selenium to Automate things.

github-follow-unfollow-bot This is a Python script for Github Bot which uses Selenium to Automate things. Pre-requisites :- Python A Github Account Re

10 Jul 01, 2022

Faker is a Python package that generates fake data for you.

Faker is a Python package that generates fake data for you. Whether you need to bootstrap your database, create good-looking XML documents, fill-in yo

15.2k Jan 01, 2023

Tools for test driven data-wrangling and data validation.

datatest: Test driven data-wrangling and data validation Datatest helps to speed up and formalize data-wrangling and data validation tasks. It impleme

269 Dec 16, 2022

UUM Merit Form Filler is a web automation which helps automate entering a matric number to the UUM system in order for participants to obtain a merit

About UUM Merit Form Filler UUM Merit Form Filler is a web automation which helps automate entering a matric number to the UUM system in order for par

3 May 31, 2022