Python interface for reading and appending tar files

Last update: Nov 12, 2021

Related tags

Overview

Python interface for reading and appending tar files, while keeping a fast index for finding and reading files in the archive.

This interface has been successfully used to store and manage over one billion files in one of the Pilot-2 simulation campaigns.

Written by Tomas Oppelstrup as part of the DOE/NCI Pilot-2 project, based on an initial (simpler) index implementation by Tomas Oppelstrup, December 11, 2018. Updated to support Python 3 as a module by Francesco DiNatale.

A script for correctness checking and examples of use can be found in tests/indextest.py. The simplest way to run the tests is by e.g.: cd test ./testscript.sh

This software is distributed under the MIT license; see the file "LICENSE" for details. This software was developed at the Lawrence Livermore National Laboratory and has the release number LLNL-CODE-826782; see the file "NOTICE" for details.

Search for files under the specified directory. Extract the file name and file path and import them as data.

Search for files under the specified directory. Extract the file name and file path and import them as data. Based on that, search for the file, select it and open it.

2 Jan 10, 2022

Extract the windows major and minor build numbers from an ISO file, and automatically sort the iso files.

WindowsBuildFromISO Extract the windows major and minor build numbers from an ISO file, and automatically sort the iso files. Features Parse multiple

9 Nov 9, 2022

A tool written in python to generate basic repo files from github

7 Dec 2, 2021

FUSE filesystem Python scripts for Nintendo console files

ninfs (formerly fuse-3ds) is a FUSE program to extract data from Nintendo game consoles. It works by presenting a virtual filesystem with the contents of your games, NAND, or SD card contents, and you can browse and copy out just the files that you need.

343 Jan 2, 2023

A python script generate password files in plain text

KeePass (or any desktop pw manager?) Helper WARNING: This script will generate password files in plain text. ITS NOT SECURE. I needed help remembering

1 Nov 21, 2021

Python script for converting figma produced SVG files into C++ JUCE framework source code

AutoJucer Python script for converting figma produced SVG files into C++ JUCE framework source code Watch the tutorial here! Getting Started Make some

1 Nov 26, 2021

A Python script to organize your files in a given directory.

File-Organizer A Python script to organize your files in a given directory. It organizes your files based on the file extension and moves them into sp

1 Sep 11, 2022

CleverCSV is a Python package for handling messy CSV files.

CleverCSV is a Python package for handling messy CSV files. It provides a drop-in replacement for the builtin CSV module with improved dialect detection, and comes with a handy command line application for working with CSV files.

1k Dec 19, 2022

ValveVMF - A python library to parse Valve's VMF files

ValveVMF ValveVMF is a Python library for parsing .vmf files for the Source Engi

2 Jan 2, 2022

Releases(v1.0.2)

v1.0.2(Nov 12, 2021)

Initial PyPi release.
Source code(tar.gz)
Source code(zip)

Owner

Lawrence Livermore National Laboratory

For more than 65 years, the Lawrence Livermore National Laboratory has applied science and technology to make the world a safer place.

GitHub Repository

Publicly Open Amazon AWS S3 Bucket Viewer

S3Viewer Publicly open storage viewer (Amazon S3 Bucket, Azure Blob, FTP server, HTTP Index Of/) s3viewer is a free tool for security researchers that

377 Dec 02, 2022

Kartothek - a Python library to manage large amounts of tabular data in a blob store

Kartothek - a Python library to manage (create, read, update, delete) large amounts of tabular data in a blob store

15 Dec 25, 2022

A python script to convert an ucompressed Gnucash XML file to a text file for Ledger and hledger.

README 1 gnucash2ledger gnucash2ledger is a Python script based on the Github Gist by nonducor (nonducor/gcash2ledger.py). This Python script will tak

0 Jan 28, 2022

Python's Filesystem abstraction layer

PyFilesystem2 Python's Filesystem abstraction layer. Documentation Wiki API Documentation GitHub Repository Blog Introduction Think of PyFilesystem's

1.8k Jan 02, 2023

A simple file module for creating, editing and saving files.

1 Nov 25, 2021

Dragon Age: Origins toolset to extract/build .erf files, patch language-specific .dlg files, and view the contents of files in the ERF or GFF format

DAOTools This is a set of tools for Dragon Age: Origins modding. It can patch the text lines of .dlg files, extract and build an .erf file, and view t

8 Dec 06, 2022

Automatically generates a TypeQL script for doing entity and relationship insertions from a .csv file, so you don't have to mess with writing TypeQL.

3 Feb 09, 2022

Python interface for reading and appending tar files

Related tags

Overview

You might also like...

Search for files under the specified directory. Extract the file name and file path and import them as data.

Extract the windows major and minor build numbers from an ISO file, and automatically sort the iso files.

A tool written in python to generate basic repo files from github

FUSE filesystem Python scripts for Nintendo console files

A python script generate password files in plain text

Python script for converting figma produced SVG files into C++ JUCE framework source code

A Python script to organize your files in a given directory.

CleverCSV is a Python package for handling messy CSV files.

ValveVMF - A python library to parse Valve's VMF files

Releases(v1.0.2)

v1.0.2(Nov 12, 2021)

Owner

Lawrence Livermore National Laboratory

Publicly Open Amazon AWS S3 Bucket Viewer

Kartothek - a Python library to manage large amounts of tabular data in a blob store

A python script to convert an ucompressed Gnucash XML file to a text file for Ledger and hledger.

Python's Filesystem abstraction layer

A simple file module for creating, editing and saving files.

Dragon Age: Origins toolset to extract/build .erf files, patch language-specific .dlg files, and view the contents of files in the ERF or GFF format

Automatically generates a TypeQL script for doing entity and relationship insertions from a .csv file, so you don't have to mess with writing TypeQL.

Extract the windows major and minor build numbers from an ISO file, and automatically sort the iso files.

Various technical documentation, in electronically parseable format

Python file organizer application

Simple Python File Manager

A simple file sharing tool written in python

Test app for importing contact information in CSV files.

A JupyterLab extension that allows opening files and directories with external desktop applications.

This is just a GUI that detects your file's real extension using the filetype module.

MHS2 Save file editing tools. Transfers save files between players, switch and pc version, encrypts and decrypts.

Some-tasks - Files for some of the tasks for the group sessions

Read and write TIFF files

Remove [x]_ from StudIP zip Archives and archive_filelist.csv completely

Extract an archive file (zip file or tar file) stored on AWS S3