Python interface for reading and appending tar files

Last update: Nov 12, 2021

Related tags

Overview

Python interface for reading and appending tar files, while keeping a fast index for finding and reading files in the archive.

This interface has been successfully used to store and manage over one billion files in one of the Pilot-2 simulation campaigns.

Written by Tomas Oppelstrup as part of the DOE/NCI Pilot-2 project, based on an initial (simpler) index implementation by Tomas Oppelstrup, December 11, 2018. Updated to support Python 3 as a module by Francesco DiNatale.

A script for correctness checking and examples of use can be found in tests/indextest.py. The simplest way to run the tests is by e.g.: cd test ./testscript.sh

This software is distributed under the MIT license; see the file "LICENSE" for details. This software was developed at the Lawrence Livermore National Laboratory and has the release number LLNL-CODE-826782; see the file "NOTICE" for details.

Search for files under the specified directory. Extract the file name and file path and import them as data.

Search for files under the specified directory. Extract the file name and file path and import them as data. Based on that, search for the file, select it and open it.

2 Jan 10, 2022

Extract the windows major and minor build numbers from an ISO file, and automatically sort the iso files.

WindowsBuildFromISO Extract the windows major and minor build numbers from an ISO file, and automatically sort the iso files. Features Parse multiple

9 Nov 9, 2022

A tool written in python to generate basic repo files from github

7 Dec 2, 2021

FUSE filesystem Python scripts for Nintendo console files

ninfs (formerly fuse-3ds) is a FUSE program to extract data from Nintendo game consoles. It works by presenting a virtual filesystem with the contents of your games, NAND, or SD card contents, and you can browse and copy out just the files that you need.

343 Jan 2, 2023

A python script generate password files in plain text

KeePass (or any desktop pw manager?) Helper WARNING: This script will generate password files in plain text. ITS NOT SECURE. I needed help remembering

1 Nov 21, 2021

Python script for converting figma produced SVG files into C++ JUCE framework source code

AutoJucer Python script for converting figma produced SVG files into C++ JUCE framework source code Watch the tutorial here! Getting Started Make some

1 Nov 26, 2021

A Python script to organize your files in a given directory.

File-Organizer A Python script to organize your files in a given directory. It organizes your files based on the file extension and moves them into sp

1 Sep 11, 2022

CleverCSV is a Python package for handling messy CSV files.

CleverCSV is a Python package for handling messy CSV files. It provides a drop-in replacement for the builtin CSV module with improved dialect detection, and comes with a handy command line application for working with CSV files.

1k Dec 19, 2022

ValveVMF - A python library to parse Valve's VMF files

ValveVMF ValveVMF is a Python library for parsing .vmf files for the Source Engi

2 Jan 2, 2022

Releases(v1.0.2)

v1.0.2(Nov 12, 2021)

Initial PyPi release.
Source code(tar.gz)
Source code(zip)

Owner

Lawrence Livermore National Laboratory

For more than 65 years, the Lawrence Livermore National Laboratory has applied science and technology to make the world a safer place.

GitHub Repository

Generates a clean .txt file of contents of a 3 lined csv file

Generates a clean .txt file of contents of a 3 lined csv file. File contents is the .gml file of some function which stores the contents of the csv as a map.

1 Jan 09, 2022

BREP : Binary Search in plaintext and gzip files

BREP : Binary Search in plaintext and gzip files Search large files in O(log n) time using binary search. We support plaintext and Gzipped files. Benc

5 Dec 24, 2021

Organize the files into the relevant sub-folders

This program can be used to organize files in a directory by their file extension. And move duplicate files to a duplicates folder.

2 Dec 15, 2021

RMfuse provides access to your reMarkable Cloud files in the form of a FUSE filesystem

RMfuse provides access to your reMarkable Cloud files in the form of a FUSE filesystem. These files are exposed either in their original format, or as PDF files that contain your annotations. This le

82 Nov 24, 2022

Creates folders into a directory to categorize files in that directory by file extensions and move all things from sub-directories to current directory.

Categorize and Uncategorize Your Folders Table of Content TL;DR just take me to how to install. What are Extension Categorizer and Folder Dumper Insta

1 Oct 17, 2021

FileGenerator - File Generator for sites that accepts documents

File Generator for sites that accepts documents This code generates files as per

2 Mar 19, 2022

Convert CSV files into a SQLite database

csvs-to-sqlite Convert CSV files into a SQLite database. Browse and publish that SQLite database with Datasette. Basic usage: csvs-to-sqlite myfile.cs

731 Dec 27, 2022

A tiny Python library for writing multi-channel TIFF stacks.

xtiff A tiny Python library for writing multi-channel TIFF stacks. The aim of this library is to provide an easy way to write multi-channel image stac

23 Dec 27, 2022

PaddingZip - a tool that you can craft a zip file that contains the padding characters between the file content.

53 Nov 07, 2022

Python function to stream unzip all the files in a ZIP archive: without loading the entire ZIP file or any of its files into memory at once

206 Jan 02, 2023

Python interface for reading and appending tar files

Related tags

Overview

You might also like...

Search for files under the specified directory. Extract the file name and file path and import them as data.

Extract the windows major and minor build numbers from an ISO file, and automatically sort the iso files.

A tool written in python to generate basic repo files from github

FUSE filesystem Python scripts for Nintendo console files

A python script generate password files in plain text

Python script for converting figma produced SVG files into C++ JUCE framework source code

A Python script to organize your files in a given directory.

CleverCSV is a Python package for handling messy CSV files.

ValveVMF - A python library to parse Valve's VMF files

Releases(v1.0.2)

v1.0.2(Nov 12, 2021)

Owner

Lawrence Livermore National Laboratory

Generates a clean .txt file of contents of a 3 lined csv file

BREP : Binary Search in plaintext and gzip files

Organize the files into the relevant sub-folders

RMfuse provides access to your reMarkable Cloud files in the form of a FUSE filesystem

Creates folders into a directory to categorize files in that directory by file extensions and move all things from sub-directories to current directory.

FileGenerator - File Generator for sites that accepts documents

Convert CSV files into a SQLite database

A tiny Python library for writing multi-channel TIFF stacks.

PaddingZip - a tool that you can craft a zip file that contains the padding characters between the file content.

Python function to stream unzip all the files in a ZIP archive: without loading the entire ZIP file or any of its files into memory at once

Vericopy - This Python script provides various usage modes for secure local file copying and hashing.

pytiff is a lightweight library for reading chunks from a tiff file

Get Your TXT File Length !.

MetaMove is written in Python3 and aims at easing batch renaming operations based on file meta data.

Simple Python File Manager

A python script to pull the transactions of an Algorand wallet and put them into a CSV file.

Import Python modules from any file system path

Media file renamer and organizion tool

A simple Python code that takes input from a csv file and makes it into a vcf file.

fast change directory with python and ruby