Nerd-Storage is a simple web server for sharing files on the local network.

Last update: Jun 07, 2022

Related tags

Storage Nerd-Storage

Overview

Nerd-Storage

A simple LAN storage.

Description

Nerd-Storage is a simple web server for sharing files on the local network.

It supports the download of files and directories, the upload of multiple files at once, making a directory, updates and deletions.

The user can also upload an existing directory as a .zip file which will then be extracted inside the storage as a folder.

Prerequisites

Linux
Python 3.6+

Dependencies

pip install Flask && pip install Flask-Login && pip install Jinja2

Installation

pip install Nerd-Storage

Usage

Run: nerdstorage

To access the storage go to: http://:5000/

To print help information: nerdstorage --help

Configuration

Run hash.py to set the login password.
Edit config.py to set the storage path.

This command will output the full path of hash.py and config.py:

pip show Nerd-Storage | grep 'Location' | grep -o -E '[/].+' | xargs -I@ printf '@/NERD/hash/hash.py\n@/NERD/config.py\n'

CLI

nerdcli is a command line interface for Nerd-Storage.

Useful link for newbies: unix.stackexchange.com/questions/storing-shell-scripts

usage: nerdcli [--parameter]

--login                         login
--logout                        logout
--ls PATH                       list directory content
--download PATH                 download file or directory
--mkdir PATH                    make a directory
--upload PATH FILE_PATH         upload a file
--upload-dir PATH FILE_PATH     upload a .zip as a directory
--delete PATH                   delete a file or directory

Config:
        Set IP and PORT.
        Script path: /path/to/script

Examples:
        https://github.com/0xHaru/Nerd-Storage/blob/master/cli/examples.md

Project home page: https://github.com/0xHaru/Nerd-Storage

Demo

Release 0.0.9

License

This project uses the following license: GPLv3.

DNA Storage Simulator that analyzes and simulates DNA storage

DNA Storage Simulator This monorepository contains code for a research project by Mayank Keoliya and supervised by Djordje Jevdjic, that analyzes and

3 Sep 25, 2022

Delta Sharing: An Open Protocol for Secure Data Sharing

Delta Sharing: An Open Protocol for Secure Data Sharing Delta Sharing is an open protocol for secure real-time exchange of large datasets, which enabl

497 Jan 2, 2023

Storage-optimizer - Identify potintial optimizations on the cloud storage accounts

Storage Optimizer Identify potintial optimizations on the cloud storage accounts

1 Feb 13, 2022

The-Secret-Sharing-Schemes - This interactive script demonstrates the Secret Sharing Schemes algorithm

The-Secret-Sharing-Schemes This interactive script demonstrates the Secret Shari

1 Jan 2, 2022

Few-NERD: Not Only a Few-shot NER Dataset

Few-NERD: Not Only a Few-shot NER Dataset This is the source code of the ACL-IJCNLP 2021 paper: Few-NERD: A Few-shot Named Entity Recognition Dataset.

319 Dec 30, 2022

NeRD: Neural Reflectance Decomposition from Image Collections

NeRD: Neural Reflectance Decomposition from Image Collections Project Page | Video | Paper | Dataset Implementation for NeRD. A novel method which dec

Computergraphics (University of Tübingen)

195 Dec 29, 2022

Just some information about this nerd.

Greetings, mates, I am ErrorDIM - aka ErrorDimension 👋 🧬 Programming Languages I Can Use: 🥇 Top Starred Repositories: # Name Stars Size Major Langu

3 Jan 11, 2022

Nerdle - a nerd's approach to solving Wordle

4 Nov 28, 2022

A simple MTProto-based bot that can download various types of media (10MB) on a local storage

TG Media Downloader Bot 🤖 A telegram bot based on Pyrogram that downloads on a local storage the following media files: animation, audio, document, p

11 Nov 1, 2022

Synchronize local directories with Tahoe-LAFS storage grids

Gridsync Gridsync aims to provide a cross-platform, graphical user interface for Tahoe-LAFS, the Least Authority File Store. It is intended to simplif

171 Dec 16, 2022

Official code for paper "Demystifying Local Vision Transformer: Sparse Connectivity, Weight Sharing, and Dynamic Weight"

Demysitifing Local Vision Transformer, arxiv This is the official PyTorch implementation of our paper. We simply replace local self attention by (dyna

138 Dec 28, 2022

A simple CLI application helps you to find giant files that are eating up your system storage

Large file finder Sometimes it's very hard to find if some giant files are eating up your system storage. We might need to hunt those down. This simpl

5 Nov 18, 2022

A simple library for temporary storage of small files

TemporaryStorage An simple library for temporary storage of small files. Navigation Install Usage In Python console As a standalone application List o

2 Apr 17, 2022

A simple software which can use to make a server in local network

home-nas it is simple software which can use to make a server in local network, it has a web site on it which can use by multipale system, i use nginx

1 Nov 10, 2021

Django app for handling the server headers required for Cross-Origin Resource Sharing (CORS)

django-cors-headers A Django App that adds Cross-Origin Resource Sharing (CORS) headers to responses. This allows in-browser requests to your Django a

4.8k Jan 3, 2023

Django app for handling the server headers required for Cross-Origin Resource Sharing (CORS)

django-cors-headers A Django App that adds Cross-Origin Resource Sharing (CORS) headers to responses. This allows in-browser requests to your Django a

4.8k Jan 5, 2023

🌐 Local tile server for viewing geospatial raster files with ipyleaflet

🌐 Local Tile Server for Geospatial Rasters Need to visualize a rather large raster (gigabytes) you have locally? This is for you. A Flask application

192 Jan 4, 2023

🌐 Local tile server for viewing geospatial raster files with ipyleaflet or folium

🌐 Local Tile Server for Geospatial Rasters Need to visualize a rather large (gigabytes) raster you have locally? This is for you. A Flask application

192 Jan 4, 2023

This is a junk file creator tool which creates junk files in Internal Storage

3 Jun 20, 2021

Comments

Large File Uploading Error
Writing this as an open-ended discussion and will be submitting the same information to the respective packages involved in this issue. Please note that this issue has been raised several times before, but has yet to be fixed / resolved. (Flask #2086, Werkzeug #1041, Werkzeug #510, Codalab-Worksheet #301, see also: StackOverflow Question)

Currently, the default_stream_factory that is embedded in Werkzeug (a Flask Dependency) splits files and performs one of two operations:

If under 500kb, store the uploaded file in-memory.

If over 500kb, store the file in a temp file in /tmp.

This creates one main visible problem:

Machines with a smaller /tmp may send a traceback to the user with a "No Space on Device" OSError, not allowing uploads to complete.

And one hidden problem:

Large File Uploads (>500kb as defined in default_stream_factory) still eat into the RAM of the host machine, despite being sent to /tmp via TemporaryFile or SpooledTemporaryFile.

This redundancy can lead to a severe issue. I was testing NS on a 4GB machine and performing a 4GB upload, which crashed the machine, and led me do two things:

Up my /tmp size to 10GB in /etc/fstab

Investigate the Memory Leak

I've not found a fix for this or any surefire way of counteracting the problem. Despite ensuring that /tmp has more than enough storage, RAM is still consumed. If the upload eats the RAM to 100% a system crash will occur, throwing the server offline. Somewhere in the reading I've been doing it's been suggested that Werkzeug stores the files into memory regardless of size (rendering formparser useless?) and has sloppy management with the data.

Any possible fixes or monkey patches would be appreciated; collaboration and discussion is welcome!
opened by InfernalPlank 23
Fixed Absolute Path Issue
On Debian / Ubuntu based distros, os.path.dirname(file) would return an empty string, causing the hash process to fail.

This fix resolves this issue by fetching the absolute path before obtaining the directory name.
opened by InfernalPlank 0

Nerd-Storage is a simple web server for sharing files on the local network.

Related tags

Overview

Nerd-Storage

Description

Prerequisites

Dependencies

Installation

Usage

Configuration

CLI

Demo

License

You might also like...

DNA Storage Simulator that analyzes and simulates DNA storage

Delta Sharing: An Open Protocol for Secure Data Sharing

Storage-optimizer - Identify potintial optimizations on the cloud storage accounts

The-Secret-Sharing-Schemes - This interactive script demonstrates the Secret Sharing Schemes algorithm

Few-NERD: Not Only a Few-shot NER Dataset

NeRD: Neural Reflectance Decomposition from Image Collections

Just some information about this nerd.

Nerdle - a nerd's approach to solving Wordle

A simple MTProto-based bot that can download various types of media (10MB) on a local storage

Synchronize local directories with Tahoe-LAFS storage grids

Official code for paper "Demystifying Local Vision Transformer: Sparse Connectivity, Weight Sharing, and Dynamic Weight"

A simple CLI application helps you to find giant files that are eating up your system storage

A simple library for temporary storage of small files

A simple software which can use to make a server in local network

Django app for handling the server headers required for Cross-Origin Resource Sharing (CORS)

Django app for handling the server headers required for Cross-Origin Resource Sharing (CORS)

🌐 Local tile server for viewing geospatial raster files with ipyleaflet

🌐 Local tile server for viewing geospatial raster files with ipyleaflet or folium

This is a junk file creator tool which creates junk files in Internal Storage

Comments

Large File Uploading Error

Fixed Absolute Path Issue

Releases(v0.2.1)

v0.2.1(Jul 23, 2021)

New Features

v0.1.2(Jun 11, 2021)

Owner

ハル

A generic JSON document store with sharing and synchronisation capabilities.

Synchronize local directories with Tahoe-LAFS storage grids

An open source multi-tool for exploring and publishing data

The Tahoe-LAFS decentralized secure filesystem.

TrueNAS CORE/Enterprise/SCALE Middleware Git Repository

Barman - Backup and Recovery Manager for PostgreSQL

Postgres CLI with autocompletion and syntax highlighting

A Terminal Client for MySQL with AutoCompletion and Syntax Highlighting.

The web end of seafile server.

a full featured file system for online data storage

Nerd-Storage is a simple web server for sharing files on the local network.

Cross-platform desktop synchronization client for the Nuxeo platform.

ZODB Client-Server framework

Automatic SQL injection and database takeover tool

ZFS, in Python, without reading the original C.

The next generation relational database.

The command-line tool that gives easy access to all of the capabilities of B2 Cloud Storage

Continuous Archiving for Postgres