FAST Aiming at the problems of cumbersome steps and slow download speed of GNSS data

Related tags

Deep LearningFAST
Overview

FAST (Fusion Abundant multi-Source data download Terminal)

介绍

FAST 针对目前GNSS数据下载步骤繁琐、下载速度慢等问题,开发了一套较为完备的融合多源数据下载终端软件——FAST。
软件目前包含GNSS科研学习过程中绝大部分所需的数据源,采用并行下载的方式极大的提升了下载的效率。

Git地址

软件特点

  • 多平台:同时支持windows与linux系统;
  • 资源丰富:基本囊括了GNSS科研学习中所需的数据源,目前支持15个大类、62个小类,具体支持数据见数据支持
  • 快速:软件采用并行下载方式,在命令行参数运行模式可自行指定下载线程数,经测试下载100天的brdc+igs+clk文件只需要48.93s!
  • 易拓展:如需支持更多数据源,可在FTP_Source.py、GNSS_TYPE.py中指定所需的数据与数据源;
  • 简单易行:程序有引导下载模式与命令行带参数运行模式两种方式下载,直接运行程序便可进入引导下载模式,命令行带参数运行FAST -h可查看带参数运行模式介绍;
  • 灵活:在带参数运行模式下,用户可灵活指定下载类型、下载位置、下载时间、是否解压、线程数等,可根据自我需求编写bat、shell、python等脚本运行;
  • 轻便:windows程序包仅有18.9 MB,Liunx程序包仅有6.63 MB.

安装教程

  • Windows系统下仅需解压程序包即可直接运行,CMD运行FAST.exe -h可查看带参数运行模式介绍;
  • Linux系统下需安装先导软件wget\lftp\ncompress\python3,以Ubuntu系统为例,于终端中输入以下代码:
apt-get install wget
apt-get install lftp
apt-get install ncompress
apt-get install python3

安装后如windows系统下相同可直接运行程序,或将程序配置至环境变量中。

使用说明

引导下载模式Windows系统双击运行FAST.exe便可进入引导下载,若为Linux系统终端输入FAST运行即可:

  1. 以下载武汉大学多系统精密星历为例,在一级选择目录中选择SP3,即为输入2后回车;
    一级目录

  2. 选择MGEX_WUH_sp3即为输入6并回车,其中MGEX代表多系统,WUH代表武汉大学IGS数据处理中心,SP3代表精密星历; 二级目录

  3. 根据引导输入时间,回车完成输入; 输入时间

  4. 下载完成,根据提示直接回车完成解压或者输入任意字符回车不解压; 下载完成 解压完成

  5. 根据提示输入y再次进入引导或退出;
    在此引导

命令行带参数运行模式Windows系统CMD或power shell运行FAST.exe -h可查看命令行运行帮助,若为Linux系统终端输入FAST -h查看帮助:

  FAST : Fusion Abundant multi-Source data download Terminal
  ©Copyright 2022.01 @ Chang Chuntao
  PLEASE DO NOT SPREAD WITHOUT PERMISSION OF THE AUTHOR !

  Usage: FAST 

  Where the following are some of the options avaiable:

  -v,  --version                   display the version of GDD and exit
  -h,  --help                      print this help
  -t,  --type                      GNSS type, if you need to download multiple data,
                                   Please separate characters with " , "
                                   Example : GPS_brdc,GPS_IGS_sp3,GPS_IGR_clk
  -l,  --loc                       which folder is the download in
  -y,  --year                      where year are the data to be download
  -d,  --day                       where day are the data to be download
  -o,  --day1                      where first day are the data to be download
  -e,  --day2                      where last day are the data to be download
  -m,  --month                     where month are the data to be download
  -u,  --uncomprss Y/N             Y - unzip file (default)
                                   N - do not unzip files
  -f,  --file                      site file directory,The site names in the file are separated by spaces.
                                   Example : bjfs irkj urum
  -p   --process                   number of threads (default 12)

  Example: FAST -t MGEX_IGS_atx
           FAST -t GPS_brdc,GPS_IGS_sp3,GPS_IGR_clk -y 2022 -d 22 -p 30
           FAST -t MGEX_WUH_sp3 -y 2022 -d 22 -u N -l D:\code\CDD\Example
           FAST -t MGEX_IGS_rnx -y 2022 -d 22 -f D:\code\cdd\mgex.txt
           FAST -t IVS_week_snx -y 2022 -m 1

数据支持

  1. BRDC : GPS_brdc / MGEX_brdm

  2. SP3 : GPS_IGS_sp3 / GPS_IGR_sp3 / GPS_IGU_sp3 / GPS_GFZ_sp3 / GPS_GRG_sp3
    MGEX_WUH_sp3 / MGEX_WUHU_sp3 / MGEX_GFZ_sp3 / MGEX_COD_sp3
    MGEX_SHA_sp3 / MGEX_GRG_sp3 / GLO_IGL_sp3

  3. RINEX :GPS_IGS_rnx / MGEX_IGS_rnx / GPS_USA_cors / GPS_HK_cors / GPS_EU_cors
    GPS_AU_cors

  4. CLK : GPS_IGS_clk / GPS_IGR_clk / GPS_IGU_clk / GPS_GFZ_clk / GPS_GRG_clk GPS_IGS_clk_30s MGEX_WUH_clk / MGEX_COD_clk / MGEX_GFZ_clk / MGEX_GRG_clk / WUH_PRIDE_clk

  5. ERP : IGS_erp / WUH_erp / COD_erp / GFZ_erp

  6. BIA : MGEX_WHU_bia / GPS_COD_bia / MGEX_COD_bia / MGEX_GFZ_bia

  7. ION : IGS_ion / WUH_ion / COD_ion

  8. SINEX : IGS_day_snx / IGS_week_snx / IVS_week_snx / ILS_week_snx / IDS_week_snx

  9. CNES_AR : CNES_post / CNES_realtime

  10. ATX : MGEX_IGS_atx

  11. DCB : GPS_COD_dcb / MGEX_CAS_dcb / MGEX_WHU_OSB / P1C1 / P1P2 / P2C2

  12. Time_Series : IGS14_TS_ENU / IGS14_TS_XYZ / Series_TS_Plot

  13. Velocity_Fields : IGS14_Venu / IGS08_Venu / PLATE_Venu

  14. SLR : HY_SLR / GRACE_SLR / BEIDOU_SLR

  15. OBX : GPS_COD_obx / GPS_GRG_obx / MGEX_WUH_obx / MGEX_COD_obx / MGEX_GFZ_obx

  16. TRO : IGS_zpd / COD_tro / JPL_tro / GRID_1x1_VMF3 / GRID_2.5x2_VMF1 / GRID_5x5_VMF3

参与贡献

  1. 常春涛@中国测绘科学研究院
    程序思路、主程序编写、文档编写、程序测试

  2. 蒋科材博士后@武汉大学
    程序思路、并行计算处理思路

  3. 慕任海博士@武汉大学
    程序思路、程序编写、程序测试

  4. 李博博士@辽宁工程技术大学&中国测绘科学研究院
    程序测试、文档编写、节点汇总

  5. 李勇熹@兰州交通大学&中国测绘科学研究院
    程序测试、节点汇总

  6. 曹多明@山东科技大学&中国测绘科学研究院
    程序测试、节点汇总

Owner
ChangChuntao
QQ 1252443496 WECHAT amst-jazz
ChangChuntao
A bare-bones Python library for quality diversity optimization.

pyribs Website Source PyPI Conda CI/CD Docs Docs Status Twitter pyribs.org GitHub docs.pyribs.org A bare-bones Python library for quality diversity op

ICAROS 127 Jan 06, 2023
Unsupervised Feature Ranking via Attribute Networks.

FRANe Unsupervised Feature Ranking via Attribute Networks (FRANe) converts a dataset into a network (graph) with nodes that correspond to the features

7 Sep 29, 2022
DABO: Data Augmentation with Bilevel Optimization

DABO: Data Augmentation with Bilevel Optimization [Paper] The goal is to automatically learn an efficient data augmentation regime for image classific

ElementAI 24 Aug 12, 2022
Turn based roguelike in python

pyTB Turn based roguelike in python Documentation can be found here: http://mcgillij.github.io/pyTB/index.html Screenshot Dependencies Written in Pyth

Jason McGillivray 4 Sep 29, 2022
PAMI stands for PAttern MIning. It constitutes several pattern mining algorithms to discover interesting patterns in transactional/temporal/spatiotemporal databases

Introduction PAMI stands for PAttern MIning. It constitutes several pattern mining algorithms to discover interesting patterns in transactional/tempor

RAGE UDAY KIRAN 43 Jan 08, 2023
Source codes for "Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphs"

Structure-Aware-BART This repo contains codes for the following paper: Jiaao Chen, Diyi Yang:Structure-Aware Abstractive Conversation Summarization vi

GT-SALT 56 Dec 08, 2022
A small fun project using python OpenCV, mediapipe, and pydirectinput

Here I tried a small fun project using python OpenCV, mediapipe, and pydirectinput. Here we can control moves car game when yellow color come to right box (press key 'd') left box (press key 'a') lef

Sameh Elisha 3 Nov 17, 2022
Bringing sanity to world of messed-up data

Sanitize sanitize is a Python module for making sure various things (e.g. HTML) are safe to use. It was originally written by Mark Pilgrim and is dist

Alireza Savand 63 Oct 26, 2021
Learning the Beauty in Songs: Neural Singing Voice Beautifier; ACL 2022 (Main conference); Official code

Learning the Beauty in Songs: Neural Singing Voice Beautifier Jinglin Liu, Chengxi Li, Yi Ren, Zhiying Zhu, Zhou Zhao Zhejiang University ACL 2022 Mai

Jinglin Liu 257 Dec 30, 2022
RoboDesk A Multi-Task Reinforcement Learning Benchmark

RoboDesk A Multi-Task Reinforcement Learning Benchmark If you find this open source release useful, please reference in your paper: @misc{kannan2021ro

Google Research 66 Oct 07, 2022
Let Python optimize the best stop loss and take profits for your TradingView strategy.

TradingView Machine Learning TradeView is a free and open source Trading View bot written in Python. It is designed to support all major exchanges. It

Robert Roman 473 Jan 09, 2023
Full Stack Deep Learning Labs

Full Stack Deep Learning Labs Welcome! Project developed during lab sessions of the Full Stack Deep Learning Bootcamp. We will build a handwriting rec

Full Stack Deep Learning 1.2k Dec 31, 2022
SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking

SPLADE 🍴 + 🥄 = 🔎 This repository contains the weights for four models as well as the code for running inference for our two papers: [v1]: SPLADE: S

NAVER 170 Dec 28, 2022
Aircraft design optimization made fast through modern automatic differentiation

Aircraft design optimization made fast through modern automatic differentiation. Plug-and-play analysis tools for aerodynamics, propulsion, structures, trajectory design, and much more.

Peter Sharpe 394 Dec 23, 2022
Keras attention models including botnet,CoaT,CoAtNet,CMT,cotnet,halonet,resnest,resnext,resnetd,volo,mlp-mixer,resmlp,gmlp,levit

Keras_cv_attention_models Keras_cv_attention_models Usage Basic Usage Layers Model surgery AotNet ResNetD ResNeXt ResNetQ BotNet VOLO ResNeSt HaloNet

319 Dec 28, 2022
Perform Linear Classification with Multi-way Data

MultiwayClassification This is an R package to perform linear classification for data with multi-way structure. The distance-weighted discrimination (

Eric F. Lock 2 Dec 15, 2020
Code for the paper: Adversarial Machine Learning: Bayesian Perspectives

Code for the paper: Adversarial Machine Learning: Bayesian Perspectives This repository contains code for reproducing the experiments in the ** Advers

Roi Naveiro 2 Nov 11, 2022
Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning. CVPR 2018

Large Scale Fine-Grained Categorization and Domain-Specific Transfer Learning Tensorflow code and models for the paper: Large Scale Fine-Grained Categ

Yin Cui 187 Oct 01, 2022
Pseudo lidar - (CVPR 2019) Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Driving

Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Driving This paper has been accpeted by Conference o

Yan Wang 881 Dec 27, 2022
CRLT: A Unified Contrastive Learning Toolkit for Unsupervised Text Representation Learning

CRLT: A Unified Contrastive Learning Toolkit for Unsupervised Text Representation Learning This repository contains the code and relevant instructions

XiaoMing 5 Aug 19, 2022