Batch Download of Files

Data Manipulation option on the download menu. 

• Pick the TXT file with the list of files to download.  You might have to edit the file, perhaps with Excel, to get just the file names, if you got the CSV option from some locations.
• If getting lidar from USGS, the file might have both zip and laz versions.  You can remove one with the Edit, ASCII remove, ASCII remove lines with substring, or you will download twice as much as needed.
• If the batch download uses ftp, your IT department might have restrictions.
• Pick (or create a new) directory for downloaded files.
• Files will be downloaded.  If you must turn off the program, it can resume where it left off automatically.  If the file is already in the download directory, it will not download again.
• You can track progress, with the file count and the file name, and the success or failure.
• Some files may be missed, which may be a function of the server policies where you are downloading.  You should check that you got the number of files expected, and if not, rerun, which will not download any files you already have.  You might have to restart the program.
• Uncompress the files if needed for LAZ or ZIP files.

If there are problems, try uGet.

 Open Topographpy: this no longer works.  You must use the AWS downloader.

This might work with other data sets, if you can get a similar listing of the files to be downloaded.  You can copy the file list from the web page into a spreadsheet, and then add the path (using the concatenate function in Excel), and export a text file.

Last revised  12/31/2020