Data Manipulation, Edit Menu

  Menu on data manipulation form provides ways to edit a data set:

  • DEM Header: with great care you can edit the DEM header. This will only save the DEM in MICRODEM format.

The options below replace the original file, so if you want to retain it, copy the file first.  These options have mostly not been updated in a long time, and may or may not be very useful at this time. Some of the options put the entire file into memory, and may not work with really huge files.

  • ASCII duplicates: removes all duplicate lines from an ASCII file.
  • ASCII Sort: sorts an ASCII file in alphabetical order.
  • ASCII Sort & remove duplicates
  • ASCII trim columns: allows you to remove specific columns from an ASCII file. The file must have data in aligned columns. You specify the first column, and the number of columns, to remove (each column is one character).  If the file is short enough, use Excel instead.
  • ASCII reverse order: make
  • ASCII CR+LF: this option insures that every line ends with a carriage return/line feel, the standard for DOS and Windows, and needed for most input of text files in this program. Some other operating systems do not use the CR/LF pair and will cause problems.
  • ASCII thin: you can thin the file.  You can skip lines at the beginning (and optionally put them in the output file, for instance they are column headers), so that you get the first data line you want.
  • ASCII randomize: takes a file, and randomizes the line order.  The first line will not be moved (potential header), but all others might.  If you want the first line randomized, after a first randomization, manually move the first line, and then randomize again.
  • ASCII remove
    • ASCII remove #0:
    • ASCII remove blank lines:
    • ASCII remove tabs: Replace all tabs with a blank space.  This may destroy the alignment of the columns.
    • ASCII remove commas: Replace all commas with a blank space.
    • ASCII remove quotes:
    • ASCII remove after delimiter
    • ASCII remove leading character
    • ASCII trim lines (removes leading and trailing blanks)
  • ASCII insert header line: puts a header line at the start of a file, as for example before CSV point file import.
  • ASCII insert line numbers:
  • ASCII find lines with substring
  • ASCII split file:
    • For a small file, you can pick a number of files, and the lines in the file will be put sequentially into the output files. 
    • For a large file or if you want, pick the number of lines.  The first header line will be repeated in all files.
  • HTML cleanup: reduce the amount of HTML bloat inserted by programs like Word.
  • HTML inventory:
  • HTML extract links: extract all the links from a single HTML file.  Use for batch download from OpenTopography.
  • HTML create file links: create a web  page with links to all the files in the directory.
  • File Extensions--meant for use on a directory full of files
    • Change file extensions: select a new extension, and replace the existing one.
    • Add file extension: if the file has no extension, or a number of periods in the name (like ICOADS.166210.201203_13), this option will just append an extension.
  • Email cleanup: if you copy email addresses from the email, you are likely to get something like "Peter Guth [pguth@usna.edu]", which if you try to paste back into the email, may not work.  This is the case with Outlook, and a long list of addresses.  So this option turns the email into "pguth@usna.edu", which will work for cut and paste.
  • ANSI file cleanup
  • File modifications

Options to edit DEMs, formerly on this menu, have been moved to the Edit menu with a DEM map open.


11/17/2015