STILTS

Starlink Tables Infrastructure Library Tool Set

Latest (see Version History)

Support at Risk

Version 2.1 released 6 November 2009

New: SIA and SSA for coneskymatch: The coneskymatch command can now make multiple Simple Image Access or Simple Spectral Access queries against remote services as well as Cone Search ones.
New: Adaptive Storage Policy: STILTS is smarter about where it stores bulk table data; can work with large non-streaming tables without needing the -disk flag (unlimited size streaming processing is not affected).

What is STILTS?
Commands
Documentation
Downloads
Further Information

What is STILTS?

The STIL Tool Set is a set of command-line tools based on STIL, the Starlink Tables Infrastructure Library. It deals with the processing of tabular data; the package has been designed for, but is not restricted to, astronomical tables such as object catalogues. Some of the tools are generic and can work with multiple formats (including FITS, VOTable, CSV, SQL and ASCII), and others are specific to the VOTable format. In some ways, STILTS forms the command-line counterpart of the GUI table analysis tool TOPCAT. The package is robust, fully documented, and designed for efficiency, especially with very large datasets.

Facilities offered include:

format conversion
crossmatching
plotting
column calculation and rearrangement
row selections
data and metadata manipulation and display
sorting
statistical calculations
histogram calculation
data validation
VO service access (experimental)

A powerful and extensible expression language is used for specifying data calculations. These facilities can be put together in very flexible and efficient ways.

For tasks in which the data can be streamed, the size of table STILTS can process is effectively unlimited. For other tasks, million-row tables usually do not present a problem.

STILTS is written in pure Java (J2SE1.4 or later), and released under the GPL.

Commands

STILTS currently consists of ten generic table processing commands:

tcopy - Table format converter
tpipe - Generic table pipeline processing utility
tmatch2, tskymatch2 - Two-table crossmatchers
tmatch1 - Intra-table crossmatcher
tmatchn - Multi-table crossmatcher
tjoin - Trivial side-by-side multiple-table joiner
tcube - N-dimensional histogram calculator
tcat, tcatn - Multiple-table concatenaters

three plotting commands:

plot2d - 2d scatter plot
plot3d - 3d scatter plot
plothist - Histogram plot

two VOTable-specific commands:

votcopy - VOTable encoding translator
votlint - VOTable validity checker

two Virtual Observatory service access commands:

regquery - Registry Query
coneskymatch (formerly multicone) - Match local table with one behind a Cone Search/SIA/SSA service

three SQL-specific commands:

sqlskymatch (formerly sqlcone) - Match local table with one in an SQL database
sqlclient - JDBC-based SQL command-line client
sqlupdate - Updates data in existing cells of an RDBMS table

and three miscellaneous items:

server - HTTP server which executes STILTS commands
calc - Quick expression evaluator
funcs - Documentation browser for expression language functions

See also the Commands by Category section of the manual.

More commands and facilities may be added in the future.

Documentation

The STILTS documentatation is provided in the user document, SUN/256. This is available in the following formats:

Downloads

The easiest way to download STILTS is from the following links:

Software jar file stilts.jar (7.4M)
Invocation script stilts
Documentation zip file (1017k)
Source code zip file (1.5M)
Source code subversion svn web interface or svn checkout https://starjava.jach.hawaii.edu/svn/trunk (see ttools package)
Archive of previous versions

The stilts.jar file contains all the classes required to run STILTS. If you run "java -jar stilts.jar" you will see a help message; on Unix you also have the choice of downloading the stilts script into the same directory and using that for convenience. For more details on invoking the tools, read SUN/256.

It is also possible to run STILTS commands against an installation of the full Starjava set or of TOPCAT, since the relevant classes are present in each case.

The current release of STILTS is v2.1, released 6 November 2009. The full Version History is available in the user document.

Further Information

Products related to STILTS are:

STIL: Public API underlying the functions of STILTS
TOPCAT: Graphical user tool for interactive table manipulation

If you have any comments, questions, requests, bugs etc, please contact me:

Author: Mark Taylor, Astrophysics Group, Physics Department, Bristol University
Email: m.b.taylor@bristol.ac.uk
STILTS WWW page: http://www.starlink.ac.uk/stilts/

And finally...

Q: What do you get if you combine all the Starlink Java table handling applications?
A: TOPCAT STILTS.
Thanks to Proporta and Malcolm Currie for that.