djc / topfew-rs

Rust implementation of Tim Bray's topfew tool

topfew-rs: Rust implementation of Tim Bray's topfew tool

Tim Bray blogged about topfew, his Go implementation of a tool to replace the awk '{print $1}' access_log | sort | uniq -c | sort -rn | head -12 pipeline. This is a reimplementation of that tool in idiomatic stable Rust.

The initial Rust version was 2.9x faster than Tim's Go implementation; current main appears to be around 6.7x faster thanks to some additional optimizations. The Rust version currently has slightly fewer non-test SLOC than the Go version. Thanks to Thomas Andreas Jung for contributing substantial performance improvements.

Usage: tf [OPTIONS] --fields <FIELDS> <FILE>

Arguments:
  <FILE>  File to search

Options:
  -f, --fields <FIELDS>  Fields to use as part of the line's key
  -n, --num <NUM>        Top number of matches to show [default: 10]
  -e, --regex <REGEX>    Regular expression used to split lines into fields [default: "[ \\t]"]
  -h, --help             Print help

If you have the Rust toolchain installed, you can install it with cargo install topfew.

topfew-rs's Issues

Output should display fields in the order given to -f

While topfew-rs deals with being given fields in any order unlike topfew (timbray/topfew#8) it still displays them in numerical order instead of the order given.

 $  /Users/bob/.cargo/bin/tf -f 9,7 test/data/small
136  /ongoing/When/202x/2020/04/29/Leaving-Amazon 200
119  /ongoing/in-feed.xml 200
112  /ongoing/serif.css 200
112  /ongoing/ongoing.js 200
109  /ongoing/Feed.png 200
104  /ongoing/darkwater60.jpg 200
95  /ongoing/picInfo.xml?o=https://www.tbray.org/ongoing/When/202x/2020/04/29/Leaving-Amazon 200
89  /favicon.ico 200
28  408 "-"
12  /ongoing/picInfo.xml?o=https://old.tbray.org/ongoing/When/202x/2020/04/29/Leaving-Amazon 200

I would expect it to do the same as the equivalent in awk

 $  awk '{print $9 " " $7}' test/data/small | sort | uniq -c | sort -rn | head
 136 200 /ongoing/When/202x/2020/04/29/Leaving-Amazon
 119 200 /ongoing/in-feed.xml
 112 200 /ongoing/serif.css
 112 200 /ongoing/ongoing.js
 109 200 /ongoing/Feed.png
 104 200 /ongoing/darkwater60.jpg
  95 200 /ongoing/picInfo.xml?o=https://www.tbray.org/ongoing/When/202x/2020/04/29/Leaving-Amazon
  89 200 /favicon.ico
  28 "-" 408
  12 200 /ongoing/picInfo.xml?o=https://old.tbray.org/ongoing/When/202x/2020/04/29/Leaving-Amazon