Can't run SQL on log files. about dsq

[eatonphil]

Hey! I notice that the README incorrectly says it must only be piped in.

There are tests in place that test it not being piped in: https://github.com/multiprocessio/dsq/blob/main/scripts/test.py#L193.

Does that work for you?

[jubinmytheen]

Hi,
Thanks for the info.
Unfortunately, it didn't work for me. Getting mimetype error while trying without piping.

# ./dsq ./testdata/logfmt/log.logfmt 'SELECT level FROM {}'
Unknown mimetype for file: ./testdata/logfmt/log.logfmt.

[eatonphil]

Support for logfmt was merged but not released. I just released it now https://github.com/multiprocessio/dsq/releases/tag/v0.22.0.

Tested and working for me.

[jubinmytheen]

It's working now.
Also, is it possible to run SQL on log files like /var/log/auth.log?

[eatonphil]

Good question! That used to be supported and it was accidentally dropped.

I've added an issue to support reading syslog: multiprocessio/datastation#292.