Coder Social home page Coder Social logo

Using ts_min instead of ts_max about anemometer HOT 5 CLOSED

box avatar box commented on August 16, 2024
Using ts_min instead of ts_max

from anemometer.

Comments (5)

gtowey avatar gtowey commented on August 16, 2024

Hi Eric,

Sorry for the slow reply, I somehow missed this issue until now.

I haven't tested this, but you should be able to make the change you're looking for by just a few things.

change all occurances of ts_min to ts_max in the following files:
conf/config.inc.php
views/report.php
views/graph_search.php
lib/Anemometer.php

You probably also want to make sure that the indexes on the report_history table are changed to include ts_max instead of ts_min where it occurs. Let me know if there are any issues and I will try to assist.

from anemometer.

gtowey avatar gtowey commented on August 16, 2024

Also just a note on this:

I think this issue doesn't affect us the same way because of the way we're collecting and storing slow query logs. We have a cron process set up which samples only 36 seconds every 15 minutes. This means that for any given sample, the ts_min and ts_max are rather close together, and when reporting on any given time interval you're usually looking at several different collection periods aggregated together.

We collect logs this way because when we enable the slow query log, we're also setting the long_query_time to 0.00 -- in Percona mysql this logs all queries. On a busy server this is a lot of data, hence the short collection period. In effect we're sampling about 4% of all queries. In Oracle mysql my suggestion would be to use 0.0001 or something similarly small as the long_query_time.

from anemometer.

deviantdolphin avatar deviantdolphin commented on August 16, 2024

Thanks for the update.

What I did as a work around was tail the slow log last 25K lines save that off and then on the next pass i take another sample of 25K lines and do a diff. I run this via cron every 10 minutes.

LIMIT=25000
mv -v /tmp/$HOST.slow /tmp/$HOST.slow.last
ssh $HOST "tail -n$LIMIT $SLOWLOG" > /tmp/$HOST.slow
diff -u /tmp/$HOST.slow.last /tmp/$HOST.slow |sed -e 's/^-//' -e 's/^+//' > /tmp/$HOST.updates
pt-query-digest $ARGS --filter=" $event->{Bytes} = length($event->{arg}) and $event->{hostname}="$HOST"" /tmp/$HOST.updates

from anemometer.

gtowey avatar gtowey commented on August 16, 2024

This issue has been fixed more permanantly by the the new mysql 5.6 support. It's now possible to override the column names used for some special fields types. You'll have to use the new sample.config.inc.php, and add the following

'special_field_names' => array(
    'time'      => 'ts_max',
)

into the array defined starting at line 296:

 $conf['reports']['slow_query_log'] = array(

from anemometer.

AlienFromStar avatar AlienFromStar commented on August 16, 2024

thank your update,
'special_field_names' => array(
'time' => 'ts_max',
)

this may dosn't work for mysql 5.7, how i can do?

from anemometer.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.