agora's Introduction

Agora

The evaluation tool

The source for the evaluation tool lives under this repo at ./agora/.

Installation

To compile and run from source:

Install Rustup If you don't have cargo already, install it by following the instructions here: https://www.rust-lang.org/tools/install

Compile and Run

The first step in using the tool is to compile it with cargo.

cd ./agora
cargo build --release

The tool will be compiled to /target/release/.

cd target/release/
./agora -h

This should print the available command-line arguments, which, at the time of this writing will look like this:

agora 0.1.0

USAGE:
    agora [OPTIONS]

FLAGS:
    -h, --help       Prints help information
    -V, --version    Prints version information

OPTIONS:
    -c, --cost <cost>                        A cost model to use for costing
        --globals <globals>
        --grt-per-time <grt-per-time>
    -l, --load-log <load-log>...             Load request log file(s) supports json and tree-buf
        --sample <sample>                    Take a sample of the request log. Unit interval [default: 1.0]
        --save-log <save-log>                Save the request log file. Only tree-buf is supported

Usage

The arguments to the tool are meant to be combined to instruct agora to accomplish tasks. What follows are just examples:

# Load two log files (from json lines format)
# Sample the logs at 10%
# Save the result as a single tree-buf file
./agora \
   --load-log ./log1.jsonl \
   --load-log ./log2.jsonl \
   --sample 0.1 \
   --save-log ./logs.treebuf

# Load the sampled/combined file
# And evaluate the effectiveness of our pricing
./agora \
  --load-log ./logs.treebuf \
  --globals ./globals.json \
  --grt-per-time 0.0001 \
  --cost ./cost-model.agora

Cost Models

Agora uses a specialized language for defining cost models that can react to changes in Query structure and parameters. See the documentation to learn about the Agora cost model language.