fengguang / lkp-tests

Linux Kernel Performance tests

Linux Kernel Performance tests

Getting started

	git clone https://github.com/intel/lkp-tests.git

	cd lkp-tests
	make install

	lkp help

Install dependency packages for jobs

	# browse and select a job you want to run, for example, jobs/hackbench.yaml
	ls lkp-tests/jobs
	
	# install the common dependencies for lkp
	lkp install

Run one atomic job

	lkp split-job lkp-tests/jobs/hackbench.yaml
	# output is:
	# jobs/hackbench.yaml => ./hackbench-1600%-process-pipe.yaml
	# jobs/hackbench.yaml => ./hackbench-1600%-process-socket.yaml
	# jobs/hackbench.yaml => ./hackbench-1600%-threads-pipe.yaml
	# jobs/hackbench.yaml => ./hackbench-1600%-threads-socket.yaml
	# jobs/hackbench.yaml => ./hackbench-50%-process-pipe.yaml
	# jobs/hackbench.yaml => ./hackbench-50%-process-socket.yaml
	# jobs/hackbench.yaml => ./hackbench-50%-threads-pipe.yaml
	# jobs/hackbench.yaml => ./hackbench-50%-threads-socket.yaml

	# install the remaining dependencies for the splited job
	lkp install ./hackbench-50%-threads-socket.yaml
	# or add -f option to force to install all dependencies
	lkp install -f ./hackbench-50%-threads-socket.yaml

	lkp run ./hackbench-50%-threads-socket.yaml

Run your own disk partitions

Specify disk partitions by defining hdd_partitions/sdd_partitions in host file named with local hostname and then lkp split-job will write the disk partitions information to split job file automatically.

Please note that disk partitions may be formatted/corrupted to run job.

	echo "hdd_partitions: /dev/sda /dev/sdb" >> lkp-tests/hosts/$(hostname | sed -r 's/-[0-9]+$//g' | sed -r 's/-[0-9]+-/-/g')
	lkp split-job lkp-tests/jobs/blogbench.yaml
	# output is:
	# lkp-tests/jobs/blogbench.yaml => ./blogbench-1HDD-ext4.yaml
	# lkp-tests/jobs/blogbench.yaml => ./blogbench-1HDD-xfs.yaml
	# ...
	lkp install ./blogbench-1HDD-ext4.yaml
	lkp run ./blogbench-1HDD-ext4.yaml

Run your own benchmarks

To run your own benchmarks that are not part of lkp-tests, you can use mytest job.

	lkp split-job lkp-tests/jobs/mytest.yaml
	# output is:
	# jobs/mytest.yaml => ./mytest-defaults.yaml
	lkp run ./mytest-defaults.yaml -- <command> <argument> ...

Check result

	lkp result hackbench

Add extra scripts in post run stage

	# create new scripts or rename hidden template scripts in the directory
	echo "echo result_root: \$RESULT_ROOT" > post-run/print-result-root
	lkp run ./ebizzy-10s-1x-200%.yaml
	# output is:
	# ...
	# result_root: /lkp/result/ebizzy/10s-1x-200%/shao2-debian/debian/defconfig/gcc-6/5.7.0-2-amd64/1

Supported Distributions

Most test cases should install/run well in

• Debian sid
• Archlinux
• CentOS7

There is however some initial support for:

• OpenSUSE:
  • jobs/trinity.yaml
• Fedora
• Clear Linux(>=22640)

As for now, lkp-tests still needs to run as root.

Adding distribution support

If you want to add support for your Linux distribution you will need an installer file which allows us to install dependencies per job. For examples look at: distro/installer/* files.

Since packages can have different names we provide an adaptation mapping for a base Ubuntu package (since development started with that) to your own distribution package name, for example adaptation files see: distro/adaptation/*. For now adaptation files must have the architecture dependent packages (ie, that ends with the postfix :i386) towards the end of the adaptation file.

You will also want to add a case for your distribution on sync_distro_sources() on the file lib/install.sh.

Extra Documentation

Refer to https://github.com/intel/lkp-tests/wiki

Contributing

1. Fork it
2. Create your feature branch (git checkout -b my-new-feature)
3. Commit your changes (git commit -am 'Add some feature')
4. Push to the branch (git push origin my-new-feature)
5. Create new Pull Request

lkp-tests's Issues

unixbench: libperl5.28 does not exist on ubuntu-18.04

7cd78129d06e3c8fd47eaab4ff seems to have introduced an issue with ubuntu-18.04. The patch changes the install dependencies for ubuntu to perl-modules-5.28 and libperl5.28 from 5.26. However, ubuntu-18.04 repos seem to only contain version 5.26. Is ubuntu 18.04 not a supported distro? If it is supported, it seems that we will need a way to specify to install whichever version of the package is available. Ideally, it would be nice to be able to specify something like "perl-modules >= 5.26", but the current method of installing packages doesn't seem to be equipped to handle that sort of thing.

could not install activesupport on centos7

the centos7u2 failed to run lkp with 2.0 ruby,
#bin/lkp run
/usr/share/rubygems/rubygems/core_ext/kernel_require.rb:55:in require': cannot load such file -- active_support/core_ext/enumerable (LoadError) from /usr/share/rubygems/rubygems/core_ext/kernel_require.rb:55:in require'
from /home/kuiliang.as/lkp-tests/lib/array_ext.rb:3:in `<top (required)>'
and gem install activesupport keep failed for ruby version, even I has compiled/install ruby 2.3.8:

$sudo gem install activesupport
Fetching: concurrent-ruby-1.1.5.gem (100%)
Successfully installed concurrent-ruby-1.1.5
Fetching: i18n-1.7.0.gem (100%)

HEADS UP! i18n 1.1 changed fallbacks to exclude default locale.
But that may break your application.

Please check your Rails app for 'config.i18n.fallbacks = true'.
If you're using I18n (>= 1.1.0) and Rails (< 5.2.2), this should be
'config.i18n.fallbacks = [I18n.default_locale]'.
If not, fallbacks will be broken in your app by I18n 1.1.x.

For more info see:
https://github.com/svenfuchs/i18n/releases/tag/v1.1.0

Successfully installed i18n-1.7.0
Fetching: thread_safe-0.3.6.gem (100%)
Successfully installed thread_safe-0.3.6
Fetching: tzinfo-1.2.5.gem (100%)
Successfully installed tzinfo-1.2.5
Fetching: zeitwerk-2.2.1.gem (100%)
ERROR: Error installing activesupport:
zeitwerk requires Ruby version >= 2.4.4.

Will this test suit support ARM/AARCH64?

LKP port to ARM

Hello,
Is LKP ported to ARM?

Thanks,
Deepa

btrfs test

Hi,

I'm a btrfs developer.

So btrfs community hasn't received bug reports from lkp-tests for a while, but we did find out some bugs via running xfstests, which is part of lkp-tests.
I was wondering why lkp-tests stopped reporting bugs, is there anything wrong in the configuration?

need job helper <create cpio from job.yaml>: create-job-cpio.sh

#!/bin/bash -e

: ${LKP_SRC:=/c/lkp-tests}

job_yaml=$1
job_name=${job_yaml##*/}
out_cgz=$(dirname $(realpath $job_yaml))/${job_name%.yaml}.cgz

tmp_dir=/tmp/$$
lkp_dir=$tmp_dir/lkp/scheduled

mkdir -p $lkp_dir
cp $job_yaml $lkp_dir
$LKP_SRC/sbin/job2sh $job_yaml -o $lkp_dir/${job_name%.yaml}.sh

cd $tmp_dir
find lkp | cpio --quiet -o -H newc | gzip > $out_cgz

rm -fr $tmp_dir