checkpoint-restore / criu Goto Github PK
View Code? Open in Web Editor NEWCheckpoint/Restore tool
Home Page: criu.org
License: Other
criu's People
Contributors
Stargazers
Watchers
Forkers
theksk avagin bugrax kvser tych0 mnegi kimh blindfs efiop rmoorman lets00 xiicloud linuxchyu jinwuxia huikang maxwell92 ldu4 adrianreber balamark crosbymichael ljb-2000 gablg1 lk4d4 tolmasky maryvilledev eabatalov marcosnils krafczyk fbocharov moypray southerngs openvz emaxerrno aryabinin matsumotory cloudcalvin open-party sergeevpavel tianyouli swells boucher shawn-xy zolok justintung wzugang federeghe n-eiling 0x7f454c46 equivalence1 tkhai is00hcw x1022as orent aburluka hqhq leoliangzhang jackchuang authenticeshkinkot criupatchwork ldvsoft datawolf cartazio juncgu tonydoen hixichen zhangciba helloweishi fogongzi rppt archer-sys egorbunov shekkbuilder lakecarrot tupipa yunchengmt vmandela brauner neofob skarbat h4ck3rm1k3 kalmuthu the7winds cnnrznn conseweb kolyshkin r8d8 krockpot ronin13 cybertan xiaozhazi ocrack solidnerd destenson veruu knightku rodrigo-bruno inputhacker gaocegege tortoisedoc snorchcriu's Issues
Restoring of docker container failed after restarting docker daemon
I experimented if I could restore a container after rebooting my docker daemon but I got Error response from daemon: Container f6b3120b3fce is not checkpointed error.
$ export CID=$(docker run -d busybox tail -f /dev/null)
$ docker checkpoint $CID
eb0ce45f8c7820978e05323cc5646affec73a3b962ed67db363e3ca744345b7d
$ sudo service docker restart
docker stop/waiting
docker start/running, process 5206
$ docker restore $CID
Error response from daemon: Container eb0ce45f8c7820978e05323cc5646affec73a3b962ed67db363e3ca744345b7d is not checkpointed
Error: failed to restore one or more containers
Is this supported by CRIU?
C/R 32-bit tasks on x86_64
For x86 we only dump and restore 64-bit tasks. Doing 32-bit should also be done, but keep in mind, that not only 64-bit tree OR 32-bit tree should be supported. There can be mixed 64-and-32-bit trees out there and CRIU should support those too.
Alter cpusets mems/cpus to allow restoring on nodes with different amt of resources
Hi,
So I want to checkpoint a container on one host and restore it in another one by moving the image directory and using --force option to restore in another container.
So I created a container on host B but restoring failed on host A (checkpoint restore on same host work on both of them).
What I did:
Host B:
docker run -d busybox /bin/sh -c 'i=0; while true; do echo
docker checkpoint --work-dir=< work dir > --image-dir=< image dir >
Host A:
docker create busybox
docker restore --work-dir=< work dir > --image-dir=< image dir copied from host b > --force=true < created container id >
restore logs: http://pastebin.com/jpnhuePH
I don't understand if the /bin/sh mentioned in the error is containers or hosts files.
My environment on both hosts:
Debian based with custom 4.0.0 kernel.
Docker version 1.9.0-dev, build 2919249, experimental
(I am using aufs as storage driver)
CRIU Version: 1.7 GitID: v1.7-45-g7ae72c6
Thanks for the help.
Support fsnotify queues
Pulled from criu.org/Todo
We dump fsnotify files, but when they contain events inside -- just ignore those. Need to fetch then and put back on restore. The difficulty here is that while dumping/restoring CRIU may touch files that are monitored and thus produce unwanted events into queue.
Inconsistent restore failure with CG_MODE_FULL - boucher cr-combined + hk + criu-current
During the first try of a container restore with CG_MODE_FULL I get a failure with:
(00.000856) Collecting 37/21 (flags 0)
(00.000878) `- ... done
(00.000905) cg: Preparing cgroups yard (cgroups restore mode 0x4)
(00.000957) cg: Opening .criu.cgyard.LsVKLt as cg yard
(00.000967) cg: Making controller dir .criu.cgyard.LsVKLt/cpuset (cpuset)
(00.001031) cg: Created cgroup dir cpuset/system.slice/docker-404a13eab68e35753ee2c66f636aa727aa2c9a7723671d25cc9ffb0ede574178.scope
(00.001074) Error (cgroup.c:978): cg: Failed closing cpuset/system.slice/docker-404a13eab68e35753ee2c66f636aa727aa2c9a7723671d25cc9ffb0ede574178.scope/cpuset.cpus: Invalid argument
(00.001079) Error (cgroup.c:1083): cg: Restoring special cpuset props failed!
The second restore try - same parameters, same images, same container, same binaries - gets a successful result. Any ideas?
Full restore log here: https://gist.github.com/6e84bae4e5c165491d1f
Thanks!
Support SIT device
Support VLANs in net namespace
Pulled from criu.org/Todo
criu restore hangs
22075 ? S 0:00 \_ bash -c ( mount --make-rprivate / && umount -l /proc && mount -t proc proc /proc/ && bash -x test/jenkins/criu-iter.sh )
22076 ? S 0:00 \_ bash -c ( mount --make-rprivate / && umount -l /proc && mount -t proc proc /proc/ && bash -x test/jenkins/criu-iter.sh )
22080 ? S 0:00 \_ bash -x test/jenkins/criu-iter.sh
26359 ? S 0:00 \_ make -C test ZDTM_ARGS=-C -i 3 -x maps04 zdtm
26410 ? S 0:00 \_ make -f Makefile.zdtm zdtm_nons
10149 ? S 0:00 \_ /bin/sh -c ./zdtm.sh --ct -C -i 3 -x maps04 -r transition/fork2 > transition_fork2.log 2>&1; \ { ret=$?; fname=transitio
10150 ? S 0:00 \_ /bin/bash ./zdtm.sh --ct -C -i 3 -x maps04 -r transition/fork2
10163 ? S 0:00 \_ ./zdtm_ct ./zdtm.sh -C -i 3 -x maps04 -r transition/fork2
10164 ? Ss 0:00 \_ /bin/bash ./zdtm.sh -C -i 3 -x maps04 -r transition/fork2
10414 ? Ss 0:00 \_ /var/lib/jenkins/jobs/CRIU-iter/workspace/criu restore -D /var/lib/jenkins/jobs/CRIU-iter/workspace/test/
10415 ? Ss 0:00 \_ ./fork2 --pidfile=fork2.pid --outfile=fork2.out
10416 ? S 0:00 \_ ./fork2 --pidfile=fork2.pid --outfile=fork2.out
10417 ? S 0:00 \_ ./fork2 --pidfile=fork2.pid --outfile=fork2.out
10418 ? S 0:00 \_ ./fork2 --pidfile=fork2.pid --outfile=fork2.out
10419 ? S 0:00 \_ ./fork2 --pidfile=fork2.pid --outfile=fork2.out
10420 ? S 0:00 \_ ./fork2 --pidfile=fork2.pid --outfile=fork2.out
10421 ? S 0:00 \_ ./fork2 --pidfile=fork2.pid --outfile=fork2.out
10422 ? S 0:00 \_ ./fork2 --pidfile=fork2.pid --outfile=fork2.out
10423 ? S 0:00 \_ ./fork2 --pidfile=fork2.pid --outfile=fork2.out
10424 ? S 0:00 \_ ./fork2 --pidfile=fork2.pid --outfile=fork2.out
10425 ? S 0:00 \_ ./fork2 --pidfile=fork2.pid --outfile=fork2.out
10426 ? Z 0:00 \_ [fork2] <defunct>
[root@jenkins workspace]# ./crit show /proc/10414/cwd/core-146.img
{
"magic": "CORE",
"entries": [
{
"mtype": "X86_64",
"tc": {
"task_state": 2,
"exit_code": 0,
"personality": 0,
"flags": 0,
"blk_sigset": "0x0",
"comm": "fork2"
}
}
]
}
(gdb) bt
#0 __syscall_common () at arch/x86/syscalls/syscall-common-x86-64.S:15
#1 0x000000000041b596 in futex_wait_while_gt (v=0, f=0x7f905035c00c) at include/lock.h:92
#2 restore_wait_inprogress_tasks () at cr-restore.c:1594
#3 0x000000000041bd63 in restore_switch_stage (next_stage=5) at cr-restore.c:1614
#4 restore_root_task (init=<optimized out>) at cr-restore.c:1876
#5 0x00000000004301d9 in cr_restore_tasks () at cr-restore.c:1990
#6 0x000000000041e7b6 in main (argc=<optimized out>, argv=0x7ffdffe0c468, envp=<optimized out>) at crtools.c:589
(gdb) frame 2
#2 restore_wait_inprogress_tasks () at cr-restore.c:1594
1594 futex_wait_while_gt(np, 0);
(gdb) p *np
$1 = {raw = {counter = 1}}
Harden the service daemon
The service daemon suffers from 2 CVEs -- it opens a random file as log and doesn't obey ptrace attach restrictions.
To fix this we decided to go this route:
- criu service should no longer be root-default service. This implies removing systemd files, changing default path for socket and fixing library to spawn swrk by default.
- criu with suid bit is not supported, criu should be run as user.
- the only place requiring super power is reading data from /proc/pid/map_files. This requires suid-ed criu-super that helps getting info from kernel.
Support ODF POSIX file locks
Pulled from criu.org/Todo
These are still rarely used, but exist. Might make sense to support them in advance, it looks like kernel API allows for that.
docker checkpoint got "Unable to parse the CRIU version: Version: 1.5"
Now, I'm trying to use native docker checkpoint/resume. However, I got the following error when I run docker checkpoint $container_id.
root@vagrant-ubuntu-trusty:~/docker# ./bundles/1.5.0-dev/binary/docker checkpoint f82be2e71cd1
Error response from daemon: Cannot checkpoint container f82be2e71cd1: Unable to parse the CRIU version: Version: 1.5
GitID: v1.2-1326-ga8e1f59
FATA[0000] Error: failed to checkpoint one or more containers
Here is my environment.
Docker: compiled from https://github.com/boucher/docker/tree/boucher-cr
CRIU: avagin@9fc4975
Actually, I'm now sure how boucher's Docker and criu are related, but I installed criu under /usr/local/sbin/criu.
root@vagrant-ubuntu-trusty:~/docker# /usr/local/sbin/criu --version
Version: 1.5
GitID: v1.2-1326-ga8e1f59
Any ideas how to debug? Appriciate for your help.
Support seccomp filter
@xemul
With the latest runc where seccomp was introduced, I tried to do the criu of container
Got the following dump log messages
(00.002859) Error (proc_parse.c:826): SECCOMP_MODE_FILTER not currently supported
(00.002899) Error (proc_parse.c:839): Error parsing proc status file
Looks like as per the code, seccomp filter is not supported.
if (cr->seccomp_mode == SECCOMP_MODE_FILTER) {
pr_err("SECCOMP_MODE_FILTER not currently supported\n");
goto err_parse;
}
Is the seccomp filter available in the latest criu ?
Error (mount.c:1254): mnt: Can't restore tmpfs content
Hi,
I am using experimental docker with C/R commands but failed to restore a container.
My environment:
Debian based with custom 4.0.0 kernel.
Docker version 1.9.0-dev, build 2919249, experimental
(I am using aufs as storage driver)
CRIU Version: 1.7 GitID: v1.7-42-g9353051
Daemon logs: http://pastebin.com/vEhtpb97
Restore logs: http://pastebin.com/y5kjmEb1
I have another host (let's call it A) with the same environment on which C/R works fine so I don't understand why it's falling on host B.
Thanks for the help and let me know if I can provide any other information.
Support undo semaphores (sysvipc)
Pulled from criu.org/Todo
These are SysVIPC objects created with semctl() and SEM_UNDO flag. Shame on us, we don't even detect these are created. Fortunately they are not in active use. Need to do it -- dump and restore. Requires modifications from both sides — criu and kernel.
Split zdtm/live/static/mountpoints test into sub-tests
Pulled from criu.org/Todo
Currently this one is one big set of tests. Need more fine-grained set.
linux-next: Error (fsnotify.c:486): fsnotify: Can't add watch for 0x3 with 0x1: Invalid argument
11:55:43 Dump log : /root/criu/test/dump/static/inotify00/48/1/dump.log
11:55:43 --------------------------------- grep Error ---------------------------------
11:55:43 ------------------------------------- END -------------------------------------
11:55:43 Restore log: /root/criu/test/dump/static/inotify00/48/1/restore.log
11:55:43 --------------------------------- grep Error ---------------------------------
11:55:43 (00.000167) Error (sysctl.c:142): Can't open sysctl net/ipv4/tcp_rmem: No such file or directory
11:55:43 (00.005886) 48: Error (fsnotify.c:486): fsnotify: Can't add watch for 0x3 with 0x1: Invalid argument
11:55:43 (00.006307) Error (cr-restore.c:1234): 48 exited, status=1
11:55:43 (00.006335) Error (cr-restore.c:1933): Restoring FAILED.
11:55:43 ------------------------------------- END -------------------------------------
Docker - After restoring MySQL Container: Cannot connect
I run a Docker MySQL Container. I C/R the container without any errors.
When I try to reconnect to it after restore, I get the message:
ERROR 2003 (HY000): Can't connect to MySQL server on 'xxx.xx.x.x' (111)
If I stop and start the container, I can reconnect
Support bridges in net namespace
Pulled from criu.org/Todo
CRIU — как маленький open-source проект меняет жизнь большой компании
Pls, look and review, if something is not OK.
cannot checkpoint firefox on ubuntu 14
Linux ubuntu 3.13.0-32-generic #57-Ubuntu SMP Tue Jul 15 03:51:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
Steps to reproduce
- built latest criu from source
- run firefox
- run
sudo ./criu dump -D checkpoint -t <pid> --file-locks --tcp-established
Expect: checkpoint firefox
Actual:
Error (parasite-syscall.c:387): si_code=1 si_pid=7723 si_status=0
Error (parasite-syscall.c:387): si_code=1 si_pid=7725 si_status=0
Error (parasite-syscall.c:387): si_code=1 si_pid=7727 si_status=0
Error (parasite-syscall.c:387): si_code=1 si_pid=7729 si_status=0
Error (parasite-syscall.c:387): si_code=1 si_pid=7731 si_status=0
Error (parasite-syscall.c:387): si_code=1 si_pid=7733 si_status=0
Error (parasite-syscall.c:387): si_code=1 si_pid=7735 si_status=0
Error (parasite-syscall.c:387): si_code=1 si_pid=7737 si_status=0
Error (parasite-syscall.c:387): si_code=1 si_pid=7739 si_status=0
Error (parasite-syscall.c:387): si_code=1 si_pid=7741 si_status=0
Error (parasite-syscall.c:387): si_code=1 si_pid=7743 si_status=0
Error (parasite-syscall.c:387): si_code=1 si_pid=7745 si_status=0
Error (parasite-syscall.c:387): si_code=4 si_pid=7507 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7508 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7509 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7510 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7511 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7512 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7513 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7514 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7518 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7519 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7521 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7522 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7523 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7524 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7525 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7527 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7528 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7529 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7530 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7533 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7534 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7535 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7536 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7537 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7539 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7541 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7542 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7543 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7545 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7546 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7550 si_status=5
Error (parasite-syscall.c:387): si_code=4 si_pid=7640 si_status=5
Error (cr-dump.c:408): Task 7501 with SysVIPC shmem map @7f473a185000 doesn't live in IPC ns
Error (cr-dump.c:1665): Dump mappings (pid: 7501) failed with -1
Error (cr-dump.c:1953): Dumping FAILED.
Shared memory changes tracking
The --track-mem option tracks changes in anon private vmas. We can do similar for anon shared memory by checking softdirty bits on individual tasks.
Split zdtm/live/static/sockets00 test into sub-tests
Dump tasks from arbitrary cgroup
Pulled from criu.org/Todo
Currently criu dumps a subtree from given pid. It makes sense to request CRIU to dump a set of tasks from given cgroup.
This is partially done with the --freeze-cgroup option.
Failure restoring container 1.9 experimental cr-combined
Running boucher's docker 1.9 experimental cr-combined fork.
$ docker -v
Docker version 1.9.0-dev, build 2791165-dirty, experimental
$
Success:
All on same host:
- docker run -d stlalpha/experimental (returns containerid)
- docker checkpoint [containerid]
- docker restore [containerid]
Failure:
All on same host:
- docker run -d stlalpha/experimental (returns containerid)
- docker checkpoint --image-dir=/home/whatevs/test1 [containerid]
- docker create stlalpha/experimental (returns dest-containerid)
- docker start [dest-containerid]
- docker stop [dest-containerid]
- docker restore --image-dir=/home/whatevs/test1 --work-dir=/tmp --force [dest-containerid]
Results in the following errors in /tmp/restore.log:
https://gist.github.com/stlalpha/bdafa07af3bfc2d654be
The image I am working with is available on dockerhub (stlalpha/experimental).
Please let me know if I can provide any further detail. Thank-you!
-jm
Pre-created cpuset cgroup with not configured .cpus/.mems causes restore to fail
Hi! I 'm trying to restore a docker MySQL container to another host. So I checkpointed it, moved the dump files to another PC, created a new "identical" container (didn't run it) and executed
docker restore --force=true --image-dir /home/kyriakos/Desktop/c_r --work-dir ~/Desktop/logs container-name
The results
Error response from daemon: Cannot restore container mysql_impo: criu failed: type NOTIFY errno 0
Error: failed to restore one or more containers
The restore log
(00.000111) Added /sys/fs/cgroup/cpuset:/sys/fs/cgroup/cpuset ext mount mapping
(00.000151) Added /sys/fs/cgroup/cpu:/sys/fs/cgroup/cpu ext mount mapping
(00.000156) Added /sys/fs/cgroup/cpuacct:/sys/fs/cgroup/cpuacct ext mount mapping
(00.000159) Added /sys/fs/cgroup/memory:/sys/fs/cgroup/memory ext mount mapping
(00.000162) Added /sys/fs/cgroup/devices:/sys/fs/cgroup/devices ext mount mapping
(00.000165) Added /sys/fs/cgroup/freezer:/sys/fs/cgroup/freezer ext mount mapping
(00.000168) Added /sys/fs/cgroup/net_cls:/sys/fs/cgroup/net_cls ext mount mapping
(00.000171) Added /sys/fs/cgroup/blkio:/sys/fs/cgroup/blkio ext mount mapping
(00.000173) Added /sys/fs/cgroup/perf_event:/sys/fs/cgroup/perf_event ext mount mapping
(00.000176) Added /sys/fs/cgroup/net_prio:/sys/fs/cgroup/net_prio ext mount mapping
(00.000179) Added /sys/fs/cgroup/hugetlb:/sys/fs/cgroup/hugetlb ext mount mapping
(00.000182) Added /sys/fs/cgroup/systemd:/sys/fs/cgroup/systemd ext mount mapping
(00.000185) Added /var/lib/mysql:/var/lib/docker/volumes/da0a45864a7af547cbec0b3c1193fc1ba0b5f6a7da965820d011841c39ca3251/_data ext mount mapping
(00.000188) Added /etc/resolv.conf:/var/lib/docker/containers/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/resolv.conf ext mount mapping
(00.000191) Added /etc/hostname:/var/lib/docker/containers/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/hostname ext mount mapping
(00.000194) Added /etc/hosts:/var/lib/docker/containers/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/hosts ext mount mapping
(00.000277) TCP recv queue memory limit is 3145728
(00.000307) cpu: fpu:1 fxsr:1 xsave:1
(00.000405) vdso: Parsing at 7ffc65d79000 7ffc65d7b000
(00.000411) vdso: PT_LOAD p_vaddr: 0
(00.000414) vdso: DT_HASH: 0x120
(00.000417) vdso: DT_STRTAB: 0x268
(00.000420) vdso: DT_SYMTAB: 0x160
(00.000422) vdso: DT_STRSZ: 94
(00.000425) vdso: DT_SYMENT: 24
(00.000427) vdso: nbucket 3 nchain 11 bucket 0x7ffc65d79128 chain 0x7ffc65d79134
(00.000433) vdso: rt [vdso] 7ffc65d79000-7ffc65d7b000 [vvar] 7ffc65d77000-7ffc65d79000
(00.000465) Reading image tree
(00.000489) Add mnt ns 11 pid 1
(00.000502) Will restore in 6c020000 namespaces
(00.000506) NS mask to use 6c020000
(00.000512) Collecting 37/21 (flags 0)
(00.000527) `- ... done
(00.000563) cg: Preparing cgroups yard (cgroups restore mode 0x4)
(00.001121) cg: Opening .criu.cgyard.xy4Eaz as cg yard
(00.001137) cg: Making controller dir .criu.cgyard.xy4Eaz/cpuset (cpuset)
(00.001490) cg: Determined cgroup dir cpuset/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573 already exist
(00.001496) cg: Skip restoring properties on cgroup dir cpuset/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573
(00.001503) cg: Making controller dir .criu.cgyard.xy4Eaz/cpu (cpu)
(00.001842) cg: Determined cgroup dir cpu/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573 already exist
(00.001848) cg: Skip restoring properties on cgroup dir cpu/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573
(00.001856) cg: Making controller dir .criu.cgyard.xy4Eaz/cpuacct (cpuacct)
(00.002235) cg: Determined cgroup dir cpuacct/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573 already exist
(00.002279) cg: Skip restoring properties on cgroup dir cpuacct/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573
(00.002287) cg: Making controller dir .criu.cgyard.xy4Eaz/memory (memory)
(00.003106) cg: Determined cgroup dir memory/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573 already exist
(00.003113) cg: Skip restoring properties on cgroup dir memory/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573
(00.003122) cg: Making controller dir .criu.cgyard.xy4Eaz/devices (devices)
(00.003233) cg: Determined cgroup dir devices/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573 already exist
(00.003241) cg: Skip restoring properties on cgroup dir devices/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573
(00.003256) cg: Making controller dir .criu.cgyard.xy4Eaz/freezer (freezer)
(00.003344) cg: Determined cgroup dir freezer/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573 already exist
(00.003349) cg: Skip restoring properties on cgroup dir freezer/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573
(00.003355) cg: Making controller dir .criu.cgyard.xy4Eaz/net_cls (net_cls)
(00.003474) cg: Determined cgroup dir net_cls/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573 already exist
(00.003479) cg: Skip restoring properties on cgroup dir net_cls/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573
(00.003485) cg: Making controller dir .criu.cgyard.xy4Eaz/blkio (blkio)
(00.003584) cg: Determined cgroup dir blkio/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573 already exist
(00.003588) cg: Skip restoring properties on cgroup dir blkio/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573
(00.003595) cg: Making controller dir .criu.cgyard.xy4Eaz/perf_event (perf_event)
(00.003664) cg: Determined cgroup dir perf_event/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573 already exist
(00.003669) cg: Skip restoring properties on cgroup dir perf_event/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573
(00.003675) cg: Making controller dir .criu.cgyard.xy4Eaz/net_prio (net_prio)
(00.003716) cg: Determined cgroup dir net_prio/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573 already exist
(00.003720) cg: Skip restoring properties on cgroup dir net_prio/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573
(00.003726) cg: Making controller dir .criu.cgyard.xy4Eaz/hugetlb (hugetlb)
(00.003849) cg: Determined cgroup dir hugetlb/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573 already exist
(00.003854) cg: Skip restoring properties on cgroup dir hugetlb/docker/b8ea7fb3f4a0007a769804a101ba551356d6a3b1909ab242562310874fd9b573
(00.003862) cg: Making controller dir .criu.cgyard.xy4Eaz/systemd (none,name=systemd)
(00.003958) cg: Determined cgroup dir systemd/ already exist
(00.003962) cg: Skip restoring properties on cgroup dir systemd/
(00.003968) cg: Determined cgroup dir systemd//user already exist
(00.003971) cg: Skip restoring properties on cgroup dir systemd//user
(00.003977) cg: Determined cgroup dir systemd//user/107.user already exist
(00.003980) cg: Skip restoring properties on cgroup dir systemd//user/107.user
(00.003986) cg: Determined cgroup dir systemd//user/107.user/c1.session already exist
(00.003990) cg: Skip restoring properties on cgroup dir systemd//user/107.user/c1.session
(00.003995) cg: Determined cgroup dir systemd//user/1000.user already exist
(00.003999) cg: Skip restoring properties on cgroup dir systemd//user/1000.user
(00.004005) cg: Determined cgroup dir systemd//user/1000.user/c2.session already exist
(00.004008) cg: Skip restoring properties on cgroup dir systemd//user/1000.user/c2.session
(00.004057) Warn (cr-restore.c:1041): Set CLONE_PARENT | CLONE_NEWPID but it might cause restore problem,because not all kernels support such clone flags combinations!
(00.004062) Forking task with 1 pid (flags 0x6c028000)
(00.004077) Saved netns fd for links restore
(00.008215) PID: real 5148 virt 1
(00.008321) Wait until namespaces are created
(00.009932) Running setup-namespaces scripts
(00.009969) RPC
(00.010122) 1: Restoring namespaces 1 flags 0x6c028000
(00.010604) 1: Restoring link lo type 1
(00.010879) 1: Restoring link eth0 type 2
(00.010884) 1: Restoring netdev eth0 idx 20
(00.010888) 1: Restore ll addr (02:../6) for device
(00.012052) 1: DEBUG Skip eth0/accept_local, val =0
(00.012060) 1: DEBUG Skip eth0/accept_redirects, val =1
(00.012063) 1: DEBUG Skip eth0/accept_source_route, val =1
(00.012066) 1: DEBUG Skip eth0/arp_accept, val =0
(00.012069) 1: DEBUG Skip eth0/arp_announce, val =0
(00.012072) 1: DEBUG Skip eth0/arp_filter, val =0
(00.012080) 1: DEBUG Skip eth0/arp_ignore, val =0
(00.012187) 1: DEBUG Skip eth0/arp_notify, val =0
(00.012192) 1: DEBUG Skip eth0/bootp_relay, val =0
(00.012195) 1: DEBUG Skip eth0/disable_policy, val =0
(00.012198) 1: DEBUG Skip eth0/disable_xfrm, val =0
(00.012200) 1: DEBUG Skip eth0/force_igmp_version, val =0
(00.012203) 1: DEBUG Skip eth0/forwarding, val =1
(00.012206) 1: DEBUG Skip eth0/igmpv2_unsolicited_report_interval, val =10000
(00.012209) 1: DEBUG Skip eth0/igmpv3_unsolicited_report_interval, val =1000
(00.012212) 1: DEBUG Skip eth0/log_martians, val =0
(00.012215) 1: DEBUG Skip eth0/medium_id, val =0
(00.012218) 1: DEBUG Skip eth0/promote_secondaries, val =0
(00.012290) 1: DEBUG Skip eth0/proxy_arp, val =0
(00.012296) 1: DEBUG Skip eth0/proxy_arp_pvlan, val =0
(00.012299) 1: DEBUG Skip eth0/route_localnet, val =0
(00.012301) 1: DEBUG Skip eth0/rp_filter, val =1
(00.012304) 1: DEBUG Skip eth0/secure_redirects, val =1
(00.012307) 1: DEBUG Skip eth0/send_redirects, val =1
(00.012310) 1: DEBUG Skip eth0/shared_media, val =1
(00.012313) 1: DEBUG Skip eth0/src_valid_mark, val =0
(00.012316) 1: DEBUG Skip eth0/tag, val =0
(00.012337) 1: Running ip addr restore
(00.018219) 1: Found fd 1 (id pipe:[173136]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.018285) 1: Inherit fd 1 moved to 7 to resolve clash
RTNETLINK answers: File exists
RTNETLINK answers: File exists
(00.019724) 1: Running ip route restore
(00.025395) 1: Found fd 1 (id pipe:[173136]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.025455) 1: Inherit fd 1 moved to 7 to resolve clash
RTNETLINK answers: File exists
(00.026933) 1: Running iptables-restore for iptables-restore
(00.032704) 1: Found fd 1 (id pipe:[173136]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.032786) 1: Inherit fd 1 moved to 7 to resolve clash
(00.035404) 1: kernel/hostname nr 12
(00.035666) 1: kernel/domainname nr 6
(00.035683) 1: Restoring IPC namespace
(00.035687) 1: Restoring IPC variables
(00.035858) 1: Restoring IPC shared memory
(00.035865) 1: No ipcns-shm-9.img image
(00.035869) 1: Restoring IPC message queues
(00.035874) 1: No ipcns-msg-9.img image
(00.035877) 1: Restoring IPC semaphores sets
(00.035882) 1: No ipcns-sem-9.img image
(00.035886) 1: Restoring mount namespace
(00.036011) 1: type ext4 source /dev/disk/by-uuid/b2c933d5-6fa6-4035-980a-ac7ae5fe64d2 mnt_id 65 s_dev 0x800006 / @ ./ flags 0x200000 options errors=remount-ro,data=ordered
(00.036100) 1: type devtmpfs source udev mnt_id 66 s_dev 0x6 / @ ./dev flags 0x200000 options size=1663008k,nr_inodes=415752,mode=755
(00.036110) 1: type devpts source devpts mnt_id 67 s_dev 0xd / @ ./dev/pts flags 0x20000a options gid=5,mode=620,ptmxmode=000
(00.036159) 1: type tmpfs source tmpfs mnt_id 68 s_dev 0x11 / @ ./run flags 0x20000a options size=333076k,mode=755
(00.036170) 1: type tmpfs source none mnt_id 69 s_dev 0x14 / @ ./run/lock flags 0x20000e options size=5120k
(00.036178) 1: type tmpfs source none mnt_id 70 s_dev 0x15 / @ ./run/shm flags 0x200006 options
(00.036187) 1: type tmpfs source none mnt_id 71 s_dev 0x16 / @ ./run/user flags 0x20000e options size=102400k,mode=755
(00.036195) 1: type fuse source gvfsd-fuse mnt_id 72 s_dev 0x26 / @ ./run/user/1000/gvfs flags 0x200006 options user_id=1000,group_id=1000
(00.036204) 1: type fuse source vmware-vmblock mnt_id 73 s_dev 0x25 / @ ./run/vmblock-fuse flags 0x200006 options user_id=0,group_id=0,default_permissions,allow_other
(00.036212) 1: type nsfs source nsfs mnt_id 74 s_dev 0x3 / @ ./run/docker/netns/16e94965a2a4 flags 0x1000000 options
(00.036327) 1: type aufs source none mnt_id 75 s_dev 0x27 / @ ./run/docker/execdriver/native/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/criu-root flags 0x200000 options si=f7520c4da969c7db,dio,dirperm1
(00.036352) 1: type sysfs source sysfs mnt_id 76 s_dev 0x10 / @ ./sys flags 0x20000e options
(00.036389) 1: type tmpfs source none mnt_id 77 s_dev 0x12 / @ ./sys/fs/cgroup flags 0x200000 options size=4k,mode=755
(00.036398) 1: type cgroup source cgroup mnt_id 78 s_dev 0x18 / @ ./sys/fs/cgroup/cpuset flags 0x200000 options cpuset
(00.036406) 1: type cgroup source cgroup mnt_id 79 s_dev 0x19 / @ ./sys/fs/cgroup/cpu flags 0x200000 options cpu
(00.036414) 1: type cgroup source cgroup mnt_id 80 s_dev 0x1a / @ ./sys/fs/cgroup/cpuacct flags 0x200000 options cpuacct
(00.036422) 1: type cgroup source cgroup mnt_id 81 s_dev 0x1b / @ ./sys/fs/cgroup/memory flags 0x200000 options memory
(00.036430) 1: type cgroup source cgroup mnt_id 82 s_dev 0x1c / @ ./sys/fs/cgroup/devices flags 0x200000 options devices
(00.036437) 1: type cgroup source cgroup mnt_id 83 s_dev 0x1d / @ ./sys/fs/cgroup/freezer flags 0x200000 options freezer
(00.036447) 1: type cgroup source cgroup mnt_id 84 s_dev 0x1e / @ ./sys/fs/cgroup/net_cls flags 0x200000 options net_cls
(00.036456) 1: type cgroup source cgroup mnt_id 85 s_dev 0x1f / @ ./sys/fs/cgroup/blkio flags 0x200000 options blkio
(00.036463) 1: type cgroup source cgroup mnt_id 86 s_dev 0x20 / @ ./sys/fs/cgroup/perf_event flags 0x200000 options perf_event
(00.036471) 1: type cgroup source cgroup mnt_id 87 s_dev 0x21 / @ ./sys/fs/cgroup/net_prio flags 0x200000 options net_prio
(00.036506) 1: type cgroup source cgroup mnt_id 88 s_dev 0x22 / @ ./sys/fs/cgroup/hugetlb flags 0x200000 options hugetlb
(00.036562) 1: type cgroup source systemd mnt_id 89 s_dev 0x23 / @ ./sys/fs/cgroup/systemd flags 0x20000e options name=systemd
(00.036572) 1: type fusectl source none mnt_id 90 s_dev 0x13 / @ ./sys/fs/fuse/connections flags 0x200000 options
(00.036580) 1: type debugfs source none mnt_id 91 s_dev 0x7 / @ ./sys/kernel/debug flags 0x200000 options
(00.036662) 1: type securityfs source none mnt_id 92 s_dev 0xb / @ ./sys/kernel/security flags 0x200000 options
(00.036671) 1: type pstore source none mnt_id 93 s_dev 0x17 / @ ./sys/fs/pstore flags 0x200000 options
(00.036679) 1: type proc source proc mnt_id 94 s_dev 0x4 / @ ./proc flags 0x20000e options
(00.036717) 1: type vfat source /dev/sdf1 mnt_id 95 s_dev 0x800051 / @ ./media/kyriakos/UBUNTU 14_0 flags 0x200006 options uid=1000,gid=1000,fmask=0022,dmask=0077,codepage=437,iocharset=iso8859-1,shortname=mixed,showexec,utf8,flush,errors=remount-ro
(00.036729) 1: type ext4 source /dev/disk/by-uuid/b2c933d5-6fa6-4035-980a-ac7ae5fe64d2 mnt_id 96 s_dev 0x800006 /var/lib/docker/aufs @ ./var/lib/docker/aufs flags 0x200000 options errors=remount-ro,data=ordered
(00.036738) 1: type aufs source none mnt_id 97 s_dev 0x27 / @ ./var/lib/docker/aufs/mnt/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743 flags 0x200000 options si=f7520c4da969c7db,dio,dirperm1
(00.036765) 1: type tmpfs source none mnt_id 98 s_dev 0x28 / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz flags 0x200000 options
(00.036774) 1: type cgroup source none mnt_id 99 s_dev 0x18 / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/cpuset flags 0x200000 options cpuset
(00.036785) 1: type cgroup source none mnt_id 100 s_dev 0x19 / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/cpu flags 0x200000 options cpu
(00.036793) 1: type cgroup source none mnt_id 101 s_dev 0x1a / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/cpuacct flags 0x200000 options cpuacct
(00.036801) 1: type cgroup source none mnt_id 102 s_dev 0x1b / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/memory flags 0x200000 options memory
(00.036881) 1: type cgroup source none mnt_id 103 s_dev 0x1c / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/devices flags 0x200000 options devices
(00.036892) 1: type cgroup source none mnt_id 104 s_dev 0x1d / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/freezer flags 0x200000 options freezer
(00.036905) 1: type cgroup source none mnt_id 105 s_dev 0x1e / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/net_cls flags 0x200000 options net_cls
(00.036941) 1: type cgroup source none mnt_id 106 s_dev 0x1f / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/blkio flags 0x200000 options blkio
(00.036953) 1: type cgroup source none mnt_id 107 s_dev 0x20 / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/perf_event flags 0x200000 options perf_event
(00.036968) 1: type cgroup source none mnt_id 108 s_dev 0x21 / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/net_prio flags 0x200000 options net_prio
(00.036976) 1: type cgroup source none mnt_id 109 s_dev 0x22 / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/hugetlb flags 0x200000 options hugetlb
(00.036985) 1: type cgroup source none mnt_id 110 s_dev 0x23 / @ ./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/systemd flags 0x200000 options name=systemd
(00.036997) 1: Building mountpoints tree
(00.037001) 1: Building plain mount tree
(00.037004) 1: Working on 110->98
(00.037007) 1: Working on 109->98
(00.037010) 1: Working on 108->98
(00.037012) 1: Working on 107->98
(00.037015) 1: Working on 106->98
(00.037018) 1: Working on 105->98
(00.037021) 1: Working on 104->98
(00.037024) 1: Working on 103->98
(00.037026) 1: Working on 102->98
(00.037100) 1: Working on 101->98
(00.037105) 1: Working on 100->98
(00.037108) 1: Working on 99->98
(00.037111) 1: Working on 98->65
(00.037114) 1: Working on 97->96
(00.037117) 1: Working on 96->65
(00.037120) 1: Working on 95->65
(00.037122) 1: Working on 94->65
(00.037125) 1: Working on 93->76
(00.037128) 1: Working on 92->76
(00.037131) 1: Working on 91->76
(00.037161) 1: Working on 90->76
(00.037165) 1: Working on 89->77
(00.037168) 1: Working on 88->77
(00.037171) 1: Working on 87->77
(00.037174) 1: Working on 86->77
(00.037176) 1: Working on 85->77
(00.037179) 1: Working on 84->77
(00.037182) 1: Working on 83->77
(00.037185) 1: Working on 82->77
(00.037187) 1: Working on 81->77
(00.037190) 1: Working on 80->77
(00.037193) 1: Working on 79->77
(00.037195) 1: Working on 78->77
(00.037198) 1: Working on 77->76
(00.037201) 1: Working on 76->65
(00.037204) 1: Working on 75->68
(00.037207) 1: Working on 74->68
(00.037210) 1: Working on 73->68
(00.037212) 1: Working on 72->71
(00.037215) 1: Working on 71->68
(00.037218) 1: Working on 70->68
(00.037221) 1: Working on 69->68
(00.037223) 1: Working on 68->65
(00.037226) 1: Working on 67->66
(00.037229) 1: Working on 66->65
(00.037232) 1: Working on 65->64
(00.037235) 1: Resorting siblings on 65
(00.037237) 1: Resorting siblings on 98
(00.037240) 1: Resorting siblings on 110
(00.037243) 1: Resorting siblings on 109
(00.037246) 1: Resorting siblings on 108
(00.037318) 1: Resorting siblings on 107
(00.037323) 1: Resorting siblings on 106
(00.037326) 1: Resorting siblings on 105
(00.037329) 1: Resorting siblings on 104
(00.037332) 1: Resorting siblings on 103
(00.037335) 1: Resorting siblings on 102
(00.037338) 1: Resorting siblings on 101
(00.037340) 1: Resorting siblings on 100
(00.037343) 1: Resorting siblings on 99
(00.037346) 1: Resorting siblings on 96
(00.037349) 1: Resorting siblings on 97
(00.037378) 1: Resorting siblings on 95
(00.037383) 1: Resorting siblings on 94
(00.037386) 1: Resorting siblings on 76
(00.037389) 1: Resorting siblings on 93
(00.037392) 1: Resorting siblings on 92
(00.037394) 1: Resorting siblings on 91
(00.037397) 1: Resorting siblings on 90
(00.037400) 1: Resorting siblings on 77
(00.037403) 1: Resorting siblings on 89
(00.037406) 1: Resorting siblings on 88
(00.037413) 1: Resorting siblings on 87
(00.037416) 1: Resorting siblings on 86
(00.037419) 1: Resorting siblings on 85
(00.037422) 1: Resorting siblings on 84
(00.037425) 1: Resorting siblings on 83
(00.037427) 1: Resorting siblings on 82
(00.037430) 1: Resorting siblings on 81
(00.037433) 1: Resorting siblings on 80
(00.037436) 1: Resorting siblings on 79
(00.037438) 1: Resorting siblings on 78
(00.037441) 1: Resorting siblings on 68
(00.037444) 1: Resorting siblings on 75
(00.037447) 1: Resorting siblings on 74
(00.037450) 1: Resorting siblings on 73
(00.037452) 1: Resorting siblings on 71
(00.037455) 1: Resorting siblings on 72
(00.037458) 1: Resorting siblings on 70
(00.037460) 1: Resorting siblings on 69
(00.037463) 1: Resorting siblings on 66
(00.037466) 1: Resorting siblings on 67
(00.037469) 1: Done:
(00.037471) 1: [./](65->64)
(00.037475) 1: [./proc](94->65)
(00.037478) 1: <--
(00.037480) 1: [./dev](66->65)
(00.037483) 1: [./dev/pts](67->66)
(00.037486) 1: <--
(00.037489) 1: <--
(00.037492) 1: [./run](68->65)
(00.037495) 1: [./run/vmblock-fuse](73->68)
(00.037498) 1: <--
(00.037500) 1: [./run/lock](69->68)
(00.037503) 1: <--
(00.037506) 1: [./run/shm](70->68)
(00.037509) 1: <--
(00.037511) 1: [./run/user](71->68)
(00.037514) 1: [./run/user/1000/gvfs](72->71)
(00.037517) 1: <--
(00.037520) 1: <--
(00.037522) 1: [./run/docker/netns/16e94965a2a4](74->68)
(00.037525) 1: <--
(00.037528) 1: [./run/docker/execdriver/native/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/criu-root](75->68)
(00.037531) 1: <--
(00.037534) 1: <--
(00.037537) 1: [./sys](76->65)
(00.037540) 1: [./sys/fs/pstore](93->76)
(00.037543) 1: <--
(00.037545) 1: [./sys/fs/cgroup](77->76)
(00.037548) 1: [./sys/fs/cgroup/systemd](89->77)
(00.037551) 1: <--
(00.037554) 1: [./sys/fs/cgroup/cpuset](78->77)
(00.037557) 1: <--
(00.037559) 1: [./sys/fs/cgroup/cpu](79->77)
(00.037562) 1: <--
(00.037565) 1: [./sys/fs/cgroup/cpuacct](80->77)
(00.037568) 1: <--
(00.037571) 1: [./sys/fs/cgroup/memory](81->77)
(00.037574) 1: <--
(00.037576) 1: [./sys/fs/cgroup/devices](82->77)
(00.037579) 1: <--
(00.037582) 1: [./sys/fs/cgroup/freezer](83->77)
(00.037585) 1: <--
(00.037587) 1: [./sys/fs/cgroup/net_cls](84->77)
(00.037590) 1: <--
(00.037593) 1: [./sys/fs/cgroup/blkio](85->77)
(00.037596) 1: <--
(00.037599) 1: [./sys/fs/cgroup/perf_event](86->77)
(00.037602) 1: <--
(00.037604) 1: [./sys/fs/cgroup/net_prio](87->77)
(00.037607) 1: <--
(00.037610) 1: [./sys/fs/cgroup/hugetlb](88->77)
(00.037613) 1: <--
(00.037615) 1: <--
(00.037618) 1: [./sys/fs/fuse/connections](90->76)
(00.037621) 1: <--
(00.037624) 1: [./sys/kernel/debug](91->76)
(00.037627) 1: <--
(00.037629) 1: [./sys/kernel/security](92->76)
(00.037632) 1: <--
(00.037635) 1: <--
(00.037638) 1: [./media/kyriakos/UBUNTU 14_0](95->65)
(00.037641) 1: <--
(00.037643) 1: [./var/lib/docker/aufs](96->65)
(00.037646) 1: [./var/lib/docker/aufs/mnt/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743](97->96)
(00.037649) 1: <--
(00.037652) 1: <--
(00.037655) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz](98->65)
(00.037658) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/systemd](110->98)
(00.037661) 1: <--
(00.037664) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/cpuset](99->98)
(00.037667) 1: <--
(00.037669) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/cpu](100->98)
(00.037672) 1: <--
(00.037675) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/cpuacct](101->98)
(00.037681) 1: <--
(00.037685) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/memory](102->98)
(00.037688) 1: <--
(00.037690) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/devices](103->98)
(00.037694) 1: <--
(00.037696) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/freezer](104->98)
(00.037699) 1: <--
(00.037702) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/net_cls](105->98)
(00.037705) 1: <--
(00.037708) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/blkio](106->98)
(00.037711) 1: <--
(00.037713) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/perf_event](107->98)
(00.037716) 1: <--
(00.037719) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/net_prio](108->98)
(00.037722) 1: <--
(00.037725) 1: [./home/kyriakos/Desktop/logs/.criu.cgyard.xy4Eaz/hugetlb](109->98)
(00.037728) 1: <--
(00.037731) 1: <--
(00.037733) 1: <--
(00.037749) 1: Reading mountpoint images
(00.037756) 1: Getting source for 60
(00.037759) 1: Getting root for 60
(00.037763) 1: Getting mpt for 60 ./proc/timer_stats
(00.037766) 1: Getting opts for 60
(00.037769) 1: Read 60 mp @ ./proc/timer_stats
(00.037773) 1: Getting source for 59
(00.037777) 1: Getting root for 59
(00.037780) 1: Getting mpt for 59 ./proc/kcore
(00.037783) 1: Getting opts for 59
(00.037786) 1: Read 59 mp @ ./proc/kcore
(00.037790) 1: Getting source for 58
(00.037793) 1: Getting root for 58
(00.037797) 1: Getting mpt for 58 ./proc/sysrq-trigger
(00.037800) 1: Getting opts for 58
(00.037802) 1: Read 58 mp @ ./proc/sysrq-trigger
(00.037806) 1: Getting source for 57
(00.037810) 1: Getting root for 57
(00.037813) 1: Getting mpt for 57 ./proc/sys
(00.037816) 1: Getting opts for 57
(00.037819) 1: Read 57 mp @ ./proc/sys
(00.037823) 1: Getting source for 56
(00.037826) 1: Getting root for 56
(00.037829) 1: Getting mpt for 56 ./proc/irq
(00.037832) 1: Getting opts for 56
(00.037835) 1: Read 56 mp @ ./proc/irq
(00.037839) 1: Getting source for 55
(00.037842) 1: Getting root for 55
(00.037845) 1: Getting mpt for 55 ./proc/fs
(00.037848) 1: Getting opts for 55
(00.037851) 1: Read 55 mp @ ./proc/fs
(00.037855) 1: Getting source for 54
(00.037859) 1: Getting root for 54
(00.037862) 1: Getting mpt for 54 ./proc/bus
(00.037865) 1: Getting opts for 54
(00.037868) 1: Read 54 mp @ ./proc/bus
(00.037872) 1: Getting source for 53
(00.037875) 1: Getting root for 53
(00.037878) 1: Getting mpt for 53 ./proc/asound
(00.037881) 1: Getting opts for 53
(00.037884) 1: Read 53 mp @ ./proc/asound
(00.037888) 1: Getting source for 111
(00.037893) 1: Mountpoint /etc/hosts will have root from /var/lib/docker/containers/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/hosts
(00.037897) 1: Getting mpt for 111 ./etc/hosts
(00.037900) 1: Getting opts for 111
(00.037902) 1: Read 111 mp @ ./etc/hosts
(00.037907) 1: Getting source for 110
(00.037910) 1: Mountpoint /etc/hostname will have root from /var/lib/docker/containers/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/hostname
(00.037914) 1: Getting mpt for 110 ./etc/hostname
(00.037917) 1: Getting opts for 110
(00.037919) 1: Read 110 mp @ ./etc/hostname
(00.037924) 1: Getting source for 109
(00.037927) 1: Mountpoint /etc/resolv.conf will have root from /var/lib/docker/containers/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/resolv.conf
(00.037931) 1: Getting mpt for 109 ./etc/resolv.conf
(00.037933) 1: Getting opts for 109
(00.037936) 1: Read 109 mp @ ./etc/resolv.conf
(00.037940) 1: Getting source for 108
(00.037944) 1: Mountpoint /var/lib/mysql will have root from /var/lib/docker/volumes/da0a45864a7af547cbec0b3c1193fc1ba0b5f6a7da965820d011841c39ca3251/_data
(00.037952) 1: Getting mpt for 108 ./var/lib/mysql
(00.037955) 1: Getting opts for 108
(00.037958) 1: Read 108 mp @ ./var/lib/mysql
(00.037962) 1: Getting source for 107
(00.037966) 1: Mountpoint /sys/fs/cgroup/systemd will have root from /sys/fs/cgroup/systemd
(00.037969) 1: Getting mpt for 107 ./sys/fs/cgroup/systemd
(00.037972) 1: Getting opts for 107
(00.037975) 1: Read 107 mp @ ./sys/fs/cgroup/systemd
(00.037979) 1: Getting source for 106
(00.037983) 1: Mountpoint /sys/fs/cgroup/hugetlb will have root from /sys/fs/cgroup/hugetlb
(00.037986) 1: Getting mpt for 106 ./sys/fs/cgroup/hugetlb
(00.037989) 1: Getting opts for 106
(00.037992) 1: Read 106 mp @ ./sys/fs/cgroup/hugetlb
(00.037998) 1: Getting source for 105
(00.038002) 1: Mountpoint /sys/fs/cgroup/net_prio will have root from /sys/fs/cgroup/net_prio
(00.038005) 1: Getting mpt for 105 ./sys/fs/cgroup/net_prio
(00.038008) 1: Getting opts for 105
(00.038011) 1: Read 105 mp @ ./sys/fs/cgroup/net_prio
(00.038015) 1: Getting source for 104
(00.038019) 1: Mountpoint /sys/fs/cgroup/perf_event will have root from /sys/fs/cgroup/perf_event
(00.038022) 1: Getting mpt for 104 ./sys/fs/cgroup/perf_event
(00.038025) 1: Getting opts for 104
(00.038028) 1: Read 104 mp @ ./sys/fs/cgroup/perf_event
(00.038032) 1: Getting source for 103
(00.038035) 1: Mountpoint /sys/fs/cgroup/blkio will have root from /sys/fs/cgroup/blkio
(00.038039) 1: Getting mpt for 103 ./sys/fs/cgroup/blkio
(00.038042) 1: Getting opts for 103
(00.038044) 1: Read 103 mp @ ./sys/fs/cgroup/blkio
(00.038048) 1: Getting source for 102
(00.038052) 1: Mountpoint /sys/fs/cgroup/net_cls will have root from /sys/fs/cgroup/net_cls
(00.038055) 1: Getting mpt for 102 ./sys/fs/cgroup/net_cls
(00.038058) 1: Getting opts for 102
(00.038061) 1: Read 102 mp @ ./sys/fs/cgroup/net_cls
(00.038065) 1: Getting source for 101
(00.038068) 1: Mountpoint /sys/fs/cgroup/freezer will have root from /sys/fs/cgroup/freezer
(00.038071) 1: Getting mpt for 101 ./sys/fs/cgroup/freezer
(00.038074) 1: Getting opts for 101
(00.038077) 1: Read 101 mp @ ./sys/fs/cgroup/freezer
(00.038081) 1: Getting source for 100
(00.038085) 1: Mountpoint /sys/fs/cgroup/devices will have root from /sys/fs/cgroup/devices
(00.038088) 1: Getting mpt for 100 ./sys/fs/cgroup/devices
(00.038091) 1: Getting opts for 100
(00.038094) 1: Read 100 mp @ ./sys/fs/cgroup/devices
(00.038100) 1: Getting source for 99
(00.038103) 1: Mountpoint /sys/fs/cgroup/memory will have root from /sys/fs/cgroup/memory
(00.038107) 1: Getting mpt for 99 ./sys/fs/cgroup/memory
(00.038110) 1: Getting opts for 99
(00.038112) 1: Read 99 mp @ ./sys/fs/cgroup/memory
(00.038117) 1: Getting source for 98
(00.038120) 1: Mountpoint /sys/fs/cgroup/cpuacct will have root from /sys/fs/cgroup/cpuacct
(00.038123) 1: Getting mpt for 98 ./sys/fs/cgroup/cpuacct
(00.038126) 1: Getting opts for 98
(00.038129) 1: Read 98 mp @ ./sys/fs/cgroup/cpuacct
(00.038133) 1: Getting source for 97
(00.038136) 1: Mountpoint /sys/fs/cgroup/cpu will have root from /sys/fs/cgroup/cpu
(00.038139) 1: Getting mpt for 97 ./sys/fs/cgroup/cpu
(00.038142) 1: Getting opts for 97
(00.038145) 1: Read 97 mp @ ./sys/fs/cgroup/cpu
(00.038149) 1: Getting source for 96
(00.038152) 1: Mountpoint /sys/fs/cgroup/cpuset will have root from /sys/fs/cgroup/cpuset
(00.038163) 1: Getting mpt for 96 ./sys/fs/cgroup/cpuset
(00.038167) 1: Getting opts for 96
(00.038170) 1: Read 96 mp @ ./sys/fs/cgroup/cpuset
(00.038174) 1: Getting source for 95
(00.038178) 1: Getting root for 95
(00.038181) 1: Getting mpt for 95 ./sys/fs/cgroup
(00.038251) 1: Getting opts for 95
(00.038255) 1: Read 95 mp @ ./sys/fs/cgroup
(00.038260) 1: Getting source for 94
(00.038263) 1: Getting root for 94
(00.038266) 1: Getting mpt for 94 ./sys
(00.038269) 1: Getting opts for 94
(00.038272) 1: Read 94 mp @ ./sys
(00.038276) 1: Getting source for 93
(00.038279) 1: Getting root for 93
(00.038284) 1: Getting mpt for 93 ./dev/mqueue
(00.038288) 1: Getting opts for 93
(00.038291) 1: Read 93 mp @ ./dev/mqueue
(00.038295) 1: Getting source for 92
(00.038298) 1: Getting root for 92
(00.038301) 1: Getting mpt for 92 ./dev/shm
(00.038304) 1: Getting opts for 92
(00.038307) 1: Read 92 mp @ ./dev/shm
(00.038311) 1: Getting source for 91
(00.038314) 1: Getting root for 91
(00.038317) 1: Getting mpt for 91 ./dev/pts
(00.038320) 1: Getting opts for 91
(00.038322) 1: Read 91 mp @ ./dev/pts
(00.038326) 1: Getting source for 90
(00.038330) 1: Getting root for 90
(00.038333) 1: Getting mpt for 90 ./dev
(00.038336) 1: Getting opts for 90
(00.038338) 1: Read 90 mp @ ./dev
(00.038342) 1: Getting source for 89
(00.038346) 1: Getting root for 89
(00.038349) 1: Getting mpt for 89 ./proc
(00.038352) 1: Getting opts for 89
(00.038354) 1: Read 89 mp @ ./proc
(00.038358) 1: Getting source for 88
(00.038362) 1: Getting root for 88
(00.038365) 1: Getting mpt for 88 ./
(00.038367) 1: Getting opts for 88
(00.038370) 1: Read 88 mp @ ./
(00.038384) 1: Path `/run/docker/execdriver/native/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/criu-root' resolved to `./run/docker/execdriver/native/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/criu-root' mountpoint
(00.038410) 1: Building mountpoints tree
(00.038414) 1: Building plain mount tree
(00.038416) 1: Working on 88->52
(00.038419) 1: Working on 89->88
(00.038422) 1: Working on 90->88
(00.038425) 1: Working on 91->90
(00.038427) 1: Working on 92->90
(00.038430) 1: Working on 93->90
(00.038433) 1: Working on 94->88
(00.038436) 1: Working on 95->94
(00.038438) 1: Working on 96->95
(00.038441) 1: Working on 97->95
(00.038444) 1: Working on 98->95
(00.038446) 1: Working on 99->95
(00.038449) 1: Working on 100->95
(00.038452) 1: Working on 101->95
(00.038454) 1: Working on 102->95
(00.038457) 1: Working on 103->95
(00.038460) 1: Working on 104->95
(00.038462) 1: Working on 105->95
(00.038465) 1: Working on 106->95
(00.038468) 1: Working on 107->95
(00.038470) 1: Working on 108->88
(00.038473) 1: Working on 109->88
(00.038476) 1: Working on 110->88
(00.038478) 1: Working on 111->88
(00.038481) 1: Working on 53->89
(00.038484) 1: Working on 54->89
(00.038486) 1: Working on 55->89
(00.038489) 1: Working on 56->89
(00.038491) 1: Working on 57->89
(00.038494) 1: Working on 58->89
(00.038497) 1: Working on 59->89
(00.038499) 1: Working on 60->89
(00.038502) 1: Resorting siblings on 88
(00.038505) 1: Resorting siblings on 89
(00.038507) 1: Resorting siblings on 53
(00.038510) 1: Resorting siblings on 54
(00.038513) 1: Resorting siblings on 55
(00.038515) 1: Resorting siblings on 56
(00.038518) 1: Resorting siblings on 57
(00.038521) 1: Resorting siblings on 58
(00.038523) 1: Resorting siblings on 59
(00.038526) 1: Resorting siblings on 60
(00.038529) 1: Resorting siblings on 90
(00.038531) 1: Resorting siblings on 91
(00.038534) 1: Resorting siblings on 92
(00.038537) 1: Resorting siblings on 93
(00.038539) 1: Resorting siblings on 94
(00.038542) 1: Resorting siblings on 95
(00.038545) 1: Resorting siblings on 96
(00.038547) 1: Resorting siblings on 97
(00.038554) 1: Resorting siblings on 98
(00.038557) 1: Resorting siblings on 99
(00.038560) 1: Resorting siblings on 100
(00.038563) 1: Resorting siblings on 101
(00.038566) 1: Resorting siblings on 102
(00.038568) 1: Resorting siblings on 103
(00.038571) 1: Resorting siblings on 104
(00.038574) 1: Resorting siblings on 105
(00.038576) 1: Resorting siblings on 106
(00.038579) 1: Resorting siblings on 107
(00.038582) 1: Resorting siblings on 108
(00.038585) 1: Resorting siblings on 109
(00.038587) 1: Resorting siblings on 110
(00.038590) 1: Resorting siblings on 111
(00.038593) 1: Done:
(00.038595) 1: [./](88->52)
(00.038598) 1: [./proc](89->88)
(00.038601) 1: [./proc/asound](53->89)
(00.038604) 1: <--
(00.038607) 1: [./proc/timer_stats](60->89)
(00.038610) 1: <--
(00.038612) 1: [./proc/kcore](59->89)
(00.038615) 1: <--
(00.038618) 1: [./proc/sysrq-trigger](58->89)
(00.038621) 1: <--
(00.038623) 1: [./proc/sys](57->89)
(00.038626) 1: <--
(00.038629) 1: [./proc/irq](56->89)
(00.038632) 1: <--
(00.038634) 1: [./proc/fs](55->89)
(00.038637) 1: <--
(00.038640) 1: [./proc/bus](54->89)
(00.038643) 1: <--
(00.038646) 1: <--
(00.038648) 1: [./etc/hosts](111->88)
(00.038651) 1: <--
(00.038654) 1: [./etc/hostname](110->88)
(00.038657) 1: <--
(00.038659) 1: [./etc/resolv.conf](109->88)
(00.038662) 1: <--
(00.038665) 1: [./var/lib/mysql](108->88)
(00.038668) 1: <--
(00.038671) 1: [./sys](94->88)
(00.038673) 1: [./sys/fs/cgroup](95->94)
(00.038676) 1: [./sys/fs/cgroup/cpuset](96->95)
(00.038679) 1: <--
(00.038682) 1: [./sys/fs/cgroup/systemd](107->95)
(00.038685) 1: <--
(00.038688) 1: [./sys/fs/cgroup/hugetlb](106->95)
(00.038691) 1: <--
(00.038693) 1: [./sys/fs/cgroup/net_prio](105->95)
(00.038696) 1: <--
(00.038699) 1: [./sys/fs/cgroup/perf_event](104->95)
(00.038702) 1: <--
(00.038705) 1: [./sys/fs/cgroup/blkio](103->95)
(00.038708) 1: <--
(00.038711) 1: [./sys/fs/cgroup/net_cls](102->95)
(00.038714) 1: <--
(00.038716) 1: [./sys/fs/cgroup/freezer](101->95)
(00.038719) 1: <--
(00.038722) 1: [./sys/fs/cgroup/devices](100->95)
(00.038725) 1: <--
(00.038728) 1: [./sys/fs/cgroup/memory](99->95)
(00.038731) 1: <--
(00.038733) 1: [./sys/fs/cgroup/cpuacct](98->95)
(00.038736) 1: <--
(00.038739) 1: [./sys/fs/cgroup/cpu](97->95)
(00.038742) 1: <--
(00.038745) 1: <--
(00.038747) 1: <--
(00.038750) 1: [./dev](90->88)
(00.038753) 1: [./dev/pts](91->90)
(00.038756) 1: <--
(00.038758) 1: [./dev/mqueue](93->90)
(00.038761) 1: <--
(00.038764) 1: [./dev/shm](92->90)
(00.038767) 1: <--
(00.038770) 1: <--
(00.038772) 1: <--
(00.038783) 1: 88:./ private 1 shared 0 slave 0
(00.038790) 1: Start with 88:./
(00.038793) 1: Mounting aufs @./ (0)
(00.038797) 1: Mounting proc @./proc (0)
(00.038820) 1: 89:./proc private 1 shared 0 slave 0
(00.038827) 1: Mounting proc @./proc/asound (0)
(00.038831) 1: Bind ./proc/asound to ./proc/asound
(00.038844) 1: 53:./proc/asound private 1 shared 0 slave 0
(00.038851) 1: Postpone slave ./proc/timer_stats
(00.038855) 1: Postpone slave ./proc/kcore
(00.038858) 1: Mounting proc @./proc/sysrq-trigger (0)
(00.038861) 1: Bind ./proc/sysrq-trigger to ./proc/sysrq-trigger
(00.038872) 1: 58:./proc/sysrq-trigger private 1 shared 0 slave 0
(00.038879) 1: Mounting proc @./proc/sys (0)
(00.038883) 1: Bind ./proc/sys to ./proc/sys
(00.038892) 1: 57:./proc/sys private 1 shared 0 slave 0
(00.038899) 1: Mounting proc @./proc/irq (0)
(00.038903) 1: Bind ./proc/irq to ./proc/irq
(00.038916) 1: 56:./proc/irq private 1 shared 0 slave 0
(00.038923) 1: Mounting proc @./proc/fs (0)
(00.038928) 1: Bind ./proc/fs to ./proc/fs
(00.038936) 1: 55:./proc/fs private 1 shared 0 slave 0
(00.038943) 1: Mounting proc @./proc/bus (0)
(00.038947) 1: Bind ./proc/bus to ./proc/bus
(00.038956) 1: 54:./proc/bus private 1 shared 0 slave 0
(00.038962) 1: Mounting unsupported @./etc/hosts (0)
(00.038966) 1: Bind /var/lib/docker/containers/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/hosts to ./etc/hosts
(00.038981) 1: 111:./etc/hosts private 1 shared 0 slave 0
(00.038992) 1: Mounting unsupported @./etc/hostname (0)
(00.038996) 1: Bind /var/lib/docker/containers/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/hostname to ./etc/hostname
(00.039006) 1: 110:./etc/hostname private 1 shared 0 slave 0
(00.039016) 1: Mounting unsupported @./etc/resolv.conf (0)
(00.039020) 1: Bind /var/lib/docker/containers/16e94965a2a49562b10aa74c98e5e53ec0591bfb1279743455af5e6646422743/resolv.conf to ./etc/resolv.conf
(00.039029) 1: 109:./etc/resolv.conf private 1 shared 0 slave 0
(00.039039) 1: Mounting unsupported @./var/lib/mysql (0)
(00.039043) 1: Bind /var/lib/docker/volumes/da0a45864a7af547cbec0b3c1193fc1ba0b5f6a7da965820d011841c39ca3251/_data to ./var/lib/mysql
(00.039058) 1: 108:./var/lib/mysql private 1 shared 0 slave 0
(00.039068) 1: Mounting sysfs @./sys (0)
(00.039092) 1: 94:./sys private 1 shared 0 slave 0
(00.039098) 1: Mounting tmpfs @./sys/fs/cgroup (0)
(00.039124) 1: 95:./sys/fs/cgroup private 1 shared 0 slave 0
(00.042435) 1: Found fd 1 (id pipe:[173136]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.042517) 1: Inherit fd 1 moved to 4 to resolve clash
(00.044695) 1: Mounting cgroup @./sys/fs/cgroup/cpuset (0)
(00.044707) 1: Bind /sys/fs/cgroup/cpuset to ./sys/fs/cgroup/cpuset
(00.044727) 1: 96:./sys/fs/cgroup/cpuset private 1 shared 0 slave 0
(00.044737) 1: Mounting cgroup @./sys/fs/cgroup/systemd (0)
(00.044741) 1: Bind /sys/fs/cgroup/systemd to ./sys/fs/cgroup/systemd
(00.044751) 1: 107:./sys/fs/cgroup/systemd private 1 shared 0 slave 0
(00.044758) 1: Mounting cgroup @./sys/fs/cgroup/hugetlb (0)
(00.044762) 1: Bind /sys/fs/cgroup/hugetlb to ./sys/fs/cgroup/hugetlb
(00.044772) 1: 106:./sys/fs/cgroup/hugetlb private 1 shared 0 slave 0
(00.044780) 1: Mounting cgroup @./sys/fs/cgroup/net_prio (0)
(00.044784) 1: Bind /sys/fs/cgroup/net_prio to ./sys/fs/cgroup/net_prio
(00.044793) 1: 105:./sys/fs/cgroup/net_prio private 1 shared 0 slave 0
(00.044800) 1: Mounting cgroup @./sys/fs/cgroup/perf_event (0)
(00.044804) 1: Bind /sys/fs/cgroup/perf_event to ./sys/fs/cgroup/perf_event
(00.044813) 1: 104:./sys/fs/cgroup/perf_event private 1 shared 0 slave 0
(00.044820) 1: Mounting cgroup @./sys/fs/cgroup/blkio (0)
(00.044824) 1: Bind /sys/fs/cgroup/blkio to ./sys/fs/cgroup/blkio
(00.044834) 1: 103:./sys/fs/cgroup/blkio private 1 shared 0 slave 0
(00.044841) 1: Mounting cgroup @./sys/fs/cgroup/net_cls (0)
(00.044845) 1: Bind /sys/fs/cgroup/net_cls to ./sys/fs/cgroup/net_cls
(00.044854) 1: 102:./sys/fs/cgroup/net_cls private 1 shared 0 slave 0
(00.044861) 1: Mounting cgroup @./sys/fs/cgroup/freezer (0)
(00.044865) 1: Bind /sys/fs/cgroup/freezer to ./sys/fs/cgroup/freezer
(00.044874) 1: 101:./sys/fs/cgroup/freezer private 1 shared 0 slave 0
(00.044881) 1: Mounting cgroup @./sys/fs/cgroup/devices (0)
(00.044885) 1: Bind /sys/fs/cgroup/devices to ./sys/fs/cgroup/devices
(00.044894) 1: 100:./sys/fs/cgroup/devices private 1 shared 0 slave 0
(00.044901) 1: Mounting cgroup @./sys/fs/cgroup/memory (0)
(00.044905) 1: Bind /sys/fs/cgroup/memory to ./sys/fs/cgroup/memory
(00.044914) 1: 99:./sys/fs/cgroup/memory private 1 shared 0 slave 0
(00.044921) 1: Mounting cgroup @./sys/fs/cgroup/cpuacct (0)
(00.044935) 1: Bind /sys/fs/cgroup/cpuacct to ./sys/fs/cgroup/cpuacct
(00.044945) 1: 98:./sys/fs/cgroup/cpuacct private 1 shared 0 slave 0
(00.044952) 1: Mounting cgroup @./sys/fs/cgroup/cpu (0)
(00.044956) 1: Bind /sys/fs/cgroup/cpu to ./sys/fs/cgroup/cpu
(00.044965) 1: 97:./sys/fs/cgroup/cpu private 1 shared 0 slave 0
(00.044973) 1: Mounting tmpfs @./dev (0)
(00.044997) 1: 90:./dev private 1 shared 0 slave 0
(00.048570) 1: Found fd 1 (id pipe:[173136]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.048650) 1: Inherit fd 1 moved to 4 to resolve clash
(00.050842) 1: Mounting devpts @./dev/pts (0)
(00.050888) 1: 91:./dev/pts private 1 shared 0 slave 0
(00.050898) 1: Mounting mqueue @./dev/mqueue (0)
(00.050915) 1: 93:./dev/mqueue private 1 shared 0 slave 0
(00.050922) 1: Mounting tmpfs @./dev/shm (0)
(00.050941) 1: 92:./dev/shm private 1 shared 0 slave 0
(00.054410) 1: Found fd 1 (id pipe:[173136]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.054517) 1: Inherit fd 1 moved to 4 to resolve clash
(00.056708) 1: Mounting tmpfs @./proc/timer_stats (0)
(00.056723) 1: Bind ./dev/null to ./proc/timer_stats
(00.056750) 1: 60:./proc/timer_stats private 1 shared 0 slave 0
(00.056758) 1: Mounting tmpfs @./proc/kcore (0)
(00.056763) 1: Bind ./dev/null to ./proc/kcore
(00.056773) 1: 59:./proc/kcore private 1 shared 0 slave 0
(00.056780) 1: Move the root to .
(00.098318) 1: Mount procfs in crtools-proc.vIAihE
(00.107874) 1: Found fd 1 (id pipe:[173136]) in inherit fd list (caller close_old_fds)
(00.107896) 1: Found fd 2 (id pipe:[173137]) in inherit fd list (caller close_old_fds)
(00.107911) 1: Preparing info about shared resources
(00.107924) 1: Collecting 34/18 (flags 0)
(00.107954) 1: Collected [dev/null] ID 0x1
(00.107965) 1: Collected [var/lib/mysql/ibdata1] ID 0x4
(00.107970) 1: Collected [tmp/ib927rlu] ID 0x5
(00.107974) 1: Collected [tmp/ibO3tWnq] ID 0x6
(00.107978) 1: Collected [tmp/ibagarqm] ID 0x7
(00.107983) 1: Collected [tmp/ib3H3jxe] ID 0x8
(00.107987) 1: Collected [var/lib/mysql/ib_logfile0] ID 0x9
(00.107991) 1: Collected [var/lib/mysql/ib_logfile1] ID 0xa
(00.107996) 1: Collected [var/lib/mysql/ibtmp1] ID 0xb
(00.108000) 1: Collected [tmp/ib8mFcLa] ID 0xc
(00.108004) 1: Collected [var/lib/mysql/mysql/time_zone_name.ibd] ID 0xd
(00.108008) 1: Collected [var/lib/mysql/mysql/plugin.ibd] ID 0xe
(00.108013) 1: Collected [var/lib/mysql/mysql/innodb_table_stats.ibd] ID 0xf
(00.108017) 1: Collected [var/lib/mysql/mysql/innodb_index_stats.ibd] ID 0x10
(00.108021) 1: Collected [var/lib/mysql/mysql/gtid_executed.ibd] ID 0x11
(00.108026) 1: Collected [var/lib/mysql/mysql/time_zone.ibd] ID 0x14
(00.108030) 1: Collected [var/lib/mysql/mysql/time_zone_transition.ibd] ID 0x15
(00.108034) 1: Collected [var/lib/mysql/mysql/time_zone_transition_type.ibd] ID 0x16
(00.108039) 1: Collected [var/lib/mysql/mysql/time_zone_leap_second.ibd] ID 0x17
(00.108043) 1: Collected [var/lib/mysql/mysql/server_cost.ibd] ID 0x18
(00.108047) 1: Collected [var/lib/mysql/mysql/engine_cost.ibd] ID 0x19
(00.108052) 1: Collected [var/lib/mysql/mysql/user.MYI] ID 0x1a
(00.108056) 1: Collected [var/lib/mysql/mysql/user.MYD] ID 0x1b
(00.108060) 1: Collected [var/lib/mysql/mysql/db.MYI] ID 0x1c
(00.108065) 1: Collected [var/lib/mysql/mysql/db.MYD] ID 0x1d
(00.108069) 1: Collected [var/lib/mysql/mysql/proxies_priv.MYI] ID 0x1e
(00.108073) 1: Collected [var/lib/mysql/mysql/proxies_priv.MYD] ID 0x1f
(00.108077) 1: Collected [var/lib/mysql/mysql/tables_priv.MYI] ID 0x20
(00.108082) 1: Collected [var/lib/mysql/mysql/tables_priv.MYD] ID 0x21
(00.108086) 1: Collected [var/lib/mysql/mysql/columns_priv.MYI] ID 0x22
(00.108090) 1: Collected [var/lib/mysql/mysql/columns_priv.MYD] ID 0x23
(00.108095) 1: Collected [var/lib/mysql/mysql/procs_priv.MYI] ID 0x24
(00.108107) 1: Collected [var/lib/mysql/mysql/procs_priv.MYD] ID 0x25
(00.108112) 1: Collected [var/lib/mysql/mysql/servers.ibd] ID 0x26
(00.108116) 1: Collected [var/lib/mysql/mysql/event.MYI] ID 0x27
(00.108121) 1: Collected [var/lib/mysql/mysql/event.MYD] ID 0x28
(00.108125) 1: Collected [usr/sbin/mysqld] ID 0x29
(00.108129) 1: Collected [lib/x86_64-linux-gnu/libnss_files-2.13.so] ID 0x2a
(00.108134) 1: Collected [lib/x86_64-linux-gnu/libnss_nis-2.13.so] ID 0x2b
(00.108138) 1: Collected [lib/x86_64-linux-gnu/libnsl-2.13.so] ID 0x2c
(00.108142) 1: Collected [lib/x86_64-linux-gnu/libnss_compat-2.13.so] ID 0x2d
(00.108147) 1: Collected [lib/x86_64-linux-gnu/libc-2.13.so] ID 0x2e
(00.108151) 1: Collected [lib/x86_64-linux-gnu/libgcc_s.so.1] ID 0x2f
(00.108155) 1: Collected [lib/x86_64-linux-gnu/libm-2.13.so] ID 0x30
(00.108159) 1: Collected [usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.17] ID 0x31
(00.108164) 1: Collected [lib/x86_64-linux-gnu/librt-2.13.so] ID 0x32
(00.108168) 1: Collected [lib/x86_64-linux-gnu/libz.so.1.2.7] ID 0x33
(00.108172) 1: Collected [lib/x86_64-linux-gnu/libdl-2.13.so] ID 0x34
(00.108176) 1: Collected [lib/x86_64-linux-gnu/libcrypt-2.13.so] ID 0x35
(00.108181) 1: Collected [lib/x86_64-linux-gnu/libaio.so.1.0.1] ID 0x36
(00.108185) 1: Collected [lib/x86_64-linux-gnu/libpthread-2.13.so] ID 0x37
(00.108189) 1: Collected [lib/x86_64-linux-gnu/ld-2.13.so] ID 0x38
(00.108193) 1: Collected [var/lib/mysql] ID 0x39
(00.108198) 1: Collected [.] ID 0x3a
(00.108203) 1: `- ... done
(00.108206) 1: Collecting 47/53 (flags 0)
(00.108215) 1: Configuring remap 0x5 -> 0x1
(00.108219) 1: Opening ghost file 0x1 for tmp/ib927rlu
(00.108250) 1: Error (files-reg.c:109): Can't open ghost file //tmp/ib927rlu.cr.1.ghost: File exists
(00.108258) 1: `- ... done
(00.118266) Error (cr-restore.c:1927): Restoring FAILED.
Any help? Thank you..
Shared memory deduplication
Pulled from criu.org/Todo
We have dedup action and --auto-dedup option for dump/restore which only works for pid pagemaps. Need the same for shmem.
Validate image files
CRIT sub-task. For a given set of image files check, that they are in "restorable" shape, i.e. contain valid data and no pieces are missing.
Dangling ghost files from failed restore cause next restore to fail
Originally described in issue #16
Support in-flight AIO requests
Pulled from criu.org/Todo
When we dump AIO ring we check it not to contain events inside and abort the dump otherwise. Need to dump events too and put them back on restore.
Support FUSE mountpoints
Pulled from criu.org/Todo
When dumping mountpoints we explicitly check the filesystem mounted. The thing is -- not all filesystems can be just ignored on dump. E.g. FUSE mount involves a user-space daemon that is responsible for the files tree contents. If we just kill one on dump we might not be able to restore it. Need to special-care one.
Deleted bind-mount points fail restore
Checkpoints are now completing successfully after enabling evasive devices for this container - however I am getting the following error on restores (checkpoint and restoring on same host) - any ideas? Thanks!:
(00.106760) 1: Found fd 1 (id pipe:[546719]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.106765) 1: Inherit fd 1 moved to 5 to resolve clash
(00.106767) 1: Going to dup 0 into 1
(00.106770) 1: Found fd 2 (id pipe:[546720]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.106773) 1: Inherit fd 2 moved to 6 to resolve clash
(00.106775) 1: Going to dup 0 into 2
(00.106782) 1: Restoring fd 1 (state -> create)
(00.106784) 1: Restoring fd 2 (state -> create)
(00.106787) 1: Restoring fd 3 (state -> create)
(00.106789) 1: Creating pipe pipe_id=0x857e7 id=0x2
(00.106796) 1: Restoring size 0x10000 for 0x857e7
(00.106803) 1: Wait fdinfo pid=1 fd=4
(00.106806) 1: Send fd 7 to /crtools-fd-1-4
(00.106823) 1: Create fd for 3
(00.106827) 1: Restoring fd 4 (state -> create)
(00.106829) 1: Creating pipe pipe_id=0x857e7 id=0x3
(00.106832) 1: Waiting fd for 4
(00.106842) 1: Create fd for 4
(00.106846) 1: Restoring fd 5 (state -> create)
(00.106853) 1: fsnotify: Restore 1 wd for 0x00000000
(00.106856) 1: fsnotify: Opening fhandle 2e:41...
(00.106871) 1: Path /' resolved to./' mountpoint
(00.106971) 1: Error (fsnotify.c:131): fsnotify: Can't open file handle for 0x0000002e:0x000000000000000e: Stale file handle
(00.114893) Error (cr-restore.c:1234): 28246 exited, status=1
(00.115123) Error (cr-restore.c:1927): Restoring FAILED.
Docker restoring with --force option failed
I'm experimenting the migration of docker container from one host to another and encountered a bit strange error.
Here is what I did.
Run a container on host A and checkpoint.
$ docker run -d --name np busybox:latest /bin/sh -c 'i=0; while true; do echo $i; i=$(expr $i + 1); sleep 1; done'
$ docker checkpoint --image-dir=/tmp/np np
Then move /tmp/np to host B and tried restoring like this.
$ docker restore --force=true --image-dir=/tmp/$container --work-dir /tmp/something $(docker create --name=$container busybox)
The above restoring failed with the following error in restore.log.
(00.102727) 1: cg: Move into 2
(00.102735) 1: cg: `-> blkio//docker/9dccf569f5b1005e9fbc4770030243704b8e3cb27e5ede62de1286835374f067/tasks
(00.102773) 1: cg: `-> cpu//docker/9dccf569f5b1005e9fbc4770030243704b8e3cb27e5ede62de1286835374f067/tasks
(00.102864) 1: cg: `-> cpuacct//docker/9dccf569f5b1005e9fbc4770030243704b8e3cb27e5ede62de1286835374f067/tasks
(00.102896) 1: cg: `-> cpuset//docker/9dccf569f5b1005e9fbc4770030243704b8e3cb27e5ede62de1286835374f067/tasks
(00.103063) 1: Error (cgroup.c:901): cg: Can't move into cpuset//docker/9dccf569f5b1005e9fbc4770030243704b8e3cb27e5ede62de1286835374f067/tasks (-1/0): No space left on device
(00.107453) Error (cr-restore.c:1933): Restoring FAILED.
Here is the full restore.log.
The strange thing is that the restoration will succeed if I run the command ( docker run -d --name np busybox:latest /bin/sh -c 'i=0; while true; do echo $i; i=$(expr $i + 1); sleep 1; done') on host B. And all subsequent restoration will succeed.
Restore tasks in stopped/frozen state
Pulled from criu.org/Todo
This is to make --leave-stopped option work -- all tasks are SIGSTOP-ed after restore. And to leave freeze cgroup in frozen state after restore.
Support C/R of selinux-managed tasks
Pulled from criu.org/Todo
Selinux imposes more restrictions on the stuff we typically do. We're currently able to c/r seccomp-ed tasks (in strict mode), apparmor-controlled ones and have seccomp-filter work in progress.
Show what was left in the system after dump
Pulled from criu.org/Todo
When we use --link-remap option or --tcp-established one CRIU leaves some traces in the system, in particular -- temporary hard links in the former case and iptables rules in the latter. Need some way to show these to the user.
The bug of the docker_cr.sh
When I verify the external C/R with docker_cr.sh ,I can dump the container successfully.
root@iZu1pbgsilbZ:/home/monster# ./docker_cr.sh -c -v 61002d6899a8007ff82e72906cd658a78b427d3c078c1374359fd263f301697a
docker binary: docker
dockerinit binary: /var/lib/docker/init/dockerinit-1.7.0-dev
criu binary: criu
image directory: /var/lib/docker/criu_img/61002d6899a8007ff82e72906cd658a78b427d3c078c1374359fd263f301697a
container root directory: /var/lib/docker/aufs/mnt/61002d6899a8007ff82e72906cd658a78b427d3c078c1374359fd263f301697a
criu dump -v4 -D /var/lib/docker/criu_img/61002d6899a8007ff82e72906cd658a78b427d3c078c1374359fd263f301697a -o dump.log --manage-cgroups --evasive-devices --ext-mount-map /etc/resolv.conf:/etc/resolv.conf --ext-mount-map /etc/hosts:/etc/hosts --ext-mount-map /etc/hostname:/etc/hostname --ext-mount-map /.dockerinit:/.dockerinit -t 18622 --root /var/lib/docker/aufs/mnt/61002d6899a8007ff82e72906cd658a78b427d3c078c1374359fd263f301697a
dump successful
(00.026438) Dumping finished successfully
But when I want to restore the container,I meet the bug .
restore failed
(00.051080) 1: Error (rst-malloc.c:130): BUG at rst-malloc.c:130
(00.063390) Error (cr-restore.c:1221): 19157 killed by signal 11
(00.063482) Error (cr-restore.c:1912): Restoring FAILED.
I don't know why.Please help me .Thanks!
Docker - Cannot restore container with volumes to host
I am trying to checkpoint a container and restore it to a new one with the same configuration.
What I am doing
docker run --name mysql1 -e MYSQL_ROOT_PASSWORD=root -d mysql:5.7
docker checkpoint --image-dir ~/Desktop/cr_migrations/mysql/memory --work-dir ~/Desktop/logs/mysql mysql1
then
docker create --name my_test -e MYSQL_ROOT_PASSWORD=root mysql:5.7
docker restore --force=true --image-dir ~/Desktop/cr_migrations/mysql/memory --work-dir ~/Desktop/logs/mysql my_test
and I get
Error response from daemon: Cannot restore container my_test: criu failed: type NOTIFY errno 0
Error: failed to restore one or more containers
The restore.log:
(00.000051) Added /sys/fs/cgroup/cpuset:/sys/fs/cgroup/cpuset ext mount mapping
(00.000072) Added /sys/fs/cgroup/cpu:/sys/fs/cgroup/cpu ext mount mapping
(00.000074) Added /sys/fs/cgroup/cpuacct:/sys/fs/cgroup/cpuacct ext mount mapping
(00.000076) Added /sys/fs/cgroup/memory:/sys/fs/cgroup/memory ext mount mapping
(00.000078) Added /sys/fs/cgroup/devices:/sys/fs/cgroup/devices ext mount mapping
(00.000079) Added /sys/fs/cgroup/freezer:/sys/fs/cgroup/freezer ext mount mapping
(00.000081) Added /sys/fs/cgroup/net_cls:/sys/fs/cgroup/net_cls ext mount mapping
(00.000083) Added /sys/fs/cgroup/blkio:/sys/fs/cgroup/blkio ext mount mapping
(00.000084) Added /sys/fs/cgroup/perf_event:/sys/fs/cgroup/perf_event ext mount mapping
(00.000086) Added /sys/fs/cgroup/net_prio:/sys/fs/cgroup/net_prio ext mount mapping
(00.000088) Added /sys/fs/cgroup/hugetlb:/sys/fs/cgroup/hugetlb ext mount mapping
(00.000089) Added /sys/fs/cgroup/systemd:/sys/fs/cgroup/systemd ext mount mapping
(00.000091) Added /var/lib/mysql:/var/lib/docker/volumes/8b40ac34b31f1b641f76d527a6287f0cdfe205de0e10171df889a4ff5a446c3d/_data ext mount mapping
(00.000093) Added /etc/resolv.conf:/var/lib/docker/containers/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/resolv.conf ext mount mapping
(00.000094) Added /etc/hostname:/var/lib/docker/containers/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/hostname ext mount mapping
(00.000096) Added /etc/hosts:/var/lib/docker/containers/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/hosts ext mount mapping
(00.000178) TCP recv queue memory limit is 3145728
(00.000189) Found task size of 7ffffffff000
(00.000204) cpu: fpu:1 fxsr:1 xsave:1
(00.000273) vdso: Parsing at 7fffe4fa8000 7fffe4faa000
(00.000276) vdso: PT_LOAD p_vaddr: 0
(00.000278) vdso: DT_HASH: 0x120
(00.000280) vdso: DT_STRTAB: 0x268
(00.000281) vdso: DT_SYMTAB: 0x160
(00.000283) vdso: DT_STRSZ: 94
(00.000284) vdso: DT_SYMENT: 24
(00.000286) vdso: nbucket 3 nchain 11 bucket 0x7fffe4fa8128 chain 0x7fffe4fa8134
(00.000289) vdso: rt [vdso] 7fffe4fa8000-7fffe4faa000 [vvar] 7fffe4fa6000-7fffe4fa8000
(00.000311) Reading image tree
(00.000327) Add mnt ns 11 pid 1
(00.000338) Will restore in 6c020000 namespaces
(00.000340) NS mask to use 6c020000
(00.000344) Collecting 37/21 (flags 0)
(00.000347) No inetsk.img image
(00.000349) `- ... done
(00.000372) cg: Preparing cgroups yard (cgroups restore mode 0x4)
(00.000437) cg: Opening .criu.cgyard.UNX0gJ as cg yard
(00.000448) cg: Making controller dir .criu.cgyard.UNX0gJ/cpuset (cpuset)
(00.000479) cg: Determined cgroup dir cpuset/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 already exist
(00.000483) cg: Skip restoring properties on cgroup dir cpuset/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242
(00.000489) cg: Making controller dir .criu.cgyard.UNX0gJ/cpu (cpu)
(00.000512) cg: Determined cgroup dir cpu/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 already exist
(00.000516) cg: Skip restoring properties on cgroup dir cpu/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242
(00.000521) cg: Making controller dir .criu.cgyard.UNX0gJ/cpuacct (cpuacct)
(00.000563) cg: Determined cgroup dir cpuacct/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 already exist
(00.000567) cg: Skip restoring properties on cgroup dir cpuacct/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242
(00.000573) cg: Making controller dir .criu.cgyard.UNX0gJ/memory (memory)
(00.000658) cg: Determined cgroup dir memory/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 already exist
(00.000663) cg: Skip restoring properties on cgroup dir memory/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242
(00.000668) cg: Making controller dir .criu.cgyard.UNX0gJ/devices (devices)
(00.000699) cg: Determined cgroup dir devices/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 already exist
(00.000703) cg: Skip restoring properties on cgroup dir devices/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242
(00.000713) cg: Making controller dir .criu.cgyard.UNX0gJ/freezer (freezer)
(00.000741) cg: Determined cgroup dir freezer/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 already exist
(00.000744) cg: Skip restoring properties on cgroup dir freezer/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242
(00.000749) cg: Making controller dir .criu.cgyard.UNX0gJ/net_cls (net_cls)
(00.000770) cg: Determined cgroup dir net_cls/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 already exist
(00.000773) cg: Skip restoring properties on cgroup dir net_cls/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242
(00.000778) cg: Making controller dir .criu.cgyard.UNX0gJ/blkio (blkio)
(00.000798) cg: Determined cgroup dir blkio/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 already exist
(00.000801) cg: Skip restoring properties on cgroup dir blkio/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242
(00.000806) cg: Making controller dir .criu.cgyard.UNX0gJ/perf_event (perf_event)
(00.000825) cg: Determined cgroup dir perf_event/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 already exist
(00.000829) cg: Skip restoring properties on cgroup dir perf_event/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242
(00.000834) cg: Making controller dir .criu.cgyard.UNX0gJ/net_prio (net_prio)
(00.000874) cg: Determined cgroup dir net_prio/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 already exist
(00.000879) cg: Skip restoring properties on cgroup dir net_prio/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242
(00.000885) cg: Making controller dir .criu.cgyard.UNX0gJ/hugetlb (hugetlb)
(00.000921) cg: Determined cgroup dir hugetlb/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 already exist
(00.000925) cg: Skip restoring properties on cgroup dir hugetlb/docker/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242
(00.000932) cg: Making controller dir .criu.cgyard.UNX0gJ/systemd (none,name=systemd)
(00.000965) cg: Determined cgroup dir systemd/ already exist
(00.000968) cg: Skip restoring properties on cgroup dir systemd/
(00.000973) cg: Determined cgroup dir systemd//user already exist
(00.000976) cg: Skip restoring properties on cgroup dir systemd//user
(00.000981) cg: Determined cgroup dir systemd//user/65534.user already exist
(00.000984) cg: Skip restoring properties on cgroup dir systemd//user/65534.user
(00.000989) cg: Determined cgroup dir systemd//user/65534.user/c8.session already exist
(00.000992) cg: Skip restoring properties on cgroup dir systemd//user/65534.user/c8.session
(00.000996) cg: Determined cgroup dir systemd//user/107.user already exist
(00.000999) cg: Skip restoring properties on cgroup dir systemd//user/107.user
(00.001004) cg: Determined cgroup dir systemd//user/107.user/c1.session already exist
(00.001007) cg: Skip restoring properties on cgroup dir systemd//user/107.user/c1.session
(00.001011) cg: Determined cgroup dir systemd//user/1000.user already exist
(00.001014) cg: Skip restoring properties on cgroup dir systemd//user/1000.user
(00.001019) cg: Determined cgroup dir systemd//user/1000.user/c2.session already exist
(00.001022) cg: Skip restoring properties on cgroup dir systemd//user/1000.user/c2.session
(00.001072) Warn (cr-restore.c:1041): Set CLONE_PARENT | CLONE_NEWPID but it might cause restore problem,because not all kernels support such clone flags combinations!
(00.001077) Forking task with 1 pid (flags 0x6c028000)
(00.001091) Saved netns fd for links restore
(00.003758) PID: real 14196 virt 1
(00.003801) Wait until namespaces are created
(00.004407) Running setup-namespaces scripts
(00.004432) RPC
(00.004730) 1: Restoring namespaces 1 flags 0x6c028000
(00.005015) 1: Restoring link lo type 1
(00.005187) 1: Restoring link eth0 type 2
(00.005190) 1: Restoring netdev eth0 idx 213
(00.005196) 1: Restore ll addr (02:../6) for device
(00.005595) 1: DEBUG Skip eth0/accept_local, val =0
(00.005601) 1: DEBUG Skip eth0/accept_redirects, val =1
(00.005603) 1: DEBUG Skip eth0/accept_source_route, val =1
(00.005605) 1: DEBUG Skip eth0/arp_accept, val =0
(00.005606) 1: DEBUG Skip eth0/arp_announce, val =0
(00.005613) 1: DEBUG Skip eth0/arp_filter, val =0
(00.005615) 1: DEBUG Skip eth0/arp_ignore, val =0
(00.005617) 1: DEBUG Skip eth0/arp_notify, val =0
(00.005619) 1: DEBUG Skip eth0/bootp_relay, val =0
(00.005621) 1: DEBUG Skip eth0/disable_policy, val =0
(00.005624) 1: DEBUG Skip eth0/disable_xfrm, val =0
(00.005626) 1: DEBUG Skip eth0/force_igmp_version, val =0
(00.005628) 1: DEBUG Skip eth0/forwarding, val =1
(00.005630) 1: DEBUG Skip eth0/igmpv2_unsolicited_report_interval, val =10000
(00.005632) 1: DEBUG Skip eth0/igmpv3_unsolicited_report_interval, val =1000
(00.005635) 1: DEBUG Skip eth0/log_martians, val =0
(00.005637) 1: DEBUG Skip eth0/medium_id, val =0
(00.005640) 1: DEBUG Skip eth0/promote_secondaries, val =0
(00.005642) 1: DEBUG Skip eth0/proxy_arp, val =0
(00.005644) 1: DEBUG Skip eth0/proxy_arp_pvlan, val =0
(00.005647) 1: DEBUG Skip eth0/route_localnet, val =0
(00.005649) 1: DEBUG Skip eth0/rp_filter, val =1
(00.005650) 1: DEBUG Skip eth0/secure_redirects, val =1
(00.005652) 1: DEBUG Skip eth0/send_redirects, val =1
(00.005653) 1: DEBUG Skip eth0/shared_media, val =1
(00.005655) 1: DEBUG Skip eth0/src_valid_mark, val =0
(00.005657) 1: DEBUG Skip eth0/tag, val =0
(00.005674) 1: Running ip addr restore
(00.008515) 1: Found fd 1 (id pipe:[316136]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.008551) 1: Inherit fd 1 moved to 7 to resolve clash
RTNETLINK answers: File exists
RTNETLINK answers: File exists
(00.009886) 1: Running ip route restore
(00.013825) 1: Found fd 1 (id pipe:[316136]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.013870) 1: Inherit fd 1 moved to 7 to resolve clash
RTNETLINK answers: File exists
(00.014729) 1: Running iptables-restore for iptables-restore
(00.017594) 1: Found fd 1 (id pipe:[316136]) in inherit fd list (caller inherit_fd_resolve_clash)
(00.017632) 1: Inherit fd 1 moved to 7 to resolve clash
(00.035037) 1: kernel/hostname nr 12
(00.035068) 1: kernel/domainname nr 6
(00.035076) 1: Restoring IPC namespace
(00.035078) 1: Restoring IPC variables
(00.035126) 1: Restoring IPC shared memory
(00.035129) 1: No ipcns-shm-9.img image
(00.035131) 1: Restoring IPC message queues
(00.035134) 1: No ipcns-msg-9.img image
(00.035135) 1: Restoring IPC semaphores sets
(00.035138) 1: No ipcns-sem-9.img image
(00.035140) 1: Restoring mount namespace
(00.035199) 1: type ext4 source /dev/disk/by-uuid/43310852-abc4-4b8b-81bd-9c4b444e3a5f mnt_id 72 s_dev 0x800006 / @ ./ flags 0x200000 options errors=remount-ro,data=ordered
(00.035206) 1: type devtmpfs source udev mnt_id 73 s_dev 0x6 / @ ./dev flags 0x200000 options size=4010936k,nr_inodes=1002734,mode=755
(00.035212) 1: type devpts source devpts mnt_id 74 s_dev 0xd / @ ./dev/pts flags 0x20000a options gid=5,mode=620,ptmxmode=000
(00.035223) 1: type tmpfs source tmpfs mnt_id 75 s_dev 0x11 / @ ./run flags 0x20000a options size=805404k,mode=755
(00.035228) 1: type tmpfs source none mnt_id 76 s_dev 0x21 / @ ./run/lock flags 0x20000e options size=5120k
(00.035232) 1: type tmpfs source none mnt_id 77 s_dev 0x22 / @ ./run/shm flags 0x200006 options
(00.035236) 1: type tmpfs source none mnt_id 78 s_dev 0x23 / @ ./run/user flags 0x20000e options size=102400k,mode=755
(00.035241) 1: type fuse source vmware-vmblock mnt_id 79 s_dev 0x27 / @ ./run/vmblock-fuse flags 0x200006 options user_id=0,group_id=0,default_permissions,allow_other
(00.035245) 1: type nsfs source nsfs mnt_id 80 s_dev 0x3 / @ ./run/docker/netns/745ec81098f4 flags 0x1000000 options
(00.035255) 1: type nsfs source nsfs mnt_id 81 s_dev 0x3 / @ ./run/docker/netns/ff125987e60a flags 0x1000000 options
(00.035285) 1: type aufs source none mnt_id 82 s_dev 0x2a / @ ./run/docker/execdriver/native/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/criu-root flags 0x200000 options si=4e3d88dc53417f0a,dio,dirperm1
(00.035291) 1: type sysfs source sysfs mnt_id 83 s_dev 0x10 / @ ./sys flags 0x20000e options
(00.035295) 1: type tmpfs source none mnt_id 84 s_dev 0x13 / @ ./sys/fs/cgroup flags 0x200000 options size=4k,mode=755
(00.035299) 1: type cgroup source cgroup mnt_id 85 s_dev 0x16 / @ ./sys/fs/cgroup/cpuset flags 0x200000 options cpuset
(00.035303) 1: type cgroup source cgroup mnt_id 86 s_dev 0x17 / @ ./sys/fs/cgroup/cpu flags 0x200000 options cpu
(00.035307) 1: type cgroup source cgroup mnt_id 87 s_dev 0x18 / @ ./sys/fs/cgroup/cpuacct flags 0x200000 options cpuacct
(00.035311) 1: type cgroup source cgroup mnt_id 88 s_dev 0x19 / @ ./sys/fs/cgroup/memory flags 0x200000 options memory
(00.035315) 1: type cgroup source cgroup mnt_id 89 s_dev 0x1a / @ ./sys/fs/cgroup/devices flags 0x200000 options devices
(00.035318) 1: type cgroup source cgroup mnt_id 90 s_dev 0x1b / @ ./sys/fs/cgroup/freezer flags 0x200000 options freezer
(00.035322) 1: type cgroup source cgroup mnt_id 91 s_dev 0x1c / @ ./sys/fs/cgroup/net_cls flags 0x200000 options net_cls
(00.035326) 1: type cgroup source cgroup mnt_id 92 s_dev 0x1d / @ ./sys/fs/cgroup/blkio flags 0x200000 options blkio
(00.035330) 1: type cgroup source cgroup mnt_id 93 s_dev 0x1e / @ ./sys/fs/cgroup/perf_event flags 0x200000 options perf_event
(00.035334) 1: type cgroup source cgroup mnt_id 94 s_dev 0x1f / @ ./sys/fs/cgroup/net_prio flags 0x200000 options net_prio
(00.035337) 1: type cgroup source cgroup mnt_id 95 s_dev 0x20 / @ ./sys/fs/cgroup/hugetlb flags 0x200000 options hugetlb
(00.035358) 1: type cgroup source systemd mnt_id 96 s_dev 0x26 / @ ./sys/fs/cgroup/systemd flags 0x20000e options name=systemd
(00.035362) 1: type fusectl source none mnt_id 97 s_dev 0x14 / @ ./sys/fs/fuse/connections flags 0x200000 options
(00.035365) 1: type debugfs source none mnt_id 98 s_dev 0x7 / @ ./sys/kernel/debug flags 0x200000 options
(00.035370) 1: type securityfs source none mnt_id 99 s_dev 0xb / @ ./sys/kernel/security flags 0x200000 options
(00.035374) 1: type efivarfs source none mnt_id 100 s_dev 0x15 / @ ./sys/firmware/efi/efivars flags 0x200000 options
(00.035377) 1: type pstore source none mnt_id 101 s_dev 0x24 / @ ./sys/fs/pstore flags 0x200000 options
(00.035381) 1: type proc source proc mnt_id 102 s_dev 0x4 / @ ./proc flags 0x20000e options
(00.035385) 1: type binfmt_misc source binfmt_misc mnt_id 103 s_dev 0x25 / @ ./proc/sys/fs/binfmt_misc flags 0x20000e options
(00.035390) 1: type vfat source /dev/sda2 mnt_id 104 s_dev 0x800002 / @ ./boot/efi flags 0x200000 options fmask=0022,dmask=0022,codepage=437,iocharset=iso8859-1,shortname=mixed,errors=remount-ro
(00.035395) 1: type ext4 source /dev/disk/by-uuid/43310852-abc4-4b8b-81bd-9c4b444e3a5f mnt_id 105 s_dev 0x800006 /var/lib/docker/aufs @ ./var/lib/docker/aufs flags 0x200000 options errors=remount-ro,data=ordered
(00.035414) 1: type aufs source none mnt_id 106 s_dev 0x28 / @ ./var/lib/docker/aufs/mnt/d1f85c676ca02f2aaf1ca23804e2c51abf8632a76ae1853d468ec0771b13453a flags 0x200000 options si=4e3d88dc534b8f0a,dio,dirperm1
(00.035420) 1: type aufs source none mnt_id 107 s_dev 0x2f / @ ./var/lib/docker/aufs/mnt/951d1cc2cb47270d1fbdee78679d4560bd1263e9b29c194c5a1105d75abd6418 flags 0x200000 options si=4e3d88dc534a4f0a,dio,dirperm1
(00.035424) 1: type aufs source none mnt_id 108 s_dev 0x29 / @ ./var/lib/docker/aufs/mnt/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242 flags 0x200000 options si=4e3d88de8cf60f0a,dio,dirperm1
(00.035429) 1: type aufs source none mnt_id 109 s_dev 0x2a / @ ./var/lib/docker/aufs/mnt/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d flags 0x200000 options si=4e3d88dc53417f0a,dio,dirperm1
(00.035435) 1: type fuseblk source /dev/sda4 mnt_id 110 s_dev 0x800004 / @ ./media/kyriakos/88427B28427B19E0 flags 0x200006 options user_id=0,group_id=0,default_permissions,allow_other,blksize=4096
(00.035440) 1: type tmpfs source none mnt_id 111 s_dev 0x2b / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ flags 0x200000 options
(00.035444) 1: type cgroup source none mnt_id 112 s_dev 0x16 / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/cpuset flags 0x200000 options cpuset
(00.035448) 1: type cgroup source none mnt_id 113 s_dev 0x17 / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/cpu flags 0x200000 options cpu
(00.035464) 1: type cgroup source none mnt_id 114 s_dev 0x18 / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/cpuacct flags 0x200000 options cpuacct
(00.035468) 1: type cgroup source none mnt_id 115 s_dev 0x19 / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/memory flags 0x200000 options memory
(00.035472) 1: type cgroup source none mnt_id 116 s_dev 0x1a / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/devices flags 0x200000 options devices
(00.035475) 1: type cgroup source none mnt_id 117 s_dev 0x1b / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/freezer flags 0x200000 options freezer
(00.035479) 1: type cgroup source none mnt_id 118 s_dev 0x1c / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/net_cls flags 0x200000 options net_cls
(00.035483) 1: type cgroup source none mnt_id 119 s_dev 0x1d / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/blkio flags 0x200000 options blkio
(00.035487) 1: type cgroup source none mnt_id 120 s_dev 0x1e / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/perf_event flags 0x200000 options perf_event
(00.035491) 1: type cgroup source none mnt_id 121 s_dev 0x1f / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/net_prio flags 0x200000 options net_prio
(00.035495) 1: type cgroup source none mnt_id 122 s_dev 0x20 / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/hugetlb flags 0x200000 options hugetlb
(00.035499) 1: type cgroup source none mnt_id 123 s_dev 0x26 / @ ./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/systemd flags 0x200000 options name=systemd
(00.035506) 1: Building mountpoints tree
(00.035508) 1: Building plain mount tree
(00.035509) 1: Working on 123->111
(00.035511) 1: Working on 122->111
(00.035512) 1: Working on 121->111
(00.035514) 1: Working on 120->111
(00.035515) 1: Working on 119->111
(00.035517) 1: Working on 118->111
(00.035518) 1: Working on 117->111
(00.035519) 1: Working on 116->111
(00.035521) 1: Working on 115->111
(00.035522) 1: Working on 114->111
(00.035524) 1: Working on 113->111
(00.035525) 1: Working on 112->111
(00.035526) 1: Working on 111->72
(00.035528) 1: Working on 110->72
(00.035530) 1: Working on 109->105
(00.035531) 1: Working on 108->105
(00.035533) 1: Working on 107->105
(00.035534) 1: Working on 106->105
(00.035536) 1: Working on 105->72
(00.035537) 1: Working on 104->72
(00.035539) 1: Working on 103->102
(00.035540) 1: Working on 102->72
(00.035541) 1: Working on 101->83
(00.035543) 1: Working on 100->83
(00.035544) 1: Working on 99->83
(00.035546) 1: Working on 98->83
(00.035547) 1: Working on 97->83
(00.035549) 1: Working on 96->84
(00.035550) 1: Working on 95->84
(00.035552) 1: Working on 94->84
(00.035553) 1: Working on 93->84
(00.035555) 1: Working on 92->84
(00.035556) 1: Working on 91->84
(00.035557) 1: Working on 90->84
(00.035559) 1: Working on 89->84
(00.035560) 1: Working on 88->84
(00.035562) 1: Working on 87->84
(00.035565) 1: Working on 86->84
(00.035567) 1: Working on 85->84
(00.035568) 1: Working on 84->83
(00.035570) 1: Working on 83->72
(00.035571) 1: Working on 82->75
(00.035573) 1: Working on 81->75
(00.035574) 1: Working on 80->75
(00.035575) 1: Working on 79->75
(00.035577) 1: Working on 78->75
(00.035578) 1: Working on 77->75
(00.035580) 1: Working on 76->75
(00.035581) 1: Working on 75->72
(00.035583) 1: Working on 74->73
(00.035584) 1: Working on 73->72
(00.035586) 1: Working on 72->71
(00.035587) 1: Resorting siblings on 72
(00.035589) 1: Resorting siblings on 111
(00.035590) 1: Resorting siblings on 123
(00.035592) 1: Resorting siblings on 122
(00.035594) 1: Resorting siblings on 121
(00.035595) 1: Resorting siblings on 120
(00.035597) 1: Resorting siblings on 119
(00.035598) 1: Resorting siblings on 118
(00.035600) 1: Resorting siblings on 117
(00.035601) 1: Resorting siblings on 116
(00.035603) 1: Resorting siblings on 115
(00.035604) 1: Resorting siblings on 114
(00.035606) 1: Resorting siblings on 113
(00.035607) 1: Resorting siblings on 112
(00.035609) 1: Resorting siblings on 110
(00.035610) 1: Resorting siblings on 105
(00.035612) 1: Resorting siblings on 109
(00.035613) 1: Resorting siblings on 108
(00.035615) 1: Resorting siblings on 107
(00.035616) 1: Resorting siblings on 106
(00.035618) 1: Resorting siblings on 104
(00.035619) 1: Resorting siblings on 102
(00.035621) 1: Resorting siblings on 103
(00.035622) 1: Resorting siblings on 83
(00.035624) 1: Resorting siblings on 101
(00.035625) 1: Resorting siblings on 100
(00.035626) 1: Resorting siblings on 99
(00.035628) 1: Resorting siblings on 98
(00.035629) 1: Resorting siblings on 97
(00.035631) 1: Resorting siblings on 84
(00.035632) 1: Resorting siblings on 96
(00.035634) 1: Resorting siblings on 95
(00.035635) 1: Resorting siblings on 94
(00.035636) 1: Resorting siblings on 93
(00.035638) 1: Resorting siblings on 92
(00.035639) 1: Resorting siblings on 91
(00.035641) 1: Resorting siblings on 90
(00.035642) 1: Resorting siblings on 89
(00.035644) 1: Resorting siblings on 88
(00.035645) 1: Resorting siblings on 87
(00.035646) 1: Resorting siblings on 86
(00.035648) 1: Resorting siblings on 85
(00.035649) 1: Resorting siblings on 75
(00.035651) 1: Resorting siblings on 82
(00.035652) 1: Resorting siblings on 81
(00.035654) 1: Resorting siblings on 80
(00.035655) 1: Resorting siblings on 79
(00.035657) 1: Resorting siblings on 78
(00.035658) 1: Resorting siblings on 77
(00.035660) 1: Resorting siblings on 76
(00.035661) 1: Resorting siblings on 73
(00.035662) 1: Resorting siblings on 74
(00.035664) 1: Done:
(00.035665) 1: [./](72->71)
(00.035667) 1: [./proc](102->72)
(00.035669) 1: [./proc/sys/fs/binfmt_misc](103->102)
(00.035670) 1: <--
(00.035672) 1: <--
(00.035673) 1: [./dev](73->72)
(00.035675) 1: [./dev/pts](74->73)
(00.035676) 1: <--
(00.035678) 1: <--
(00.035679) 1: [./run](75->72)
(00.035681) 1: [./run/vmblock-fuse](79->75)
(00.035682) 1: <--
(00.035684) 1: [./run/lock](76->75)
(00.035685) 1: <--
(00.035687) 1: [./run/shm](77->75)
(00.035688) 1: <--
(00.035690) 1: [./run/user](78->75)
(00.035691) 1: <--
(00.035692) 1: [./run/docker/netns/ff125987e60a](81->75)
(00.035694) 1: <--
(00.035695) 1: [./run/docker/netns/745ec81098f4](80->75)
(00.035697) 1: <--
(00.035698) 1: [./run/docker/execdriver/native/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/criu-root](82->75)
(00.035700) 1: <--
(00.035701) 1: <--
(00.035703) 1: [./sys](83->72)
(00.035706) 1: [./sys/fs/pstore](101->83)
(00.035708) 1: <--
(00.035709) 1: [./sys/fs/cgroup](84->83)
(00.035711) 1: [./sys/fs/cgroup/systemd](96->84)
(00.035712) 1: <--
(00.035713) 1: [./sys/fs/cgroup/cpuset](85->84)
(00.035715) 1: <--
(00.035716) 1: [./sys/fs/cgroup/cpu](86->84)
(00.035718) 1: <--
(00.035719) 1: [./sys/fs/cgroup/cpuacct](87->84)
(00.035721) 1: <--
(00.035722) 1: [./sys/fs/cgroup/memory](88->84)
(00.035724) 1: <--
(00.035725) 1: [./sys/fs/cgroup/devices](89->84)
(00.035727) 1: <--
(00.035728) 1: [./sys/fs/cgroup/freezer](90->84)
(00.035730) 1: <--
(00.035731) 1: [./sys/fs/cgroup/net_cls](91->84)
(00.035732) 1: <--
(00.035734) 1: [./sys/fs/cgroup/blkio](92->84)
(00.035735) 1: <--
(00.035737) 1: [./sys/fs/cgroup/perf_event](93->84)
(00.035738) 1: <--
(00.035740) 1: [./sys/fs/cgroup/net_prio](94->84)
(00.035741) 1: <--
(00.035743) 1: [./sys/fs/cgroup/hugetlb](95->84)
(00.035744) 1: <--
(00.035746) 1: <--
(00.035747) 1: [./sys/fs/fuse/connections](97->83)
(00.035749) 1: <--
(00.035750) 1: [./sys/kernel/debug](98->83)
(00.035752) 1: <--
(00.035753) 1: [./sys/kernel/security](99->83)
(00.035754) 1: <--
(00.035756) 1: [./sys/firmware/efi/efivars](100->83)
(00.035757) 1: <--
(00.035759) 1: <--
(00.035760) 1: [./boot/efi](104->72)
(00.035762) 1: <--
(00.035763) 1: [./media/kyriakos/88427B28427B19E0](110->72)
(00.035765) 1: <--
(00.035766) 1: [./var/lib/docker/aufs](105->72)
(00.035768) 1: [./var/lib/docker/aufs/mnt/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d](109->105)
(00.035769) 1: <--
(00.035771) 1: [./var/lib/docker/aufs/mnt/d1f85c676ca02f2aaf1ca23804e2c51abf8632a76ae1853d468ec0771b13453a](106->105)
(00.035772) 1: <--
(00.035774) 1: [./var/lib/docker/aufs/mnt/951d1cc2cb47270d1fbdee78679d4560bd1263e9b29c194c5a1105d75abd6418](107->105)
(00.035775) 1: <--
(00.035777) 1: [./var/lib/docker/aufs/mnt/cd8f1601f0d0327fd5bfe103ca0c8178e55c2342ccd66571cb78cb3d4325d242](108->105)
(00.035778) 1: <--
(00.035780) 1: <--
(00.035781) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ](111->72)
(00.035783) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/systemd](123->111)
(00.035784) 1: <--
(00.035785) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/cpuset](112->111)
(00.035787) 1: <--
(00.035788) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/cpu](113->111)
(00.035790) 1: <--
(00.035791) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/cpuacct](114->111)
(00.035793) 1: <--
(00.035794) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/memory](115->111)
(00.035796) 1: <--
(00.035797) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/devices](116->111)
(00.035799) 1: <--
(00.035800) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/freezer](117->111)
(00.035802) 1: <--
(00.035803) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/net_cls](118->111)
(00.035805) 1: <--
(00.035806) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/blkio](119->111)
(00.035808) 1: <--
(00.035809) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/perf_event](120->111)
(00.035811) 1: <--
(00.035812) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/net_prio](121->111)
(00.035814) 1: <--
(00.035815) 1: [./home/kyriakos/Desktop/logs/mysql/.criu.cgyard.UNX0gJ/hugetlb](122->111)
(00.035817) 1: <--
(00.035818) 1: <--
(00.035819) 1: <--
(00.035828) 1: Reading mountpoint images
(00.035831) 1: Getting source for 64
(00.035833) 1: Getting root for 64
(00.035835) 1: Getting mpt for 64 ./proc/timer_stats
(00.035838) 1: Getting opts for 64
(00.035840) 1: Read 64 mp @ ./proc/timer_stats
(00.035842) 1: Getting source for 63
(00.035844) 1: Getting root for 63
(00.035846) 1: Getting mpt for 63 ./proc/kcore
(00.035847) 1: Getting opts for 63
(00.035848) 1: Read 63 mp @ ./proc/kcore
(00.035851) 1: Getting source for 62
(00.035852) 1: Getting root for 62
(00.035854) 1: Getting mpt for 62 ./proc/sysrq-trigger
(00.035855) 1: Getting opts for 62
(00.035857) 1: Read 62 mp @ ./proc/sysrq-trigger
(00.035859) 1: Getting source for 60
(00.035860) 1: Getting root for 60
(00.035862) 1: Getting mpt for 60 ./proc/sys
(00.035863) 1: Getting opts for 60
(00.035865) 1: Read 60 mp @ ./proc/sys
(00.035867) 1: Getting source for 59
(00.035868) 1: Getting root for 59
(00.035870) 1: Getting mpt for 59 ./proc/irq
(00.035871) 1: Getting opts for 59
(00.035872) 1: Read 59 mp @ ./proc/irq
(00.035874) 1: Getting source for 58
(00.035876) 1: Getting root for 58
(00.035877) 1: Getting mpt for 58 ./proc/fs
(00.035879) 1: Getting opts for 58
(00.035880) 1: Read 58 mp @ ./proc/fs
(00.035882) 1: Getting source for 57
(00.035884) 1: Getting root for 57
(00.035885) 1: Getting mpt for 57 ./proc/bus
(00.035887) 1: Getting opts for 57
(00.035888) 1: Read 57 mp @ ./proc/bus
(00.035890) 1: Getting source for 56
(00.035891) 1: Getting root for 56
(00.035893) 1: Getting mpt for 56 ./proc/asound
(00.035894) 1: Getting opts for 56
(00.035896) 1: Read 56 mp @ ./proc/asound
(00.035898) 1: Getting source for 119
(00.035901) 1: Mountpoint /etc/hosts will have root from /var/lib/docker/containers/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/hosts
(00.035903) 1: Getting mpt for 119 ./etc/hosts
(00.035904) 1: Getting opts for 119
(00.035906) 1: Read 119 mp @ ./etc/hosts
(00.035908) 1: Getting source for 118
(00.035909) 1: Mountpoint /etc/hostname will have root from /var/lib/docker/containers/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/hostname
(00.035911) 1: Getting mpt for 118 ./etc/hostname
(00.035913) 1: Getting opts for 118
(00.035914) 1: Read 118 mp @ ./etc/hostname
(00.035916) 1: Getting source for 117
(00.035918) 1: Mountpoint /etc/resolv.conf will have root from /var/lib/docker/containers/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/resolv.conf
(00.035920) 1: Getting mpt for 117 ./etc/resolv.conf
(00.035921) 1: Getting opts for 117
(00.035922) 1: Read 117 mp @ ./etc/resolv.conf
(00.035925) 1: Getting source for 116
(00.035926) 1: Mountpoint /var/lib/mysql will have root from /var/lib/docker/volumes/8b40ac34b31f1b641f76d527a6287f0cdfe205de0e10171df889a4ff5a446c3d/_data
(00.035928) 1: Getting mpt for 116 ./var/lib/mysql
(00.035929) 1: Getting opts for 116
(00.035931) 1: Read 116 mp @ ./var/lib/mysql
(00.035933) 1: Getting source for 115
(00.035935) 1: Mountpoint /sys/fs/cgroup/systemd will have root from /sys/fs/cgroup/systemd
(00.035936) 1: Getting mpt for 115 ./sys/fs/cgroup/systemd
(00.035938) 1: Getting opts for 115
(00.035939) 1: Read 115 mp @ ./sys/fs/cgroup/systemd
(00.035941) 1: Getting source for 114
(00.035943) 1: Mountpoint /sys/fs/cgroup/hugetlb will have root from /sys/fs/cgroup/hugetlb
(00.035945) 1: Getting mpt for 114 ./sys/fs/cgroup/hugetlb
(00.035946) 1: Getting opts for 114
(00.035948) 1: Read 114 mp @ ./sys/fs/cgroup/hugetlb
(00.035950) 1: Getting source for 113
(00.035952) 1: Mountpoint /sys/fs/cgroup/net_prio will have root from /sys/fs/cgroup/net_prio
(00.035953) 1: Getting mpt for 113 ./sys/fs/cgroup/net_prio
(00.035955) 1: Getting opts for 113
(00.035956) 1: Read 113 mp @ ./sys/fs/cgroup/net_prio
(00.035960) 1: Getting source for 112
(00.035962) 1: Mountpoint /sys/fs/cgroup/perf_event will have root from /sys/fs/cgroup/perf_event
(00.035963) 1: Getting mpt for 112 ./sys/fs/cgroup/perf_event
(00.035965) 1: Getting opts for 112
(00.035966) 1: Read 112 mp @ ./sys/fs/cgroup/perf_event
(00.035969) 1: Getting source for 111
(00.035971) 1: Mountpoint /sys/fs/cgroup/blkio will have root from /sys/fs/cgroup/blkio
(00.035973) 1: Getting mpt for 111 ./sys/fs/cgroup/blkio
(00.035974) 1: Getting opts for 111
(00.035976) 1: Read 111 mp @ ./sys/fs/cgroup/blkio
(00.035978) 1: Getting source for 110
(00.035979) 1: Mountpoint /sys/fs/cgroup/net_cls will have root from /sys/fs/cgroup/net_cls
(00.035981) 1: Getting mpt for 110 ./sys/fs/cgroup/net_cls
(00.035982) 1: Getting opts for 110
(00.035984) 1: Read 110 mp @ ./sys/fs/cgroup/net_cls
(00.035986) 1: Getting source for 109
(00.035987) 1: Mountpoint /sys/fs/cgroup/freezer will have root from /sys/fs/cgroup/freezer
(00.035989) 1: Getting mpt for 109 ./sys/fs/cgroup/freezer
(00.035990) 1: Getting opts for 109
(00.035992) 1: Read 109 mp @ ./sys/fs/cgroup/freezer
(00.035994) 1: Getting source for 108
(00.035995) 1: Mountpoint /sys/fs/cgroup/devices will have root from /sys/fs/cgroup/devices
(00.035997) 1: Getting mpt for 108 ./sys/fs/cgroup/devices
(00.035998) 1: Getting opts for 108
(00.036000) 1: Read 108 mp @ ./sys/fs/cgroup/devices
(00.036002) 1: Getting source for 107
(00.036003) 1: Mountpoint /sys/fs/cgroup/memory will have root from /sys/fs/cgroup/memory
(00.036005) 1: Getting mpt for 107 ./sys/fs/cgroup/memory
(00.036006) 1: Getting opts for 107
(00.036008) 1: Read 107 mp @ ./sys/fs/cgroup/memory
(00.036010) 1: Getting source for 106
(00.036011) 1: Mountpoint /sys/fs/cgroup/cpuacct will have root from /sys/fs/cgroup/cpuacct
(00.036013) 1: Getting mpt for 106 ./sys/fs/cgroup/cpuacct
(00.036014) 1: Getting opts for 106
(00.036016) 1: Read 106 mp @ ./sys/fs/cgroup/cpuacct
(00.036018) 1: Getting source for 105
(00.036020) 1: Mountpoint /sys/fs/cgroup/cpu will have root from /sys/fs/cgroup/cpu
(00.036022) 1: Getting mpt for 105 ./sys/fs/cgroup/cpu
(00.036023) 1: Getting opts for 105
(00.036025) 1: Read 105 mp @ ./sys/fs/cgroup/cpu
(00.036027) 1: Getting source for 104
(00.036028) 1: Mountpoint /sys/fs/cgroup/cpuset will have root from /sys/fs/cgroup/cpuset
(00.036030) 1: Getting mpt for 104 ./sys/fs/cgroup/cpuset
(00.036031) 1: Getting opts for 104
(00.036032) 1: Read 104 mp @ ./sys/fs/cgroup/cpuset
(00.036035) 1: Getting source for 103
(00.036036) 1: Getting root for 103
(00.036038) 1: Getting mpt for 103 ./sys/fs/cgroup
(00.036039) 1: Getting opts for 103
(00.036040) 1: Read 103 mp @ ./sys/fs/cgroup
(00.036043) 1: Getting source for 102
(00.036044) 1: Getting root for 102
(00.036045) 1: Getting mpt for 102 ./sys
(00.036047) 1: Getting opts for 102
(00.036048) 1: Read 102 mp @ ./sys
(00.036050) 1: Getting source for 101
(00.036052) 1: Getting root for 101
(00.036053) 1: Getting mpt for 101 ./dev/mqueue
(00.036055) 1: Getting opts for 101
(00.036056) 1: Read 101 mp @ ./dev/mqueue
(00.036058) 1: Getting source for 100
(00.036060) 1: Getting root for 100
(00.036061) 1: Getting mpt for 100 ./dev/shm
(00.036063) 1: Getting opts for 100
(00.036064) 1: Read 100 mp @ ./dev/shm
(00.036067) 1: Getting source for 99
(00.036068) 1: Getting root for 99
(00.036070) 1: Getting mpt for 99 ./dev/pts
(00.036071) 1: Getting opts for 99
(00.036073) 1: Read 99 mp @ ./dev/pts
(00.036075) 1: Getting source for 98
(00.036076) 1: Getting root for 98
(00.036078) 1: Getting mpt for 98 ./dev
(00.036079) 1: Getting opts for 98
(00.036082) 1: Read 98 mp @ ./dev
(00.036084) 1: Getting source for 97
(00.036086) 1: Getting root for 97
(00.036087) 1: Getting mpt for 97 ./proc
(00.036089) 1: Getting opts for 97
(00.036090) 1: Read 97 mp @ ./proc
(00.036092) 1: Getting source for 96
(00.036094) 1: Getting root for 96
(00.036095) 1: Getting mpt for 96 ./
(00.036097) 1: Getting opts for 96
(00.036098) 1: Read 96 mp @ ./
(00.036106) 1: Path `/run/docker/execdriver/native/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/criu-root' resolved to `./run/docker/execdriver/native/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/criu-root' mountpoint
(00.036132) 1: Building mountpoints tree
(00.036136) 1: Building plain mount tree
(00.036138) 1: Working on 96->54
(00.036141) 1: Working on 97->96
(00.036143) 1: Working on 98->96
(00.036144) 1: Working on 99->98
(00.036146) 1: Working on 100->98
(00.036147) 1: Working on 101->98
(00.036148) 1: Working on 102->96
(00.036150) 1: Working on 103->102
(00.036151) 1: Working on 104->103
(00.036153) 1: Working on 105->103
(00.036154) 1: Working on 106->103
(00.036156) 1: Working on 107->103
(00.036157) 1: Working on 108->103
(00.036158) 1: Working on 109->103
(00.036160) 1: Working on 110->103
(00.036161) 1: Working on 111->103
(00.036163) 1: Working on 112->103
(00.036164) 1: Working on 113->103
(00.036165) 1: Working on 114->103
(00.036167) 1: Working on 115->103
(00.036168) 1: Working on 116->96
(00.036170) 1: Working on 117->96
(00.036171) 1: Working on 118->96
(00.036172) 1: Working on 119->96
(00.036174) 1: Working on 56->97
(00.036175) 1: Working on 57->97
(00.036177) 1: Working on 58->97
(00.036178) 1: Working on 59->97
(00.036180) 1: Working on 60->97
(00.036181) 1: Working on 62->97
(00.036182) 1: Working on 63->97
(00.036184) 1: Working on 64->97
(00.036185) 1: Resorting siblings on 96
(00.036187) 1: Resorting siblings on 97
(00.036188) 1: Resorting siblings on 56
(00.036190) 1: Resorting siblings on 57
(00.036191) 1: Resorting siblings on 58
(00.036192) 1: Resorting siblings on 59
(00.036194) 1: Resorting siblings on 60
(00.036195) 1: Resorting siblings on 62
(00.036197) 1: Resorting siblings on 63
(00.036198) 1: Resorting siblings on 64
(00.036200) 1: Resorting siblings on 98
(00.036201) 1: Resorting siblings on 99
(00.036202) 1: Resorting siblings on 100
(00.036204) 1: Resorting siblings on 101
(00.036205) 1: Resorting siblings on 102
(00.036207) 1: Resorting siblings on 103
(00.036208) 1: Resorting siblings on 104
(00.036210) 1: Resorting siblings on 105
(00.036211) 1: Resorting siblings on 106
(00.036212) 1: Resorting siblings on 107
(00.036214) 1: Resorting siblings on 108
(00.036215) 1: Resorting siblings on 109
(00.036217) 1: Resorting siblings on 110
(00.036218) 1: Resorting siblings on 111
(00.036220) 1: Resorting siblings on 112
(00.036221) 1: Resorting siblings on 113
(00.036222) 1: Resorting siblings on 114
(00.036224) 1: Resorting siblings on 115
(00.036225) 1: Resorting siblings on 116
(00.036227) 1: Resorting siblings on 117
(00.036228) 1: Resorting siblings on 118
(00.036230) 1: Resorting siblings on 119
(00.036231) 1: Done:
(00.036232) 1: [./](96->54)
(00.036234) 1: [./proc](97->96)
(00.036236) 1: [./proc/asound](56->97)
(00.036237) 1: <--
(00.036239) 1: [./proc/timer_stats](64->97)
(00.036240) 1: <--
(00.036242) 1: [./proc/kcore](63->97)
(00.036243) 1: <--
(00.036244) 1: [./proc/sysrq-trigger](62->97)
(00.036246) 1: <--
(00.036247) 1: [./proc/sys](60->97)
(00.036249) 1: <--
(00.036252) 1: [./proc/irq](59->97)
(00.036253) 1: <--
(00.036255) 1: [./proc/fs](58->97)
(00.036256) 1: <--
(00.036258) 1: [./proc/bus](57->97)
(00.036259) 1: <--
(00.036261) 1: <--
(00.036262) 1: [./etc/hosts](119->96)
(00.036264) 1: <--
(00.036265) 1: [./etc/hostname](118->96)
(00.036266) 1: <--
(00.036268) 1: [./etc/resolv.conf](117->96)
(00.036269) 1: <--
(00.036271) 1: [./var/lib/mysql](116->96)
(00.036272) 1: <--
(00.036274) 1: [./sys](102->96)
(00.036275) 1: [./sys/fs/cgroup](103->102)
(00.036277) 1: [./sys/fs/cgroup/cpuset](104->103)
(00.036278) 1: <--
(00.036280) 1: [./sys/fs/cgroup/systemd](115->103)
(00.036281) 1: <--
(00.036283) 1: [./sys/fs/cgroup/hugetlb](114->103)
(00.036284) 1: <--
(00.036286) 1: [./sys/fs/cgroup/net_prio](113->103)
(00.036287) 1: <--
(00.036289) 1: [./sys/fs/cgroup/perf_event](112->103)
(00.036290) 1: <--
(00.036291) 1: [./sys/fs/cgroup/blkio](111->103)
(00.036293) 1: <--
(00.036294) 1: [./sys/fs/cgroup/net_cls](110->103)
(00.036296) 1: <--
(00.036297) 1: [./sys/fs/cgroup/freezer](109->103)
(00.036299) 1: <--
(00.036300) 1: [./sys/fs/cgroup/devices](108->103)
(00.036302) 1: <--
(00.036303) 1: [./sys/fs/cgroup/memory](107->103)
(00.036305) 1: <--
(00.036306) 1: [./sys/fs/cgroup/cpuacct](106->103)
(00.036307) 1: <--
(00.036309) 1: [./sys/fs/cgroup/cpu](105->103)
(00.036310) 1: <--
(00.036312) 1: <--
(00.036313) 1: <--
(00.036315) 1: [./dev](98->96)
(00.036316) 1: [./dev/pts](99->98)
(00.036318) 1: <--
(00.036319) 1: [./dev/mqueue](101->98)
(00.036321) 1: <--
(00.036322) 1: [./dev/shm](100->98)
(00.036324) 1: <--
(00.036325) 1: <--
(00.036326) 1: <--
(00.036335) 1: 96:./ private 1 shared 0 slave 0
(00.036338) 1: Start with 96:./
(00.036340) 1: Mounting aufs @./ (0)
(00.036342) 1: Mounting proc @./proc (0)
(00.036356) 1: 97:./proc private 1 shared 0 slave 0
(00.036359) 1: Mounting proc @./proc/asound (0)
(00.036361) 1: Bind ./proc/asound to ./proc/asound
(00.036369) 1: 56:./proc/asound private 1 shared 0 slave 0
(00.036372) 1: Postpone slave ./proc/timer_stats
(00.036373) 1: Postpone slave ./proc/kcore
(00.036375) 1: Mounting proc @./proc/sysrq-trigger (0)
(00.036376) 1: Bind ./proc/sysrq-trigger to ./proc/sysrq-trigger
(00.036382) 1: 62:./proc/sysrq-trigger private 1 shared 0 slave 0
(00.036385) 1: Mounting proc @./proc/sys (0)
(00.036387) 1: Bind ./proc/sys to ./proc/sys
(00.036391) 1: 60:./proc/sys private 1 shared 0 slave 0
(00.036394) 1: Mounting proc @./proc/irq (0)
(00.036395) 1: Bind ./proc/irq to ./proc/irq
(00.036400) 1: 59:./proc/irq private 1 shared 0 slave 0
(00.036403) 1: Mounting proc @./proc/fs (0)
(00.036405) 1: Bind ./proc/fs to ./proc/fs
(00.036409) 1: 58:./proc/fs private 1 shared 0 slave 0
(00.036412) 1: Mounting proc @./proc/bus (0)
(00.036414) 1: Bind ./proc/bus to ./proc/bus
(00.036418) 1: 57:./proc/bus private 1 shared 0 slave 0
(00.036421) 1: Mounting unsupported @./etc/hosts (0)
(00.036422) 1: Bind /var/lib/docker/containers/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/hosts to ./etc/hosts
(00.036430) 1: 119:./etc/hosts private 1 shared 0 slave 0
(00.036434) 1: Mounting unsupported @./etc/hostname (0)
(00.036436) 1: Bind /var/lib/docker/containers/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/hostname to ./etc/hostname
(00.036441) 1: 118:./etc/hostname private 1 shared 0 slave 0
(00.036445) 1: Mounting unsupported @./etc/resolv.conf (0)
(00.036446) 1: Bind /var/lib/docker/containers/ff125987e60ab475ccd254d4fbcaa706f4657efbe9fea055c5bd8c226ce0df5d/resolv.conf to ./etc/resolv.conf
(00.036454) 1: 117:./etc/resolv.conf private 1 shared 0 slave 0
(00.036458) 1: Mounting unsupported @./var/lib/mysql (0)
(00.036459) 1: Bind /var/lib/docker/volumes/8b40ac34b31f1b641f76d527a6287f0cdfe205de0e10171df889a4ff5a446c3d/_data to ./var/lib/mysql
(00.036465) 1: Error (mount.c:1924): Can't mount at ./var/lib/mysql: No such file or directory
(00.036468) 1: Error (mount.c:2023): Unable to statfs ./var/lib/mysql: No such file or directory
(00.056346) Error (cr-restore.c:1933): Restoring FAILED.
As I can see it seems that Criu it is unable to find file ./var/lib/mysql. This is specified on the container as "Volume"
(From docker inspect command)
"Cmd": [
"mysqld"
],
"Image": "mysql:5.7",
"Volumes": {
"/var/lib/mysql": {}
},
"VolumeDriver": "",
"WorkingDir": "",
"Entrypoint": [
"/entrypoint.sh"
],
I can see that criu is searching for a relative path or am I wrong?
Probably we also need @boucher's help..
Thank you
RO or absent /tmp causes dump to fail
As described in isse #6 r/o /tmp causes failure in open_mountpoint() due to inability to mkdtemp(). Same will be for the case when /tmp is absent. Same will be for RO / :)
docker checkpoint failed
I'm trying to make docker checkpoint works, but I got the following error.
Here is the docker client log.
vagrant@vagrant-ubuntu-trusty:~/docker$ export CID=$(docker run -d busybox:latest /bin/sh -c 'i=0; while true; do echo $i >> /foo; i=$(e
xpr $i + 1); sleep 3; done')
vagrant@vagrant-ubuntu-trusty:~/docker$ docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
806b0fa36744 busybox:latest "/bin/sh -c 'i=0; wh 3 seconds ago Up 1 seconds determined_visvesvaraya
vagrant@vagrant-ubuntu-trusty:~/docker$ docker checkpoint $CID
Error response from daemon: Cannot checkpoint container 806b0fa36744339b60e41727c1c7f4aa65e30cd3ab86a63206cae9c4854b6fbb: criu failed: type NOTIFY errno 0
Here is the docker daemon log.
INFO[0840] POST /v1.20/containers/806b0fa36744339b60e41727c1c7f4aa65e30cd3ab86a63206cae9c4854b6fbb/checkpoint
ERRO[0840] Handler for POST /containers/{name:.*}/checkpoint returned error: Cannot checkpoint container 806b0fa36744339b60e41727c1c7f4aa65e30cd3ab86a63206cae9c4854b6fbb: criu failed: type NOTIFY errno 0
ERRO[0840] HTTP Error err=Cannot checkpoint container 806b0fa36744339b60e41727c1c7f4aa65e30cd3ab86a63206cae9c4854b6fbb: criu failed: type NOTIFY errno 0 statusCode=500
Here is my environment.
Ubuntu: 14.04 (vagrant)
criu
vagrant@vagrant-ubuntu-trusty:~/docker$ criu --version
Version: 1.6
GitID: v1.6-95-gde70936
docker boucher/docker@dd06ea0
vagrant@vagrant-ubuntu-trusty:~/docker$ docker -v
Docker version 1.8.0-dev, build dd06ea0
Please let me know if you need more information.
Trying to Checkpoint MySql container - criu failed: type NOTIFY errno 0
Docker:
Client:
Version: 1.8.0-dev
API version: 1.20
Go version: go1.4.2
Git commit: 24e477b
Built: Sun Aug 2 11:18:41 UTC 2015
OS/Arch: linux/amd64
Experimental: true
Server:
Version: 1.8.0-dev
API version: 1.20
Go version: go1.4.2
Git commit: 24e477b
Built: Sun Aug 2 11:18:41 UTC 2015
OS/Arch: linux/amd64
Experimental: true
CRIU:
Version: 1.6
GitID: v1.6-147-g8ef2577
I am trying to C/R a MySQL container.
I start it
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
99f990b401b0 mysql:5.7 "/entrypoint.sh mysq 2 days ago Up 2 minutes 3306/tcp mysql_test
and then I am trying to checkpoint it. The result is:
$ docker checkpoint mysql_test
Error response from daemon: Cannot checkpoint container mysql_test: criu failed: type NOTIFY errno 0
Error: failed to checkpoint one or more containers
dump.log
(00.000033) Added /var/lib/mysql:/var/lib/mysql ext mount mapping
(00.000058) Added /etc/resolv.conf:/etc/resolv.conf ext mount mapping
(00.000060) Added /etc/hostname:/etc/hostname ext mount mapping
(00.000061) Added /etc/hosts:/etc/hosts ext mount mapping
(00.000062) ========================================
(00.000064) Dumping processes (pid: 3076)
(00.000065) ========================================
(00.000125) Found anon-shmem device at 5
(00.000131) Reset 3176's dirty tracking
(00.000169) ... done
(00.000193) Dirty track supported on kernel
(00.000259) irmap: Searching irmap cache in work dir
(00.000267) No irmap-cache image
(00.000270) irmap: Searching irmap cache in parent
(00.000278) irmap: No irmap cache
(00.000282) cpu: fpu:1 fxsr:1 xsave:1
(00.000363) vdso: Parsing at 7fff2d2ce000 7fff2d2d0000
(00.000366) vdso: PT_LOAD p_vaddr: 0
(00.000367) vdso: DT_HASH: 0x120
(00.000369) vdso: DT_STRTAB: 0x268
(00.000370) vdso: DT_SYMTAB: 0x160
(00.000371) vdso: DT_STRSZ: 94
(00.000372) vdso: DT_SYMENT: 24
(00.000373) vdso: nbucket 3 nchain 11 bucket 0x7fff2d2ce128 chain 0x7fff2d2ce134
(00.000376) vdso: rt [vdso] 7fff2d2ce000-7fff2d2d0000 [vvar] 7fff2d2cc000-7fff2d2ce000
(00.000425) Writing image inventory (version 1)
(00.000450) Add pid ns 1 pid 3176
(00.000461) Add net ns 2 pid 3176
(00.000469) Add ipc ns 3 pid 3176
(00.000474) Add uts ns 4 pid 3176
(00.000480) Add mnt ns 5 pid 3176
(00.000485) Add user ns 6 pid 3176
(00.000487) cg: Dumping cgroups for 3176
(00.000532) cg: `- New css ID 1
(00.000535) cg: `- [blkio] -> [/]
(00.000536) cg: `- [cpu] -> [/]
(00.000537) cg: `- [cpuacct] -> [/]
(00.000538) cg: `- [cpuset] -> [/]
(00.000539) cg: `- [devices] -> [/]
(00.000540) cg: `- [freezer] -> [/]
(00.000541) cg: `- [hugetlb] -> [/]
(00.000542) cg: `- [memory] -> [/]
(00.000543) cg: `- [name=systemd] -> [/]
(00.000544) cg: `- [net_cls] -> [/]
(00.000545) cg: `- [net_prio] -> [/]
(00.000546) cg: `- [perf_event] -> [/]
(00.000547) cg: Set 1 is criu one
(00.000870) Seized task 3076, state 1
(00.000937) Seizing 3076's 3108 thread
(00.000988) Seizing 3076's 3109 thread
(00.001341) Seizing 3076's 3110 thread
(00.001391) Seizing 3076's 3111 thread
(00.001435) Seizing 3076's 3112 thread
(00.001477) Seizing 3076's 3113 thread
(00.001517) Seizing 3076's 3114 thread
(00.001557) Seizing 3076's 3115 thread
(00.001597) Seizing 3076's 3116 thread
(00.001636) Seizing 3076's 3117 thread
(00.001676) Seizing 3076's 3118 thread
(00.001717) Seizing 3076's 3119 thread
(00.001758) Seizing 3076's 3126 thread
(00.001823) Seizing 3076's 3127 thread
(00.001864) Seizing 3076's 3128 thread
(00.001904) Seizing 3076's 3129 thread
(00.001944) Seizing 3076's 3130 thread
(00.001983) Seizing 3076's 3131 thread
(00.002023) Seizing 3076's 3132 thread
(00.002062) Seizing 3076's 3133 thread
(00.002102) Seizing 3076's 3134 thread
(00.002142) Seizing 3076's 3135 thread
(00.002181) Seizing 3076's 3136 thread
(00.002363) Collected 3076 in 1 state
(00.002376) Will take pid namespace in the image
(00.002378) Add pid ns 7 pid 3076
(00.002382) Will take net namespace in the image
(00.002383) Add net ns 8 pid 3076
(00.002387) Will take ipc namespace in the image
(00.002388) Add ipc ns 9 pid 3076
(00.002392) Will take uts namespace in the image
(00.002393) Add uts ns 10 pid 3076
(00.002397) Will take mnt namespace in the image
(00.002398) Add mnt ns 11 pid 3076
(00.002402) Lock network
(00.002404) Running network-lock scripts
(00.002413) RPC
(00.002621) lockinfo: 1:1 1 3076 08:06:1985361 0 EOF
(00.002627) lockinfo: 2:1 1 3076 08:06:1985359 0 EOF
(00.002630) lockinfo: 3:1 1 3076 08:06:1985357 0 EOF
(00.002634) lockinfo: 4:1 1 3076 08:06:1985391 0 EOF
(00.002637) lockinfo: 5:1 1 3076 08:06:1985383 0 EOF
(00.002640) lockinfo: 6:1 1 3076 08:06:1985381 0 EOF
(00.002644) lockinfo: 7:1 1 3076 08:06:1985353 0 EOF
(00.002647) lockinfo: 8:1 1 3076 08:06:1985324 0 EOF
(00.002650) lockinfo: 9:1 1 3076 08:06:1985322 0 EOF
(00.002654) lockinfo: 10:1 0 2179 08:06:3935993 128 128
(00.002657) lockinfo: 11:1 0 2179 08:06:3935991 1073741826 1073742335
(00.002666) lockinfo: 12:1 0 2380 08:06:3957354 128 128
(00.002669) lockinfo: 13:1 0 2380 08:06:3936035 1073741826 1073742335
(00.002673) lockinfo: 14:1 0 2380 08:06:3956394 128 128
(00.002676) lockinfo: 15:1 0 2380 08:06:3936037 1073741826 1073742335
(00.002680) lockinfo: 16:1 0 2380 08:06:3954068 128 128
(00.002707) lockinfo: 17:1 0 2380 08:06:3936033 1073741826 1073742335
(00.002711) lockinfo: 18:1 0 2380 08:06:3936029 128 128
(00.002747) lockinfo: 19:1 0 2380 08:06:3936027 1073741826 1073742335
(00.002750) lockinfo: 20:1 1 2376 08:06:3935995 0 0
(00.002754) lockinfo: 21:1 0 2365 08:06:3935993 128 128
(00.002757) lockinfo: 22:1 0 2365 08:06:3935991 1073741826 1073742335
(00.002760) lockinfo: 23:1 0 2359 08:06:3935993 128 128
(00.002773) lockinfo: 24:1 0 2359 08:06:3935991 1073741826 1073742335
(00.002777) lockinfo: 25:2 1 916 00:14:12057 0 EOF
(00.002780) lockinfo: 26:1 1 948 08:06:1967392 0 EOF
(00.002783) lockinfo: 27:2 1 879 00:11:11417 0 EOF
(00.002787) lockinfo: 28:1 1 3076 08:06:1985395 0 EOF
(00.002790) lockinfo: 29:1 1 3076 08:06:1985393 0 EOF
(00.002793) lockinfo: 30:1 1 3076 08:06:1985355 0 EOF
(00.002797) lockinfo: 31:1 1 3076 08:06:1984658 0 EOF
(00.002800) lockinfo: 32:1 1 3076 08:06:1985287 0 EOF
(00.002803) lockinfo: 33:1 1 3076 08:06:1985285 0 EOF
(00.002806) lockinfo: 34:1 1 3076 08:06:1985283 0 EOF
(00.002810) lockinfo: 35:1 0 2556 08:06:3935993 128 128
(00.002813) lockinfo: 36:1 0 2556 08:06:3935991 1073741826 1073742335
(00.002822) lockinfo: 37:1 1 2380 08:06:3936016 0 EOF
(00.002826) lockinfo: 38:1 0 2354 08:06:3935993 128 128
(00.002829) lockinfo: 39:1 0 2354 08:06:3935991 1073741826 1073742335
(00.002933) type aufs source none mnt_id 81 s_dev 0x26 / @ ./ flags 0x200000 options si=3f48c2e58a26870f,dio,dirperm1
(00.002937) Collecting AUFS branch pathnames ...
(00.003021) /sys/fs/aufs/si_3f48c2e58a26870f/br0 : /var/lib/docker/aufs/diff/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af
(00.003042) /sys/fs/aufs/si_3f48c2e58a26870f/br1 : /var/lib/docker/aufs/diff/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af-init
(00.003061) /sys/fs/aufs/si_3f48c2e58a26870f/br2 : /var/lib/docker/aufs/diff/fdb9c2185fc2d1518457e5f5d03303846d0d71de199c3bf312cfacbfd81f8c59
(00.003082) /sys/fs/aufs/si_3f48c2e58a26870f/br3 : /var/lib/docker/aufs/diff/7b4030a6b20ba9f0daec8f5b3baf6e579a087e54f2c3ed748596c899819a5083
(00.003102) /sys/fs/aufs/si_3f48c2e58a26870f/br4 : /var/lib/docker/aufs/diff/099dc92e9b15dd5a8699b105a9194615371e5e59a9ad73b706ad4b03cad644d8
(00.003121) /sys/fs/aufs/si_3f48c2e58a26870f/br5 : /var/lib/docker/aufs/diff/6e2ce31eb835b1d582ae0722e7b8b2634b1bcef84e07502f6b64f041bd646a5b
(00.003140) /sys/fs/aufs/si_3f48c2e58a26870f/br6 : /var/lib/docker/aufs/diff/5191ddfc3b018a7a88b54e602d9ebc4983c8caf3bf289594420ffd59f9ff44d1
(00.003160) /sys/fs/aufs/si_3f48c2e58a26870f/br7 : /var/lib/docker/aufs/diff/a9057a689e837969e7d9c24d0b1df21b0c171d3224266d82bcd8efdb5211179d
(00.003182) /sys/fs/aufs/si_3f48c2e58a26870f/br8 : /var/lib/docker/aufs/diff/ac0ee0367a322d51526614629cc60ec6c182624893925bea2557337dcea9c194
(00.003201) /sys/fs/aufs/si_3f48c2e58a26870f/br9 : /var/lib/docker/aufs/diff/059dbbef4dd8f26a1fc5e0e60188052d6fec14e7af889be0f530ed3bf2e6b391
(00.003220) /sys/fs/aufs/si_3f48c2e58a26870f/br10 : /var/lib/docker/aufs/diff/2d1023ecaed49e18b0a7cb473702bab72601deee129d8b7c2eb3426cc1f147f0
(00.003239) /sys/fs/aufs/si_3f48c2e58a26870f/br11 : /var/lib/docker/aufs/diff/f928e22e58b0596faa4c2e45fd12195a1e616c3b096e10e6856446c53db6dd18
(00.003258) /sys/fs/aufs/si_3f48c2e58a26870f/br12 : /var/lib/docker/aufs/diff/543ff72402d8d796cae34d4c980e247debd9bace8a7e22819dd1693541bb084e
(00.003277) /sys/fs/aufs/si_3f48c2e58a26870f/br13 : /var/lib/docker/aufs/diff/273cd71eacf0b918851435d73dcfeb067239b9bfcae37def64f4e13726299eb1
(00.003296) /sys/fs/aufs/si_3f48c2e58a26870f/br14 : /var/lib/docker/aufs/diff/c2b0136be90f7370c0a3372157f53f9b84e15a91b34e73011b47f62dd23077e7
(00.003314) /sys/fs/aufs/si_3f48c2e58a26870f/br15 : /var/lib/docker/aufs/diff/60c52dbe9d9121f0baf4d44fece2d447a0a48f4da84522f0eb7082a0ca6b465e
(00.003339) /sys/fs/aufs/si_3f48c2e58a26870f/br16 : /var/lib/docker/aufs/diff/4c8cbfd2973e1b92137486922e1af5677fced4f6902e6513b81413e22f33ceab
(00.003348) type proc source proc mnt_id 82 s_dev 0x28 / @ ./proc flags 0x20000e options
(00.003354) type tmpfs source tmpfs mnt_id 83 s_dev 0x29 / @ ./dev flags 0x1000000 options mode=755
(00.003360) type devpts source devpts mnt_id 84 s_dev 0x2a / @ ./dev/pts flags 0x20000a options gid=5,mode=620,ptmxmode=666
(00.003379) type tmpfs source shm mnt_id 85 s_dev 0x2b / @ ./dev/shm flags 0x20000e options size=65536k
(00.003385) type mqueue source mqueue mnt_id 86 s_dev 0x27 / @ ./dev/mqueue flags 0x20000e options
(00.003391) type sysfs source sysfs mnt_id 87 s_dev 0x2c / @ ./sys flags 0x20000f options
(00.003396) type tmpfs source tmpfs mnt_id 88 s_dev 0x2d / @ ./sys/fs/cgroup flags 0x20000e options
(00.003401) type cgroup source cgroup mnt_id 89 s_dev 0x18 /docker/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af @ ./sys/fs/cgroup/cpuset flags 0x20000f options cpuset
(00.003407) type cgroup source cgroup mnt_id 90 s_dev 0x19 /docker/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af @ ./sys/fs/cgroup/cpu flags 0x20000f options cpu
(00.003443) type cgroup source cgroup mnt_id 91 s_dev 0x1a /docker/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af @ ./sys/fs/cgroup/cpuacct flags 0x20000f options cpuacct
(00.003450) type cgroup source cgroup mnt_id 92 s_dev 0x1b /docker/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af @ ./sys/fs/cgroup/memory flags 0x20000f options memory
(00.003459) type cgroup source cgroup mnt_id 93 s_dev 0x1c /docker/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af @ ./sys/fs/cgroup/devices flags 0x20000f options devices
(00.003465) type cgroup source cgroup mnt_id 94 s_dev 0x1d /docker/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af @ ./sys/fs/cgroup/freezer flags 0x20000f options freezer
(00.003471) type cgroup source cgroup mnt_id 95 s_dev 0x1e /docker/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af @ ./sys/fs/cgroup/net_cls flags 0x20000f options net_cls
(00.003476) type cgroup source cgroup mnt_id 96 s_dev 0x1f /docker/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af @ ./sys/fs/cgroup/blkio flags 0x20000f options blkio
(00.003512) type cgroup source cgroup mnt_id 97 s_dev 0x20 /docker/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af @ ./sys/fs/cgroup/perf_event flags 0x20000f options perf_event
(00.003518) type cgroup source cgroup mnt_id 98 s_dev 0x21 /docker/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af @ ./sys/fs/cgroup/net_prio flags 0x20000f options net_prio
(00.003524) type cgroup source cgroup mnt_id 99 s_dev 0x22 /docker/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af @ ./sys/fs/cgroup/hugetlb flags 0x20000f options hugetlb
(00.003529) type cgroup source systemd mnt_id 100 s_dev 0x23 / @ ./sys/fs/cgroup/systemd flags 0x20000f options name=systemd
(00.003535) type ext4 source /dev/disk/by-uuid/b2c933d5-6fa6-4035-980a-ac7ae5fe64d2 mnt_id 101 s_dev 0x800006 /var/lib/docker/vfs/dir/e388120b0d2367b183ecf63e1a1d88efaa17fc1ea7b34441a923fe40ead740f9 @ ./var/lib/mysql flags 0x200000 options errors=remount-ro,data=ordered
(00.003545) type ext4 source /dev/disk/by-uuid/b2c933d5-6fa6-4035-980a-ac7ae5fe64d2 mnt_id 102 s_dev 0x800006 /var/lib/docker/containers/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af/resolv.conf @ ./etc/resolv.conf flags 0x200000 options errors=remount-ro,data=ordered
(00.003570) type ext4 source /dev/disk/by-uuid/b2c933d5-6fa6-4035-980a-ac7ae5fe64d2 mnt_id 103 s_dev 0x800006 /var/lib/docker/containers/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af/hostname @ ./etc/hostname flags 0x200000 options errors=remount-ro,data=ordered
(00.003577) type ext4 source /dev/disk/by-uuid/b2c933d5-6fa6-4035-980a-ac7ae5fe64d2 mnt_id 104 s_dev 0x800006 /var/lib/docker/containers/99f990b401b0a4035a59dbaec80d87cebcbb1e74d863687b97049d324f93a2af/hosts @ ./etc/hosts flags 0x200000 options errors=remount-ro,data=ordered
(00.003587) type proc source proc mnt_id 50 s_dev 0x28 /asound @ ./proc/asound flags 0x20000f options
(00.003593) type proc source proc mnt_id 51 s_dev 0x28 /bus @ ./proc/bus flags 0x20000f options
(00.003598) type proc source proc mnt_id 52 s_dev 0x28 /fs @ ./proc/fs flags 0x20000f options
(00.003603) type proc source proc mnt_id 53 s_dev 0x28 /irq @ ./proc/irq flags 0x20000f options
(00.003608) type proc source proc mnt_id 54 s_dev 0x28 /sys @ ./proc/sys flags 0x20000f options
(00.003613) type proc source proc mnt_id 55 s_dev 0x28 /sysrq-trigger @ ./proc/sysrq-trigger flags 0x20000f options
(00.003618) type tmpfs source tmpfs mnt_id 56 s_dev 0x29 /null @ ./proc/kcore flags 0x1000000 options mode=755
(00.003623) type tmpfs source tmpfs mnt_id 57 s_dev 0x29 /null @ ./proc/timer_stats flags 0x1000000 options mode=755
(00.003634) Building mountpoints tree
(00.003636) Building plain mount tree
(00.003637) Working on 57->82
(00.003638) Working on 56->82
(00.003639) Working on 55->82
(00.003640) Working on 54->82
(00.003641) Working on 53->82
(00.003643) Working on 52->82
(00.003644) Working on 51->82
(00.003645) Working on 50->82
(00.003646) Working on 104->81
(00.003647) Working on 103->81
(00.003648) Working on 102->81
(00.003649) Working on 101->81
(00.003650) Working on 100->88
(00.003651) Working on 99->88
(00.003652) Working on 98->88
(00.003653) Working on 97->88
(00.003654) Working on 96->88
(00.003655) Working on 95->88
(00.003656) Working on 94->88
(00.003657) Working on 93->88
(00.003658) Working on 92->88
(00.003659) Working on 91->88
(00.003661) Working on 90->88
(00.003662) Working on 89->88
(00.003663) Working on 88->87
(00.003664) Working on 87->81
(00.003665) Working on 86->83
(00.003666) Working on 85->83
(00.003667) Working on 84->83
(00.003668) Working on 83->81
(00.003669) Working on 82->81
(00.003670) Working on 81->48
(00.003672) Resorting siblings on 81
(00.003673) Resorting siblings on 104
(00.003674) Resorting siblings on 103
(00.003675) Resorting siblings on 102
(00.003676) Resorting siblings on 101
(00.003677) Resorting siblings on 87
(00.003678) Resorting siblings on 88
(00.003679) Resorting siblings on 100
(00.003680) Resorting siblings on 99
(00.003681) Resorting siblings on 98
(00.003682) Resorting siblings on 97
(00.003683) Resorting siblings on 96
(00.003684) Resorting siblings on 95
(00.003685) Resorting siblings on 94
(00.003686) Resorting siblings on 93
(00.003687) Resorting siblings on 92
(00.003688) Resorting siblings on 91
(00.003689) Resorting siblings on 90
(00.003690) Resorting siblings on 89
(00.003691) Resorting siblings on 83
(00.003692) Resorting siblings on 86
(00.003693) Resorting siblings on 85
(00.003694) Resorting siblings on 84
(00.003695) Resorting siblings on 82
(00.003696) Resorting siblings on 57
(00.003697) Resorting siblings on 56
(00.003698) Resorting siblings on 55
(00.003699) Resorting siblings on 54
(00.003700) Resorting siblings on 53
(00.003701) Resorting siblings on 52
(00.003702) Resorting siblings on 51
(00.003703) Resorting siblings on 50
(00.003704) Done:
(00.003705) [./](81->48)
(00.003707) [./sys](87->81)
(00.003708) [./sys/fs/cgroup](88->87)
(00.003710) [./sys/fs/cgroup/systemd](100->88)
(00.003711) <--
(00.003712) [./sys/fs/cgroup/cpuset](89->88)
(00.003713) <--
(00.003714) [./sys/fs/cgroup/cpu](90->88)
(00.003715) <--
(00.003716) [./sys/fs/cgroup/cpuacct](91->88)
(00.003717) <--
(00.003718) [./sys/fs/cgroup/memory](92->88)
(00.003720) <--
(00.003720) [./sys/fs/cgroup/devices](93->88)
(00.003722) <--
(00.003723) [./sys/fs/cgroup/freezer](94->88)
(00.003724) <--
(00.003725) [./sys/fs/cgroup/net_cls](95->88)
(00.003726) <--
(00.003727) [./sys/fs/cgroup/blkio](96->88)
(00.003728) <--
(00.003729) [./sys/fs/cgroup/perf_event](97->88)
(00.003730) <--
(00.003731) [./sys/fs/cgroup/net_prio](98->88)
(00.003735) <--
(00.003736) [./sys/fs/cgroup/hugetlb](99->88)
(00.003737) <--
(00.003738) <--
(00.003739) <--
(00.003740) [./proc](82->81)
(00.003741) [./proc/timer_stats](57->82)
(00.003742) <--
(00.003743) [./proc/asound](50->82)
(00.003744) <--
(00.003745) [./proc/bus](51->82)
(00.003746) <--
(00.003747) [./proc/fs](52->82)
(00.003749) <--
(00.003750) [./proc/irq](53->82)
(00.003751) <--
(00.003752) [./proc/sys](54->82)
(00.003753) <--
(00.003754) [./proc/sysrq-trigger](55->82)
(00.003755) <--
(00.003756) [./proc/kcore](56->82)
(00.003757) <--
(00.003758) <--
(00.003759) [./dev](83->81)
(00.003760) [./dev/mqueue](86->83)
(00.003761) <--
(00.003762) [./dev/pts](84->83)
(00.003764) <--
(00.003765) [./dev/shm](85->83)
(00.003766) <--
(00.003767) <--
(00.003768) [./etc/hosts](104->81)
(00.003769) <--
(00.003770) [./var/lib/mysql](101->81)
(00.003771) <--
(00.003772) [./etc/resolv.conf](102->81)
(00.003773) <--
(00.003774) [./etc/hostname](103->81)
(00.003775) <--
(00.003776) <--
(00.003778) Found /etc/hosts mapping for ./etc/hosts mountpoint
(00.003780) Found /etc/hostname mapping for ./etc/hostname mountpoint
(00.003781) Found /etc/resolv.conf mapping for ./etc/resolv.conf mountpoint
(00.003782) Found /var/lib/mysql mapping for ./var/lib/mysql mountpoint
(00.003790) Error (mount.c:630): 99:./sys/fs/cgroup/hugetlb doesn't have a proper root mount
(00.003792) Unlock network
(00.003794) Running network-unlock scripts
(00.003800) RPC
(00.003842) Unfreezing tasks into 1
(00.003845) Unseizing 3076 into 1
(00.004013) Error (cr-dump.c:1996): Dumping FAILED.
(edit: I also tried to checkpoint with apache, but the same results)
Any help?
Thanks for all the support!
Issue checkpointing larger container
I am getting the following error regarding cgroups states during checkpointing. I have tried all of the available modes in criu:
Docker - After restoring tomcat container, cannot connect to it
Guys sorry for the continuous issues and thanks for all the support..
Docker
Client:
Version: 1.9.0-dev
API version: 1.21
Go version: go1.4.2
Git commit: 59c375a-dirty
Built: Fri Aug 14 17:11:58 UTC 2015
OS/Arch: linux/amd64
Experimental: true
Server:
Version: 1.9.0-dev
API version: 1.21
Go version: go1.4.2
Git commit: 59c375a-dirty
Built: Fri Aug 14 17:11:58 UTC 2015
OS/Arch: linux/amd64
Experimental: true
CRIU
Version: 1.6
GitID: v1.6-163-g231b61d
I run the following sequence
$> docker run -d --name tomcat1 tomcat:8.0
$> docker checkpoint --image-dir ~/Desktop/cr_migrations/tomcat/memory --work-dir ~/Desktop/logs/tomcat tomcat1
$> docker export tomcat1 > ~/Desktop/cr_migrations/tomcat/fs.tar
$> docker import --change "ENV PATH /usr/local/tomcat/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin" --change "ENV LANG C.UTF-8" --change "ENV JAVA_VERSION 7u79" --change "ENV JAVA_DEBIAN_VERSION 7u79-2.5.5-1~deb8u1" --change "ENV CATALINA_HOME /usr/local/tomcat" --change "ENV TOMCAT_MAJOR 8" --change "ENV TOMCAT_VERSION 8.0.24" --change "ENV TOMCAT_TGZ_URL https://www.apache.org/dist/tomcat/tomcat-8/v8.0.24/bin/apache-tomcat-8.0.24.tar.gz" --change "CMD [\"catalina.sh\", \"run\"]" --change "EXPOSE 8080" --change "WORKDIR /usr/local/tomcat" - tomcat:kyriakos < ~/Desktop/cr_migrations/tomcat/fs.tar
$> docker create --name tomcat2 tomcat:kyriakos
$> docker restore --force=true --allow-tcp=true --allow-ext-unix=true --image-dir ~/Desktop/cr_migrations/tomcat/memory --work-dir ~/Desktop/logs/tomcat tomcat2
and I have
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
86bba1f8977d tomcat:kyria "catalina.sh run" About a minute ago Up About a minute 8080/tcp tomcat2
with
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "172.17.0.10",
"IPPrefixLen": 16,
"IPv6Gateway": "",
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null
When I type 172.17.0.10:8080 in my browser, I cannot connect to the restored container.
Thanks
Edit: I also tried to C/R with the default actions
$> docker checkpoint tomcat1
$> docker restore tomcat1
and I had the same results.
In addition, if it helps, when I do docker top tomcat2 I receive
Error response from daemon: [8] System error: open /sys/fs/cgroup/devices/docker/dfae7ff5796cc879232038d6f6ef75114e710aa9e9fc0f6438fa8d4267c32313/cgroup.procs: no such file or directory
Support PPP sockets and devices
Pulled from criu.org/Todo
Issue mounting memory cgroup in Docker
I'm passing along a bug reported to me via email. Let me know if you'd prefer sending this type of thing to the mailing list in the future.
My configuration:
Linux ismael 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt11-1+deb8u3
(2015-08-04) x86_64 GNU/Linux
I am using the last release compiled version of Docker Experimental
v1.9.0 with the compiled version of CRIU v1.6 and libprotobuf:
https://github.com/boucher/docker/releases
I start the daemon:
sudo ./docker-1.9.0-dev daemon
then a container:
docker run -d --publish-service test busybox /bin/sh -c 'i=0; while true; do echo $i; i=$(expr $i + 1); sleep 1; done'
the checkpoint goes well:
sudo ./docker-1.9.0-dev checkpoint --image-dir=/home/ismael/images --work-dir=/home/ismael/logs <container id>
but the restore part fail:
sudo ./docker-1.9.0-dev restore --image-dir=/home/ismael/images --work-dir=/home/ismael/logs <container id>
It output:
Error response from daemon: Cannot restore container 7cbe526dbef8d71c98ea7b365ebc1a12325ddc300216a6697e37831a8f56af44: criu failed: type RESTORE errno 0
dump log: https://gist.github.com/boucher/d6803d75a14606bd95fb
restore log: https://gist.github.com/boucher/ab66916846d27c73d361
Support C/R of frozen cgroup
If I pause a container
docker pause <container_name>
and then try to checkpoint it
docker checkpoint <container_name>
checkpoint stalls...
From another terminal I am trying to unpause
docker unpause <container_name>
and it also stalls.
Having issue to compile criu 1.2 on Ubuntu
Hi Guys,
I tried to install criu on precise and trusty,I went through the installation process of protobuf,protobuf-c and stuck on criu. I am getting this error when I do make && make config && make install:
pie/restorer.c: In function ‘restore_mapping’:
pie/restorer.c:355:21: error: expected ‘)’ before ‘PRIx64’
pr_debug("\tmmap(%"PRIx64" -> %"PRIx64", %x %x %d)\n",
Thanks
Error (sk-inet.c:610): Can't bind inet socket: Cannot assign requested address
(00.206948) 198: Restoring fd 11 (state -> create)
(00.206952) 198: Restore: family 10 type 1 proto 6 port 7676 state 1 src_addr 2001:db8:1::feee:cfa2:163e
(00.206958) 198: Restoring TCP connection
(00.206961) 198: Restoring TCP connection id 18 ino 1b683d
(00.206972) 198: Setting 1 queue seq to 2466973862
(00.206975) 198: Setting 2 queue seq to 1315864320
(00.206999) 198: Error (sk-inet.c:610): Can't bind inet socket: Cannot assign requested address
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
1168: eth0: <BROADCAST,MULTICAST,UP> mtu 1500 qdisc pfifo_fast state UNKNOWN group default qlen 1000
link/ether fe:ee:cf:a2:16:3e brd ff:ff:ff:ff:ff:ff
inet 172.21.1.167/16 scope global eth0
valid_lft forever preferred_lft forever
inet6 2001:db8:1::feee:cfa2:163e/64 scope global tentative
valid_lft forever preferred_lft forever
inet6 fe80::fcee:cfff:fea2:163e/64 scope link tentative
valid_lft forever preferred_lft forever
https://gist.github.com/boucher/7693ed611225ba24f927
Reported-by: @boucher
criu fails to checkpoint container
With Ubuntu 15.04 (Kernel 3.19)
I've tried the checkpoint with runc
(00.123993) 165: 2c:/sys @ ./proc/sys
(00.123996) 238: 20:/user.slice/user-1000.slice/session-c2.scope/runc @ ./sys/fs/cgroup/hugetlb
(00.123999) 237: 1f:/user.slice/user-1000.slice/session-c2.scope/runc @ ./sys/fs/cgroup/memory
(00.124002) 236: 1e:/user.slice/user-1000.slice/session-c2.scope/runc @ ./sys/fs/cgroup/net_cls,net_prio
(00.124005) 235: 1d:/user.slice/user-1000.slice/session-c2.scope/runc @ ./sys/fs/cgroup/cpu,cpuacct
(00.124007) 234: 1c:/user.slice/user-1000.slice/session-c2.scope/runc @ ./sys/fs/cgroup/perf_event
(00.124010) 233: 1b:/user.slice/user-1000.slice/session-c2.scope/runc @ ./sys/fs/cgroup/blkio
(00.124012) 232: 1a:/user.slice/user-1000.slice/session-c2.scope/runc @ ./sys/fs/cgroup/cpuset
(00.124015) 231: 19:/user.slice/user-1000.slice/session-c2.scope/runc @ ./sys/fs/cgroup/freezer
(00.124017) 230: 18:/user.slice/user-1000.slice/session-c2.scope/runc @ ./sys/fs/cgroup/devices
(00.124020) 229: 16:/user.slice/user-1000.slice/session-c2.scope @ ./sys/fs/cgroup/systemd
(00.124022) 228: 32:/ @ ./sys/fs/cgroup
(00.124024) Something is mounted on top of ./sys/fs/cgroup
(00.124085) Error (mount.c:1005): Can't create a temporary directory: Read-only file system
(00.124210) Unlock network
(00.124214) Running network-unlock scripts
(00.124224) RPC
(00.124325) Unfreezing tasks into 1
(00.124330) Unseizing 8159 into 1
(00.124376) Error (cr-dump.c:1947): Dumping FAILED.
Support file leases
Pulled from criu.org/Todo
The F_SETLEASE/F_GETLEASE API is not currently supported, but doesn't differ much from regular locks.
Restoring Docker container with docker_cr.sh failed
I tried to ckeckpoint/restore a container with docker_cr.sh. Checkpoint succeeded but I couldn't make restarting works.
Here is my env.
Ubuntu: 14.04 (vagrant)
CRIU: Compiled from source at xemul@61c1936
Docker: Compiled from source at https://github.com/SaiedKazemi/docker/commit/62ce554ce42e3ad0f5c4c69896685903ecbd1ffc
I could checkpoint/restore a simple bash process with compiled criu, so I believe installation is done properly.
Here is what I did.
# Run a docker container in the example
root@vagrant-ubuntu-trusty:~# export CID=$(docker run -d busybox:latest /bin/sh -c 'i=0; while true; do echo $i >> /foo; i=$(expr $i + 1
); sleep 3; done')
# Make sure it's running
root@vagrant-ubuntu-trusty:~# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
cb8fd3d21034 busybox:latest /bin/sh -c 'i=0; whi 3 seconds ago Up 2 seconds berserk_rosalind
# Checkpoint container succeeds
root@vagrant-ubuntu-trusty:~/criu/contrib# ./docker_cr.sh -c -v $CID
docker binary: docker
dockerinit binary: /var/lib/docker/init/dockerinit-1.0.1
criu binary: criu
image directory: /var/lib/docker/criu_img/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c
container root directory: /var/lib/docker/aufs/mnt/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c
criu dump -v4 -D /var/lib/docker/criu_img/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c -o dump.log --manage-cgroups --evasive-devices --ext-mount-map /etc/resolv.conf:/etc/resolv.conf --ext-mount-map /etc/hosts:/etc/hosts --ext-mount-map /etc/hostname:/etc/hostname --ext-mount-map /.dockerinit:/.dockerinit -t 1426 --root /var/lib/docker/aufs/mnt/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c
dump successful
(00.214765) Dumping finished successfully
# Restoring doesn't succeed, though
root@vagrant-ubuntu-trusty:~/criu/contrib# ./docker_cr.sh -r -v $CID
docker binary: docker
dockerinit binary: /var/lib/docker/init/dockerinit-1.0.1
criu binary: criu
image directory: /var/lib/docker/criu_img/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c
container root directory: /var/lib/docker/aufs/mnt/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c
mount -t aufs -o
/var/lib/docker/aufs/diff/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c
/var/lib/docker/aufs/diff/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c-init
/var/lib/docker/aufs/diff/8c2e06607696bd4afb3d03b687e361cc43cf8ec1a4a725bc96e39f05ba97dd55
/var/lib/docker/aufs/diff/6ce2e90b0bc7224de3db1f0d646fe8e2c4dd37f1793928287f6074bc451a57ea
/var/lib/docker/aufs/diff/cf2616975b4a3cba083ca99bc3f0bf25f5f528c3c52be1596b30f60b0b1c37ff
none
/var/lib/docker/aufs/mnt/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c
criu restore -v4 -D /var/lib/docker/criu_img/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c -o restore.log --manage-cgroups --evasive-devices --ext-mount-map /etc/resolv.conf:/var/lib/docker/containers/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c/resolv.conf --ext-mount-map /etc/hosts:/var/lib/docker/containers/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c/hosts --ext-mount-map /etc/hostname:/var/lib/docker/containers/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c/hostname --ext-mount-map /.dockerinit:/var/lib/docker/init/dockerinit-1.0.1 -d --root /var/lib/docker/aufs/mnt/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c --pidfile /var/lib/docker/criu_img/cb8fd3d210342905c03f762bf8fccff366ef63327bf2429ead916683daa5122c/restore.pid
restore failed
(00.106843) Error (cr-restore.c:1221): 1622 exited, status=1
(00.119208) Error (cr-restore.c:1895): Restoring FAILED.
Any ideas how what's wrong?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.