Trace number 3439646

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.9 5010.73

General information on the benchmark

NameSAT02/handmade/simon/
satex-challenges/f600.shuffled.cnf
MD5SUMd42133fd7674f41611be43d1b8ca7db6
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.021996
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses2550
Sum of the clauses size7650
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32550
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439646-1306965642/watcher-3439646-1306965642 -o /tmp/evaluation-result-3439646-1306965642/solver-3439646-1306965642 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439646-1306965642.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.08 8.10 8.00 1/481 24812
/proc/meminfo: memFree=21851164/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=91584 CPUtime=0.03 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 762 0 0 0 3 0 0 0 25 0 8 0 540755509 93782016 698 33554432000 4194304 4625164 140734557978048 18446744073709551615 47559681750966 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 22896 698 301 106 0 18399 0
[pid=24812/tid=24813] ppid=24810 vsize=91584 CPUtime=0.01 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1 0 0 0 1 0 0 0 25 0 8 0 540755509 93782016 698 33554432000 4194304 4625164 140734557978048 18446744073709551615 47559681750962 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=91584 CPUtime=0 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 540755509 93782016 698 33554432000 4194304 4625164 140734557978048 18446744073709551615 268660718577 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=91584 CPUtime=0 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 540755509 93782016 698 33554432000 4194304 4625164 140734557978048 18446744073709551615 47559681750952 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=91584 CPUtime=0 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 540755509 93782016 698 33554432000 4194304 4625164 140734557978048 18446744073709551615 47559681750966 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=91584 CPUtime=0 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 540755509 93782016 698 33554432000 4194304 4625164 140734557978048 18446744073709551615 47559681750962 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=91584 CPUtime=0.01 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 540755509 93782016 698 33554432000 4194304 4625164 140734557978048 18446744073709551615 47559681750962 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=91584 CPUtime=0 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 540755509 93782016 698 33554432000 4194304 4625164 140734557978048 18446744073709551615 47559681750962 0 0 4096 2 0 0 0 -1 0 0 0 0

[startup+0.678529 s]
/proc/loadavg: 8.08 8.10 8.00 1/481 24812
/proc/meminfo: memFree=21851164/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=431732 CPUtime=7.34 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 14930 0 0 0 732 2 0 0 25 0 8 0 540755509 442093568 7540 33554432000 4194304 4625164 140734557978048 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 107933 7540 351 106 0 103436 0
[pid=24812/tid=24813] ppid=24810 vsize=431732 CPUtime=0.92 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1349 0 0 0 92 0 0 0 25 0 8 0 540755509 442093568 7540 33554432000 4194304 4625164 140734557978048 18446744073709551615 4462399 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=431732 CPUtime=0.89 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1321 0 0 0 89 0 0 0 25 0 8 0 540755509 442093568 7540 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=431732 CPUtime=0.91 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 4890 0 0 0 91 0 0 0 19 0 8 0 540755509 442093568 7540 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351942 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=431732 CPUtime=0.91 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1238 0 0 0 91 0 0 0 25 0 8 0 540755509 442093568 7540 33554432000 4194304 4625164 140734557978048 18446744073709551615 4462506 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=431732 CPUtime=0.92 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1305 0 0 0 92 0 0 0 19 0 8 0 540755509 442093568 7540 33554432000 4194304 4625164 140734557978048 18446744073709551615 4349336 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=431732 CPUtime=0.91 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1759 0 0 0 91 0 0 0 25 0 8 0 540755509 442093568 7540 33554432000 4194304 4625164 140734557978048 18446744073709551615 4462399 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=431732 CPUtime=0.9 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1220 0 0 0 90 0 0 0 19 0 8 0 540755509 442093568 7540 33554432000 4194304 4625164 140734557978048 18446744073709551615 4465117 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 7.34
Current children cumulated vsize (KiB) 431732

[startup+1.03184 s]
/proc/loadavg: 8.08 8.10 8.00 1/481 24812
/proc/meminfo: memFree=21851164/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=432000 CPUtime=8.14 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 15824 0 0 0 812 2 0 0 25 0 8 0 540755509 442368000 7984 33554432000 4194304 4625164 140734557978048 18446744073709551615 4512854 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 108000 7984 351 106 0 103503 0
[pid=24812/tid=24813] ppid=24810 vsize=432000 CPUtime=1.02 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1377 0 0 0 102 0 0 0 25 0 8 0 540755509 442368000 7984 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=432000 CPUtime=0.99 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1355 0 0 0 99 0 0 0 25 0 8 0 540755509 442368000 7984 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=432000 CPUtime=1.01 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 5469 0 0 0 101 0 0 0 19 0 8 0 540755509 442368000 7984 33554432000 4194304 4625164 140734557978048 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=432000 CPUtime=1.01 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1267 0 0 0 101 0 0 0 25 0 8 0 540755509 442368000 7984 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=432000 CPUtime=1.02 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1328 0 0 0 102 0 0 0 19 0 8 0 540755509 442368000 7984 33554432000 4194304 4625164 140734557978048 18446744073709551615 4349087 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=432000 CPUtime=1.01 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1780 0 0 0 101 0 0 0 25 0 8 0 540755509 442368000 7984 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=432000 CPUtime=1 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1241 0 0 0 100 0 0 0 19 0 8 0 540755509 442368000 7984 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351884 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 8.14
Current children cumulated vsize (KiB) 432000

[startup+1.13182 s]
/proc/loadavg: 8.08 8.10 8.00 1/481 24812
/proc/meminfo: memFree=21851164/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=433708 CPUtime=8.93 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 17299 0 0 0 891 2 0 0 25 0 8 0 540755509 444116992 8460 33554432000 4194304 4625164 140734557978048 18446744073709551615 4512125 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 108427 8461 351 106 0 103930 0
[pid=24812/tid=24813] ppid=24810 vsize=433708 CPUtime=1.12 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1392 0 0 0 112 0 0 0 25 0 8 0 540755509 444116992 8461 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=433708 CPUtime=1.08 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1758 0 0 0 108 0 0 0 25 0 8 0 540755509 444116992 8461 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=433708 CPUtime=1.11 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 5983 0 0 0 111 0 0 0 19 0 8 0 540755509 444116992 8461 33554432000 4194304 4625164 140734557978048 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=433708 CPUtime=1.11 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1290 0 0 0 111 0 0 0 25 0 8 0 540755509 444116992 8461 33554432000 4194304 4625164 140734557978048 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=433708 CPUtime=1.12 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1761 0 0 0 112 0 0 0 19 0 8 0 540755509 444116992 8461 33554432000 4194304 4625164 140734557978048 18446744073709551615 4348870 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=433708 CPUtime=1.11 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1824 0 0 0 111 0 0 0 25 0 8 0 540755509 444116992 8461 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=433708 CPUtime=1.1 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1260 0 0 0 110 0 0 0 19 0 8 0 540755509 444116992 8461 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 8.93
Current children cumulated vsize (KiB) 433708

[startup+1.23181 s]
/proc/loadavg: 8.08 8.10 8.00 1/481 24812
/proc/meminfo: memFree=21851164/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=434868 CPUtime=9.74 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 18539 0 0 0 971 3 0 0 25 0 8 0 540755509 445304832 9166 33554432000 4194304 4625164 140734557978048 18446744073709551615 4511933 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 108717 9166 351 106 0 104220 0
[pid=24812/tid=24813] ppid=24810 vsize=434868 CPUtime=1.22 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1804 0 0 0 122 0 0 0 25 0 8 0 540755509 445304832 9166 33554432000 4194304 4625164 140734557978048 18446744073709551615 4291652 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=434868 CPUtime=1.18 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1822 0 0 0 118 0 0 0 25 0 8 0 540755509 445304832 9166 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=434868 CPUtime=1.21 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 6439 0 0 0 121 0 0 0 19 0 8 0 540755509 445304832 9166 33554432000 4194304 4625164 140734557978048 18446744073709551615 4552423 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=434868 CPUtime=1.21 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1313 0 0 0 121 0 0 0 25 0 8 0 540755509 445304832 9166 33554432000 4194304 4625164 140734557978048 18446744073709551615 4353037 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=434868 CPUtime=1.22 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1788 0 0 0 122 0 0 0 19 0 8 0 540755509 445304832 9166 33554432000 4194304 4625164 140734557978048 18446744073709551615 4349109 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=434868 CPUtime=1.21 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1893 0 0 0 121 0 0 0 25 0 8 0 540755509 445304832 9166 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352252 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=434868 CPUtime=1.2 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1297 0 0 0 120 0 0 0 19 0 8 0 540755509 445304832 9166 33554432000 4194304 4625164 140734557978048 18446744073709551615 4487053 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 9.74
Current children cumulated vsize (KiB) 434868

[startup+1.50076 s]
/proc/loadavg: 8.08 8.10 8.00 1/481 24812
/proc/meminfo: memFree=21851164/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=434840 CPUtime=11.89 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 22426 0 0 0 1186 3 0 0 25 0 8 0 540755509 445276160 10403 33554432000 4194304 4625164 140734557978048 18446744073709551615 4338016 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 108710 10403 351 106 0 104213 0
[pid=24812/tid=24813] ppid=24810 vsize=434840 CPUtime=1.49 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1889 0 0 0 149 0 0 0 25 0 8 0 540755509 445276160 10403 33554432000 4194304 4625164 140734557978048 18446744073709551615 4465017 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=434840 CPUtime=1.45 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1880 0 0 0 145 0 0 0 25 0 8 0 540755509 445276160 10403 33554432000 4194304 4625164 140734557978048 18446744073709551615 4339646 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=434840 CPUtime=1.49 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 8439 0 0 0 148 1 0 0 19 0 8 0 540755509 445276160 10403 33554432000 4194304 4625164 140734557978048 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=434840 CPUtime=1.48 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1796 0 0 0 148 0 0 0 25 0 8 0 540755509 445276160 10403 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=434840 CPUtime=1.49 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1868 0 0 0 149 0 0 0 19 0 8 0 540755509 445276160 10403 33554432000 4194304 4625164 140734557978048 18446744073709551615 4349084 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=434840 CPUtime=1.48 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 2574 0 0 0 148 0 0 0 25 0 8 0 540755509 445276160 10403 33554432000 4194304 4625164 140734557978048 18446744073709551615 268676645915 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=434840 CPUtime=1.46 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 1744 0 0 0 146 0 0 0 20 0 8 0 540755509 445276160 10403 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.89
Current children cumulated vsize (KiB) 434840

[startup+3.11848 s]
/proc/loadavg: 8.08 8.10 8.00 9/489 24820
/proc/meminfo: memFree=21781548/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=453676 CPUtime=24.79 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 38776 0 0 0 2473 6 0 0 25 0 8 0 540755509 464564224 17528 33554432000 4194304 4625164 140734557978048 18446744073709551615 4512042 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 113419 17528 366 106 0 108922 0
[pid=24812/tid=24813] ppid=24810 vsize=453676 CPUtime=3.1 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 4056 0 0 0 310 0 0 0 25 0 8 0 540755509 464564224 17528 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=453676 CPUtime=3.07 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 2973 0 0 0 307 0 0 0 25 0 8 0 540755509 464564224 17528 33554432000 4194304 4625164 140734557978048 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=453676 CPUtime=3.1 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 16239 0 0 0 308 2 0 0 25 0 8 0 540755509 464564224 17528 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=453676 CPUtime=3.1 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 2883 0 0 0 310 0 0 0 25 0 8 0 540755509 464564224 17528 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=453676 CPUtime=3.1 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 2929 0 0 0 310 0 0 0 25 0 8 0 540755509 464564224 17528 33554432000 4194304 4625164 140734557978048 18446744073709551615 4348879 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=453676 CPUtime=3.11 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 3970 0 0 0 310 1 0 0 25 0 8 0 540755509 464564224 17528 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=453676 CPUtime=3.04 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 2747 0 0 0 304 0 0 0 25 0 8 0 540755509 464564224 17528 33554432000 4194304 4625164 140734557978048 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.79
Current children cumulated vsize (KiB) 453676

[startup+6.30092 s]
/proc/loadavg: 8.08 8.10 8.00 9/489 24821
/proc/meminfo: memFree=21742612/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=463904 CPUtime=50.3 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 68963 0 0 0 5019 11 0 0 25 0 8 0 540755509 475037696 27299 33554432000 4194304 4625164 140734557978048 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 115976 27299 351 106 0 111479 0
[pid=24812/tid=24813] ppid=24810 vsize=463904 CPUtime=6.3 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 4558 0 0 0 630 0 0 0 25 0 8 0 540755509 475037696 27415 33554432000 4194304 4625164 140734557978048 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=463904 CPUtime=6.27 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 4499 0 0 0 627 0 0 0 25 0 8 0 540755509 475037696 27415 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=463904 CPUtime=6.3 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 32955 0 0 0 625 5 0 0 25 0 8 0 540755509 475037696 27415 33554432000 4194304 4625164 140734557978048 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=463904 CPUtime=6.3 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 4649 0 0 0 629 1 0 0 25 0 8 0 540755509 475037696 27415 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352404 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=463904 CPUtime=6.3 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 6065 0 0 0 630 0 0 0 25 0 8 0 540755509 475037696 27415 33554432000 4194304 4625164 140734557978048 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=463904 CPUtime=6.3 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 8239 0 0 0 629 1 0 0 25 0 8 0 540755509 475037696 27415 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=463904 CPUtime=6.19 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 4334 0 0 0 619 0 0 0 25 0 8 0 540755509 475037696 27415 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0

################
# More data... #
################

[pid=24812/tid=24815] ppid=24810 vsize=5201708 CPUtime=4662.36 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 18789153 0 0 0 463526 2710 0 0 25 0 8 0 540755509 5326548992 1023331 33554432000 4194304 4625164 140734557978048 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=5201708 CPUtime=4662.35 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 197382 0 0 0 466183 52 0 0 25 0 8 0 540755509 5326548992 1023331 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=5201708 CPUtime=4661.66 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 257086 0 0 0 466100 66 0 0 25 0 8 0 540755509 5326548992 1023331 33554432000 4194304 4625164 140734557978048 18446744073709551615 4339536 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=5201708 CPUtime=4662.39 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 484899 0 0 0 466149 90 0 0 25 0 8 0 540755509 5326548992 1023331 33554432000 4194304 4625164 140734557978048 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=5201708 CPUtime=4586 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 191903 0 0 0 458545 55 0 0 25 0 8 0 540755509 5326548992 1023331 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37220.6
Current children cumulated vsize (KiB) 5201708

[startup+4722.3 s]
/proc/loadavg: 8.13 8.10 8.02 9/489 24967
/proc/meminfo: memFree=17720132/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=5207388 CPUtime=37699.6 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 20915755 0 0 0 3766777 3186 0 0 25 0 8 0 540755509 5332365312 1034138 33554432000 4194304 4625164 140734557978048 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 1301847 1034138 409 106 0 1297350 0
[pid=24812/tid=24813] ppid=24810 vsize=5207388 CPUtime=4721.05 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 268974 0 0 0 472045 60 0 0 25 0 8 0 540755509 5332365312 1034138 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=5207388 CPUtime=4722.36 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 194549 0 0 0 472182 54 0 0 25 0 8 0 540755509 5332365312 1034138 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=5207388 CPUtime=4722.36 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 19050020 0 0 0 469490 2746 0 0 25 0 8 0 540755509 5332365312 1034138 33554432000 4194304 4625164 140734557978048 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=5207388 CPUtime=4722.36 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 197578 0 0 0 472183 53 0 0 25 0 8 0 540755509 5332365312 1034138 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=5207388 CPUtime=4721.67 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 257263 0 0 0 472100 67 0 0 25 0 8 0 540755509 5332365312 1034138 33554432000 4194304 4625164 140734557978048 18446744073709551615 4348821 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=5207388 CPUtime=4722.39 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 487992 0 0 0 472148 91 0 0 25 0 8 0 540755509 5332365312 1034138 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=5207388 CPUtime=4645.01 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 193362 0 0 0 464445 56 0 0 25 0 8 0 540755509 5332365312 1034138 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37699.6
Current children cumulated vsize (KiB) 5207388

[startup+4782.3 s]
/proc/loadavg: 8.12 8.09 8.02 9/489 24969
/proc/meminfo: memFree=17645544/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=5315812 CPUtime=38178.6 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 21277462 0 0 0 3814630 3235 0 0 25 0 8 0 540755509 5443391488 1052010 33554432000 4194304 4625164 140734557978048 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 1328953 1052010 548 106 0 1324456 0
[pid=24812/tid=24813] ppid=24810 vsize=5315812 CPUtime=4781.04 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 269499 0 0 0 478044 60 0 0 25 0 8 0 540755509 5443391488 1052010 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=5315812 CPUtime=4782.36 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 254706 0 0 0 478174 62 0 0 25 0 8 0 540755509 5443391488 1052010 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=5315812 CPUtime=4782.36 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 19344662 0 0 0 475452 2784 0 0 25 0 8 0 540755509 5443391488 1052010 33554432000 4194304 4625164 140734557978048 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=5315812 CPUtime=4782.36 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 197664 0 0 0 478183 53 0 0 25 0 8 0 540755509 5443391488 1052010 33554432000 4194304 4625164 140734557978048 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=5315812 CPUtime=4781.67 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 257356 0 0 0 478100 67 0 0 25 0 8 0 540755509 5443391488 1052010 33554432000 4194304 4625164 140734557978048 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=5315812 CPUtime=4782.39 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 491112 0 0 0 478147 92 0 0 25 0 8 0 540755509 5443391488 1052010 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=5315812 CPUtime=4704.04 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 193796 0 0 0 470347 57 0 0 25 0 8 0 540755509 5443391488 1052010 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38178.7
Current children cumulated vsize (KiB) 5315812

[startup+4842.3 s]
/proc/loadavg: 8.11 8.09 8.02 9/489 24970
/proc/meminfo: memFree=17615976/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=5381348 CPUtime=38657.7 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 21574652 0 0 0 3862492 3274 0 0 25 0 8 0 540755509 5510500352 1054728 33554432000 4194304 4625164 140734557978048 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 1345337 1054728 427 106 0 1340840 0
[pid=24812/tid=24813] ppid=24810 vsize=5381348 CPUtime=4841.03 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 269578 0 0 0 484043 60 0 0 25 0 8 0 540755509 5510500352 1054728 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=5381348 CPUtime=4842.36 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 254861 0 0 0 484174 62 0 0 25 0 8 0 540755509 5510500352 1054728 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351769 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=5381348 CPUtime=4842.36 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 19640672 0 0 0 481414 2822 0 0 25 0 8 0 540755509 5510500352 1054728 33554432000 4194304 4625164 140734557978048 18446744073709551615 4547221 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=5381348 CPUtime=4842.36 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 197837 0 0 0 484183 53 0 0 25 0 8 0 540755509 5510500352 1054728 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=5381348 CPUtime=4841.67 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 257474 0 0 0 484100 67 0 0 25 0 8 0 540755509 5510500352 1054728 33554432000 4194304 4625164 140734557978048 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=5381348 CPUtime=4842.39 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 491188 0 0 0 484147 92 0 0 25 0 8 0 540755509 5510500352 1054729 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=5381348 CPUtime=4763.05 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 194027 0 0 0 476248 57 0 0 25 0 8 0 540755509 5510500352 1054729 33554432000 4194304 4625164 140734557978048 18446744073709551615 4352007 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38657.7
Current children cumulated vsize (KiB) 5381348

[startup+4902.3 s]
/proc/loadavg: 8.10 8.09 8.02 9/489 24972
/proc/meminfo: memFree=17596708/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=5381348 CPUtime=39136.7 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 21880843 0 0 0 3910344 3323 0 0 25 0 8 0 540755509 5510500352 1062808 33554432000 4194304 4625164 140734557978048 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 1345337 1062808 384 106 0 1340840 0
[pid=24812/tid=24813] ppid=24810 vsize=5381348 CPUtime=4901 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 269674 0 0 0 490040 60 0 0 25 0 8 0 540755509 5510500352 1062808 33554432000 4194304 4625164 140734557978048 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=5381348 CPUtime=4902.36 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 255172 0 0 0 490174 62 0 0 25 0 8 0 540755509 5510500352 1062808 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=5381348 CPUtime=4902.36 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 19939547 0 0 0 487369 2867 0 0 25 0 8 0 540755509 5510500352 1062808 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=5381348 CPUtime=4902.36 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 200411 0 0 0 490182 54 0 0 25 0 8 0 540755509 5510500352 1062808 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=5381348 CPUtime=4901.67 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 257803 0 0 0 490100 67 0 0 25 0 8 0 540755509 5510500352 1062808 33554432000 4194304 4625164 140734557978048 18446744073709551615 4349325 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=5381348 CPUtime=4902.39 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 493310 0 0 0 490146 93 0 0 25 0 8 0 540755509 5510500352 1062808 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=5381348 CPUtime=4822.07 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 194466 0 0 0 482150 57 0 0 25 0 8 0 540755509 5510500352 1062808 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39136.7
Current children cumulated vsize (KiB) 5381348

[startup+4962.3 s]
/proc/loadavg: 8.09 8.08 8.02 9/489 24974
/proc/meminfo: memFree=17560944/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=5381348 CPUtime=39615.7 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 22138129 0 0 0 3958203 3366 0 0 25 0 8 0 540755509 5510500352 1071321 33554432000 4194304 4625164 140734557978048 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 1345337 1071321 468 106 0 1340840 0
[pid=24812/tid=24813] ppid=24810 vsize=5381348 CPUtime=4960.99 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 269695 0 0 0 496039 60 0 0 25 0 8 0 540755509 5510500352 1071321 33554432000 4194304 4625164 140734557978048 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=5381348 CPUtime=4962.36 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 255318 0 0 0 496174 62 0 0 25 0 8 0 540755509 5510500352 1071321 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=5381348 CPUtime=4962.36 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 20192293 0 0 0 493328 2908 0 0 25 0 8 0 540755509 5510500352 1071321 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=5381348 CPUtime=4962.36 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 201697 0 0 0 496182 54 0 0 25 0 8 0 540755509 5510500352 1071321 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=5381348 CPUtime=4961.67 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 258168 0 0 0 496099 68 0 0 25 0 8 0 540755509 5510500352 1071321 33554432000 4194304 4625164 140734557978048 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=5381348 CPUtime=4962.4 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 494258 0 0 0 496146 94 0 0 25 0 8 0 540755509 5510500352 1071321 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=5381348 CPUtime=4881.09 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 195025 0 0 0 488051 58 0 0 25 0 8 0 540755509 5510500352 1071321 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39615.7
Current children cumulated vsize (KiB) 5381348



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.5 s]
/proc/loadavg: 8.11 8.09 8.02 9/489 24975
/proc/meminfo: memFree=17546640/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=5392168 CPUtime=40000.6 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) R 24810 24812 24603 0 -1 4202496 22209881 0 0 0 3996679 3378 0 0 25 0 8 0 540755509 5521580032 1074146 33554432000 4194304 4625164 140734557978048 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 1348042 1074146 397 106 0 1343545 0
[pid=24812/tid=24813] ppid=24810 vsize=5392168 CPUtime=5009.2 cores=0-7
/proc/24812/task/24813/stat : 24813 (SArTagnan) R 24810 24812 24603 0 -1 4202560 269707 0 0 0 500860 60 0 0 25 0 8 0 540755509 5521580032 1074146 33554432000 4194304 4625164 140734557978048 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=24812/tid=24814] ppid=24810 vsize=5392168 CPUtime=5010.58 cores=0-7
/proc/24812/task/24814/stat : 24814 (SArTagnan) R 24810 24812 24603 0 -1 4202560 255389 0 0 0 500996 62 0 0 25 0 8 0 540755509 5521580032 1074146 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=24812/tid=24815] ppid=24810 vsize=5392168 CPUtime=5010.59 cores=0-7
/proc/24812/task/24815/stat : 24815 (SArTagnan) R 24810 24812 24603 0 -1 4202560 20259552 0 0 0 498140 2919 0 0 25 0 8 0 540755509 5521580032 1074146 33554432000 4194304 4625164 140734557978048 18446744073709551615 268660359627 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=24812/tid=24816] ppid=24810 vsize=5392168 CPUtime=5010.59 cores=0-7
/proc/24812/task/24816/stat : 24816 (SArTagnan) R 24810 24812 24603 0 -1 4202560 202088 0 0 0 501004 55 0 0 25 0 8 0 540755509 5521580032 1074146 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=24812/tid=24817] ppid=24810 vsize=5392168 CPUtime=5009.89 cores=0-7
/proc/24812/task/24817/stat : 24817 (SArTagnan) R 24810 24812 24603 0 -1 4202560 258438 0 0 0 500921 68 0 0 25 0 8 0 540755509 5521580032 1074146 33554432000 4194304 4625164 140734557978048 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=24812/tid=24818] ppid=24810 vsize=5392168 CPUtime=5010.62 cores=0-7
/proc/24812/task/24818/stat : 24818 (SArTagnan) R 24810 24812 24603 0 -1 4202560 494826 0 0 0 500968 94 0 0 25 0 8 0 540755509 5521580032 1074146 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=5392168 CPUtime=4928.49 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4202560 195469 0 0 0 492791 58 0 0 25 0 8 0 540755509 5521580032 1074146 33554432000 4194304 4625164 140734557978048 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 5392168

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.7 s]
/proc/loadavg: 8.11 8.09 8.02 9/489 24975
/proc/meminfo: memFree=17546640/32951124 swapFree=46575304/67111528
[pid=24812] ppid=24810 vsize=0 CPUtime=40000.8 cores=0-7
/proc/24812/stat : 24812 (SArTagnan) Z 24810 24812 24603 0 -1 4203548 22209881 0 0 0 3996688 3396 0 0 25 0 2 0 540755509 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/24812/statm: 0 0 0 0 0 0 0
[pid=24812/tid=24819] ppid=24810 vsize=0 CPUtime=4928.68 cores=0-7
/proc/24812/task/24819/stat : 24819 (SArTagnan) R 24810 24812 24603 0 -1 4203588 195469 0 0 0 492792 76 0 0 25 0 2 0 540755509 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.73
CPU time (s): 40000.9
CPU user time (s): 39966.9
CPU system time (s): 33.9908
CPU usage (%): 798.304
Max. virtual memory (cumulated for all children) (KiB): 5522592

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39966.9
system time used= 33.9908
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22209881
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 513
involuntary context switches= 165220

runsolver used 22.6226 second user time and 59.378 second system time

The end

Launcher Data 

Begin job on node107 at 2011-06-02 00:00:42
IDJOB=3439646
IDBENCH=87732
IDSOLVER=1936
FILE ID=node107/3439646-1306965642
RUNJOBID= node107-1306960629-24617
PBS_JOBID= 13497646
Free space on /tmp= 73824 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT02/handmade/simon/satex-challenges/f600.shuffled.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439646-1306965642/watcher-3439646-1306965642 -o /tmp/evaluation-result-3439646-1306965642/solver-3439646-1306965642 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439646-1306965642.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= d42133fd7674f41611be43d1b8ca7db6
RANDOM SEED=538612366

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21851320 kB
Buffers:        249512 kB
Cached:        1805880 kB
SwapCached:      22420 kB
Active:        8970136 kB
Inactive:      1785996 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21851320 kB
SwapTotal:    67111528 kB
SwapFree:     46575304 kB
Dirty:             396 kB
Writeback:           0 kB
AnonPages:     8696412 kB
Mapped:          32292 kB
Slab:           176736 kB
PageTables:      94816 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 145073816 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73824 MiB
End job on node107 at 2011-06-02 01:24:15