Trace number 3438361

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40001.1 5011.33

General information on the benchmark

NameCRAFTED/modcircuits/
mod3block_2vars_11gates_u2_autoenc.cnf
MD5SUM36c3169a5cad0483dd15befcefc4323e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1540.75
Satisfiable
(Un)Satisfiability was proved
Number of variables526
Number of clauses146535
Sum of the clauses size858954
Maximum clause length14
Minimum clause length1
Number of clauses of size 164
Number of clauses of size 22476
Number of clauses of size 34
Number of clauses of size 41387
Number of clauses of size 57328
Number of clauses of size over 5135276

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438361-1306915516/watcher-3438361-1306915516 -o /tmp/evaluation-result-3438361-1306915516/solver-3438361-1306915516 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438361-1306915516.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 6.14 3.56 1/470 9570
/proc/meminfo: memFree=8803124/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=24140 CPUtime=0 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 1132 0 0 0 0 0 0 0 24 0 1 0 783966899 24719360 821 33554432000 4194304 4625164 140734456406576 18446744073709551615 254261313744 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/9570/statm: 6035 834 296 106 0 1538 0

[startup+0.111921 s]
/proc/loadavg: 8.12 6.14 3.56 1/470 9570
/proc/meminfo: memFree=8803124/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=48100 CPUtime=0.1 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 12252 0 0 0 10 0 0 0 24 0 1 0 783966899 49254400 6360 33554432000 4194304 4625164 140734456406576 18446744073709551615 4298385 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/9570/statm: 12025 6387 315 106 0 7528 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 48100

[startup+0.200907 s]
/proc/loadavg: 8.12 6.14 3.56 1/470 9570
/proc/meminfo: memFree=8803124/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=449452 CPUtime=0.4 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) D 9568 9570 9477 0 -1 4202496 29288 0 0 0 37 3 0 0 18 0 8 0 783966899 460238848 22513 33554432000 4194304 4625164 140734456406576 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/9570/statm: 112363 22523 399 106 0 107866 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 449452

[startup+0.306696 s]
/proc/loadavg: 8.12 6.14 3.56 1/470 9570
/proc/meminfo: memFree=8803124/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=535832 CPUtime=0.99 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 39384 0 0 0 95 4 0 0 18 0 8 0 783966899 548691968 30240 33554432000 4194304 4625164 140734456406576 18446744073709551615 4518211 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/9570/statm: 133958 30240 504 106 0 129461 0
Current children cumulated CPU time (s) 0.99
Current children cumulated vsize (KiB) 535832

[startup+1.43465 s]
/proc/loadavg: 8.12 6.14 3.56 1/470 9570
/proc/meminfo: memFree=8803124/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=554656 CPUtime=8.86 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 66324 0 0 0 877 9 0 0 19 0 8 0 783966899 567967744 37834 33554432000 4194304 4625164 140734456406576 18446744073709551615 4329131 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 138664 37834 529 106 0 134167 0
Current children cumulated CPU time (s) 8.86
Current children cumulated vsize (KiB) 554656

[startup+1.50064 s]
/proc/loadavg: 8.12 6.14 3.56 1/470 9570
/proc/meminfo: memFree=8803124/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=554656 CPUtime=9.39 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 67370 0 0 0 930 9 0 0 19 0 8 0 783966899 567967744 38168 33554432000 4194304 4625164 140734456406576 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 138664 38170 529 106 0 134167 0
Current children cumulated CPU time (s) 9.39
Current children cumulated vsize (KiB) 554656

[startup+3.10036 s]
/proc/loadavg: 8.11 6.17 3.58 9/478 9578
/proc/meminfo: memFree=8631328/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=688856 CPUtime=22.14 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 93454 0 0 0 2200 14 0 0 22 0 8 0 783966899 705388544 43677 33554432000 4194304 4625164 140734456406576 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 172214 43677 544 106 0 167717 0
[pid=9570/tid=9572] ppid=9568 vsize=688856 CPUtime=2.88 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 4757 0 0 0 287 1 0 0 22 0 8 0 783966912 705388544 43677 33554432000 4194304 4625164 140734456406576 18446744073709551615 254261277729 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=688856 CPUtime=2.77 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 4748 0 0 0 276 1 0 0 22 0 8 0 783966912 705388544 43677 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=688856 CPUtime=2.69 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 38378 0 0 0 264 5 0 0 22 0 8 0 783966912 705388544 43677 33554432000 4194304 4625164 140734456406576 18446744073709551615 4552348 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=9570/tid=9575] ppid=9568 vsize=688856 CPUtime=2.61 cores=0-7
/proc/9570/task/9575/stat : 9575 (SArTagnan) R 9568 9570 9477 0 -1 4202560 5398 0 0 0 260 1 0 0 22 0 8 0 783966912 705388544 43677 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=688856 CPUtime=2.73 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4202560 4547 0 0 0 272 1 0 0 22 0 8 0 783966912 705388544 43677 33554432000 4194304 4625164 140734456406576 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=9570/tid=9577] ppid=9568 vsize=688856 CPUtime=2.62 cores=0-7
/proc/9570/task/9577/stat : 9577 (SArTagnan) R 9568 9570 9477 0 -1 4202560 4242 0 0 0 262 0 0 0 18 0 8 0 783966912 705388544 43677 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9570/tid=9578] ppid=9568 vsize=688856 CPUtime=2.81 cores=0-7
/proc/9570/task/9578/stat : 9578 (SArTagnan) R 9568 9570 9477 0 -1 4202560 4799 0 0 0 281 0 0 0 22 0 8 0 783966912 705388544 43677 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 22.14
Current children cumulated vsize (KiB) 688856

[startup+6.31879 s]
/proc/loadavg: 8.11 6.17 3.58 9/478 9578
/proc/meminfo: memFree=8595508/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=712548 CPUtime=47.84 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 148607 0 0 0 4759 25 0 0 25 0 8 0 783966899 729649152 51853 33554432000 4194304 4625164 140734456406576 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 178137 51853 544 106 0 173640 0
[pid=9570/tid=9572] ppid=9568 vsize=712548 CPUtime=6.09 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 8352 0 0 0 607 2 0 0 25 0 8 0 783966912 729649152 51853 33554432000 4194304 4625164 140734456406576 18446744073709551615 4462650 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=712548 CPUtime=5.99 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 5756 0 0 0 598 1 0 0 25 0 8 0 783966912 729649152 51853 33554432000 4194304 4625164 140734456406576 18446744073709551615 4467677 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=712548 CPUtime=5.91 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 74853 0 0 0 580 11 0 0 25 0 8 0 783966912 729649152 51853 33554432000 4194304 4625164 140734456406576 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=9570/tid=9575] ppid=9568 vsize=712548 CPUtime=5.83 cores=0-7
/proc/9570/task/9575/stat : 9575 (SArTagnan) R 9568 9570 9477 0 -1 4202560 9422 0 0 0 581 2 0 0 25 0 8 0 783966912 729649152 51853 33554432000 4194304 4625164 140734456406576 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=712548 CPUtime=5.94 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4202560 7893 0 0 0 593 1 0 0 25 0 8 0 783966912 729649152 51853 33554432000 4194304 4625164 140734456406576 18446744073709551615 4349054 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=9570/tid=9577] ppid=9568 vsize=712548 CPUtime=5.79 cores=0-7
/proc/9570/task/9577/stat : 9577 (SArTagnan) R 9568 9570 9477 0 -1 4202560 7527 0 0 0 578 1 0 0 25 0 8 0 783966912 729649152 51853 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9570/tid=9578] ppid=9568 vsize=712548 CPUtime=6.03 cores=0-7
/proc/9570/task/9578/stat : 9578 (SArTagnan) R 9568 9570 9477 0 -1 4202560 8153 0 0 0 602 1 0 0 25 0 8 0 783966912 729649152 51853 33554432000 4194304 4625164 140734456406576 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 47.84
Current children cumulated vsize (KiB) 712548

[startup+12.7007 s]
/proc/loadavg: 8.10 6.23 3.63 9/478 9579
/proc/meminfo: memFree=8560276/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=731468 CPUtime=98.79 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 204891 0 0 0 9842 37 0 0 25 0 8 0 783966899 749023232 63407 33554432000 4194304 4625164 140734456406576 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 182867 63407 544 106 0 178370 0
[pid=9570/tid=9572] ppid=9568 vsize=731468 CPUtime=12.48 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 14268 0 0 0 1245 3 0 0 25 0 8 0 783966912 749023232 63407 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=731468 CPUtime=12.37 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 9391 0 0 0 1235 2 0 0 25 0 8 0 783966912 749023232 63407 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=731468 CPUtime=12.29 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 111276 0 0 0 1213 16 0 0 25 0 8 0 783966912 749023232 63407 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=9570/tid=9575] ppid=9568 vsize=731468 CPUtime=12.21 cores=0-7
/proc/9570/task/9575/stat : 9575 (SArTagnan) R 9568 9570 9477 0 -1 4202560 16105 0 0 0 1216 5 0 0 25 0 8 0 783966912 749023232 63407 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=731468 CPUtime=12.33 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4202560 9190 0 0 0 1230 3 0 0 25 0 8 0 783966912 749023232 63407 33554432000 4194304 4625164 140734456406576 18446744073709551615 4436872 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=9570/tid=9577] ppid=9568 vsize=731468 CPUtime=12.08 cores=0-7
/proc/9570/task/9577/stat : 9577 (SArTagnan) R 9568 9570 9477 0 -1 4202560 8440 0 0 0 1207 1 0 0 25 0 8 0 783966912 749023232 63407 33554432000 4194304 4625164 140734456406576 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9570/tid=9578] ppid=9568 vsize=731468 CPUtime=12.42 cores=0-7
/proc/9570/task/9578/stat : 9578 (SArTagnan) R 9568 9570 9477 0 -1 4202560 9410 0 0 0 1240 2 0 0 25 0 8 0 783966912 749023232 63407 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 98.79
Current children cumulated vsize (KiB) 731468

[startup+25.5004 s]
/proc/loadavg: 8.08 6.28 3.68 9/478 9579
/proc/meminfo: memFree=8479328/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=756416 CPUtime=200.99 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 320846 0 0 0 20038 61 0 0 25 0 8 0 783966899 774569984 81968 33554432000 4194304 4625164 140734456406576 18446744073709551615 4512180 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 189104 81968 536 106 0 184607 0
[pid=9570/tid=9572] ppid=9568 vsize=756416 CPUtime=25.28 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 17703 0 0 0 2523 5 0 0 25 0 8 0 783966912 774569984 81968 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=756416 CPUtime=25.18 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 11523 0 0 0 2514 4 0 0 25 0 8 0 783966912 774569984 81968 33554432000 4194304 4625164 140734456406576 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=756416 CPUtime=25.08 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 199593 0 0 0 2478 30 0 0 25 0 8 0 783966912 774569984 81968 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=9570/tid=9575] ppid=9568 vsize=756416 CPUtime=25.02 cores=0-7
/proc/9570/task/9575/stat : 9575 (SArTagnan) R 9568 9570 9477 0 -1 4202560 25919 0 0 0 2495 7 0 0 25 0 8 0 783966912 774569984 81968 33554432000 4194304 4625164 140734456406576 18446744073709551615 4352731 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=756416 CPUtime=25.13 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4202560 10866 0 0 0 2509 4 0 0 25 0 8 0 783966912 774569984 81968 33554432000 4194304 4625164 140734456406576 18446744073709551615 4349075 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=9570/tid=9577] ppid=9568 vsize=756416 CPUtime=24.68 cores=0-7
/proc/9570/task/9577/stat : 9577 (SArTagnan) R 9568 9570 9477 0 -1 4202560 13081 0 0 0 2465 3 0 0 25 0 8 0 783966912 774569984 81968 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9570/tid=9578] ppid=9568 vsize=756416 CPUtime=25.21 cores=0-7
/proc/9570/task/9578/stat : 9578 (SArTagnan) R 9568 9570 9477 0 -1 4202560 15034 0 0 0 2518 3 0 0 25 0 8 0 783966912 774569984 81968 33554432000 4194304 4625164 140734456406576 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 200.99
Current children cumulated vsize (KiB) 756416

[startup+51.1009 s]
/proc/loadavg: 8.13 6.44 3.80 9/478 9580
/proc/meminfo: memFree=8189464/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=1016996 CPUtime=405.32 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 623540 0 0 0 40423 109 0 0 25 0 8 0 783966899 1041403904 154113 33554432000 4194304 4625164 140734456406576 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 254249 154113 603 106 0 249752 0
[pid=9570/tid=9572] ppid=9568 vsize=1016996 CPUtime=50.87 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 44112 0 0 0 5076 11 0 0 25 0 8 0 783966912 1041403904 154113 33554432000 4194304 4625164 140734456406576 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=1016996 CPUtime=50.77 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 17138 0 0 0 5072 5 0 0 25 0 8 0 783966912 1041403904 154113 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=1016996 CPUtime=50.68 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 340612 0 0 0 5018 50 0 0 25 0 8 0 783966912 1041403904 154113 33554432000 4194304 4625164 140734456406576 18446744073709551615 4552296 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=9570/tid=9575] ppid=9568 vsize=1016996 CPUtime=50.6 cores=0-7
/proc/9570/task/9575/stat : 9575 (SArTagnan) R 9568 9570 9477 0 -1 4202560 61247 0 0 0 5049 11 0 0 25 0 8 0 783966912 1041403904 154113 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=1016996 CPUtime=50.72 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4202560 55810 0 0 0 5060 12 0 0 25 0 8 0 783966912 1041403904 154113 33554432000 4194304 4625164 140734456406576 18446744073709551615 4348821 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=9570/tid=9577] ppid=9568 vsize=1016996 CPUtime=49.87 cores=0-7
/proc/9570/task/9577/stat : 9577 (SArTagnan) R 9568 9570 9477 0 -1 4202560 52780 0 0 0 4978 9 0 0 25 0 8 0 783966912 1041403904 154113 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9570/tid=9578] ppid=9568 vsize=1016996 CPUtime=50.8 cores=0-7
/proc/9570/task/9578/stat : 9578 (SArTagnan) R 9568 9570 9477 0 -1 4202560 18692 0 0 0 5075 5 0 0 25 0 8 0 783966912 1041403904 154113 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 405.32
Current children cumulated vsize (KiB) 1016996

[startup+102.301 s]
/proc/loadavg: 8.12 6.71 4.04 9/478 9581
/proc/meminfo: memFree=7995496/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=1203580 CPUtime=814.1 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 1027682 0 0 0 81222 188 0 0 25 0 8 0 783966899 1232465920 202586 33554432000 4194304 4625164 140734456406576 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 300895 202586 405 106 0 296398 0
[pid=9570/tid=9572] ppid=9568 vsize=1203580 CPUtime=102.07 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 61666 0 0 0 10191 16 0 0 25 0 8 0 783966912 1232465920 202586 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=1203580 CPUtime=101.96 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 27788 0 0 0 10188 8 0 0 25 0 8 0 783966912 1232465920 202586 33554432000 4194304 4625164 140734456406576 18446744073709551615 4339564 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=1203580 CPUtime=101.88 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 640098 0 0 0 10088 100 0 0 25 0 8 0 783966912 1232465920 202586 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0

################
# More data... #
################

Current children cumulated vsize (KiB) 4295724

[startup+4722.3 s]
/proc/loadavg: 8.07 8.06 8.00 9/478 9784
/proc/meminfo: memFree=18731872/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=4295724 CPUtime=37695.9 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 27595802 0 0 0 3764460 5129 0 0 25 0 8 0 783966899 4398821376 893613 33554432000 4194304 4625164 140734456406576 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 1073931 893613 368 106 0 1069434 0
[pid=9570/tid=9572] ppid=9568 vsize=4295724 CPUtime=4722.01 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 172210 0 0 0 472140 61 0 0 25 0 8 0 783966912 4398821376 893613 33554432000 4194304 4625164 140734456406576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=4295724 CPUtime=4721.28 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 118086 0 0 0 472041 87 0 0 25 0 8 0 783966912 4398821376 893613 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=4295724 CPUtime=4721.93 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 25772674 0 0 0 467674 4519 0 0 25 0 8 0 783966912 4398821376 893613 33554432000 4194304 4625164 140734456406576 18446744073709551615 4352047 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=9570/tid=9575] ppid=9568 vsize=4295724 CPUtime=4721.61 cores=0-7
/proc/9570/task/9575/stat : 9575 (SArTagnan) R 9568 9570 9477 0 -1 4202560 219546 0 0 0 472102 59 0 0 25 0 8 0 783966912 4398821376 893613 33554432000 4194304 4625164 140734456406576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=4295724 CPUtime=4658.64 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4202560 233151 0 0 0 465780 84 0 0 25 0 8 0 783966912 4398821376 893613 33554432000 4194304 4625164 140734456406576 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9570/tid=9577] ppid=9568 vsize=4295724 CPUtime=4708.47 cores=0-7
/proc/9570/task/9577/stat : 9577 (SArTagnan) R 9568 9570 9477 0 -1 4202560 459145 0 0 0 470703 144 0 0 25 0 8 0 783966912 4398821376 893613 33554432000 4194304 4625164 140734456406576 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9578] ppid=9568 vsize=4295724 CPUtime=4719.67 cores=0-7
/proc/9570/task/9578/stat : 9578 (SArTagnan) R 9568 9570 9477 0 -1 4202560 99523 0 0 0 471907 60 0 0 25 0 8 0 783966912 4398821376 893613 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37695.9
Current children cumulated vsize (KiB) 4295724

[startup+4782.3 s]
/proc/loadavg: 8.11 8.07 8.01 9/478 9786
/proc/meminfo: memFree=18721688/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=4295724 CPUtime=38174.9 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 27983032 0 0 0 3812298 5194 0 0 25 0 8 0 783966899 4398821376 896212 33554432000 4194304 4625164 140734456406576 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 1073931 896212 377 106 0 1069434 0
[pid=9570/tid=9572] ppid=9568 vsize=4295724 CPUtime=4782.01 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 172588 0 0 0 478140 61 0 0 25 0 8 0 783966912 4398821376 896212 33554432000 4194304 4625164 140734456406576 18446744073709551615 4330855 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=4295724 CPUtime=4781.28 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 118209 0 0 0 478041 87 0 0 25 0 8 0 783966912 4398821376 896212 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=4295724 CPUtime=4781.93 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 26136409 0 0 0 473616 4577 0 0 25 0 8 0 783966912 4398821376 896212 33554432000 4194304 4625164 140734456406576 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=9570/tid=9575] ppid=9568 vsize=4295724 CPUtime=4781.6 cores=0-7
/proc/9570/task/9575/stat : 9575 (SArTagnan) R 9568 9570 9477 0 -1 4202560 219594 0 0 0 478101 59 0 0 25 0 8 0 783966912 4398821376 896212 33554432000 4194304 4625164 140734456406576 18446744073709551615 4330810 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=4295724 CPUtime=4717.67 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4202560 233282 0 0 0 471683 84 0 0 25 0 8 0 783966912 4398821376 896212 33554432000 4194304 4625164 140734456406576 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9570/tid=9577] ppid=9568 vsize=4295724 CPUtime=4768.47 cores=0-7
/proc/9570/task/9577/stat : 9577 (SArTagnan) R 9568 9570 9477 0 -1 4202560 459194 0 0 0 476703 144 0 0 25 0 8 0 783966912 4398821376 896212 33554432000 4194304 4625164 140734456406576 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9578] ppid=9568 vsize=4295724 CPUtime=4779.66 cores=0-7
/proc/9570/task/9578/stat : 9578 (SArTagnan) R 9568 9570 9477 0 -1 4202560 99634 0 0 0 477906 60 0 0 25 0 8 0 783966912 4398821376 896212 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38174.9
Current children cumulated vsize (KiB) 4295724

[startup+4842.3 s]
/proc/loadavg: 8.32 8.15 8.03 9/478 9790
/proc/meminfo: memFree=18712656/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=4295724 CPUtime=38653.1 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 28342409 0 0 0 3860047 5261 0 0 25 0 8 0 783966899 4398821376 898700 33554432000 4194304 4625164 140734456406576 18446744073709551615 4512747 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 1073931 898700 379 106 0 1069434 0
[pid=9570/tid=9572] ppid=9568 vsize=4295724 CPUtime=4842.01 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 172808 0 0 0 484140 61 0 0 25 0 8 0 783966912 4398821376 898700 33554432000 4194304 4625164 140734456406576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=4295724 CPUtime=4841.28 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 118262 0 0 0 484041 87 0 0 25 0 8 0 783966912 4398821376 898700 33554432000 4194304 4625164 140734456406576 18446744073709551615 4352831 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=4295724 CPUtime=4841.93 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 26469160 0 0 0 479556 4637 0 0 25 0 8 0 783966912 4398821376 898700 33554432000 4194304 4625164 140734456406576 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=9570/tid=9575] ppid=9568 vsize=4295724 CPUtime=4841.6 cores=0-7
/proc/9570/task/9575/stat : 9575 (SArTagnan) R 9568 9570 9477 0 -1 4202560 219643 0 0 0 484101 59 0 0 25 0 8 0 783966912 4398821376 898700 33554432000 4194304 4625164 140734456406576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=4295724 CPUtime=4776.68 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4202560 233664 0 0 0 477584 84 0 0 25 0 8 0 783966912 4398821376 898700 33554432000 4194304 4625164 140734456406576 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9570/tid=9577] ppid=9568 vsize=4295724 CPUtime=4828.48 cores=0-7
/proc/9570/task/9577/stat : 9577 (SArTagnan) R 9568 9570 9477 0 -1 4202560 459243 0 0 0 482703 145 0 0 25 0 8 0 783966912 4398821376 898700 33554432000 4194304 4625164 140734456406576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9578] ppid=9568 vsize=4295724 CPUtime=4838.81 cores=0-7
/proc/9570/task/9578/stat : 9578 (SArTagnan) R 9568 9570 9477 0 -1 4202560 99695 0 0 0 483821 60 0 0 25 0 8 0 783966912 4398821376 898700 33554432000 4194304 4625164 140734456406576 18446744073709551615 4465169 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38653.1
Current children cumulated vsize (KiB) 4295724

[startup+4902.3 s]
/proc/loadavg: 8.16 8.13 8.03 9/478 9792
/proc/meminfo: memFree=18670472/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=4369072 CPUtime=39132.2 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 28726345 0 0 0 3907886 5332 0 0 25 0 8 0 783966899 4473929728 909028 33554432000 4194304 4625164 140734456406576 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 1092268 909028 353 106 0 1087771 0
[pid=9570/tid=9572] ppid=9568 vsize=4369072 CPUtime=4902.03 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 172854 0 0 0 490142 61 0 0 25 0 8 0 783966912 4473929728 909044 33554432000 4194304 4625164 140734456406576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=4369072 CPUtime=4901.31 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 137825 0 0 0 490041 90 0 0 25 0 8 0 783966912 4473929728 909044 33554432000 4194304 4625164 140734456406576 18446744073709551615 4291814 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=4369072 CPUtime=4901.95 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 26802354 0 0 0 485495 4700 0 0 25 0 8 0 783966912 4473929728 909044 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=9570/tid=9575] ppid=9568 vsize=4369072 CPUtime=4901.62 cores=0-7
/proc/9570/task/9575/stat : 9575 (SArTagnan) R 9568 9570 9477 0 -1 4202560 219975 0 0 0 490103 59 0 0 25 0 8 0 783966912 4473929728 909044 33554432000 4194304 4625164 140734456406576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=4369072 CPUtime=4835.72 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4202560 233743 0 0 0 483488 84 0 0 25 0 8 0 783966912 4473929728 909044 33554432000 4194304 4625164 140734456406576 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9570/tid=9577] ppid=9568 vsize=4369072 CPUtime=4888.5 cores=0-7
/proc/9570/task/9577/stat : 9577 (SArTagnan) R 9568 9570 9477 0 -1 4202560 459291 0 0 0 488705 145 0 0 25 0 8 0 783966912 4473929728 909044 33554432000 4194304 4625164 140734456406576 18446744073709551615 4330814 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9578] ppid=9568 vsize=4369072 CPUtime=4898.8 cores=0-7
/proc/9570/task/9578/stat : 9578 (SArTagnan) R 9568 9570 9477 0 -1 4202560 99782 0 0 0 489820 60 0 0 25 0 8 0 783966912 4473929728 909044 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39132.2
Current children cumulated vsize (KiB) 4369072

[startup+4962.3 s]
/proc/loadavg: 8.09 8.12 8.03 9/478 9794
/proc/meminfo: memFree=18656580/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=4434608 CPUtime=39611.1 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 29111910 0 0 0 3955706 5406 0 0 25 0 8 0 783966899 4541038592 911946 33554432000 4194304 4625164 140734456406576 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 1108652 911946 364 106 0 1104155 0
[pid=9570/tid=9572] ppid=9568 vsize=4434608 CPUtime=4962.02 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 172906 0 0 0 496140 62 0 0 25 0 8 0 783966912 4541038592 911946 33554432000 4194304 4625164 140734456406576 18446744073709551615 4488056 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=4434608 CPUtime=4961.28 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 138253 0 0 0 496038 90 0 0 25 0 8 0 783966912 4541038592 911946 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=4434608 CPUtime=4961.93 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 27164308 0 0 0 491426 4767 0 0 25 0 8 0 783966912 4541038592 911946 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=9570/tid=9575] ppid=9568 vsize=4434608 CPUtime=4961.61 cores=0-7
/proc/9570/task/9575/stat : 9575 (SArTagnan) R 9568 9570 9477 0 -1 4202560 220024 0 0 0 496101 60 0 0 25 0 8 0 783966912 4541038592 911946 33554432000 4194304 4625164 140734456406576 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=4434608 CPUtime=4894.73 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4202560 234272 0 0 0 489389 84 0 0 25 0 8 0 783966912 4541038592 911946 33554432000 4194304 4625164 140734456406576 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9570/tid=9577] ppid=9568 vsize=4434608 CPUtime=4948.48 cores=0-7
/proc/9570/task/9577/stat : 9577 (SArTagnan) R 9568 9570 9477 0 -1 4202560 459334 0 0 0 494703 145 0 0 25 0 8 0 783966912 4541038592 911946 33554432000 4194304 4625164 140734456406576 18446744073709551615 4330791 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9578] ppid=9568 vsize=4434608 CPUtime=4958.77 cores=0-7
/proc/9570/task/9578/stat : 9578 (SArTagnan) R 9568 9570 9477 0 -1 4202560 99846 0 0 0 495817 60 0 0 25 0 8 0 783966912 4541038592 911946 33554432000 4194304 4625164 140734456406576 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39611.1
Current children cumulated vsize (KiB) 4434608



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.1 s]
/proc/loadavg: 8.08 8.11 8.03 9/478 9795
/proc/meminfo: memFree=18652344/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=4434608 CPUtime=40000.8 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) R 9568 9570 9477 0 -1 4202496 29421034 0 0 0 3994621 5460 0 0 25 0 8 0 783966899 4541038592 913668 33554432000 4194304 4625164 140734456406576 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 1108652 913668 377 106 0 1104155 0
[pid=9570/tid=9572] ppid=9568 vsize=4434608 CPUtime=5010.84 cores=0-7
/proc/9570/task/9572/stat : 9572 (SArTagnan) R 9568 9570 9477 0 -1 4202560 172957 0 0 0 501022 62 0 0 25 0 8 0 783966912 4541038592 913669 33554432000 4194304 4625164 140734456406576 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=9570/tid=9573] ppid=9568 vsize=4434608 CPUtime=5010.11 cores=0-7
/proc/9570/task/9573/stat : 9573 (SArTagnan) R 9568 9570 9477 0 -1 4202560 138312 0 0 0 500920 91 0 0 25 0 8 0 783966912 4541038592 913669 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=9570/tid=9574] ppid=9568 vsize=4434608 CPUtime=5010.75 cores=0-7
/proc/9570/task/9574/stat : 9574 (SArTagnan) R 9568 9570 9477 0 -1 4202560 27454076 0 0 0 496258 4817 0 0 25 0 8 0 783966912 4541038592 913669 33554432000 4194304 4625164 140734456406576 18446744073709551615 4351967 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=9570/tid=9575] ppid=9568 vsize=4434608 CPUtime=5010.42 cores=0-7
/proc/9570/task/9575/stat : 9575 (SArTagnan) R 9568 9570 9477 0 -1 4202560 220063 0 0 0 500982 60 0 0 25 0 8 0 783966912 4541038592 913669 33554432000 4194304 4625164 140734456406576 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=4434608 CPUtime=4942.74 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4202560 234363 0 0 0 494190 84 0 0 25 0 8 0 783966912 4541038592 913669 33554432000 4194304 4625164 140734456406576 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=9570/tid=9577] ppid=9568 vsize=4434608 CPUtime=4997.3 cores=0-7
/proc/9570/task/9577/stat : 9577 (SArTagnan) R 9568 9570 9477 0 -1 4202560 459376 0 0 0 499585 145 0 0 25 0 8 0 783966912 4541038592 913669 33554432000 4194304 4625164 140734456406576 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=9570/tid=9578] ppid=9568 vsize=4434608 CPUtime=5007.58 cores=0-7
/proc/9570/task/9578/stat : 9578 (SArTagnan) R 9568 9570 9477 0 -1 4202560 99937 0 0 0 500698 60 0 0 25 0 8 0 783966912 4541038592 913669 33554432000 4194304 4625164 140734456406576 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 4434608

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.22 s]
/proc/loadavg: 8.08 8.11 8.03 2/473 9796
/proc/meminfo: memFree=20435968/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=0 CPUtime=40001 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) Z 9568 9570 9477 0 -1 4203548 29421035 0 0 0 3994630 5471 0 0 25 0 2 0 783966899 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 0 0 0 0 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=0 CPUtime=4942.86 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4203588 234363 0 0 0 494191 95 0 0 25 0 2 0 783966912 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40001
Current children cumulated vsize (KiB) 0

[startup+5011.32 s]
/proc/loadavg: 8.08 8.11 8.03 2/473 9796
/proc/meminfo: memFree=20435968/32951124 swapFree=67057928/67111528
[pid=9570] ppid=9568 vsize=0 CPUtime=40001.1 cores=0-7
/proc/9570/stat : 9570 (SArTagnan) Z 9568 9570 9477 0 -1 4203548 29421035 0 0 0 3994630 5479 0 0 25 0 2 0 783966899 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/9570/statm: 0 0 0 0 0 0 0
[pid=9570/tid=9576] ppid=9568 vsize=0 CPUtime=4942.94 cores=0-7
/proc/9570/task/9576/stat : 9576 (SArTagnan) R 9568 9570 9477 0 -1 4203588 234363 0 0 0 494191 103 0 0 25 0 2 0 783966912 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40001.1
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.33
CPU time (s): 40001.1
CPU user time (s): 39946.3
CPU system time (s): 54.8097
CPU usage (%): 798.213
Max. virtual memory (cumulated for all children) (KiB): 4434608

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39946.3
system time used= 54.8097
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29421035
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12048
involuntary context switches= 180346

runsolver used 21.6897 second user time and 58.4421 second system time

The end

Launcher Data 

Begin job on node140 at 2011-06-01 10:05:16
IDJOB=3438361
IDBENCH=71153
IDSOLVER=1936
FILE ID=node140/3438361-1306915516
RUNJOBID= node140-1306915128-9491
PBS_JOBID= 13488511
Free space on /tmp= 57764 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/modcircuits/mod3block_2vars_11gates_u2_autoenc.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438361-1306915516/watcher-3438361-1306915516 -o /tmp/evaluation-result-3438361-1306915516/solver-3438361-1306915516 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438361-1306915516.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 36c3169a5cad0483dd15befcefc4323e
RANDOM SEED=1917865879

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       8803528 kB
Buffers:        233136 kB
Cached:       16347504 kB
SwapCached:       6932 kB
Active:       12191092 kB
Inactive:     11303880 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       8803528 kB
SwapTotal:    67111528 kB
SwapFree:     67057928 kB
Dirty:            4700 kB
Writeback:           0 kB
AnonPages:     6912816 kB
Mapped:          37612 kB
Slab:           530324 kB
PageTables:      52792 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 141378148 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73776 MiB
End job on node140 at 2011-06-01 11:28:49