Trace number 3438351

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)UNSAT 12413.2 1555.84

General information on the benchmark

NameCRAFTED/modcircuits/
mod4block_3vars_7gates.cnf
MD5SUMcc925e6de728ca79f6f89379842f14b0
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2027.29
Satisfiable
(Un)Satisfiability was proved
Number of variables574
Number of clauses118394
Sum of the clauses size692282
Maximum clause length24
Minimum clause length1
Number of clauses of size 1160
Number of clauses of size 21597
Number of clauses of size 30
Number of clauses of size 41923
Number of clauses of size 57170
Number of clauses of size over 5107544

Solver Data 

12412.71/1555.74	
12412.71/1555.74	s UNSATISFIABLE
12412.71/1555.74	c import in main loop

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438351-1306914555/watcher-3438351-1306914555 -o /tmp/evaluation-result-3438351-1306914555/solver-3438351-1306914555 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438351-1306914555.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.84 1.98 1.99 1/507 22440
/proc/meminfo: memFree=4268648/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=23096 CPUtime=0.01 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 1295 0 0 0 1 0 0 0 25 0 1 0 881686324 23650304 904 33554432000 4194304 4625164 140734051494112 18446744073709551615 215988253381 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/22440/statm: 5774 904 296 106 0 1277 0

[startup+0.048265 s]
/proc/loadavg: 1.84 1.98 1.99 1/507 22440
/proc/meminfo: memFree=4268648/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=29644 CPUtime=0.04 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 4943 0 0 0 4 0 0 0 25 0 1 0 881686324 30355456 2477 33554432000 4194304 4625164 140734051494112 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/22440/statm: 7411 2480 296 106 0 2914 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 29644

[startup+0.100256 s]
/proc/loadavg: 1.84 1.98 1.99 1/507 22440
/proc/meminfo: memFree=4268648/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=71688 CPUtime=0.09 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 16255 0 0 0 7 2 0 0 25 0 1 0 881686324 73408512 12447 33554432000 4194304 4625164 140734051494112 18446744073709551615 4298385 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/22440/statm: 17922 12468 317 106 0 13425 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 71688

[startup+0.300226 s]
/proc/loadavg: 1.84 1.98 1.99 1/507 22440
/proc/meminfo: memFree=4268648/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=511776 CPUtime=1.18 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 32891 0 0 0 113 5 0 0 18 0 8 0 881686324 524058624 20204 33554432000 4194304 4625164 140734051494112 18446744073709551615 215988252083 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22440/statm: 127944 20204 349 106 0 123447 0
Current children cumulated CPU time (s) 1.18
Current children cumulated vsize (KiB) 511776

[startup+0.700156 s]
/proc/loadavg: 1.84 1.98 1.99 1/507 22440
/proc/meminfo: memFree=4268648/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=511776 CPUtime=4.38 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 37021 0 0 0 433 5 0 0 18 0 8 0 881686324 524058624 21211 33554432000 4194304 4625164 140734051494112 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22440/statm: 127944 21211 350 106 0 123447 0
Current children cumulated CPU time (s) 4.38
Current children cumulated vsize (KiB) 511776

[startup+1.50102 s]
/proc/loadavg: 1.84 1.98 1.99 10/515 22448
/proc/meminfo: memFree=4181668/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=579840 CPUtime=10.77 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 46769 0 0 0 1069 8 0 0 19 0 8 0 881686324 593756160 23715 33554432000 4194304 4625164 140734051494112 18446744073709551615 4396493 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22440/statm: 144960 23715 353 106 0 140463 0
[pid=22440/tid=22442] ppid=22438 vsize=579840 CPUtime=1.37 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 3327 0 0 0 137 0 0 0 19 0 8 0 881686334 593756160 23715 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=579840 CPUtime=1.24 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 1909 0 0 0 124 0 0 0 25 0 8 0 881686334 593756160 23715 33554432000 4194304 4625164 140734051494112 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=579840 CPUtime=1.34 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 13337 0 0 0 133 1 0 0 25 0 8 0 881686334 593756160 23715 33554432000 4194304 4625164 140734051494112 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=579840 CPUtime=1.35 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 1938 0 0 0 135 0 0 0 19 0 8 0 881686334 593756160 23715 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=579840 CPUtime=1.36 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 2016 0 0 0 136 0 0 0 19 0 8 0 881686334 593756160 23715 33554432000 4194304 4625164 140734051494112 18446744073709551615 4349138 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=579840 CPUtime=1.25 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 1746 0 0 0 125 0 0 0 19 0 8 0 881686334 593756160 23715 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=579840 CPUtime=1.36 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 1962 0 0 0 136 0 0 0 18 0 8 0 881686334 593756160 23715 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351989 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 10.77
Current children cumulated vsize (KiB) 579840

[startup+3.10074 s]
/proc/loadavg: 2.33 2.08 2.02 9/515 22448
/proc/meminfo: memFree=4167904/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=589216 CPUtime=23.55 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 69228 0 0 0 2343 12 0 0 24 0 8 0 881686324 603357184 26965 33554432000 4194304 4625164 140734051494112 18446744073709551615 4509488 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22440/statm: 147304 26965 353 106 0 142807 0
[pid=22440/tid=22442] ppid=22438 vsize=589216 CPUtime=2.96 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 3544 0 0 0 296 0 0 0 24 0 8 0 881686334 603357184 26965 33554432000 4194304 4625164 140734051494112 18446744073709551615 4462504 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=589216 CPUtime=2.84 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 3404 0 0 0 284 0 0 0 25 0 8 0 881686334 603357184 26965 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=589216 CPUtime=2.94 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 27759 0 0 0 291 3 0 0 25 0 8 0 881686334 603357184 26965 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=589216 CPUtime=2.95 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 3495 0 0 0 295 0 0 0 23 0 8 0 881686334 603357184 26965 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=589216 CPUtime=2.96 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 3516 0 0 0 295 1 0 0 23 0 8 0 881686334 603357184 26965 33554432000 4194304 4625164 140734051494112 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=589216 CPUtime=2.85 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 3366 0 0 0 285 0 0 0 23 0 8 0 881686334 603357184 26965 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=589216 CPUtime=2.97 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 3589 0 0 0 296 1 0 0 20 0 8 0 881686334 603357184 26965 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 23.55
Current children cumulated vsize (KiB) 589216

[startup+6.30118 s]
/proc/loadavg: 2.33 2.08 2.02 9/515 22448
/proc/meminfo: memFree=4147412/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=593004 CPUtime=49.08 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 101955 0 0 0 4891 17 0 0 25 0 8 0 881686324 607236096 33215 33554432000 4194304 4625164 140734051494112 18446744073709551615 4512004 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22440/statm: 148251 33215 399 106 0 143754 0
[pid=22440/tid=22442] ppid=22438 vsize=593004 CPUtime=6.17 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 6056 0 0 0 616 1 0 0 25 0 8 0 881686334 607236096 33215 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=593004 CPUtime=6.04 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 3604 0 0 0 604 0 0 0 25 0 8 0 881686334 607236096 33215 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=593004 CPUtime=6.12 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 56172 0 0 0 605 7 0 0 25 0 8 0 881686334 607236096 33215 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=593004 CPUtime=6.15 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 3838 0 0 0 615 0 0 0 25 0 8 0 881686334 607236096 33215 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=593004 CPUtime=6.16 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 3740 0 0 0 615 1 0 0 25 0 8 0 881686334 607236096 33215 33554432000 4194304 4625164 140734051494112 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=593004 CPUtime=6.05 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 3921 0 0 0 605 0 0 0 25 0 8 0 881686334 607236096 33215 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=593004 CPUtime=6.17 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 4018 0 0 0 616 1 0 0 25 0 8 0 881686334 607236096 33215 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352170 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 49.08
Current children cumulated vsize (KiB) 593004

[startup+12.7011 s]
/proc/loadavg: 2.79 2.18 2.05 9/515 22448
/proc/meminfo: memFree=4115268/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=612160 CPUtime=100.16 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 168687 0 0 0 9989 27 0 0 25 0 8 0 881686324 626851840 39237 33554432000 4194304 4625164 140734051494112 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22440/statm: 153040 39237 392 106 0 148543 0
[pid=22440/tid=22442] ppid=22438 vsize=612160 CPUtime=12.57 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 6637 0 0 0 1256 1 0 0 25 0 8 0 881686334 626851840 39237 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=612160 CPUtime=12.44 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 6146 0 0 0 1243 1 0 0 25 0 8 0 881686334 626851840 39237 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=612160 CPUtime=12.53 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 109178 0 0 0 1238 15 0 0 25 0 8 0 881686334 626851840 39237 33554432000 4194304 4625164 140734051494112 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=612160 CPUtime=12.56 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 6465 0 0 0 1255 1 0 0 25 0 8 0 881686334 626851840 39237 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=612160 CPUtime=12.56 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 6301 0 0 0 1255 1 0 0 25 0 8 0 881686334 626851840 39237 33554432000 4194304 4625164 140734051494112 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=612160 CPUtime=12.45 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 6623 0 0 0 1244 1 0 0 25 0 8 0 881686334 626851840 39237 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=612160 CPUtime=12.56 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 6488 0 0 0 1255 1 0 0 25 0 8 0 881686334 626851840 39237 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 100.16
Current children cumulated vsize (KiB) 612160

[startup+25.5008 s]
/proc/loadavg: 4.01 2.48 2.15 9/515 22462
/proc/meminfo: memFree=4072804/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=626664 CPUtime=202.03 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 269176 0 0 0 20157 46 0 0 25 0 8 0 881686324 641703936 49489 33554432000 4194304 4625164 140734051494112 18446744073709551615 4511956 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22440/statm: 156666 49489 415 106 0 152169 0
[pid=22440/tid=22442] ppid=22438 vsize=626664 CPUtime=25.22 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 11663 0 0 0 2520 2 0 0 25 0 8 0 881686334 641703936 49489 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=626664 CPUtime=25.24 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 6597 0 0 0 2523 1 0 0 25 0 8 0 881686334 641703936 49489 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=626664 CPUtime=25.29 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 192374 0 0 0 2499 30 0 0 25 0 8 0 881686334 641703936 49489 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=626664 CPUtime=25.36 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 11535 0 0 0 2534 2 0 0 25 0 8 0 881686334 641703936 49489 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=626664 CPUtime=25.35 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 7007 0 0 0 2534 1 0 0 25 0 8 0 881686334 641703936 49489 33554432000 4194304 4625164 140734051494112 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=626664 CPUtime=25.15 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 10479 0 0 0 2513 2 0 0 25 0 8 0 881686334 641703936 49489 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352760 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=626664 CPUtime=25.35 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 7047 0 0 0 2534 1 0 0 25 0 8 0 881686334 641703936 49489 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 202.03
Current children cumulated vsize (KiB) 626664

[startup+51.1003 s]
/proc/loadavg: 5.37 2.92 2.31 9/515 22463
/proc/meminfo: memFree=4018384/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=663432 CPUtime=406.37 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 462153 0 0 0 40557 80 0 0 25 0 8 0 881686324 679354368 63885 33554432000 4194304 4625164 140734051494112 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22440/statm: 165858 63885 419 106 0 161361 0
[pid=22440/tid=22442] ppid=22438 vsize=663432 CPUtime=50.83 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 17741 0 0 0 5079 4 0 0 25 0 8 0 881686334 679354368 63885 33554432000 4194304 4625164 140734051494112 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=663432 CPUtime=50.84 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 10393 0 0 0 5082 2 0 0 25 0 8 0 881686334 679354368 63885 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=663432 CPUtime=50.88 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 358588 0 0 0 5031 57 0 0 25 0 8 0 881686334 679354368 63885 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=663432 CPUtime=50.96 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 17437 0 0 0 5093 3 0 0 25 0 8 0 881686334 679354368 63885 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=663432 CPUtime=50.95 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 10584 0 0 0 5093 2 0 0 25 0 8 0 881686334 679354368 63885 33554432000 4194304 4625164 140734051494112 18446744073709551615 4348970 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=663432 CPUtime=50.73 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 11463 0 0 0 5070 3 0 0 25 0 8 0 881686334 679354368 63885 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=663432 CPUtime=50.95 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 10675 0 0 0 5092 3 0 0 25 0 8 0 881686334 679354368 63885 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 406.37

################
# More data... #
################

[pid=22440] ppid=22438 vsize=2036600 CPUtime=12306.2 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 6532455 0 0 0 1229613 1011 0 0 25 0 8 0 881686324 2085478400 387574 33554432000 4194304 4625164 140734051494112 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22440/statm: 509150 387574 354 106 0 504653 0
[pid=22440/tid=22442] ppid=22438 vsize=2036600 CPUtime=1540.58 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 117456 0 0 0 154032 26 0 0 25 0 8 0 881686334 2085478400 387574 33554432000 4194304 4625164 140734051494112 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=2036600 CPUtime=1517.85 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 34682 0 0 0 151774 11 0 0 25 0 8 0 881686334 2085478400 387574 33554432000 4194304 4625164 140734051494112 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=2036600 CPUtime=1541.85 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 5907291 0 0 0 153319 866 0 0 25 0 8 0 881686334 2085478400 387574 33554432000 4194304 4625164 140734051494112 18446744073709551615 4579418 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=2036600 CPUtime=1542.11 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 163129 0 0 0 154178 33 0 0 25 0 8 0 881686334 2085478400 387574 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=2036600 CPUtime=1542.11 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 50624 0 0 0 154199 12 0 0 25 0 8 0 881686334 2085478400 387574 33554432000 4194304 4625164 140734051494112 18446744073709551615 4348965 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=2036600 CPUtime=1540.89 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 46280 0 0 0 154071 18 0 0 25 0 8 0 881686334 2085478400 387574 33554432000 4194304 4625164 140734051494112 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=2036600 CPUtime=1541.04 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 30290 0 0 0 154096 8 0 0 25 0 8 0 881686334 2085478400 387574 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12306.2
Current children cumulated vsize (KiB) 2036600

Solver just ended. Dumping a history of the last processes samples

[startup+1548.7 s]
/proc/loadavg: 8.15 8.03 6.89 9/515 22606
/proc/meminfo: memFree=18239900/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=2044800 CPUtime=12357.3 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 6556105 0 0 0 1234719 1015 0 0 25 0 8 0 881686324 2093875200 391617 33554432000 4194304 4625164 140734051494112 18446744073709551615 4390435 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22440/statm: 511200 391617 353 106 0 506703 0
[pid=22440/tid=22442] ppid=22438 vsize=2044800 CPUtime=1546.98 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 117515 0 0 0 154672 26 0 0 25 0 8 0 881686334 2093875200 391619 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=2044800 CPUtime=1524.16 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 34689 0 0 0 152405 11 0 0 25 0 8 0 881686334 2093875200 391619 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=2044800 CPUtime=1548.28 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 5927920 0 0 0 153958 870 0 0 25 0 8 0 881686334 2093875200 391619 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=2044800 CPUtime=1548.46 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 164277 0 0 0 154813 33 0 0 25 0 8 0 881686334 2093875200 391619 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=2044800 CPUtime=1548.53 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 50635 0 0 0 154841 12 0 0 25 0 8 0 881686334 2093875200 391619 33554432000 4194304 4625164 140734051494112 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=2044800 CPUtime=1547.3 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 46280 0 0 0 154712 18 0 0 25 0 8 0 881686334 2093875200 391619 33554432000 4194304 4625164 140734051494112 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=2044800 CPUtime=1547.45 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 30290 0 0 0 154737 8 0 0 25 0 8 0 881686334 2093875200 391619 33554432000 4194304 4625164 140734051494112 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12357.3
Current children cumulated vsize (KiB) 2044800

[startup+1551.9 s]
/proc/loadavg: 8.15 8.03 6.89 9/515 22606
/proc/meminfo: memFree=18237048/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=2116276 CPUtime=12382.8 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 6596197 0 0 0 1237256 1019 0 0 25 0 8 0 881686324 2167066624 396988 33554432000 4194304 4625164 140734051494112 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22440/statm: 529069 396988 353 106 0 524572 0
[pid=22440/tid=22442] ppid=22438 vsize=2116276 CPUtime=1550.16 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 155267 0 0 0 154986 30 0 0 25 0 8 0 881686334 2167066624 396988 33554432000 4194304 4625164 140734051494112 18446744073709551615 4462528 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=2116276 CPUtime=1527.29 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 34706 0 0 0 152718 11 0 0 25 0 8 0 881686334 2167066624 396988 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351798 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=2116276 CPUtime=1551.46 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 5928651 0 0 0 154276 870 0 0 25 0 8 0 881686334 2167066624 396988 33554432000 4194304 4625164 140734051494112 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=2116276 CPUtime=1551.64 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 164907 0 0 0 155131 33 0 0 25 0 8 0 881686334 2167066624 396988 33554432000 4194304 4625164 140734051494112 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=2116276 CPUtime=1551.69 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 50641 0 0 0 155157 12 0 0 25 0 8 0 881686334 2167066624 396988 33554432000 4194304 4625164 140734051494112 18446744073709551615 4349779 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=2116276 CPUtime=1550.48 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 46280 0 0 0 155030 18 0 0 25 0 8 0 881686334 2167066624 396988 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=2116276 CPUtime=1550.63 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 30290 0 0 0 155055 8 0 0 25 0 8 0 881686334 2167066624 396988 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12382.8
Current children cumulated vsize (KiB) 2116276

[startup+1553.5 s]
/proc/loadavg: 8.14 8.03 6.90 9/515 22606
/proc/meminfo: memFree=18218076/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=2116276 CPUtime=12395.2 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 6597466 0 0 0 1238495 1022 0 0 25 0 8 0 881686324 2167066624 397236 33554432000 4194304 4625164 140734051494112 18446744073709551615 4511870 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22440/statm: 529069 397236 354 106 0 524572 0
[pid=22440/tid=22442] ppid=22438 vsize=2116276 CPUtime=1551.64 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 155280 0 0 0 155133 31 0 0 18 0 8 0 881686334 2167066624 397236 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=2116276 CPUtime=1528.82 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 34708 0 0 0 152871 11 0 0 25 0 8 0 881686334 2167066624 397236 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352007 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=2116276 CPUtime=1553.06 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 5929682 0 0 0 154436 870 0 0 25 0 8 0 881686334 2167066624 397236 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=2116276 CPUtime=1553.08 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 164978 0 0 0 155274 34 0 0 25 0 8 0 881686334 2167066624 397236 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=2116276 CPUtime=1553.25 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 50649 0 0 0 155313 12 0 0 19 0 8 0 881686334 2167066624 397236 33554432000 4194304 4625164 140734051494112 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=2116276 CPUtime=1552.08 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 46280 0 0 0 155190 18 0 0 25 0 8 0 881686334 2167066624 397236 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=2116276 CPUtime=1552.23 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 30290 0 0 0 155215 8 0 0 25 0 8 0 881686334 2167066624 397236 33554432000 4194304 4625164 140734051494112 18446744073709551615 4339616 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12395.2
Current children cumulated vsize (KiB) 2116276

[startup+1555.1 s]
/proc/loadavg: 8.14 8.03 6.90 9/515 22606
/proc/meminfo: memFree=18218076/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=2116276 CPUtime=12408 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 6598534 0 0 0 1239773 1022 0 0 25 0 8 0 881686324 2167066624 397720 33554432000 4194304 4625164 140734051494112 18446744073709551615 4512142 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22440/statm: 529069 397720 354 106 0 524572 0
[pid=22440/tid=22442] ppid=22438 vsize=2116276 CPUtime=1553.24 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 155280 0 0 0 155293 31 0 0 20 0 8 0 881686334 2167066624 397720 33554432000 4194304 4625164 140734051494112 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=2116276 CPUtime=1530.42 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 34708 0 0 0 153031 11 0 0 25 0 8 0 881686334 2167066624 397720 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=2116276 CPUtime=1554.66 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 5930232 0 0 0 154596 870 0 0 25 0 8 0 881686334 2167066624 397720 33554432000 4194304 4625164 140734051494112 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=2116276 CPUtime=1554.66 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 164978 0 0 0 155432 34 0 0 25 0 8 0 881686334 2167066624 397720 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=2116276 CPUtime=1554.85 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 50649 0 0 0 155473 12 0 0 22 0 8 0 881686334 2167066624 397720 33554432000 4194304 4625164 140734051494112 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=2116276 CPUtime=1553.68 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 46280 0 0 0 155350 18 0 0 25 0 8 0 881686334 2167066624 397720 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=2116276 CPUtime=1553.83 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 30290 0 0 0 155375 8 0 0 25 0 8 0 881686334 2167066624 397720 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12408
Current children cumulated vsize (KiB) 2116276

[startup+1555.5 s]
/proc/loadavg: 8.14 8.03 6.90 9/515 22606
/proc/meminfo: memFree=18216588/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=2116276 CPUtime=12411.1 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 6598961 0 0 0 1240090 1023 0 0 25 0 8 0 881686324 2167066624 398124 33554432000 4194304 4625164 140734051494112 18446744073709551615 4390435 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22440/statm: 529069 398124 354 106 0 524572 0
[pid=22440/tid=22442] ppid=22438 vsize=2116276 CPUtime=1553.64 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 155280 0 0 0 155333 31 0 0 21 0 8 0 881686334 2167066624 398124 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=2116276 CPUtime=1530.82 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 34708 0 0 0 153071 11 0 0 25 0 8 0 881686334 2167066624 398124 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=2116276 CPUtime=1555.06 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 5930232 0 0 0 154636 870 0 0 25 0 8 0 881686334 2167066624 398124 33554432000 4194304 4625164 140734051494112 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=2116276 CPUtime=1555.04 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 164978 0 0 0 155470 34 0 0 25 0 8 0 881686334 2167066624 398124 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=2116276 CPUtime=1555.25 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 50649 0 0 0 155513 12 0 0 24 0 8 0 881686334 2167066624 398124 33554432000 4194304 4625164 140734051494112 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=2116276 CPUtime=1554.07 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 46280 0 0 0 155389 18 0 0 25 0 8 0 881686334 2167066624 398124 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=2116276 CPUtime=1554.23 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 30291 0 0 0 155415 8 0 0 25 0 8 0 881686334 2167066624 398124 33554432000 4194304 4625164 140734051494112 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12411.1
Current children cumulated vsize (KiB) 2116276

[startup+1555.7 s]
/proc/loadavg: 8.14 8.03 6.90 9/515 22606
/proc/meminfo: memFree=18216588/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=2116276 CPUtime=12412.7 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) R 22438 22440 22379 0 -1 4202496 6599096 0 0 0 1240248 1023 0 0 25 0 8 0 881686324 2167066624 398258 33554432000 4194304 4625164 140734051494112 18446744073709551615 4390435 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22440/statm: 529069 398258 354 106 0 524572 0
[pid=22440/tid=22442] ppid=22438 vsize=2116276 CPUtime=1553.84 cores=0-7
/proc/22440/task/22442/stat : 22442 (SArTagnan) R 22438 22440 22379 0 -1 4202560 155280 0 0 0 155353 31 0 0 22 0 8 0 881686334 2167066624 398258 33554432000 4194304 4625164 140734051494112 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=2116276 CPUtime=1531.02 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4202560 34708 0 0 0 153091 11 0 0 25 0 8 0 881686334 2167066624 398258 33554432000 4194304 4625164 140734051494112 18446744073709551615 4352843 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22440/tid=22444] ppid=22438 vsize=2116276 CPUtime=1555.26 cores=0-7
/proc/22440/task/22444/stat : 22444 (SArTagnan) R 22438 22440 22379 0 -1 4202560 5930232 0 0 0 154656 870 0 0 25 0 8 0 881686334 2167066624 398258 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22440/tid=22445] ppid=22438 vsize=2116276 CPUtime=1555.24 cores=0-7
/proc/22440/task/22445/stat : 22445 (SArTagnan) R 22438 22440 22379 0 -1 4202560 164978 0 0 0 155490 34 0 0 25 0 8 0 881686334 2167066624 398258 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22440/tid=22446] ppid=22438 vsize=2116276 CPUtime=1555.45 cores=0-7
/proc/22440/task/22446/stat : 22446 (SArTagnan) R 22438 22440 22379 0 -1 4202560 50649 0 0 0 155532 13 0 0 25 0 8 0 881686334 2167066624 398258 33554432000 4194304 4625164 140734051494112 18446744073709551615 4330132 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22440/tid=22447] ppid=22438 vsize=2116276 CPUtime=1554.27 cores=0-7
/proc/22440/task/22447/stat : 22447 (SArTagnan) R 22438 22440 22379 0 -1 4202560 46280 0 0 0 155409 18 0 0 25 0 8 0 881686334 2167066624 398258 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22440/tid=22448] ppid=22438 vsize=2116276 CPUtime=1554.43 cores=0-7
/proc/22440/task/22448/stat : 22448 (SArTagnan) R 22438 22440 22379 0 -1 4202560 30293 0 0 0 155435 8 0 0 25 0 8 0 881686334 2167066624 398258 33554432000 4194304 4625164 140734051494112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12412.7
Current children cumulated vsize (KiB) 2116276

[startup+1555.8 s]
/proc/loadavg: 8.14 8.03 6.90 9/515 22606
/proc/meminfo: memFree=18216588/32950940 swapFree=67111364/67111528
[pid=22440] ppid=22438 vsize=0 CPUtime=12413.1 cores=0-7
/proc/22440/stat : 22440 (SArTagnan) Z 22438 22440 22379 0 -1 4203548 6599141 0 0 0 1240286 1028 0 0 25 0 2 0 881686324 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/22440/statm: 0 0 0 0 0 0 0
[pid=22440/tid=22443] ppid=22438 vsize=0 CPUtime=1531.12 cores=0-7
/proc/22440/task/22443/stat : 22443 (SArTagnan) R 22438 22440 22379 0 -1 4203588 34709 0 0 0 153096 16 0 0 25 0 2 0 881686334 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12413.1
Current children cumulated vsize (KiB) 0

Child status: 20
Real time (s): 1555.84
CPU time (s): 12413.2
CPU user time (s): 12402.9
CPU system time (s): 10.3244
CPU usage (%): 797.845
Max. virtual memory (cumulated for all children) (KiB): 2116276

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 12402.9
system time used= 10.3244
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6599141
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10744
involuntary context switches= 60150

runsolver used 7.45487 second user time and 19.5 second system time

The end

Launcher Data 

Begin job on node117 at 2011-06-01 09:49:16
IDJOB=3438351
IDBENCH=71139
IDSOLVER=1936
FILE ID=node117/3438351-1306914555
RUNJOBID= node117-1306914555-22393
PBS_JOBID= 13488510
Free space on /tmp= 58388 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/modcircuits/mod4block_3vars_7gates.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438351-1306914555/watcher-3438351-1306914555 -o /tmp/evaluation-result-3438351-1306914555/solver-3438351-1306914555 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438351-1306914555.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= cc925e6de728ca79f6f89379842f14b0
RANDOM SEED=429631663

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:       4269176 kB
Buffers:        311772 kB
Cached:       17884180 kB
SwapCached:          0 kB
Active:       20937600 kB
Inactive:      7043136 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:       4269176 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            3748 kB
Writeback:           0 kB
AnonPages:     9785636 kB
Mapped:          41360 kB
Slab:           570756 kB
PageTables:      57540 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS: 149468804 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73624 MiB
End job on node117 at 2011-06-01 10:15:11