Trace number 3439311

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (exit code) 32938.6 4133.36

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_22_70_7-dir.shuffled-as.sat03-154.cnf
MD5SUMaa9ee2fa26214e80fac6d004d5d0b003
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark17173
Satisfiable
(Un)Satisfiability was proved
Number of variables660
Number of clauses56654
Sum of the clauses size113924
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 256632
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 522

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439311-1306960629/watcher-3439311-1306960629 -o /tmp/evaluation-result-3439311-1306960629/solver-3439311-1306960629 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439311-1306960629.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/508 27644
/proc/meminfo: memFree=20057232/32950928 swapFree=61513528/67111528
[pid=27644] ppid=27642 vsize=89460 CPUtime=0.01 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 2343 0 0 0 1 0 0 0 24 0 7 0 886293581 91607040 1867 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415448049 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/27644/statm: 22365 1867 301 106 0 17868 0
[pid=27644/tid=27645] ppid=27642 vsize=99704 CPUtime=0 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 8 0 886293583 102096896 1868 33554432000 4194304 4625164 140735158227792 18446744073709551615 47991726401458 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27646] ppid=27642 vsize=99704 CPUtime=0 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886293583 102096896 1868 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415448049 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27647] ppid=27642 vsize=99704 CPUtime=0 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886293583 102096896 1868 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415448049 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27648] ppid=27642 vsize=99704 CPUtime=0 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886293583 102096896 1868 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415448049 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=99704 CPUtime=0 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886293583 102096896 1868 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415448049 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27650] ppid=27642 vsize=99704 CPUtime=0 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 8 0 886293583 102096896 1868 33554432000 4194304 4625164 140735158227792 18446744073709551615 47991726401458 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=27644/tid=27651] ppid=27642 vsize=99704 CPUtime=0 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 886293583 102096896 1868 33554432000 4194304 4625164 140735158227792 18446744073709551615 47991726401448 0 0 4096 2 0 0 0 -1 3 0 0 0

[startup+0.0657001 s]
/proc/loadavg: 0.00 0.00 0.00 2/508 27644
/proc/meminfo: memFree=20057232/32950928 swapFree=61513528/67111528
[pid=27644] ppid=27642 vsize=362040 CPUtime=0.29 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 2607 0 0 0 29 0 0 0 25 0 8 0 886293581 370728960 2124 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415052833 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/27644/statm: 90510 2124 340 106 0 86013 0
[pid=27644/tid=27645] ppid=27642 vsize=362040 CPUtime=0.04 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 2 0 0 0 4 0 0 0 25 0 8 0 886293583 370728960 2124 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415047600 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27646] ppid=27642 vsize=362040 CPUtime=0 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 25 0 0 0 0 0 0 0 18 0 8 0 886293583 370728960 2124 33554432000 4194304 4625164 140735158227792 18446744073709551615 4464234 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27647] ppid=27642 vsize=362040 CPUtime=0 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) S 27642 27644 27618 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 8 0 886293583 370728960 2124 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415496686 0 0 4096 2 18446604449734310592 0 0 -1 7 0 0 0
[pid=27644/tid=27648] ppid=27642 vsize=362040 CPUtime=0.03 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) D 27642 27644 27618 0 -1 4202560 23 0 0 0 3 0 0 0 25 0 8 0 886293583 370728960 2124 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415434935 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=362040 CPUtime=0.04 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) D 27642 27644 27618 0 -1 4202560 25 0 0 0 4 0 0 0 25 0 8 0 886293583 370728960 2124 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415052485 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27650] ppid=27642 vsize=362040 CPUtime=0.04 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) D 27642 27644 27618 0 -1 4202560 35 0 0 0 4 0 0 0 18 0 8 0 886293583 370728960 2124 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415434935 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=27644/tid=27651] ppid=27642 vsize=362040 CPUtime=0.04 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 12 0 0 0 4 0 0 0 25 0 8 0 886293583 370728960 2124 33554432000 4194304 4625164 140735158227792 18446744073709551615 4352170 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 362040

[startup+0.110019 s]
/proc/loadavg: 0.00 0.00 0.00 2/508 27644
/proc/meminfo: memFree=20057232/32950928 swapFree=61513528/67111528
[pid=27644] ppid=27642 vsize=451064 CPUtime=6.66 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 27388 0 0 0 662 4 0 0 18 0 8 0 886293581 461889536 20336 33554432000 4194304 4625164 140735158227792 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/27644/statm: 112766 20336 388 106 0 108269 0
[pid=27644/tid=27645] ppid=27642 vsize=451064 CPUtime=0.8 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 1758 0 0 0 80 0 0 0 25 0 8 0 886293583 461889536 20336 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27644/tid=27646] ppid=27642 vsize=451064 CPUtime=0.8 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 2304 0 0 0 80 0 0 0 18 0 8 0 886293583 461889536 20336 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27647] ppid=27642 vsize=451064 CPUtime=0.8 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 3309 0 0 0 80 0 0 0 19 0 8 0 886293583 461889536 20337 33554432000 4194304 4625164 140735158227792 18446744073709551615 4469201 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=27644/tid=27648] ppid=27642 vsize=451064 CPUtime=0.83 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 2024 0 0 0 83 0 0 0 25 0 8 0 886293583 461889536 20337 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=451064 CPUtime=0.84 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 2232 0 0 0 84 0 0 0 18 0 8 0 886293583 461889536 20337 33554432000 4194304 4625164 140735158227792 18446744073709551615 4349336 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27650] ppid=27642 vsize=451064 CPUtime=0.84 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 2274 0 0 0 84 0 0 0 19 0 8 0 886293583 461889536 20338 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=27644/tid=27651] ppid=27642 vsize=451064 CPUtime=0.84 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 1735 0 0 0 84 0 0 0 18 0 8 0 886293583 461889536 20338 33554432000 4194304 4625164 140735158227792 18446744073709551615 4352183 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 6.66
Current children cumulated vsize (KiB) 451064

[startup+0.971107 s]
/proc/loadavg: 0.00 0.00 0.00 2/508 27644
/proc/meminfo: memFree=20057232/32950928 swapFree=61513528/67111528
[pid=27644] ppid=27642 vsize=451064 CPUtime=7.46 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 28311 0 0 0 741 5 0 0 19 0 8 0 886293581 461889536 21095 33554432000 4194304 4625164 140735158227792 18446744073709551615 4512017 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/27644/statm: 112766 21119 379 106 0 108269 0
[pid=27644/tid=27645] ppid=27642 vsize=451064 CPUtime=0.89 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 1968 0 0 0 89 0 0 0 25 0 8 0 886293583 461889536 21129 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415089099 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27644/tid=27646] ppid=27642 vsize=451064 CPUtime=0.89 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 2326 0 0 0 89 0 0 0 19 0 8 0 886293583 461889536 21142 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27647] ppid=27642 vsize=451064 CPUtime=0.9 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 3558 0 0 0 90 0 0 0 19 0 8 0 886293583 461889536 21155 33554432000 4194304 4625164 140735158227792 18446744073709551615 4547614 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=27644/tid=27648] ppid=27642 vsize=451064 CPUtime=0.93 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 2051 0 0 0 93 0 0 0 25 0 8 0 886293583 461889536 21166 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=451064 CPUtime=0.94 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 2280 0 0 0 94 0 0 0 19 0 8 0 886293583 461889536 21179 33554432000 4194304 4625164 140735158227792 18446744073709551615 4435498 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27650] ppid=27642 vsize=451064 CPUtime=0.94 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 2478 0 0 0 94 0 0 0 19 0 8 0 886293583 461889536 21190 33554432000 4194304 4625164 140735158227792 18446744073709551615 4339546 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=27644/tid=27651] ppid=27642 vsize=451064 CPUtime=0.94 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 1767 0 0 0 94 0 0 0 18 0 8 0 886293583 461889536 21202 33554432000 4194304 4625164 140735158227792 18446744073709551615 4462668 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 7.46
Current children cumulated vsize (KiB) 451064

[startup+1.15118 s]
/proc/loadavg: 0.00 0.00 0.00 2/508 27644
/proc/meminfo: memFree=20057232/32950928 swapFree=61513528/67111528
[pid=27644] ppid=27642 vsize=472184 CPUtime=9.09 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 36282 0 0 0 903 6 0 0 19 0 8 0 886293581 483516416 25904 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415434887 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/27644/statm: 118046 25904 619 106 0 113549 0
[pid=27644/tid=27645] ppid=27642 vsize=472184 CPUtime=1.1 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 2654 0 0 0 110 0 0 0 18 0 8 0 886293583 483516416 25904 33554432000 4194304 4625164 140735158227792 18446744073709551615 4469375 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27644/tid=27646] ppid=27642 vsize=472184 CPUtime=1.1 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 3099 0 0 0 110 0 0 0 19 0 8 0 886293583 483516416 25392 33554432000 4194304 4625164 140735158227792 18446744073709551615 4352102 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27647] ppid=27642 vsize=472184 CPUtime=1.1 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) D 27642 27644 27618 0 -1 4202560 4586 0 0 0 110 0 0 0 18 0 8 0 886293583 483516416 25392 33554432000 4194304 4625164 140735158227792 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=27644/tid=27648] ppid=27642 vsize=472184 CPUtime=1.13 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) D 27642 27644 27618 0 -1 4202560 3072 0 0 0 113 0 0 0 25 0 8 0 886293583 483516416 25334 33554432000 4194304 4625164 140735158227792 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=472184 CPUtime=1.14 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 3075 0 0 0 114 0 0 0 18 0 8 0 886293583 483516416 25334 33554432000 4194304 4625164 140735158227792 18446744073709551615 4319050 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27650] ppid=27642 vsize=472184 CPUtime=1.14 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) D 27642 27644 27618 0 -1 4202560 2643 0 0 0 114 0 0 0 19 0 8 0 886293583 483516416 24880 33554432000 4194304 4625164 140735158227792 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=27644/tid=27651] ppid=27642 vsize=472184 CPUtime=1.14 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) D 27642 27644 27618 0 -1 4202560 1788 0 0 0 114 0 0 0 19 0 8 0 886293583 483516416 24880 33554432000 4194304 4625164 140735158227792 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 9.09
Current children cumulated vsize (KiB) 472184

[startup+1.84856 s]
/proc/loadavg: 0.00 0.00 0.00 2/508 27644
/proc/meminfo: memFree=20057232/32950928 swapFree=61513528/67111528
[pid=27644] ppid=27642 vsize=468304 CPUtime=14.67 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 48672 0 0 0 1458 9 0 0 20 0 8 0 886293581 479543296 31853 33554432000 4194304 4625164 140735158227792 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/27644/statm: 117076 31858 415 106 0 112579 0
[pid=27644/tid=27645] ppid=27642 vsize=468304 CPUtime=1.79 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 3044 0 0 0 179 0 0 0 19 0 8 0 886293583 479543296 31858 33554432000 4194304 4625164 140735158227792 18446744073709551615 4339874 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27644/tid=27646] ppid=27642 vsize=468304 CPUtime=1.79 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 3436 0 0 0 179 0 0 0 20 0 8 0 886293583 479543296 31858 33554432000 4194304 4625164 140735158227792 18446744073709551615 4317256 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27647] ppid=27642 vsize=468304 CPUtime=1.8 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 9664 0 0 0 178 2 0 0 19 0 8 0 886293583 479543296 31858 33554432000 4194304 4625164 140735158227792 18446744073709551615 4334949 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=27644/tid=27648] ppid=27642 vsize=468304 CPUtime=1.83 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 3499 0 0 0 183 0 0 0 25 0 8 0 886293583 479543296 31858 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=468304 CPUtime=1.83 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 5014 0 0 0 183 0 0 0 19 0 8 0 886293583 479543296 31858 33554432000 4194304 4625164 140735158227792 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27650] ppid=27642 vsize=468304 CPUtime=1.84 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 3934 0 0 0 184 0 0 0 20 0 8 0 886293583 479543296 31858 33554432000 4194304 4625164 140735158227792 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=27644/tid=27651] ppid=27642 vsize=468304 CPUtime=1.84 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 2700 0 0 0 184 0 0 0 20 0 8 0 886293583 479543296 31858 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 14.67
Current children cumulated vsize (KiB) 468304

[startup+3.10081 s]
/proc/loadavg: 0.72 0.15 0.05 9/516 27652
/proc/meminfo: memFree=19906028/32950928 swapFree=61513528/67111528
[pid=27644] ppid=27642 vsize=479836 CPUtime=24.48 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 71575 0 0 0 2435 13 0 0 25 0 8 0 886293581 491352064 47166 33554432000 4194304 4625164 140735158227792 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/27644/statm: 119959 47166 581 106 0 115462 0
[pid=27644/tid=27645] ppid=27642 vsize=479836 CPUtime=3.03 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 5109 0 0 0 302 1 0 0 21 0 8 0 886293583 491352064 47166 33554432000 4194304 4625164 140735158227792 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27644/tid=27646] ppid=27642 vsize=479836 CPUtime=3.02 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 4839 0 0 0 302 0 0 0 18 0 8 0 886293583 491352064 47166 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27647] ppid=27642 vsize=479836 CPUtime=3.01 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 14730 0 0 0 299 2 0 0 21 0 8 0 886293583 491352064 47166 33554432000 4194304 4625164 140735158227792 18446744073709551615 4579376 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=27644/tid=27648] ppid=27642 vsize=479836 CPUtime=3.06 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 3697 0 0 0 306 0 0 0 25 0 8 0 886293583 491352064 47166 33554432000 4194304 4625164 140735158227792 18446744073709551615 4278640 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=479836 CPUtime=3.07 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 7403 0 0 0 306 1 0 0 21 0 8 0 886293583 491352064 47166 33554432000 4194304 4625164 140735158227792 18446744073709551615 4349027 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27650] ppid=27642 vsize=479836 CPUtime=3.07 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 7813 0 0 0 306 1 0 0 18 0 8 0 886293583 491352064 47166 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=27644/tid=27651] ppid=27642 vsize=479836 CPUtime=3.06 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 4001 0 0 0 306 0 0 0 24 0 8 0 886293583 491352064 47166 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.48
Current children cumulated vsize (KiB) 479836

[startup+6.3012 s]
/proc/loadavg: 1.30 0.28 0.09 9/516 27652
/proc/meminfo: memFree=19811168/32950928 swapFree=61513528/67111528
[pid=27644] ppid=27642 vsize=509064 CPUtime=50.01 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 111970 0 0 0 4982 19 0 0 25 0 8 0 886293581 521281536 65563 33554432000 4194304 4625164 140735158227792 18446744073709551615 4393104 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/27644/statm: 127266 65563 570 106 0 122769 0
[pid=27644/tid=27645] ppid=27642 vsize=509064 CPUtime=6.22 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 8469 0 0 0 621 1 0 0 25 0 8 0 886293583 521281536 65563 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=27644/tid=27646] ppid=27642 vsize=509064 CPUtime=6.22 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 7099 0 0 0 621 1 0 0 25 0 8 0 886293583 521281536 65563 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=27644/tid=27647] ppid=27642 vsize=509064 CPUtime=6.15 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 29835 0 0 0 610 5 0 0 25 0 8 0 886293583 521281536 65563 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=27644/tid=27648] ppid=27642 vsize=509064 CPUtime=6.26 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 3800 0 0 0 626 0 0 0 25 0 8 0 886293583 521281536 65563 33554432000 4194304 4625164 140735158227792 18446744073709551615 4288743 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=509064 CPUtime=6.26 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 11166 0 0 0 625 1 0 0 25 0 8 0 886293583 521281536 65563 33554432000 4194304 4625164 140735158227792 18446744073709551615 4349336 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27650] ppid=27642 vsize=509064 CPUtime=6.27 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 10645 0 0 0 625 2 0 0 25 0 8 0 886293583 521281536 65563 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=27644/tid=27651] ppid=27642 vsize=509064 CPUtime=6.27 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 6414 0 0 0 626 1 0 0 25 0 8 0 886293583 521281536 65563 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0

################
# More data... #
################

[pid=27644/tid=27649] ppid=27642 vsize=26178804 CPUtime=4000.64 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 427171 0 0 0 399993 71 0 0 25 0 8 0 886293583 26807095296 5683557 33554432000 4194304 4625164 140735158227792 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 14
[pid=27644/tid=27650] ppid=27642 vsize=26178804 CPUtime=3999.5 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 444095 0 0 0 399863 87 0 0 25 0 8 0 886293583 26807095296 5683557 33554432000 4194304 4625164 140735158227792 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 15
[pid=27644/tid=27651] ppid=27642 vsize=26178804 CPUtime=3969.77 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 269984 0 0 0 396810 167 0 0 25 0 8 0 886293583 26807095296 5683557 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 16
Current children cumulated CPU time (s) 31900.1
Current children cumulated vsize (KiB) 26178804

[startup+4062.3 s]
/proc/loadavg: 8.06 8.08 7.96 9/516 27781
/proc/meminfo: memFree=660876/32950928 swapFree=58641344/67111528
[pid=27644] ppid=27642 vsize=26244340 CPUtime=32379 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 38453591 0 322 0 3230582 7321 0 0 25 0 8 0 886293581 26874204160 5705745 33554432000 4194304 4625164 140735158227792 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 1658
/proc/27644/statm: 6561085 5705745 354 106 0 6556588 0
[pid=27644/tid=27645] ppid=27642 vsize=26244340 CPUtime=4060.79 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 385012 0 0 0 406010 69 0 0 25 0 8 0 886293583 26874204160 5705745 33554432000 4194304 4625164 140735158227792 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 30
[pid=27644/tid=27646] ppid=27642 vsize=26244340 CPUtime=4040.96 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 375847 0 0 0 403807 289 0 0 25 0 8 0 886293583 26874204160 5705745 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 20
[pid=27644/tid=27647] ppid=27642 vsize=26244340 CPUtime=4040.67 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 23749247 0 0 0 400028 4039 0 0 25 0 8 0 886293583 26874204160 5705745 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 783
[pid=27644/tid=27648] ppid=27642 vsize=26244340 CPUtime=4044.84 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 412049 0 0 0 404415 69 0 0 25 0 8 0 886293583 26874204160 5705745 33554432000 4194304 4625164 140735158227792 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=26244340 CPUtime=4060.65 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 427171 0 0 0 405994 71 0 0 25 0 8 0 886293583 26874204160 5705745 33554432000 4194304 4625164 140735158227792 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 14
[pid=27644/tid=27650] ppid=27642 vsize=26244340 CPUtime=4059.5 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 446045 0 0 0 405862 88 0 0 25 0 8 0 886293583 26874204160 5705746 33554432000 4194304 4625164 140735158227792 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 15
[pid=27644/tid=27651] ppid=27642 vsize=26244340 CPUtime=4029.74 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 270785 0 0 0 402807 167 0 0 25 0 8 0 886293583 26874204160 5705746 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415052833 0 0 4096 2 0 0 0 -1 4 0 0 16
Current children cumulated CPU time (s) 32379
Current children cumulated vsize (KiB) 26244340

[startup+4122.3 s]
/proc/loadavg: 8.06 8.08 7.97 9/516 27782
/proc/meminfo: memFree=431772/32950928 swapFree=58641344/67111528
[pid=27644] ppid=27642 vsize=26375412 CPUtime=32857.9 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 39030822 0 323 0 3278366 7425 0 0 25 0 8 0 886293581 27008421888 5758830 33554432000 4194304 4625164 140735158227792 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 1660
/proc/27644/statm: 6593853 5758830 376 106 0 6589356 0
[pid=27644/tid=27645] ppid=27642 vsize=26375412 CPUtime=4120.79 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 385037 0 0 0 412010 69 0 0 25 0 8 0 886293583 27008421888 5758830 33554432000 4194304 4625164 140735158227792 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 30
[pid=27644/tid=27646] ppid=27642 vsize=26375412 CPUtime=4099.88 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 377295 0 0 0 409697 291 0 0 25 0 8 0 886293583 27008421888 5758830 33554432000 4194304 4625164 140735158227792 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 20
[pid=27644/tid=27647] ppid=27642 vsize=26375412 CPUtime=4100.66 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 24253916 0 0 0 405946 4120 0 0 25 0 8 0 886293583 27008421888 5758830 33554432000 4194304 4625164 140735158227792 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 1 0 0 783
[pid=27644/tid=27648] ppid=27642 vsize=26375412 CPUtime=4104.85 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 412687 0 0 0 410415 70 0 0 25 0 8 0 886293583 27008421888 5758830 33554432000 4194304 4625164 140735158227792 18446744073709551615 4330814 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=26375412 CPUtime=4120.65 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 427171 0 0 0 411994 71 0 0 25 0 8 0 886293583 27008421888 5758830 33554432000 4194304 4625164 140735158227792 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 5 0 0 14
[pid=27644/tid=27650] ppid=27642 vsize=26375412 CPUtime=4119.49 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 446477 0 0 0 411861 88 0 0 25 0 8 0 886293583 27008421888 5758832 33554432000 4194304 4625164 140735158227792 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 15
[pid=27644/tid=27651] ppid=27642 vsize=26375412 CPUtime=4089.73 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 272541 0 0 0 408804 169 0 0 25 0 8 0 886293583 27008421888 5758832 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 16
Current children cumulated CPU time (s) 32857.9
Current children cumulated vsize (KiB) 26375412

Solver just ended. Dumping a history of the last processes samples

[startup+4124.1 s]
/proc/loadavg: 8.06 8.08 7.97 9/516 27782
/proc/meminfo: memFree=429416/32950928 swapFree=58641344/67111528
[pid=27644] ppid=27642 vsize=26375412 CPUtime=32872.3 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 39049121 0 323 0 3279802 7428 0 0 25 0 8 0 886293581 27008421888 5759319 33554432000 4194304 4625164 140735158227792 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 1660
/proc/27644/statm: 6593853 5759342 397 106 0 6589356 0
[pid=27644/tid=27645] ppid=27642 vsize=26375412 CPUtime=4122.59 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 385037 0 0 0 412190 69 0 0 25 0 8 0 886293583 27008421888 5759353 33554432000 4194304 4625164 140735158227792 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 30
[pid=27644/tid=27646] ppid=27642 vsize=26375412 CPUtime=4101.67 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 377554 0 0 0 409875 292 0 0 25 0 8 0 886293583 27008421888 5759365 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 20
[pid=27644/tid=27647] ppid=27642 vsize=26375412 CPUtime=4102.46 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 24271933 0 0 0 406124 4122 0 0 25 0 8 0 886293583 27008421888 5759377 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415089089 0 0 4096 2 0 0 0 -1 1 0 0 783
[pid=27644/tid=27648] ppid=27642 vsize=26375412 CPUtime=4106.65 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 412691 0 0 0 410595 70 0 0 25 0 8 0 886293583 27008421888 5759389 33554432000 4194304 4625164 140735158227792 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=26375412 CPUtime=4122.45 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 427171 0 0 0 412174 71 0 0 25 0 8 0 886293583 27008421888 5759401 33554432000 4194304 4625164 140735158227792 18446744073709551615 4329733 0 0 4096 2 0 0 0 -1 5 0 0 14
[pid=27644/tid=27650] ppid=27642 vsize=26375412 CPUtime=4121.29 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 446477 0 0 0 412041 88 0 0 25 0 8 0 886293583 27008421888 5759413 33554432000 4194304 4625164 140735158227792 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 15
[pid=27644/tid=27651] ppid=27642 vsize=26375412 CPUtime=4091.54 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 272542 0 0 0 408985 169 0 0 25 0 8 0 886293583 27008421888 5759424 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 16
Current children cumulated CPU time (s) 32872.3
Current children cumulated vsize (KiB) 26375412

[startup+4127.3 s]
/proc/loadavg: 8.05 8.08 7.97 9/516 27782
/proc/meminfo: memFree=425072/32950928 swapFree=58641344/67111528
[pid=27644] ppid=27642 vsize=26375412 CPUtime=32897.8 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 39082170 0 323 0 3282351 7433 0 0 25 0 8 0 886293581 27008421888 5760391 33554432000 4194304 4625164 140735158227792 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 1660
/proc/27644/statm: 6593853 5760391 373 106 0 6589356 0
[pid=27644/tid=27645] ppid=27642 vsize=26375412 CPUtime=4125.79 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 385037 0 0 0 412510 69 0 0 25 0 8 0 886293583 27008421888 5760391 33554432000 4194304 4625164 140735158227792 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 30
[pid=27644/tid=27646] ppid=27642 vsize=26375412 CPUtime=4104.8 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 377767 0 0 0 410188 292 0 0 25 0 8 0 886293583 27008421888 5760391 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 7 0 0 20
[pid=27644/tid=27647] ppid=27642 vsize=26375412 CPUtime=4105.66 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 24304232 0 0 0 406439 4127 0 0 25 0 8 0 886293583 27008421888 5760391 33554432000 4194304 4625164 140735158227792 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 783
[pid=27644/tid=27648] ppid=27642 vsize=26375412 CPUtime=4109.85 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 412692 0 0 0 410915 70 0 0 25 0 8 0 886293583 27008421888 5760391 33554432000 4194304 4625164 140735158227792 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=26375412 CPUtime=4125.65 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 427171 0 0 0 412494 71 0 0 25 0 8 0 886293583 27008421888 5760391 33554432000 4194304 4625164 140735158227792 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 14
[pid=27644/tid=27650] ppid=27642 vsize=26375412 CPUtime=4124.49 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 446483 0 0 0 412361 88 0 0 25 0 8 0 886293583 27008421888 5760391 33554432000 4194304 4625164 140735158227792 18446744073709551615 4339541 0 0 4096 2 0 0 0 -1 3 0 0 15
[pid=27644/tid=27651] ppid=27642 vsize=26375412 CPUtime=4094.73 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 272542 0 0 0 409304 169 0 0 25 0 8 0 886293583 27008421888 5760391 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 16
Current children cumulated CPU time (s) 32897.8
Current children cumulated vsize (KiB) 26375412

[startup+4130.5 s]
/proc/loadavg: 8.05 8.08 7.97 9/516 27782
/proc/meminfo: memFree=428848/32950928 swapFree=58641344/67111528
[pid=27644] ppid=27642 vsize=26375412 CPUtime=32923.4 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 39106437 0 323 0 3284900 7439 0 0 25 0 8 0 886293581 27008421888 5761316 33554432000 4194304 4625164 140735158227792 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 1660
/proc/27644/statm: 6593853 5761316 369 106 0 6589356 0
[pid=27644/tid=27645] ppid=27642 vsize=26375412 CPUtime=4128.99 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 385037 0 0 0 412830 69 0 0 25 0 8 0 886293583 27008421888 5761316 33554432000 4194304 4625164 140735158227792 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 30
[pid=27644/tid=27646] ppid=27642 vsize=26375412 CPUtime=4107.94 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 378070 0 0 0 410502 292 0 0 25 0 8 0 886293583 27008421888 5761316 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 20
[pid=27644/tid=27647] ppid=27642 vsize=26375412 CPUtime=4108.86 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 24327706 0 0 0 406754 4132 0 0 25 0 8 0 886293583 27008421888 5761316 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 783
[pid=27644/tid=27648] ppid=27642 vsize=26375412 CPUtime=4113.05 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 412692 0 0 0 411235 70 0 0 25 0 8 0 886293583 27008421888 5761316 33554432000 4194304 4625164 140735158227792 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=26375412 CPUtime=4128.85 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 427171 0 0 0 412814 71 0 0 25 0 8 0 886293583 27008421888 5761316 33554432000 4194304 4625164 140735158227792 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 5 0 0 14
[pid=27644/tid=27650] ppid=27642 vsize=26375412 CPUtime=4127.69 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 446492 0 0 0 412681 88 0 0 25 0 8 0 886293583 27008421888 5761316 33554432000 4194304 4625164 140735158227792 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 15
[pid=27644/tid=27651] ppid=27642 vsize=26375412 CPUtime=4097.94 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 272544 0 0 0 409625 169 0 0 25 0 8 0 886293583 27008421888 5761316 33554432000 4194304 4625164 140735158227792 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 16
Current children cumulated CPU time (s) 32923.4
Current children cumulated vsize (KiB) 26375412

[startup+4132.1 s]
/proc/loadavg: 8.13 8.10 7.97 9/516 27782
/proc/meminfo: memFree=398956/32950928 swapFree=58641344/67111528
[pid=27644] ppid=27642 vsize=26375412 CPUtime=32936.1 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) R 27642 27644 27618 0 -1 4202496 39134841 0 323 0 3286169 7445 0 0 25 0 8 0 886293581 27008421888 5772605 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415052833 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 1660
/proc/27644/statm: 6593853 5772605 379 106 0 6589356 0
[pid=27644/tid=27645] ppid=27642 vsize=26375412 CPUtime=4130.59 cores=0-7
/proc/27644/task/27645/stat : 27645 (SArTagnan) R 27642 27644 27618 0 -1 4202560 385037 0 0 0 412990 69 0 0 25 0 8 0 886293583 27008421888 5772606 33554432000 4194304 4625164 140735158227792 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 30
[pid=27644/tid=27646] ppid=27642 vsize=26375412 CPUtime=4109.51 cores=0-7
/proc/27644/task/27646/stat : 27646 (SArTagnan) R 27642 27644 27618 0 -1 4202560 378167 0 0 0 410658 293 0 0 25 0 8 0 886293583 27008421888 5772606 33554432000 4194304 4625164 140735158227792 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 7 0 0 20
[pid=27644/tid=27647] ppid=27642 vsize=26375412 CPUtime=4110.46 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4202560 24340514 0 0 0 406913 4133 0 0 25 0 8 0 886293583 27008421888 5772606 33554432000 4194304 4625164 140735158227792 18446744073709551615 4547788 0 0 4096 2 0 0 0 -1 1 0 0 783
[pid=27644/tid=27648] ppid=27642 vsize=26375412 CPUtime=4114.65 cores=0-7
/proc/27644/task/27648/stat : 27648 (SArTagnan) R 27642 27644 27618 0 -1 4202560 412694 0 0 0 411395 70 0 0 25 0 8 0 886293583 27008421888 5772607 33554432000 4194304 4625164 140735158227792 18446744073709551615 256415040716 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=27644/tid=27649] ppid=27642 vsize=26375412 CPUtime=4130.45 cores=0-7
/proc/27644/task/27649/stat : 27649 (SArTagnan) R 27642 27644 27618 0 -1 4202560 427171 0 0 0 412974 71 0 0 25 0 8 0 886293583 27008421888 5772607 33554432000 4194304 4625164 140735158227792 18446744073709551615 4329856 0 0 4096 2 0 0 0 -1 5 0 0 14
[pid=27644/tid=27650] ppid=27642 vsize=26375412 CPUtime=4129.29 cores=0-7
/proc/27644/task/27650/stat : 27650 (SArTagnan) R 27642 27644 27618 0 -1 4202560 446515 0 0 0 412841 88 0 0 25 0 8 0 886293583 27008421888 5772608 33554432000 4194304 4625164 140735158227792 18446744073709551615 4469405 0 0 4096 2 0 0 0 -1 3 0 0 15
[pid=27644/tid=27651] ppid=27642 vsize=26375412 CPUtime=4099.54 cores=0-7
/proc/27644/task/27651/stat : 27651 (SArTagnan) R 27642 27644 27618 0 -1 4202560 272544 0 0 0 409785 169 0 0 25 0 8 0 886293583 27008421888 5772608 33554432000 4194304 4625164 140735158227792 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 16
Current children cumulated CPU time (s) 32936.1
Current children cumulated vsize (KiB) 26375412

[startup+4132.9 s]
/proc/loadavg: 8.13 8.10 7.97 9/516 27782
/proc/meminfo: memFree=398956/32950928 swapFree=58641344/67111528
[pid=27644] ppid=27642 vsize=0 CPUtime=32938.1 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) Z 27642 27644 27618 0 -1 4202524 39149646 0 323 0 3286299 7511 0 0 18 0 2 0 886293581 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 1660
/proc/27644/statm: 0 0 0 0 0 0 0
[pid=27644/tid=27647] ppid=27642 vsize=0 CPUtime=4111.26 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4203588 24343682 0 0 0 406929 4197 0 0 18 0 2 0 886293583 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 783
Current children cumulated CPU time (s) 32938.1
Current children cumulated vsize (KiB) 0

[startup+4133.3 s]
/proc/loadavg: 8.13 8.10 7.97 2/510 27782
/proc/meminfo: memFree=17739000/32950928 swapFree=58671692/67111528
[pid=27644] ppid=27642 vsize=0 CPUtime=32938.5 cores=0-7
/proc/27644/stat : 27644 (SArTagnan) Z 27642 27644 27618 0 -1 4202524 39149646 0 323 0 3286299 7551 0 0 18 0 2 0 886293581 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 1660
/proc/27644/statm: 0 0 0 0 0 0 0
[pid=27644/tid=27647] ppid=27642 vsize=0 CPUtime=4111.66 cores=0-7
/proc/27644/task/27647/stat : 27647 (SArTagnan) R 27642 27644 27618 0 -1 4203588 24343682 0 0 0 406929 4237 0 0 19 0 2 0 886293583 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 783
Current children cumulated CPU time (s) 32938.5
Current children cumulated vsize (KiB) 0

Child status: 1
Real time (s): 4133.36
CPU time (s): 32938.6
CPU user time (s): 32863
CPU system time (s): 75.5795
CPU usage (%): 796.895
Max. virtual memory (cumulated for all children) (KiB): 29648756

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 32863
system time used= 75.5795
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 39149646
page faults= 323
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 44089
involuntary context switches= 145657

runsolver used 19.2031 second user time and 53.9468 second system time

The end

Launcher Data 

Begin job on node115 at 2011-06-01 22:37:09
IDJOB=3439311
IDBENCH=83976
IDSOLVER=1936
FILE ID=node115/3439311-1306960629
RUNJOBID= node115-1306960629-27632
PBS_JOBID= 13497638
Free space on /tmp= 73768 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_22_70_7-dir.shuffled-as.sat03-154.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439311-1306960629/watcher-3439311-1306960629 -o /tmp/evaluation-result-3439311-1306960629/solver-3439311-1306960629 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439311-1306960629.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= aa9ee2fa26214e80fac6d004d5d0b003
RANDOM SEED=481871933

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20057396 kB
Buffers:        189492 kB
Cached:         549628 kB
SwapCached:       5268 kB
Active:       11995852 kB
Inactive:       614360 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20057396 kB
SwapTotal:    67111528 kB
SwapFree:     61513528 kB
Dirty:            1172 kB
Writeback:           0 kB
AnonPages:    11869200 kB
Mapped:          33000 kB
Slab:           136112 kB
PageTables:      75628 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 151810892 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73768 MiB
End job on node115 at 2011-06-01 23:46:03