Trace number 3439041

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.4 5003.79

General information on the benchmark

Namecrafted/manthey/sudoku-single-hard/
sudoku_81x81_unknown.cnf
MD5SUMcbd78921480e79d133eb06cb2172caa1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables18217
Number of clauses284829
Sum of the clauses size622430
Maximum clause length28
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2275099
Number of clauses of size 3620
Number of clauses of size 4984
Number of clauses of size 51120
Number of clauses of size over 57006

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439041-1307665910/watcher-3439041-1307665910 -o /tmp/evaluation-result-3439041-1307665910/solver-3439041-1307665910 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439041-1307665910.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.11 7.23 4.80 2/167 5038
/proc/meminfo: memFree=32476400/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=27100 CPUtime=0 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 832 0 0 0 0 0 0 0 25 0 1 0 878191432 27750400 769 33554432000 4194304 4625164 140736818754496 18446744073709551615 253640859392 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/5038/statm: 6775 769 296 106 0 2278 0

[startup+0.0227951 s]
/proc/loadavg: 8.11 7.23 4.80 2/167 5038
/proc/meminfo: memFree=32476400/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=28444 CPUtime=0.02 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 1535 0 0 0 2 0 0 0 25 0 1 0 878191432 29126656 1087 33554432000 4194304 4625164 140736818754496 18446744073709551615 253640478277 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/5038/statm: 7111 1087 296 106 0 2614 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 28444

[startup+0.100771 s]
/proc/loadavg: 8.11 7.23 4.80 2/167 5038
/proc/meminfo: memFree=32476400/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=69192 CPUtime=0.09 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 10644 0 0 0 8 1 0 0 25 0 1 0 878191432 70852608 8345 33554432000 4194304 4625164 140736818754496 18446744073709551615 253640557013 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/5038/statm: 17298 8368 298 106 0 12801 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 69192

[startup+0.382865 s]
/proc/loadavg: 8.11 7.23 4.80 2/167 5038
/proc/meminfo: memFree=32476400/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=548096 CPUtime=2.52 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) D 5036 5038 4580 0 -1 4202496 23802 0 0 0 249 3 0 0 25 0 8 0 878191432 561250304 20109 33554432000 4194304 4625164 140736818754496 18446744073709551615 253640902839 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 137024 20109 350 106 0 132527 0
Current children cumulated CPU time (s) 2.52
Current children cumulated vsize (KiB) 548096

[startup+0.874086 s]
/proc/loadavg: 8.11 7.23 4.80 2/167 5038
/proc/meminfo: memFree=32476400/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=666244 CPUtime=6.16 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 51613 0 0 0 609 7 0 0 25 0 8 0 878191432 682233856 37460 33554432000 4194304 4625164 140736818754496 18446744073709551615 4278435 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 166561 36948 350 106 0 162064 0
Current children cumulated CPU time (s) 6.16
Current children cumulated vsize (KiB) 666244

[startup+1.50648 s]
/proc/loadavg: 8.18 7.26 4.82 9/175 5046
/proc/meminfo: memFree=32316164/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=693000 CPUtime=11.21 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 66380 0 0 0 1111 10 0 0 25 0 8 0 878191432 709632000 38226 33554432000 4194304 4625164 140736818754496 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 173250 38226 353 106 0 168753 0
[pid=5038/tid=5040] ppid=5036 vsize=693000 CPUtime=1.39 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 6703 0 0 0 139 0 0 0 19 0 8 0 878191443 709632000 38227 33554432000 4194304 4625164 140736818754496 18446744073709551615 4288904 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=693000 CPUtime=1.39 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 5718 0 0 0 138 1 0 0 19 0 8 0 878191443 709632000 38227 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=693000 CPUtime=1.36 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 8675 0 0 0 135 1 0 0 19 0 8 0 878191443 709632000 38227 33554432000 4194304 4625164 140736818754496 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=693000 CPUtime=1.38 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 3797 0 0 0 138 0 0 0 19 0 8 0 878191443 709632000 38228 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=693000 CPUtime=1.37 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 5330 0 0 0 137 0 0 0 19 0 8 0 878191443 709632000 38228 33554432000 4194304 4625164 140736818754496 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=693000 CPUtime=1.38 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 5638 0 0 0 138 0 0 0 19 0 8 0 878191443 709632000 38228 33554432000 4194304 4625164 140736818754496 18446744073709551615 253640518005 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=693000 CPUtime=1.37 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 6724 0 0 0 136 1 0 0 25 0 8 0 878191443 709632000 38229 33554432000 4194304 4625164 140736818754496 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.21
Current children cumulated vsize (KiB) 693000

[startup+3.10119 s]
/proc/loadavg: 8.18 7.26 4.82 9/175 5046
/proc/meminfo: memFree=32304632/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=727092 CPUtime=23.97 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 99220 0 0 0 2382 15 0 0 25 0 8 0 878191432 744542208 44485 33554432000 4194304 4625164 140736818754496 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 181773 44485 353 106 0 177276 0
[pid=5038/tid=5040] ppid=5036 vsize=727092 CPUtime=2.99 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 9148 0 0 0 298 1 0 0 25 0 8 0 878191443 744542208 44485 33554432000 4194304 4625164 140736818754496 18446744073709551615 4288883 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=727092 CPUtime=2.98 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 8202 0 0 0 297 1 0 0 24 0 8 0 878191443 744542208 44485 33554432000 4194304 4625164 140736818754496 18446744073709551615 4339111 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=727092 CPUtime=2.96 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 22160 0 0 0 293 3 0 0 25 0 8 0 878191443 744542208 44485 33554432000 4194304 4625164 140736818754496 18446744073709551615 4554661 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=727092 CPUtime=2.97 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 7132 0 0 0 296 1 0 0 24 0 8 0 878191443 744542208 44485 33554432000 4194304 4625164 140736818754496 18446744073709551615 253640526730 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=727092 CPUtime=2.96 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 7719 0 0 0 296 0 0 0 25 0 8 0 878191443 744542208 44485 33554432000 4194304 4625164 140736818754496 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=727092 CPUtime=2.98 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 8848 0 0 0 297 1 0 0 25 0 8 0 878191443 744542208 44485 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=727092 CPUtime=2.97 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 9221 0 0 0 296 1 0 0 25 0 8 0 878191443 744542208 44485 33554432000 4194304 4625164 140736818754496 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 23.97
Current children cumulated vsize (KiB) 727092

[startup+6.30061 s]
/proc/loadavg: 8.17 7.27 4.84 9/175 5046
/proc/meminfo: memFree=32274500/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=727092 CPUtime=49.54 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 120293 0 0 0 4935 19 0 0 25 0 8 0 878191432 744542208 52068 33554432000 4194304 4625164 140736818754496 18446744073709551615 4512968 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 181773 52069 353 106 0 177276 0
[pid=5038/tid=5040] ppid=5036 vsize=727092 CPUtime=6.19 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 10516 0 0 0 618 1 0 0 25 0 8 0 878191443 744542208 52069 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=727092 CPUtime=6.18 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 9154 0 0 0 617 1 0 0 25 0 8 0 878191443 744542208 52069 33554432000 4194304 4625164 140736818754496 18446744073709551615 4316714 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=727092 CPUtime=6.16 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 36634 0 0 0 611 5 0 0 25 0 8 0 878191443 744542208 52069 33554432000 4194304 4625164 140736818754496 18446744073709551615 4573848 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=727092 CPUtime=6.17 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 8139 0 0 0 616 1 0 0 25 0 8 0 878191443 744542208 52069 33554432000 4194304 4625164 140736818754496 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=727092 CPUtime=6.15 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 8426 0 0 0 614 1 0 0 25 0 8 0 878191443 744542208 52069 33554432000 4194304 4625164 140736818754496 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=727092 CPUtime=6.18 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 9525 0 0 0 616 2 0 0 25 0 8 0 878191443 744542208 52069 33554432000 4194304 4625164 140736818754496 18446744073709551615 253640520737 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=727092 CPUtime=6.16 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 9767 0 0 0 615 1 0 0 25 0 8 0 878191443 744542208 52069 33554432000 4194304 4625164 140736818754496 18446744073709551615 4464377 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.54
Current children cumulated vsize (KiB) 727092

[startup+12.7004 s]
/proc/loadavg: 8.15 7.29 4.85 9/175 5046
/proc/meminfo: memFree=32231508/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=770908 CPUtime=100.71 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 199194 0 0 0 10035 36 0 0 25 0 8 0 878191432 789409792 62553 33554432000 4194304 4625164 140736818754496 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 192727 62554 353 106 0 188230 0
[pid=5038/tid=5040] ppid=5036 vsize=770908 CPUtime=12.58 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 15224 0 0 0 1256 2 0 0 25 0 8 0 878191443 789409792 62554 33554432000 4194304 4625164 140736818754496 18446744073709551615 4352186 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=770908 CPUtime=12.58 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 13456 0 0 0 1256 2 0 0 25 0 8 0 878191443 789409792 62554 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=770908 CPUtime=12.56 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 84127 0 0 0 1243 13 0 0 25 0 8 0 878191443 789409792 62554 33554432000 4194304 4625164 140736818754496 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=770908 CPUtime=12.57 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 13001 0 0 0 1254 3 0 0 25 0 8 0 878191443 789409792 62554 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=770908 CPUtime=12.51 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 12206 0 0 0 1249 2 0 0 25 0 8 0 878191443 789409792 62554 33554432000 4194304 4625164 140736818754496 18446744073709551615 4348844 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=770908 CPUtime=12.58 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 13051 0 0 0 1256 2 0 0 25 0 8 0 878191443 789409792 62554 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=770908 CPUtime=12.57 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 14116 0 0 0 1254 3 0 0 25 0 8 0 878191443 789409792 62554 33554432000 4194304 4625164 140736818754496 18446744073709551615 4465186 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 100.71
Current children cumulated vsize (KiB) 770908

[startup+25.5011 s]
/proc/loadavg: 8.13 7.31 4.89 9/175 5046
/proc/meminfo: memFree=32164284/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=786340 CPUtime=203.05 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 271679 0 0 0 20252 53 0 0 25 0 8 0 878191432 805212160 79641 33554432000 4194304 4625164 140736818754496 18446744073709551615 4513941 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 196585 79641 353 106 0 192088 0
[pid=5038/tid=5040] ppid=5036 vsize=786340 CPUtime=25.39 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 22341 0 0 0 2533 6 0 0 25 0 8 0 878191443 805212160 79641 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=786340 CPUtime=25.38 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 16129 0 0 0 2534 4 0 0 25 0 8 0 878191443 805212160 79641 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=786340 CPUtime=25.36 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 137664 0 0 0 2516 20 0 0 25 0 8 0 878191443 805212160 79641 33554432000 4194304 4625164 140736818754496 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=786340 CPUtime=25.37 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 16651 0 0 0 2532 5 0 0 25 0 8 0 878191443 805212160 79641 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=786340 CPUtime=25.25 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 13441 0 0 0 2523 2 0 0 25 0 8 0 878191443 805212160 79641 33554432000 4194304 4625164 140736818754496 18446744073709551615 4350056 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=786340 CPUtime=25.38 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 14126 0 0 0 2535 3 0 0 25 0 8 0 878191443 805212160 79641 33554432000 4194304 4625164 140736818754496 18446744073709551615 4464408 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=786340 CPUtime=25.36 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 16578 0 0 0 2532 4 0 0 25 0 8 0 878191443 805212160 79641 33554432000 4194304 4625164 140736818754496 18446744073709551615 4352017 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.05
Current children cumulated vsize (KiB) 786340

[startup+51.1005 s]
/proc/loadavg: 8.08 7.37 4.98 9/175 5047
/proc/meminfo: memFree=32013220/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=824644 CPUtime=407.69 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 466765 0 0 0 40666 103 0 0 25 0 8 0 878191432 844435456 117016 33554432000 4194304 4625164 140736818754496 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 206161 117016 353 106 0 201664 0
[pid=5038/tid=5040] ppid=5036 vsize=824644 CPUtime=50.98 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 28537 0 0 0 5087 11 0 0 25 0 8 0 878191443 844435456 117016 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=824644 CPUtime=50.98 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 23314 0 0 0 5091 7 0 0 25 0 8 0 878191443 844435456 117016 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=824644 CPUtime=50.95 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 282344 0 0 0 5053 42 0 0 25 0 8 0 878191443 844435456 117016 33554432000 4194304 4625164 140736818754496 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=824644 CPUtime=50.97 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 27432 0 0 0 5088 9 0 0 25 0 8 0 878191443 844435456 117016 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=824644 CPUtime=50.7 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 23187 0 0 0 5065 5 0 0 25 0 8 0 878191443 844435456 117016 33554432000 4194304 4625164 140736818754496 18446744073709551615 4349210 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=824644 CPUtime=50.97 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 18922 0 0 0 5090 7 0 0 25 0 8 0 878191443 844435456 117016 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=824644 CPUtime=50.96 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 26931 0 0 0 5084 12 0 0 25 0 8 0 878191443 844435456 117016 33554432000 4194304 4625164 140736818754496 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 407.69

################
# More data... #
################

[pid=5038/tid=5042] ppid=5036 vsize=4421052 CPUtime=4662.23 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 26236560 0 0 0 462415 3808 0 0 25 0 8 0 878191443 4527157248 945954 33554432000 4194304 4625164 140736818754496 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=4421052 CPUtime=4662.3 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 147374 0 0 0 466172 58 0 0 25 0 8 0 878191443 4527157248 945954 33554432000 4194304 4625164 140736818754496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=4421052 CPUtime=4658.59 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 141914 0 0 0 465805 54 0 0 25 0 8 0 878191443 4527157248 945955 33554432000 4194304 4625164 140736818754496 18446744073709551615 4329483 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=4421052 CPUtime=4661.66 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 206545 0 0 0 466036 130 0 0 25 0 8 0 878191443 4527157248 945955 33554432000 4194304 4625164 140736818754496 18446744073709551615 4316669 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=4421052 CPUtime=4640.45 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 148959 0 0 0 463944 101 0 0 25 0 8 0 878191443 4527157248 945955 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37271.6
Current children cumulated vsize (KiB) 4421052

[startup+4722.3 s]
/proc/loadavg: 8.08 8.04 8.00 9/175 5184
/proc/meminfo: memFree=28675456/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=4525824 CPUtime=37751.3 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 27738008 0 0 0 3770633 4494 0 0 25 0 8 0 878191432 4634443776 948999 33554432000 4194304 4625164 140736818754496 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 1131456 948999 353 106 0 1126959 0
[pid=5038/tid=5040] ppid=5036 vsize=4525824 CPUtime=4722.29 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 145626 0 0 0 472175 54 0 0 25 0 8 0 878191443 4634443776 948999 33554432000 4194304 4625164 140736818754496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=4525824 CPUtime=4721.56 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 305105 0 0 0 471946 210 0 0 25 0 8 0 878191443 4634443776 948999 33554432000 4194304 4625164 140736818754496 18446744073709551615 4288950 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=4525824 CPUtime=4722.24 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 26494021 0 0 0 468378 3846 0 0 25 0 8 0 878191443 4634443776 948999 33554432000 4194304 4625164 140736818754496 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=4525824 CPUtime=4722.3 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 147505 0 0 0 472172 58 0 0 25 0 8 0 878191443 4634443776 948999 33554432000 4194304 4625164 140736818754496 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=4525824 CPUtime=4718.59 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 142094 0 0 0 471805 54 0 0 25 0 8 0 878191443 4634443776 948999 33554432000 4194304 4625164 140736818754496 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=4525824 CPUtime=4721.66 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 206602 0 0 0 472036 130 0 0 25 0 8 0 878191443 4634443776 948999 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=4525824 CPUtime=4700.13 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 148995 0 0 0 469912 101 0 0 25 0 8 0 878191443 4634443776 948999 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37751.3
Current children cumulated vsize (KiB) 4525824

[startup+4782.3 s]
/proc/loadavg: 8.07 8.05 8.00 9/175 5185
/proc/meminfo: memFree=28652996/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=4525824 CPUtime=38230.9 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 28160791 0 0 0 3818534 4561 0 0 25 0 8 0 878191432 4634443776 956996 33554432000 4194304 4625164 140736818754496 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 1131456 956996 353 106 0 1126959 0
[pid=5038/tid=5040] ppid=5036 vsize=4525824 CPUtime=4782.29 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 145778 0 0 0 478175 54 0 0 25 0 8 0 878191443 4634443776 956996 33554432000 4194304 4625164 140736818754496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=4525824 CPUtime=4781.57 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 309593 0 0 0 477944 213 0 0 25 0 8 0 878191443 4634443776 956996 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=4525824 CPUtime=4782.24 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 26911604 0 0 0 474315 3909 0 0 25 0 8 0 878191443 4634443776 956996 33554432000 4194304 4625164 140736818754496 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=4525824 CPUtime=4782.3 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 147639 0 0 0 478172 58 0 0 25 0 8 0 878191443 4634443776 956996 33554432000 4194304 4625164 140736818754496 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=4525824 CPUtime=4778.59 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 142183 0 0 0 477805 54 0 0 25 0 8 0 878191443 4634443776 956996 33554432000 4194304 4625164 140736818754496 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=4525824 CPUtime=4781.65 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 206662 0 0 0 478035 130 0 0 25 0 8 0 878191443 4634443776 956996 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=4525824 CPUtime=4759.8 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 149059 0 0 0 475879 101 0 0 25 0 8 0 878191443 4634443776 956996 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38230.9
Current children cumulated vsize (KiB) 4525824

[startup+4842.3 s]
/proc/loadavg: 8.02 8.04 8.00 9/175 5187
/proc/meminfo: memFree=28616020/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=4568704 CPUtime=38710.6 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 28519216 0 0 0 3866440 4623 0 0 25 0 8 0 878191432 4678352896 963215 33554432000 4194304 4625164 140736818754496 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 1142176 963215 353 106 0 1137679 0
[pid=5038/tid=5040] ppid=5036 vsize=4568704 CPUtime=4842.29 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 145901 0 0 0 484175 54 0 0 25 0 8 0 878191443 4678352896 963215 33554432000 4194304 4625164 140736818754496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=4568704 CPUtime=4841.56 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 314431 0 0 0 483935 221 0 0 25 0 8 0 878191443 4678352896 963216 33554432000 4194304 4625164 140736818754496 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=4568704 CPUtime=4842.23 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 27242675 0 0 0 480265 3958 0 0 25 0 8 0 878191443 4678352896 963216 33554432000 4194304 4625164 140736818754496 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=4568704 CPUtime=4842.31 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 147779 0 0 0 484172 59 0 0 25 0 8 0 878191443 4678352896 963216 33554432000 4194304 4625164 140736818754496 18446744073709551615 4330814 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=4568704 CPUtime=4838.6 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 142288 0 0 0 483805 55 0 0 25 0 8 0 878191443 4678352896 963216 33554432000 4194304 4625164 140736818754496 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=4568704 CPUtime=4841.65 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 206705 0 0 0 484034 131 0 0 25 0 8 0 878191443 4678352896 963217 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=4568704 CPUtime=4819.48 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 170857 0 0 0 481844 104 0 0 25 0 8 0 878191443 4678352896 963217 33554432000 4194304 4625164 140736818754496 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38710.6
Current children cumulated vsize (KiB) 4568704

[startup+4902.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/175 5188
/proc/meminfo: memFree=28580656/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=4600348 CPUtime=39190.3 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 28772417 0 0 0 3914368 4662 0 0 25 0 8 0 878191432 4710756352 973593 33554432000 4194304 4625164 140736818754496 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 1150087 973593 353 106 0 1145590 0
[pid=5038/tid=5040] ppid=5036 vsize=4600348 CPUtime=4902.29 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 146021 0 0 0 490175 54 0 0 25 0 8 0 878191443 4710756352 973593 33554432000 4194304 4625164 140736818754496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=4600348 CPUtime=4901.57 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 316993 0 0 0 489934 223 0 0 25 0 8 0 878191443 4710756352 973593 33554432000 4194304 4625164 140736818754496 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=4600348 CPUtime=4902.24 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 27492432 0 0 0 486229 3995 0 0 25 0 8 0 878191443 4710756352 973593 33554432000 4194304 4625164 140736818754496 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=4600348 CPUtime=4902.31 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 147903 0 0 0 490172 59 0 0 25 0 8 0 878191443 4710756352 973593 33554432000 4194304 4625164 140736818754496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=4600348 CPUtime=4898.6 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 142392 0 0 0 489805 55 0 0 25 0 8 0 878191443 4710756352 973593 33554432000 4194304 4625164 140736818754496 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=4600348 CPUtime=4901.65 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 206761 0 0 0 490034 131 0 0 25 0 8 0 878191443 4710756352 973593 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=4600348 CPUtime=4879.15 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 171040 0 0 0 487811 104 0 0 25 0 8 0 878191443 4710756352 973593 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39190.3
Current children cumulated vsize (KiB) 4600348

[startup+4962.3 s]
/proc/loadavg: 8.06 8.05 8.00 9/175 5190
/proc/meminfo: memFree=28534492/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=4600348 CPUtime=39670 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 29301956 0 0 0 3962256 4742 0 0 25 0 8 0 878191432 4710756352 984243 33554432000 4194304 4625164 140736818754496 18446744073709551615 4338085 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 1150087 984243 353 106 0 1145590 0
[pid=5038/tid=5040] ppid=5036 vsize=4600348 CPUtime=4962.3 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 146128 0 0 0 496175 55 0 0 25 0 8 0 878191443 4710756352 984243 33554432000 4194304 4625164 140736818754496 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=4600348 CPUtime=4961.57 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 326268 0 0 0 495924 233 0 0 25 0 8 0 878191443 4710756352 984243 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=4600348 CPUtime=4962.24 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 28012106 0 0 0 492160 4064 0 0 25 0 8 0 878191443 4710756352 984243 33554432000 4194304 4625164 140736818754496 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=4600348 CPUtime=4962.32 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 148018 0 0 0 496173 59 0 0 25 0 8 0 878191443 4710756352 984243 33554432000 4194304 4625164 140736818754496 18446744073709551615 4330976 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=4600348 CPUtime=4958.6 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 142489 0 0 0 495805 55 0 0 25 0 8 0 878191443 4710756352 984243 33554432000 4194304 4625164 140736818754496 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=4600348 CPUtime=4961.64 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 206795 0 0 0 496033 131 0 0 25 0 8 0 878191443 4710756352 984243 33554432000 4194304 4625164 140736818754496 18446744073709551615 4352145 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=4600348 CPUtime=4938.83 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 171058 0 0 0 493779 104 0 0 25 0 8 0 878191443 4710756352 984243 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39670
Current children cumulated vsize (KiB) 4600348



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.6 s]
/proc/loadavg: 8.08 8.06 8.00 9/175 5191
/proc/meminfo: memFree=28528640/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=4600348 CPUtime=40000.2 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) R 5036 5038 4580 0 -1 4202496 29676692 0 0 0 3995222 4798 0 0 25 0 8 0 878191432 4710756352 985491 33554432000 4194304 4625164 140736818754496 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 1150087 985491 353 106 0 1145590 0
[pid=5038/tid=5040] ppid=5036 vsize=4600348 CPUtime=5003.61 cores=0-7
/proc/5038/task/5040/stat : 5040 (SArTagnan) R 5036 5038 4580 0 -1 4202560 146204 0 0 0 500306 55 0 0 25 0 8 0 878191443 4710756352 985491 33554432000 4194304 4625164 140736818754496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5038/tid=5041] ppid=5036 vsize=4600348 CPUtime=5002.88 cores=0-7
/proc/5038/task/5041/stat : 5041 (SArTagnan) R 5036 5038 4580 0 -1 4202560 330046 0 0 0 500049 239 0 0 25 0 8 0 878191443 4710756352 985491 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5038/tid=5042] ppid=5036 vsize=4600348 CPUtime=5003.55 cores=0-7
/proc/5038/task/5042/stat : 5042 (SArTagnan) R 5036 5038 4580 0 -1 4202560 28382624 0 0 0 496240 4115 0 0 25 0 8 0 878191443 4710756352 985491 33554432000 4194304 4625164 140736818754496 18446744073709551615 4375504 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=5038/tid=5043] ppid=5036 vsize=4600348 CPUtime=5003.62 cores=0-7
/proc/5038/task/5043/stat : 5043 (SArTagnan) R 5036 5038 4580 0 -1 4202560 148124 0 0 0 500303 59 0 0 25 0 8 0 878191443 4710756352 985491 33554432000 4194304 4625164 140736818754496 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5038/tid=5044] ppid=5036 vsize=4600348 CPUtime=4999.9 cores=0-7
/proc/5038/task/5044/stat : 5044 (SArTagnan) R 5036 5038 4580 0 -1 4202560 142563 0 0 0 499935 55 0 0 25 0 8 0 878191443 4710756352 985491 33554432000 4194304 4625164 140736818754496 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=5038/tid=5045] ppid=5036 vsize=4600348 CPUtime=5002.95 cores=0-7
/proc/5038/task/5045/stat : 5045 (SArTagnan) R 5036 5038 4580 0 -1 4202560 206848 0 0 0 500164 131 0 0 25 0 8 0 878191443 4710756352 985491 33554432000 4194304 4625164 140736818754496 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=4600348 CPUtime=4979.9 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4202560 171090 0 0 0 497886 104 0 0 25 0 8 0 878191443 4710756352 985491 33554432000 4194304 4625164 140736818754496 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 4600348

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5003.71 s]
/proc/loadavg: 8.08 8.06 8.00 9/175 5191
/proc/meminfo: memFree=28528640/32951124 swapFree=67060628/67111528
[pid=5038] ppid=5036 vsize=0 CPUtime=40000.3 cores=0-7
/proc/5038/stat : 5038 (SArTagnan) Z 5036 5038 4580 0 -1 4203548 29676692 0 0 0 3995226 4808 0 0 25 0 2 0 878191432 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5038/statm: 0 0 0 0 0 0 0
[pid=5038/tid=5046] ppid=5036 vsize=0 CPUtime=4980.01 cores=0-7
/proc/5038/task/5046/stat : 5046 (SArTagnan) R 5036 5038 4580 0 -1 4203588 171090 0 0 0 497887 114 0 0 25 0 2 0 878191443 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5003.79
CPU time (s): 40000.4
CPU user time (s): 39952.3
CPU system time (s): 48.1607
CPU usage (%): 799.403
Max. virtual memory (cumulated for all children) (KiB): 4665884

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39952.3
system time used= 48.1607
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29676692
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11240
involuntary context switches= 120556

runsolver used 7.8938 second user time and 19.3431 second system time

The end

Launcher Data 

Begin job on node106 at 2011-06-10 02:31:50
IDJOB=3439041
IDBENCH=83244
IDSOLVER=1936
FILE ID=node106/3439041-1307665910
RUNJOBID= node106-1307665312-4594
PBS_JOBID= 13549439
Free space on /tmp= 74120 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/manthey/sudoku-single-hard/sudoku_81x81_unknown.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439041-1307665910/watcher-3439041-1307665910 -o /tmp/evaluation-result-3439041-1307665910/solver-3439041-1307665910 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439041-1307665910.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= cbd78921480e79d133eb06cb2172caa1
RANDOM SEED=845199479

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      32476448 kB
Buffers:         70260 kB
Cached:         230252 kB
SwapCached:      12404 kB
Active:          87348 kB
Inactive:       230828 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      32476448 kB
SwapTotal:    67111528 kB
SwapFree:     67060628 kB
Dirty:            4832 kB
Writeback:           0 kB
AnonPages:       15668 kB
Mapped:           9420 kB
Slab:            89444 kB
PageTables:       4008 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   155016 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74120 MiB
End job on node106 at 2011-06-10 03:55:16