Trace number 3386192

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.2 1205.59

General information on the benchmark

Nameindustrial/palacios/medium/
cube-11-h14-sat.cnf
MD5SUM7cc30e40be8c690e76c3fb158623be61
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark229.736
Satisfiable
(Un)Satisfiability was proved
Number of variables508177
Number of clauses1529045
Sum of the clauses size3568287
Maximum clause length19
Minimum clause length1
Number of clauses of size 11331
Number of clauses of size 21019705
Number of clauses of size 3505422
Number of clauses of size 42413
Number of clauses of size 519
Number of clauses of size over 5155

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386192-1305576659/watcher-3386192-1305576659 -o /tmp/evaluation-result-3386192-1305576659/solver-3386192-1305576659 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386192-1305576659.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.74 8.32 8.31 2/488 1530
/proc/meminfo: memFree=15980764/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=22336 CPUtime=0 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 1305 0 0 0 0 0 0 0 22 0 1 0 669263719 22872064 1244 33554432000 4194304 4625164 140733745641888 18446744073709551615 4296876 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1530/statm: 5584 1254 291 106 0 1087 0

[startup+0.102283 s]
/proc/loadavg: 7.74 8.32 8.31 2/488 1530
/proc/meminfo: memFree=15980764/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=104512 CPUtime=0.09 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 14140 0 0 0 8 1 0 0 22 0 1 0 669263719 107020288 11531 33554432000 4194304 4625164 140733745641888 18446744073709551615 218905730816 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1530/statm: 26128 11532 299 106 0 21631 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 104512

[startup+0.200253 s]
/proc/loadavg: 7.74 8.32 8.31 2/488 1530
/proc/meminfo: memFree=15980764/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=113316 CPUtime=0.19 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 19383 0 0 0 18 1 0 0 23 0 1 0 669263719 116035584 14261 33554432000 4194304 4625164 140733745641888 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1530/statm: 28329 14261 299 106 0 23832 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 113316

[startup+0.300237 s]
/proc/loadavg: 7.74 8.32 8.31 2/488 1530
/proc/meminfo: memFree=15980764/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=130024 CPUtime=0.29 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 25375 0 0 0 27 2 0 0 23 0 1 0 669263719 133144576 17596 33554432000 4194304 4625164 140733745641888 18446744073709551615 218905428437 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1530/statm: 32506 17619 299 106 0 28009 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 130024

[startup+0.700163 s]
/proc/loadavg: 7.74 8.32 8.31 2/488 1530
/proc/meminfo: memFree=15980764/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=180708 CPUtime=0.69 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 52460 0 0 0 63 6 0 0 25 0 1 0 669263719 185044992 28547 33554432000 4194304 4625164 140733745641888 18446744073709551615 4277645 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1530/statm: 45177 28571 301 106 0 40680 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 180708

[startup+1.50099 s]
/proc/loadavg: 7.28 8.22 8.28 9/495 1537
/proc/meminfo: memFree=15377828/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=659564 CPUtime=3.62 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 126363 0 0 0 347 15 0 0 25 0 4 0 669263719 675393536 93925 33554432000 4194304 4625164 140733745641888 18446744073709551615 4499479 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 164891 93925 344 106 0 160394 0
[pid=1530/tid=1535] ppid=1528 vsize=659564 CPUtime=0.71 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 6126 0 0 0 71 0 0 0 25 0 4 0 669263797 675393536 93925 33554432000 4194304 4625164 140733745641888 18446744073709551615 4375338 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=659564 CPUtime=0.71 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 12288 0 0 0 69 2 0 0 25 0 4 0 669263797 675393536 93925 33554432000 4194304 4625164 140733745641888 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=659564 CPUtime=0.71 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 3612 0 0 0 71 0 0 0 25 0 4 0 669263797 675393536 93925 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.62
Current children cumulated vsize (KiB) 659564

[startup+3.1007 s]
/proc/loadavg: 7.28 8.22 8.28 9/495 1538
/proc/meminfo: memFree=15325624/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=659564 CPUtime=10 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 134398 0 0 0 984 16 0 0 25 0 4 0 669263719 675393536 101404 33554432000 4194304 4625164 140733745641888 18446744073709551615 4390651 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 164891 101404 346 106 0 160394 0
[pid=1530/tid=1535] ppid=1528 vsize=659564 CPUtime=2.31 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 7393 0 0 0 230 1 0 0 25 0 4 0 669263797 675393536 101404 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=659564 CPUtime=2.3 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 12672 0 0 0 228 2 0 0 25 0 4 0 669263797 675393536 101404 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=659564 CPUtime=2.31 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 9108 0 0 0 230 1 0 0 25 0 4 0 669263797 675393536 101404 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351774 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 10
Current children cumulated vsize (KiB) 659564

[startup+6.30112 s]
/proc/loadavg: 7.34 8.22 8.27 9/495 1538
/proc/meminfo: memFree=15287108/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=668428 CPUtime=22.76 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 138269 0 0 0 2259 17 0 0 25 0 4 0 669263719 684470272 102662 33554432000 4194304 4625164 140733745641888 18446744073709551615 4390528 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 167107 102662 340 106 0 162610 0
[pid=1530/tid=1535] ppid=1528 vsize=668428 CPUtime=5.51 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 7924 0 0 0 550 1 0 0 25 0 4 0 669263797 684470272 102662 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288780 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=668428 CPUtime=5.51 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 13692 0 0 0 549 2 0 0 25 0 4 0 669263797 684470272 102662 33554432000 4194304 4625164 140733745641888 18446744073709551615 4352098 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=668428 CPUtime=5.51 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 10980 0 0 0 550 1 0 0 25 0 4 0 669263797 684470272 102662 33554432000 4194304 4625164 140733745641888 18446744073709551615 4555341 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 22.76
Current children cumulated vsize (KiB) 668428

[startup+12.701 s]
/proc/loadavg: 7.39 8.21 8.27 9/495 1538
/proc/meminfo: memFree=15251848/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=678328 CPUtime=48.25 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 146273 0 0 0 4807 18 0 0 25 0 4 0 669263719 694607872 105735 33554432000 4194304 4625164 140733745641888 18446744073709551615 4390569 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 169582 105735 340 106 0 165085 0
[pid=1530/tid=1535] ppid=1528 vsize=678328 CPUtime=11.91 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 9454 0 0 0 1190 1 0 0 25 0 4 0 669263797 694607872 105735 33554432000 4194304 4625164 140733745641888 18446744073709551615 4352562 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=678328 CPUtime=11.91 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 13757 0 0 0 1189 2 0 0 25 0 4 0 669263797 694607872 105735 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=678328 CPUtime=11.91 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 16925 0 0 0 1189 2 0 0 25 0 4 0 669263797 694607872 105735 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 48.25
Current children cumulated vsize (KiB) 678328

[startup+25.5006 s]
/proc/loadavg: 7.69 8.23 8.28 9/495 1538
/proc/meminfo: memFree=15175124/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=712320 CPUtime=99.23 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 189937 0 0 0 9900 23 0 0 25 0 4 0 669263719 729415680 115461 33554432000 4194304 4625164 140733745641888 18446744073709551615 4391840 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 178080 115461 345 106 0 173583 0
[pid=1530/tid=1535] ppid=1528 vsize=712320 CPUtime=24.71 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 15401 0 0 0 2469 2 0 0 25 0 4 0 669263797 729415680 115461 33554432000 4194304 4625164 140733745641888 18446744073709551615 4375338 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=712320 CPUtime=24.7 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 20006 0 0 0 2468 2 0 0 25 0 4 0 669263797 729415680 115461 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=712320 CPUtime=24.71 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 41922 0 0 0 2466 5 0 0 25 0 4 0 669263797 729415680 115461 33554432000 4194304 4625164 140733745641888 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 99.23
Current children cumulated vsize (KiB) 712320

[startup+51.101 s]
/proc/loadavg: 7.79 8.21 8.27 9/495 1539
/proc/meminfo: memFree=15089248/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=773496 CPUtime=201.21 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 287024 0 0 0 20083 38 0 0 25 0 4 0 669263719 792059904 127188 33554432000 4194304 4625164 140733745641888 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 193374 127188 351 106 0 188877 0
[pid=1530/tid=1535] ppid=1528 vsize=773496 CPUtime=50.3 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 28456 0 0 0 5026 4 0 0 25 0 4 0 669263797 792059904 127188 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=773496 CPUtime=50.3 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 27650 0 0 0 5027 3 0 0 25 0 4 0 669263797 792059904 127188 33554432000 4194304 4625164 140733745641888 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=773496 CPUtime=50.31 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 107903 0 0 0 5016 15 0 0 25 0 4 0 669263797 792059904 127188 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 201.21
Current children cumulated vsize (KiB) 773496

[startup+102.301 s]
/proc/loadavg: 8.07 8.22 8.27 9/495 1540
/proc/meminfo: memFree=14982976/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=773496 CPUtime=405.19 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 412255 0 0 0 40461 58 0 0 25 0 4 0 669263719 792059904 133871 33554432000 4194304 4625164 140733745641888 18446744073709551615 4278665 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 193374 133871 348 106 0 188877 0
[pid=1530/tid=1535] ppid=1528 vsize=773496 CPUtime=101.51 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 30876 0 0 0 10147 4 0 0 25 0 4 0 669263797 792059904 133871 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=773496 CPUtime=101.52 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 27967 0 0 0 10149 3 0 0 25 0 4 0 669263797 792059904 133871 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=773496 CPUtime=101.53 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 229112 0 0 0 10119 34 0 0 25 0 4 0 669263797 792059904 133871 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 405.19
Current children cumulated vsize (KiB) 773496

[startup+162.301 s]
/proc/loadavg: 8.12 8.21 8.26 9/495 1542
/proc/meminfo: memFree=14870340/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=839032 CPUtime=644.2 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 548362 0 0 0 64343 77 0 0 25 0 4 0 669263719 859168768 143381 33554432000 4194304 4625164 140733745641888 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 209758 143381 345 106 0 205261 0
[pid=1530/tid=1535] ppid=1528 vsize=839032 CPUtime=161.5 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 34337 0 0 0 16145 5 0 0 25 0 4 0 669263797 859168768 143381 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=839032 CPUtime=161.51 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 29004 0 0 0 16147 4 0 0 25 0 4 0 669263797 859168768 143381 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=839032 CPUtime=161.51 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 359286 0 0 0 16099 52 0 0 25 0 4 0 669263797 859168768 143381 33554432000 4194304 4625164 140733745641888 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 644.2
Current children cumulated vsize (KiB) 839032

[startup+222.319 s]
/proc/loadavg: 8.21 8.22 8.26 9/495 1543
/proc/meminfo: memFree=14763656/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=923812 CPUtime=883.29 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 676294 0 0 0 88231 98 0 0 25 0 4 0 669263719 945983488 152027 33554432000 4194304 4625164 140733745641888 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 230953 152027 345 106 0 226456 0
[pid=1530/tid=1535] ppid=1528 vsize=923812 CPUtime=221.52 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 37650 0 0 0 22146 6 0 0 25 0 4 0 669263797 945983488 152027 33554432000 4194304 4625164 140733745641888 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=923812 CPUtime=221.53 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 30035 0 0 0 22149 4 0 0 25 0 4 0 669263797 945983488 152027 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=923812 CPUtime=221.53 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 472109 0 0 0 22083 70 0 0 25 0 4 0 669263797 945983488 152027 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 883.29
Current children cumulated vsize (KiB) 923812

[startup+282.301 s]

################
# More data... #
################

[pid=1530] ppid=1528 vsize=1435200 CPUtime=2556.4 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 1783384 0 0 0 255369 271 0 0 25 0 4 0 669263719 1469644800 289639 33554432000 4194304 4625164 140733745641888 18446744073709551615 4509011 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 358800 289639 343 106 0 354303 0
[pid=1530/tid=1535] ppid=1528 vsize=1435200 CPUtime=641.51 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 114966 0 0 0 64133 18 0 0 25 0 4 0 669263797 1469644800 289639 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=1435200 CPUtime=641.52 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 99531 0 0 0 64137 15 0 0 25 0 4 0 669263797 1469644800 289639 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=1435200 CPUtime=641.53 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 1367527 0 0 0 63946 207 0 0 25 0 4 0 669263797 1469644800 289639 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2556.4
Current children cumulated vsize (KiB) 1435200

[startup+702.301 s]
/proc/loadavg: 8.06 8.10 8.17 9/495 1556
/proc/meminfo: memFree=13459092/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=1708660 CPUtime=2795.42 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 2046844 0 0 0 279235 307 0 0 25 0 4 0 669263719 1749667840 317004 33554432000 4194304 4625164 140733745641888 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 427165 317004 343 106 0 422668 0
[pid=1530/tid=1535] ppid=1528 vsize=1708660 CPUtime=701.51 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 161726 0 0 0 70127 24 0 0 25 0 4 0 669263797 1749667840 317004 33554432000 4194304 4625164 140733745641888 18446744073709551615 4327808 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=1708660 CPUtime=701.52 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 137409 0 0 0 70133 19 0 0 25 0 4 0 669263797 1749667840 317004 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351722 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=1708660 CPUtime=701.52 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 1508484 0 0 0 69926 226 0 0 25 0 4 0 669263797 1749667840 317004 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2795.42
Current children cumulated vsize (KiB) 1708660

[startup+762.301 s]
/proc/loadavg: 8.19 8.13 8.18 9/495 1558
/proc/meminfo: memFree=13342488/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=1789100 CPUtime=3034.46 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 2185306 0 0 0 303117 329 0 0 25 0 4 0 669263719 1832038400 337146 33554432000 4194304 4625164 140733745641888 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 447275 337146 343 106 0 442778 0
[pid=1530/tid=1535] ppid=1528 vsize=1789100 CPUtime=761.53 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 166571 0 0 0 76127 26 0 0 25 0 4 0 669263797 1832038400 337155 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=1789100 CPUtime=761.55 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 148117 0 0 0 76134 21 0 0 25 0 4 0 669263797 1832038400 337155 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=1789100 CPUtime=761.54 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 1628027 0 0 0 75911 243 0 0 25 0 4 0 669263797 1832038400 337155 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351795 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3034.46
Current children cumulated vsize (KiB) 1789100

[startup+822.3 s]
/proc/loadavg: 8.18 8.13 8.18 9/495 1559
/proc/meminfo: memFree=13247836/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=1871184 CPUtime=3273.46 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 2307267 0 0 0 326994 352 0 0 25 0 4 0 669263719 1916092416 352806 33554432000 4194304 4625164 140733745641888 18446744073709551615 4511798 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 467796 352806 345 106 0 463299 0
[pid=1530/tid=1535] ppid=1528 vsize=1871184 CPUtime=821.51 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 170788 0 0 0 82123 28 0 0 25 0 4 0 669263797 1916092416 352806 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=1871184 CPUtime=821.53 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 150408 0 0 0 82131 22 0 0 25 0 4 0 669263797 1916092416 352806 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=1871184 CPUtime=821.52 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 1741270 0 0 0 81890 262 0 0 25 0 4 0 669263797 1916092416 352806 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3273.46
Current children cumulated vsize (KiB) 1871184

[startup+882.32 s]
/proc/loadavg: 8.13 8.12 8.17 9/495 1561
/proc/meminfo: memFree=13146616/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=1871184 CPUtime=3512.56 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 2437503 0 0 0 350882 374 0 0 25 0 4 0 669263719 1916092416 364722 33554432000 4194304 4625164 140733745641888 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 467796 364722 343 106 0 463299 0
[pid=1530/tid=1535] ppid=1528 vsize=1871184 CPUtime=881.54 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 173877 0 0 0 88125 29 0 0 25 0 4 0 669263797 1916092416 364722 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=1871184 CPUtime=881.55 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 152396 0 0 0 88133 22 0 0 25 0 4 0 669263797 1916092416 364722 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288719 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=1871184 CPUtime=881.55 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 1864841 0 0 0 87873 282 0 0 25 0 4 0 669263797 1916092416 364722 33554432000 4194304 4625164 140733745641888 18446744073709551615 4327743 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3512.56
Current children cumulated vsize (KiB) 1871184

[startup+942.301 s]
/proc/loadavg: 8.11 8.11 8.16 9/495 1563
/proc/meminfo: memFree=13089532/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=1871184 CPUtime=3751.52 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 2534322 0 0 0 374763 389 0 0 25 0 4 0 669263719 1916092416 372174 33554432000 4194304 4625164 140733745641888 18446744073709551615 4509483 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 467796 372174 345 106 0 463299 0
[pid=1530/tid=1535] ppid=1528 vsize=1871184 CPUtime=941.52 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 174810 0 0 0 94122 30 0 0 25 0 4 0 669263797 1916092416 372174 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=1871184 CPUtime=941.53 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 152602 0 0 0 94131 22 0 0 25 0 4 0 669263797 1916092416 372174 33554432000 4194304 4625164 140733745641888 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=1871184 CPUtime=941.53 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 1960141 0 0 0 93857 296 0 0 25 0 4 0 669263797 1916092416 372174 33554432000 4194304 4625164 140733745641888 18446744073709551615 4352582 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3751.52
Current children cumulated vsize (KiB) 1871184

[startup+1002.3 s]
/proc/loadavg: 8.10 8.11 8.16 9/495 1564
/proc/meminfo: memFree=13038280/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=1937968 CPUtime=3990.53 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 2647499 0 0 0 398645 408 0 0 25 0 4 0 669263719 1984479232 380128 33554432000 4194304 4625164 140733745641888 18446744073709551615 4512487 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 484492 380128 344 106 0 479995 0
[pid=1530/tid=1535] ppid=1528 vsize=1937968 CPUtime=1001.52 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 176336 0 0 0 100121 31 0 0 25 0 4 0 669263797 1984479232 380128 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=1937968 CPUtime=1001.53 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 153310 0 0 0 100131 22 0 0 25 0 4 0 669263797 1984479232 380128 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=1937968 CPUtime=1001.54 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 2070835 0 0 0 99839 315 0 0 25 0 4 0 669263797 1984479232 380128 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3990.53
Current children cumulated vsize (KiB) 1937968

[startup+1062.3 s]
/proc/loadavg: 8.09 8.10 8.15 9/495 1566
/proc/meminfo: memFree=12987264/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=1939492 CPUtime=4229.57 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 2746799 0 0 0 422532 425 0 0 25 0 4 0 669263719 1986039808 387671 33554432000 4194304 4625164 140733745641888 18446744073709551615 4509483 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 484873 387671 346 106 0 480376 0
[pid=1530/tid=1535] ppid=1528 vsize=1939492 CPUtime=1061.53 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 178808 0 0 0 106121 32 0 0 25 0 4 0 669263797 1986039808 387671 33554432000 4194304 4625164 140733745641888 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=1939492 CPUtime=1061.53 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 153654 0 0 0 106131 22 0 0 25 0 4 0 669263797 1986039808 387671 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=1939492 CPUtime=1061.54 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 2167013 0 0 0 105824 330 0 0 25 0 4 0 669263797 1986039808 387671 33554432000 4194304 4625164 140733745641888 18446744073709551615 4334124 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4229.57
Current children cumulated vsize (KiB) 1939492

[startup+1122.3 s]
/proc/loadavg: 8.19 8.12 8.16 9/495 1567
/proc/meminfo: memFree=12925356/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=1939492 CPUtime=4468.59 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 2867528 0 0 0 446415 444 0 0 25 0 4 0 669263719 1986039808 394524 33554432000 4194304 4625164 140733745641888 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 484873 394524 344 106 0 480376 0
[pid=1530/tid=1535] ppid=1528 vsize=1939492 CPUtime=1121.53 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 180557 0 0 0 112120 33 0 0 25 0 4 0 669263797 1986039808 394524 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=1939492 CPUtime=1121.53 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 153914 0 0 0 112131 22 0 0 25 0 4 0 669263797 1986039808 394524 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=1939492 CPUtime=1121.54 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 2285414 0 0 0 111806 348 0 0 25 0 4 0 669263797 1986039808 394524 33554432000 4194304 4625164 140733745641888 18446744073709551615 4328596 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4468.59
Current children cumulated vsize (KiB) 1939492

[startup+1182.3 s]
/proc/loadavg: 8.23 8.15 8.16 9/495 1569
/proc/meminfo: memFree=12361120/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=1939492 CPUtime=4707.62 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 2970777 0 0 0 470300 462 0 0 25 0 4 0 669263719 1986039808 403504 33554432000 4194304 4625164 140733745641888 18446744073709551615 4508979 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 484873 403504 348 106 0 480376 0
[pid=1530/tid=1535] ppid=1528 vsize=1939492 CPUtime=1181.53 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 182984 0 0 0 118119 34 0 0 25 0 4 0 669263797 1986039808 403504 33554432000 4194304 4625164 140733745641888 18446744073709551615 4353075 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=1939492 CPUtime=1181.53 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 154637 0 0 0 118131 22 0 0 25 0 4 0 669263797 1986039808 403504 33554432000 4194304 4625164 140733745641888 18446744073709551615 4352731 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=1939492 CPUtime=1181.54 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 2384966 0 0 0 117789 365 0 0 25 0 4 0 669263797 1986039808 403504 33554432000 4194304 4625164 140733745641888 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4707.62
Current children cumulated vsize (KiB) 1939492



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205.5 s]
/proc/loadavg: 8.22 8.15 8.16 5/491 1571
/proc/meminfo: memFree=14384820/32951124 swapFree=62248504/67111528
[pid=1530] ppid=1528 vsize=1956348 CPUtime=4800.06 cores=1,3,5,7
/proc/1530/stat : 1530 (SArTagnan) R 1528 1530 1492 0 -1 4202496 3001936 0 0 0 479539 467 0 0 25 0 4 0 669263719 2003300352 408501 33554432000 4194304 4625164 140733745641888 18446744073709551615 4390555 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/1530/statm: 489087 408501 343 106 0 484590 0
[pid=1530/tid=1535] ppid=1528 vsize=1956348 CPUtime=1204.75 cores=1,3,5,7
/proc/1530/task/1535/stat : 1535 (SArTagnan) R 1528 1530 1492 0 -1 4202560 183544 0 0 0 120441 34 0 0 25 0 4 0 669263797 2003300352 408501 33554432000 4194304 4625164 140733745641888 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1530/tid=1536] ppid=1528 vsize=1956348 CPUtime=1204.75 cores=1,3,5,7
/proc/1530/task/1536/stat : 1536 (SArTagnan) R 1528 1530 1492 0 -1 4202560 155162 0 0 0 120453 22 0 0 25 0 4 0 669263797 2003300352 408501 33554432000 4194304 4625164 140733745641888 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=1530/tid=1537] ppid=1528 vsize=1956348 CPUtime=1204.75 cores=1,3,5,7
/proc/1530/task/1537/stat : 1537 (SArTagnan) R 1528 1530 1492 0 -1 4202560 2414816 0 0 0 120106 369 0 0 25 0 4 0 669263797 2003300352 408501 33554432000 4194304 4625164 140733745641888 18446744073709551615 4552399 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.06
Current children cumulated vsize (KiB) 1956348

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.59
CPU time (s): 4800.2
CPU user time (s): 4795.46
CPU system time (s): 4.73328
CPU usage (%): 398.163
Max. virtual memory (cumulated for all children) (KiB): 2015148

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.46
system time used= 4.73328
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3001936
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 152
involuntary context switches= 31779

runsolver used 5.09123 second user time and 14.6708 second system time

The end

Launcher Data 

Begin job on node137 at 2011-05-16 22:11:00
IDJOB=3386192
IDBENCH=20423
IDSOLVER=1871
FILE ID=node137/3386192-1305576659
RUNJOBID= node137-1305576659-1511
PBS_JOBID= 13350207
Free space on /tmp= 73616 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT07/industrial/palacios/medium/cube-11-h14-sat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386192-1305576659/watcher-3386192-1305576659 -o /tmp/evaluation-result-3386192-1305576659/solver-3386192-1305576659 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386192-1305576659.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7cc30e40be8c690e76c3fb158623be61
RANDOM SEED=2041762865

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15981168 kB
Buffers:        329468 kB
Cached:        4410376 kB
SwapCached:      25020 kB
Active:        6986576 kB
Inactive:      9702576 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15981168 kB
SwapTotal:    67111528 kB
SwapFree:     62248504 kB
Dirty:           51136 kB
Writeback:           0 kB
AnonPages:    11934216 kB
Mapped:          31176 kB
Slab:           139900 kB
PageTables:      68384 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 147022124 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73636 MiB
End job on node137 at 2011-05-16 22:31:08