Trace number 3371461

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.42 1203.04

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top23.cnf
MD5SUM6ee28191d649bfeef8c7d8c569a3cd59
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark703.609
Satisfiable
(Un)Satisfiability was proved
Number of variables60823
Number of clauses193450
Sum of the clauses size472824
Maximum clause length2414
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2117689
Number of clauses of size 374473
Number of clauses of size 4275
Number of clauses of size 521
Number of clauses of size over 5991

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371461-1305423047/watcher-3371461-1305423047 -o /tmp/evaluation-result-3371461-1305423047/solver-3371461-1305423047 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371461-1305423047.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.99 6.58 7.37 2/282 6528
/proc/meminfo: memFree=18909384/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=14048 CPUtime=0 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) R 6526 6528 5706 0 -1 4202496 1593 1252 0 0 0 0 0 0 21 0 1 0 653904337 14385152 1522 33554432000 4194304 4417452 140736768173200 18446744073709551615 274664505455 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/6528/statm: 3512 1531 144 55 0 1398 0

[startup+0.030464 s]
/proc/loadavg: 3.99 6.58 7.37 2/282 6528
/proc/meminfo: memFree=18909384/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=19752 CPUtime=0.02 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) R 6526 6528 5706 0 -1 4202496 3049 1252 0 0 2 0 0 0 21 0 1 0 653904337 20226048 2962 33554432000 4194304 4417452 140736768173200 18446744073709551615 4260062 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/6528/statm: 4938 2962 149 55 0 2824 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 19752

[startup+0.100455 s]
/proc/loadavg: 3.99 6.58 7.37 2/282 6528
/proc/meminfo: memFree=18909384/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=29724 CPUtime=0.09 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) R 6526 6528 5706 0 -1 4202496 5550 1252 0 0 9 0 0 0 21 0 1 0 653904337 30437376 5455 33554432000 4194304 4417452 140736768173200 18446744073709551615 274664808192 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/6528/statm: 7431 5455 149 55 0 5317 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 29724

[startup+0.300379 s]
/proc/loadavg: 3.99 6.58 7.37 2/282 6528
/proc/meminfo: memFree=18909384/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=155484 CPUtime=0.48 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 15282 1252 0 0 46 2 0 0 22 0 5 0 653904337 159215616 11751 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 38871 11751 171 55 0 36757 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 155484

[startup+0.700308 s]
/proc/loadavg: 3.99 6.58 7.37 2/282 6528
/proc/meminfo: memFree=18909384/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=157408 CPUtime=2.08 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 20445 1252 0 0 205 3 0 0 22 0 5 0 653904337 161185792 12345 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 39352 12345 174 55 0 37238 0
Current children cumulated CPU time (s) 2.08
Current children cumulated vsize (KiB) 157408

[startup+1.50117 s]
/proc/loadavg: 3.99 6.58 7.37 10/291 6542
/proc/meminfo: memFree=18829712/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=157408 CPUtime=5.27 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 24770 1252 0 0 524 3 0 0 22 0 5 0 653904337 161185792 12686 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 39352 12686 174 55 0 37238 0
[pid=6528/tid=6539] ppid=6526 vsize=157408 CPUtime=1.26 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 2275 1252 0 0 126 0 0 0 25 0 5 0 653904360 161185792 12686 33554432000 4194304 4417452 140736768173200 18446744073709551615 4281408 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=157408 CPUtime=1.25 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 3477 1252 0 0 125 0 0 0 25 0 5 0 653904360 161185792 12686 33554432000 4194304 4417452 140736768173200 18446744073709551615 4287492 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=157408 CPUtime=1.25 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 8244 1252 0 0 124 1 0 0 25 0 5 0 653904360 161185792 12686 33554432000 4194304 4417452 140736768173200 18446744073709551615 4286414 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=157408 CPUtime=1.26 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 1289 1252 0 0 126 0 0 0 25 0 5 0 653904360 161185792 12686 33554432000 4194304 4417452 140736768173200 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.27
Current children cumulated vsize (KiB) 157408

[startup+3.10089 s]
/proc/loadavg: 4.31 6.61 7.37 10/291 6542
/proc/meminfo: memFree=18829464/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=175664 CPUtime=11.66 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 31210 1252 0 0 1162 4 0 0 22 0 5 0 653904337 179879936 17299 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 43916 17299 179 55 0 41802 0
[pid=6528/tid=6539] ppid=6526 vsize=175664 CPUtime=2.86 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 4544 1252 0 0 286 0 0 0 25 0 5 0 653904360 179879936 17299 33554432000 4194304 4417452 140736768173200 18446744073709551615 4239952 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=175664 CPUtime=2.85 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 5274 1252 0 0 285 0 0 0 25 0 5 0 653904360 179879936 17299 33554432000 4194304 4417452 140736768173200 18446744073709551615 4253228 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=175664 CPUtime=2.83 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 10618 1252 0 0 282 1 0 0 25 0 5 0 653904360 179879936 17299 33554432000 4194304 4417452 140736768173200 18446744073709551615 4250003 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=175664 CPUtime=2.86 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 1289 1252 0 0 286 0 0 0 25 0 5 0 653904360 179879936 17299 33554432000 4194304 4417452 140736768173200 18446744073709551615 4237002 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11.66
Current children cumulated vsize (KiB) 175664

[startup+6.30033 s]
/proc/loadavg: 4.31 6.61 7.37 10/291 6542
/proc/meminfo: memFree=18782732/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=189384 CPUtime=24.43 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 34960 1252 0 0 2438 5 0 0 22 0 5 0 653904337 193929216 21049 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 47346 21049 179 55 0 45232 0
[pid=6528/tid=6539] ppid=6526 vsize=189384 CPUtime=6.06 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 5234 1252 0 0 606 0 0 0 25 0 5 0 653904360 193929216 21049 33554432000 4194304 4417452 140736768173200 18446744073709551615 4235411 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=189384 CPUtime=6.06 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 6990 1252 0 0 605 1 0 0 25 0 5 0 653904360 193929216 21049 33554432000 4194304 4417452 140736768173200 18446744073709551615 4250017 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=189384 CPUtime=6 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 10938 1252 0 0 599 1 0 0 25 0 5 0 653904360 193929216 21049 33554432000 4194304 4417452 140736768173200 18446744073709551615 4236255 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=189384 CPUtime=6.06 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 2313 1252 0 0 606 0 0 0 25 0 5 0 653904360 193929216 21049 33554432000 4194304 4417452 140736768173200 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.43
Current children cumulated vsize (KiB) 189384

[startup+12.7012 s]
/proc/loadavg: 4.61 6.63 7.37 10/291 6543
/proc/meminfo: memFree=18786648/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=180360 CPUtime=49.98 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 35871 1252 0 0 4993 5 0 0 22 0 5 0 653904337 184688640 18505 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 45090 18505 179 55 0 42976 0
[pid=6528/tid=6539] ppid=6526 vsize=180360 CPUtime=12.46 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 5234 1252 0 0 1246 0 0 0 25 0 5 0 653904360 184688640 18505 33554432000 4194304 4417452 140736768173200 18446744073709551615 4236816 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=180360 CPUtime=12.46 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 7374 1252 0 0 1245 1 0 0 25 0 5 0 653904360 184688640 18505 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364576 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=180360 CPUtime=12.34 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 11354 1252 0 0 1233 1 0 0 25 0 5 0 653904360 184688640 18505 33554432000 4194304 4417452 140736768173200 18446744073709551615 4331729 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=180360 CPUtime=12.46 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 2424 1252 0 0 1246 0 0 0 25 0 5 0 653904360 184688640 18505 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 49.98
Current children cumulated vsize (KiB) 180360

[startup+25.501 s]
/proc/loadavg: 5.49 6.73 7.39 10/291 6543
/proc/meminfo: memFree=18779092/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=184420 CPUtime=101.05 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 36958 1252 0 0 10100 5 0 0 22 0 5 0 653904337 188846080 19527 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 46105 19527 180 55 0 43991 0
[pid=6528/tid=6539] ppid=6526 vsize=184420 CPUtime=25.26 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 5253 1252 0 0 2526 0 0 0 25 0 5 0 653904360 188846080 19527 33554432000 4194304 4417452 140736768173200 18446744073709551615 4253167 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=184420 CPUtime=25.26 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 7395 1252 0 0 2525 1 0 0 25 0 5 0 653904360 188846080 19527 33554432000 4194304 4417452 140736768173200 18446744073709551615 4249976 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=184420 CPUtime=25.02 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 12401 1252 0 0 2501 1 0 0 25 0 5 0 653904360 188846080 19527 33554432000 4194304 4417452 140736768173200 18446744073709551615 4257383 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=184420 CPUtime=25.26 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 2424 1252 0 0 2526 0 0 0 25 0 5 0 653904360 188846080 19527 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.05
Current children cumulated vsize (KiB) 184420

[startup+51.1006 s]
/proc/loadavg: 6.35 6.83 7.41 10/291 6544
/proc/meminfo: memFree=18724544/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=208560 CPUtime=203.23 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 48175 1252 0 0 20316 7 0 0 22 0 5 0 653904337 213565440 24318 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 52140 24318 180 55 0 50026 0
[pid=6528/tid=6539] ppid=6526 vsize=208560 CPUtime=50.86 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 9396 1252 0 0 5085 1 0 0 25 0 5 0 653904360 213565440 24318 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=208560 CPUtime=50.85 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 12011 1252 0 0 5084 1 0 0 25 0 5 0 653904360 213565440 24318 33554432000 4194304 4417452 140736768173200 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=208560 CPUtime=50.39 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 13769 1252 0 0 5038 1 0 0 25 0 5 0 653904360 213565440 24318 33554432000 4194304 4417452 140736768173200 18446744073709551615 4357238 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=208560 CPUtime=50.86 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 3514 1252 0 0 5086 0 0 0 25 0 5 0 653904360 213565440 24318 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.23
Current children cumulated vsize (KiB) 208560

[startup+102.311 s]
/proc/loadavg: 7.34 7.02 7.44 9/291 6545
/proc/meminfo: memFree=18658316/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=233376 CPUtime=407.6 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 71026 1252 0 0 40750 10 0 0 22 0 5 0 653904337 238977024 30522 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 58344 30522 180 55 0 56230 0
[pid=6528/tid=6539] ppid=6526 vsize=233376 CPUtime=102.07 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 14156 1252 0 0 10205 2 0 0 25 0 5 0 653904360 238977024 30522 33554432000 4194304 4417452 140736768173200 18446744073709551615 4366203 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=233376 CPUtime=102.07 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 24819 1252 0 0 10203 4 0 0 25 0 5 0 653904360 238977024 30522 33554432000 4194304 4417452 140736768173200 18446744073709551615 4366113 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=233376 CPUtime=101.14 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 18042 1252 0 0 10112 2 0 0 25 0 5 0 653904360 238977024 30522 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=233376 CPUtime=102.07 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 4524 1252 0 0 10207 0 0 0 25 0 5 0 653904360 238977024 30522 33554432000 4194304 4417452 140736768173200 18446744073709551615 4236941 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 407.6
Current children cumulated vsize (KiB) 233376

[startup+162.3 s]
/proc/loadavg: 7.77 7.20 7.47 10/291 6547
/proc/meminfo: memFree=18622596/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=260228 CPUtime=647.02 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 118154 1252 0 0 64683 19 0 0 22 0 5 0 653904337 266473472 37267 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 65057 37267 180 55 0 62943 0
[pid=6528/tid=6539] ppid=6526 vsize=260228 CPUtime=162.06 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 30996 1252 0 0 16201 5 0 0 25 0 5 0 653904360 266473472 37267 33554432000 4194304 4417452 140736768173200 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=260228 CPUtime=162.05 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 39316 1252 0 0 16199 6 0 0 25 0 5 0 653904360 266473472 37267 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=260228 CPUtime=160.59 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 24490 1252 0 0 16056 3 0 0 25 0 5 0 653904360 266473472 37267 33554432000 4194304 4417452 140736768173200 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=260228 CPUtime=162.06 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 13867 1252 0 0 16205 1 0 0 25 0 5 0 653904360 266473472 37267 33554432000 4194304 4417452 140736768173200 18446744073709551615 4237273 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 647.02
Current children cumulated vsize (KiB) 260228


################
# More data... #
################

[pid=6528/tid=6540] ppid=6526 vsize=521268 CPUtime=702.07 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 194946 1252 0 0 70175 32 0 0 25 0 5 0 653904360 533778432 102527 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=521268 CPUtime=695.68 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 159801 1252 0 0 69541 27 0 0 25 0 5 0 653904360 533778432 102527 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364711 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=521268 CPUtime=702.07 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 116362 1252 0 0 70188 19 0 0 25 0 5 0 653904360 533778432 102527 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364440 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2802.12
Current children cumulated vsize (KiB) 521268

[startup+762.311 s]
/proc/loadavg: 8.08 7.97 7.76 9/291 6563
/proc/meminfo: memFree=18126368/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=447260 CPUtime=3041.59 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 736052 1252 0 0 304035 124 0 0 22 0 5 0 653904337 457994240 84025 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 111815 84025 180 55 0 109701 0
[pid=6528/tid=6539] ppid=6526 vsize=447260 CPUtime=762.05 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 221461 1252 0 0 76168 37 0 0 25 0 5 0 653904360 457994240 84025 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=447260 CPUtime=762.07 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 208767 1252 0 0 76172 35 0 0 25 0 5 0 653904360 457994240 84025 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=447260 CPUtime=755.14 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 166142 1252 0 0 75486 28 0 0 25 0 5 0 653904360 457994240 84025 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=447260 CPUtime=762.08 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 130197 1252 0 0 76186 22 0 0 25 0 5 0 653904360 457994240 84025 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3041.59
Current children cumulated vsize (KiB) 447260

[startup+822.3 s]
/proc/loadavg: 8.15 8.00 7.78 10/291 6564
/proc/meminfo: memFree=18007196/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=555560 CPUtime=3281.01 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 777805 1252 0 0 327970 131 0 0 22 0 5 0 653904337 568893440 111100 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 138890 111100 180 55 0 136776 0
[pid=6528/tid=6539] ppid=6526 vsize=555560 CPUtime=822.04 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 224710 1252 0 0 82167 37 0 0 25 0 5 0 653904360 568893440 111100 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=555560 CPUtime=822.06 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 222972 1252 0 0 82169 37 0 0 25 0 5 0 653904360 568893440 111100 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=555560 CPUtime=814.59 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 175246 1252 0 0 81430 29 0 0 25 0 5 0 653904360 568893440 111100 33554432000 4194304 4417452 140736768173200 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=555560 CPUtime=822.07 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 145392 1252 0 0 82182 25 0 0 25 0 5 0 653904360 568893440 111100 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3281.01
Current children cumulated vsize (KiB) 555560

[startup+882.301 s]
/proc/loadavg: 8.10 8.01 7.80 10/291 6566
/proc/meminfo: memFree=18002972/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=565024 CPUtime=3520.47 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 819310 1252 0 0 351910 137 0 0 22 0 5 0 653904337 578584576 113466 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 141256 113466 180 55 0 139142 0
[pid=6528/tid=6539] ppid=6526 vsize=565024 CPUtime=882.03 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 237620 1252 0 0 88164 39 0 0 25 0 5 0 653904360 578584576 113466 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=565024 CPUtime=882.06 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 226002 1252 0 0 88168 38 0 0 25 0 5 0 653904360 578584576 113466 33554432000 4194304 4417452 140736768173200 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=565024 CPUtime=874.05 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 188217 1252 0 0 87374 31 0 0 25 0 5 0 653904360 578584576 113466 33554432000 4194304 4417452 140736768173200 18446744073709551615 4247481 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=565024 CPUtime=882.07 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 157986 1252 0 0 88181 26 0 0 25 0 5 0 653904360 578584576 113466 33554432000 4194304 4417452 140736768173200 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3520.47
Current children cumulated vsize (KiB) 565024

[startup+942.301 s]
/proc/loadavg: 8.14 8.04 7.82 9/291 6567
/proc/meminfo: memFree=17856892/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=673600 CPUtime=3759.92 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 886017 1252 0 0 375843 149 0 0 22 0 5 0 653904337 689766400 140610 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 168400 140610 180 55 0 166286 0
[pid=6528/tid=6539] ppid=6526 vsize=673600 CPUtime=942.03 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 241122 1252 0 0 94163 40 0 0 25 0 5 0 653904360 689766400 140610 33554432000 4194304 4417452 140736768173200 18446744073709551615 4366117 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=673600 CPUtime=942.06 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 260004 1252 0 0 94162 44 0 0 25 0 5 0 653904360 689766400 140610 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=673600 CPUtime=933.51 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 207169 1252 0 0 93316 35 0 0 25 0 5 0 653904360 689766400 140610 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=673600 CPUtime=942.07 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 168237 1252 0 0 94179 28 0 0 25 0 5 0 653904360 689766400 140610 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3759.92
Current children cumulated vsize (KiB) 673600

[startup+1002.3 s]
/proc/loadavg: 8.09 8.04 7.83 10/291 6569
/proc/meminfo: memFree=17772192/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=710524 CPUtime=3999.35 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 930397 1252 0 0 399778 157 0 0 22 0 5 0 653904337 727576576 149841 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 177631 149841 180 55 0 175517 0
[pid=6528/tid=6539] ppid=6526 vsize=710524 CPUtime=1002.01 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 265395 1252 0 0 100158 43 0 0 25 0 5 0 653904360 727576576 149841 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=710524 CPUtime=1002.05 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 268196 1252 0 0 100160 45 0 0 25 0 5 0 653904360 727576576 149841 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=710524 CPUtime=992.95 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 207169 1252 0 0 99260 35 0 0 25 0 5 0 653904360 727576576 149841 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=710524 CPUtime=1002.07 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 180152 1252 0 0 100177 30 0 0 25 0 5 0 653904360 727576576 149841 33554432000 4194304 4417452 140736768173200 18446744073709551615 4356992 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3999.35
Current children cumulated vsize (KiB) 710524

[startup+1062.3 s]
/proc/loadavg: 8.08 8.05 7.84 10/291 6571
/proc/meminfo: memFree=17855628/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=594860 CPUtime=4238.81 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 993278 1252 0 0 423713 168 0 0 22 0 5 0 653904337 609136640 120925 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 148715 120925 180 55 0 146601 0
[pid=6528/tid=6539] ppid=6526 vsize=594860 CPUtime=1062.02 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 297527 1252 0 0 106152 50 0 0 25 0 5 0 653904360 609136640 120925 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=594860 CPUtime=1062.06 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 274176 1252 0 0 106159 47 0 0 25 0 5 0 653904360 609136640 120925 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=594860 CPUtime=1052.41 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 221425 1252 0 0 105205 36 0 0 25 0 5 0 653904360 609136640 120925 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=594860 CPUtime=1062.07 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 190665 1252 0 0 106175 32 0 0 25 0 5 0 653904360 609136640 120925 33554432000 4194304 4417452 140736768173200 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4238.81
Current children cumulated vsize (KiB) 594860

[startup+1122.3 s]
/proc/loadavg: 8.06 8.05 7.85 9/291 6572
/proc/meminfo: memFree=17840736/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=534808 CPUtime=4478.26 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 1022571 1252 0 0 447653 173 0 0 22 0 5 0 653904337 547643392 105912 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 133702 105912 180 55 0 131588 0
[pid=6528/tid=6539] ppid=6526 vsize=534808 CPUtime=1122.01 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 298680 1252 0 0 112151 50 0 0 25 0 5 0 653904360 547643392 105912 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=534808 CPUtime=1122.06 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 277871 1252 0 0 112159 47 0 0 25 0 5 0 653904360 547643392 105912 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=534808 CPUtime=1111.86 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 231137 1252 0 0 111148 38 0 0 25 0 5 0 653904360 547643392 105912 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=534808 CPUtime=1122.07 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 205398 1252 0 0 112173 34 0 0 25 0 5 0 653904360 547643392 105912 33554432000 4194304 4417452 140736768173200 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4478.26
Current children cumulated vsize (KiB) 534808

[startup+1182.3 s]
/proc/loadavg: 8.06 8.05 7.86 10/291 6574
/proc/meminfo: memFree=17703944/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=659804 CPUtime=4717.73 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 1058741 1252 0 0 471595 178 0 0 22 0 5 0 653904337 675639296 137161 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 164951 137161 180 55 0 162837 0
[pid=6528/tid=6539] ppid=6526 vsize=659804 CPUtime=1182.02 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 309919 1252 0 0 118150 52 0 0 25 0 5 0 653904360 675639296 137161 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=659804 CPUtime=1182.06 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 288732 1252 0 0 118157 49 0 0 25 0 5 0 653904360 675639296 137161 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=659804 CPUtime=1171.32 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 239329 1252 0 0 117093 39 0 0 25 0 5 0 653904360 675639296 137161 33554432000 4194304 4417452 140736768173200 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=659804 CPUtime=1182.08 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 211276 1252 0 0 118172 36 0 0 25 0 5 0 653904360 675639296 137161 33554432000 4194304 4417452 140736768173200 18446744073709551615 4365959 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4717.73
Current children cumulated vsize (KiB) 659804



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203 s]
/proc/loadavg: 8.10 8.06 7.87 9/291 6574
/proc/meminfo: memFree=17627556/32951132 swapFree=67093824/67111528
[pid=6528] ppid=6526 vsize=677984 CPUtime=4800.35 cores=1,3,5,7
/proc/6528/stat : 6528 (plingeling) S 6526 6528 5706 0 -1 4202496 1068853 1252 0 0 479855 180 0 0 22 0 5 0 653904337 694255616 141706 33554432000 4194304 4417452 140736768173200 18446744073709551615 274676611045 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6528/statm: 169496 141706 180 55 0 167382 0
[pid=6528/tid=6539] ppid=6526 vsize=677984 CPUtime=1202.73 cores=1,3,5,7
/proc/6528/task/6539/stat : 6539 (plingeling) R 6526 6528 5706 0 -1 4202560 309919 1252 0 0 120221 52 0 0 25 0 5 0 653904360 694255616 141706 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6528/tid=6540] ppid=6526 vsize=677984 CPUtime=1202.78 cores=1,3,5,7
/proc/6528/task/6540/stat : 6540 (plingeling) R 6526 6528 5706 0 -1 4202560 292691 1252 0 0 120228 50 0 0 25 0 5 0 653904360 694255616 141706 33554432000 4194304 4417452 140736768173200 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6528/tid=6541] ppid=6526 vsize=677984 CPUtime=1191.83 cores=1,3,5,7
/proc/6528/task/6541/stat : 6541 (plingeling) R 6526 6528 5706 0 -1 4202560 240467 1252 0 0 119144 39 0 0 25 0 5 0 653904360 694255616 141706 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6528/tid=6542] ppid=6526 vsize=677984 CPUtime=1202.78 cores=1,3,5,7
/proc/6528/task/6542/stat : 6542 (plingeling) R 6526 6528 5706 0 -1 4202560 216291 1252 0 0 120242 36 0 0 25 0 5 0 653904360 694255616 141706 33554432000 4194304 4417452 140736768173200 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 677984

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.04
CPU time (s): 4800.42
CPU user time (s): 4798.59
CPU system time (s): 1.83172
CPU usage (%): 399.024
Max. virtual memory (cumulated for all children) (KiB): 783372

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.59
system time used= 1.83172
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1070105
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 144
involuntary context switches= 33910

runsolver used 2.97755 second user time and 7.96979 second system time

The end

Launcher Data 

Begin job on node131 at 2011-05-15 03:30:47
IDJOB=3371461
IDBENCH=83114
IDSOLVER=1848
FILE ID=node131/3371461-1305423047
RUNJOBID= node131-1305423047-6504
PBS_JOBID= 13324564
Free space on /tmp= 73684 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top23.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371461-1305423047/watcher-3371461-1305423047 -o /tmp/evaluation-result-3371461-1305423047/solver-3371461-1305423047 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371461-1305423047.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6ee28191d649bfeef8c7d8c569a3cd59
RANDOM SEED=69421644

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      18909540 kB
Buffers:        278544 kB
Cached:        3776764 kB
SwapCached:       1504 kB
Active:       10592344 kB
Inactive:      3191948 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      18909540 kB
SwapTotal:    67111528 kB
SwapFree:     67093824 kB
Dirty:            6268 kB
Writeback:          56 kB
AnonPages:     9728084 kB
Mapped:          27112 kB
Slab:           164200 kB
PageTables:      31496 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 28023812 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73684 MiB
End job on node131 at 2011-05-15 03:50:52