Trace number 3371063

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.39 1202.82

General information on the benchmark

NameSAT05/crafted/jarvisalo05/mod2-rand3bip-sat/
mod2-rand3bip-sat-270-1.shuffled-as.sat05-2248.cnf
MD5SUM51d9aefd9da7f94abc32dd024090dc46
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.005998
Satisfiable
(Un)Satisfiability was proved
Number of variables270
Number of clauses1080
Sum of the clauses size3240
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31080
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371063-1305431182/watcher-3371063-1305431182 -o /tmp/evaluation-result-3371063-1305431182/solver-3371063-1305431182 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371063-1305431182.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.35 7.59 7.84 5/292 11488
/proc/meminfo: memFree=28236268/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=50164 CPUtime=0 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 419 1251 0 0 0 0 0 0 25 0 5 0 654716127 51367936 345 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 12541 345 168 55 0 10427 0
[pid=11488/tid=11494] ppid=11486 vsize=50164 CPUtime=0 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 25 1251 0 0 0 0 0 0 25 0 5 0 654716128 51367936 357 33554432000 4194304 4417452 140737480968512 18446744073709551615 4252216 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=50164 CPUtime=0 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 0 1251 0 0 0 0 0 0 25 0 5 0 654716128 51367936 357 33554432000 4194304 4417452 140737480968512 18446744073709551615 228122770417 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=50164 CPUtime=0 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 1 1251 0 0 0 0 0 0 25 0 5 0 654716128 51367936 357 33554432000 4194304 4417452 140737480968512 18446744073709551615 4302548 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=50164 CPUtime=0 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 2 1251 0 0 0 0 0 0 25 0 5 0 654716128 51367936 357 33554432000 4194304 4417452 140737480968512 18446744073709551615 4365973 0 0 4096 17442 0 0 0 -1 1 0 0 0

[startup+0.136624 s]
/proc/loadavg: 6.35 7.59 7.84 5/292 11488
/proc/meminfo: memFree=28236268/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=117540 CPUtime=0.51 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 1191 1251 0 0 51 0 0 0 25 0 5 0 654716127 120360960 827 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 29385 827 179 55 0 27271 0
[pid=11488/tid=11494] ppid=11486 vsize=117540 CPUtime=0.13 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 191 1251 0 0 13 0 0 0 25 0 5 0 654716128 120360960 827 33554432000 4194304 4417452 140737480968512 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=117540 CPUtime=0.12 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 133 1251 0 0 12 0 0 0 25 0 5 0 654716128 120360960 827 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=117540 CPUtime=0.12 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 254 1251 0 0 12 0 0 0 25 0 5 0 654716128 120360960 827 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364693 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=117540 CPUtime=0.12 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 210 1251 0 0 12 0 0 0 25 0 5 0 654716128 120360960 827 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.51
Current children cumulated vsize (KiB) 117540

[startup+0.200613 s]
/proc/loadavg: 6.35 7.59 7.84 5/292 11488
/proc/meminfo: memFree=28236268/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=118264 CPUtime=0.76 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 1604 1251 0 0 76 0 0 0 25 0 5 0 654716127 121102336 992 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 29566 992 179 55 0 27452 0
[pid=11488/tid=11494] ppid=11486 vsize=118264 CPUtime=0.19 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 356 1251 0 0 19 0 0 0 25 0 5 0 654716128 121102336 992 33554432000 4194304 4417452 140737480968512 18446744073709551615 4278500 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=118264 CPUtime=0.18 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 243 1251 0 0 18 0 0 0 25 0 5 0 654716128 121102336 992 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=118264 CPUtime=0.18 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 333 1251 0 0 18 0 0 0 25 0 5 0 654716128 121102336 992 33554432000 4194304 4417452 140737480968512 18446744073709551615 4354323 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=118264 CPUtime=0.19 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 269 1251 0 0 19 0 0 0 25 0 5 0 654716128 121102336 992 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.76
Current children cumulated vsize (KiB) 118264

[startup+0.300595 s]
/proc/loadavg: 6.35 7.59 7.84 5/292 11488
/proc/meminfo: memFree=28236268/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=118572 CPUtime=1.16 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 2097 1251 0 0 116 0 0 0 25 0 5 0 654716127 121417728 1096 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 29643 1096 179 55 0 27529 0
[pid=11488/tid=11494] ppid=11486 vsize=118572 CPUtime=0.29 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 484 1251 0 0 29 0 0 0 25 0 5 0 654716128 121417728 1096 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=118572 CPUtime=0.28 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 358 1251 0 0 28 0 0 0 25 0 5 0 654716128 121417728 1096 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=118572 CPUtime=0.28 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 451 1251 0 0 28 0 0 0 25 0 5 0 654716128 121417728 1096 33554432000 4194304 4417452 140737480968512 18446744073709551615 4365962 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=118572 CPUtime=0.29 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 401 1251 0 0 29 0 0 0 25 0 5 0 654716128 121417728 1096 33554432000 4194304 4417452 140737480968512 18446744073709551615 4365973 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 118572

[startup+0.700522 s]
/proc/loadavg: 6.35 7.59 7.84 5/292 11488
/proc/meminfo: memFree=28236268/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=120744 CPUtime=2.76 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 4342 1251 0 0 276 0 0 0 25 0 5 0 654716127 123641856 1652 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 30186 1652 179 55 0 28072 0
[pid=11488/tid=11494] ppid=11486 vsize=120744 CPUtime=0.69 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 970 1251 0 0 69 0 0 0 25 0 5 0 654716128 123641856 1652 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=120744 CPUtime=0.68 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 1011 1251 0 0 68 0 0 0 25 0 5 0 654716128 123641856 1652 33554432000 4194304 4417452 140737480968512 18446744073709551615 4365458 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=120744 CPUtime=0.68 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 1067 1251 0 0 68 0 0 0 25 0 5 0 654716128 123641856 1652 33554432000 4194304 4417452 140737480968512 18446744073709551615 4353585 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=120744 CPUtime=0.69 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 891 1251 0 0 69 0 0 0 25 0 5 0 654716128 123641856 1652 33554432000 4194304 4417452 140737480968512 18446744073709551615 4366126 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 120744

[startup+1.50038 s]
/proc/loadavg: 6.35 7.59 7.84 9/297 11498
/proc/meminfo: memFree=28228928/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=122552 CPUtime=5.95 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 7795 1251 0 0 594 1 0 0 25 0 5 0 654716127 125493248 2114 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 30638 2114 179 55 0 28524 0
[pid=11488/tid=11494] ppid=11486 vsize=122552 CPUtime=1.49 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 1760 1251 0 0 149 0 0 0 25 0 5 0 654716128 125493248 2114 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=122552 CPUtime=1.47 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 1830 1251 0 0 147 0 0 0 25 0 5 0 654716128 125493248 2114 33554432000 4194304 4417452 140737480968512 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=122552 CPUtime=1.48 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 1765 1251 0 0 148 0 0 0 25 0 5 0 654716128 125493248 2114 33554432000 4194304 4417452 140737480968512 18446744073709551615 4365996 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=122552 CPUtime=1.48 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 2037 1251 0 0 148 0 0 0 25 0 5 0 654716128 125493248 2114 33554432000 4194304 4417452 140737480968512 18446744073709551615 4365936 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 122552

[startup+3.10109 s]
/proc/loadavg: 6.35 7.59 7.84 9/297 11498
/proc/meminfo: memFree=28224712/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=125924 CPUtime=12.34 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 14756 1251 0 0 1232 2 0 0 25 0 5 0 654716127 128946176 2957 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 31481 2957 179 55 0 29367 0
[pid=11488/tid=11494] ppid=11486 vsize=125924 CPUtime=3.09 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 3440 1251 0 0 309 0 0 0 25 0 5 0 654716128 128946176 2957 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364885 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=125924 CPUtime=3.06 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 3262 1251 0 0 306 0 0 0 25 0 5 0 654716128 128946176 2957 33554432000 4194304 4417452 140737480968512 18446744073709551615 18446744073699065989 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=125924 CPUtime=3.08 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 3545 1251 0 0 308 0 0 0 25 0 5 0 654716128 128946176 2957 33554432000 4194304 4417452 140737480968512 18446744073709551615 4357572 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=125924 CPUtime=3.08 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 4106 1251 0 0 308 0 0 0 25 0 5 0 654716128 128946176 2957 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364614 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 125924

[startup+6.30051 s]
/proc/loadavg: 6.48 7.60 7.84 9/297 11498
/proc/meminfo: memFree=28220000/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=131868 CPUtime=25.11 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 26002 1251 0 0 2507 4 0 0 25 0 5 0 654716127 135032832 4443 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 32967 4443 179 55 0 30853 0
[pid=11488/tid=11494] ppid=11486 vsize=131868 CPUtime=6.29 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 5753 1251 0 0 628 1 0 0 25 0 5 0 654716128 135032832 4443 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=131868 CPUtime=6.23 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 5560 1251 0 0 623 0 0 0 25 0 5 0 654716128 135032832 4443 33554432000 4194304 4417452 140737480968512 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=131868 CPUtime=6.29 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 6404 1251 0 0 628 1 0 0 25 0 5 0 654716128 135032832 4443 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=131868 CPUtime=6.29 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 7882 1251 0 0 628 1 0 0 25 0 5 0 654716128 135032832 4443 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 131868

[startup+12.7004 s]
/proc/loadavg: 6.61 7.60 7.84 9/297 11498
/proc/meminfo: memFree=28214612/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=137236 CPUtime=50.65 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 44161 1251 0 0 5058 7 0 0 25 0 5 0 654716127 140529664 5766 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 34309 5766 179 55 0 32195 0
[pid=11488/tid=11494] ppid=11486 vsize=137236 CPUtime=12.69 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 10135 1251 0 0 1267 2 0 0 25 0 5 0 654716128 140529664 5766 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=137236 CPUtime=12.57 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 10049 1251 0 0 1256 1 0 0 25 0 5 0 654716128 140529664 5766 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=137236 CPUtime=12.68 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 10499 1251 0 0 1267 1 0 0 25 0 5 0 654716128 140529664 5766 33554432000 4194304 4417452 140737480968512 18446744073709551615 4365078 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=137236 CPUtime=12.69 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 13075 1251 0 0 1267 2 0 0 25 0 5 0 654716128 140529664 5766 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.65
Current children cumulated vsize (KiB) 137236

[startup+25.501 s]
/proc/loadavg: 6.91 7.62 7.84 9/297 11498
/proc/meminfo: memFree=28181928/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=153152 CPUtime=101.74 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 79698 1251 0 0 10161 13 0 0 25 0 5 0 654716127 156827648 9767 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 38288 9767 179 55 0 36174 0
[pid=11488/tid=11494] ppid=11486 vsize=153152 CPUtime=25.49 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 18123 1251 0 0 2546 3 0 0 25 0 5 0 654716128 156827648 9767 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=153152 CPUtime=25.25 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 18380 1251 0 0 2522 3 0 0 25 0 5 0 654716128 156827648 9767 33554432000 4194304 4417452 140737480968512 18446744073709551615 4250651 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=153152 CPUtime=25.49 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 18970 1251 0 0 2546 3 0 0 25 0 5 0 654716128 156827648 9767 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=153152 CPUtime=25.48 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 23822 1251 0 0 2545 3 0 0 25 0 5 0 654716128 156827648 9767 33554432000 4194304 4417452 140737480968512 18446744073709551615 4366813 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.74
Current children cumulated vsize (KiB) 153152

[startup+51.1004 s]
/proc/loadavg: 7.28 7.65 7.85 9/297 11499
/proc/meminfo: memFree=28168384/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=160628 CPUtime=203.9 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 129740 1251 0 0 20369 21 0 0 25 0 5 0 654716127 164483072 11641 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 40157 11641 179 55 0 38043 0
[pid=11488/tid=11494] ppid=11486 vsize=160628 CPUtime=51.09 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 28919 1251 0 0 5104 5 0 0 25 0 5 0 654716128 164483072 11641 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=160628 CPUtime=50.62 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 29283 1251 0 0 5058 4 0 0 25 0 5 0 654716128 164483072 11641 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=160628 CPUtime=51.08 cores=1,3,5,7

################
# More data... #
################

[pid=11488/tid=11495] ppid=11486 vsize=259696 CPUtime=755.39 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 170827 1251 0 0 75513 26 0 0 25 0 5 0 654716128 265928704 36376 33554432000 4194304 4417452 140737480968512 18446744073709551615 4365036 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=259696 CPUtime=762.31 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 212283 1251 0 0 76201 30 0 0 25 0 5 0 654716128 265928704 36376 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=259696 CPUtime=762.31 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 235936 1251 0 0 76198 33 0 0 25 0 5 0 654716128 265928704 36376 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3042.33
Current children cumulated vsize (KiB) 259696

[startup+822.301 s]
/proc/loadavg: 8.13 8.10 7.99 9/297 11519
/proc/meminfo: memFree=27473792/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=252280 CPUtime=3281.77 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 826281 1251 0 0 328054 123 0 0 25 0 5 0 654716127 258334720 34537 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 63070 34537 179 55 0 60956 0
[pid=11488/tid=11494] ppid=11486 vsize=252280 CPUtime=822.29 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 178927 1251 0 0 82201 28 0 0 25 0 5 0 654716128 258334720 34537 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=252280 CPUtime=814.84 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 178384 1251 0 0 81457 27 0 0 25 0 5 0 654716128 258334720 34537 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=252280 CPUtime=822.3 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 221376 1251 0 0 82199 31 0 0 25 0 5 0 654716128 258334720 34537 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=252280 CPUtime=822.3 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 247191 1251 0 0 82195 35 0 0 25 0 5 0 654716128 258334720 34537 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3281.77
Current children cumulated vsize (KiB) 252280

[startup+882.311 s]
/proc/loadavg: 8.12 8.11 8.00 9/297 11530
/proc/meminfo: memFree=27376860/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=268768 CPUtime=3521.24 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 860797 1251 0 0 351997 127 0 0 25 0 5 0 654716127 275218432 38644 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 67192 38644 179 55 0 65078 0
[pid=11488/tid=11494] ppid=11486 vsize=268768 CPUtime=882.3 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 187162 1251 0 0 88201 29 0 0 25 0 5 0 654716128 275218432 38644 33554432000 4194304 4417452 140737480968512 18446744073709551615 4251096 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=268768 CPUtime=874.3 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 185781 1251 0 0 87402 28 0 0 25 0 5 0 654716128 275218432 38644 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=268768 CPUtime=882.31 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 231112 1251 0 0 88199 32 0 0 25 0 5 0 654716128 275218432 38644 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=268768 CPUtime=882.3 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 256339 1251 0 0 88194 36 0 0 25 0 5 0 654716128 275218432 38644 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3521.24
Current children cumulated vsize (KiB) 268768

[startup+942.3 s]
/proc/loadavg: 8.11 8.11 8.00 9/297 11532
/proc/meminfo: memFree=27279392/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=257524 CPUtime=3760.67 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 896847 1251 0 0 375934 133 0 0 25 0 5 0 654716127 263704576 35859 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 64381 35859 179 55 0 62267 0
[pid=11488/tid=11494] ppid=11486 vsize=257524 CPUtime=942.29 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 198420 1251 0 0 94198 31 0 0 25 0 5 0 654716128 263704576 35859 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=257524 CPUtime=933.75 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 192594 1251 0 0 93346 29 0 0 25 0 5 0 654716128 263704576 35859 33554432000 4194304 4417452 140737480968512 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=257524 CPUtime=942.3 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 238666 1251 0 0 94197 33 0 0 25 0 5 0 654716128 263704576 35859 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=257524 CPUtime=942.29 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 266764 1251 0 0 94191 38 0 0 25 0 5 0 654716128 263704576 35859 33554432000 4194304 4417452 140737480968512 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3760.67
Current children cumulated vsize (KiB) 257524

[startup+1002.3 s]
/proc/loadavg: 8.15 8.12 8.01 9/297 11533
/proc/meminfo: memFree=27253376/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=251816 CPUtime=4000.12 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 927385 1251 0 0 399875 137 0 0 25 0 5 0 654716127 257859584 34422 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 62954 34422 179 55 0 60840 0
[pid=11488/tid=11494] ppid=11486 vsize=251816 CPUtime=1002.29 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 203768 1251 0 0 100197 32 0 0 25 0 5 0 654716128 257859584 34422 33554432000 4194304 4417452 140737480968512 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=251816 CPUtime=993.2 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 202396 1251 0 0 99290 30 0 0 25 0 5 0 654716128 257859584 34422 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=251816 CPUtime=1002.31 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 244091 1251 0 0 100197 34 0 0 25 0 5 0 654716128 257859584 34422 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=251816 CPUtime=1002.29 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 276727 1251 0 0 100190 39 0 0 25 0 5 0 654716128 257859584 34422 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4000.12
Current children cumulated vsize (KiB) 251816

[startup+1062.3 s]
/proc/loadavg: 8.20 8.13 8.01 9/297 11535
/proc/meminfo: memFree=27124096/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=291140 CPUtime=4239.58 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 964017 1251 0 0 423816 142 0 0 25 0 5 0 654716127 298127360 44256 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 72785 44256 179 55 0 70671 0
[pid=11488/tid=11494] ppid=11486 vsize=291140 CPUtime=1062.29 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 216204 1251 0 0 106195 34 0 0 25 0 5 0 654716128 298127360 44256 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=291140 CPUtime=1052.66 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 209913 1251 0 0 105235 31 0 0 25 0 5 0 654716128 298127360 44256 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=291140 CPUtime=1062.32 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 247943 1251 0 0 106197 35 0 0 25 0 5 0 654716128 298127360 44256 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364752 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=291140 CPUtime=1062.3 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 289554 1251 0 0 106189 41 0 0 25 0 5 0 654716128 298127360 44256 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4239.58
Current children cumulated vsize (KiB) 291140

[startup+1122.3 s]
/proc/loadavg: 8.40 8.19 8.04 9/297 11539
/proc/meminfo: memFree=27580428/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=281600 CPUtime=4479.04 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 988411 1251 0 0 447758 146 0 0 25 0 5 0 654716127 288358400 41867 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 70400 41867 179 55 0 68286 0
[pid=11488/tid=11494] ppid=11486 vsize=281600 CPUtime=1122.29 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 222228 1251 0 0 112194 35 0 0 25 0 5 0 654716128 288358400 41867 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=281600 CPUtime=1112.11 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 214924 1251 0 0 111179 32 0 0 25 0 5 0 654716128 288358400 41867 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=281600 CPUtime=1122.31 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 253447 1251 0 0 112196 35 0 0 25 0 5 0 654716128 288358400 41867 33554432000 4194304 4417452 140737480968512 18446744073709551615 4366082 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=281600 CPUtime=1122.29 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 297409 1251 0 0 112187 42 0 0 25 0 5 0 654716128 288358400 41867 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4479.04
Current children cumulated vsize (KiB) 281600

[startup+1182.3 s]
/proc/loadavg: 7.97 8.12 8.02 5/287 11559
/proc/meminfo: memFree=29107312/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=263684 CPUtime=4718.51 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 1019892 1251 0 0 471700 151 0 0 25 0 5 0 654716127 270012416 37400 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 65921 37400 179 55 0 63807 0
[pid=11488/tid=11494] ppid=11486 vsize=263684 CPUtime=1182.29 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 230211 1251 0 0 118193 36 0 0 25 0 5 0 654716128 270012416 37400 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=263684 CPUtime=1171.57 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 220301 1251 0 0 117124 33 0 0 25 0 5 0 654716128 270012416 37400 33554432000 4194304 4417452 140737480968512 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=263684 CPUtime=1182.32 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 262495 1251 0 0 118195 37 0 0 25 0 5 0 654716128 270012416 37400 33554432000 4194304 4417452 140737480968512 18446744073709551615 18446744073699065863 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=263684 CPUtime=1182.3 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 306482 1251 0 0 118186 44 0 0 25 0 5 0 654716128 270012416 37400 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4718.51
Current children cumulated vsize (KiB) 263684



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.8 s]
/proc/loadavg: 6.84 7.85 7.94 5/287 11560
/proc/meminfo: memFree=29092452/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=278596 CPUtime=4800.34 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 1033079 1251 0 0 479881 153 0 0 25 0 5 0 654716127 285282304 41132 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 69649 41132 179 55 0 67535 0
[pid=11488/tid=11494] ppid=11486 vsize=278596 CPUtime=1202.8 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 232066 1251 0 0 120244 36 0 0 25 0 5 0 654716128 285282304 41132 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=278596 CPUtime=1191.88 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 226341 1251 0 0 119154 34 0 0 25 0 5 0 654716128 285282304 41132 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=278596 CPUtime=1202.83 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 263651 1251 0 0 120246 37 0 0 25 0 5 0 654716128 285282304 41132 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=278596 CPUtime=1202.8 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 310618 1251 0 0 120236 44 0 0 25 0 5 0 654716128 285282304 41132 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 278596

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.8 s]
/proc/loadavg: 6.84 7.85 7.94 5/287 11560
/proc/meminfo: memFree=29092452/32951124 swapFree=54427468/67111528
[pid=11488] ppid=11486 vsize=278596 CPUtime=4800.34 cores=1,3,5,7
/proc/11488/stat : 11488 (plingeling) S 11486 11488 3918 0 -1 4202496 1033079 1251 0 0 479881 153 0 0 25 0 5 0 654716127 285282304 41132 33554432000 4194304 4417452 140737480968512 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/11488/statm: 69649 41132 179 55 0 67535 0
[pid=11488/tid=11494] ppid=11486 vsize=278596 CPUtime=1202.8 cores=1,3,5,7
/proc/11488/task/11494/stat : 11494 (plingeling) R 11486 11488 3918 0 -1 4202560 232066 1251 0 0 120244 36 0 0 25 0 5 0 654716128 285282304 41132 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=11488/tid=11495] ppid=11486 vsize=278596 CPUtime=1191.88 cores=1,3,5,7
/proc/11488/task/11495/stat : 11495 (plingeling) R 11486 11488 3918 0 -1 4202560 226341 1251 0 0 119154 34 0 0 25 0 5 0 654716128 285282304 41132 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=11488/tid=11496] ppid=11486 vsize=278596 CPUtime=1202.83 cores=1,3,5,7
/proc/11488/task/11496/stat : 11496 (plingeling) R 11486 11488 3918 0 -1 4202560 263651 1251 0 0 120246 37 0 0 25 0 5 0 654716128 285282304 41132 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=11488/tid=11497] ppid=11486 vsize=278596 CPUtime=1202.8 cores=1,3,5,7
/proc/11488/task/11497/stat : 11497 (plingeling) R 11486 11488 3918 0 -1 4202560 310618 1251 0 0 120236 44 0 0 25 0 5 0 654716128 285282304 41132 33554432000 4194304 4417452 140737480968512 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 278596

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.82
CPU time (s): 4800.39
CPU user time (s): 4798.85
CPU system time (s): 1.53977
CPU usage (%): 399.094
Max. virtual memory (cumulated for all children) (KiB): 306772

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.85
system time used= 1.53977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1034330
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 85
involuntary context switches= 34137

runsolver used 2.88356 second user time and 8.07177 second system time

The end

Launcher Data 

Begin job on node138 at 2011-05-15 05:46:22
IDJOB=3371063
IDBENCH=85304
IDSOLVER=1848
FILE ID=node138/3371063-1305431182
RUNJOBID= node138-1305431138-11310
PBS_JOBID= 13324591
Free space on /tmp= 73460 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT05/crafted/jarvisalo05/mod2-rand3bip-sat/mod2-rand3bip-sat-270-1.shuffled-as.sat05-2248.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371063-1305431182/watcher-3371063-1305431182 -o /tmp/evaluation-result-3371063-1305431182/solver-3371063-1305431182 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371063-1305431182.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 51d9aefd9da7f94abc32dd024090dc46
RANDOM SEED=740256613

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28236424 kB
Buffers:        260420 kB
Cached:        3351336 kB
SwapCached:      18472 kB
Active:        1890436 kB
Inactive:      2602896 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28236424 kB
SwapTotal:    67111528 kB
SwapFree:     54427468 kB
Dirty:          153056 kB
Writeback:           4 kB
AnonPages:      874440 kB
Mapped:           9468 kB
Slab:           117148 kB
PageTables:      41752 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 40406160 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73616 MiB
End job on node138 at 2011-05-15 06:06:26