Trace number 3371172

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.47 1203.08

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v2100c215164g4.cnf
MD5SUM399c54da7337981a88a374a67e87ba30
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2100
Number of clauses215164
Sum of the clauses size432288
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2215094
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 570

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371172-1305419005/watcher-3371172-1305419005 -o /tmp/evaluation-result-3371172-1305419005/solver-3371172-1305419005 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371172-1305419005.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.40 7.73 7.96 1/298 22373
/proc/meminfo: memFree=27735736/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=8728 CPUtime=0 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 215 0 0 0 0 0 0 0 21 0 1 0 653498997 8937472 146 33554432000 4194304 4417452 140733589282624 18446744073709551615 210204647168 0 0 4096 0 18446744071562362840 0 0 17 4 0 0 0
/proc/22373/statm: 2182 146 122 55 0 68 0

[startup+0.0947299 s]
/proc/loadavg: 6.40 7.73 7.96 1/298 22373
/proc/meminfo: memFree=27735736/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=18384 CPUtime=0.06 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) R 22371 22373 21663 0 -1 4202496 2657 1250 0 2 6 0 0 0 21 0 1 0 653498997 18825216 2587 33554432000 4194304 4417452 140733589282624 18446744073709551615 210204647168 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/22373/statm: 4596 2587 148 55 0 2482 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 18384

[startup+0.100717 s]
/proc/loadavg: 6.40 7.73 7.96 1/298 22373
/proc/meminfo: memFree=27735736/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=22480 CPUtime=0.06 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) R 22371 22373 21663 0 -1 4202496 3203 1250 0 2 6 0 0 0 21 0 1 0 653498997 23019520 3133 33554432000 4194304 4417452 140733589282624 18446744073709551615 210204341341 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/22373/statm: 5620 3154 148 55 0 3506 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 22480

[startup+0.300578 s]
/proc/loadavg: 6.40 7.73 7.96 1/298 22373
/proc/meminfo: memFree=27735736/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=73756 CPUtime=0.67 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 6570 1250 0 2 66 1 0 0 21 0 5 0 653498997 75526144 6254 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 18439 6254 176 55 0 16325 0
Current children cumulated CPU time (s) 0.67
Current children cumulated vsize (KiB) 73756

[startup+0.700512 s]
/proc/loadavg: 6.40 7.73 7.96 1/298 22373
/proc/meminfo: memFree=27735736/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=90688 CPUtime=2.26 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 18347 1250 0 2 224 2 0 0 21 0 5 0 653498997 92864512 10459 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 22672 10459 180 55 0 20558 0
Current children cumulated CPU time (s) 2.26
Current children cumulated vsize (KiB) 90688

[startup+1.50038 s]
/proc/loadavg: 6.52 7.74 7.96 10/304 22387
/proc/meminfo: memFree=27651564/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=99764 CPUtime=5.45 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 24757 1250 0 2 542 3 0 0 21 0 5 0 653498997 102158336 12728 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 24941 12728 180 55 0 22827 0
[pid=22373/tid=22384] ppid=22371 vsize=99764 CPUtime=1.33 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 4202 1250 0 2 133 0 0 0 25 0 5 0 653499013 102158336 12728 33554432000 4194304 4417452 140733589282624 18446744073709551615 4236239 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=99764 CPUtime=1.31 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 3816 1250 0 2 131 0 0 0 25 0 5 0 653499013 102158336 12728 33554432000 4194304 4417452 140733589282624 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=99764 CPUtime=1.32 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 4112 1250 0 2 132 0 0 0 25 0 5 0 653499013 102158336 12728 33554432000 4194304 4417452 140733589282624 18446744073709551615 4376709 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=99764 CPUtime=1.33 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 7910 1250 0 2 132 1 0 0 25 0 5 0 653499013 102158336 12728 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.45
Current children cumulated vsize (KiB) 99764

[startup+3.10111 s]
/proc/loadavg: 6.52 7.74 7.96 10/304 22387
/proc/meminfo: memFree=27635448/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=116024 CPUtime=11.84 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 32838 1250 0 2 1180 4 0 0 21 0 5 0 653498997 118808576 16793 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 29006 16793 180 55 0 26892 0
[pid=22373/tid=22384] ppid=22371 vsize=116024 CPUtime=2.93 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 5288 1250 0 2 293 0 0 0 25 0 5 0 653499013 118808576 16793 33554432000 4194304 4417452 140733589282624 18446744073709551615 4249347 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=116024 CPUtime=2.9 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 3816 1250 0 2 290 0 0 0 25 0 5 0 653499013 118808576 16793 33554432000 4194304 4417452 140733589282624 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=116024 CPUtime=2.92 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 4112 1250 0 2 292 0 0 0 25 0 5 0 653499013 118808576 16793 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=116024 CPUtime=2.93 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 14905 1250 0 2 291 2 0 0 25 0 5 0 653499013 118808576 16793 33554432000 4194304 4417452 140733589282624 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.84
Current children cumulated vsize (KiB) 116024

[startup+6.30058 s]
/proc/loadavg: 6.52 7.74 7.96 10/304 22387
/proc/meminfo: memFree=27620448/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=125944 CPUtime=24.61 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 45062 1250 0 2 2455 6 0 0 21 0 5 0 653498997 128966656 19273 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 31486 19273 180 55 0 29372 0
[pid=22373/tid=22384] ppid=22371 vsize=125944 CPUtime=6.13 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 5288 1250 0 2 613 0 0 0 25 0 5 0 653499013 128966656 19273 33554432000 4194304 4417452 140733589282624 18446744073709551615 4226982 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=125944 CPUtime=6.07 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 3816 1250 0 2 607 0 0 0 25 0 5 0 653499013 128966656 19273 33554432000 4194304 4417452 140733589282624 18446744073709551615 4250348 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=125944 CPUtime=6.12 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 4624 1250 0 2 612 0 0 0 25 0 5 0 653499013 128966656 19273 33554432000 4194304 4417452 140733589282624 18446744073709551615 4258550 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=125944 CPUtime=6.13 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 26617 1250 0 2 609 4 0 0 25 0 5 0 653499013 128966656 19273 33554432000 4194304 4417452 140733589282624 18446744073709551615 4353504 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.61
Current children cumulated vsize (KiB) 125944

[startup+12.7005 s]
/proc/loadavg: 6.75 7.75 7.96 10/304 22387
/proc/meminfo: memFree=27529068/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=144532 CPUtime=50.16 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 66643 1250 0 2 5007 9 0 0 21 0 5 0 653498997 148000768 23920 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 36133 23920 180 55 0 34019 0
[pid=22373/tid=22384] ppid=22371 vsize=144532 CPUtime=12.53 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 6373 1250 0 2 1253 0 0 0 25 0 5 0 653499013 148000768 23920 33554432000 4194304 4417452 140733589282624 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=144532 CPUtime=12.41 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 5987 1250 0 2 1241 0 0 0 25 0 5 0 653499013 148000768 23920 33554432000 4194304 4417452 140733589282624 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=144532 CPUtime=12.52 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 4624 1250 0 2 1252 0 0 0 25 0 5 0 653499013 148000768 23920 33554432000 4194304 4417452 140733589282624 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=144532 CPUtime=12.53 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 44942 1250 0 2 1247 6 0 0 25 0 5 0 653499013 148000768 23920 33554432000 4194304 4417452 140733589282624 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.16
Current children cumulated vsize (KiB) 144532

[startup+25.5004 s]
/proc/loadavg: 6.94 7.75 7.96 10/304 22388
/proc/meminfo: memFree=27459876/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=227388 CPUtime=101.23 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 105317 1250 0 2 10109 14 0 0 21 0 5 0 653498997 232845312 44634 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 56847 44634 180 55 0 54733 0
[pid=22373/tid=22384] ppid=22371 vsize=227388 CPUtime=25.32 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 6847 1250 0 2 2532 0 0 0 25 0 5 0 653499013 232845312 44634 33554432000 4194304 4417452 140733589282624 18446744073709551615 4343748 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=227388 CPUtime=25.09 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 5987 1250 0 2 2509 0 0 0 25 0 5 0 653499013 232845312 44634 33554432000 4194304 4417452 140733589282624 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=227388 CPUtime=25.32 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 6088 1250 0 2 2532 0 0 0 25 0 5 0 653499013 232845312 44634 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=227388 CPUtime=25.33 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 81678 1250 0 2 2522 11 0 0 25 0 5 0 653499013 232845312 44634 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.23
Current children cumulated vsize (KiB) 227388

[startup+51.1011 s]
/proc/loadavg: 7.38 7.79 7.96 10/304 22389
/proc/meminfo: memFree=27401372/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=267480 CPUtime=203.4 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 152533 1250 0 2 20318 22 0 0 21 0 5 0 653498997 273899520 38274 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 66870 38274 180 55 0 64756 0
[pid=22373/tid=22384] ppid=22371 vsize=267480 CPUtime=50.91 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 7961 1250 0 2 5091 0 0 0 25 0 5 0 653499013 273899520 38274 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=267480 CPUtime=50.46 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 6813 1250 0 2 5046 0 0 0 25 0 5 0 653499013 273899520 38274 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=267480 CPUtime=50.92 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 7807 1250 0 2 5092 0 0 0 25 0 5 0 653499013 273899520 38274 33554432000 4194304 4417452 140733589282624 18446744073709551615 4248936 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=267480 CPUtime=50.93 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 125235 1250 0 2 5075 18 0 0 25 0 5 0 653499013 273899520 38274 33554432000 4194304 4417452 140733589282624 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 203.4
Current children cumulated vsize (KiB) 267480

[startup+102.311 s]
/proc/loadavg: 7.75 7.82 7.96 10/304 22390
/proc/meminfo: memFree=27264196/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=357040 CPUtime=407.77 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 231836 1250 0 2 40743 34 0 0 21 0 5 0 653498997 365608960 60696 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 89260 60696 180 55 0 87146 0
[pid=22373/tid=22384] ppid=22371 vsize=357040 CPUtime=102.12 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 8725 1250 0 2 10212 0 0 0 25 0 5 0 653499013 365608960 60696 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=357040 CPUtime=101.21 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 7102 1250 0 2 10120 1 0 0 25 0 5 0 653499013 365608960 60696 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=357040 CPUtime=102.14 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 7807 1250 0 2 10213 1 0 0 25 0 5 0 653499013 365608960 60696 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=357040 CPUtime=102.14 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 203485 1250 0 2 10184 30 0 0 25 0 5 0 653499013 365608960 60696 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 407.77
Current children cumulated vsize (KiB) 357040

[startup+162.301 s]
/proc/loadavg: 7.91 7.85 7.96 10/304 22391
/proc/meminfo: memFree=26820604/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=572624 CPUtime=647.17 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 289828 1250 0 2 64676 41 0 0 21 0 5 0 653498997 586366976 114592 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 143156 114592 180 55 0 141042 0
[pid=22373/tid=22384] ppid=22371 vsize=572624 CPUtime=162.1 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 10002 1250 0 2 16209 1 0 0 25 0 5 0 653499013 586366976 114592 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=572624 CPUtime=160.66 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 7102 1250 0 2 16065 1 0 0 25 0 5 0 653499013 586366976 114592 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=572624 CPUtime=162.13 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 9172 1250 0 2 16212 1 0 0 25 0 5 0 653499013 586366976 114592 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=572624 CPUtime=162.13 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 258835 1250 0 2 16176 37 0 0 25 0 5 0 653499013 586366976 114592 33554432000 4194304 4417452 140733589282624 18446744073709551615 4357229 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 647.17
Current children cumulated vsize (KiB) 572624


################
# More data... #
################

[pid=22373/tid=22385] ppid=22371 vsize=1251124 CPUtime=695.74 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 16080 1250 0 2 69572 2 0 0 25 0 5 0 653499013 1281150976 282060 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=1251124 CPUtime=702.13 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 31833 1250 0 2 70210 3 0 0 25 0 5 0 653499013 1281150976 282060 33554432000 4194304 4417452 140733589282624 18446744073709551615 4232680 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=1251124 CPUtime=702.14 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 573294 1250 0 2 70126 88 0 0 25 0 5 0 653499013 1281150976 282060 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2802.17
Current children cumulated vsize (KiB) 1251124

[startup+762.311 s]
/proc/loadavg: 8.02 8.03 8.00 10/304 22407
/proc/meminfo: memFree=25719224/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=1397284 CPUtime=3041.66 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 687480 1250 0 2 304061 105 0 0 21 0 5 0 653498997 1430818816 320757 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 349321 320757 180 55 0 347207 0
[pid=22373/tid=22384] ppid=22371 vsize=1397284 CPUtime=762 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 26794 1250 0 2 76197 3 0 0 25 0 5 0 653499013 1430818816 320757 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=1397284 CPUtime=755.21 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 18288 1250 0 2 75518 3 0 0 25 0 5 0 653499013 1430818816 320757 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=1397284 CPUtime=762.14 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 31833 1250 0 2 76211 3 0 0 25 0 5 0 653499013 1430818816 320757 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=1397284 CPUtime=762.14 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 605848 1250 0 2 76120 94 0 0 25 0 5 0 653499013 1430818816 320757 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3041.66
Current children cumulated vsize (KiB) 1397284

[startup+822.3 s]
/proc/loadavg: 8.04 8.04 8.00 10/304 22409
/proc/meminfo: memFree=26193480/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=790120 CPUtime=3281.07 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 742645 1250 0 2 327992 115 0 0 21 0 5 0 653498997 809082880 168966 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 197530 168966 180 55 0 195416 0
[pid=22373/tid=22384] ppid=22371 vsize=790120 CPUtime=821.98 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 35523 1250 0 2 82194 4 0 0 25 0 5 0 653499013 809082880 168966 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=790120 CPUtime=814.66 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 18288 1250 0 2 81463 3 0 0 25 0 5 0 653499013 809082880 168966 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=790120 CPUtime=822.13 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 31833 1250 0 2 82210 3 0 0 25 0 5 0 653499013 809082880 168966 33554432000 4194304 4417452 140733589282624 18446744073709551615 4366082 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=790120 CPUtime=822.14 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 652284 1250 0 2 82111 103 0 0 25 0 5 0 653499013 809082880 168966 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3281.07
Current children cumulated vsize (KiB) 790120

[startup+882.3 s]
/proc/loadavg: 8.05 8.04 8.00 10/304 22411
/proc/meminfo: memFree=26164292/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=861324 CPUtime=3520.51 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 760446 1250 0 2 351934 117 0 0 21 0 5 0 653498997 881995776 186767 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 215331 186767 180 55 0 213217 0
[pid=22373/tid=22384] ppid=22371 vsize=861324 CPUtime=881.96 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 37075 1250 0 2 88192 4 0 0 25 0 5 0 653499013 881995776 186767 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=861324 CPUtime=874.11 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 20599 1250 0 2 87408 3 0 0 25 0 5 0 653499013 881995776 186767 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=861324 CPUtime=882.13 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 31833 1250 0 2 88210 3 0 0 25 0 5 0 653499013 881995776 186767 33554432000 4194304 4417452 140733589282624 18446744073709551615 4260039 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=861324 CPUtime=882.14 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 666222 1250 0 2 88109 105 0 0 25 0 5 0 653499013 881995776 186767 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3520.51
Current children cumulated vsize (KiB) 861324

[startup+942.3 s]
/proc/loadavg: 8.13 8.06 8.01 10/304 22413
/proc/meminfo: memFree=25887860/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=981088 CPUtime=3759.95 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 790387 1250 0 2 375874 121 0 0 21 0 5 0 653498997 1004634112 216708 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 245272 216708 180 55 0 243158 0
[pid=22373/tid=22384] ppid=22371 vsize=981088 CPUtime=941.95 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 37075 1250 0 2 94191 4 0 0 25 0 5 0 653499013 1004634112 216708 33554432000 4194304 4417452 140733589282624 18446744073709551615 4309871 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=981088 CPUtime=933.55 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 20599 1250 0 2 93352 3 0 0 25 0 5 0 653499013 1004634112 216708 33554432000 4194304 4417452 140733589282624 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=981088 CPUtime=942.13 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 31833 1250 0 2 94210 3 0 0 25 0 5 0 653499013 1004634112 216708 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=981088 CPUtime=942.14 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 696163 1250 0 2 94106 108 0 0 25 0 5 0 653499013 1004634112 216708 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3759.95
Current children cumulated vsize (KiB) 981088

[startup+1002.3 s]
/proc/loadavg: 8.12 8.06 8.00 10/304 22414
/proc/meminfo: memFree=25789136/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=1100012 CPUtime=3999.38 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 820118 1250 0 2 399814 124 0 0 21 0 5 0 653498997 1126412288 246439 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 275003 246439 180 55 0 272889 0
[pid=22373/tid=22384] ppid=22371 vsize=1100012 CPUtime=1001.94 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 37075 1250 0 2 100190 4 0 0 25 0 5 0 653499013 1126412288 246439 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=1100012 CPUtime=993 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 20599 1250 0 2 99297 3 0 0 25 0 5 0 653499013 1126412288 246439 33554432000 4194304 4417452 140733589282624 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=1100012 CPUtime=1002.13 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 31833 1250 0 2 100210 3 0 0 25 0 5 0 653499013 1126412288 246439 33554432000 4194304 4417452 140733589282624 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=1100012 CPUtime=1002.14 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 725894 1250 0 2 100102 112 0 0 25 0 5 0 653499013 1126412288 246439 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3999.38
Current children cumulated vsize (KiB) 1100012

[startup+1062.3 s]
/proc/loadavg: 8.18 8.08 8.01 10/304 22415
/proc/meminfo: memFree=25572960/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=1165548 CPUtime=4238.83 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 836502 1250 0 2 423756 127 0 0 21 0 5 0 653498997 1193521152 262823 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 291387 262823 180 55 0 289273 0
[pid=22373/tid=22384] ppid=22371 vsize=1165548 CPUtime=1061.93 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 37075 1250 0 2 106189 4 0 0 25 0 5 0 653499013 1193521152 262823 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=1165548 CPUtime=1052.47 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 20599 1250 0 2 105244 3 0 0 25 0 5 0 653499013 1193521152 262823 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=1165548 CPUtime=1062.13 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 31833 1250 0 2 106210 3 0 0 25 0 5 0 653499013 1193521152 262823 33554432000 4194304 4417452 140733589282624 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=1165548 CPUtime=1062.14 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 742278 1250 0 2 106099 115 0 0 25 0 5 0 653499013 1193521152 262823 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4238.83
Current children cumulated vsize (KiB) 1165548

[startup+1122.3 s]
/proc/loadavg: 8.13 8.08 8.01 10/304 22417
/proc/meminfo: memFree=25941204/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=1237940 CPUtime=4478.28 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 854600 1250 0 2 447697 131 0 0 21 0 5 0 653498997 1267650560 280921 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 309485 280921 180 55 0 307371 0
[pid=22373/tid=22384] ppid=22371 vsize=1237940 CPUtime=1121.92 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 40165 1250 0 2 112188 4 0 0 25 0 5 0 653499013 1267650560 280921 33554432000 4194304 4417452 140733589282624 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=1237940 CPUtime=1111.92 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 20599 1250 0 2 111189 3 0 0 25 0 5 0 653499013 1267650560 280921 33554432000 4194304 4417452 140733589282624 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=1237940 CPUtime=1122.13 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 31833 1250 0 2 112210 3 0 0 25 0 5 0 653499013 1267650560 280921 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=1237940 CPUtime=1122.14 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 757286 1250 0 2 112096 118 0 0 25 0 5 0 653499013 1267650560 280921 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4478.28
Current children cumulated vsize (KiB) 1237940

[startup+1182.3 s]
/proc/loadavg: 8.16 8.10 8.01 10/304 22419
/proc/meminfo: memFree=25903232/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=1326928 CPUtime=4717.73 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 877096 1250 0 2 471637 136 0 0 21 0 5 0 653498997 1358774272 303168 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 331732 303168 180 55 0 329618 0
[pid=22373/tid=22384] ppid=22371 vsize=1326928 CPUtime=1181.91 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 40414 1250 0 2 118187 4 0 0 25 0 5 0 653499013 1358774272 303168 33554432000 4194304 4417452 140733589282624 18446744073709551615 4357269 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=1326928 CPUtime=1171.38 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 20599 1250 0 2 117135 3 0 0 25 0 5 0 653499013 1358774272 303168 33554432000 4194304 4417452 140733589282624 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=1326928 CPUtime=1182.13 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 31833 1250 0 2 118210 3 0 0 25 0 5 0 653499013 1358774272 303168 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=1326928 CPUtime=1182.15 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 779533 1250 0 2 118091 124 0 0 25 0 5 0 653499013 1358774272 303168 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4717.73
Current children cumulated vsize (KiB) 1326928



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203 s]
/proc/loadavg: 8.11 8.09 8.01 5/298 22420
/proc/meminfo: memFree=26549788/32951124 swapFree=63649232/67111528
[pid=22373] ppid=22371 vsize=1294160 CPUtime=4800.36 cores=0,2,4,6
/proc/22373/stat : 22373 (plingeling) S 22371 22373 21663 0 -1 4202496 877096 1250 0 2 479899 137 0 0 21 0 5 0 653498997 1325219840 294976 33554432000 4194304 4417452 140733589282624 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22373/statm: 323540 294976 180 55 0 321426 0
[pid=22373/tid=22384] ppid=22371 vsize=1294160 CPUtime=1202.61 cores=0,2,4,6
/proc/22373/task/22384/stat : 22384 (plingeling) R 22371 22373 21663 0 -1 4202560 40414 1250 0 2 120257 4 0 0 25 0 5 0 653499013 1325219840 294976 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22373/tid=22385] ppid=22371 vsize=1294160 CPUtime=1191.89 cores=0,2,4,6
/proc/22373/task/22385/stat : 22385 (plingeling) R 22371 22373 21663 0 -1 4202560 20599 1250 0 2 119186 3 0 0 25 0 5 0 653499013 1325219840 294976 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22373/tid=22386] ppid=22371 vsize=1294160 CPUtime=1202.84 cores=0,2,4,6
/proc/22373/task/22386/stat : 22386 (plingeling) R 22371 22373 21663 0 -1 4202560 31833 1250 0 2 120281 3 0 0 25 0 5 0 653499013 1325219840 294976 33554432000 4194304 4417452 140733589282624 18446744073709551615 4251008 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22373/tid=22387] ppid=22371 vsize=1294160 CPUtime=1202.86 cores=0,2,4,6
/proc/22373/task/22387/stat : 22387 (plingeling) R 22371 22373 21663 0 -1 4202560 779533 1250 0 2 120162 124 0 0 25 0 5 0 653499013 1325219840 294976 33554432000 4194304 4417452 140733589282624 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 1294160

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.08
CPU time (s): 4800.47
CPU user time (s): 4799.03
CPU system time (s): 1.43278
CPU usage (%): 399.015
Max. virtual memory (cumulated for all children) (KiB): 1397284

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.03
system time used= 1.43278
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 878346
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 129
involuntary context switches= 24200

runsolver used 3.17652 second user time and 7.77382 second system time

The end

Launcher Data 

Begin job on node130 at 2011-05-15 02:23:25
IDJOB=3371172
IDBENCH=71308
IDSOLVER=1848
FILE ID=node130/3371172-1305419005
RUNJOBID= node130-1305419005-22348
PBS_JOBID= 13324556
Free space on /tmp= 73424 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v2100c215164g4.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371172-1305419005/watcher-3371172-1305419005 -o /tmp/evaluation-result-3371172-1305419005/solver-3371172-1305419005 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371172-1305419005.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 399c54da7337981a88a374a67e87ba30
RANDOM SEED=2065034378

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27735900 kB
Buffers:        266872 kB
Cached:        3623340 kB
SwapCached:      10248 kB
Active:        1148432 kB
Inactive:      3796324 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27735900 kB
SwapTotal:    67111528 kB
SwapFree:     63649232 kB
Dirty:            3944 kB
Writeback:           0 kB
AnonPages:     1052228 kB
Mapped:          13276 kB
Slab:           183212 kB
PageTables:      25184 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 51531356 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73424 MiB
End job on node130 at 2011-05-15 02:43:30