Trace number 3371008

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.11 1202.86

General information on the benchmark

NameCRAFTED/rbsat/crafted/forced/
rbsat-v760c43649gyes5.cnf
MD5SUMe7d4dc25f0d8e558fb091b1e566deab7
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.32395
Satisfiable
(Un)Satisfiability was proved
Number of variables760
Number of clauses43649
Sum of the clauses size87978
Maximum clause length19
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 243609
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371008-1305420210/watcher-3371008-1305420210 -o /tmp/evaluation-result-3371008-1305420210/solver-3371008-1305420210 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371008-1305420210.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.11 8.09 8.01 5/299 22483
/proc/meminfo: memFree=27732308/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=9768 CPUtime=0 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) R 22481 22483 21663 0 -1 4202496 501 1254 0 0 0 0 0 0 25 0 1 0 653619511 10002432 432 33554432000 4194304 4417452 140734601840368 18446744073709551615 210204341229 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/22483/statm: 2442 440 147 55 0 328 0

[startup+0.0353419 s]
/proc/loadavg: 8.11 8.09 8.01 5/299 22483
/proc/meminfo: memFree=27732308/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=119992 CPUtime=0.04 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 1477 1254 0 0 4 0 0 0 25 0 5 0 653619511 122871808 1404 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 29998 1404 171 55 0 27884 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 119992

[startup+0.135326 s]
/proc/loadavg: 8.11 8.09 8.01 5/299 22483
/proc/meminfo: memFree=27732308/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=121680 CPUtime=0.43 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 2881 1254 0 0 43 0 0 0 25 0 5 0 653619511 124600320 1855 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 30420 1855 176 55 0 28306 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 121680

[startup+0.300299 s]
/proc/loadavg: 8.11 8.09 8.01 5/299 22483
/proc/meminfo: memFree=27732308/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=125380 CPUtime=1.09 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 4164 1254 0 0 109 0 0 0 25 0 5 0 653619511 128389120 2793 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 31345 2793 179 55 0 29231 0
Current children cumulated CPU time (s) 1.09
Current children cumulated vsize (KiB) 125380

[startup+0.700232 s]
/proc/loadavg: 8.11 8.09 8.01 5/299 22483
/proc/meminfo: memFree=27732308/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=131512 CPUtime=2.7 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 6674 1254 0 0 269 1 0 0 25 0 5 0 653619511 134668288 4326 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 32878 4326 179 55 0 30764 0
Current children cumulated CPU time (s) 2.7
Current children cumulated vsize (KiB) 131512

[startup+1.5011 s]
/proc/loadavg: 8.10 8.09 8.01 9/304 22493
/proc/meminfo: memFree=27706104/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=133260 CPUtime=5.89 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 10228 1254 0 0 588 1 0 0 25 0 5 0 653619511 136458240 4794 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 33315 4794 179 55 0 31201 0
[pid=22483/tid=22490] ppid=22481 vsize=133260 CPUtime=1.47 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 653 1254 0 0 147 0 0 0 25 0 5 0 653619514 136458240 4794 33554432000 4194304 4417452 140734601840368 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=133260 CPUtime=1.46 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 431 1254 0 0 146 0 0 0 25 0 5 0 653619514 136458240 4794 33554432000 4194304 4417452 140734601840368 18446744073709551615 4236362 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=133260 CPUtime=1.46 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 1711 1254 0 0 146 0 0 0 25 0 5 0 653619514 136458240 4794 33554432000 4194304 4417452 140734601840368 18446744073709551615 4366074 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=133260 CPUtime=1.45 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 5982 1254 0 0 145 0 0 0 25 0 5 0 653619514 136458240 4794 33554432000 4194304 4417452 140734601840368 18446744073709551615 4320823 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.89
Current children cumulated vsize (KiB) 133260

[startup+3.10083 s]
/proc/loadavg: 8.10 8.09 8.01 9/304 22493
/proc/meminfo: memFree=27696556/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=135384 CPUtime=12.27 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 16336 1254 0 0 1225 2 0 0 25 0 5 0 653619511 138633216 5294 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 33846 5294 179 55 0 31732 0
[pid=22483/tid=22490] ppid=22481 vsize=135384 CPUtime=3.07 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 853 1254 0 0 307 0 0 0 25 0 5 0 653619514 138633216 5294 33554432000 4194304 4417452 140734601840368 18446744073709551615 4258201 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=135384 CPUtime=3.06 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 832 1254 0 0 306 0 0 0 25 0 5 0 653619514 138633216 5294 33554432000 4194304 4417452 140734601840368 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=135384 CPUtime=3.06 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 2726 1254 0 0 306 0 0 0 25 0 5 0 653619514 138633216 5294 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364440 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=135384 CPUtime=3.04 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 10474 1254 0 0 303 1 0 0 25 0 5 0 653619514 138633216 5294 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.27
Current children cumulated vsize (KiB) 135384

[startup+6.3003 s]
/proc/loadavg: 8.10 8.08 8.01 10/304 22493
/proc/meminfo: memFree=27677548/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=146288 CPUtime=25.05 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 32137 1254 0 0 2501 4 0 0 25 0 5 0 653619511 149798912 8021 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 36572 8021 180 55 0 34458 0
[pid=22483/tid=22490] ppid=22481 vsize=146288 CPUtime=6.26 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 3278 1254 0 0 626 0 0 0 25 0 5 0 653619514 149798912 8021 33554432000 4194304 4417452 140734601840368 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=146288 CPUtime=6.26 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 1888 1254 0 0 626 0 0 0 25 0 5 0 653619514 149798912 8021 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=146288 CPUtime=6.26 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 6338 1254 0 0 626 0 0 0 25 0 5 0 653619514 149798912 8021 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=146288 CPUtime=6.21 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 19182 1254 0 0 619 2 0 0 25 0 5 0 653619514 149798912 8021 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.05
Current children cumulated vsize (KiB) 146288

[startup+12.7002 s]
/proc/loadavg: 8.09 8.08 8.01 9/304 22494
/proc/meminfo: memFree=27645632/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=164052 CPUtime=50.58 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 62523 1254 0 0 5050 8 0 0 25 0 5 0 653619511 167989248 12462 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 41013 12462 180 55 0 38899 0
[pid=22483/tid=22490] ppid=22481 vsize=164052 CPUtime=12.66 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 9673 1254 0 0 1265 1 0 0 25 0 5 0 653619514 167989248 12462 33554432000 4194304 4417452 140734601840368 18446744073709551615 4275939 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=164052 CPUtime=12.65 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 7615 1254 0 0 1265 0 0 0 25 0 5 0 653619514 167989248 12462 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=164052 CPUtime=12.66 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 10585 1254 0 0 1265 1 0 0 25 0 5 0 653619514 167989248 12462 33554432000 4194304 4417452 140734601840368 18446744073709551615 4259629 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=164052 CPUtime=12.55 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 33199 1254 0 0 1251 4 0 0 25 0 5 0 653619514 167989248 12462 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.58
Current children cumulated vsize (KiB) 164052

[startup+25.5011 s]
/proc/loadavg: 8.15 8.10 8.02 9/304 22494
/proc/meminfo: memFree=27584744/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=196856 CPUtime=101.67 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 108399 1254 0 0 10151 16 0 0 25 0 5 0 653619511 201580544 20663 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 49214 20663 180 55 0 47100 0
[pid=22483/tid=22490] ppid=22481 vsize=196856 CPUtime=25.46 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 18706 1254 0 0 2544 2 0 0 25 0 5 0 653619514 201580544 20663 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=196856 CPUtime=25.46 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 16910 1254 0 0 2544 2 0 0 25 0 5 0 653619514 201580544 20663 33554432000 4194304 4417452 140734601840368 18446744073709551615 4236564 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=196856 CPUtime=25.46 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 23275 1254 0 0 2543 3 0 0 25 0 5 0 653619514 201580544 20663 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=196856 CPUtime=25.23 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 48057 1254 0 0 2517 6 0 0 25 0 5 0 653619514 201580544 20663 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.67
Current children cumulated vsize (KiB) 196856

[startup+51.1008 s]
/proc/loadavg: 8.14 8.10 8.02 10/304 22495
/proc/meminfo: memFree=27485636/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=274132 CPUtime=203.83 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 191446 1254 0 0 20354 29 0 0 25 0 5 0 653619511 280711168 39982 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 68533 39982 180 55 0 66419 0
[pid=22483/tid=22490] ppid=22481 vsize=274132 CPUtime=51.06 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 39432 1254 0 0 5101 5 0 0 25 0 5 0 653619514 280711168 39982 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=274132 CPUtime=51.05 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 28237 1254 0 0 5101 4 0 0 25 0 5 0 653619514 280711168 39982 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=274132 CPUtime=51.05 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 42526 1254 0 0 5099 6 0 0 25 0 5 0 653619514 280711168 39982 33554432000 4194304 4417452 140734601840368 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=274132 CPUtime=50.6 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 79800 1254 0 0 5048 12 0 0 25 0 5 0 653619514 280711168 39982 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.83
Current children cumulated vsize (KiB) 274132

[startup+102.311 s]
/proc/loadavg: 8.16 8.11 8.02 9/304 22496
/proc/meminfo: memFree=27461056/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=255080 CPUtime=408.2 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 299502 1254 0 0 40773 47 0 0 25 0 5 0 653619511 261201920 35219 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 63770 35219 180 55 0 61656 0
[pid=22483/tid=22490] ppid=22481 vsize=255080 CPUtime=102.27 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 65503 1254 0 0 10218 9 0 0 25 0 5 0 653619514 261201920 35219 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=255080 CPUtime=102.25 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 43409 1254 0 0 10218 7 0 0 25 0 5 0 653619514 261201920 35219 33554432000 4194304 4417452 140734601840368 18446744073709551615 4366450 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=255080 CPUtime=102.27 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 68496 1254 0 0 10217 10 0 0 25 0 5 0 653619514 261201920 35219 33554432000 4194304 4417452 140734601840368 18446744073709551615 4357651 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=255080 CPUtime=101.34 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 120643 1254 0 0 10116 18 0 0 25 0 5 0 653619514 261201920 35219 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.2
Current children cumulated vsize (KiB) 255080

[startup+162.3 s]
/proc/loadavg: 8.16 8.12 8.03 10/304 22498
/proc/meminfo: memFree=27206932/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=392776 CPUtime=647.6 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 417050 1254 0 0 64696 64 0 0 25 0 5 0 653619511 402202624 69643 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 98194 69643 180 55 0 96080 0
[pid=22483/tid=22490] ppid=22481 vsize=392776 CPUtime=162.26 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 92266 1254 0 0 16213 13 0 0 25 0 5 0 653619514 402202624 69643 33554432000 4194304 4417452 140734601840368 18446744073709551615 4356889 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=392776 CPUtime=162.23 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 65649 1254 0 0 16212 11 0 0 25 0 5 0 653619514 402202624 69643 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=392776 CPUtime=162.26 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 101254 1254 0 0 16211 15 0 0 25 0 5 0 653619514 402202624 69643 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=392776 CPUtime=160.8 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 156430 1254 0 0 16056 24 0 0 25 0 5 0 653619514 402202624 69643 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 647.6
Current children cumulated vsize (KiB) 392776


################
# More data... #
################

[pid=22483/tid=22491] ppid=22481 vsize=619032 CPUtime=702.14 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 198954 1254 0 0 70183 31 0 0 25 0 5 0 653619514 633888768 126207 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=619032 CPUtime=702.27 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 290353 1254 0 0 70186 41 0 0 25 0 5 0 653619514 633888768 126207 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=619032 CPUtime=695.89 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 325995 1254 0 0 69539 50 0 0 25 0 5 0 653619514 633888768 126207 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2802.63
Current children cumulated vsize (KiB) 619032

[startup+762.311 s]
/proc/loadavg: 8.09 8.08 8.03 9/304 22514
/proc/meminfo: memFree=26351560/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=778528 CPUtime=3042.1 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 1156144 1254 0 0 304035 175 0 0 25 0 5 0 653619511 797212672 166081 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 194632 166081 180 55 0 192518 0
[pid=22483/tid=22490] ppid=22481 vsize=778528 CPUtime=762.29 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 279962 1254 0 0 76188 41 0 0 25 0 5 0 653619514 797212672 166081 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=778528 CPUtime=762.13 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 212823 1254 0 0 76180 33 0 0 25 0 5 0 653619514 797212672 166081 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=778528 CPUtime=762.28 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 301498 1254 0 0 76185 43 0 0 25 0 5 0 653619514 797212672 166081 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=778528 CPUtime=755.35 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 360410 1254 0 0 75478 57 0 0 25 0 5 0 653619514 797212672 166081 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3042.1
Current children cumulated vsize (KiB) 778528

[startup+822.301 s]
/proc/loadavg: 8.08 8.08 8.03 10/304 22515
/proc/meminfo: memFree=26280200/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=773004 CPUtime=3281.52 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 1191950 1254 0 0 327971 181 0 0 25 0 5 0 653619511 791556096 164700 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 193251 164700 180 55 0 191137 0
[pid=22483/tid=22490] ppid=22481 vsize=773004 CPUtime=822.28 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 293414 1254 0 0 82185 43 0 0 25 0 5 0 653619514 791556096 164700 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=773004 CPUtime=822.12 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 224223 1254 0 0 82177 35 0 0 25 0 5 0 653619514 791556096 164700 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=773004 CPUtime=822.27 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 311470 1254 0 0 82183 44 0 0 25 0 5 0 653619514 791556096 164700 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=773004 CPUtime=814.8 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 361392 1254 0 0 81423 57 0 0 25 0 5 0 653619514 791556096 164700 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3281.52
Current children cumulated vsize (KiB) 773004

[startup+882.301 s]
/proc/loadavg: 8.08 8.08 8.03 9/304 22517
/proc/meminfo: memFree=26361108/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=852160 CPUtime=3520.96 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 1236394 1254 0 0 351907 189 0 0 25 0 5 0 653619511 872611840 184489 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 213040 184489 180 55 0 210926 0
[pid=22483/tid=22490] ppid=22481 vsize=852160 CPUtime=882.27 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 308615 1254 0 0 88182 45 0 0 25 0 5 0 653619514 872611840 184489 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=852160 CPUtime=882.11 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 236835 1254 0 0 88174 37 0 0 25 0 5 0 653619514 872611840 184489 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=852160 CPUtime=882.26 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 328101 1254 0 0 88179 47 0 0 25 0 5 0 653619514 872611840 184489 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=852160 CPUtime=874.25 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 361392 1254 0 0 87368 57 0 0 25 0 5 0 653619514 872611840 184489 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3520.96
Current children cumulated vsize (KiB) 852160

[startup+942.301 s]
/proc/loadavg: 8.08 8.08 8.03 9/304 22519
/proc/meminfo: memFree=26551268/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=646516 CPUtime=3760.41 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 1321568 1254 0 0 375838 203 0 0 25 0 5 0 653619511 662032384 133078 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 161629 133078 180 55 0 159515 0
[pid=22483/tid=22490] ppid=22481 vsize=646516 CPUtime=942.27 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 320596 1254 0 0 94180 47 0 0 25 0 5 0 653619514 662032384 133078 33554432000 4194304 4417452 140734601840368 18446744073709551615 4356980 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=646516 CPUtime=942.09 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 265313 1254 0 0 94167 42 0 0 25 0 5 0 653619514 662032384 133078 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=646516 CPUtime=942.27 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 335091 1254 0 0 94178 49 0 0 25 0 5 0 653619514 662032384 133078 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=646516 CPUtime=933.72 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 399117 1254 0 0 93309 63 0 0 25 0 5 0 653619514 662032384 133078 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3760.41
Current children cumulated vsize (KiB) 646516

[startup+1002.3 s]
/proc/loadavg: 8.03 8.06 8.03 10/304 22520
/proc/meminfo: memFree=26398352/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=726908 CPUtime=3999.85 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 1360334 1254 0 0 399776 209 0 0 25 0 5 0 653619511 744353792 153176 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 181727 153176 180 55 0 179613 0
[pid=22483/tid=22490] ppid=22481 vsize=726908 CPUtime=1002.27 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 335060 1254 0 0 100178 49 0 0 25 0 5 0 653619514 744353792 153176 33554432000 4194304 4417452 140734601840368 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=726908 CPUtime=1002.09 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 274140 1254 0 0 100165 44 0 0 25 0 5 0 653619514 744353792 153176 33554432000 4194304 4417452 140734601840368 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=726908 CPUtime=1002.27 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 345344 1254 0 0 100176 51 0 0 25 0 5 0 653619514 744353792 153176 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=726908 CPUtime=993.17 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 404339 1254 0 0 99253 64 0 0 25 0 5 0 653619514 744353792 153176 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3999.85
Current children cumulated vsize (KiB) 726908

[startup+1062.3 s]
/proc/loadavg: 8.01 8.05 8.02 9/304 22531
/proc/meminfo: memFree=26414244/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=660772 CPUtime=4239.3 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 1413056 1254 0 0 423713 217 0 0 25 0 5 0 653619511 676630528 136642 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 165193 136642 180 55 0 163079 0
[pid=22483/tid=22490] ppid=22481 vsize=660772 CPUtime=1062.27 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 346247 1254 0 0 106176 51 0 0 25 0 5 0 653619514 676630528 136642 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=660772 CPUtime=1062.07 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 287009 1254 0 0 106162 45 0 0 25 0 5 0 653619514 676630528 136642 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=660772 CPUtime=1062.26 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 353536 1254 0 0 106174 52 0 0 25 0 5 0 653619514 676630528 136642 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=660772 CPUtime=1052.62 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 424813 1254 0 0 105196 66 0 0 25 0 5 0 653619514 676630528 136642 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4239.3
Current children cumulated vsize (KiB) 660772

[startup+1122.3 s]
/proc/loadavg: 8.04 8.05 8.02 9/304 22532
/proc/meminfo: memFree=26233292/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=788548 CPUtime=4478.74 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 1465412 1254 0 0 447648 226 0 0 25 0 5 0 653619511 807473152 168586 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 197137 168586 180 55 0 195023 0
[pid=22483/tid=22490] ppid=22481 vsize=788548 CPUtime=1122.28 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 360890 1254 0 0 112174 54 0 0 25 0 5 0 653619514 807473152 168586 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=788548 CPUtime=1122.07 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 299206 1254 0 0 112160 47 0 0 25 0 5 0 653619514 807473152 168586 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=788548 CPUtime=1122.26 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 364478 1254 0 0 112172 54 0 0 25 0 5 0 653619514 807473152 168586 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=788548 CPUtime=1112.07 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 439387 1254 0 0 111138 69 0 0 25 0 5 0 653619514 807473152 168586 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4478.74
Current children cumulated vsize (KiB) 788548

[startup+1182.3 s]
/proc/loadavg: 8.05 8.05 8.02 10/304 22534
/proc/meminfo: memFree=25946812/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=991956 CPUtime=4718.19 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 1549629 1254 0 0 471580 239 0 0 25 0 5 0 653619511 1015762944 219438 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 247989 219438 180 55 0 245875 0
[pid=22483/tid=22490] ppid=22481 vsize=991956 CPUtime=1182.28 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 379531 1254 0 0 118170 58 0 0 25 0 5 0 653619514 1015762944 219438 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=991956 CPUtime=1182.05 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 327688 1254 0 0 118154 51 0 0 25 0 5 0 653619514 1015762944 219438 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=991956 CPUtime=1182.27 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 384881 1254 0 0 118169 58 0 0 25 0 5 0 653619514 1015762944 219438 33554432000 4194304 4417452 140734601840368 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=991956 CPUtime=1171.54 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 456078 1254 0 0 117083 71 0 0 25 0 5 0 653619514 1015762944 219438 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4718.19
Current children cumulated vsize (KiB) 991956



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.8 s]
/proc/loadavg: 8.10 8.07 8.02 5/299 22535
/proc/meminfo: memFree=26842000/32951124 swapFree=63649232/67111528
[pid=22483] ppid=22481 vsize=1006808 CPUtime=4800.02 cores=0,2,4,6
/proc/22483/stat : 22483 (plingeling) S 22481 22483 21663 0 -1 4202496 1553342 1254 0 0 479762 240 0 0 25 0 5 0 653619511 1030971392 223151 33554432000 4194304 4417452 140734601840368 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/22483/statm: 251702 223151 180 55 0 249588 0
[pid=22483/tid=22490] ppid=22481 vsize=1006808 CPUtime=1202.79 cores=0,2,4,6
/proc/22483/task/22490/stat : 22490 (plingeling) R 22481 22483 21663 0 -1 4202560 383244 1254 0 0 120221 58 0 0 25 0 5 0 653619514 1030971392 223151 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22483/tid=22491] ppid=22481 vsize=1006808 CPUtime=1202.56 cores=0,2,4,6
/proc/22483/task/22491/stat : 22491 (plingeling) R 22481 22483 21663 0 -1 4202560 327688 1254 0 0 120205 51 0 0 25 0 5 0 653619514 1030971392 223151 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22483/tid=22492] ppid=22481 vsize=1006808 CPUtime=1202.78 cores=0,2,4,6
/proc/22483/task/22492/stat : 22492 (plingeling) R 22481 22483 21663 0 -1 4202560 384881 1254 0 0 120220 58 0 0 25 0 5 0 653619514 1030971392 223151 33554432000 4194304 4417452 140734601840368 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22483/tid=22493] ppid=22481 vsize=1006808 CPUtime=1191.85 cores=0,2,4,6
/proc/22483/task/22493/stat : 22493 (plingeling) R 22481 22483 21663 0 -1 4202560 456078 1254 0 0 119114 71 0 0 25 0 5 0 653619514 1030971392 223151 33554432000 4194304 4417452 140734601840368 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.02
Current children cumulated vsize (KiB) 1006808

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.86
CPU time (s): 4800.11
CPU user time (s): 4797.66
CPU system time (s): 2.44763
CPU usage (%): 399.058
Max. virtual memory (cumulated for all children) (KiB): 1006808

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.66
system time used= 2.44763
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1554597
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 132
involuntary context switches= 24201

runsolver used 3.21351 second user time and 7.73682 second system time

The end

Launcher Data 

Begin job on node130 at 2011-05-15 02:43:30
IDJOB=3371008
IDBENCH=71526
IDSOLVER=1848
FILE ID=node130/3371008-1305420210
RUNJOBID= node130-1305419005-22348
PBS_JOBID= 13324556
Free space on /tmp= 73428 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/forced/rbsat-v760c43649gyes5.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371008-1305420210/watcher-3371008-1305420210 -o /tmp/evaluation-result-3371008-1305420210/solver-3371008-1305420210 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371008-1305420210.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e7d4dc25f0d8e558fb091b1e566deab7
RANDOM SEED=1730026528

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27732588 kB
Buffers:        267136 kB
Cached:        3620136 kB
SwapCached:      10248 kB
Active:        1151916 kB
Inactive:      3796196 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27732588 kB
SwapTotal:    67111528 kB
SwapFree:     63649232 kB
Dirty:            1188 kB
Writeback:          12 kB
AnonPages:     1057560 kB
Mapped:          13252 kB
Slab:           183348 kB
PageTables:      25216 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 51524696 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73428 MiB
End job on node130 at 2011-05-15 03:03:35