Trace number 3371134

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.38 1203.25

General information on the benchmark

NameSAT03/handmade/stanion/hwb/
hwb-n30-02-S77299857.shuffled-as.sat03-1633.cnf
MD5SUMbdf2c49c74bfdbd3bd4663dca402d24f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables194
Number of clauses954
Sum of the clauses size3252
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 210
Number of clauses of size 3544
Number of clauses of size 4400
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371134-1305430370/watcher-3371134-1305430370 -o /tmp/evaluation-result-3371134-1305430370/solver-3371134-1305430370 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371134-1305430370.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.08 1.64 1.86 1/302 29569
/proc/meminfo: memFree=18002856/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=49992 CPUtime=0 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 371 1255 0 0 0 0 0 0 21 0 5 0 654636687 51191808 296 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 12498 296 171 55 0 10384 0
[pid=29569/tid=29575] ppid=29567 vsize=49992 CPUtime=0 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 46 1255 0 0 0 0 0 0 22 0 5 0 654636688 51191808 307 33554432000 4194304 4417452 140734108902272 18446744073709551615 4252871 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=49992 CPUtime=0 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 0 1255 0 0 0 0 0 0 23 0 5 0 654636688 51191808 307 33554432000 4194304 4417452 140734108902272 18446744073709551615 274474023921 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=49992 CPUtime=0 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 0 1255 0 0 0 0 0 0 23 0 5 0 654636688 51191808 307 33554432000 4194304 4417452 140734108902272 18446744073709551615 274474023921 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=49992 CPUtime=0 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 0 1255 0 0 0 0 0 0 23 0 5 0 654636688 51191808 307 33554432000 4194304 4417452 140734108902272 18446744073709551615 274474023921 0 0 4096 17442 0 0 0 -1 4 0 0 0

[startup+0.099296 s]
/proc/loadavg: 1.08 1.64 1.86 1/302 29569
/proc/meminfo: memFree=18002856/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=51936 CPUtime=0.25 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 1029 1255 0 0 25 0 0 0 21 0 5 0 654636687 53182464 804 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 12984 804 179 55 0 10870 0
[pid=29569/tid=29575] ppid=29567 vsize=51936 CPUtime=0.09 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 207 1255 0 0 9 0 0 0 23 0 5 0 654636688 53182464 804 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=51936 CPUtime=0.06 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 88 1255 0 0 6 0 0 0 23 0 5 0 654636688 53182464 804 33554432000 4194304 4417452 140734108902272 18446744073709551615 4254855 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=51936 CPUtime=0 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 17 1255 0 0 0 0 0 0 23 0 5 0 654636688 53182464 804 33554432000 4194304 4417452 140734108902272 18446744073709551615 274474072558 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=51936 CPUtime=0.08 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 381 1255 0 0 8 0 0 0 23 0 5 0 654636688 53182464 804 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.25
Current children cumulated vsize (KiB) 51936

[startup+0.100296 s]
/proc/loadavg: 1.08 1.64 1.86 1/302 29569
/proc/meminfo: memFree=18002856/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=51936 CPUtime=0.25 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 1029 1255 0 0 25 0 0 0 21 0 5 0 654636687 53182464 804 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 12984 804 179 55 0 10870 0
[pid=29569/tid=29575] ppid=29567 vsize=51936 CPUtime=0.09 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 207 1255 0 0 9 0 0 0 23 0 5 0 654636688 53182464 804 33554432000 4194304 4417452 140734108902272 18446744073709551615 4366407 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=51936 CPUtime=0.06 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 88 1255 0 0 6 0 0 0 23 0 5 0 654636688 53182464 804 33554432000 4194304 4417452 140734108902272 18446744073709551615 4257702 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=51936 CPUtime=0 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 17 1255 0 0 0 0 0 0 23 0 5 0 654636688 53182464 804 33554432000 4194304 4417452 140734108902272 18446744073709551615 274474072558 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=51936 CPUtime=0.08 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 381 1255 0 0 8 0 0 0 23 0 5 0 654636688 53182464 804 33554432000 4194304 4417452 140734108902272 18446744073709551615 4250599 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.25
Current children cumulated vsize (KiB) 51936

[startup+0.30026 s]
/proc/loadavg: 1.08 1.64 1.86 1/302 29569
/proc/meminfo: memFree=18002856/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=119824 CPUtime=0.85 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 2310 1255 0 0 85 0 0 0 21 0 5 0 654636687 122699776 1403 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 29956 1403 180 55 0 27842 0
[pid=29569/tid=29575] ppid=29567 vsize=119824 CPUtime=0.2 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 357 1255 0 0 20 0 0 0 23 0 5 0 654636688 122699776 1403 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364437 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=119824 CPUtime=0.26 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 569 1255 0 0 26 0 0 0 25 0 5 0 654636688 122699776 1403 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364861 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=119824 CPUtime=0.09 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 131 1255 0 0 9 0 0 0 23 0 5 0 654636688 122699776 1403 33554432000 4194304 4417452 140734108902272 18446744073709551615 4251038 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=119824 CPUtime=0.28 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 917 1255 0 0 28 0 0 0 25 0 5 0 654636688 122699776 1403 33554432000 4194304 4417452 140734108902272 18446744073709551615 4366092 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.85
Current children cumulated vsize (KiB) 119824

[startup+0.700191 s]
/proc/loadavg: 1.08 1.64 1.86 1/302 29569
/proc/meminfo: memFree=18002856/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=122232 CPUtime=2.36 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 5070 1255 0 0 236 0 0 0 21 0 5 0 654636687 125165568 2011 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 30558 2011 180 55 0 28444 0
[pid=29569/tid=29575] ppid=29567 vsize=122232 CPUtime=0.57 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 1084 1255 0 0 57 0 0 0 25 0 5 0 654636688 125165568 2011 33554432000 4194304 4417452 140734108902272 18446744073709551615 4365150 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=122232 CPUtime=0.66 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 1113 1255 0 0 66 0 0 0 25 0 5 0 654636688 125165568 2011 33554432000 4194304 4417452 140734108902272 18446744073709551615 4357737 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=122232 CPUtime=0.43 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 679 1255 0 0 43 0 0 0 25 0 5 0 654636688 125165568 2011 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=122232 CPUtime=0.68 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 1858 1255 0 0 68 0 0 0 25 0 5 0 654636688 125165568 2011 33554432000 4194304 4417452 140734108902272 18446744073709551615 4250432 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.36
Current children cumulated vsize (KiB) 122232

[startup+1.50105 s]
/proc/loadavg: 1.64 1.75 1.90 9/316 29596
/proc/meminfo: memFree=17983532/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=128276 CPUtime=5.55 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 9663 1255 0 0 554 1 0 0 21 0 5 0 654636687 131354624 3517 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 32069 3517 180 55 0 29955 0
[pid=29569/tid=29575] ppid=29567 vsize=128276 CPUtime=1.36 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 2266 1255 0 0 136 0 0 0 25 0 5 0 654636688 131354624 3517 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=128276 CPUtime=1.46 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 2312 1255 0 0 146 0 0 0 25 0 5 0 654636688 131354624 3517 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=128276 CPUtime=1.23 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 1614 1255 0 0 123 0 0 0 25 0 5 0 654636688 131354624 3517 33554432000 4194304 4417452 140734108902272 18446744073709551615 4365965 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=128276 CPUtime=1.47 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 3135 1255 0 0 147 0 0 0 25 0 5 0 654636688 131354624 3517 33554432000 4194304 4417452 140734108902272 18446744073709551615 4353661 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.55
Current children cumulated vsize (KiB) 128276

[startup+3.10077 s]
/proc/loadavg: 1.64 1.75 1.90 9/316 29596
/proc/meminfo: memFree=17974404/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=131924 CPUtime=11.94 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 17179 1255 0 0 1192 2 0 0 21 0 5 0 654636687 135090176 4406 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 32981 4406 180 55 0 30867 0
[pid=29569/tid=29575] ppid=29567 vsize=131924 CPUtime=2.96 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 4223 1255 0 0 296 0 0 0 25 0 5 0 654636688 135090176 4406 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=131924 CPUtime=3.06 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 4445 1255 0 0 306 0 0 0 25 0 5 0 654636688 135090176 4406 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=131924 CPUtime=2.83 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 3479 1255 0 0 283 0 0 0 25 0 5 0 654636688 135090176 4406 33554432000 4194304 4417452 140734108902272 18446744073709551615 4251063 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=131924 CPUtime=3.06 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 4696 1255 0 0 306 0 0 0 25 0 5 0 654636688 135090176 4406 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.94
Current children cumulated vsize (KiB) 131924

[startup+6.30021 s]
/proc/loadavg: 1.64 1.75 1.90 9/316 29596
/proc/meminfo: memFree=17958132/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=138128 CPUtime=24.71 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 30562 1255 0 0 2467 4 0 0 21 0 5 0 654636687 141443072 5957 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 34532 5957 180 55 0 32418 0
[pid=29569/tid=29575] ppid=29567 vsize=138128 CPUtime=6.16 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 7121 1255 0 0 615 1 0 0 25 0 5 0 654636688 141443072 5957 33554432000 4194304 4417452 140734108902272 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=138128 CPUtime=6.26 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 7486 1255 0 0 625 1 0 0 25 0 5 0 654636688 141443072 5957 33554432000 4194304 4417452 140734108902272 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=138128 CPUtime=6.03 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 6242 1255 0 0 603 0 0 0 25 0 5 0 654636688 141443072 5957 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=138128 CPUtime=6.23 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 9377 1255 0 0 622 1 0 0 25 0 5 0 654636688 141443072 5957 33554432000 4194304 4417452 140734108902272 18446744073709551615 4366659 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.71
Current children cumulated vsize (KiB) 138128

[startup+12.7011 s]
/proc/loadavg: 2.69 1.97 1.97 9/316 29597
/proc/meminfo: memFree=17946144/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=150656 CPUtime=50.26 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 52583 1255 0 0 5017 9 0 0 21 0 5 0 654636687 154271744 9089 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 37664 9089 180 55 0 35550 0
[pid=29569/tid=29575] ppid=29567 vsize=150656 CPUtime=12.57 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 11948 1255 0 0 1255 2 0 0 25 0 5 0 654636688 154271744 9089 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364696 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=150656 CPUtime=12.66 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 12912 1255 0 0 1264 2 0 0 25 0 5 0 654636688 154271744 9089 33554432000 4194304 4417452 140734108902272 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=150656 CPUtime=12.43 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 11040 1255 0 0 1242 1 0 0 25 0 5 0 654636688 154271744 9089 33554432000 4194304 4417452 140734108902272 18446744073709551615 4250505 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=150656 CPUtime=12.57 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 16347 1255 0 0 1255 2 0 0 25 0 5 0 654636688 154271744 9089 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364752 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.26
Current children cumulated vsize (KiB) 150656

[startup+25.5008 s]
/proc/loadavg: 3.51 2.17 2.03 9/316 29597
/proc/meminfo: memFree=17917488/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=160316 CPUtime=101.33 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 88490 1255 0 0 10119 14 0 0 21 0 5 0 654636687 164163584 11535 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 40079 11535 180 55 0 37965 0
[pid=29569/tid=29575] ppid=29567 vsize=160316 CPUtime=25.36 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 21659 1255 0 0 2533 3 0 0 25 0 5 0 654636688 164163584 11535 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=160316 CPUtime=25.46 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 22426 1255 0 0 2543 3 0 0 25 0 5 0 654636688 164163584 11535 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=160316 CPUtime=25.23 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 19904 1255 0 0 2520 3 0 0 25 0 5 0 654636688 164163584 11535 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=160316 CPUtime=25.24 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 24165 1255 0 0 2521 3 0 0 25 0 5 0 654636688 164163584 11535 33554432000 4194304 4417452 140734108902272 18446744073709551615 4366391 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.33
Current children cumulated vsize (KiB) 160316

[startup+51.1003 s]
/proc/loadavg: 5.27 2.72 2.22 9/316 29597
/proc/meminfo: memFree=17891916/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=168876 CPUtime=203.48 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 142568 1255 0 0 20324 24 0 0 21 0 5 0 654636687 172929024 13644 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 42219 13644 180 55 0 40105 0
[pid=29569/tid=29575] ppid=29567 vsize=168876 CPUtime=50.96 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 33473 1255 0 0 5091 5 0 0 25 0 5 0 654636688 172929024 13644 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=168876 CPUtime=51.06 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 36000 1255 0 0 5100 6 0 0 25 0 5 0 654636688 172929024 13644 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=168876 CPUtime=50.83 cores=0,2,4,6

################
# More data... #
################

[pid=29569/tid=29576] ppid=29567 vsize=475712 CPUtime=702.27 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 110991 1255 0 0 70207 20 0 0 25 0 5 0 654636688 487129088 90353 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=475712 CPUtime=702.05 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 109726 1255 0 0 70187 18 0 0 25 0 5 0 654636688 487129088 90353 33554432000 4194304 4417452 140734108902272 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=475712 CPUtime=695.33 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 182855 1255 0 0 69506 27 0 0 25 0 5 0 654636688 487129088 90353 33554432000 4194304 4417452 140734108902272 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2801.73
Current children cumulated vsize (KiB) 475712

[startup+762.312 s]
/proc/loadavg: 8.08 7.58 5.34 9/316 29617
/proc/meminfo: memFree=17197960/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=535532 CPUtime=3041.16 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 610592 1255 0 0 304017 99 0 0 21 0 5 0 654636687 548384768 105308 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 133883 105308 180 55 0 131769 0
[pid=29569/tid=29575] ppid=29567 vsize=535532 CPUtime=762.05 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 175711 1255 0 0 76178 27 0 0 25 0 5 0 654636688 548384768 105308 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=535532 CPUtime=762.29 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 130179 1255 0 0 76205 24 0 0 25 0 5 0 654636688 548384768 105308 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=535532 CPUtime=762.06 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 109726 1255 0 0 76188 18 0 0 25 0 5 0 654636688 548384768 105308 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=535532 CPUtime=754.73 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 194640 1255 0 0 75444 29 0 0 25 0 5 0 654636688 548384768 105308 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3041.16
Current children cumulated vsize (KiB) 535532

[startup+822.301 s]
/proc/loadavg: 8.07 7.67 5.51 9/316 29618
/proc/meminfo: memFree=17240712/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=501328 CPUtime=3280.51 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 635813 1255 0 0 327948 103 0 0 21 0 5 0 654636687 513359872 96757 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 125332 96757 180 55 0 123218 0
[pid=29569/tid=29575] ppid=29567 vsize=501328 CPUtime=822.03 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 184175 1255 0 0 82175 28 0 0 25 0 5 0 654636688 513359872 96757 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=501328 CPUtime=822.28 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 130179 1255 0 0 82204 24 0 0 25 0 5 0 654636688 513359872 96757 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=501328 CPUtime=822.05 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 117918 1255 0 0 82186 19 0 0 25 0 5 0 654636688 513359872 96757 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=501328 CPUtime=814.13 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 203205 1255 0 0 81382 31 0 0 25 0 5 0 654636688 513359872 96757 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3280.51
Current children cumulated vsize (KiB) 501328

[startup+882.301 s]
/proc/loadavg: 8.07 7.74 5.66 9/316 29620
/proc/meminfo: memFree=17261260/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=513140 CPUtime=3519.91 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 651201 1255 0 0 351885 106 0 0 21 0 5 0 654636687 525455360 99710 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 128285 99710 180 55 0 126171 0
[pid=29569/tid=29575] ppid=29567 vsize=513140 CPUtime=882.02 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 196536 1255 0 0 88172 30 0 0 25 0 5 0 654636688 525455360 99710 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=513140 CPUtime=882.27 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 131941 1255 0 0 88203 24 0 0 25 0 5 0 654636688 525455360 99710 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=513140 CPUtime=882.05 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 119183 1255 0 0 88186 19 0 0 25 0 5 0 654636688 525455360 99710 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=513140 CPUtime=873.53 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 203205 1255 0 0 87322 31 0 0 25 0 5 0 654636688 525455360 99710 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3519.91
Current children cumulated vsize (KiB) 513140

[startup+942.3 s]
/proc/loadavg: 8.10 7.81 5.82 9/316 29621
/proc/meminfo: memFree=17204568/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=572540 CPUtime=3759.3 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 686531 1255 0 0 375818 112 0 0 21 0 5 0 654636687 586280960 114560 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 143135 114560 180 55 0 141021 0
[pid=29569/tid=29575] ppid=29567 vsize=572540 CPUtime=942.01 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 206490 1255 0 0 94169 32 0 0 25 0 5 0 654636688 586280960 114560 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=572540 CPUtime=942.27 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 131941 1255 0 0 94203 24 0 0 25 0 5 0 654636688 586280960 114560 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=572540 CPUtime=942.05 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 130655 1255 0 0 94184 21 0 0 25 0 5 0 654636688 586280960 114560 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=572540 CPUtime=932.93 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 217109 1255 0 0 93260 33 0 0 25 0 5 0 654636688 586280960 114560 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3759.3
Current children cumulated vsize (KiB) 572540

[startup+1002.3 s]
/proc/loadavg: 8.07 7.86 5.96 9/316 29623
/proc/meminfo: memFree=17119588/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=655408 CPUtime=3998.69 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 707248 1255 0 0 399753 116 0 0 21 0 5 0 654636687 671137792 135277 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 163852 135277 180 55 0 161738 0
[pid=29569/tid=29575] ppid=29567 vsize=655408 CPUtime=1002 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 210586 1255 0 0 100168 32 0 0 25 0 5 0 654636688 671137792 135277 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364958 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=655408 CPUtime=1002.28 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 131941 1255 0 0 100204 24 0 0 25 0 5 0 654636688 671137792 135277 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=655408 CPUtime=1002.05 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 138847 1255 0 0 100182 23 0 0 25 0 5 0 654636688 671137792 135277 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=655408 CPUtime=992.34 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 225538 1255 0 0 99199 35 0 0 25 0 5 0 654636688 671137792 135277 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3998.69
Current children cumulated vsize (KiB) 655408

[startup+1062.3 s]
/proc/loadavg: 8.14 7.91 6.09 9/316 29625
/proc/meminfo: memFree=17045148/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=687428 CPUtime=4238.09 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 715253 1255 0 0 423691 118 0 0 21 0 5 0 654636687 703926272 143282 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 171857 143282 180 55 0 169743 0
[pid=29569/tid=29575] ppid=29567 vsize=687428 CPUtime=1061.99 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 217609 1255 0 0 106165 34 0 0 25 0 5 0 654636688 703926272 143282 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=687428 CPUtime=1062.28 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 131941 1255 0 0 106204 24 0 0 25 0 5 0 654636688 703926272 143282 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=687428 CPUtime=1062.05 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 138847 1255 0 0 106182 23 0 0 25 0 5 0 654636688 703926272 143282 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=687428 CPUtime=1051.74 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 226520 1255 0 0 105139 35 0 0 25 0 5 0 654636688 703926272 143282 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4238.09
Current children cumulated vsize (KiB) 687428

[startup+1122.3 s]
/proc/loadavg: 8.12 7.94 6.21 9/316 29626
/proc/meminfo: memFree=16854008/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=737852 CPUtime=4477.48 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 742304 1255 0 0 447626 122 0 0 21 0 5 0 654636687 755560448 155888 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 184463 155888 180 55 0 182349 0
[pid=29569/tid=29575] ppid=29567 vsize=737852 CPUtime=1121.98 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 223257 1255 0 0 112163 35 0 0 25 0 5 0 654636688 755560448 155888 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=737852 CPUtime=1122.29 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 153059 1255 0 0 112201 28 0 0 25 0 5 0 654636688 755560448 155888 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=737852 CPUtime=1122.05 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 138847 1255 0 0 112182 23 0 0 25 0 5 0 654636688 755560448 155888 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=737852 CPUtime=1111.14 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 226805 1255 0 0 111079 35 0 0 25 0 5 0 654636688 755560448 155888 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4477.48
Current children cumulated vsize (KiB) 737852

[startup+1182.3 s]
/proc/loadavg: 8.12 7.96 6.33 9/316 29628
/proc/meminfo: memFree=16725124/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=861192 CPUtime=4716.88 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 773139 1255 0 0 471559 129 0 0 21 0 5 0 654636687 881860608 186723 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 215298 186723 180 55 0 213184 0
[pid=29569/tid=29575] ppid=29567 vsize=861192 CPUtime=1181.96 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 230952 1255 0 0 118160 36 0 0 25 0 5 0 654636688 881860608 186723 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=861192 CPUtime=1182.28 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 156582 1255 0 0 118200 28 0 0 25 0 5 0 654636688 881860608 186723 33554432000 4194304 4417452 140734108902272 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=861192 CPUtime=1182.05 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 138847 1255 0 0 118182 23 0 0 25 0 5 0 654636688 881860608 186723 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=861192 CPUtime=1170.54 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 246422 1255 0 0 117015 39 0 0 25 0 5 0 654636688 881860608 186723 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364958 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4716.88
Current children cumulated vsize (KiB) 861192



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.2 s]
/proc/loadavg: 8.09 7.97 6.36 5/311 29629
/proc/meminfo: memFree=17250276/32950928 swapFree=67111348/67111528
[pid=29569] ppid=29567 vsize=861192 CPUtime=4800.3 cores=0,2,4,6
/proc/29569/stat : 29569 (plingeling) S 29567 29569 20898 0 -1 4202496 773139 1255 0 0 479901 129 0 0 21 0 5 0 654636687 881860608 186723 33554432000 4194304 4417452 140734108902272 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29569/statm: 215298 186723 180 55 0 213184 0
[pid=29569/tid=29575] ppid=29567 vsize=861192 CPUtime=1202.88 cores=0,2,4,6
/proc/29569/task/29575/stat : 29575 (plingeling) R 29567 29569 20898 0 -1 4202560 230952 1255 0 0 120252 36 0 0 25 0 5 0 654636688 881860608 186723 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29569/tid=29576] ppid=29567 vsize=861192 CPUtime=1203.19 cores=0,2,4,6
/proc/29569/task/29576/stat : 29576 (plingeling) R 29567 29569 20898 0 -1 4202560 156582 1255 0 0 120291 28 0 0 25 0 5 0 654636688 881860608 186723 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29569/tid=29577] ppid=29567 vsize=861192 CPUtime=1202.96 cores=0,2,4,6
/proc/29569/task/29577/stat : 29577 (plingeling) R 29567 29569 20898 0 -1 4202560 138847 1255 0 0 120273 23 0 0 25 0 5 0 654636688 881860608 186723 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29569/tid=29578] ppid=29567 vsize=861192 CPUtime=1191.23 cores=0,2,4,6
/proc/29569/task/29578/stat : 29578 (plingeling) R 29567 29569 20898 0 -1 4202560 246422 1255 0 0 119084 39 0 0 25 0 5 0 654636688 881860608 186723 33554432000 4194304 4417452 140734108902272 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 861192

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.25
CPU time (s): 4800.38
CPU user time (s): 4799.04
CPU system time (s): 1.3308
CPU usage (%): 398.95
Max. virtual memory (cumulated for all children) (KiB): 861192

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.04
system time used= 1.3308
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 774394
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 60
involuntary context switches= 25768

runsolver used 3.57746 second user time and 8.43172 second system time

The end

Launcher Data 

Begin job on node125 at 2011-05-15 05:32:50
IDJOB=3371134
IDBENCH=84028
IDSOLVER=1848
FILE ID=node125/3371134-1305430370
RUNJOBID= node125-1305430370-29557
PBS_JOBID= 13324587
Free space on /tmp= 73232 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT03/handmade/stanion/hwb/hwb-n30-02-S77299857.shuffled-as.sat03-1633.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371134-1305430370/watcher-3371134-1305430370 -o /tmp/evaluation-result-3371134-1305430370/solver-3371134-1305430370 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371134-1305430370.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bdf2c49c74bfdbd3bd4663dca402d24f
RANDOM SEED=951674077

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      18003012 kB
Buffers:        266820 kB
Cached:        4252928 kB
SwapCached:          0 kB
Active:       11168800 kB
Inactive:      3405784 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      18003012 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:             500 kB
Writeback:           0 kB
AnonPages:    10054572 kB
Mapped:          29000 kB
Slab:           274228 kB
PageTables:      35656 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 50987360 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73232 MiB
End job on node125 at 2011-05-15 05:52:56