Trace number 3371181

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.34 1203.63

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n160-s73223945-unsat.cnf
MD5SUMebbfc0ffb6aa4fcba0d5ce3964018543
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables161
Number of clauses332
Sum of the clauses size996
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3332
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371181-1305424050/watcher-3371181-1305424050 -o /tmp/evaluation-result-3371181-1305424050/solver-3371181-1305424050 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371181-1305424050.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.51 4.32 5.87 6/353 28588
/proc/meminfo: memFree=21542680/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=115696 CPUtime=0.01 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 402 1251 0 0 1 0 0 0 18 0 5 0 634821166 118472704 329 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 28924 329 176 55 0 26810 0
[pid=28588/tid=28594] ppid=28586 vsize=115696 CPUtime=0 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 20 1251 0 0 0 0 0 0 19 0 5 0 634821167 118472704 342 33554432000 4194304 4417452 140735444786608 18446744073709551615 4273225 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=115696 CPUtime=0 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 1 1251 0 0 0 0 0 0 21 0 5 0 634821167 118472704 342 33554432000 4194304 4417452 140735444786608 18446744073709551615 255106873838 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=115696 CPUtime=0 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 36 1251 0 0 0 0 0 0 18 0 5 0 634821167 118472704 342 33554432000 4194304 4417452 140735444786608 18446744073709551615 4353666 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=115696 CPUtime=0 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 49 1251 0 0 0 0 0 0 20 0 5 0 634821167 118472704 342 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 1 0 0 0

[startup+0.0632691 s]
/proc/loadavg: 3.51 4.32 5.87 6/353 28588
/proc/meminfo: memFree=21542680/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=117164 CPUtime=0.22 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 831 1251 0 0 22 0 0 0 18 0 5 0 634821166 119975936 730 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 29291 730 179 55 0 27177 0
[pid=28588/tid=28594] ppid=28586 vsize=117164 CPUtime=0.05 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 120 1251 0 0 5 0 0 0 20 0 5 0 634821167 119975936 730 33554432000 4194304 4417452 140735444786608 18446744073709551615 4320914 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=117164 CPUtime=0.04 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 62 1251 0 0 4 0 0 0 20 0 5 0 634821167 119975936 730 33554432000 4194304 4417452 140735444786608 18446744073709551615 4354035 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=117164 CPUtime=0.05 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 158 1251 0 0 5 0 0 0 18 0 5 0 634821167 119975936 730 33554432000 4194304 4417452 140735444786608 18446744073709551615 4250947 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=117164 CPUtime=0.05 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 182 1251 0 0 5 0 0 0 20 0 5 0 634821167 119975936 730 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 117164

[startup+0.163252 s]
/proc/loadavg: 3.51 4.32 5.87 6/353 28588
/proc/meminfo: memFree=21542680/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=119112 CPUtime=0.62 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 2004 1251 0 0 62 0 0 0 18 0 5 0 634821166 121970688 1211 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 29778 1211 179 55 0 27664 0
[pid=28588/tid=28594] ppid=28586 vsize=119112 CPUtime=0.15 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 488 1251 0 0 15 0 0 0 20 0 5 0 634821167 121970688 1211 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=119112 CPUtime=0.14 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 374 1251 0 0 14 0 0 0 21 0 5 0 634821167 121970688 1211 33554432000 4194304 4417452 140735444786608 18446744073709551615 4356984 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=119112 CPUtime=0.15 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 387 1251 0 0 15 0 0 0 18 0 5 0 634821167 121970688 1211 33554432000 4194304 4417452 140735444786608 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=119112 CPUtime=0.15 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 446 1251 0 0 15 0 0 0 21 0 5 0 634821167 121970688 1211 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.62
Current children cumulated vsize (KiB) 119112

[startup+0.363218 s]
/proc/loadavg: 3.51 4.32 5.87 6/353 28588
/proc/meminfo: memFree=21542680/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=121140 CPUtime=1.41 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 3962 1251 0 0 141 0 0 0 18 0 5 0 634821166 124047360 1676 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 30285 1676 179 55 0 28171 0
[pid=28588/tid=28594] ppid=28586 vsize=121140 CPUtime=0.35 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 924 1251 0 0 35 0 0 0 20 0 5 0 634821167 124047360 1676 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=121140 CPUtime=0.34 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 926 1251 0 0 34 0 0 0 21 0 5 0 634821167 124047360 1676 33554432000 4194304 4417452 140735444786608 18446744073709551615 255106462671 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=121140 CPUtime=0.35 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 947 1251 0 0 35 0 0 0 18 0 5 0 634821167 124047360 1676 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=121140 CPUtime=0.35 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 856 1251 0 0 35 0 0 0 21 0 5 0 634821167 124047360 1676 33554432000 4194304 4417452 140735444786608 18446744073709551615 4354492 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 121140

[startup+0.701159 s]
/proc/loadavg: 3.51 4.32 5.87 6/353 28588
/proc/meminfo: memFree=21542680/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=122352 CPUtime=2.77 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 6814 1251 0 0 276 1 0 0 18 0 5 0 634821166 125288448 2037 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 30588 2037 179 55 0 28474 0
[pid=28588/tid=28594] ppid=28586 vsize=122352 CPUtime=0.69 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 1433 1251 0 0 69 0 0 0 20 0 5 0 634821167 125288448 2037 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=122352 CPUtime=0.68 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 1871 1251 0 0 68 0 0 0 22 0 5 0 634821167 125288448 2037 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=122352 CPUtime=0.69 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 1702 1251 0 0 69 0 0 0 18 0 5 0 634821167 125288448 2037 33554432000 4194304 4417452 140735444786608 18446744073709551615 4365976 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=122352 CPUtime=0.69 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 1499 1251 0 0 69 0 0 0 22 0 5 0 634821167 125288448 2037 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364716 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.77
Current children cumulated vsize (KiB) 122352

[startup+1.50102 s]
/proc/loadavg: 3.51 4.32 5.87 10/358 28598
/proc/meminfo: memFree=21521084/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=126984 CPUtime=5.96 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 12059 1251 0 0 595 1 0 0 18 0 5 0 634821166 130031616 3195 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 31746 3195 179 55 0 29632 0
[pid=28588/tid=28594] ppid=28586 vsize=126984 CPUtime=1.49 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 2740 1251 0 0 149 0 0 0 23 0 5 0 634821167 130031616 3195 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=126984 CPUtime=1.47 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 3207 1251 0 0 147 0 0 0 25 0 5 0 634821167 130031616 3195 33554432000 4194304 4417452 140735444786608 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=126984 CPUtime=1.49 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 3306 1251 0 0 149 0 0 0 20 0 5 0 634821167 130031616 3195 33554432000 4194304 4417452 140735444786608 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=126984 CPUtime=1.49 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 2497 1251 0 0 149 0 0 0 25 0 5 0 634821167 130031616 3195 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 126984

[startup+3.10074 s]
/proc/loadavg: 3.51 4.32 5.87 10/358 28598
/proc/meminfo: memFree=21513148/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=132876 CPUtime=12.34 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 23722 1251 0 0 1231 3 0 0 18 0 5 0 634821166 136065024 4636 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 33219 4636 179 55 0 31105 0
[pid=28588/tid=28594] ppid=28586 vsize=132876 CPUtime=3.08 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 5150 1251 0 0 308 0 0 0 18 0 5 0 634821167 136065024 4636 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=132876 CPUtime=3.05 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 6583 1251 0 0 304 1 0 0 25 0 5 0 634821167 136065024 4636 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364684 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=132876 CPUtime=3.08 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 6866 1251 0 0 308 0 0 0 25 0 5 0 634821167 136065024 4636 33554432000 4194304 4417452 140735444786608 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=132876 CPUtime=3.08 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 4814 1251 0 0 308 0 0 0 25 0 5 0 634821167 136065024 4636 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 132876

[startup+6.30118 s]
/proc/loadavg: 3.87 4.38 5.88 10/358 28598
/proc/meminfo: memFree=21498900/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=138780 CPUtime=25.11 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 41660 1251 0 0 2505 6 0 0 18 0 5 0 634821166 142110720 6144 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 34695 6144 179 55 0 32581 0
[pid=28588/tid=28594] ppid=28586 vsize=138780 CPUtime=6.29 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 9857 1251 0 0 628 1 0 0 25 0 5 0 634821167 142110720 6144 33554432000 4194304 4417452 140735444786608 18446744073709551615 4365050 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=138780 CPUtime=6.22 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 12055 1251 0 0 620 2 0 0 25 0 5 0 634821167 142110720 6144 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=138780 CPUtime=6.29 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 11028 1251 0 0 628 1 0 0 25 0 5 0 634821167 142110720 6144 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364687 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=138780 CPUtime=6.29 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 8411 1251 0 0 628 1 0 0 25 0 5 0 634821167 142110720 6144 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.11
Current children cumulated vsize (KiB) 138780

[startup+12.7011 s]
/proc/loadavg: 4.20 4.44 5.89 10/358 28598
/proc/meminfo: memFree=21480100/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=143720 CPUtime=50.64 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 70685 1251 0 0 5053 11 0 0 18 0 5 0 634821166 147169280 7347 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 35930 7347 179 55 0 33816 0
[pid=28588/tid=28594] ppid=28586 vsize=143720 CPUtime=12.69 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 16536 1251 0 0 1267 2 0 0 25 0 5 0 634821167 147169280 7347 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=143720 CPUtime=12.55 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 19634 1251 0 0 1252 3 0 0 25 0 5 0 634821167 147169280 7347 33554432000 4194304 4417452 140735444786608 18446744073709551615 4232791 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=143720 CPUtime=12.69 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 17786 1251 0 0 1267 2 0 0 25 0 5 0 634821167 147169280 7347 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364542 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=143720 CPUtime=12.69 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 16420 1251 0 0 1267 2 0 0 25 0 5 0 634821167 147169280 7347 33554432000 4194304 4417452 140735444786608 18446744073709551615 4250502 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.64
Current children cumulated vsize (KiB) 143720

[startup+25.5008 s]
/proc/loadavg: 5.12 4.63 5.93 10/358 28599
/proc/meminfo: memFree=21459136/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=159908 CPUtime=101.69 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 117033 1251 0 0 10151 18 0 0 18 0 5 0 634821166 163745792 11394 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 39977 11394 179 55 0 37863 0
[pid=28588/tid=28594] ppid=28586 vsize=159908 CPUtime=25.48 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 27432 1251 0 0 2544 4 0 0 25 0 5 0 634821167 163745792 11394 33554432000 4194304 4417452 140735444786608 18446744073709551615 4236930 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=159908 CPUtime=25.2 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 31935 1251 0 0 2515 5 0 0 25 0 5 0 634821167 163745792 11394 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=159908 CPUtime=25.49 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 31064 1251 0 0 2545 4 0 0 25 0 5 0 634821167 163745792 11394 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=159908 CPUtime=25.48 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 26293 1251 0 0 2545 3 0 0 25 0 5 0 634821167 163745792 11394 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.69
Current children cumulated vsize (KiB) 159908

[startup+51.1003 s]
/proc/loadavg: 6.10 4.90 5.99 10/358 28599
/proc/meminfo: memFree=21440136/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=173240 CPUtime=203.82 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 190600 1251 0 0 20352 30 0 0 18 0 5 0 634821166 177397760 14750 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 43310 14750 179 55 0 41196 0
[pid=28588/tid=28594] ppid=28586 vsize=173240 CPUtime=51.08 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 46026 1251 0 0 5101 7 0 0 25 0 5 0 634821167 177397760 14750 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=173240 CPUtime=50.52 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 51941 1251 0 0 5045 7 0 0 25 0 5 0 634821167 177397760 14750 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=173240 CPUtime=51.09 cores=1,3,5,7

################
# More data... #
################

[pid=28588/tid=28595] ppid=28586 vsize=270140 CPUtime=694.5 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 327016 1251 0 0 69398 52 0 0 25 0 5 0 634821167 276623360 38952 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=270140 CPUtime=702.3 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 345917 1251 0 0 70174 56 0 0 25 0 5 0 634821167 276623360 38952 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=270140 CPUtime=702.3 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 274551 1251 0 0 70187 43 0 0 25 0 5 0 634821167 276623360 38952 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2801.44
Current children cumulated vsize (KiB) 270140

[startup+762.313 s]
/proc/loadavg: 8.24 7.85 7.13 10/358 28618
/proc/meminfo: memFree=21227640/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=282260 CPUtime=3040.82 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 1373606 1251 0 0 303858 224 0 0 18 0 5 0 634821166 289034240 41982 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 70565 41982 179 55 0 68451 0
[pid=28588/tid=28594] ppid=28586 vsize=282260 CPUtime=762.31 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 364422 1251 0 0 76172 59 0 0 25 0 5 0 634821167 289034240 41982 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=282260 CPUtime=753.83 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 344166 1251 0 0 75328 55 0 0 25 0 5 0 634821167 289034240 41982 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=282260 CPUtime=762.31 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 371537 1251 0 0 76171 60 0 0 25 0 5 0 634821167 289034240 41982 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=282260 CPUtime=762.32 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 293172 1251 0 0 76185 47 0 0 25 0 5 0 634821167 289034240 41982 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3040.82
Current children cumulated vsize (KiB) 282260

[startup+822.301 s]
/proc/loadavg: 8.21 7.91 7.19 10/358 28629
/proc/meminfo: memFree=21216376/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=288536 CPUtime=3280.07 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 1452264 1251 0 0 327770 237 0 0 18 0 5 0 634821166 295460864 43578 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 72134 43578 179 55 0 70020 0
[pid=28588/tid=28594] ppid=28586 vsize=288536 CPUtime=822.3 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 384374 1251 0 0 82167 63 0 0 25 0 5 0 634821167 295460864 43578 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=288536 CPUtime=813.15 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 364335 1251 0 0 81256 59 0 0 25 0 5 0 634821167 295460864 43578 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=288536 CPUtime=822.31 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 393627 1251 0 0 82167 64 0 0 25 0 5 0 634821167 295460864 43578 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=288536 CPUtime=822.28 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 309619 1251 0 0 82179 49 0 0 25 0 5 0 634821167 295460864 43578 33554432000 4194304 4417452 140735444786608 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3280.07
Current children cumulated vsize (KiB) 288536

[startup+882.3 s]
/proc/loadavg: 8.43 8.00 7.26 11/365 29027
/proc/meminfo: memFree=21258408/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=250032 CPUtime=3518.96 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 1533234 1251 0 0 351646 250 0 0 18 0 5 0 634821166 256032768 33953 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 62508 33953 179 55 0 60394 0
[pid=28588/tid=28594] ppid=28586 vsize=250032 CPUtime=882.1 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 407881 1251 0 0 88144 66 0 0 25 0 5 0 634821167 256032768 33953 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=250032 CPUtime=872.44 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 383306 1251 0 0 87182 62 0 0 25 0 5 0 634821167 256032768 33953 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=250032 CPUtime=882.26 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 416523 1251 0 0 88158 68 0 0 25 0 5 0 634821167 256032768 33953 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=250032 CPUtime=882.13 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 325215 1251 0 0 88161 52 0 0 25 0 5 0 634821167 256032768 33953 33554432000 4194304 4417452 140735444786608 18446744073709551615 4366087 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3518.96
Current children cumulated vsize (KiB) 250032

[startup+942.301 s]
/proc/loadavg: 8.19 8.01 7.31 10/358 29105
/proc/meminfo: memFree=21252928/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=273668 CPUtime=3758.05 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 1607168 1251 0 0 375544 261 0 0 18 0 5 0 634821166 280236032 39834 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 68417 39834 179 55 0 66303 0
[pid=28588/tid=28594] ppid=28586 vsize=273668 CPUtime=942.08 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 427138 1251 0 0 94139 69 0 0 25 0 5 0 634821167 280236032 39834 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=273668 CPUtime=931.74 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 403683 1251 0 0 93109 65 0 0 25 0 5 0 634821167 280236032 39834 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=273668 CPUtime=942.06 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 439194 1251 0 0 94135 71 0 0 25 0 5 0 634821167 280236032 39834 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=273668 CPUtime=942.13 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 336844 1251 0 0 94159 54 0 0 25 0 5 0 634821167 280236032 39834 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3758.05
Current children cumulated vsize (KiB) 273668

[startup+1002.3 s]
/proc/loadavg: 8.12 8.02 7.36 10/358 29107
/proc/meminfo: memFree=21234564/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=282156 CPUtime=3997.35 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 1676216 1251 0 0 399464 271 0 0 18 0 5 0 634821166 288927744 41977 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 70539 41977 179 55 0 68425 0
[pid=28588/tid=28594] ppid=28586 vsize=282156 CPUtime=1002.08 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 445881 1251 0 0 100137 71 0 0 25 0 5 0 634821167 288927744 41977 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=282156 CPUtime=991.04 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 424344 1251 0 0 99036 68 0 0 25 0 5 0 634821167 288927744 41977 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=282156 CPUtime=1002.06 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 458780 1251 0 0 100132 74 0 0 25 0 5 0 634821167 288927744 41977 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=282156 CPUtime=1002.13 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 346902 1251 0 0 100158 55 0 0 25 0 5 0 634821167 288927744 41977 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3997.35
Current children cumulated vsize (KiB) 282156

[startup+1062.3 s]
/proc/loadavg: 8.10 8.03 7.40 10/358 29108
/proc/meminfo: memFree=21214712/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=282728 CPUtime=4236.68 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 1755287 1251 0 0 423384 284 0 0 18 0 5 0 634821166 289513472 42099 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 70682 42099 179 55 0 68568 0
[pid=28588/tid=28594] ppid=28586 vsize=282728 CPUtime=1062.08 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 466610 1251 0 0 106133 75 0 0 25 0 5 0 634821167 289513472 42099 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=282728 CPUtime=1050.37 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 444567 1251 0 0 104965 72 0 0 25 0 5 0 634821167 289513472 42099 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=282728 CPUtime=1062.07 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 480840 1251 0 0 106129 78 0 0 25 0 5 0 634821167 289513472 42099 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=282728 CPUtime=1062.14 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 362961 1251 0 0 106156 58 0 0 25 0 5 0 634821167 289513472 42099 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4236.68
Current children cumulated vsize (KiB) 282728

[startup+1122.3 s]
/proc/loadavg: 8.03 8.02 7.43 10/358 29110
/proc/meminfo: memFree=21220764/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=304696 CPUtime=4476 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 1827563 1251 0 0 447304 296 0 0 18 0 5 0 634821166 312008704 47591 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 76174 47591 179 55 0 74060 0
[pid=28588/tid=28594] ppid=28586 vsize=304696 CPUtime=1122.08 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 480461 1251 0 0 112131 77 0 0 25 0 5 0 634821167 312008704 47591 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=304696 CPUtime=1109.68 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 468714 1251 0 0 110893 75 0 0 25 0 5 0 634821167 312008704 47591 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=304696 CPUtime=1122.07 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 503109 1251 0 0 112125 82 0 0 25 0 5 0 634821167 312008704 47591 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=304696 CPUtime=1122.14 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 374970 1251 0 0 112154 60 0 0 25 0 5 0 634821167 312008704 47591 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4476
Current children cumulated vsize (KiB) 304696

[startup+1182.3 s]
/proc/loadavg: 8.10 8.05 7.48 9/358 29112
/proc/meminfo: memFree=21225340/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=294044 CPUtime=4715.32 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 1890667 1251 0 0 471226 306 0 0 18 0 5 0 634821166 301101056 44928 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 73511 44928 179 55 0 71397 0
[pid=28588/tid=28594] ppid=28586 vsize=294044 CPUtime=1182.09 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 501159 1251 0 0 118128 81 0 0 25 0 5 0 634821167 301101056 44928 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364850 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=294044 CPUtime=1169 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 486053 1251 0 0 116822 78 0 0 25 0 5 0 634821167 301101056 44928 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=294044 CPUtime=1182.06 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 517500 1251 0 0 118122 84 0 0 25 0 5 0 634821167 301101056 44928 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=294044 CPUtime=1182.14 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 385646 1251 0 0 118152 62 0 0 25 0 5 0 634821167 301101056 44928 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4715.32
Current children cumulated vsize (KiB) 294044



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.6 s]
/proc/loadavg: 8.23 8.08 7.50 9/358 29112
/proc/meminfo: memFree=21175112/32951124 swapFree=67111348/67111528
[pid=28588] ppid=28586 vsize=292604 CPUtime=4800.3 cores=1,3,5,7
/proc/28588/stat : 28588 (plingeling) S 28586 28588 27864 0 -1 4202496 1918893 1251 0 0 479718 312 0 0 18 0 5 0 634821166 299626496 44568 33554432000 4194304 4417452 140735444786608 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28588/statm: 73151 44568 179 55 0 71037 0
[pid=28588/tid=28594] ppid=28586 vsize=292604 CPUtime=1203.4 cores=1,3,5,7
/proc/28588/task/28594/stat : 28594 (plingeling) R 28586 28588 27864 0 -1 4202560 507462 1251 0 0 120258 82 0 0 25 0 5 0 634821167 299626496 44568 33554432000 4194304 4417452 140735444786608 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=28588/tid=28595] ppid=28586 vsize=292604 CPUtime=1190.04 cores=1,3,5,7
/proc/28588/task/28595/stat : 28595 (plingeling) R 28586 28588 27864 0 -1 4202560 494200 1251 0 0 118925 79 0 0 25 0 5 0 634821167 299626496 44568 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28588/tid=28596] ppid=28586 vsize=292604 CPUtime=1203.38 cores=1,3,5,7
/proc/28588/task/28596/stat : 28596 (plingeling) R 28586 28588 27864 0 -1 4202560 526993 1251 0 0 120252 86 0 0 25 0 5 0 634821167 299626496 44568 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28588/tid=28597] ppid=28586 vsize=292604 CPUtime=1203.45 cores=1,3,5,7
/proc/28588/task/28597/stat : 28597 (plingeling) R 28586 28588 27864 0 -1 4202560 389929 1251 0 0 120282 63 0 0 25 0 5 0 634821167 299626496 44568 33554432000 4194304 4417452 140735444786608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 292604

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.63
CPU time (s): 4800.34
CPU user time (s): 4797.21
CPU system time (s): 3.13252
CPU usage (%): 398.823
Max. virtual memory (cumulated for all children) (KiB): 331456

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.21
system time used= 3.13252
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1920144
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 178
involuntary context switches= 35435

runsolver used 3.9304 second user time and 9.59354 second system time

The end

Launcher Data 

Begin job on node144 at 2011-05-15 03:47:30
IDJOB=3371181
IDBENCH=83144
IDSOLVER=1848
FILE ID=node144/3371181-1305424050
RUNJOBID= node144-1305424050-28560
PBS_JOBID= 13324583
Free space on /tmp= 73240 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n160-s73223945-unsat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371181-1305424050/watcher-3371181-1305424050 -o /tmp/evaluation-result-3371181-1305424050/solver-3371181-1305424050 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371181-1305424050.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ebbfc0ffb6aa4fcba0d5ce3964018543
RANDOM SEED=1040798330

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21542836 kB
Buffers:        292860 kB
Cached:        3640224 kB
SwapCached:          0 kB
Active:        8225556 kB
Inactive:      2836204 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21542836 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:             444 kB
Writeback:           0 kB
AnonPages:     7128784 kB
Mapped:          27184 kB
Slab:           244968 kB
PageTables:      37312 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 82033864 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73256 MiB
End job on node144 at 2011-05-15 04:07:36