Trace number 3273815

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.29 1201.72

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n120-s55656844-unsat.cnf
MD5SUM4877ca9f3fe317c84d3087c8296a2a0b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark219.038
Satisfiable
(Un)Satisfiability was proved
Number of variables121
Number of clauses252
Sum of the clauses size756
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3252
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3273815-1304084275/watcher-3273815-1304084275 -o /tmp/evaluation-result-3273815-1304084275/solver-3273815-1304084275 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3273815-1304084275.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.56 8.06 8.13 1/176 5588
/proc/meminfo: memFree=29738100/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=49832 CPUtime=0 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 327 1253 0 0 0 0 0 0 23 0 5 0 520025400 51027968 253 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 12458 253 173 55 0 10344 0
[pid=5588/tid=5594] ppid=5586 vsize=49832 CPUtime=0 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 26 1253 0 0 0 0 0 0 24 0 5 0 520025401 51027968 253 33554432000 4194304 4417332 140734554792208 18446744073709551615 4273068 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=49832 CPUtime=0 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 0 1253 0 0 0 0 0 0 25 0 5 0 520025401 51027968 253 33554432000 4194304 4417332 140734554792208 18446744073709551615 255377357809 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=49832 CPUtime=0 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 2 1253 0 0 0 0 0 0 25 0 5 0 520025401 51027968 253 33554432000 4194304 4417332 140734554792208 18446744073709551615 255377406495 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=49832 CPUtime=0 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 1 1253 0 0 0 0 0 0 25 0 5 0 520025401 51027968 253 33554432000 4194304 4417332 140734554792208 18446744073709551615 255377406495 0 0 4096 17442 0 0 0 -1 2 0 0 0

[startup+0.0718459 s]
/proc/loadavg: 7.56 8.06 8.13 1/176 5588
/proc/meminfo: memFree=29738100/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=118356 CPUtime=0.26 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 1164 1253 0 0 26 0 0 0 23 0 5 0 520025400 121196544 1016 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 29589 1016 179 55 0 27475 0
[pid=5588/tid=5594] ppid=5586 vsize=118356 CPUtime=0.06 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 218 1253 0 0 6 0 0 0 25 0 5 0 520025401 121196544 1016 33554432000 4194304 4417332 140734554792208 18446744073709551615 4243554 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=118284 CPUtime=0.06 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 190 1253 0 0 6 0 0 0 25 0 5 0 520025401 121122816 998 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=118244 CPUtime=0.06 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 258 1253 0 0 6 0 0 0 25 0 5 0 520025401 121081856 998 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=118244 CPUtime=0.06 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 200 1253 0 0 6 0 0 0 25 0 5 0 520025401 121081856 998 33554432000 4194304 4417332 140734554792208 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 118356

[startup+0.100839 s]
/proc/loadavg: 7.56 8.06 8.13 1/176 5588
/proc/meminfo: memFree=29738100/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=118384 CPUtime=0.37 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 1341 1253 0 0 37 0 0 0 23 0 5 0 520025400 121225216 1043 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 29596 1043 179 55 0 27482 0
[pid=5588/tid=5594] ppid=5586 vsize=118384 CPUtime=0.09 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 286 1253 0 0 9 0 0 0 25 0 5 0 520025401 121225216 1043 33554432000 4194304 4417332 140734554792208 18446744073709551615 4356788 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=118384 CPUtime=0.09 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 190 1253 0 0 9 0 0 0 25 0 5 0 520025401 121225216 1043 33554432000 4194304 4417332 140734554792208 18446744073709551615 4357164 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=118384 CPUtime=0.09 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 352 1253 0 0 9 0 0 0 25 0 5 0 520025401 121225216 1043 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=118512 CPUtime=0.09 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 227 1253 0 0 9 0 0 0 25 0 5 0 520025401 121356288 1055 33554432000 4194304 4417332 140734554792208 18446744073709551615 255376995309 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 118384

[startup+0.300803 s]
/proc/loadavg: 7.56 8.06 8.13 1/176 5588
/proc/meminfo: memFree=29738100/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=121008 CPUtime=1.17 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 3371 1253 0 0 117 0 0 0 23 0 5 0 520025400 123912192 1700 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 30252 1700 179 55 0 28138 0
[pid=5588/tid=5594] ppid=5586 vsize=121008 CPUtime=0.29 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 823 1253 0 0 29 0 0 0 25 0 5 0 520025401 123912192 1700 33554432000 4194304 4417332 140734554792208 18446744073709551615 4352559 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=121008 CPUtime=0.29 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 645 1253 0 0 29 0 0 0 25 0 5 0 520025401 123912192 1700 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=121008 CPUtime=0.29 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 836 1253 0 0 29 0 0 0 25 0 5 0 520025401 123912192 1700 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=121008 CPUtime=0.29 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 769 1253 0 0 29 0 0 0 25 0 5 0 520025401 123912192 1700 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364614 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 121008

[startup+0.700729 s]
/proc/loadavg: 7.56 8.06 8.13 1/176 5588
/proc/meminfo: memFree=29738100/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=122976 CPUtime=2.77 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 6203 1253 0 0 277 0 0 0 23 0 5 0 520025400 125927424 2192 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 30744 2192 179 55 0 28630 0
[pid=5588/tid=5594] ppid=5586 vsize=122976 CPUtime=0.69 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 1638 1253 0 0 69 0 0 0 25 0 5 0 520025401 125927424 2192 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364482 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=122976 CPUtime=0.69 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 1282 1253 0 0 69 0 0 0 25 0 5 0 520025401 125927424 2192 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=122976 CPUtime=0.69 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 1607 1253 0 0 69 0 0 0 25 0 5 0 520025401 125927424 2192 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=122976 CPUtime=0.69 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 1378 1253 0 0 69 0 0 0 25 0 5 0 520025401 125927424 2192 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.77
Current children cumulated vsize (KiB) 122976

[startup+1.50058 s]
/proc/loadavg: 7.56 8.06 8.13 9/190 5617
/proc/meminfo: memFree=29716452/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=127840 CPUtime=5.96 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 11940 1253 0 0 595 1 0 0 23 0 5 0 520025400 130908160 3408 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 31960 3408 179 55 0 29846 0
[pid=5588/tid=5594] ppid=5586 vsize=127840 CPUtime=1.48 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 3077 1253 0 0 148 0 0 0 25 0 5 0 520025401 130908160 3408 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=127840 CPUtime=1.48 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 2523 1253 0 0 148 0 0 0 25 0 5 0 520025401 130908160 3408 33554432000 4194304 4417332 140734554792208 18446744073709551615 4251261 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=127840 CPUtime=1.48 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 3096 1253 0 0 148 0 0 0 25 0 5 0 520025401 130908160 3408 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=127840 CPUtime=1.49 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 2946 1253 0 0 149 0 0 0 25 0 5 0 520025401 130908160 3408 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 127840

[startup+3.10029 s]
/proc/loadavg: 7.56 8.06 8.13 9/190 5617
/proc/meminfo: memFree=29711860/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=132512 CPUtime=12.35 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 19921 1253 0 0 1232 3 0 0 23 0 5 0 520025400 135692288 4576 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 33128 4576 179 55 0 31014 0
[pid=5588/tid=5594] ppid=5586 vsize=132512 CPUtime=3.09 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 5418 1253 0 0 308 1 0 0 25 0 5 0 520025401 135692288 4576 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=132512 CPUtime=3.07 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 4806 1253 0 0 307 0 0 0 25 0 5 0 520025401 135692288 4576 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=132512 CPUtime=3.09 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 4944 1253 0 0 308 1 0 0 25 0 5 0 520025401 135692288 4576 33554432000 4194304 4417332 140734554792208 18446744073709551615 4250876 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=132512 CPUtime=3.08 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 4455 1253 0 0 308 0 0 0 25 0 5 0 520025401 135692288 4576 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 132512

[startup+6.30069 s]
/proc/loadavg: 7.67 8.08 8.14 9/190 5617
/proc/meminfo: memFree=29701080/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=136132 CPUtime=25.14 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 33974 1253 0 0 2509 5 0 0 23 0 5 0 520025400 139399168 5479 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 34033 5479 179 55 0 31919 0
[pid=5588/tid=5594] ppid=5586 vsize=136132 CPUtime=6.29 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 8396 1253 0 0 628 1 0 0 25 0 5 0 520025401 139399168 5479 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=136132 CPUtime=6.26 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 8758 1253 0 0 625 1 0 0 25 0 5 0 520025401 139399168 5479 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=136132 CPUtime=6.29 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 8838 1253 0 0 627 2 0 0 25 0 5 0 520025401 139399168 5479 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=136132 CPUtime=6.29 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 7684 1253 0 0 628 1 0 0 25 0 5 0 520025401 139399168 5479 33554432000 4194304 4417332 140734554792208 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.14
Current children cumulated vsize (KiB) 136132

[startup+12.7005 s]
/proc/loadavg: 7.70 8.08 8.14 9/190 5617
/proc/meminfo: memFree=29682512/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=138816 CPUtime=50.7 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 58365 1253 0 0 5060 10 0 0 23 0 5 0 520025400 142147584 6120 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 34704 6120 179 55 0 32590 0
[pid=5588/tid=5594] ppid=5586 vsize=138816 CPUtime=12.68 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 15240 1253 0 0 1266 2 0 0 25 0 5 0 520025401 142147584 6120 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=138816 CPUtime=12.62 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 15169 1253 0 0 1260 2 0 0 25 0 5 0 520025401 142147584 6120 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=138816 CPUtime=12.69 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 14942 1253 0 0 1266 3 0 0 25 0 5 0 520025401 142147584 6120 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=138816 CPUtime=12.68 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 12716 1253 0 0 1266 2 0 0 25 0 5 0 520025401 142147584 6120 33554432000 4194304 4417332 140734554792208 18446744073709551615 4236554 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 138816

[startup+25.5011 s]
/proc/loadavg: 7.77 8.07 8.13 9/190 5618
/proc/meminfo: memFree=29666016/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=150936 CPUtime=101.83 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 100526 1253 0 0 10167 16 0 0 23 0 5 0 520025400 154558464 9150 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 37734 9150 179 55 0 35620 0
[pid=5588/tid=5594] ppid=5586 vsize=150936 CPUtime=25.49 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 24992 1253 0 0 2545 4 0 0 25 0 5 0 520025401 154558464 9150 33554432000 4194304 4417332 140734554792208 18446744073709551615 4365991 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=150936 CPUtime=25.35 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 25724 1253 0 0 2531 4 0 0 25 0 5 0 520025401 154558464 9150 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=150936 CPUtime=25.48 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 25448 1253 0 0 2545 3 0 0 25 0 5 0 520025401 154558464 9150 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=150936 CPUtime=25.48 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 24064 1253 0 0 2545 3 0 0 25 0 5 0 520025401 154558464 9150 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 101.83
Current children cumulated vsize (KiB) 150936

[startup+51.1004 s]
/proc/loadavg: 7.84 8.07 8.13 9/190 5619
/proc/meminfo: memFree=29637720/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=164224 CPUtime=204.09 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 160809 1253 0 0 20384 25 0 0 23 0 5 0 520025400 168165376 12502 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 41056 12502 179 55 0 38942 0
[pid=5588/tid=5594] ppid=5586 vsize=164224 CPUtime=51.08 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 39794 1253 0 0 5102 6 0 0 25 0 5 0 520025401 168165376 12502 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=164224 CPUtime=50.8 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 39967 1253 0 0 5075 5 0 0 25 0 5 0 520025401 168165376 12502 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=164224 CPUtime=51.08 cores=0,2,4,6

################
# More data... #
################

[pid=5588/tid=5595] ppid=5586 vsize=252940 CPUtime=758.15 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 267895 1253 0 0 75774 41 0 0 25 0 5 0 520025401 259010560 34677 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=252940 CPUtime=762.3 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 262901 1253 0 0 76189 41 0 0 25 0 5 0 520025401 259010560 34677 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=252940 CPUtime=762.25 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 282879 1253 0 0 76182 43 0 0 25 0 5 0 520025401 259010560 34677 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3045.05
Current children cumulated vsize (KiB) 252940

[startup+822.3 s]
/proc/loadavg: 8.27 8.20 8.15 9/190 5639
/proc/meminfo: memFree=29392632/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=238976 CPUtime=3284.69 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 1146316 1253 0 0 328292 177 0 0 23 0 5 0 520025400 244711424 31160 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 59744 31160 179 55 0 57630 0
[pid=5588/tid=5594] ppid=5586 vsize=238976 CPUtime=822.32 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 290024 1253 0 0 82187 45 0 0 25 0 5 0 520025401 244711424 31160 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=238976 CPUtime=817.83 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 281005 1253 0 0 81740 43 0 0 25 0 5 0 520025401 244711424 31160 33554432000 4194304 4417332 140734554792208 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=238976 CPUtime=822.29 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 277697 1253 0 0 82186 43 0 0 25 0 5 0 520025401 244711424 31160 33554432000 4194304 4417332 140734554792208 18446744073709551615 4236797 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=238976 CPUtime=822.23 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 297292 1253 0 0 82178 45 0 0 25 0 5 0 520025401 244711424 31160 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3284.69
Current children cumulated vsize (KiB) 238976

[startup+882.3 s]
/proc/loadavg: 8.17 8.18 8.14 9/190 5641
/proc/meminfo: memFree=29389504/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=225924 CPUtime=3524.37 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 1208542 1253 0 0 352250 187 0 0 23 0 5 0 520025400 231346176 27921 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 56481 27921 179 55 0 54367 0
[pid=5588/tid=5594] ppid=5586 vsize=225924 CPUtime=882.32 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 309232 1253 0 0 88184 48 0 0 25 0 5 0 520025401 231346176 27921 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=225924 CPUtime=877.5 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 294307 1253 0 0 87706 44 0 0 25 0 5 0 520025401 231346176 27921 33554432000 4194304 4417332 140734554792208 18446744073709551615 4245753 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=225924 CPUtime=882.29 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 291631 1253 0 0 88184 45 0 0 25 0 5 0 520025401 231346176 27921 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=225924 CPUtime=882.23 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 313074 1253 0 0 88175 48 0 0 25 0 5 0 520025401 231346176 27921 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3524.37
Current children cumulated vsize (KiB) 225924

[startup+942.3 s]
/proc/loadavg: 8.22 8.19 8.15 9/190 5642
/proc/meminfo: memFree=29389368/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=241172 CPUtime=3764.04 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 1264986 1253 0 0 376210 194 0 0 23 0 5 0 520025400 246960128 31731 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 60293 31731 179 55 0 58179 0
[pid=5588/tid=5594] ppid=5586 vsize=241172 CPUtime=942.32 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 322777 1253 0 0 94183 49 0 0 25 0 5 0 520025401 246960128 31731 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=241172 CPUtime=937.18 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 307725 1253 0 0 93672 46 0 0 25 0 5 0 520025401 246960128 31731 33554432000 4194304 4417332 140734554792208 18446744073709551615 4366582 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=241172 CPUtime=942.3 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 307140 1253 0 0 94182 48 0 0 25 0 5 0 520025401 246960128 31731 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=241172 CPUtime=942.23 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 327046 1253 0 0 94173 50 0 0 25 0 5 0 520025401 246960128 31731 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3764.04
Current children cumulated vsize (KiB) 241172

[startup+1002.3 s]
/proc/loadavg: 8.19 8.18 8.15 9/190 5644
/proc/meminfo: memFree=29404964/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=262824 CPUtime=4003.72 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 1320107 1253 0 0 400170 202 0 0 23 0 5 0 520025400 269131776 37144 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 65706 37144 179 55 0 63592 0
[pid=5588/tid=5594] ppid=5586 vsize=262824 CPUtime=1002.32 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 330867 1253 0 0 100182 50 0 0 25 0 5 0 520025401 269131776 37144 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=262824 CPUtime=996.86 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 325211 1253 0 0 99637 49 0 0 25 0 5 0 520025401 269131776 37144 33554432000 4194304 4417332 140734554792208 18446744073709551615 4264994 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=262824 CPUtime=1002.29 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 323969 1253 0 0 100179 50 0 0 25 0 5 0 520025401 269131776 37144 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=262824 CPUtime=1002.22 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 339762 1253 0 0 100171 51 0 0 25 0 5 0 520025401 269131776 37144 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4003.72
Current children cumulated vsize (KiB) 262824

[startup+1062.3 s]
/proc/loadavg: 8.12 8.16 8.14 9/190 5645
/proc/meminfo: memFree=29354964/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=264492 CPUtime=4243.39 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 1368805 1253 0 0 424130 209 0 0 23 0 5 0 520025400 270839808 37561 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 66123 37561 179 55 0 64009 0
[pid=5588/tid=5594] ppid=5586 vsize=264492 CPUtime=1062.32 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 338763 1253 0 0 106181 51 0 0 25 0 5 0 520025401 270839808 37561 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=264492 CPUtime=1056.53 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 336293 1253 0 0 105602 51 0 0 25 0 5 0 520025401 270839808 37561 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=264492 CPUtime=1062.3 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 339699 1253 0 0 106177 53 0 0 25 0 5 0 520025401 270839808 37561 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=264492 CPUtime=1062.21 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 353752 1253 0 0 106168 53 0 0 25 0 5 0 520025401 270839808 37561 33554432000 4194304 4417332 140734554792208 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4243.39
Current children cumulated vsize (KiB) 264492

[startup+1122.3 s]
/proc/loadavg: 8.20 8.17 8.15 9/190 5647
/proc/meminfo: memFree=29349120/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=254328 CPUtime=4483.06 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 1424689 1253 0 0 448089 217 0 0 23 0 5 0 520025400 260431872 34998 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 63582 34998 179 55 0 61468 0
[pid=5588/tid=5594] ppid=5586 vsize=254328 CPUtime=1122.32 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 351924 1253 0 0 112179 53 0 0 25 0 5 0 520025401 260431872 34998 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364899 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=254328 CPUtime=1116.2 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 350573 1253 0 0 111567 53 0 0 25 0 5 0 520025401 260431872 34998 33554432000 4194304 4417332 140734554792208 18446744073709551615 4232648 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=254328 CPUtime=1122.3 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 355273 1253 0 0 112175 55 0 0 25 0 5 0 520025401 260431872 34998 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=254328 CPUtime=1122.21 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 366621 1253 0 0 112166 55 0 0 25 0 5 0 520025401 260431872 34998 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4483.06
Current children cumulated vsize (KiB) 254328

[startup+1182.3 s]
/proc/loadavg: 8.12 8.16 8.14 9/190 5649
/proc/meminfo: memFree=29370168/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=258524 CPUtime=4722.74 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 1476384 1253 0 0 472048 226 0 0 23 0 5 0 520025400 264728576 36047 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 64631 36047 179 55 0 62517 0
[pid=5588/tid=5594] ppid=5586 vsize=258524 CPUtime=1182.33 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 361144 1253 0 0 118178 55 0 0 25 0 5 0 520025401 264728576 36047 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=258524 CPUtime=1175.88 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 365885 1253 0 0 117532 56 0 0 25 0 5 0 520025401 264728576 36047 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=258524 CPUtime=1182.29 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 366977 1253 0 0 118173 56 0 0 25 0 5 0 520025401 264728576 36047 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364990 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=258524 CPUtime=1182.2 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 382080 1253 0 0 118163 57 0 0 25 0 5 0 520025401 264728576 36047 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4722.74
Current children cumulated vsize (KiB) 258524



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.09 8.14 8.14 9/190 5649
/proc/meminfo: memFree=29350696/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=274256 CPUtime=4800.25 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 1502260 1253 0 0 479794 231 0 0 23 0 5 0 520025400 280838144 39980 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 68564 39980 179 55 0 66450 0
[pid=5588/tid=5594] ppid=5586 vsize=274256 CPUtime=1201.73 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 365968 1253 0 0 120117 56 0 0 25 0 5 0 520025401 280838144 39980 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=274256 CPUtime=1195.17 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 373158 1253 0 0 119460 57 0 0 25 0 5 0 520025401 280838144 39980 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=274256 CPUtime=1201.7 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 375705 1253 0 0 120112 58 0 0 25 0 5 0 520025401 280838144 39980 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=274256 CPUtime=1201.61 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 387131 1253 0 0 120103 58 0 0 25 0 5 0 520025401 280838144 39980 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 274256

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.09 8.14 8.14 9/190 5649
/proc/meminfo: memFree=29350696/32951124 swapFree=67111352/67111528
[pid=5588] ppid=5586 vsize=274256 CPUtime=4800.25 cores=0,2,4,6
/proc/5588/stat : 5588 (plingeling) S 5586 5588 4914 0 -1 4202496 1502260 1253 0 0 479794 231 0 0 23 0 5 0 520025400 280838144 39980 33554432000 4194304 4417332 140734554792208 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 68564 39980 179 55 0 66450 0
[pid=5588/tid=5594] ppid=5586 vsize=274256 CPUtime=1201.73 cores=0,2,4,6
/proc/5588/task/5594/stat : 5594 (plingeling) R 5586 5588 4914 0 -1 4202560 365968 1253 0 0 120117 56 0 0 25 0 5 0 520025401 280838144 39980 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5588/tid=5595] ppid=5586 vsize=274256 CPUtime=1195.17 cores=0,2,4,6
/proc/5588/task/5595/stat : 5595 (plingeling) R 5586 5588 4914 0 -1 4202560 373158 1253 0 0 119460 57 0 0 25 0 5 0 520025401 280838144 39980 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5588/tid=5596] ppid=5586 vsize=274256 CPUtime=1201.7 cores=0,2,4,6
/proc/5588/task/5596/stat : 5596 (plingeling) R 5586 5588 4914 0 -1 4202560 375705 1253 0 0 120112 58 0 0 25 0 5 0 520025401 280838144 39980 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5588/tid=5597] ppid=5586 vsize=274256 CPUtime=1201.61 cores=0,2,4,6
/proc/5588/task/5597/stat : 5597 (plingeling) R 5586 5588 4914 0 -1 4202560 387131 1253 0 0 120103 58 0 0 25 0 5 0 520025401 280838144 39980 33554432000 4194304 4417332 140734554792208 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 274256

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.72
CPU time (s): 4800.29
CPU user time (s): 4797.97
CPU system time (s): 2.32165
CPU usage (%): 399.451
Max. virtual memory (cumulated for all children) (KiB): 302528

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.97
system time used= 2.32165
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1503513
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 87
involuntary context switches= 73225

runsolver used 1.84972 second user time and 4.71428 second system time

The end

Launcher Data 

Begin job on node135 at 2011-04-29 15:37:55
IDJOB=3273815
IDBENCH=83147
IDSOLVER=1605
FILE ID=node135/3273815-1304084275
RUNJOBID= node135-1304084275-5578
PBS_JOBID= 13170518
Free space on /tmp= 71120 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n120-s55656844-unsat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3273815-1304084275/watcher-3273815-1304084275 -o /tmp/evaluation-result-3273815-1304084275/solver-3273815-1304084275 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3273815-1304084275.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4877ca9f3fe317c84d3087c8296a2a0b
RANDOM SEED=646903886

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29738380 kB
Buffers:        905748 kB
Cached:        1723188 kB
SwapCached:        172 kB
Active:         108504 kB
Inactive:      2586256 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29738380 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:              24 kB
Writeback:           8 kB
AnonPages:       65028 kB
Mapped:          14496 kB
Slab:           453664 kB
PageTables:       4856 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   192720 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71120 MiB
End job on node135 at 2011-04-29 15:57:59