Trace number 3273768

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.27 1201.72

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n220-s24359701-sat.cnf
MD5SUMceff918324677440f95867755c4e7133
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark5.76412
Satisfiable
(Un)Satisfiability was proved
Number of variables220
Number of clauses528
Sum of the clauses size1320
Maximum clause length5
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2440
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 588
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3273768-1304084233/watcher-3273768-1304084233 -o /tmp/evaluation-result-3273768-1304084233/solver-3273768-1304084233 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3273768-1304084233.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.83 4.86 6.48 5/185 9271
/proc/meminfo: memFree=25032472/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=49836 CPUtime=0 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 327 1257 0 0 0 0 0 0 23 0 5 0 520021539 51032064 252 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 12459 253 171 55 0 10345 0
[pid=9271/tid=9277] ppid=9269 vsize=115372 CPUtime=0 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 25 1257 0 0 0 0 0 0 24 0 5 0 520021540 118140928 257 33554432000 4194304 4417332 140734693698896 18446744073709551615 4270953 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=115372 CPUtime=0 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 5 1257 0 0 0 0 0 0 25 0 5 0 520021540 118140928 258 33554432000 4194304 4417332 140734693698896 18446744073709551615 246516939246 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=115372 CPUtime=0 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 5 1257 0 0 0 0 0 0 25 0 5 0 520021540 118140928 258 33554432000 4194304 4417332 140734693698896 18446744073709551615 246516495045 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=115372 CPUtime=0 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 0 1257 0 0 0 0 0 0 25 0 5 0 520021540 118140928 258 33554432000 4194304 4417332 140734693698896 18446744073709551615 246516890609 0 0 4096 17442 0 0 0 -1 3 0 0 0

[startup+0.539788 s]
/proc/loadavg: 3.83 4.86 6.48 5/185 9271
/proc/meminfo: memFree=25032472/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=124540 CPUtime=3.24 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 7376 1257 0 0 324 0 0 0 23 0 5 0 520021539 127528960 2613 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 31135 2613 181 55 0 29021 0
[pid=9271/tid=9277] ppid=9269 vsize=124540 CPUtime=0.81 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 1693 1257 0 0 81 0 0 0 25 0 5 0 520021540 127528960 2613 33554432000 4194304 4417332 140734693698896 18446744073709551615 4308160 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=124540 CPUtime=0.8 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 1635 1257 0 0 80 0 0 0 25 0 5 0 520021540 127528960 2613 33554432000 4194304 4417332 140734693698896 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=124540 CPUtime=0.81 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 1723 1257 0 0 81 0 0 0 25 0 5 0 520021540 127528960 2613 33554432000 4194304 4417332 140734693698896 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=124540 CPUtime=0.8 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 2028 1257 0 0 80 0 0 0 19 0 5 0 520021540 127528960 2613 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.24
Current children cumulated vsize (KiB) 124540

[startup+0.919469 s]
/proc/loadavg: 3.83 4.86 6.48 5/185 9271
/proc/meminfo: memFree=25032472/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=123224 CPUtime=3.64 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 8141 1257 0 0 364 0 0 0 23 0 5 0 520021539 126181376 2284 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 30806 2284 181 55 0 28692 0
[pid=9271/tid=9277] ppid=9269 vsize=123224 CPUtime=0.91 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 1693 1257 0 0 91 0 0 0 25 0 5 0 520021540 126181376 2284 33554432000 4194304 4417332 140734693698896 18446744073709551615 4309982 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=123224 CPUtime=0.9 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 1924 1257 0 0 90 0 0 0 25 0 5 0 520021540 126181376 2284 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=123224 CPUtime=0.91 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 1920 1257 0 0 91 0 0 0 25 0 5 0 520021540 126181376 2284 33554432000 4194304 4417332 140734693698896 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=123224 CPUtime=0.9 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 2307 1257 0 0 90 0 0 0 19 0 5 0 520021540 126181376 2284 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.64
Current children cumulated vsize (KiB) 123224

[startup+1.00046 s]
/proc/loadavg: 3.83 4.86 6.48 5/185 9271
/proc/meminfo: memFree=25032472/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=125056 CPUtime=3.97 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 8721 1257 0 0 396 1 0 0 23 0 5 0 520021539 128057344 2742 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 31264 2742 181 55 0 29150 0
[pid=9271/tid=9277] ppid=9269 vsize=125056 CPUtime=0.99 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 1821 1257 0 0 99 0 0 0 25 0 5 0 520021540 128057344 2742 33554432000 4194304 4417332 140734693698896 18446744073709551615 4255584 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=125056 CPUtime=0.98 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 2055 1257 0 0 98 0 0 0 25 0 5 0 520021540 128057344 2742 33554432000 4194304 4417332 140734693698896 18446744073709551615 4353476 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=125056 CPUtime=0.99 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 2073 1257 0 0 99 0 0 0 25 0 5 0 520021540 128057344 2742 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=125056 CPUtime=0.98 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 2475 1257 0 0 98 0 0 0 19 0 5 0 520021540 128057344 2742 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.97
Current children cumulated vsize (KiB) 125056

[startup+1.10044 s]
/proc/loadavg: 3.83 4.86 6.48 5/185 9271
/proc/meminfo: memFree=25032472/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=124592 CPUtime=4.37 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 9404 1257 0 0 436 1 0 0 23 0 5 0 520021539 127582208 2626 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 31148 2626 181 55 0 29034 0
[pid=9271/tid=9277] ppid=9269 vsize=124592 CPUtime=1.09 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 2376 1257 0 0 109 0 0 0 25 0 5 0 520021540 127582208 2626 33554432000 4194304 4417332 140734693698896 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=124592 CPUtime=1.08 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 2055 1257 0 0 108 0 0 0 25 0 5 0 520021540 127582208 2626 33554432000 4194304 4417332 140734693698896 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=124592 CPUtime=1.09 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 2073 1257 0 0 109 0 0 0 25 0 5 0 520021540 127582208 2626 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=124592 CPUtime=1.08 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 2603 1257 0 0 108 0 0 0 19 0 5 0 520021540 127582208 2626 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.37
Current children cumulated vsize (KiB) 124592

[startup+1.50037 s]
/proc/loadavg: 3.83 4.86 6.48 5/185 9271
/proc/meminfo: memFree=25032472/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=126956 CPUtime=5.97 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 12489 1257 0 0 596 1 0 0 23 0 5 0 520021539 130002944 3216 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 31739 3216 181 55 0 29625 0
[pid=9271/tid=9277] ppid=9269 vsize=126956 CPUtime=1.49 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 3074 1257 0 0 149 0 0 0 25 0 5 0 520021540 130002944 3216 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=126956 CPUtime=1.48 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 2799 1257 0 0 148 0 0 0 25 0 5 0 520021540 130002944 3216 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=126956 CPUtime=1.48 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 2800 1257 0 0 148 0 0 0 25 0 5 0 520021540 130002944 3216 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=126956 CPUtime=1.48 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 3519 1257 0 0 148 0 0 0 20 0 5 0 520021540 130002944 3216 33554432000 4194304 4417332 140734693698896 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 126956

[startup+3.10107 s]
/proc/loadavg: 3.83 4.86 6.48 9/190 9281
/proc/meminfo: memFree=24999516/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=131376 CPUtime=12.36 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 22639 1257 0 0 1233 3 0 0 23 0 5 0 520021539 134529024 4308 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 32844 4308 181 55 0 30730 0
[pid=9271/tid=9277] ppid=9269 vsize=131376 CPUtime=3.08 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 6214 1257 0 0 308 0 0 0 25 0 5 0 520021540 134529024 4308 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=131376 CPUtime=3.08 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 4994 1257 0 0 308 0 0 0 25 0 5 0 520021540 134529024 4308 33554432000 4194304 4417332 140734693698896 18446744073709551615 4305912 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=131376 CPUtime=3.08 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 5120 1257 0 0 308 0 0 0 25 0 5 0 520021540 134529024 4308 33554432000 4194304 4417332 140734693698896 18446744073709551615 4250907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=131376 CPUtime=3.07 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 6014 1257 0 0 307 0 0 0 25 0 5 0 520021540 134529024 4308 33554432000 4194304 4417332 140734693698896 18446744073709551615 4250873 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 131376

[startup+6.30649 s]
/proc/loadavg: 4.16 4.91 6.49 9/190 9281
/proc/meminfo: memFree=24987476/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=137780 CPUtime=25.16 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 35714 1257 0 0 2512 4 0 0 23 0 5 0 520021539 141086720 5914 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 34445 5914 181 55 0 32331 0
[pid=9271/tid=9277] ppid=9269 vsize=137780 CPUtime=6.3 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 9454 1257 0 0 629 1 0 0 25 0 5 0 520021540 141086720 5914 33554432000 4194304 4417332 140734693698896 18446744073709551615 4310608 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=137780 CPUtime=6.28 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 7912 1257 0 0 628 0 0 0 25 0 5 0 520021540 141086720 5914 33554432000 4194304 4417332 140734693698896 18446744073709551615 4251104 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=137780 CPUtime=6.29 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 8466 1257 0 0 629 0 0 0 25 0 5 0 520021540 141086720 5914 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=137780 CPUtime=6.26 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 9585 1257 0 0 625 1 0 0 25 0 5 0 520021540 141086720 5914 33554432000 4194304 4417332 140734693698896 18446744073709551615 4357618 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.16
Current children cumulated vsize (KiB) 137780

[startup+12.7003 s]
/proc/loadavg: 4.47 4.96 6.50 9/190 9281
/proc/meminfo: memFree=24976928/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=143604 CPUtime=50.71 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 61755 1257 0 0 5062 9 0 0 23 0 5 0 520021539 147050496 7355 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 35901 7355 181 55 0 33787 0
[pid=9271/tid=9277] ppid=9269 vsize=143604 CPUtime=12.69 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 15640 1257 0 0 1267 2 0 0 25 0 5 0 520021540 147050496 7355 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=143604 CPUtime=12.68 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 14459 1257 0 0 1266 2 0 0 25 0 5 0 520021540 147050496 7355 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=143604 CPUtime=12.68 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 15516 1257 0 0 1267 1 0 0 25 0 5 0 520021540 147050496 7355 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364639 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=143604 CPUtime=12.62 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 15843 1257 0 0 1260 2 0 0 25 0 5 0 520021540 147050496 7355 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364575 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 143604

[startup+25.501 s]
/proc/loadavg: 5.25 5.11 6.52 9/190 9282
/proc/meminfo: memFree=24950772/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=146516 CPUtime=101.83 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 98558 1257 0 0 10168 15 0 0 23 0 5 0 520021539 150032384 8077 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 36629 8077 181 55 0 34515 0
[pid=9271/tid=9277] ppid=9269 vsize=146516 CPUtime=25.49 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 28602 1257 0 0 2545 4 0 0 25 0 5 0 520021540 150032384 8077 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=146516 CPUtime=25.48 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 21748 1257 0 0 2545 3 0 0 25 0 5 0 520021540 150032384 8077 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=146516 CPUtime=25.49 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 23984 1257 0 0 2546 3 0 0 25 0 5 0 520021540 150032384 8077 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=146516 CPUtime=25.35 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 23927 1257 0 0 2531 4 0 0 25 0 5 0 520021540 150032384 8077 33554432000 4194304 4417332 140734693698896 18446744073709551615 4366038 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.83
Current children cumulated vsize (KiB) 146516

[startup+51.1003 s]
/proc/loadavg: 6.38 5.39 6.58 9/190 9282
/proc/meminfo: memFree=24940840/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=157936 CPUtime=204.09 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 161909 1257 0 0 20382 27 0 0 23 0 5 0 520021539 161726464 10962 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 39484 10962 181 55 0 37370 0
[pid=9271/tid=9277] ppid=9269 vsize=157936 CPUtime=51.08 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 43954 1257 0 0 5102 6 0 0 25 0 5 0 520021540 161726464 10962 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364769 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=157936 CPUtime=51.08 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 37904 1257 0 0 5101 7 0 0 25 0 5 0 520021540 161726464 10962 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=157936 CPUtime=51.08 cores=1,3,5,7

################
# More data... #
################

[pid=9271/tid=9278] ppid=9269 vsize=224816 CPUtime=762.23 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 236198 1257 0 0 76183 40 0 0 25 0 5 0 520021540 230211584 27682 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=224816 CPUtime=762.29 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 239758 1257 0 0 76192 37 0 0 25 0 5 0 520021540 230211584 27682 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=224816 CPUtime=758.15 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 234422 1257 0 0 75779 36 0 0 25 0 5 0 520021540 230211584 27682 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3045.01
Current children cumulated vsize (KiB) 224816

[startup+822.3 s]
/proc/loadavg: 8.20 7.95 7.45 9/190 9303
/proc/meminfo: memFree=24744544/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=218540 CPUtime=3284.69 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 981996 1257 0 0 328313 156 0 0 23 0 5 0 520021539 223784960 26113 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 54635 26113 181 55 0 52521 0
[pid=9271/tid=9277] ppid=9269 vsize=218540 CPUtime=822.31 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 236205 1257 0 0 82194 37 0 0 25 0 5 0 520021540 223784960 26113 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=218540 CPUtime=822.23 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 250295 1257 0 0 82181 42 0 0 25 0 5 0 520021540 223784960 26113 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=218540 CPUtime=822.29 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 251801 1257 0 0 82191 38 0 0 25 0 5 0 520021540 223784960 26113 33554432000 4194304 4417332 140734693698896 18446744073709551615 4365997 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=218540 CPUtime=817.83 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 243398 1257 0 0 81745 38 0 0 25 0 5 0 520021540 223784960 26113 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3284.69
Current children cumulated vsize (KiB) 218540

[startup+882.3 s]
/proc/loadavg: 8.21 8.00 7.49 9/190 9304
/proc/meminfo: memFree=24744260/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=236952 CPUtime=3524.35 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 1016713 1257 0 0 352274 161 0 0 23 0 5 0 520021539 242638848 30716 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 59238 30716 181 55 0 57124 0
[pid=9271/tid=9277] ppid=9269 vsize=236952 CPUtime=882.31 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 242863 1257 0 0 88193 38 0 0 25 0 5 0 520021540 242638848 30716 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=236952 CPUtime=882.22 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 258765 1257 0 0 88179 43 0 0 25 0 5 0 520021540 242638848 30716 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=236952 CPUtime=882.29 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 263325 1257 0 0 88189 40 0 0 25 0 5 0 520021540 242638848 30716 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=236952 CPUtime=877.51 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 251463 1257 0 0 87712 39 0 0 25 0 5 0 520021540 242638848 30716 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3524.35
Current children cumulated vsize (KiB) 236952

[startup+942.3 s]
/proc/loadavg: 8.12 8.01 7.53 9/190 9306
/proc/meminfo: memFree=24762448/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=233492 CPUtime=3764.06 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 1064202 1257 0 0 376236 170 0 0 23 0 5 0 520021539 239095808 29851 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 58373 29851 181 55 0 56259 0
[pid=9271/tid=9277] ppid=9269 vsize=233492 CPUtime=942.32 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 255469 1257 0 0 94191 41 0 0 25 0 5 0 520021540 239095808 29851 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=233492 CPUtime=942.22 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 266603 1257 0 0 94178 44 0 0 25 0 5 0 520021540 239095808 29851 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=233492 CPUtime=942.3 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 272146 1257 0 0 94189 41 0 0 25 0 5 0 520021540 239095808 29851 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=233492 CPUtime=937.18 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 269687 1257 0 0 93676 42 0 0 25 0 5 0 520021540 239095808 29851 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3764.06
Current children cumulated vsize (KiB) 233492

[startup+1002.3 s]
/proc/loadavg: 8.16 8.05 7.57 9/190 9308
/proc/meminfo: memFree=24737728/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=243192 CPUtime=4003.7 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 1107739 1257 0 0 400193 177 0 0 23 0 5 0 520021539 249028608 32035 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 60798 32035 181 55 0 58684 0
[pid=9271/tid=9277] ppid=9269 vsize=243192 CPUtime=1002.31 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 268228 1257 0 0 100188 43 0 0 25 0 5 0 520021540 249028608 32035 33554432000 4194304 4417332 140734693698896 18446744073709551615 4342489 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=243192 CPUtime=1002.22 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 276277 1257 0 0 100176 46 0 0 25 0 5 0 520021540 249028608 32035 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=243192 CPUtime=1002.29 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 282158 1257 0 0 100186 43 0 0 25 0 5 0 520021540 249028608 32035 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=243192 CPUtime=996.85 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 280779 1257 0 0 99641 44 0 0 25 0 5 0 520021540 249028608 32035 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364938 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4003.7
Current children cumulated vsize (KiB) 243192

[startup+1062.31 s]
/proc/loadavg: 8.16 8.08 7.61 9/190 9309
/proc/meminfo: memFree=24710292/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=253028 CPUtime=4243.4 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 1143444 1257 0 0 424157 183 0 0 23 0 5 0 520021539 259100672 34703 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 63257 34703 181 55 0 61143 0
[pid=9271/tid=9277] ppid=9269 vsize=253028 CPUtime=1062.33 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 277061 1257 0 0 106188 45 0 0 25 0 5 0 520021540 259100672 34703 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=253028 CPUtime=1062.22 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 283369 1257 0 0 106175 47 0 0 25 0 5 0 520021540 259100672 34703 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=253028 CPUtime=1062.29 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 289789 1257 0 0 106185 44 0 0 25 0 5 0 520021540 259100672 34703 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=253028 CPUtime=1056.53 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 292928 1257 0 0 105607 46 0 0 25 0 5 0 520021540 259100672 34703 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4243.4
Current children cumulated vsize (KiB) 253028

[startup+1122.3 s]
/proc/loadavg: 8.23 8.12 7.65 10/190 9311
/proc/meminfo: memFree=24699832/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=278504 CPUtime=4483.05 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 1186912 1257 0 0 448115 190 0 0 23 0 5 0 520021539 285188096 41104 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 69626 41104 181 55 0 67512 0
[pid=9271/tid=9277] ppid=9269 vsize=278504 CPUtime=1122.32 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 283855 1257 0 0 112186 46 0 0 25 0 5 0 520021540 285188096 41104 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=278504 CPUtime=1122.21 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 291179 1257 0 0 112173 48 0 0 25 0 5 0 520021540 285188096 41104 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=278504 CPUtime=1122.28 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 297373 1257 0 0 112183 45 0 0 25 0 5 0 520021540 285188096 41104 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=278504 CPUtime=1116.2 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 314208 1257 0 0 111571 49 0 0 25 0 5 0 520021540 285188096 41104 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4483.05
Current children cumulated vsize (KiB) 278504

[startup+1182.3 s]
/proc/loadavg: 8.20 8.14 7.69 10/190 9312
/proc/meminfo: memFree=24696064/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=255732 CPUtime=4722.72 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 1223532 1257 0 0 472077 195 0 0 23 0 5 0 520021539 261869568 35411 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 63933 35411 181 55 0 61819 0
[pid=9271/tid=9277] ppid=9269 vsize=255732 CPUtime=1182.32 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 294165 1257 0 0 118185 47 0 0 25 0 5 0 520021540 261869568 35411 33554432000 4194304 4417332 140734693698896 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=255732 CPUtime=1182.2 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 297495 1257 0 0 118171 49 0 0 25 0 5 0 520021540 261869568 35411 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=255732 CPUtime=1182.29 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 307815 1257 0 0 118182 47 0 0 25 0 5 0 520021540 261869568 35411 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=255732 CPUtime=1175.87 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 323760 1257 0 0 117537 50 0 0 25 0 5 0 520021540 261869568 35411 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4722.72
Current children cumulated vsize (KiB) 255732



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.14 8.13 7.69 5/185 9314
/proc/meminfo: memFree=24896608/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=249596 CPUtime=4800.23 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 1243565 1257 0 0 479825 198 0 0 23 0 5 0 520021539 255586304 33845 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 62399 33845 181 55 0 60285 0
[pid=9271/tid=9277] ppid=9269 vsize=249596 CPUtime=1201.73 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 298475 1257 0 0 120125 48 0 0 25 0 5 0 520021540 255586304 33845 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=249596 CPUtime=1201.61 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 303852 1257 0 0 120111 50 0 0 25 0 5 0 520021540 255586304 33845 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=249596 CPUtime=1201.69 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 309856 1257 0 0 120122 47 0 0 25 0 5 0 520021540 255586304 33845 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=249596 CPUtime=1195.17 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 331085 1257 0 0 119465 52 0 0 25 0 5 0 520021540 255586304 33845 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 249596

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.14 8.13 7.69 5/185 9314
/proc/meminfo: memFree=24896608/32951124 swapFree=67111352/67111528
[pid=9271] ppid=9269 vsize=249596 CPUtime=4800.23 cores=1,3,5,7
/proc/9271/stat : 9271 (plingeling) S 9269 9271 8802 0 -1 4202496 1243565 1257 0 0 479825 198 0 0 23 0 5 0 520021539 255586304 33845 33554432000 4194304 4417332 140734693698896 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/9271/statm: 62399 33845 181 55 0 60285 0
[pid=9271/tid=9277] ppid=9269 vsize=249596 CPUtime=1201.73 cores=1,3,5,7
/proc/9271/task/9277/stat : 9277 (plingeling) R 9269 9271 8802 0 -1 4202560 298475 1257 0 0 120125 48 0 0 25 0 5 0 520021540 255586304 33845 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9271/tid=9278] ppid=9269 vsize=249596 CPUtime=1201.61 cores=1,3,5,7
/proc/9271/task/9278/stat : 9278 (plingeling) R 9269 9271 8802 0 -1 4202560 303852 1257 0 0 120111 50 0 0 25 0 5 0 520021540 255586304 33845 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9271/tid=9279] ppid=9269 vsize=249596 CPUtime=1201.69 cores=1,3,5,7
/proc/9271/task/9279/stat : 9279 (plingeling) R 9269 9271 8802 0 -1 4202560 309856 1257 0 0 120122 47 0 0 25 0 5 0 520021540 255586304 33845 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9271/tid=9280] ppid=9269 vsize=249596 CPUtime=1195.17 cores=1,3,5,7
/proc/9271/task/9280/stat : 9280 (plingeling) R 9269 9271 8802 0 -1 4202560 331085 1257 0 0 119465 52 0 0 25 0 5 0 520021540 255586304 33845 33554432000 4194304 4417332 140734693698896 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 249596

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.72
CPU time (s): 4800.27
CPU user time (s): 4798.28
CPU system time (s): 1.9947
CPU usage (%): 399.451
Max. virtual memory (cumulated for all children) (KiB): 278600

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.28
system time used= 1.9947
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1244822
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 83
involuntary context switches= 39112

runsolver used 1.88671 second user time and 4.67129 second system time

The end

Launcher Data 

Begin job on node134 at 2011-04-29 15:37:13
IDJOB=3273768
IDBENCH=83146
IDSOLVER=1605
FILE ID=node134/3273768-1304084233
RUNJOBID= node134-1304084233-9243
PBS_JOBID= 13170534
Free space on /tmp= 71584 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n220-s24359701-sat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3273768-1304084233/watcher-3273768-1304084233 -o /tmp/evaluation-result-3273768-1304084233/solver-3273768-1304084233 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3273768-1304084233.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ceff918324677440f95867755c4e7133
RANDOM SEED=557772753

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25032752 kB
Buffers:       1487488 kB
Cached:        5844024 kB
SwapCached:         64 kB
Active:        1451488 kB
Inactive:      5946544 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25032752 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:             424 kB
Writeback:           0 kB
AnonPages:       66620 kB
Mapped:          15428 kB
Slab:           459016 kB
PageTables:       4848 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   249504 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71584 MiB
End job on node134 at 2011-04-29 15:57:17