Trace number 3291369

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.46 1201.82

General information on the benchmark

NameSAT03/industrial/goldberg/hard_eq_check/
x1mul.miter.shuffled-as.sat03-359.cnf
MD5SUM9edcffddbe07377cf6685697aafad673
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark16.6405
Satisfiable
(Un)Satisfiability was proved
Number of variables8756
Number of clauses55571
Sum of the clauses size187746
Maximum clause length70
Minimum clause length1
Number of clauses of size 128
Number of clauses of size 212786
Number of clauses of size 325852
Number of clauses of size 40
Number of clauses of size 516904
Number of clauses of size over 51

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3291369-1304101405/watcher-3291369-1304101405 -o /tmp/evaluation-result-3291369-1304101405/solver-3291369-1304101405 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3291369-1304101405.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.39 7.92 7.94 1/173 17163
/proc/meminfo: memFree=30924380/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=10428 CPUtime=0 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) R 17161 17163 16318 0 -1 4202496 703 1252 0 0 0 0 0 0 22 0 1 0 521739241 10678272 631 33554432000 4194304 4417332 140736629609008 18446744073709551615 251814240000 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/17163/statm: 2607 631 148 55 0 493 0

[startup+0.052454 s]
/proc/loadavg: 7.39 7.92 7.94 1/173 17163
/proc/meminfo: memFree=30924380/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=19096 CPUtime=0.04 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) R 17161 17163 16318 0 -1 4202496 2854 1252 0 0 4 0 0 0 22 0 1 0 521739241 19554304 2782 33554432000 4194304 4417332 140736629609008 18446744073709551615 4323245 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/17163/statm: 4774 2782 148 55 0 2660 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 19096

[startup+0.100449 s]
/proc/loadavg: 7.39 7.92 7.94 1/173 17163
/proc/meminfo: memFree=30924380/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=63128 CPUtime=0.1 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 4220 1252 0 0 10 0 0 0 22 0 5 0 521739241 64643072 3564 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 15782 3564 158 55 0 13668 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 63128

[startup+0.300415 s]
/proc/loadavg: 7.39 7.92 7.94 1/173 17163
/proc/meminfo: memFree=30924380/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=131252 CPUtime=0.9 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 5735 1252 0 0 90 0 0 0 22 0 5 0 521739241 134402048 4277 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 32813 4277 175 55 0 30699 0
Current children cumulated CPU time (s) 0.9
Current children cumulated vsize (KiB) 131252

[startup+0.700346 s]
/proc/loadavg: 7.39 7.92 7.94 1/173 17163
/proc/meminfo: memFree=30924380/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=139280 CPUtime=2.51 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 8646 1252 0 0 250 1 0 0 22 0 5 0 521739241 142622720 6257 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 34820 6257 180 55 0 32706 0
Current children cumulated CPU time (s) 2.51
Current children cumulated vsize (KiB) 139280

[startup+1.50021 s]
/proc/loadavg: 7.39 7.92 7.94 9/186 17187
/proc/meminfo: memFree=30878924/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=141440 CPUtime=5.7 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 9199 1252 0 0 569 1 0 0 22 0 5 0 521739241 144834560 6810 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 35360 6810 181 55 0 33246 0
[pid=17163/tid=17180] ppid=17161 vsize=141440 CPUtime=1.4 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 1268 1252 0 0 140 0 0 0 25 0 5 0 521739250 144834560 6810 33554432000 4194304 4417332 140736629609008 18446744073709551615 4253198 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=141440 CPUtime=1.39 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 1559 1252 0 0 139 0 0 0 25 0 5 0 521739250 144834560 6810 33554432000 4194304 4417332 140736629609008 18446744073709551615 4252404 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=141440 CPUtime=1.4 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 1369 1252 0 0 140 0 0 0 25 0 5 0 521739250 144834560 6810 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=141440 CPUtime=1.4 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 792 1252 0 0 140 0 0 0 25 0 5 0 521739250 144834560 6810 33554432000 4194304 4417332 140736629609008 18446744073709551615 4366398 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.7
Current children cumulated vsize (KiB) 141440

[startup+3.10094 s]
/proc/loadavg: 7.39 7.92 7.94 9/186 17187
/proc/meminfo: memFree=30874960/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=144528 CPUtime=12.1 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 9971 1252 0 0 1209 1 0 0 22 0 5 0 521739241 147996672 7582 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 36132 7582 181 55 0 34018 0
[pid=17163/tid=17180] ppid=17161 vsize=144528 CPUtime=3 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 1268 1252 0 0 300 0 0 0 25 0 5 0 521739250 147996672 7582 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=144528 CPUtime=2.99 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 1625 1252 0 0 299 0 0 0 25 0 5 0 521739250 147996672 7582 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=144528 CPUtime=3 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 1436 1252 0 0 300 0 0 0 25 0 5 0 521739250 147996672 7582 33554432000 4194304 4417332 140736629609008 18446744073709551615 4365894 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=144528 CPUtime=3 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 1431 1252 0 0 300 0 0 0 25 0 5 0 521739250 147996672 7582 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364475 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.1
Current children cumulated vsize (KiB) 144528

[startup+6.30041 s]
/proc/loadavg: 7.44 7.92 7.94 9/186 17187
/proc/meminfo: memFree=30857788/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=150544 CPUtime=24.88 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 11855 1252 0 0 2487 1 0 0 22 0 5 0 521739241 154157056 9086 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 37636 9086 181 55 0 35522 0
[pid=17163/tid=17180] ppid=17161 vsize=150544 CPUtime=6.2 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 1268 1252 0 0 620 0 0 0 25 0 5 0 521739250 154157056 9086 33554432000 4194304 4417332 140736629609008 18446744073709551615 4257634 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=150544 CPUtime=6.17 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 1905 1252 0 0 617 0 0 0 25 0 5 0 521739250 154157056 9086 33554432000 4194304 4417332 140736629609008 18446744073709551615 4309925 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=150544 CPUtime=6.2 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 2164 1252 0 0 620 0 0 0 25 0 5 0 521739250 154157056 9086 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=150544 CPUtime=6.2 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 2307 1252 0 0 620 0 0 0 25 0 5 0 521739250 154157056 9086 33554432000 4194304 4417332 140736629609008 18446744073709551615 4365846 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.88
Current children cumulated vsize (KiB) 150544

[startup+12.7003 s]
/proc/loadavg: 7.48 7.92 7.94 9/186 17187
/proc/meminfo: memFree=30840952/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=154796 CPUtime=50.44 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 15581 1252 0 0 5042 2 0 0 22 0 5 0 521739241 158511104 10149 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 38699 10149 181 55 0 36585 0
[pid=17163/tid=17180] ppid=17161 vsize=154796 CPUtime=12.6 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 1268 1252 0 0 1260 0 0 0 25 0 5 0 521739250 158511104 10149 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=154796 CPUtime=12.53 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 2299 1252 0 0 1253 0 0 0 25 0 5 0 521739250 158511104 10149 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364487 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=154796 CPUtime=12.6 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 3385 1252 0 0 1260 0 0 0 25 0 5 0 521739250 158511104 10149 33554432000 4194304 4417332 140736629609008 18446744073709551615 4282876 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=154796 CPUtime=12.6 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 4418 1252 0 0 1259 1 0 0 25 0 5 0 521739250 158511104 10149 33554432000 4194304 4417332 140736629609008 18446744073709551615 4237169 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.44
Current children cumulated vsize (KiB) 154796

[startup+25.5012 s]
/proc/loadavg: 7.73 7.96 7.95 9/186 17188
/proc/meminfo: memFree=30829528/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=164408 CPUtime=101.57 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 32202 1252 0 0 10152 5 0 0 22 0 5 0 521739241 168353792 12562 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 41102 12562 181 55 0 38988 0
[pid=17163/tid=17180] ppid=17161 vsize=164408 CPUtime=25.4 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 4202 1252 0 0 2540 0 0 0 25 0 5 0 521739250 168353792 12562 33554432000 4194304 4417332 140736629609008 18446744073709551615 4356720 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=164408 CPUtime=25.26 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 4859 1252 0 0 2526 0 0 0 25 0 5 0 521739250 168353792 12562 33554432000 4194304 4417332 140736629609008 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=164408 CPUtime=25.39 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 6808 1252 0 0 2539 0 0 0 25 0 5 0 521739250 168353792 12562 33554432000 4194304 4417332 140736629609008 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=164408 CPUtime=25.39 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 12122 1252 0 0 2537 2 0 0 25 0 5 0 521739250 168353792 12562 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.57
Current children cumulated vsize (KiB) 164408

[startup+51.1009 s]
/proc/loadavg: 7.82 7.96 7.95 9/186 17188
/proc/meminfo: memFree=30771436/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=198288 CPUtime=203.84 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 76672 1252 0 0 20372 12 0 0 22 0 5 0 521739241 203046912 21047 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 49572 21047 181 55 0 47458 0
[pid=17163/tid=17180] ppid=17161 vsize=198288 CPUtime=51 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 15638 1252 0 0 5098 2 0 0 25 0 5 0 521739250 203046912 21047 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=198288 CPUtime=50.72 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 15128 1252 0 0 5070 2 0 0 25 0 5 0 521739250 203046912 21047 33554432000 4194304 4417332 140736629609008 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=198288 CPUtime=51 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 16644 1252 0 0 5098 2 0 0 25 0 5 0 521739250 203046912 21047 33554432000 4194304 4417332 140736629609008 18446744073709551615 4330435 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=198288 CPUtime=51 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 25051 1252 0 0 5096 4 0 0 25 0 5 0 521739250 203046912 21047 33554432000 4194304 4417332 140736629609008 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.84
Current children cumulated vsize (KiB) 198288

[startup+102.306 s]
/proc/loadavg: 8.02 7.99 7.96 9/186 17190
/proc/meminfo: memFree=30684620/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=214312 CPUtime=408.37 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 158817 1252 0 0 40813 24 0 0 22 0 5 0 521739241 219455488 25053 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 53578 25053 181 55 0 51464 0
[pid=17163/tid=17180] ppid=17161 vsize=214312 CPUtime=102.2 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 35725 1252 0 0 10216 4 0 0 25 0 5 0 521739250 219455488 25053 33554432000 4194304 4417332 140736629609008 18446744073709551615 4250651 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=214312 CPUtime=101.64 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 32477 1252 0 0 10159 5 0 0 25 0 5 0 521739250 219455488 25053 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=214312 CPUtime=102.2 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 38365 1252 0 0 10215 5 0 0 25 0 5 0 521739250 219455488 25053 33554432000 4194304 4417332 140736629609008 18446744073709551615 4344083 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=214312 CPUtime=102.2 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 48039 1252 0 0 10213 7 0 0 25 0 5 0 521739250 219455488 25053 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.37
Current children cumulated vsize (KiB) 214312

[startup+162.301 s]
/proc/loadavg: 8.09 8.02 7.97 9/186 17191
/proc/meminfo: memFree=30690560/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=226772 CPUtime=648.03 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 263716 1252 0 0 64760 43 0 0 22 0 5 0 521739241 232214528 28181 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 56693 28181 181 55 0 54579 0
[pid=17163/tid=17180] ppid=17161 vsize=226772 CPUtime=162.2 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 63366 1252 0 0 16210 10 0 0 25 0 5 0 521739250 232214528 28181 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=226772 CPUtime=161.32 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 57843 1252 0 0 16122 10 0 0 25 0 5 0 521739250 232214528 28181 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=226772 CPUtime=162.19 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 61867 1252 0 0 16210 9 0 0 25 0 5 0 521739250 232214528 28181 33554432000 4194304 4417332 140736629609008 18446744073709551615 4365869 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=226772 CPUtime=162.2 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 76429 1252 0 0 16208 12 0 0 25 0 5 0 521739250 232214528 28181 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 648.03
Current children cumulated vsize (KiB) 226772


################
# More data... #
################

[pid=17163/tid=17181] ppid=17161 vsize=303468 CPUtime=698.38 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 252506 1252 0 0 69796 42 0 0 25 0 5 0 521739250 310751232 47323 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=303468 CPUtime=702.18 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 266841 1252 0 0 70173 45 0 0 25 0 5 0 521739250 310751232 47323 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=303468 CPUtime=702.21 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 261310 1252 0 0 70178 43 0 0 25 0 5 0 521739250 310751232 47323 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2805.1
Current children cumulated vsize (KiB) 303468

[startup+762.307 s]
/proc/loadavg: 8.14 8.05 8.00 9/186 17207
/proc/meminfo: memFree=30044332/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=316912 CPUtime=3044.79 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 1104809 1252 0 0 304295 184 0 0 22 0 5 0 521739241 324517888 50684 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 79228 50684 181 55 0 77114 0
[pid=17163/tid=17180] ppid=17161 vsize=316912 CPUtime=762.21 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 276867 1252 0 0 76176 45 0 0 25 0 5 0 521739250 324517888 50684 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364639 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=316912 CPUtime=758.05 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 267136 1252 0 0 75761 44 0 0 25 0 5 0 521739250 324517888 50684 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=316912 CPUtime=762.19 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 283180 1252 0 0 76172 47 0 0 25 0 5 0 521739250 324517888 50684 33554432000 4194304 4417332 140736629609008 18446744073709551615 4354227 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=316912 CPUtime=762.22 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 273415 1252 0 0 76177 45 0 0 25 0 5 0 521739250 324517888 50684 33554432000 4194304 4417332 140736629609008 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3044.79
Current children cumulated vsize (KiB) 316912

[startup+822.3 s]
/proc/loadavg: 8.16 8.07 8.00 9/186 17208
/proc/meminfo: memFree=30035388/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=307616 CPUtime=3284.45 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 1166449 1252 0 0 328251 194 0 0 22 0 5 0 521739241 314998784 48360 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 76904 48360 181 55 0 74790 0
[pid=17163/tid=17180] ppid=17161 vsize=307616 CPUtime=822.21 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 292247 1252 0 0 82173 48 0 0 25 0 5 0 521739250 314998784 48360 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=307616 CPUtime=817.72 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 285340 1252 0 0 81725 47 0 0 25 0 5 0 521739250 314998784 48360 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364977 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=307616 CPUtime=822.18 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 298170 1252 0 0 82168 50 0 0 25 0 5 0 521739250 314998784 48360 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=307616 CPUtime=822.21 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 286481 1252 0 0 82174 47 0 0 25 0 5 0 521739250 314998784 48360 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3284.45
Current children cumulated vsize (KiB) 307616

[startup+882.3 s]
/proc/loadavg: 8.06 8.05 8.00 9/186 17210
/proc/meminfo: memFree=29866604/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=318436 CPUtime=3524.12 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 1222183 1252 0 0 352210 202 0 0 22 0 5 0 521739241 326078464 51096 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 79609 51096 181 55 0 77495 0
[pid=17163/tid=17180] ppid=17161 vsize=318436 CPUtime=882.21 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 307420 1252 0 0 88171 50 0 0 25 0 5 0 521739250 326078464 51096 33554432000 4194304 4417332 140736629609008 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=318436 CPUtime=877.4 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 299472 1252 0 0 87691 49 0 0 25 0 5 0 521739250 326078464 51096 33554432000 4194304 4417332 140736629609008 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=318436 CPUtime=882.18 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 311121 1252 0 0 88166 52 0 0 25 0 5 0 521739250 326078464 51096 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=318436 CPUtime=882.21 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 299959 1252 0 0 88173 48 0 0 25 0 5 0 521739250 326078464 51096 33554432000 4194304 4417332 140736629609008 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3524.12
Current children cumulated vsize (KiB) 318436

[startup+942.3 s]
/proc/loadavg: 8.07 8.06 8.00 9/186 17212
/proc/meminfo: memFree=29840424/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=312528 CPUtime=3763.8 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 1286290 1252 0 0 376167 213 0 0 22 0 5 0 521739241 320028672 49619 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 78132 49619 181 55 0 76018 0
[pid=17163/tid=17180] ppid=17161 vsize=312528 CPUtime=942.21 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 319905 1252 0 0 94169 52 0 0 25 0 5 0 521739250 320028672 49619 33554432000 4194304 4417332 140736629609008 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=312528 CPUtime=937.08 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 321963 1252 0 0 93654 54 0 0 25 0 5 0 521739250 320028672 49619 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=312528 CPUtime=942.19 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 325645 1252 0 0 94164 55 0 0 25 0 5 0 521739250 320028672 49619 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=312528 CPUtime=942.21 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 314566 1252 0 0 94170 51 0 0 25 0 5 0 521739250 320028672 49619 33554432000 4194304 4417332 140736629609008 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3763.8
Current children cumulated vsize (KiB) 312528

[startup+1002.3 s]
/proc/loadavg: 8.07 8.06 8.00 9/186 17214
/proc/meminfo: memFree=29744296/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=331548 CPUtime=4003.47 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 1340467 1252 0 0 400126 221 0 0 22 0 5 0 521739241 339505152 54374 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 82887 54374 181 55 0 80773 0
[pid=17163/tid=17180] ppid=17161 vsize=331548 CPUtime=1002.22 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 331629 1252 0 0 100168 54 0 0 25 0 5 0 521739250 339505152 54374 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364599 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=331548 CPUtime=996.74 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 337705 1252 0 0 99618 56 0 0 25 0 5 0 521739250 339505152 54374 33554432000 4194304 4417332 140736629609008 18446744073709551615 4357476 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=331548 CPUtime=1002.18 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 337011 1252 0 0 100162 56 0 0 25 0 5 0 521739250 339505152 54374 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=331548 CPUtime=1002.21 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 329911 1252 0 0 100168 53 0 0 25 0 5 0 521739250 339505152 54374 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.47
Current children cumulated vsize (KiB) 331548

[startup+1062.3 s]
/proc/loadavg: 8.07 8.06 8.00 9/186 17215
/proc/meminfo: memFree=29702988/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=324408 CPUtime=4243.15 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 1401364 1252 0 0 424084 231 0 0 22 0 5 0 521739241 332193792 52589 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 81102 52589 181 55 0 78988 0
[pid=17163/tid=17180] ppid=17161 vsize=324408 CPUtime=1062.21 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 346190 1252 0 0 106165 56 0 0 25 0 5 0 521739250 332193792 52589 33554432000 4194304 4417332 140736629609008 18446744073709551615 4366038 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=324408 CPUtime=1056.42 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 354885 1252 0 0 105583 59 0 0 25 0 5 0 521739250 332193792 52589 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=324408 CPUtime=1062.18 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 350378 1252 0 0 106160 58 0 0 25 0 5 0 521739250 332193792 52589 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=324408 CPUtime=1062.21 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 345700 1252 0 0 106165 56 0 0 25 0 5 0 521739250 332193792 52589 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4243.15
Current children cumulated vsize (KiB) 324408

[startup+1122.3 s]
/proc/loadavg: 8.11 8.08 8.01 9/186 17217
/proc/meminfo: memFree=29621260/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=301848 CPUtime=4482.83 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 1450920 1252 0 0 448044 239 0 0 22 0 5 0 521739241 309092352 46949 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 75462 46949 181 55 0 73348 0
[pid=17163/tid=17180] ppid=17161 vsize=301848 CPUtime=1122.21 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 358853 1252 0 0 112163 58 0 0 25 0 5 0 521739250 309092352 46949 33554432000 4194304 4417332 140736629609008 18446744073709551615 4357164 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=301848 CPUtime=1116.09 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 372183 1252 0 0 111548 61 0 0 25 0 5 0 521739250 309092352 46949 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364990 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=301848 CPUtime=1122.18 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 360300 1252 0 0 112159 59 0 0 25 0 5 0 521739250 309092352 46949 33554432000 4194304 4417332 140736629609008 18446744073709551615 4250476 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=301848 CPUtime=1122.22 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 355373 1252 0 0 112164 58 0 0 25 0 5 0 521739250 309092352 46949 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4482.83
Current children cumulated vsize (KiB) 301848

[startup+1182.3 s]
/proc/loadavg: 8.11 8.09 8.01 9/186 17218
/proc/meminfo: memFree=29470828/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=344336 CPUtime=4722.5 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 1497522 1252 0 0 472005 245 0 0 22 0 5 0 521739241 352600064 57571 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 86084 57571 181 55 0 83970 0
[pid=17163/tid=17180] ppid=17161 vsize=344336 CPUtime=1182.21 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 367818 1252 0 0 118162 59 0 0 25 0 5 0 521739250 352600064 57571 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=344336 CPUtime=1175.78 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 388314 1252 0 0 117514 64 0 0 25 0 5 0 521739250 352600064 57571 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=344336 CPUtime=1182.18 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 371065 1252 0 0 118158 60 0 0 25 0 5 0 521739250 352600064 57571 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=344336 CPUtime=1182.21 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 366114 1252 0 0 118162 59 0 0 25 0 5 0 521739250 352600064 57571 33554432000 4194304 4417332 140736629609008 18446744073709551615 4236577 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4722.5
Current children cumulated vsize (KiB) 344336



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.22 8.11 8.02 9/186 17219
/proc/meminfo: memFree=29485704/32950928 swapFree=67111448/67111528
[pid=17163] ppid=17161 vsize=329364 CPUtime=4800.41 cores=1,3,5,7
/proc/17163/stat : 17163 (plingeling) S 17161 17163 16318 0 -1 4202496 1507917 1252 0 0 479795 246 0 0 22 0 5 0 521739241 337268736 53828 33554432000 4194304 4417332 140736629609008 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/17163/statm: 82341 53828 181 55 0 80227 0
[pid=17163/tid=17180] ppid=17161 vsize=329364 CPUtime=1201.72 cores=1,3,5,7
/proc/17163/task/17180/stat : 17180 (plingeling) R 17161 17163 16318 0 -1 4202560 369947 1252 0 0 120113 59 0 0 25 0 5 0 521739250 337268736 53828 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17163/tid=17181] ppid=17161 vsize=329364 CPUtime=1195.17 cores=1,3,5,7
/proc/17163/task/17181/stat : 17181 (plingeling) R 17161 17163 16318 0 -1 4202560 389606 1252 0 0 119453 64 0 0 25 0 5 0 521739250 337268736 53828 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17163/tid=17182] ppid=17161 vsize=329364 CPUtime=1201.68 cores=1,3,5,7
/proc/17163/task/17182/stat : 17182 (plingeling) R 17161 17163 16318 0 -1 4202560 371646 1252 0 0 120108 60 0 0 25 0 5 0 521739250 337268736 53828 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=17163/tid=17183] ppid=17161 vsize=329364 CPUtime=1201.73 cores=1,3,5,7
/proc/17163/task/17183/stat : 17183 (plingeling) R 17161 17163 16318 0 -1 4202560 372507 1252 0 0 120112 61 0 0 25 0 5 0 521739250 337268736 53828 33554432000 4194304 4417332 140736629609008 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 329364

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.82
CPU time (s): 4800.46
CPU user time (s): 4797.98
CPU system time (s): 2.48162
CPU usage (%): 399.431
Max. virtual memory (cumulated for all children) (KiB): 374416

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.98
system time used= 2.48162
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1509169
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 193
involuntary context switches= 35430

runsolver used 1.88771 second user time and 4.67229 second system time

The end

Launcher Data 

Begin job on node126 at 2011-04-29 20:23:25
IDJOB=3291369
IDBENCH=84211
IDSOLVER=1605
FILE ID=node126/3291369-1304101405
RUNJOBID= node126-1304101405-17149
PBS_JOBID= 13170590
Free space on /tmp= 71596 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT03/industrial/goldberg/hard_eq_check/x1mul.miter.shuffled-as.sat03-359.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3291369-1304101405/watcher-3291369-1304101405 -o /tmp/evaluation-result-3291369-1304101405/solver-3291369-1304101405 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3291369-1304101405.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9edcffddbe07377cf6685697aafad673
RANDOM SEED=1832630067

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30924660 kB
Buffers:        249508 kB
Cached:        1400760 kB
SwapCached:         76 kB
Active:         118956 kB
Inactive:      1595704 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30924660 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:            2352 kB
Writeback:           0 kB
AnonPages:       64248 kB
Mapped:          14408 kB
Slab:           247088 kB
PageTables:       4564 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   185052 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71596 MiB
End job on node126 at 2011-04-29 20:43:29