Trace number 3371070

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.37 1203.16

General information on the benchmark

NameCRAFTED/sgi/
new-difficult-23-189-21-75.cnf
MD5SUM46a186d5aa9ba41a176adf24fb365342
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.203968
Satisfiable
(Un)Satisfiability was proved
Number of variables483
Number of clauses25396
Sum of the clauses size51233
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 225375
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 521

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371070-1305420714/watcher-3371070-1305420714 -o /tmp/evaluation-result-3371070-1305420714/solver-3371070-1305420714 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371070-1305420714.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.13 8.09 7.68 5/321 9551
/proc/meminfo: memFree=10840540/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=9452 CPUtime=0 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) R 9549 9551 8860 0 -1 4202496 454 1250 0 0 0 0 0 0 25 0 1 0 653673746 9678848 385 33554432000 4194304 4417452 140736719911968 18446744073709551615 212436016896 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/9551/statm: 2363 385 147 55 0 249 0

[startup+0.121472 s]
/proc/loadavg: 8.13 8.09 7.68 5/321 9551
/proc/meminfo: memFree=10840540/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=120868 CPUtime=0.42 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 2562 1250 0 0 42 0 0 0 25 0 5 0 653673746 123768832 1637 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 30217 1637 180 55 0 28103 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 120868

[startup+0.200456 s]
/proc/loadavg: 8.13 8.09 7.68 5/321 9551
/proc/meminfo: memFree=10840540/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=120984 CPUtime=0.73 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 2907 1250 0 0 73 0 0 0 25 0 5 0 653673746 123887616 1684 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 30246 1684 180 55 0 28132 0
Current children cumulated CPU time (s) 0.73
Current children cumulated vsize (KiB) 120984

[startup+0.300438 s]
/proc/loadavg: 8.13 8.09 7.68 5/321 9551
/proc/meminfo: memFree=10840540/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=123704 CPUtime=1.13 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 3569 1250 0 0 113 0 0 0 25 0 5 0 653673746 126672896 2346 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 30926 2346 180 55 0 28812 0
Current children cumulated CPU time (s) 1.13
Current children cumulated vsize (KiB) 123704

[startup+0.700363 s]
/proc/loadavg: 8.13 8.09 7.68 5/321 9551
/proc/meminfo: memFree=10840540/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=128244 CPUtime=2.73 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 5667 1250 0 0 273 0 0 0 25 0 5 0 653673746 131321856 3500 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 32061 3500 180 55 0 29947 0
Current children cumulated CPU time (s) 2.73
Current children cumulated vsize (KiB) 128244

[startup+1.50021 s]
/proc/loadavg: 8.13 8.09 7.68 9/326 9561
/proc/meminfo: memFree=10839756/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=132528 CPUtime=5.91 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 10341 1250 0 0 591 0 0 0 25 0 5 0 653673746 135708672 4560 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 33132 4560 180 55 0 31018 0
[pid=9551/tid=9558] ppid=9549 vsize=132528 CPUtime=1.48 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 587 1250 0 0 148 0 0 0 25 0 5 0 653673747 135708672 4560 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=132528 CPUtime=1.47 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 502 1250 0 0 147 0 0 0 25 0 5 0 653673747 135708672 4560 33554432000 4194304 4417452 140736719911968 18446744073709551615 4354025 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=132528 CPUtime=1.47 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 2283 1250 0 0 147 0 0 0 25 0 5 0 653673747 135708672 4560 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=132528 CPUtime=1.46 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 6052 1250 0 0 146 0 0 0 25 0 5 0 653673747 135708672 4560 33554432000 4194304 4417452 140736719911968 18446744073709551615 4357241 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.91
Current children cumulated vsize (KiB) 132528

[startup+3.10091 s]
/proc/loadavg: 8.13 8.09 7.68 9/326 9561
/proc/meminfo: memFree=10831944/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=146908 CPUtime=12.31 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 23396 1250 0 0 1229 2 0 0 25 0 5 0 653673746 150433792 8155 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 36727 8155 180 55 0 34613 0
[pid=9551/tid=9558] ppid=9549 vsize=146908 CPUtime=3.07 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 3345 1250 0 0 307 0 0 0 25 0 5 0 653673747 150433792 8155 33554432000 4194304 4417452 140736719911968 18446744073709551615 4306307 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=146908 CPUtime=3.07 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 3228 1250 0 0 307 0 0 0 25 0 5 0 653673747 150433792 8155 33554432000 4194304 4417452 140736719911968 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=146908 CPUtime=3.07 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 5275 1250 0 0 307 0 0 0 25 0 5 0 653673747 150433792 8155 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=146908 CPUtime=3.05 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 10631 1250 0 0 304 1 0 0 25 0 5 0 653673747 150433792 8155 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.31
Current children cumulated vsize (KiB) 146908

[startup+6.3003 s]
/proc/loadavg: 8.12 8.09 7.69 9/326 9561
/proc/meminfo: memFree=10801984/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=173496 CPUtime=25.07 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 46243 1250 0 0 2501 6 0 0 25 0 5 0 653673746 177659904 14802 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 43374 14802 180 55 0 41260 0
[pid=9551/tid=9558] ppid=9549 vsize=173496 CPUtime=6.27 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 8772 1250 0 0 626 1 0 0 25 0 5 0 653673747 177659904 14802 33554432000 4194304 4417452 140736719911968 18446744073709551615 4250569 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=173496 CPUtime=6.27 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 9974 1250 0 0 626 1 0 0 25 0 5 0 653673747 177659904 14802 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=173496 CPUtime=6.26 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 10290 1250 0 0 626 0 0 0 25 0 5 0 653673747 177659904 14802 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=173496 CPUtime=6.22 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 16290 1250 0 0 620 2 0 0 25 0 5 0 653673747 177659904 14802 33554432000 4194304 4417452 140736719911968 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.07
Current children cumulated vsize (KiB) 173496

[startup+12.7011 s]
/proc/loadavg: 8.11 8.09 7.69 9/326 9561
/proc/meminfo: memFree=10759124/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=191900 CPUtime=50.61 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 79745 1250 0 0 5049 12 0 0 25 0 5 0 653673746 196505600 19403 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 47975 19403 180 55 0 45861 0
[pid=9551/tid=9558] ppid=9549 vsize=191900 CPUtime=12.67 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 15393 1250 0 0 1265 2 0 0 25 0 5 0 653673747 196505600 19403 33554432000 4194304 4417452 140736719911968 18446744073709551615 4356878 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=191900 CPUtime=12.67 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 16736 1250 0 0 1265 2 0 0 25 0 5 0 653673747 196505600 19403 33554432000 4194304 4417452 140736719911968 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=191900 CPUtime=12.67 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 17707 1250 0 0 1265 2 0 0 25 0 5 0 653673747 196505600 19403 33554432000 4194304 4417452 140736719911968 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=191900 CPUtime=12.55 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 28992 1250 0 0 1251 4 0 0 25 0 5 0 653673747 196505600 19403 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.61
Current children cumulated vsize (KiB) 191900

[startup+25.5007 s]
/proc/loadavg: 8.16 8.10 7.70 6/322 9666
/proc/meminfo: memFree=10931896/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=237088 CPUtime=101.68 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 130480 1250 0 0 10147 21 0 0 25 0 5 0 653673746 242778112 30700 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 59272 30700 180 55 0 57158 0
[pid=9551/tid=9558] ppid=9549 vsize=237088 CPUtime=25.48 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 27515 1250 0 0 2543 5 0 0 25 0 5 0 653673747 242778112 30700 33554432000 4194304 4417452 140736719911968 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=237088 CPUtime=25.47 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 29829 1250 0 0 2543 4 0 0 25 0 5 0 653673747 242778112 30700 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=237088 CPUtime=25.47 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 29969 1250 0 0 2543 4 0 0 25 0 5 0 653673747 242778112 30700 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364583 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=237088 CPUtime=25.22 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 42250 1250 0 0 2516 6 0 0 25 0 5 0 653673747 242778112 30700 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.68
Current children cumulated vsize (KiB) 237088

[startup+51.1008 s]
/proc/loadavg: 7.71 8.00 7.67 9/326 9742
/proc/meminfo: memFree=10556904/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=282164 CPUtime=203.82 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 208696 1250 0 0 20349 33 0 0 25 0 5 0 653673746 288935936 41969 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 70541 41969 180 55 0 68427 0
[pid=9551/tid=9558] ppid=9549 vsize=282164 CPUtime=51.07 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 42661 1250 0 0 5100 7 0 0 25 0 5 0 653673747 288935936 41969 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=282164 CPUtime=51.06 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 56026 1250 0 0 5098 8 0 0 25 0 5 0 653673747 288935936 41969 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=282164 CPUtime=51.07 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 45457 1250 0 0 5100 7 0 0 25 0 5 0 653673747 288935936 41969 33554432000 4194304 4417452 140736719911968 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=282164 CPUtime=50.57 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 63635 1250 0 0 5048 9 0 0 25 0 5 0 653673747 288935936 41969 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.82
Current children cumulated vsize (KiB) 282164

[startup+102.301 s]
/proc/loadavg: 7.95 8.01 7.69 9/326 9744
/proc/meminfo: memFree=10305684/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=429660 CPUtime=408.13 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 344131 1250 0 0 40757 56 0 0 25 0 5 0 653673746 439971840 78843 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 107415 78843 180 55 0 105301 0
[pid=9551/tid=9558] ppid=9549 vsize=429660 CPUtime=102.29 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 84510 1250 0 0 10215 14 0 0 25 0 5 0 653673747 439971840 78843 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=429660 CPUtime=102.27 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 93058 1250 0 0 10212 15 0 0 25 0 5 0 653673747 439971840 78843 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=429660 CPUtime=102.28 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 63863 1250 0 0 10218 10 0 0 25 0 5 0 653673747 439971840 78843 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=429660 CPUtime=101.26 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 101783 1250 0 0 10111 15 0 0 25 0 5 0 653673747 439971840 78843 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 408.13
Current children cumulated vsize (KiB) 429660

[startup+162.301 s]
/proc/loadavg: 8.03 8.02 7.71 9/326 9745
/proc/meminfo: memFree=10271420/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=475412 CPUtime=647.5 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 463271 1250 0 0 64675 75 0 0 25 0 5 0 653673746 486821888 90281 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 118853 90281 180 55 0 116739 0
[pid=9551/tid=9558] ppid=9549 vsize=475412 CPUtime=162.27 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 128857 1250 0 0 16208 19 0 0 25 0 5 0 653673747 486821888 90281 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=475412 CPUtime=162.25 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 110896 1250 0 0 16207 18 0 0 25 0 5 0 653673747 486821888 90281 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=475412 CPUtime=162.27 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 100302 1250 0 0 16210 17 0 0 25 0 5 0 653673747 486821888 90281 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=475412 CPUtime=160.66 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 122299 1250 0 0 16046 20 0 0 25 0 5 0 653673747 486821888 90281 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 647.5
Current children cumulated vsize (KiB) 475412


################
# More data... #
################

[pid=9551/tid=9559] ppid=9549 vsize=926772 CPUtime=702.18 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 419896 1250 0 0 70155 63 0 0 25 0 5 0 653673747 949014528 203130 33554432000 4194304 4417452 140736719911968 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=926772 CPUtime=702.29 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 370291 1250 0 0 70173 56 0 0 25 0 5 0 653673747 949014528 203130 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=926772 CPUtime=695.28 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 312119 1250 0 0 69482 46 0 0 25 0 5 0 653673747 949014528 203130 33554432000 4194304 4417452 140736719911968 18446744073709551615 4366090 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2802.08
Current children cumulated vsize (KiB) 926772

[startup+762.301 s]
/proc/loadavg: 8.28 8.17 7.92 9/326 9773
/proc/meminfo: memFree=9826864/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=871520 CPUtime=3041.49 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 1797939 1250 0 0 303888 261 0 0 25 0 5 0 653673746 892436480 189317 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 217880 189317 180 55 0 215766 0
[pid=9551/tid=9558] ppid=9549 vsize=871520 CPUtime=762.3 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 532881 1250 0 0 76157 73 0 0 25 0 5 0 653673747 892436480 189317 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=871520 CPUtime=762.18 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 567352 1250 0 0 76136 82 0 0 25 0 5 0 653673747 892436480 189317 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=871520 CPUtime=762.31 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 373613 1250 0 0 76174 57 0 0 25 0 5 0 653673747 892436480 189317 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=871520 CPUtime=754.69 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 323176 1250 0 0 75421 48 0 0 25 0 5 0 653673747 892436480 189317 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3041.49
Current children cumulated vsize (KiB) 871520

[startup+822.3 s]
/proc/loadavg: 8.20 8.17 7.93 9/326 9775
/proc/meminfo: memFree=9679396/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=1024980 CPUtime=3280.87 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 2007714 1250 0 0 327798 289 0 0 25 0 5 0 653673746 1049579520 227682 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 256245 227682 180 55 0 254131 0
[pid=9551/tid=9558] ppid=9549 vsize=1024980 CPUtime=822.28 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 538525 1250 0 0 82154 74 0 0 25 0 5 0 653673747 1049579520 227682 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=1024980 CPUtime=822.16 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 738892 1250 0 0 82111 105 0 0 25 0 5 0 653673747 1049579520 227682 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=1024980 CPUtime=822.3 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 397436 1250 0 0 82171 59 0 0 25 0 5 0 653673747 1049579520 227682 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=1024980 CPUtime=814.08 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 331944 1250 0 0 81358 50 0 0 25 0 5 0 653673747 1049579520 227682 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3280.87
Current children cumulated vsize (KiB) 1024980

[startup+882.312 s]
/proc/loadavg: 8.12 8.15 7.94 9/326 9776
/proc/meminfo: memFree=9651932/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=1041828 CPUtime=3520.31 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 2089750 1250 0 0 351732 299 0 0 25 0 5 0 653673746 1066831872 231894 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 260457 231894 180 55 0 258343 0
[pid=9551/tid=9558] ppid=9549 vsize=1041828 CPUtime=882.29 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 546717 1250 0 0 88154 75 0 0 25 0 5 0 653673747 1066831872 231894 33554432000 4194304 4417452 140736719911968 18446744073709551615 4311366 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=1041828 CPUtime=882.17 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 738892 1250 0 0 88112 105 0 0 25 0 5 0 653673747 1066831872 231894 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=1041828 CPUtime=882.3 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 471280 1250 0 0 88163 67 0 0 25 0 5 0 653673747 1066831872 231894 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=1041828 CPUtime=873.49 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 331944 1250 0 0 87299 50 0 0 25 0 5 0 653673747 1066831872 231894 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3520.31
Current children cumulated vsize (KiB) 1041828

[startup+942.301 s]
/proc/loadavg: 8.13 8.15 7.95 9/326 9778
/proc/meminfo: memFree=9518732/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=1156176 CPUtime=3759.67 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 2222404 1250 0 0 375648 319 0 0 25 0 5 0 653673746 1183924224 260472 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 289044 260472 180 55 0 286930 0
[pid=9551/tid=9558] ppid=9549 vsize=1156176 CPUtime=942.28 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 662657 1250 0 0 94136 92 0 0 25 0 5 0 653673747 1183924224 260472 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=1156176 CPUtime=942.14 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 738892 1250 0 0 94109 105 0 0 25 0 5 0 653673747 1183924224 260472 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=1156176 CPUtime=942.3 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 475376 1250 0 0 94162 68 0 0 25 0 5 0 653673747 1183924224 260472 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=1156176 CPUtime=932.89 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 344562 1250 0 0 93237 52 0 0 25 0 5 0 653673747 1183924224 260472 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3759.67
Current children cumulated vsize (KiB) 1156176

[startup+1002.3 s]
/proc/loadavg: 8.12 8.14 7.95 9/326 9780
/proc/meminfo: memFree=9496744/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=1194436 CPUtime=3999.06 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 2363041 1250 0 0 399569 337 0 0 25 0 5 0 653673746 1223102464 270037 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 298609 270037 180 55 0 296495 0
[pid=9551/tid=9558] ppid=9549 vsize=1194436 CPUtime=1002.29 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 785537 1250 0 0 100121 108 0 0 25 0 5 0 653673747 1223102464 270037 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=1194436 CPUtime=1002.14 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 738892 1250 0 0 100109 105 0 0 25 0 5 0 653673747 1223102464 270037 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=1194436 CPUtime=1002.3 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 484941 1250 0 0 100161 69 0 0 25 0 5 0 653673747 1223102464 270037 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=1194436 CPUtime=992.29 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 352754 1250 0 0 99176 53 0 0 25 0 5 0 653673747 1223102464 270037 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3999.06
Current children cumulated vsize (KiB) 1194436

[startup+1062.3 s]
/proc/loadavg: 8.21 8.15 7.97 9/326 9781
/proc/meminfo: memFree=9396884/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=1232976 CPUtime=4238.47 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 2606148 1250 0 0 423476 371 0 0 25 0 5 0 653673746 1262567424 279672 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 308244 279672 180 55 0 306130 0
[pid=9551/tid=9558] ppid=9549 vsize=1232976 CPUtime=1062.3 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 994433 1250 0 0 106094 136 0 0 25 0 5 0 653673747 1262567424 279672 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=1232976 CPUtime=1062.13 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 738892 1250 0 0 106108 105 0 0 25 0 5 0 653673747 1262567424 279672 33554432000 4194304 4417452 140736719911968 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=1232976 CPUtime=1062.3 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 502768 1250 0 0 106157 73 0 0 25 0 5 0 653673747 1262567424 279672 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=1232976 CPUtime=1051.7 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 369138 1250 0 0 105114 56 0 0 25 0 5 0 653673747 1262567424 279672 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4238.47
Current children cumulated vsize (KiB) 1232976

[startup+1122.3 s]
/proc/loadavg: 8.07 8.12 7.97 9/326 9783
/proc/meminfo: memFree=9442228/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=1207244 CPUtime=4477.86 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 2716976 1250 0 0 447394 392 0 0 25 0 5 0 653673746 1236217856 273239 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 301811 273239 180 55 0 299697 0
[pid=9551/tid=9558] ppid=9549 vsize=1207244 CPUtime=1122.29 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 1044911 1250 0 0 112086 143 0 0 25 0 5 0 653673747 1236217856 273239 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=1207244 CPUtime=1122.12 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 738892 1250 0 0 112107 105 0 0 25 0 5 0 653673747 1236217856 273239 33554432000 4194304 4417452 140736719911968 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=1207244 CPUtime=1122.31 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 547802 1250 0 0 112147 84 0 0 25 0 5 0 653673747 1236217856 273239 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=1207244 CPUtime=1111.1 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 384454 1250 0 0 111051 59 0 0 25 0 5 0 653673747 1236217856 273239 33554432000 4194304 4417452 140736719911968 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4477.86
Current children cumulated vsize (KiB) 1207244

[startup+1182.3 s]
/proc/loadavg: 8.13 8.13 7.98 9/326 9784
/proc/meminfo: memFree=9408576/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=1240696 CPUtime=4717.27 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 2745819 1250 0 0 471331 396 0 0 25 0 5 0 653673746 1270472704 281602 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 310174 281602 180 55 0 308060 0
[pid=9551/tid=9558] ppid=9549 vsize=1240696 CPUtime=1182.3 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 1044911 1250 0 0 118087 143 0 0 25 0 5 0 653673747 1270472704 281602 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=1240696 CPUtime=1182.11 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 738892 1250 0 0 118106 105 0 0 25 0 5 0 653673747 1270472704 281602 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=1240696 CPUtime=1182.31 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 555994 1250 0 0 118146 85 0 0 25 0 5 0 653673747 1270472704 281602 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=1240696 CPUtime=1170.51 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 405105 1250 0 0 116989 62 0 0 25 0 5 0 653673747 1270472704 281602 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4717.27
Current children cumulated vsize (KiB) 1240696



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.1 s]
/proc/loadavg: 8.08 8.12 7.98 9/326 9785
/proc/meminfo: memFree=9503304/32951124 swapFree=67093864/67111528
[pid=9551] ppid=9549 vsize=1145336 CPUtime=4800.28 cores=1,3,5,7
/proc/9551/stat : 9551 (plingeling) S 9549 9551 8860 0 -1 4202496 2765667 1250 0 0 479629 399 0 0 25 0 5 0 653673746 1172824064 257762 33554432000 4194304 4417452 140736719911968 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/9551/statm: 286334 257762 180 55 0 284220 0
[pid=9551/tid=9558] ppid=9549 vsize=1145336 CPUtime=1203.11 cores=1,3,5,7
/proc/9551/task/9558/stat : 9558 (plingeling) R 9549 9551 8860 0 -1 4202560 1044911 1250 0 0 120168 143 0 0 25 0 5 0 653673747 1172824064 257762 33554432000 4194304 4417452 140736719911968 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=9551/tid=9559] ppid=9549 vsize=1145336 CPUtime=1202.92 cores=1,3,5,7
/proc/9551/task/9559/stat : 9559 (plingeling) R 9549 9551 8860 0 -1 4202560 756072 1250 0 0 120184 108 0 0 25 0 5 0 653673747 1172824064 257762 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364893 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=9551/tid=9560] ppid=9549 vsize=1145336 CPUtime=1203.12 cores=1,3,5,7
/proc/9551/task/9560/stat : 9560 (plingeling) R 9549 9551 8860 0 -1 4202560 555994 1250 0 0 120227 85 0 0 25 0 5 0 653673747 1172824064 257762 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=9551/tid=9561] ppid=9549 vsize=1145336 CPUtime=1191.1 cores=1,3,5,7
/proc/9551/task/9561/stat : 9561 (plingeling) R 9549 9551 8860 0 -1 4202560 407773 1250 0 0 119048 62 0 0 25 0 5 0 653673747 1172824064 257762 33554432000 4194304 4417452 140736719911968 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.28
Current children cumulated vsize (KiB) 1145336

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.16
CPU time (s): 4800.37
CPU user time (s): 4796.32
CPU system time (s): 4.04439
CPU usage (%): 398.979
Max. virtual memory (cumulated for all children) (KiB): 1327024

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.32
system time used= 4.04439
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2766917
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 94
involuntary context switches= 34204

runsolver used 3.2955 second user time and 8.74867 second system time

The end

Launcher Data 

Begin job on node102 at 2011-05-15 02:51:54
IDJOB=3371070
IDBENCH=71805
IDSOLVER=1848
FILE ID=node102/3371070-1305420714
RUNJOBID= node102-1305419434-9343
PBS_JOBID= 13324562
Free space on /tmp= 73524 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/sgi/new-difficult-23-189-21-75.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371070-1305420714/watcher-3371070-1305420714 -o /tmp/evaluation-result-3371070-1305420714/solver-3371070-1305420714 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371070-1305420714.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 46a186d5aa9ba41a176adf24fb365342
RANDOM SEED=1719338036

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      10840696 kB
Buffers:        265252 kB
Cached:        2846684 kB
SwapCached:       1128 kB
Active:       19795608 kB
Inactive:      2022484 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      10840696 kB
SwapTotal:    67111528 kB
SwapFree:     67093864 kB
Dirty:            5160 kB
Writeback:           0 kB
AnonPages:    18704876 kB
Mapped:          26924 kB
Slab:           176928 kB
PageTables:      53560 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 59382280 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73516 MiB
End job on node102 at 2011-05-15 03:11:59