Trace number 3251384

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.61 1202.29

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m47-q841.5-n45-p15-s16393788.cnf
MD5SUM683c9f75b69575e6451b8563d12f176b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.85272
Satisfiable
(Un)Satisfiability was proved
Number of variables1981
Number of clauses333838
Sum of the clauses size669567
Maximum clause length47
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2333793
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3251384-1304118165/watcher-3251384-1304118165 -o /tmp/evaluation-result-3251384-1304118165/solver-3251384-1304118165 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3251384-1304118165.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.37 7.76 7.89 3/177 5338
/proc/meminfo: memFree=22828644/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=9472 CPUtime=0 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) R 5336 5338 5295 0 -1 4202496 428 1261 0 0 0 0 0 0 25 0 1 0 523416170 9699328 357 33554432000 4194304 4417332 140733207690208 18446744073709551615 274473967360 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/5338/statm: 2368 357 146 55 0 254 0

[startup+0.0269821 s]
/proc/loadavg: 6.37 7.76 7.89 3/177 5338
/proc/meminfo: memFree=22828644/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=11536 CPUtime=0.01 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) R 5336 5338 5295 0 -1 4202496 1025 1261 0 0 1 0 0 0 25 0 1 0 523416170 11812864 906 33554432000 4194304 4417332 140733207690208 18446744073709551615 274473586207 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/5338/statm: 2884 906 147 55 0 770 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 11536

[startup+0.101024 s]
/proc/loadavg: 6.37 7.76 7.89 3/177 5338
/proc/meminfo: memFree=22828644/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=25872 CPUtime=0.08 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) R 5336 5338 5295 0 -1 4202496 4609 1261 0 0 8 0 0 0 25 0 1 0 523416170 26492928 4490 33554432000 4194304 4417332 140733207690208 18446744073709551615 274473967360 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/5338/statm: 6468 4490 147 55 0 4354 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 25872

[startup+0.30094 s]
/proc/loadavg: 6.37 7.76 7.89 3/177 5338
/proc/meminfo: memFree=22828644/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=150072 CPUtime=0.54 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 9374 1261 0 0 53 1 0 0 25 0 5 0 523416170 153673728 8977 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 37518 8977 174 55 0 35404 0
Current children cumulated CPU time (s) 0.54
Current children cumulated vsize (KiB) 150072

[startup+0.700871 s]
/proc/loadavg: 6.37 7.76 7.89 3/177 5338
/proc/meminfo: memFree=22828644/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=169596 CPUtime=2.14 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 18350 1261 0 0 212 2 0 0 25 0 5 0 523416170 173666304 13554 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 42399 13554 179 55 0 40285 0
Current children cumulated CPU time (s) 2.14
Current children cumulated vsize (KiB) 169596

[startup+1.50073 s]
/proc/loadavg: 6.37 7.76 7.89 10/186 5352
/proc/meminfo: memFree=22725652/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=180712 CPUtime=5.33 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 23158 1261 0 0 530 3 0 0 25 0 5 0 523416170 185049088 16543 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 45178 16543 180 55 0 43064 0
[pid=5338/tid=5349] ppid=5336 vsize=180712 CPUtime=1.28 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 2067 1261 0 0 128 0 0 0 25 0 5 0 523416192 185049088 16543 33554432000 4194304 4417332 140733207690208 18446744073709551615 4250082 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=180712 CPUtime=1.27 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 2072 1261 0 0 127 0 0 0 25 0 5 0 523416192 185049088 16543 33554432000 4194304 4417332 140733207690208 18446744073709551615 4248923 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=180712 CPUtime=1.28 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 2030 1261 0 0 128 0 0 0 25 0 5 0 523416192 185049088 16543 33554432000 4194304 4417332 140733207690208 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=180712 CPUtime=1.27 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 8272 1261 0 0 126 1 0 0 25 0 5 0 523416192 185049088 16543 33554432000 4194304 4417332 140733207690208 18446744073709551615 4320926 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.33
Current children cumulated vsize (KiB) 180712

[startup+3.10045 s]
/proc/loadavg: 6.58 7.78 7.89 10/186 5352
/proc/meminfo: memFree=22702848/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=200564 CPUtime=11.72 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 31506 1261 0 0 1168 4 0 0 25 0 5 0 523416170 205377536 21537 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 50141 21537 181 55 0 48027 0
[pid=5338/tid=5349] ppid=5336 vsize=200564 CPUtime=2.88 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 2067 1261 0 0 288 0 0 0 25 0 5 0 523416192 205377536 21537 33554432000 4194304 4417332 140733207690208 18446744073709551615 4236224 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=200564 CPUtime=2.87 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 2072 1261 0 0 287 0 0 0 25 0 5 0 523416192 205377536 21537 33554432000 4194304 4417332 140733207690208 18446744073709551615 4249897 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=200564 CPUtime=2.88 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 2031 1261 0 0 288 0 0 0 25 0 5 0 523416192 205377536 21537 33554432000 4194304 4417332 140733207690208 18446744073709551615 4249976 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=200564 CPUtime=2.86 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 16619 1261 0 0 284 2 0 0 25 0 5 0 523416192 205377536 21537 33554432000 4194304 4417332 140733207690208 18446744073709551615 4366725 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.72
Current children cumulated vsize (KiB) 200564

[startup+6.30088 s]
/proc/loadavg: 6.58 7.78 7.89 9/186 5353
/proc/meminfo: memFree=22630440/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=221944 CPUtime=24.5 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 46010 1261 0 0 2444 6 0 0 25 0 5 0 523416170 227270656 26920 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 55486 26920 181 55 0 53372 0
[pid=5338/tid=5349] ppid=5336 vsize=221944 CPUtime=6.08 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 2067 1261 0 0 608 0 0 0 25 0 5 0 523416192 227270656 26920 33554432000 4194304 4417332 140733207690208 18446744073709551615 4249559 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=221944 CPUtime=6.08 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 2072 1261 0 0 608 0 0 0 25 0 5 0 523416192 227270656 26920 33554432000 4194304 4417332 140733207690208 18446744073709551615 4248838 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=221944 CPUtime=6.08 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 2671 1261 0 0 608 0 0 0 25 0 5 0 523416192 227270656 26920 33554432000 4194304 4417332 140733207690208 18446744073709551615 4274913 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=221944 CPUtime=6.04 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 30483 1261 0 0 600 4 0 0 25 0 5 0 523416192 227270656 26920 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.5
Current children cumulated vsize (KiB) 221944

[startup+12.7008 s]
/proc/loadavg: 6.80 7.79 7.89 10/186 5353
/proc/meminfo: memFree=22554444/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=246768 CPUtime=50.07 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 63544 1261 0 0 4998 9 0 0 25 0 5 0 523416170 252690432 33178 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 61692 33178 181 55 0 59578 0
[pid=5338/tid=5349] ppid=5336 vsize=246768 CPUtime=12.48 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 2067 1261 0 0 1248 0 0 0 25 0 5 0 523416192 252690432 33178 33554432000 4194304 4417332 140733207690208 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=246768 CPUtime=12.48 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 2191 1261 0 0 1248 0 0 0 25 0 5 0 523416192 252690432 33178 33554432000 4194304 4417332 140733207690208 18446744073709551615 4250074 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=246768 CPUtime=12.47 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 2723 1261 0 0 1247 0 0 0 25 0 5 0 523416192 252690432 33178 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=246768 CPUtime=12.4 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 47846 1261 0 0 1234 6 0 0 25 0 5 0 523416192 252690432 33178 33554432000 4194304 4417332 140733207690208 18446744073709551615 4356771 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.07
Current children cumulated vsize (KiB) 246768

[startup+25.5005 s]
/proc/loadavg: 6.98 7.79 7.89 9/186 5353
/proc/meminfo: memFree=22454008/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=332168 CPUtime=101.2 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 113097 1261 0 0 10104 16 0 0 25 0 5 0 523416170 340140032 54500 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 83042 54500 181 55 0 80928 0
[pid=5338/tid=5349] ppid=5336 vsize=332168 CPUtime=25.27 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 3011 1261 0 0 2527 0 0 0 25 0 5 0 523416192 340140032 54500 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=332168 CPUtime=25.27 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 3343 1261 0 0 2527 0 0 0 25 0 5 0 523416192 340140032 54500 33554432000 4194304 4417332 140733207690208 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=332168 CPUtime=25.27 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 14249 1261 0 0 2526 1 0 0 25 0 5 0 523416192 340140032 54500 33554432000 4194304 4417332 140733207690208 18446744073709551615 4232609 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=332168 CPUtime=25.14 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 83777 1261 0 0 2502 12 0 0 25 0 5 0 523416192 340140032 54500 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.2
Current children cumulated vsize (KiB) 332168

[startup+51.101 s]
/proc/loadavg: 7.47 7.84 7.91 10/186 5354
/proc/meminfo: memFree=22206080/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=472604 CPUtime=203.47 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 188960 1261 0 0 20319 28 0 0 25 0 5 0 523416170 483946496 91626 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 118151 91626 181 55 0 116037 0
[pid=5338/tid=5349] ppid=5336 vsize=472604 CPUtime=50.87 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 5463 1261 0 0 5087 0 0 0 25 0 5 0 523416192 483946496 91626 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=472604 CPUtime=50.87 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 5997 1261 0 0 5087 0 0 0 25 0 5 0 523416192 483946496 91626 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=472604 CPUtime=50.87 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 23127 1261 0 0 5084 3 0 0 25 0 5 0 523416192 483946496 91626 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=472604 CPUtime=50.6 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 145656 1261 0 0 5039 21 0 0 25 0 5 0 523416192 483946496 91626 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.47
Current children cumulated vsize (KiB) 472604

[startup+102.307 s]
/proc/loadavg: 8.05 7.93 7.93 9/186 5358
/proc/meminfo: memFree=21813328/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=657664 CPUtime=407.23 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 292198 1261 0 0 40679 44 0 0 25 0 5 0 523416170 673447936 136428 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 164416 136428 181 55 0 162302 0
[pid=5338/tid=5349] ppid=5336 vsize=657664 CPUtime=102.08 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 13049 1261 0 0 10207 1 0 0 25 0 5 0 523416192 673447936 136428 33554432000 4194304 4417332 140733207690208 18446744073709551615 4259889 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=657664 CPUtime=101.93 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 15423 1261 0 0 10192 1 0 0 25 0 5 0 523416192 673447936 136428 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364602 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=657664 CPUtime=102.07 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 37445 1261 0 0 10203 4 0 0 25 0 5 0 523416192 673447936 136428 33554432000 4194304 4417332 140733207690208 18446744073709551615 4309936 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=657664 CPUtime=100.9 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 217564 1261 0 0 10056 34 0 0 25 0 5 0 523416192 673447936 136428 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 407.23
Current children cumulated vsize (KiB) 657664

[startup+162.3 s]
/proc/loadavg: 8.09 7.96 7.94 10/186 5360
/proc/meminfo: memFree=21676092/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=771452 CPUtime=646.87 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 407672 1261 0 0 64628 59 0 0 25 0 5 0 523416170 789966848 164344 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 192863 164344 181 55 0 190749 0
[pid=5338/tid=5349] ppid=5336 vsize=771452 CPUtime=162.07 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 27824 1261 0 0 16204 3 0 0 25 0 5 0 523416192 789966848 164344 33554432000 4194304 4417332 140733207690208 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=771452 CPUtime=161.93 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 24878 1261 0 0 16191 2 0 0 25 0 5 0 523416192 789966848 164344 33554432000 4194304 4417332 140733207690208 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=771452 CPUtime=162.07 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 56817 1261 0 0 16201 6 0 0 25 0 5 0 523416192 789966848 164344 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=771452 CPUtime=160.56 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 289436 1261 0 0 16012 44 0 0 25 0 5 0 523416192 789966848 164344 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 646.87
Current children cumulated vsize (KiB) 771452


################
# More data... #
################

/proc/meminfo: memFree=19257096/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=2286492 CPUtime=3043.61 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 1692286 1261 0 0 304098 263 0 0 25 0 5 0 523416170 2341367808 543158 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 571623 543158 181 55 0 569509 0
[pid=5338/tid=5349] ppid=5336 vsize=2286492 CPUtime=762.09 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 221600 1261 0 0 76177 32 0 0 25 0 5 0 523416192 2341367808 543158 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=2286492 CPUtime=761.95 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 260655 1261 0 0 76160 35 0 0 25 0 5 0 523416192 2341367808 543158 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=2286492 CPUtime=762.07 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 386898 1261 0 0 76158 49 0 0 25 0 5 0 523416192 2341367808 543158 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=2286492 CPUtime=757.25 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 814416 1261 0 0 75581 144 0 0 25 0 5 0 523416192 2341367808 543158 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3043.61
Current children cumulated vsize (KiB) 2286492

[startup+822.3 s]
/proc/loadavg: 8.13 8.11 8.02 9/186 5377
/proc/meminfo: memFree=19224936/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=2116528 CPUtime=3283.25 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 1774286 1261 0 0 328049 276 0 0 25 0 5 0 523416170 2167324672 500667 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 529132 500667 181 55 0 527018 0
[pid=5338/tid=5349] ppid=5336 vsize=2116528 CPUtime=822.09 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 283255 1261 0 0 82167 42 0 0 25 0 5 0 523416192 2167324672 500667 33554432000 4194304 4417332 140733207690208 18446744073709551615 4263050 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=2116528 CPUtime=821.94 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 264063 1261 0 0 82158 36 0 0 25 0 5 0 523416192 2167324672 500667 33554432000 4194304 4417332 140733207690208 18446744073709551615 4309920 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=2116528 CPUtime=822.07 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 386898 1261 0 0 82158 49 0 0 25 0 5 0 523416192 2167324672 500667 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364919 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=2116528 CPUtime=816.92 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 831353 1261 0 0 81545 147 0 0 25 0 5 0 523416192 2167324672 500667 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3283.25
Current children cumulated vsize (KiB) 2116528

[startup+882.301 s]
/proc/loadavg: 8.08 8.10 8.02 10/186 5379
/proc/meminfo: memFree=19044596/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=2196656 CPUtime=3522.92 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 1832578 1261 0 0 352006 286 0 0 25 0 5 0 523416170 2249375744 520708 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 549164 520708 181 55 0 547050 0
[pid=5338/tid=5349] ppid=5336 vsize=2196656 CPUtime=882.09 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 319433 1261 0 0 88163 46 0 0 25 0 5 0 523416192 2249375744 520708 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=2196656 CPUtime=881.94 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 286177 1261 0 0 88153 41 0 0 25 0 5 0 523416192 2249375744 520708 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=2196656 CPUtime=882.07 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 386898 1261 0 0 88157 50 0 0 25 0 5 0 523416192 2249375744 520708 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=2196656 CPUtime=876.59 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 831353 1261 0 0 87512 147 0 0 25 0 5 0 523416192 2249375744 520708 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3522.92
Current children cumulated vsize (KiB) 2196656

[startup+942.301 s]
/proc/loadavg: 8.07 8.10 8.02 10/186 5380
/proc/meminfo: memFree=18571000/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=2393612 CPUtime=3762.6 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 1912011 1261 0 0 375962 298 0 0 25 0 5 0 523416170 2451058688 569953 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 598403 569953 181 55 0 596289 0
[pid=5338/tid=5349] ppid=5336 vsize=2393612 CPUtime=942.09 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 319433 1261 0 0 94163 46 0 0 25 0 5 0 523416192 2451058688 569953 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=2393612 CPUtime=941.94 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 325506 1261 0 0 94146 48 0 0 25 0 5 0 523416192 2451058688 569953 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=2393612 CPUtime=942.07 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 386898 1261 0 0 94157 50 0 0 25 0 5 0 523416192 2451058688 569953 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=2393612 CPUtime=936.26 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 871457 1261 0 0 93475 151 0 0 25 0 5 0 523416192 2451058688 569953 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3762.6
Current children cumulated vsize (KiB) 2393612

[startup+1002.3 s]
/proc/loadavg: 8.12 8.10 8.02 10/186 5382
/proc/meminfo: memFree=17816056/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=2851120 CPUtime=4002.27 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 2051944 1261 0 0 399911 316 0 0 25 0 5 0 523416170 2919546880 684330 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 712780 684330 181 55 0 710666 0
[pid=5338/tid=5349] ppid=5336 vsize=2851120 CPUtime=1002.09 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 363841 1261 0 0 100155 54 0 0 25 0 5 0 523416192 2919546880 684330 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=2851120 CPUtime=1001.94 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 339716 1261 0 0 100145 49 0 0 25 0 5 0 523416192 2919546880 684330 33554432000 4194304 4417332 140733207690208 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=2851120 CPUtime=1002.07 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 403282 1261 0 0 100156 51 0 0 25 0 5 0 523416192 2919546880 684330 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=2851120 CPUtime=995.92 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 936388 1261 0 0 99434 158 0 0 25 0 5 0 523416192 2919546880 684330 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4002.27
Current children cumulated vsize (KiB) 2851120

[startup+1062.3 s]
/proc/loadavg: 8.12 8.10 8.02 10/186 5384
/proc/meminfo: memFree=17518532/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=3160084 CPUtime=4241.95 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 2129185 1261 0 0 423867 328 0 0 25 0 5 0 523416170 3235926016 761571 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 790021 761571 181 55 0 787907 0
[pid=5338/tid=5349] ppid=5336 vsize=3160084 CPUtime=1062.1 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 372033 1261 0 0 106154 56 0 0 25 0 5 0 523416192 3235926016 761571 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=3160084 CPUtime=1061.94 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 375997 1261 0 0 106141 53 0 0 25 0 5 0 523416192 3235926016 761571 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=3160084 CPUtime=1062.07 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 403282 1261 0 0 106156 51 0 0 25 0 5 0 523416192 3235926016 761571 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=3160084 CPUtime=1055.6 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 969156 1261 0 0 105395 165 0 0 25 0 5 0 523416192 3235926016 761571 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4241.95
Current children cumulated vsize (KiB) 3160084

[startup+1122.3 s]
/proc/loadavg: 8.10 8.09 8.02 9/186 5385
/proc/meminfo: memFree=16956036/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=3598528 CPUtime=4481.61 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 2238796 1261 0 0 447815 346 0 0 25 0 5 0 523416170 3684892672 871182 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 899632 871182 181 55 0 897518 0
[pid=5338/tid=5349] ppid=5336 vsize=3598528 CPUtime=1122.1 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 372033 1261 0 0 112154 56 0 0 25 0 5 0 523416192 3684892672 871182 33554432000 4194304 4417332 140733207690208 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=3598528 CPUtime=1121.95 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 396163 1261 0 0 112138 57 0 0 25 0 5 0 523416192 3684892672 871182 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=3598528 CPUtime=1122.07 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 438976 1261 0 0 112151 56 0 0 25 0 5 0 523416192 3684892672 871182 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=3598528 CPUtime=1115.26 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 1022907 1261 0 0 111351 175 0 0 25 0 5 0 523416192 3684892672 871182 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4481.61
Current children cumulated vsize (KiB) 3598528

[startup+1182.3 s]
/proc/loadavg: 8.10 8.09 8.02 9/186 5387
/proc/meminfo: memFree=16445736/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=3951572 CPUtime=4721.29 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 2384870 1261 0 0 471761 368 0 0 25 0 5 0 523416170 4046409728 959445 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 987893 959445 181 55 0 985779 0
[pid=5338/tid=5349] ppid=5336 vsize=3951572 CPUtime=1182.09 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 388898 1261 0 0 118152 57 0 0 25 0 5 0 523416192 4046409728 959445 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=3951572 CPUtime=1181.95 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 492815 1261 0 0 118123 72 0 0 25 0 5 0 523416192 4046409728 959445 33554432000 4194304 4417332 140733207690208 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=3951572 CPUtime=1182.07 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 471533 1261 0 0 118147 60 0 0 25 0 5 0 523416192 4046409728 959445 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=3951572 CPUtime=1174.93 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 1022907 1261 0 0 117318 175 0 0 25 0 5 0 523416192 4046409728 959445 33554432000 4194304 4417332 140733207690208 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4721.29
Current children cumulated vsize (KiB) 3951572



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.1 s]
/proc/loadavg: 8.07 8.08 8.02 5/180 5388
/proc/meminfo: memFree=18883108/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=4054420 CPUtime=4800.39 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) S 5336 5338 5295 0 -1 4202496 2410582 1261 0 0 479666 373 0 0 25 0 5 0 523416170 4151726080 985157 33554432000 4194304 4417332 140733207690208 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 1013605 985157 181 55 0 1011491 0
[pid=5338/tid=5349] ppid=5336 vsize=4054420 CPUtime=1201.9 cores=0,2,4,6
/proc/5338/task/5349/stat : 5349 (plingeling) R 5336 5338 5295 0 -1 4202560 388898 1261 0 0 120133 57 0 0 25 0 5 0 523416192 4151726080 985157 33554432000 4194304 4417332 140733207690208 18446744073709551615 4262493 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5338/tid=5350] ppid=5336 vsize=4054420 CPUtime=1201.75 cores=0,2,4,6
/proc/5338/task/5350/stat : 5350 (plingeling) R 5336 5338 5295 0 -1 4202560 492815 1261 0 0 120103 72 0 0 25 0 5 0 523416192 4151726080 985157 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5338/tid=5351] ppid=5336 vsize=4054420 CPUtime=1201.87 cores=0,2,4,6
/proc/5338/task/5351/stat : 5351 (plingeling) R 5336 5338 5295 0 -1 4202560 471533 1261 0 0 120127 60 0 0 25 0 5 0 523416192 4151726080 985157 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=4054420 CPUtime=1194.62 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4202560 1048619 1261 0 0 119282 180 0 0 25 0 5 0 523416192 4151726080 985157 33554432000 4194304 4417332 140733207690208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 4054420

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.21 s]
/proc/loadavg: 8.07 8.08 8.02 2/178 5389
/proc/meminfo: memFree=21098692/32950928 swapFree=67111524/67111528
[pid=5338] ppid=5336 vsize=0 CPUtime=4800.52 cores=0,2,4,6
/proc/5338/stat : 5338 (plingeling) Z 5336 5338 5295 0 -1 4203548 2410582 1261 0 0 479669 383 0 0 18 0 2 0 523416170 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/5338/statm: 0 0 0 0 0 0 0
[pid=5338/tid=5352] ppid=5336 vsize=0 CPUtime=1194.74 cores=0,2,4,6
/proc/5338/task/5352/stat : 5352 (plingeling) R 5336 5338 5295 0 -1 4203588 1048619 1261 0 0 119283 191 0 0 25 0 2 0 523416192 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.52
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.29
CPU time (s): 4800.61
CPU user time (s): 4796.69
CPU system time (s): 3.9144
CPU usage (%): 399.289
Max. virtual memory (cumulated for all children) (KiB): 4054420

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.69
system time used= 3.9144
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2411843
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 124
involuntary context switches= 23312

runsolver used 2.00869 second user time and 4.53831 second system time

The end

Launcher Data 

Begin job on node125 at 2011-04-30 01:02:45
IDJOB=3251384
IDBENCH=88221
IDSOLVER=1605
FILE ID=node125/3251384-1304118165
RUNJOBID= node125-1304118165-5313
PBS_JOBID= 13170720
Free space on /tmp= 72756 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m47-q841.5-n45-p15-s16393788.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3251384-1304118165/watcher-3251384-1304118165 -o /tmp/evaluation-result-3251384-1304118165/solver-3251384-1304118165 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3251384-1304118165.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 683c9f75b69575e6451b8563d12f176b
RANDOM SEED=1714915801

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      22828932 kB
Buffers:       2124552 kB
Cached:        7405612 kB
SwapCached:          4 kB
Active:        2126804 kB
Inactive:      7469408 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      22828932 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            7156 kB
Writeback:           0 kB
AnonPages:       65692 kB
Mapped:          15164 kB
Slab:           460168 kB
PageTables:       5032 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   208092 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72756 MiB
End job on node125 at 2011-04-30 01:22:49