Trace number 3370944

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.33 1207.38

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x39.cnf
MD5SUMe7679ca49bb432c9b90305d907365c4e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3276
Number of clauses628173
Sum of the clauses size2502864
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24914
Number of clauses of size 30
Number of clauses of size 4623259
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3370944-1305425861/watcher-3370944-1305425861 -o /tmp/evaluation-result-3370944-1305425861/solver-3370944-1305425861 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3370944-1305425861.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.78 7.49 7.81 5/320 20559
/proc/meminfo: memFree=15557800/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=10200 CPUtime=0 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) R 20557 20559 19229 0 -1 4202496 610 1252 0 0 0 0 0 0 18 0 1 0 732816856 10444800 540 33554432000 4194304 4417452 140733551060672 18446744073709551615 231895490304 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20559/statm: 2550 540 147 55 0 436 0

[startup+0.106304 s]
/proc/loadavg: 5.78 7.49 7.81 5/320 20559
/proc/meminfo: memFree=15557800/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=34808 CPUtime=0.09 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) R 20557 20559 19229 0 -1 4202496 6891 1252 0 0 9 0 0 0 18 0 1 0 732816856 35643392 6725 33554432000 4194304 4417452 140733551060672 18446744073709551615 231895184477 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20559/statm: 8702 6725 148 55 0 6588 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 34808

[startup+0.200275 s]
/proc/loadavg: 5.78 7.49 7.81 5/320 20559
/proc/meminfo: memFree=15557800/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=59384 CPUtime=0.19 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) R 20557 20559 19229 0 -1 4202496 13035 1252 0 0 18 1 0 0 18 0 1 0 732816856 60809216 12869 33554432000 4194304 4417452 140733551060672 18446744073709551615 231895490304 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20559/statm: 14846 12869 148 55 0 12732 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 59384

[startup+0.300255 s]
/proc/loadavg: 5.78 7.49 7.81 5/320 20559
/proc/meminfo: memFree=15557800/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=75768 CPUtime=0.28 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) R 20557 20559 19229 0 -1 4202496 17131 1252 0 0 27 1 0 0 19 0 1 0 732816856 77586432 16965 33554432000 4194304 4417452 140733551060672 18446744073709551615 4323376 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20559/statm: 18942 16965 148 55 0 16828 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 75768

[startup+0.701178 s]
/proc/loadavg: 5.78 7.49 7.81 5/320 20559
/proc/meminfo: memFree=15557800/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=141304 CPUtime=0.69 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) R 20557 20559 19229 0 -1 4202496 33515 1252 0 0 66 3 0 0 19 0 1 0 732816856 144695296 33349 33554432000 4194304 4417452 140733551060672 18446744073709551615 231895490304 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20559/statm: 35326 33349 148 55 0 33212 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 141304

[startup+1.50097 s]
/proc/loadavg: 5.78 7.49 7.81 9/325 20569
/proc/meminfo: memFree=15405744/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=223264 CPUtime=3.71 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 49269 1252 0 0 365 6 0 0 19 0 5 0 732816856 228622336 43624 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 55816 43624 174 55 0 53702 0
[pid=20559/tid=20566] ppid=20557 vsize=223264 CPUtime=0.73 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 4722 1252 0 0 73 0 0 0 25 0 5 0 732816932 228622336 43624 33554432000 4194304 4417452 140733551060672 18446744073709551615 4278271 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=223264 CPUtime=0.72 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 4751 1252 0 0 72 0 0 0 25 0 5 0 732816932 228622336 43624 33554432000 4194304 4417452 140733551060672 18446744073709551615 4278570 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=223264 CPUtime=0.73 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 4135 1252 0 0 73 0 0 0 25 0 5 0 732816932 228622336 43624 33554432000 4194304 4417452 140733551060672 18446744073709551615 4278200 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=223264 CPUtime=0.74 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 2134 1252 0 0 74 0 0 0 25 0 5 0 732816932 228622336 43624 33554432000 4194304 4417452 140733551060672 18446744073709551615 4366391 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.71
Current children cumulated vsize (KiB) 223264

[startup+3.10066 s]
/proc/loadavg: 5.78 7.49 7.81 9/325 20569
/proc/meminfo: memFree=15349372/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=258420 CPUtime=10.09 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 61742 1252 0 0 1001 8 0 0 19 0 5 0 732816856 264622080 50857 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 64605 50857 179 55 0 62491 0
[pid=20559/tid=20566] ppid=20557 vsize=258420 CPUtime=2.34 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 7765 1252 0 0 233 1 0 0 25 0 5 0 732816932 264622080 50857 33554432000 4194304 4417452 140733551060672 18446744073709551615 4239408 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=258420 CPUtime=2.32 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 6247 1252 0 0 231 1 0 0 25 0 5 0 732816932 264622080 50857 33554432000 4194304 4417452 140733551060672 18446744073709551615 231895184467 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=258420 CPUtime=2.33 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 7183 1252 0 0 232 1 0 0 25 0 5 0 732816932 264622080 50857 33554432000 4194304 4417452 140733551060672 18446744073709551615 4239401 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=258420 CPUtime=2.34 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 7020 1252 0 0 233 1 0 0 25 0 5 0 732816932 264622080 50857 33554432000 4194304 4417452 140733551060672 18446744073709551615 4242043 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10.09
Current children cumulated vsize (KiB) 258420

[startup+6.30107 s]
/proc/loadavg: 5.96 7.50 7.81 9/325 20569
/proc/meminfo: memFree=15264200/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=356448 CPUtime=22.86 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 94067 1252 0 0 2272 14 0 0 19 0 5 0 732816856 365002752 76898 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 89112 76898 179 55 0 86998 0
[pid=20559/tid=20566] ppid=20557 vsize=356448 CPUtime=5.53 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 13852 1252 0 0 552 1 0 0 25 0 5 0 732816932 365002752 76898 33554432000 4194304 4417452 140733551060672 18446744073709551615 4239418 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=356448 CPUtime=5.48 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 13881 1252 0 0 546 2 0 0 25 0 5 0 732816932 365002752 76898 33554432000 4194304 4417452 140733551060672 18446744073709551615 4239414 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=356448 CPUtime=5.53 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 13270 1252 0 0 551 2 0 0 25 0 5 0 732816932 365002752 76898 33554432000 4194304 4417452 140733551060672 18446744073709551615 4239408 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=356448 CPUtime=5.54 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 19537 1252 0 0 551 3 0 0 25 0 5 0 732816932 365002752 76898 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 22.86
Current children cumulated vsize (KiB) 356448

[startup+12.7009 s]
/proc/loadavg: 6.12 7.51 7.81 9/325 20569
/proc/meminfo: memFree=15165708/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=357772 CPUtime=48.39 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 111393 1252 0 0 4822 17 0 0 19 0 5 0 732816856 366358528 77229 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 89443 77229 179 55 0 87329 0
[pid=20559/tid=20566] ppid=20557 vsize=357772 CPUtime=11.93 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 13852 1252 0 0 1192 1 0 0 25 0 5 0 732816932 366358528 77229 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=357772 CPUtime=11.8 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 13881 1252 0 0 1178 2 0 0 25 0 5 0 732816932 366358528 77229 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=357772 CPUtime=11.93 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 13270 1252 0 0 1191 2 0 0 25 0 5 0 732816932 366358528 77229 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=357772 CPUtime=11.94 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 36863 1252 0 0 1188 6 0 0 25 0 5 0 732816932 366358528 77229 33554432000 4194304 4417452 140733551060672 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 48.39
Current children cumulated vsize (KiB) 357772

[startup+25.5005 s]
/proc/loadavg: 6.54 7.53 7.81 9/325 20570
/proc/meminfo: memFree=15079148/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=395632 CPUtime=99.46 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 136997 1252 0 0 9925 21 0 0 19 0 5 0 732816856 405127168 86709 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 98908 86709 179 55 0 96794 0
[pid=20559/tid=20566] ppid=20557 vsize=395632 CPUtime=24.73 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 13852 1252 0 0 2472 1 0 0 25 0 5 0 732816932 405127168 86709 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=395632 CPUtime=24.47 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 13881 1252 0 0 2445 2 0 0 25 0 5 0 732816932 405127168 86709 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=395632 CPUtime=24.73 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 13270 1252 0 0 2471 2 0 0 25 0 5 0 732816932 405127168 86709 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=395632 CPUtime=24.74 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 62467 1252 0 0 2464 10 0 0 25 0 5 0 732816932 405127168 86709 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 99.46
Current children cumulated vsize (KiB) 395632

[startup+51.1007 s]
/proc/loadavg: 7.18 7.60 7.83 9/325 20570
/proc/meminfo: memFree=14913972/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=560660 CPUtime=201.6 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 245261 1252 0 0 20124 36 0 0 19 0 5 0 732816856 574115840 111600 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 140165 111600 179 55 0 138051 0
[pid=20559/tid=20566] ppid=20557 vsize=560660 CPUtime=50.33 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 55344 1252 0 0 5026 7 0 0 25 0 5 0 732816932 574115840 111600 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=560660 CPUtime=49.82 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 22701 1252 0 0 4979 3 0 0 25 0 5 0 732816932 574115840 111600 33554432000 4194304 4417452 140733551060672 18446744073709551615 4250852 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=560660 CPUtime=50.34 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 35318 1252 0 0 5028 6 0 0 25 0 5 0 732816932 574115840 111600 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=560660 CPUtime=50.33 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 98371 1252 0 0 5018 15 0 0 25 0 5 0 732816932 574115840 111600 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 201.6
Current children cumulated vsize (KiB) 560660

[startup+102.301 s]
/proc/loadavg: 7.72 7.68 7.84 9/325 20572
/proc/meminfo: memFree=14443004/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=811868 CPUtime=405.91 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 462988 1252 0 0 40522 69 0 0 19 0 5 0 732816856 831352832 174402 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 202967 174402 179 55 0 200853 0
[pid=20559/tid=20566] ppid=20557 vsize=811868 CPUtime=101.55 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 110649 1252 0 0 10141 14 0 0 25 0 5 0 732816932 831352832 174402 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=811868 CPUtime=100.51 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 76454 1252 0 0 10039 12 0 0 25 0 5 0 732816932 831352832 174402 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=811868 CPUtime=101.55 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 85169 1252 0 0 10141 14 0 0 25 0 5 0 732816932 831352832 174402 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=811868 CPUtime=101.54 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 157189 1252 0 0 10130 24 0 0 25 0 5 0 732816932 831352832 174402 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 405.91
Current children cumulated vsize (KiB) 811868

[startup+162.301 s]
/proc/loadavg: 7.93 7.75 7.85 9/325 20573
/proc/meminfo: memFree=14039972/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=951312 CPUtime=645.28 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 635377 1252 0 0 64432 96 0 0 19 0 5 0 732816856 974143488 209263 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 237828 209263 179 55 0 235714 0
[pid=20559/tid=20566] ppid=20557 vsize=951312 CPUtime=161.54 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 141421 1252 0 0 16135 19 0 0 25 0 5 0 732816932 974143488 209263 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=951312 CPUtime=159.9 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 111756 1252 0 0 15975 15 0 0 25 0 5 0 732816932 974143488 209263 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=951312 CPUtime=161.54 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 157501 1252 0 0 16128 26 0 0 25 0 5 0 732816932 974143488 209263 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=951312 CPUtime=161.54 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 191172 1252 0 0 16123 31 0 0 25 0 5 0 732816932 974143488 209263 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 645.28
Current children cumulated vsize (KiB) 951312


################
# More data... #
################

[pid=20559/tid=20567] ppid=20557 vsize=1665300 CPUtime=693.52 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 378369 1252 0 0 69300 52 0 0 25 0 5 0 732816932 1705267200 387760 33554432000 4194304 4417452 140733551060672 18446744073709551615 4246272 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=1665300 CPUtime=700.18 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 583287 1252 0 0 69928 90 0 0 25 0 5 0 732816932 1705267200 387760 33554432000 4194304 4417452 140733551060672 18446744073709551615 4250532 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=1665300 CPUtime=698.02 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 415042 1252 0 0 69735 67 0 0 25 0 5 0 732816932 1705267200 387760 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2793.04
Current children cumulated vsize (KiB) 1665300

[startup+762.301 s]
/proc/loadavg: 9.40 9.08 8.48 11/333 2918
/proc/meminfo: memFree=12899652/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=1778412 CPUtime=3031.52 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 2424024 1252 0 0 302784 368 0 0 19 0 5 0 732816856 1821093888 415751 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 444603 415751 179 55 0 442489 0
[pid=20559/tid=20566] ppid=20557 vsize=1778412 CPUtime=760.42 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 927203 1252 0 0 75901 141 0 0 25 0 5 0 732816932 1821093888 415751 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=1778412 CPUtime=752.84 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 393604 1252 0 0 75230 54 0 0 25 0 5 0 732816932 1821093888 415751 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=1778412 CPUtime=760.12 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 641600 1252 0 0 75914 98 0 0 25 0 5 0 732816932 1821093888 415751 33554432000 4194304 4417452 140733551060672 18446744073709551615 4258491 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=1778412 CPUtime=757.35 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 428090 1252 0 0 75666 69 0 0 25 0 5 0 732816932 1821093888 415751 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3031.52
Current children cumulated vsize (KiB) 1778412

[startup+822.3 s]
/proc/loadavg: 9.29 9.10 8.52 10/332 4763
/proc/meminfo: memFree=12532384/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=1912476 CPUtime=3269.98 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 2665192 1252 0 0 326591 407 0 0 19 0 5 0 732816856 1958375424 449554 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 478119 449554 179 55 0 476005 0
[pid=20559/tid=20566] ppid=20557 vsize=1912476 CPUtime=820.27 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 1070246 1252 0 0 81861 166 0 0 25 0 5 0 732816932 1958375424 449554 33554432000 4194304 4417452 140733551060672 18446744073709551615 4366074 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=1912476 CPUtime=812.18 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 434287 1252 0 0 81160 58 0 0 25 0 5 0 732816932 1958375424 449554 33554432000 4194304 4417452 140733551060672 18446744073709551615 4250476 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=1912476 CPUtime=819.96 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 681815 1252 0 0 81892 104 0 0 25 0 5 0 732816932 1958375424 449554 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=1912476 CPUtime=816.78 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 445317 1252 0 0 81605 73 0 0 25 0 5 0 732816932 1958375424 449554 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3269.98
Current children cumulated vsize (KiB) 1912476

[startup+882.312 s]
/proc/loadavg: 9.52 9.20 8.59 10/331 6641
/proc/meminfo: memFree=12718136/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=1715216 CPUtime=3508.46 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 2764104 1252 0 0 350421 425 0 0 19 0 5 0 732816856 1756381184 400239 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 428804 400239 179 55 0 426690 0
[pid=20559/tid=20566] ppid=20557 vsize=1715216 CPUtime=880.09 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 1076571 1252 0 0 87840 169 0 0 25 0 5 0 732816932 1756381184 400239 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364583 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=1715216 CPUtime=871.46 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 481468 1252 0 0 87080 66 0 0 25 0 5 0 732816932 1756381184 400239 33554432000 4194304 4417452 140733551060672 18446744073709551615 4254968 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=1715216 CPUtime=879.79 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 693811 1252 0 0 87873 106 0 0 25 0 5 0 732816932 1756381184 400239 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=1715216 CPUtime=876.35 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 478727 1252 0 0 87555 80 0 0 25 0 5 0 732816932 1756381184 400239 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3508.46
Current children cumulated vsize (KiB) 1715216

[startup+942.301 s]
/proc/loadavg: 9.27 9.19 8.63 10/332 8409
/proc/meminfo: memFree=12309456/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=2003260 CPUtime=3746.94 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 2955009 1252 0 0 374243 451 0 0 19 0 5 0 732816856 2051338240 472250 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 500815 472250 179 55 0 498701 0
[pid=20559/tid=20566] ppid=20557 vsize=2003260 CPUtime=939.95 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 1175003 1252 0 0 93813 182 0 0 25 0 5 0 732816932 2051338240 472250 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=2003260 CPUtime=930.72 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 507900 1252 0 0 93003 69 0 0 25 0 5 0 732816932 2051338240 472250 33554432000 4194304 4417452 140733551060672 18446744073709551615 4366117 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=2003260 CPUtime=939.64 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 731612 1252 0 0 93854 110 0 0 25 0 5 0 732816932 2051338240 472250 33554432000 4194304 4417452 140733551060672 18446744073709551615 4321570 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=2003260 CPUtime=935.84 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 506967 1252 0 0 93500 84 0 0 25 0 5 0 732816932 2051338240 472250 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3746.94
Current children cumulated vsize (KiB) 2003260

[startup+1002.3 s]
/proc/loadavg: 9.22 9.20 8.66 11/332 10239
/proc/meminfo: memFree=12147184/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=1988496 CPUtime=3985.39 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 3013691 1252 0 0 398081 458 0 0 19 0 5 0 732816856 2036219904 468559 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 497124 468559 179 55 0 495010 0
[pid=20559/tid=20566] ppid=20557 vsize=1988496 CPUtime=999.83 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 1175003 1252 0 0 99801 182 0 0 25 0 5 0 732816932 2036219904 468559 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=1988496 CPUtime=989.93 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 529897 1252 0 0 98920 73 0 0 25 0 5 0 732816932 2036219904 468559 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249181 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=1988496 CPUtime=999.52 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 768297 1252 0 0 99838 114 0 0 25 0 5 0 732816932 2036219904 468559 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=1988496 CPUtime=995.33 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 506967 1252 0 0 99449 84 0 0 25 0 5 0 732816932 2036219904 468559 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3985.39
Current children cumulated vsize (KiB) 1988496

[startup+1062.3 s]
/proc/loadavg: 9.31 9.23 8.71 10/332 12054
/proc/meminfo: memFree=12187584/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=2018288 CPUtime=4223.88 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 3133729 1252 0 0 421910 478 0 0 19 0 5 0 732816856 2066726912 476007 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 504572 476007 179 55 0 502458 0
[pid=20559/tid=20566] ppid=20557 vsize=2018288 CPUtime=1059.73 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 1242481 1252 0 0 105779 194 0 0 25 0 5 0 732816932 2066726912 476007 33554432000 4194304 4417452 140733551060672 18446744073709551615 4254977 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=2018288 CPUtime=1049.2 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 554449 1252 0 0 104844 76 0 0 25 0 5 0 732816932 2066726912 476007 33554432000 4194304 4417452 140733551060672 18446744073709551615 4232787 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=2018288 CPUtime=1059.41 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 796305 1252 0 0 105822 119 0 0 25 0 5 0 732816932 2066726912 476007 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=2018288 CPUtime=1054.76 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 506967 1252 0 0 105392 84 0 0 25 0 5 0 732816932 2066726912 476007 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4223.88
Current children cumulated vsize (KiB) 2018288

[startup+1122.3 s]
/proc/loadavg: 9.31 9.24 8.74 10/333 13875
/proc/meminfo: memFree=12010988/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=2327356 CPUtime=4462.35 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 3247820 1252 0 0 445738 497 0 0 19 0 5 0 732816856 2383212544 553274 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 581839 553274 179 55 0 579725 0
[pid=20559/tid=20566] ppid=20557 vsize=2327356 CPUtime=1119.61 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 1299767 1252 0 0 111756 205 0 0 25 0 5 0 732816932 2383212544 553274 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=2327356 CPUtime=1108.43 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 576161 1252 0 0 110764 79 0 0 25 0 5 0 732816932 2383212544 553274 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=2327356 CPUtime=1119.23 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 822827 1252 0 0 111800 123 0 0 25 0 5 0 732816932 2383212544 553274 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=2327356 CPUtime=1114.3 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 515538 1252 0 0 111345 85 0 0 25 0 5 0 732816932 2383212544 553274 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4462.35
Current children cumulated vsize (KiB) 2327356

[startup+1182.3 s]
/proc/loadavg: 9.41 9.27 8.78 11/333 15743
/proc/meminfo: memFree=12656152/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=1977472 CPUtime=4700.81 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 3402856 1252 0 0 469562 519 0 0 19 0 5 0 732816856 2024931328 465803 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 494368 465803 179 55 0 492254 0
[pid=20559/tid=20566] ppid=20557 vsize=1977472 CPUtime=1179.52 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 1364240 1252 0 0 117738 214 0 0 25 0 5 0 732816932 2024931328 465803 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=1977472 CPUtime=1167.73 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 628181 1252 0 0 116687 86 0 0 25 0 5 0 732816932 2024931328 465803 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=1977472 CPUtime=1179.1 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 861370 1252 0 0 117783 127 0 0 25 0 5 0 732816932 2024931328 465803 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=1977472 CPUtime=1173.67 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 515538 1252 0 0 117281 86 0 0 25 0 5 0 732816932 2024931328 465803 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4700.81
Current children cumulated vsize (KiB) 1977472



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207.3 s]
/proc/loadavg: 9.27 9.25 8.78 7/326 17736
/proc/meminfo: memFree=14049600/32950928 swapFree=67085488/67111528
[pid=20559] ppid=20557 vsize=1684596 CPUtime=4800.22 cores=0,2,4,6
/proc/20559/stat : 20559 (plingeling) S 20557 20559 19229 0 -1 4202496 3487163 1252 0 0 479492 530 0 0 19 0 5 0 732816856 1725026304 392584 33554432000 4194304 4417452 140733551060672 18446744073709551615 231907293157 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20559/statm: 421149 392584 179 55 0 419035 0
[pid=20559/tid=20566] ppid=20557 vsize=1684596 CPUtime=1204.47 cores=0,2,4,6
/proc/20559/task/20566/stat : 20566 (plingeling) R 20557 20559 19229 0 -1 4202560 1381415 1252 0 0 120231 216 0 0 25 0 5 0 732816932 1725026304 392584 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20559/tid=20567] ppid=20557 vsize=1684596 CPUtime=1192.44 cores=0,2,4,6
/proc/20559/task/20567/stat : 20567 (plingeling) R 20557 20559 19229 0 -1 4202560 631997 1252 0 0 119157 87 0 0 25 0 5 0 732816932 1725026304 392584 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20559/tid=20568] ppid=20557 vsize=1684596 CPUtime=1204.01 cores=0,2,4,6
/proc/20559/task/20568/stat : 20568 (plingeling) R 20557 20559 19229 0 -1 4202560 869139 1252 0 0 120273 128 0 0 25 0 5 0 732816932 1725026304 392584 33554432000 4194304 4417452 140733551060672 18446744073709551615 4249193 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20559/tid=20569] ppid=20557 vsize=1684596 CPUtime=1198.54 cores=0,2,4,6
/proc/20559/task/20569/stat : 20569 (plingeling) R 20557 20559 19229 0 -1 4202560 571085 1252 0 0 119760 94 0 0 25 0 5 0 732816932 1725026304 392584 33554432000 4194304 4417452 140733551060672 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.22
Current children cumulated vsize (KiB) 1684596

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1207.38
CPU time (s): 4800.33
CPU user time (s): 4794.96
CPU system time (s): 5.37418
CPU usage (%): 397.581
Max. virtual memory (cumulated for all children) (KiB): 2458184

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4794.96
system time used= 5.37418
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3488415
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 97
involuntary context switches= 50431

runsolver used 3.51347 second user time and 8.5777 second system time

The end

Launcher Data 

Begin job on node114 at 2011-05-15 04:17:42
IDJOB=3370944
IDBENCH=83184
IDSOLVER=1848
FILE ID=node114/3370944-1305425861
RUNJOBID= node114-1305425861-20458
PBS_JOBID= 13324585
Free space on /tmp= 72980 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x39.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3370944-1305425861/watcher-3370944-1305425861 -o /tmp/evaluation-result-3370944-1305425861/solver-3370944-1305425861 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3370944-1305425861.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e7679ca49bb432c9b90305d907365c4e
RANDOM SEED=112022311

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      15558080 kB
Buffers:        285424 kB
Cached:        6272012 kB
SwapCached:         96 kB
Active:       11971264 kB
Inactive:      5015776 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      15558080 kB
SwapTotal:    67111528 kB
SwapFree:     67085488 kB
Dirty:           20208 kB
Writeback:           0 kB
AnonPages:    10428696 kB
Mapped:          27008 kB
Slab:           306284 kB
PageTables:      36928 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 52570344 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72988 MiB
End job on node114 at 2011-05-15 04:37:51