Trace number 3370934

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.18 1207.09

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-6x40.cnf
MD5SUM3a7a68cedc6ab84c0df9c27d166b0b6b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables960
Number of clauses48480
Sum of the clauses size191040
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21440
Number of clauses of size 30
Number of clauses of size 447040
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3370934-1305425792/watcher-3370934-1305425792 -o /tmp/evaluation-result-3370934-1305425792/solver-3370934-1305425792 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3370934-1305425792.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.43 7.98 7.84 1/345 24367
/proc/meminfo: memFree=24117328/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=11284 CPUtime=0 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) R 24365 24367 23744 0 -1 4202496 961 1258 0 0 0 0 0 0 25 0 1 0 654175915 11554816 843 33554432000 4194304 4417452 140736772469664 18446744073709551615 254500691712 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/24367/statm: 2821 843 148 55 0 707 0

[startup+0.035371 s]
/proc/loadavg: 7.43 7.98 7.84 1/345 24367
/proc/meminfo: memFree=24117328/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=17352 CPUtime=0.02 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) R 24365 24367 23744 0 -1 4202496 2562 1258 0 0 2 0 0 0 25 0 1 0 654175915 17768448 2360 33554432000 4194304 4417452 140736772469664 18446744073709551615 254500691712 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/24367/statm: 4338 2360 148 55 0 2224 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 17352

[startup+0.165267 s]
/proc/loadavg: 7.43 7.98 7.84 1/345 24367
/proc/meminfo: memFree=24117328/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=135832 CPUtime=0.47 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 5770 1258 0 0 46 1 0 0 25 0 5 0 654175915 139091968 5391 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 33958 5391 179 55 0 31844 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 135832

[startup+0.300243 s]
/proc/loadavg: 7.43 7.98 7.84 1/345 24367
/proc/meminfo: memFree=24117328/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=138028 CPUtime=1.01 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 6661 1258 0 0 100 1 0 0 25 0 5 0 654175915 141340672 5922 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 34507 5922 179 55 0 32393 0
Current children cumulated CPU time (s) 1.01
Current children cumulated vsize (KiB) 138028

[startup+0.700162 s]
/proc/loadavg: 7.43 7.98 7.84 1/345 24367
/proc/meminfo: memFree=24117328/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=144880 CPUtime=2.61 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 9720 1258 0 0 260 1 0 0 25 0 5 0 654175915 148357120 7656 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 36220 7656 179 55 0 34106 0
Current children cumulated CPU time (s) 2.61
Current children cumulated vsize (KiB) 144880

[startup+1.501 s]
/proc/loadavg: 7.43 7.98 7.84 6/352 24417
/proc/meminfo: memFree=24067368/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=153572 CPUtime=5.81 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 17817 1258 0 0 578 3 0 0 25 0 5 0 654175915 157257728 9808 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 38393 9808 179 55 0 36279 0
[pid=24367/tid=24376] ppid=24365 vsize=153572 CPUtime=1.43 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 2851 1258 0 0 143 0 0 0 25 0 5 0 654175921 157257728 9808 33554432000 4194304 4417452 140736772469664 18446744073709551615 4245635 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=153572 CPUtime=1.43 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 1987 1258 0 0 143 0 0 0 25 0 5 0 654175921 157257728 9808 33554432000 4194304 4417452 140736772469664 18446744073709551615 4265499 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=153572 CPUtime=1.42 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 4026 1258 0 0 142 0 0 0 25 0 5 0 654175921 157257728 9808 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=153572 CPUtime=1.43 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 5355 1258 0 0 143 0 0 0 25 0 5 0 654175921 157257728 9808 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.81
Current children cumulated vsize (KiB) 153572

[startup+3.10069 s]
/proc/loadavg: 7.43 7.98 7.84 10/359 24432
/proc/meminfo: memFree=23965828/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=174028 CPUtime=12.19 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 35154 1258 0 0 1214 5 0 0 25 0 5 0 654175915 178204672 14922 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 43507 14922 179 55 0 41393 0
[pid=24367/tid=24376] ppid=24365 vsize=174028 CPUtime=3.03 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 7962 1258 0 0 302 1 0 0 25 0 5 0 654175921 178204672 14922 33554432000 4194304 4417452 140736772469664 18446744073709551615 18446744073699065955 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=174028 CPUtime=3.03 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 4252 1258 0 0 303 0 0 0 25 0 5 0 654175921 178204672 14922 33554432000 4194304 4417452 140736772469664 18446744073709551615 4337299 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=174028 CPUtime=3.01 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 8317 1258 0 0 300 1 0 0 25 0 5 0 654175921 178204672 14922 33554432000 4194304 4417452 140736772469664 18446744073709551615 4258161 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=174028 CPUtime=3.03 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 11025 1258 0 0 302 1 0 0 25 0 5 0 654175921 178204672 14922 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.19
Current children cumulated vsize (KiB) 174028

[startup+6.30105 s]
/proc/loadavg: 7.47 7.98 7.84 9/359 24432
/proc/meminfo: memFree=23887108/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=222068 CPUtime=24.95 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 70969 1258 0 0 2485 10 0 0 25 0 5 0 654175915 227397632 26932 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 55517 26932 179 55 0 53403 0
[pid=24367/tid=24376] ppid=24365 vsize=222068 CPUtime=6.23 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 19452 1258 0 0 621 2 0 0 25 0 5 0 654175921 227397632 26932 33554432000 4194304 4417452 140736772469664 18446744073709551615 4366087 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=222068 CPUtime=6.24 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 12042 1258 0 0 622 2 0 0 25 0 5 0 654175921 227397632 26932 33554432000 4194304 4417452 140736772469664 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=222068 CPUtime=6.17 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 19506 1258 0 0 615 2 0 0 25 0 5 0 654175921 227397632 26932 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=222068 CPUtime=6.23 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 16371 1258 0 0 621 2 0 0 25 0 5 0 654175921 227397632 26932 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.95
Current children cumulated vsize (KiB) 222068

[startup+12.7008 s]
/proc/loadavg: 7.52 7.98 7.84 10/359 24432
/proc/meminfo: memFree=23824380/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=269832 CPUtime=50.48 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 119199 1258 0 0 5029 19 0 0 25 0 5 0 654175915 276307968 38873 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 67458 38873 179 55 0 65344 0
[pid=24367/tid=24376] ppid=24365 vsize=269832 CPUtime=12.64 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 38832 1258 0 0 1258 6 0 0 25 0 5 0 654175921 276307968 38873 33554432000 4194304 4417452 140736772469664 18446744073709551615 4320821 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=269832 CPUtime=12.63 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 18827 1258 0 0 1261 2 0 0 25 0 5 0 654175921 276307968 38873 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=269832 CPUtime=12.5 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 34730 1258 0 0 1244 6 0 0 25 0 5 0 654175921 276307968 38873 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=269832 CPUtime=12.63 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 23212 1258 0 0 1260 3 0 0 25 0 5 0 654175921 276307968 38873 33554432000 4194304 4417452 140736772469664 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.48
Current children cumulated vsize (KiB) 269832

[startup+25.5012 s]
/proc/loadavg: 7.62 7.98 7.84 9/359 24432
/proc/meminfo: memFree=23613348/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=435828 CPUtime=101.54 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 196902 1258 0 0 10123 31 0 0 25 0 5 0 654175915 446287872 80372 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 108957 80372 179 55 0 106843 0
[pid=24367/tid=24376] ppid=24365 vsize=435828 CPUtime=25.43 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 67444 1258 0 0 2533 10 0 0 25 0 5 0 654175921 446287872 80372 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=435828 CPUtime=25.43 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 23728 1258 0 0 2540 3 0 0 25 0 5 0 654175921 446287872 80372 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364850 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=435828 CPUtime=25.15 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 63609 1258 0 0 2505 10 0 0 25 0 5 0 654175921 446287872 80372 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=435828 CPUtime=25.43 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 38523 1258 0 0 2538 5 0 0 25 0 5 0 654175921 446287872 80372 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.54
Current children cumulated vsize (KiB) 435828

[startup+51.1011 s]
/proc/loadavg: 7.90 8.01 7.85 10/359 24433
/proc/meminfo: memFree=23381232/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=597456 CPUtime=203.67 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 303462 1258 0 0 20320 47 0 0 25 0 5 0 654175915 611794944 120779 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 149364 120779 179 55 0 147250 0
[pid=24367/tid=24376] ppid=24365 vsize=597456 CPUtime=51.04 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 106886 1258 0 0 5088 16 0 0 25 0 5 0 654175921 611794944 120779 33554432000 4194304 4417452 140736772469664 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=597456 CPUtime=51.04 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 39730 1258 0 0 5099 5 0 0 25 0 5 0 654175921 611794944 120779 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=597456 CPUtime=50.48 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 89468 1258 0 0 5033 15 0 0 25 0 5 0 654175921 611794944 120779 33554432000 4194304 4417452 140736772469664 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=597456 CPUtime=51.03 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 63780 1258 0 0 5094 9 0 0 25 0 5 0 654175921 611794944 120779 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.67
Current children cumulated vsize (KiB) 597456

[startup+102.314 s]
/proc/loadavg: 7.95 8.01 7.86 9/359 24434
/proc/meminfo: memFree=22860408/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=772888 CPUtime=407.95 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 559334 1258 0 0 40710 85 0 0 25 0 5 0 654175915 791437312 164637 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 193222 164637 179 55 0 191108 0
[pid=24367/tid=24376] ppid=24365 vsize=772888 CPUtime=102.24 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 199553 1258 0 0 10195 29 0 0 25 0 5 0 654175921 791437312 164637 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=772888 CPUtime=102.25 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 93002 1258 0 0 10214 11 0 0 25 0 5 0 654175921 791437312 164637 33554432000 4194304 4417452 140736772469664 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=772888 CPUtime=101.13 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 163265 1258 0 0 10085 28 0 0 25 0 5 0 654175921 791437312 164637 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=772888 CPUtime=102.25 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 99916 1258 0 0 10210 15 0 0 25 0 5 0 654175921 791437312 164637 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 407.95
Current children cumulated vsize (KiB) 772888

[startup+162.301 s]
/proc/loadavg: 8.17 8.05 7.88 10/359 24436
/proc/meminfo: memFree=22546416/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=1011144 CPUtime=647.25 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 868779 1258 0 0 64588 137 0 0 25 0 5 0 654175915 1035411456 224201 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 252786 224201 179 55 0 250672 0
[pid=24367/tid=24376] ppid=24365 vsize=1011144 CPUtime=162.24 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 287811 1258 0 0 16178 46 0 0 25 0 5 0 654175921 1035411456 224201 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=1011144 CPUtime=162.24 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 190572 1258 0 0 16198 26 0 0 25 0 5 0 654175921 1035411456 224201 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=1011144 CPUtime=160.46 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 251399 1258 0 0 16002 44 0 0 25 0 5 0 654175921 1035411456 224201 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=1011144 CPUtime=162.24 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 135399 1258 0 0 16204 20 0 0 25 0 5 0 654175921 1035411456 224201 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 647.25
Current children cumulated vsize (KiB) 1011144


################
# More data... #
################

[pid=24367/tid=24377] ppid=24365 vsize=1674344 CPUtime=701.38 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 559538 1258 0 0 70060 78 0 0 25 0 5 0 654175921 1714528256 390002 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=1674344 CPUtime=693.26 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 1075140 1258 0 0 69152 174 0 0 25 0 5 0 654175921 1714528256 390002 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=1674344 CPUtime=698.98 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 338535 1258 0 0 69844 54 0 0 25 0 5 0 654175921 1714528256 390002 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2795.18
Current children cumulated vsize (KiB) 1674344

[startup+762.314 s]
/proc/loadavg: 9.41 9.06 8.43 10/366 4603
/proc/meminfo: memFree=20946280/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=1573800 CPUtime=3033.59 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 3062941 1258 0 0 302881 478 0 0 25 0 5 0 654175915 1611571200 364865 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 393450 364865 180 55 0 391336 0
[pid=24367/tid=24376] ppid=24365 vsize=1573800 CPUtime=761.41 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 990382 1258 0 0 75983 158 0 0 25 0 5 0 654175921 1611571200 364865 33554432000 4194304 4417452 140736772469664 18446744073709551615 4366806 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=1573800 CPUtime=761.29 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 596929 1258 0 0 76046 83 0 0 25 0 5 0 654175921 1611571200 364865 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=1573800 CPUtime=752.42 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 1133497 1258 0 0 75061 181 0 0 25 0 5 0 654175921 1611571200 364865 33554432000 4194304 4417452 140736772469664 18446744073709551615 4259600 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=1573800 CPUtime=758.39 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 338535 1258 0 0 75785 54 0 0 25 0 5 0 654175921 1611571200 364865 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3033.59
Current children cumulated vsize (KiB) 1573800

[startup+822.301 s]
/proc/loadavg: 9.23 9.07 8.48 11/365 6342
/proc/meminfo: memFree=21080680/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=1676656 CPUtime=3271.93 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 3234660 1258 0 0 326692 501 0 0 25 0 5 0 654175915 1716895744 390580 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 419164 390580 180 55 0 417050 0
[pid=24367/tid=24376] ppid=24365 vsize=1676656 CPUtime=821.24 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 1038896 1258 0 0 81960 164 0 0 25 0 5 0 654175921 1716895744 390580 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=1676656 CPUtime=821.17 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 631941 1258 0 0 82029 88 0 0 25 0 5 0 654175921 1716895744 390580 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=1676656 CPUtime=811.59 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 1214449 1258 0 0 80967 192 0 0 25 0 5 0 654175921 1716895744 390580 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=1676656 CPUtime=817.86 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 345776 1258 0 0 81730 56 0 0 25 0 5 0 654175921 1716895744 390580 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3271.93
Current children cumulated vsize (KiB) 1676656

[startup+882.301 s]
/proc/loadavg: 9.23 9.10 8.52 11/365 8130
/proc/meminfo: memFree=20969580/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=1735928 CPUtime=3510.35 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 3322099 1258 0 0 350519 516 0 0 25 0 5 0 654175915 1777590272 405398 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 433982 405398 180 55 0 431868 0
[pid=24367/tid=24376] ppid=24365 vsize=1735928 CPUtime=881.1 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 1104006 1258 0 0 87935 175 0 0 25 0 5 0 654175921 1777590272 405398 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=1735928 CPUtime=881.04 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 654270 1258 0 0 88013 91 0 0 25 0 5 0 654175921 1777590272 405398 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=1735928 CPUtime=870.74 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 1214449 1258 0 0 86882 192 0 0 25 0 5 0 654175921 1777590272 405398 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=1735928 CPUtime=877.37 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 345776 1258 0 0 87681 56 0 0 25 0 5 0 654175921 1777590272 405398 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3510.35
Current children cumulated vsize (KiB) 1735928

[startup+942.301 s]
/proc/loadavg: 9.31 9.15 8.57 10/367 9996
/proc/meminfo: memFree=20957536/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=1814744 CPUtime=3748.65 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 3394463 1258 0 0 374336 529 0 0 25 0 5 0 654175915 1858297856 425102 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 453686 425102 180 55 0 451572 0
[pid=24367/tid=24376] ppid=24365 vsize=1814744 CPUtime=940.94 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 1104006 1258 0 0 93919 175 0 0 25 0 5 0 654175921 1858297856 425102 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=1814744 CPUtime=940.78 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 680290 1258 0 0 93981 97 0 0 25 0 5 0 654175921 1858297856 425102 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=1814744 CPUtime=929.83 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 1222641 1258 0 0 92789 194 0 0 25 0 5 0 654175921 1858297856 425102 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=1814744 CPUtime=937.02 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 383928 1258 0 0 93641 61 0 0 25 0 5 0 654175921 1858297856 425102 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3748.65
Current children cumulated vsize (KiB) 1814744

[startup+1002.3 s]
/proc/loadavg: 9.24 9.16 8.61 12/366 11880
/proc/meminfo: memFree=21305776/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=1543912 CPUtime=3986.94 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 3545864 1258 0 0 398139 555 0 0 25 0 5 0 654175915 1580965888 357426 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 385978 357426 180 55 0 383864 0
[pid=24367/tid=24376] ppid=24365 vsize=1543912 CPUtime=1000.69 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 1113458 1258 0 0 99890 179 0 0 25 0 5 0 654175921 1580965888 357426 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=1543912 CPUtime=1000.6 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 726354 1258 0 0 99959 101 0 0 25 0 5 0 654175921 1580965888 357426 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=1543912 CPUtime=989.01 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 1318526 1258 0 0 98690 211 0 0 25 0 5 0 654175921 1580965888 357426 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=1543912 CPUtime=996.55 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 383928 1258 0 0 99594 61 0 0 25 0 5 0 654175921 1580965888 357426 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3986.94
Current children cumulated vsize (KiB) 1543912

[startup+1062.3 s]
/proc/loadavg: 9.27 9.18 8.65 10/367 13683
/proc/meminfo: memFree=21326420/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=1684048 CPUtime=4225.3 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 3671654 1258 0 0 421956 574 0 0 25 0 5 0 654175915 1724465152 388623 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 421012 388623 180 55 0 418898 0
[pid=24367/tid=24376] ppid=24365 vsize=1684048 CPUtime=1060.51 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 1162281 1258 0 0 105865 186 0 0 25 0 5 0 654175921 1724465152 388623 33554432000 4194304 4417452 140736772469664 18446744073709551615 4263109 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=1684048 CPUtime=1060.43 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 772592 1258 0 0 105935 108 0 0 25 0 5 0 654175921 1724465152 388623 33554432000 4194304 4417452 140736772469664 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=1684048 CPUtime=1048.18 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 1327105 1258 0 0 104606 212 0 0 25 0 5 0 654175921 1724465152 388623 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=1684048 CPUtime=1056.09 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 406078 1258 0 0 105543 66 0 0 25 0 5 0 654175921 1724465152 388623 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4225.3
Current children cumulated vsize (KiB) 1684048

[startup+1122.3 s]
/proc/loadavg: 9.44 9.23 8.69 10/367 15549
/proc/meminfo: memFree=20920932/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=1871536 CPUtime=4463.64 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 3760760 1258 0 0 445778 586 0 0 25 0 5 0 654175915 1916452864 439300 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 467884 439300 180 55 0 465770 0
[pid=24367/tid=24376] ppid=24365 vsize=1871536 CPUtime=1120.35 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 1182240 1258 0 0 111847 188 0 0 25 0 5 0 654175921 1916452864 439300 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=1871536 CPUtime=1120.33 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 791324 1258 0 0 111922 111 0 0 25 0 5 0 654175921 1916452864 439300 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=1871536 CPUtime=1107.41 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 1377520 1258 0 0 110522 219 0 0 25 0 5 0 654175921 1916452864 439300 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=1871536 CPUtime=1115.47 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 406078 1258 0 0 111481 66 0 0 25 0 5 0 654175921 1916452864 439300 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4463.64
Current children cumulated vsize (KiB) 1871536

[startup+1182.3 s]
/proc/loadavg: 9.47 9.26 8.74 10/367 17420
/proc/meminfo: memFree=21078852/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=1678024 CPUtime=4701.92 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 3907838 1258 0 0 469585 607 0 0 25 0 5 0 654175915 1718296576 392862 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 419506 392862 180 55 0 417392 0
[pid=24367/tid=24376] ppid=24365 vsize=1678024 CPUtime=1180.13 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 1248520 1258 0 0 117816 197 0 0 25 0 5 0 654175921 1718296576 392862 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=1678024 CPUtime=1180.12 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 822874 1258 0 0 117897 115 0 0 25 0 5 0 654175921 1718296576 392862 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=1678024 CPUtime=1166.53 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 1426768 1258 0 0 116426 227 0 0 25 0 5 0 654175921 1718296576 392862 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=1678024 CPUtime=1175.05 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 406078 1258 0 0 117439 66 0 0 25 0 5 0 654175921 1718296576 392862 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4701.92
Current children cumulated vsize (KiB) 1678024



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207 s]
/proc/loadavg: 9.31 9.24 8.74 10/366 18188
/proc/meminfo: memFree=21320580/32950928 swapFree=45937192/67111528
[pid=24367] ppid=24365 vsize=1704532 CPUtime=4800.08 cores=1,3,5,7
/proc/24367/stat : 24367 (plingeling) S 24365 24367 23744 0 -1 4202496 3976813 1258 0 0 479389 619 0 0 25 0 5 0 654175915 1745440768 399489 33554432000 4194304 4417452 140736772469664 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/24367/statm: 426133 399489 180 55 0 424019 0
[pid=24367/tid=24376] ppid=24365 vsize=1704532 CPUtime=1204.81 cores=1,3,5,7
/proc/24367/task/24376/stat : 24376 (plingeling) R 24365 24367 23744 0 -1 4202560 1252115 1258 0 0 120284 197 0 0 25 0 5 0 654175921 1745440768 399489 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=24367/tid=24377] ppid=24365 vsize=1704532 CPUtime=1204.79 cores=1,3,5,7
/proc/24367/task/24377/stat : 24377 (plingeling) R 24365 24367 23744 0 -1 4202560 862089 1258 0 0 120357 122 0 0 25 0 5 0 654175921 1745440768 399489 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=24367/tid=24378] ppid=24365 vsize=1704532 CPUtime=1190.9 cores=1,3,5,7
/proc/24367/task/24378/stat : 24378 (plingeling) R 24365 24367 23744 0 -1 4202560 1452933 1258 0 0 118859 231 0 0 25 0 5 0 654175921 1745440768 399489 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24367/tid=24379] ppid=24365 vsize=1704532 CPUtime=1199.49 cores=1,3,5,7
/proc/24367/task/24379/stat : 24379 (plingeling) R 24365 24367 23744 0 -1 4202560 406078 1258 0 0 119883 66 0 0 25 0 5 0 654175921 1745440768 399489 33554432000 4194304 4417452 140736772469664 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.08
Current children cumulated vsize (KiB) 1704532

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1207.09
CPU time (s): 4800.18
CPU user time (s): 4793.91
CPU system time (s): 6.26705
CPU usage (%): 397.666
Max. virtual memory (cumulated for all children) (KiB): 2140860

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4793.92
system time used= 6.26705
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3978071
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 82
involuntary context switches= 56198

runsolver used 3.85941 second user time and 10.1935 second system time

The end

Launcher Data 

Begin job on node149 at 2011-05-15 04:16:32
IDJOB=3370934
IDBENCH=83178
IDSOLVER=1848
FILE ID=node149/3370934-1305425792
RUNJOBID= node149-1305424586-23763
PBS_JOBID= 13324600
Free space on /tmp= 73620 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-6x40.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3370934-1305425792/watcher-3370934-1305425792 -o /tmp/evaluation-result-3370934-1305425792/solver-3370934-1305425792 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3370934-1305425792.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3a7a68cedc6ab84c0df9c27d166b0b6b
RANDOM SEED=375543427

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      24117608 kB
Buffers:        315000 kB
Cached:        3887540 kB
SwapCached:      19984 kB
Active:        6307740 kB
Inactive:      2231788 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      24117608 kB
SwapTotal:    67111528 kB
SwapFree:     45937192 kB
Dirty:             836 kB
Writeback:           0 kB
AnonPages:     4329100 kB
Mapped:          13812 kB
Slab:           156688 kB
PageTables:      71916 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 80190028 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73612 MiB
End job on node149 at 2011-05-15 04:36:41