Trace number 3371423

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.48 1203.71

General information on the benchmark

NameSAT03/industrial/li/li-exam/
li-exam-61.shuffled-as.sat03-366.cnf
MD5SUM3be662940f394fa876137a905247d755
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables28147
Number of clauses108436
Sum of the clauses size373110
Maximum clause length166
Minimum clause length1
Number of clauses of size 114
Number of clauses of size 218786
Number of clauses of size 351588
Number of clauses of size 437440
Number of clauses of size 53
Number of clauses of size over 5605

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371423-1305430630/watcher-3371423-1305430630 -o /tmp/evaluation-result-3371423-1305430630/solver-3371423-1305430630 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371423-1305430630.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.42 7.95 8.04 3/350 30800
/proc/meminfo: memFree=24098980/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=13540 CPUtime=0 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) R 30798 30800 23744 0 -1 4202496 1446 1255 0 0 0 0 0 0 22 0 1 0 654659697 13864960 1377 33554432000 4194304 4417452 140735405857280 18446744073709551615 254500691712 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/30800/statm: 3385 1377 149 55 0 1271 0

[startup+0.0539581 s]
/proc/loadavg: 7.42 7.95 8.04 3/350 30800
/proc/meminfo: memFree=24098980/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=22004 CPUtime=0.04 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) R 30798 30800 23744 0 -1 4202496 3637 1255 0 0 4 0 0 0 22 0 1 0 654659697 22532096 3525 33554432000 4194304 4417452 140735405857280 18446744073709551615 4231537 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/30800/statm: 5501 3525 149 55 0 3387 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 22004

[startup+0.100898 s]
/proc/loadavg: 7.42 7.95 8.04 3/350 30800
/proc/meminfo: memFree=24098980/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=25076 CPUtime=0.08 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) R 30798 30800 23744 0 -1 4202496 4405 1255 0 0 8 0 0 0 22 0 1 0 654659697 25677824 4293 33554432000 4194304 4417452 140735405857280 18446744073709551615 254500691712 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/30800/statm: 6269 4293 149 55 0 4155 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 25076

[startup+0.300796 s]
/proc/loadavg: 7.42 7.95 8.04 3/350 30800
/proc/meminfo: memFree=24098980/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=78700 CPUtime=0.32 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 8009 1255 0 0 31 1 0 0 23 0 5 0 654659697 80588800 7472 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 19675 7472 158 55 0 17561 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 78700

[startup+0.700717 s]
/proc/loadavg: 7.42 7.95 8.04 3/350 30800
/proc/meminfo: memFree=24098980/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=83364 CPUtime=1.91 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 13347 1255 0 0 190 1 0 0 23 0 5 0 654659697 85364736 8623 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 20841 8623 175 55 0 18727 0
Current children cumulated CPU time (s) 1.91
Current children cumulated vsize (KiB) 83364

[startup+1.50056 s]
/proc/loadavg: 7.46 7.95 8.04 9/359 30814
/proc/meminfo: memFree=24047700/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=149552 CPUtime=5.1 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 17746 1255 0 0 508 2 0 0 23 0 5 0 654659697 153141248 8819 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 37388 8819 175 55 0 35274 0
[pid=30800/tid=30811] ppid=30798 vsize=149552 CPUtime=1.2 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 3220 1255 0 0 120 0 0 0 25 0 5 0 654659726 153141248 8819 33554432000 4194304 4417452 140735405857280 18446744073709551615 4302131 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=149552 CPUtime=1.2 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 3572 1255 0 0 120 0 0 0 25 0 5 0 654659726 153141248 8819 33554432000 4194304 4417452 140735405857280 18446744073709551615 4306602 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=149552 CPUtime=1.2 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 2422 1255 0 0 120 0 0 0 19 0 5 0 654659726 153141248 8819 33554432000 4194304 4417452 140735405857280 18446744073709551615 4283504 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=149552 CPUtime=1.19 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 531 1255 0 0 119 0 0 0 25 0 5 0 654659726 153141248 8819 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364805 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.1
Current children cumulated vsize (KiB) 149552

[startup+3.10023 s]
/proc/loadavg: 7.46 7.95 8.04 10/359 30814
/proc/meminfo: memFree=24031952/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=163608 CPUtime=11.49 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 24979 1255 0 0 1146 3 0 0 23 0 5 0 654659697 167534592 12350 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 40902 12350 180 55 0 38788 0
[pid=30800/tid=30811] ppid=30798 vsize=163608 CPUtime=2.8 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 5430 1255 0 0 280 0 0 0 25 0 5 0 654659726 167534592 12350 33554432000 4194304 4417452 140735405857280 18446744073709551615 4253176 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=163608 CPUtime=2.8 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 7224 1255 0 0 280 0 0 0 25 0 5 0 654659726 167534592 12350 33554432000 4194304 4417452 140735405857280 18446744073709551615 4252431 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=163608 CPUtime=2.8 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 3793 1255 0 0 280 0 0 0 23 0 5 0 654659726 167534592 12350 33554432000 4194304 4417452 140735405857280 18446744073709551615 4337287 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=163608 CPUtime=2.78 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 531 1255 0 0 278 0 0 0 25 0 5 0 654659726 167534592 12350 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364576 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.49
Current children cumulated vsize (KiB) 163608

[startup+6.3006 s]
/proc/loadavg: 7.46 7.95 8.04 10/359 30814
/proc/meminfo: memFree=24026616/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=166948 CPUtime=24.26 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 25814 1255 0 0 2423 3 0 0 23 0 5 0 654659697 170954752 13185 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 41737 13185 180 55 0 39623 0
[pid=30800/tid=30811] ppid=30798 vsize=166948 CPUtime=6 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 5634 1255 0 0 600 0 0 0 25 0 5 0 654659726 170954752 13185 33554432000 4194304 4417452 140735405857280 18446744073709551615 4236008 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=166948 CPUtime=5.99 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 7428 1255 0 0 599 0 0 0 25 0 5 0 654659726 170954752 13185 33554432000 4194304 4417452 140735405857280 18446744073709551615 4273486 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=166948 CPUtime=6 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 4220 1255 0 0 600 0 0 0 25 0 5 0 654659726 170954752 13185 33554432000 4194304 4417452 140735405857280 18446744073709551615 4377023 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=166948 CPUtime=5.95 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 531 1255 0 0 595 0 0 0 25 0 5 0 654659726 170954752 13185 33554432000 4194304 4417452 140735405857280 18446744073709551615 4232783 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.26
Current children cumulated vsize (KiB) 166948

[startup+12.7003 s]
/proc/loadavg: 7.55 7.95 8.04 10/359 30814
/proc/meminfo: memFree=24009440/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=174276 CPUtime=49.78 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 27652 1255 0 0 4975 3 0 0 23 0 5 0 654659697 178458624 15017 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 43569 15017 180 55 0 41455 0
[pid=30800/tid=30811] ppid=30798 vsize=174276 CPUtime=12.4 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 6041 1255 0 0 1240 0 0 0 25 0 5 0 654659726 178458624 15017 33554432000 4194304 4417452 140735405857280 18446744073709551615 4232598 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=174276 CPUtime=12.39 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 7835 1255 0 0 1239 0 0 0 25 0 5 0 654659726 178458624 15017 33554432000 4194304 4417452 140735405857280 18446744073709551615 4232636 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=174276 CPUtime=12.4 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 4220 1255 0 0 1240 0 0 0 25 0 5 0 654659726 178458624 15017 33554432000 4194304 4417452 140735405857280 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=174276 CPUtime=12.27 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 1555 1255 0 0 1227 0 0 0 25 0 5 0 654659726 178458624 15017 33554432000 4194304 4417452 140735405857280 18446744073709551615 4232648 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 49.78
Current children cumulated vsize (KiB) 174276

[startup+25.5008 s]
/proc/loadavg: 7.61 7.95 8.03 10/359 30814
/proc/meminfo: memFree=23987988/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=184420 CPUtime=100.83 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 30219 1255 0 0 10080 3 0 0 23 0 5 0 654659697 188846080 17553 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 46105 17553 180 55 0 43991 0
[pid=30800/tid=30811] ppid=30798 vsize=184420 CPUtime=25.2 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 6091 1255 0 0 2520 0 0 0 25 0 5 0 654659726 188846080 17553 33554432000 4194304 4417452 140735405857280 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=184420 CPUtime=25.19 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 7848 1255 0 0 2519 0 0 0 25 0 5 0 654659726 188846080 17553 33554432000 4194304 4417452 140735405857280 18446744073709551615 4232566 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=184420 CPUtime=25.2 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 4220 1255 0 0 2520 0 0 0 25 0 5 0 654659726 188846080 17553 33554432000 4194304 4417452 140735405857280 18446744073709551615 4277571 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=184420 CPUtime=24.93 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 4059 1255 0 0 2493 0 0 0 25 0 5 0 654659726 188846080 17553 33554432000 4194304 4417452 140735405857280 18446744073709551615 4357013 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 100.83
Current children cumulated vsize (KiB) 184420

[startup+51.1007 s]
/proc/loadavg: 7.81 7.97 8.04 10/359 30815
/proc/meminfo: memFree=23927740/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=202788 CPUtime=202.96 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 57157 1255 0 0 20289 7 0 0 23 0 5 0 654659697 207654912 23072 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 50697 23072 180 55 0 48583 0
[pid=30800/tid=30811] ppid=30798 vsize=202788 CPUtime=50.8 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 7743 1255 0 0 5080 0 0 0 25 0 5 0 654659726 207654912 23072 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=202788 CPUtime=50.78 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 8624 1255 0 0 5078 0 0 0 25 0 5 0 654659726 207654912 23072 33554432000 4194304 4417452 140735405857280 18446744073709551615 4358106 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=202788 CPUtime=50.8 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 6343 1255 0 0 5080 0 0 0 25 0 5 0 654659726 207654912 23072 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=202788 CPUtime=50.25 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 26446 1255 0 0 5022 3 0 0 25 0 5 0 654659726 207654912 23072 33554432000 4194304 4417452 140735405857280 18446744073709551615 4356852 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 202.96
Current children cumulated vsize (KiB) 202788

[startup+102.313 s]
/proc/loadavg: 7.98 7.99 8.04 9/359 30816
/proc/meminfo: memFree=23818836/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=293248 CPUtime=407.25 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 127513 1255 0 0 40708 17 0 0 23 0 5 0 654659697 300285952 44766 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 73312 44766 180 55 0 71198 0
[pid=30800/tid=30811] ppid=30798 vsize=293248 CPUtime=102.02 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 9545 1255 0 0 10201 1 0 0 25 0 5 0 654659726 300285952 44766 33554432000 4194304 4417452 140735405857280 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=293248 CPUtime=102 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 11110 1255 0 0 10199 1 0 0 25 0 5 0 654659726 300285952 44766 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=293248 CPUtime=102.01 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 8386 1255 0 0 10201 0 0 0 25 0 5 0 654659726 300285952 44766 33554432000 4194304 4417452 140735405857280 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=293248 CPUtime=100.9 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 90471 1255 0 0 10078 12 0 0 25 0 5 0 654659726 300285952 44766 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 407.25
Current children cumulated vsize (KiB) 293248

[startup+162.301 s]
/proc/loadavg: 8.06 8.00 8.04 10/359 30818
/proc/meminfo: memFree=23680540/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=449428 CPUtime=646.54 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 199103 1255 0 0 64626 28 0 0 23 0 5 0 654659697 460214272 83811 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 112357 83811 180 55 0 110243 0
[pid=30800/tid=30811] ppid=30798 vsize=449428 CPUtime=162 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 16236 1255 0 0 16199 1 0 0 25 0 5 0 654659726 460214272 83811 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=449428 CPUtime=161.96 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 19827 1255 0 0 16194 2 0 0 25 0 5 0 654659726 460214272 83811 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=449428 CPUtime=162 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 12814 1255 0 0 16199 1 0 0 25 0 5 0 654659726 460214272 83811 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=449428 CPUtime=160.24 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 142225 1255 0 0 16004 20 0 0 25 0 5 0 654659726 460214272 83811 33554432000 4194304 4417452 140735405857280 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 646.54
Current children cumulated vsize (KiB) 449428


################
# More data... #
################

[pid=30800/tid=30812] ppid=30798 vsize=1989552 CPUtime=701.87 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 110673 1255 0 0 70175 12 0 0 25 0 5 0 654659726 2037301248 468764 33554432000 4194304 4417452 140735405857280 18446744073709551615 4309221 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=1989552 CPUtime=702.03 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 94943 1255 0 0 70191 12 0 0 25 0 5 0 654659726 2037301248 468764 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=1989552 CPUtime=694.38 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 519174 1255 0 0 69357 81 0 0 25 0 5 0 654659726 2037301248 468764 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2800.61
Current children cumulated vsize (KiB) 1989552

[startup+762.313 s]
/proc/loadavg: 8.10 8.09 8.05 10/359 30834
/proc/meminfo: memFree=21777388/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=2218012 CPUtime=3040 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 896239 1255 0 0 303871 129 0 0 23 0 5 0 654659697 2271244288 525755 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 554503 525755 180 55 0 552389 0
[pid=30800/tid=30811] ppid=30798 vsize=2218012 CPUtime=762.04 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 89299 1255 0 0 76192 12 0 0 25 0 5 0 654659726 2271244288 525755 33554432000 4194304 4417452 140735405857280 18446744073709551615 4251160 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=2218012 CPUtime=761.88 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 165387 1255 0 0 76170 18 0 0 25 0 5 0 654659726 2271244288 525755 33554432000 4194304 4417452 140735405857280 18446744073709551615 4357902 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=2218012 CPUtime=762.05 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 103156 1255 0 0 76191 14 0 0 25 0 5 0 654659726 2271244288 525755 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=2218012 CPUtime=753.73 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 530396 1255 0 0 75290 83 0 0 25 0 5 0 654659726 2271244288 525755 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3040
Current children cumulated vsize (KiB) 2218012

[startup+822.3 s]
/proc/loadavg: 8.21 8.13 8.06 9/359 30836
/proc/meminfo: memFree=21363936/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=2570088 CPUtime=3279.3 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 991324 1255 0 0 327788 142 0 0 23 0 5 0 654659697 2631770112 613795 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 642522 613795 180 55 0 640408 0
[pid=30800/tid=30811] ppid=30798 vsize=2570088 CPUtime=822.02 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 144883 1255 0 0 82184 18 0 0 25 0 5 0 654659726 2631770112 613795 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=2570088 CPUtime=821.85 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 173579 1255 0 0 82166 19 0 0 25 0 5 0 654659726 2631770112 613795 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=2570088 CPUtime=822.03 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 118081 1255 0 0 82188 15 0 0 25 0 5 0 654659726 2631770112 613795 33554432000 4194304 4417452 140735405857280 18446744073709551615 4270130 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=2570088 CPUtime=813.07 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 546780 1255 0 0 81221 86 0 0 25 0 5 0 654659726 2631770112 613795 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3279.3
Current children cumulated vsize (KiB) 2570088

[startup+882.3 s]
/proc/loadavg: 8.08 8.10 8.06 10/359 30837
/proc/meminfo: memFree=20825616/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=3177440 CPUtime=3518.63 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 1151358 1255 0 0 351697 166 0 0 23 0 5 0 654659697 3253698560 765636 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 794360 765636 180 55 0 792246 0
[pid=30800/tid=30811] ppid=30798 vsize=3177440 CPUtime=882.02 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 144883 1255 0 0 88183 19 0 0 25 0 5 0 654659726 3253698560 765636 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=3177440 CPUtime=881.84 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 202051 1255 0 0 88159 25 0 0 25 0 5 0 654659726 3253698560 765636 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=3177440 CPUtime=882.04 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 208035 1255 0 0 88179 25 0 0 25 0 5 0 654659726 3253698560 765636 33554432000 4194304 4417452 140735405857280 18446744073709551615 4308488 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=3177440 CPUtime=872.41 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 588388 1255 0 0 87147 94 0 0 25 0 5 0 654659726 3253698560 765636 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364597 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3518.63
Current children cumulated vsize (KiB) 3177440

[startup+942.3 s]
/proc/loadavg: 8.03 8.08 8.05 9/359 30839
/proc/meminfo: memFree=21669896/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=2242756 CPUtime=3757.98 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 1336544 1255 0 0 375597 201 0 0 23 0 5 0 654659697 2296582144 532012 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 560689 532012 180 55 0 558575 0
[pid=30800/tid=30811] ppid=30798 vsize=2242756 CPUtime=942.03 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 157014 1255 0 0 94182 21 0 0 25 0 5 0 654659726 2296582144 532012 33554432000 4194304 4417452 140735405857280 18446744073709551615 4255643 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=2242756 CPUtime=941.82 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 291364 1255 0 0 94140 42 0 0 25 0 5 0 654659726 2296582144 532012 33554432000 4194304 4417452 140735405857280 18446744073709551615 4366043 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=2242756 CPUtime=942.05 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 255799 1255 0 0 94171 34 0 0 25 0 5 0 654659726 2296582144 532012 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=2242756 CPUtime=931.77 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 624366 1255 0 0 93076 101 0 0 25 0 5 0 654659726 2296582144 532012 33554432000 4194304 4417452 140735405857280 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3757.98
Current children cumulated vsize (KiB) 2242756

[startup+1002.3 s]
/proc/loadavg: 8.01 8.06 8.05 10/359 30840
/proc/meminfo: memFree=22051036/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=1936548 CPUtime=3997.32 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 1426784 1255 0 0 399515 217 0 0 23 0 5 0 654659697 1983025152 455460 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 484137 455460 180 55 0 482023 0
[pid=30800/tid=30811] ppid=30798 vsize=1936548 CPUtime=1002.03 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 199746 1255 0 0 100174 29 0 0 25 0 5 0 654659726 1983025152 455460 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=1936548 CPUtime=1001.82 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 299326 1255 0 0 100139 43 0 0 25 0 5 0 654659726 1983025152 455460 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=1936548 CPUtime=1002.05 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 256659 1255 0 0 100170 35 0 0 25 0 5 0 654659726 1983025152 455460 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=1936548 CPUtime=991.11 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 663052 1255 0 0 99004 107 0 0 25 0 5 0 654659726 1983025152 455460 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3997.32
Current children cumulated vsize (KiB) 1936548

[startup+1062.3 s]
/proc/loadavg: 8.06 8.06 8.05 9/359 30842
/proc/meminfo: memFree=21926992/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=2039304 CPUtime=4236.67 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 1460877 1255 0 0 423444 223 0 0 23 0 5 0 654659697 2088247296 481159 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 509826 481159 180 55 0 507712 0
[pid=30800/tid=30811] ppid=30798 vsize=2039304 CPUtime=1062.03 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 200814 1255 0 0 106174 29 0 0 25 0 5 0 654659726 2088247296 481159 33554432000 4194304 4417452 140735405857280 18446744073709551615 4265437 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=2039304 CPUtime=1061.8 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 300442 1255 0 0 106137 43 0 0 25 0 5 0 654659726 2088247296 481159 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=2039304 CPUtime=1062.04 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 258390 1255 0 0 106169 35 0 0 25 0 5 0 654659726 2088247296 481159 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=2039304 CPUtime=1050.47 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 693230 1255 0 0 104935 112 0 0 25 0 5 0 654659726 2088247296 481159 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4236.67
Current children cumulated vsize (KiB) 2039304

[startup+1122.3 s]
/proc/loadavg: 8.07 8.06 8.04 10/359 30844
/proc/meminfo: memFree=21854656/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=2149284 CPUtime=4476 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 1504964 1255 0 0 447372 228 0 0 23 0 5 0 654659697 2200866816 508654 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 537321 508654 180 55 0 535207 0
[pid=30800/tid=30811] ppid=30798 vsize=2149284 CPUtime=1122.04 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 202238 1255 0 0 112174 30 0 0 25 0 5 0 654659726 2200866816 508654 33554432000 4194304 4417452 140735405857280 18446744073709551615 4263077 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=2149284 CPUtime=1121.8 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 310865 1255 0 0 112135 45 0 0 25 0 5 0 654659726 2200866816 508654 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=2149284 CPUtime=1122.05 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 266582 1255 0 0 112169 36 0 0 25 0 5 0 654659726 2200866816 508654 33554432000 4194304 4417452 140735405857280 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=2149284 CPUtime=1109.81 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 717278 1255 0 0 110866 115 0 0 25 0 5 0 654659726 2200866816 508654 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4476
Current children cumulated vsize (KiB) 2149284

[startup+1182.3 s]
/proc/loadavg: 8.02 8.05 8.04 10/359 30845
/proc/meminfo: memFree=21563844/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=2398372 CPUtime=4715.36 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 1592898 1255 0 0 471294 242 0 0 23 0 5 0 654659697 2455932928 570962 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 599593 570962 180 55 0 597479 0
[pid=30800/tid=30811] ppid=30798 vsize=2398372 CPUtime=1182.04 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 213279 1255 0 0 118173 31 0 0 25 0 5 0 654659726 2455932928 570962 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=2398372 CPUtime=1181.79 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 339596 1255 0 0 118131 48 0 0 25 0 5 0 654659726 2455932928 570962 33554432000 4194304 4417452 140735405857280 18446744073709551615 4237371 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=2398372 CPUtime=1182.06 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 284352 1255 0 0 118167 39 0 0 25 0 5 0 654659726 2455932928 570962 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=2398372 CPUtime=1169.16 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 747670 1255 0 0 116795 121 0 0 25 0 5 0 654659726 2455932928 570962 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4715.36
Current children cumulated vsize (KiB) 2398372



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.6 s]
/proc/loadavg: 8.02 8.05 8.04 5/353 30847
/proc/meminfo: memFree=21818216/32950928 swapFree=45937192/67111528
[pid=30800] ppid=30798 vsize=2398428 CPUtime=4800.35 cores=0,2,4,6
/proc/30800/stat : 30800 (plingeling) S 30798 30800 23744 0 -1 4202496 1592914 1255 0 0 479793 242 0 0 23 0 5 0 654659697 2455990272 570976 33554432000 4194304 4417452 140735405857280 18446744073709551615 254512494565 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/30800/statm: 599607 570976 180 55 0 597493 0
[pid=30800/tid=30811] ppid=30798 vsize=2398428 CPUtime=1203.35 cores=0,2,4,6
/proc/30800/task/30811/stat : 30811 (plingeling) R 30798 30800 23744 0 -1 4202560 213295 1255 0 0 120304 31 0 0 25 0 5 0 654659726 2455990272 570976 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30800/tid=30812] ppid=30798 vsize=2398428 CPUtime=1203.09 cores=0,2,4,6
/proc/30800/task/30812/stat : 30812 (plingeling) R 30798 30800 23744 0 -1 4202560 339596 1255 0 0 120261 48 0 0 25 0 5 0 654659726 2455990272 570976 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30800/tid=30813] ppid=30798 vsize=2398428 CPUtime=1203.37 cores=0,2,4,6
/proc/30800/task/30813/stat : 30813 (plingeling) R 30798 30800 23744 0 -1 4202560 284352 1255 0 0 120298 39 0 0 25 0 5 0 654659726 2455990272 570976 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30800/tid=30814] ppid=30798 vsize=2398428 CPUtime=1190.22 cores=0,2,4,6
/proc/30800/task/30814/stat : 30814 (plingeling) R 30798 30800 23744 0 -1 4202560 747670 1255 0 0 118901 121 0 0 25 0 5 0 654659726 2455990272 570976 33554432000 4194304 4417452 140735405857280 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 2398428

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.71
CPU time (s): 4800.48
CPU user time (s): 4797.96
CPU system time (s): 2.51362
CPU usage (%): 398.808
Max. virtual memory (cumulated for all children) (KiB): 3248856

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.96
system time used= 2.51362
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1594169
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 115
involuntary context switches= 25728

runsolver used 3.76143 second user time and 9.39357 second system time

The end

Launcher Data 

Begin job on node149 at 2011-05-15 05:37:10
IDJOB=3371423
IDBENCH=84223
IDSOLVER=1848
FILE ID=node149/3371423-1305430630
RUNJOBID= node149-1305430630-30775
PBS_JOBID= 13324600
Free space on /tmp= 73616 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT03/industrial/li/li-exam/li-exam-61.shuffled-as.sat03-366.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371423-1305430630/watcher-3371423-1305430630 -o /tmp/evaluation-result-3371423-1305430630/solver-3371423-1305430630 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371423-1305430630.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3be662940f394fa876137a905247d755
RANDOM SEED=262928565

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      24099136 kB
Buffers:        316364 kB
Cached:        3892448 kB
SwapCached:      19984 kB
Active:        6337216 kB
Inactive:      2219712 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      24099136 kB
SwapTotal:    67111528 kB
SwapFree:     45937192 kB
Dirty:            4448 kB
Writeback:           0 kB
AnonPages:     4341288 kB
Mapped:          13992 kB
Slab:           157240 kB
PageTables:      72516 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 80221112 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73620 MiB
End job on node149 at 2011-05-15 05:57:16