Trace number 3265466

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.27 1202.86

General information on the benchmark

NameSAT05/crafted/lynce05/social-golfer-problem/
sgp_5-6-8.shuffled-as.sat05-2669.cnf
MD5SUM4229175ff4382a4625ce92a19d20dde4
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark135.322
Satisfiable
(Un)Satisfiability was proved
Number of variables58560
Number of clauses778800
Sum of the clauses size1766280
Maximum clause length48
Minimum clause length1
Number of clauses of size 196
Number of clauses of size 2599208
Number of clauses of size 3177096
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52400

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3265466-1304106645/watcher-3265466-1304106645 -o /tmp/evaluation-result-3265466-1304106645/solver-3265466-1304106645 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3265466-1304106645.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.53 7.94 7.97 5/181 20797
/proc/meminfo: memFree=28124316/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=14028 CPUtime=0 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) R 20795 20797 19850 0 -1 4202496 1600 1262 0 0 0 0 0 0 25 0 1 0 522266903 14364672 1530 33554432000 4194304 4417332 140736223086448 18446744073709551615 212435710947 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20797/statm: 3507 1530 148 55 0 1393 0

[startup+0.036667 s]
/proc/loadavg: 7.53 7.94 7.97 5/181 20797
/proc/meminfo: memFree=28124316/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=22152 CPUtime=0.03 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) R 20795 20797 19850 0 -1 4202496 3647 1262 0 0 3 0 0 0 25 0 1 0 522266903 22683648 3561 33554432000 4194304 4417332 140736223086448 18446744073709551615 212436016896 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20797/statm: 5538 3561 148 55 0 3424 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 22152

[startup+0.100653 s]
/proc/loadavg: 7.53 7.94 7.97 5/181 20797
/proc/meminfo: memFree=28124316/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=25224 CPUtime=0.09 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) R 20795 20797 19850 0 -1 4202496 4415 1262 0 0 9 0 0 0 25 0 1 0 522266903 25829376 4329 33554432000 4194304 4417332 140736223086448 18446744073709551615 212436016896 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20797/statm: 6306 4329 148 55 0 4192 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25224

[startup+0.300615 s]
/proc/loadavg: 7.53 7.94 7.97 5/181 20797
/proc/meminfo: memFree=28124316/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=44812 CPUtime=0.29 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) R 20795 20797 19850 0 -1 4202496 9314 1262 0 0 28 1 0 0 25 0 1 0 522266903 45887488 9226 33554432000 4194304 4417332 140736223086448 18446744073709551615 4259780 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20797/statm: 11203 9226 148 55 0 9089 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 44812

[startup+0.70054 s]
/proc/loadavg: 7.53 7.94 7.97 5/181 20797
/proc/meminfo: memFree=28124316/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=61784 CPUtime=0.68 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) R 20795 20797 19850 0 -1 4202496 13557 1262 0 0 67 1 0 0 25 0 1 0 522266903 63266816 13469 33554432000 4194304 4417332 140736223086448 18446744073709551615 4209679 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/20797/statm: 15446 13469 148 55 0 13332 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 61784

[startup+1.50035 s]
/proc/loadavg: 7.53 7.94 7.97 6/182 20803
/proc/meminfo: memFree=28037872/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=136456 CPUtime=1.51 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 22399 1262 0 0 148 3 0 0 25 0 5 0 522266903 139730944 21910 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 34114 21910 157 55 0 32000 0
Current children cumulated CPU time (s) 1.51
Current children cumulated vsize (KiB) 136456

[startup+3.10104 s]
/proc/loadavg: 7.53 7.94 7.97 10/186 20807
/proc/meminfo: memFree=28030276/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=146276 CPUtime=7.91 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 30374 1262 0 0 787 4 0 0 25 0 5 0 522266903 149786624 24177 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 36569 24177 175 55 0 34455 0
[pid=20797/tid=20804] ppid=20795 vsize=146276 CPUtime=1.61 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 1378 1262 0 0 161 0 0 0 20 0 5 0 522267052 149786624 24177 33554432000 4194304 4417332 140736223086448 18446744073709551615 4290595 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=146276 CPUtime=1.59 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 1924 1262 0 0 159 0 0 0 25 0 5 0 522267052 149786624 24177 33554432000 4194304 4417332 140736223086448 18446744073709551615 4284732 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=146276 CPUtime=1.6 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 1338 1262 0 0 160 0 0 0 20 0 5 0 522267052 149786624 24177 33554432000 4194304 4417332 140736223086448 18446744073709551615 4287187 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=146276 CPUtime=1.6 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 3941 1262 0 0 160 0 0 0 20 0 5 0 522267052 149786624 24177 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 7.91
Current children cumulated vsize (KiB) 146276

[startup+6.30044 s]
/proc/loadavg: 7.56 7.94 7.97 9/186 20807
/proc/meminfo: memFree=28020264/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=154160 CPUtime=20.68 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 50470 1262 0 0 2062 6 0 0 25 0 5 0 522266903 157859840 26338 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 38540 26338 181 55 0 36426 0
[pid=20797/tid=20804] ppid=20795 vsize=154160 CPUtime=4.8 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 7453 1262 0 0 480 0 0 0 25 0 5 0 522267052 157859840 26338 33554432000 4194304 4417332 140736223086448 18446744073709551615 4249976 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=154160 CPUtime=4.77 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 8945 1262 0 0 476 1 0 0 25 0 5 0 522267052 157859840 26338 33554432000 4194304 4417332 140736223086448 18446744073709551615 4249978 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=154160 CPUtime=4.8 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 6720 1262 0 0 480 0 0 0 25 0 5 0 522267052 157859840 26338 33554432000 4194304 4417332 140736223086448 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=154160 CPUtime=4.79 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 5559 1262 0 0 479 0 0 0 25 0 5 0 522267052 157859840 26338 33554432000 4194304 4417332 140736223086448 18446744073709551615 4322015 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 20.68
Current children cumulated vsize (KiB) 154160

[startup+12.7002 s]
/proc/loadavg: 7.60 7.94 7.97 9/186 20807
/proc/meminfo: memFree=27970780/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=192552 CPUtime=46.24 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 60634 1262 0 0 4616 8 0 0 25 0 5 0 522266903 197173248 35936 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 48138 35936 181 55 0 46024 0
[pid=20797/tid=20804] ppid=20795 vsize=192552 CPUtime=11.19 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 8923 1262 0 0 1119 0 0 0 25 0 5 0 522267052 197173248 35936 33554432000 4194304 4417332 140736223086448 18446744073709551615 4252951 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=192552 CPUtime=11.13 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 11014 1262 0 0 1112 1 0 0 25 0 5 0 522267052 197173248 35936 33554432000 4194304 4417332 140736223086448 18446744073709551615 4310462 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=192552 CPUtime=11.2 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 10454 1262 0 0 1119 1 0 0 25 0 5 0 522267052 197173248 35936 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=192552 CPUtime=11.2 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 8450 1262 0 0 1119 1 0 0 25 0 5 0 522267052 197173248 35936 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 46.24
Current children cumulated vsize (KiB) 192552

[startup+25.5008 s]
/proc/loadavg: 7.69 7.94 7.97 9/186 20808
/proc/meminfo: memFree=28036124/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=289668 CPUtime=97.37 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 69038 1262 0 0 9728 9 0 0 25 0 5 0 522266903 296620032 43837 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 72417 43837 181 55 0 70303 0
[pid=20797/tid=20804] ppid=20795 vsize=289668 CPUtime=24 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 10896 1262 0 0 2399 1 0 0 25 0 5 0 522267052 296620032 43837 33554432000 4194304 4417332 140736223086448 18446744073709551615 4254977 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=289668 CPUtime=23.86 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 13283 1262 0 0 2385 1 0 0 25 0 5 0 522267052 296620032 43837 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=289668 CPUtime=24 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 10566 1262 0 0 2399 1 0 0 25 0 5 0 522267052 296620032 43837 33554432000 4194304 4417332 140736223086448 18446744073709551615 4236845 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=289668 CPUtime=23.99 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 12500 1262 0 0 2398 1 0 0 25 0 5 0 522267052 296620032 43837 33554432000 4194304 4417332 140736223086448 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 97.37
Current children cumulated vsize (KiB) 289668

[startup+51.1009 s]
/proc/loadavg: 7.79 7.95 7.97 9/186 20808
/proc/meminfo: memFree=27846404/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=335236 CPUtime=199.63 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 86031 1262 0 0 19952 11 0 0 25 0 5 0 522266903 343281664 55229 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 83809 55229 181 55 0 81695 0
[pid=20797/tid=20804] ppid=20795 vsize=335236 CPUtime=49.6 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 16160 1262 0 0 4959 1 0 0 25 0 5 0 522267052 343281664 55229 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=335236 CPUtime=49.32 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 13659 1262 0 0 4931 1 0 0 25 0 5 0 522267052 343281664 55229 33554432000 4194304 4417332 140736223086448 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=335236 CPUtime=49.6 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 13142 1262 0 0 4959 1 0 0 25 0 5 0 522267052 343281664 55229 33554432000 4194304 4417332 140736223086448 18446744073709551615 4232629 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=335236 CPUtime=49.59 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 21277 1262 0 0 4957 2 0 0 25 0 5 0 522267052 343281664 55229 33554432000 4194304 4417332 140736223086448 18446744073709551615 4320992 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 199.63
Current children cumulated vsize (KiB) 335236

[startup+102.307 s]
/proc/loadavg: 7.91 7.95 7.97 9/186 20810
/proc/meminfo: memFree=27491184/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=374216 CPUtime=404.17 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 136852 1262 0 0 40399 18 0 0 25 0 5 0 522266903 383197184 65006 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 93554 65006 181 55 0 91440 0
[pid=20797/tid=20804] ppid=20795 vsize=374216 CPUtime=100.8 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 25760 1262 0 0 10078 2 0 0 25 0 5 0 522267052 383197184 65006 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=374216 CPUtime=100.23 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 24008 1262 0 0 10020 3 0 0 25 0 5 0 522267052 383197184 65006 33554432000 4194304 4417332 140736223086448 18446744073709551615 4265405 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=374216 CPUtime=100.81 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 25301 1262 0 0 10078 3 0 0 25 0 5 0 522267052 383197184 65006 33554432000 4194304 4417332 140736223086448 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=374216 CPUtime=100.81 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 39990 1262 0 0 10076 5 0 0 25 0 5 0 522267052 383197184 65006 33554432000 4194304 4417332 140736223086448 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 404.17
Current children cumulated vsize (KiB) 374216

[startup+162.301 s]
/proc/loadavg: 8.01 7.97 7.98 9/186 20811
/proc/meminfo: memFree=27733936/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=497160 CPUtime=643.83 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 225370 1262 0 0 64354 29 0 0 25 0 5 0 522266903 509091840 95742 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 124290 95742 181 55 0 122176 0
[pid=20797/tid=20804] ppid=20795 vsize=497160 CPUtime=160.8 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 44799 1262 0 0 16076 4 0 0 25 0 5 0 522267052 509091840 95742 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=497160 CPUtime=159.9 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 44333 1262 0 0 15984 6 0 0 25 0 5 0 522267052 509091840 95742 33554432000 4194304 4417332 140736223086448 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=497160 CPUtime=160.8 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 41220 1262 0 0 16076 4 0 0 25 0 5 0 522267052 509091840 95742 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=497160 CPUtime=160.81 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 73225 1262 0 0 16071 10 0 0 25 0 5 0 522267052 509091840 95742 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 643.83
Current children cumulated vsize (KiB) 497160

[startup+222.3 s]
/proc/loadavg: 8.08 7.99 7.98 9/186 20886
/proc/meminfo: memFree=30109244/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=476708 CPUtime=883.5 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 295455 1262 0 0 88311 39 0 0 25 0 5 0 522266903 488148992 90629 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 119177 90629 181 55 0 117063 0
[pid=20797/tid=20804] ppid=20795 vsize=476708 CPUtime=220.8 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 57101 1262 0 0 22074 6 0 0 25 0 5 0 522267052 488148992 90629 33554432000 4194304 4417332 140736223086448 18446744073709551615 4366011 0 0 4096 17442 0 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=20797/tid=20805] ppid=20795 vsize=810044 CPUtime=696.92 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 250498 1262 0 0 69653 39 0 0 25 0 5 0 522267052 829485056 173963 33554432000 4194304 4417332 140736223086448 18446744073709551615 4252002 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=810044 CPUtime=700.81 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 390171 1262 0 0 70023 58 0 0 25 0 5 0 522267052 829485056 173963 33554432000 4194304 4417332 140736223086448 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=810044 CPUtime=700.82 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 226152 1262 0 0 70052 30 0 0 25 0 5 0 522267052 829485056 173963 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364614 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2800.88
Current children cumulated vsize (KiB) 810044

[startup+762.307 s]
/proc/loadavg: 8.01 8.05 8.00 9/186 20909
/proc/meminfo: memFree=29392200/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=826592 CPUtime=3040.58 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 1366155 1262 0 0 303858 200 0 0 25 0 5 0 522266903 846430208 178100 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 206648 178100 181 55 0 204534 0
[pid=20797/tid=20804] ppid=20795 vsize=826592 CPUtime=760.82 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 406904 1262 0 0 76024 58 0 0 25 0 5 0 522267052 846430208 178100 33554432000 4194304 4417332 140736223086448 18446744073709551615 4232584 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=826592 CPUtime=756.59 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 277736 1262 0 0 75616 43 0 0 25 0 5 0 522267052 846430208 178100 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=826592 CPUtime=760.81 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 422580 1262 0 0 76020 61 0 0 25 0 5 0 522267052 846430208 178100 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=826592 CPUtime=760.83 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 237142 1262 0 0 76051 32 0 0 25 0 5 0 522267052 846430208 178100 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3040.58
Current children cumulated vsize (KiB) 826592

[startup+822.3 s]
/proc/loadavg: 8.13 8.08 8.01 9/186 20914
/proc/meminfo: memFree=29419368/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=831604 CPUtime=3280.23 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 1467400 1262 0 0 327810 213 0 0 25 0 5 0 522266903 851562496 179353 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 207901 179353 181 55 0 205787 0
[pid=20797/tid=20804] ppid=20795 vsize=831604 CPUtime=820.82 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 445946 1262 0 0 82018 64 0 0 25 0 5 0 522267052 851562496 179353 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=831604 CPUtime=816.26 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 291960 1262 0 0 81581 45 0 0 25 0 5 0 522267052 851562496 179353 33554432000 4194304 4417332 140736223086448 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=831604 CPUtime=820.82 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 442849 1262 0 0 82017 65 0 0 25 0 5 0 522267052 851562496 179353 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=831604 CPUtime=820.82 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 264852 1262 0 0 82047 35 0 0 25 0 5 0 522267052 851562496 179353 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3280.23
Current children cumulated vsize (KiB) 831604

[startup+882.301 s]
/proc/loadavg: 8.08 8.08 8.01 9/186 20915
/proc/meminfo: memFree=29189184/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=995244 CPUtime=3519.91 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 1575164 1262 0 0 351763 228 0 0 25 0 5 0 522266903 1019129856 220263 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 248811 220263 181 55 0 246697 0
[pid=20797/tid=20804] ppid=20795 vsize=995244 CPUtime=880.82 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 475883 1262 0 0 88014 68 0 0 25 0 5 0 522267052 1019129856 220263 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=995244 CPUtime=875.93 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 331494 1262 0 0 87542 51 0 0 25 0 5 0 522267052 1019129856 220263 33554432000 4194304 4417332 140736223086448 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=995244 CPUtime=880.82 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 453053 1262 0 0 88016 66 0 0 25 0 5 0 522267052 1019129856 220263 33554432000 4194304 4417332 140736223086448 18446744073709551615 4357746 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=995244 CPUtime=880.83 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 292941 1262 0 0 88044 39 0 0 25 0 5 0 522267052 1019129856 220263 33554432000 4194304 4417332 140736223086448 18446744073709551615 4259889 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3519.91
Current children cumulated vsize (KiB) 995244

[startup+942.3 s]
/proc/loadavg: 8.21 8.11 8.02 9/186 20917
/proc/meminfo: memFree=29136920/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=985748 CPUtime=3759.58 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 1679705 1262 0 0 375714 244 0 0 25 0 5 0 522266903 1009405952 217889 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 246437 217889 181 55 0 244323 0
[pid=20797/tid=20804] ppid=20795 vsize=985748 CPUtime=940.82 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 497057 1262 0 0 94012 70 0 0 25 0 5 0 522267052 1009405952 217889 33554432000 4194304 4417332 140736223086448 18446744073709551615 4263180 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=985748 CPUtime=935.6 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 387201 1262 0 0 93499 61 0 0 25 0 5 0 522267052 1009405952 217889 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=985748 CPUtime=940.82 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 467253 1262 0 0 94014 68 0 0 25 0 5 0 522267052 1009405952 217889 33554432000 4194304 4417332 140736223086448 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=985748 CPUtime=940.83 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 306401 1262 0 0 94042 41 0 0 25 0 5 0 522267052 1009405952 217889 33554432000 4194304 4417332 140736223086448 18446744073709551615 4321262 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3759.58
Current children cumulated vsize (KiB) 985748

[startup+1002.3 s]
/proc/loadavg: 8.21 8.12 8.03 9/186 20919
/proc/meminfo: memFree=28936488/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=1184728 CPUtime=3999.25 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 1813136 1262 0 0 399665 260 0 0 25 0 5 0 522266903 1213161472 267633 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 296182 267633 181 55 0 294068 0
[pid=20797/tid=20804] ppid=20795 vsize=1184728 CPUtime=1000.82 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 508675 1262 0 0 100010 72 0 0 25 0 5 0 522267052 1213161472 267633 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=1184728 CPUtime=995.27 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 436226 1262 0 0 99460 67 0 0 25 0 5 0 522267052 1213161472 267633 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=1184728 CPUtime=1000.82 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 531741 1262 0 0 100007 75 0 0 25 0 5 0 522267052 1213161472 267633 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=1184728 CPUtime=1000.83 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 314701 1262 0 0 100041 42 0 0 25 0 5 0 522267052 1213161472 267633 33554432000 4194304 4417332 140736223086448 18446744073709551615 4365007 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3999.25
Current children cumulated vsize (KiB) 1184728

[startup+1062.3 s]
/proc/loadavg: 8.20 8.13 8.03 9/186 20920
/proc/meminfo: memFree=28973520/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=1174956 CPUtime=4238.94 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 1991170 1262 0 0 423609 285 0 0 25 0 5 0 522266903 1203154944 265191 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 293739 265191 181 55 0 291625 0
[pid=20797/tid=20804] ppid=20795 vsize=1174956 CPUtime=1060.82 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 569589 1262 0 0 106004 78 0 0 25 0 5 0 522267052 1203154944 265191 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=1174956 CPUtime=1054.94 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 475314 1262 0 0 105422 72 0 0 25 0 5 0 522267052 1203154944 265191 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=1174956 CPUtime=1060.82 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 597988 1262 0 0 105997 85 0 0 25 0 5 0 522267052 1203154944 265191 33554432000 4194304 4417332 140736223086448 18446744073709551615 4366775 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=1174956 CPUtime=1060.84 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 326486 1262 0 0 106040 44 0 0 25 0 5 0 522267052 1203154944 265191 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4238.94
Current children cumulated vsize (KiB) 1174956

[startup+1122.3 s]
/proc/loadavg: 8.12 8.11 8.03 9/186 20922
/proc/meminfo: memFree=28910128/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=1206908 CPUtime=4478.61 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 2135841 1262 0 0 447557 304 0 0 25 0 5 0 522266903 1235873792 273179 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 301727 273179 181 55 0 299613 0
[pid=20797/tid=20804] ppid=20795 vsize=1206908 CPUtime=1120.83 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 605050 1262 0 0 111999 84 0 0 25 0 5 0 522267052 1235873792 273179 33554432000 4194304 4417332 140736223086448 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=1206908 CPUtime=1114.61 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 545656 1262 0 0 111380 81 0 0 25 0 5 0 522267052 1235873792 273179 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=1206908 CPUtime=1120.83 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 636856 1262 0 0 111992 91 0 0 25 0 5 0 522267052 1235873792 273179 33554432000 4194304 4417332 140736223086448 18446744073709551615 4232584 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=1206908 CPUtime=1120.84 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 326486 1262 0 0 112040 44 0 0 25 0 5 0 522267052 1235873792 273179 33554432000 4194304 4417332 140736223086448 18446744073709551615 4365108 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4478.61
Current children cumulated vsize (KiB) 1206908

[startup+1182.3 s]
/proc/loadavg: 8.11 8.11 8.03 9/186 20923
/proc/meminfo: memFree=29071660/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=1126784 CPUtime=4718.29 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 2245248 1262 0 0 471509 320 0 0 25 0 5 0 522266903 1153826816 253148 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 281696 253148 181 55 0 279582 0
[pid=20797/tid=20804] ppid=20795 vsize=1126784 CPUtime=1180.83 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 649989 1262 0 0 117993 90 0 0 25 0 5 0 522267052 1153826816 253148 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=1126784 CPUtime=1174.28 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 582797 1262 0 0 117340 88 0 0 25 0 5 0 522267052 1153826816 253148 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=1126784 CPUtime=1180.82 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 664183 1262 0 0 117988 94 0 0 25 0 5 0 522267052 1153826816 253148 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=1126784 CPUtime=1180.84 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 326486 1262 0 0 118040 44 0 0 25 0 5 0 522267052 1153826816 253148 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4718.29
Current children cumulated vsize (KiB) 1126784



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.8 s]
/proc/loadavg: 8.08 8.10 8.03 9/186 20924
/proc/meminfo: memFree=28915276/32951124 swapFree=67111416/67111528
[pid=20797] ppid=20795 vsize=1184912 CPUtime=4800.19 cores=0,2,4,6
/proc/20797/stat : 20797 (plingeling) S 20795 20797 19850 0 -1 4202496 2292548 1262 0 0 479693 326 0 0 25 0 5 0 522266903 1213349888 267680 33554432000 4194304 4417332 140736223086448 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/20797/statm: 296228 267680 181 55 0 294114 0
[pid=20797/tid=20804] ppid=20795 vsize=1184912 CPUtime=1201.33 cores=0,2,4,6
/proc/20797/task/20804/stat : 20804 (plingeling) R 20795 20797 19850 0 -1 4202560 670633 1262 0 0 120041 92 0 0 25 0 5 0 522267052 1213349888 267680 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20797/tid=20805] ppid=20795 vsize=1184912 CPUtime=1194.67 cores=0,2,4,6
/proc/20797/task/20805/stat : 20805 (plingeling) R 20795 20797 19850 0 -1 4202560 593069 1262 0 0 119378 89 0 0 25 0 5 0 522267052 1213349888 267680 33554432000 4194304 4417332 140736223086448 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20797/tid=20806] ppid=20795 vsize=1184912 CPUtime=1201.34 cores=0,2,4,6
/proc/20797/task/20806/stat : 20806 (plingeling) R 20795 20797 19850 0 -1 4202560 680567 1262 0 0 120037 97 0 0 25 0 5 0 522267052 1213349888 267680 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20797/tid=20807] ppid=20795 vsize=1184912 CPUtime=1201.35 cores=0,2,4,6
/proc/20797/task/20807/stat : 20807 (plingeling) R 20795 20797 19850 0 -1 4202560 326486 1262 0 0 120091 44 0 0 25 0 5 0 522267052 1213349888 267680 33554432000 4194304 4417332 140736223086448 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 1184912

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.86
CPU time (s): 4800.27
CPU user time (s): 4796.96
CPU system time (s): 3.3155
CPU usage (%): 399.071
Max. virtual memory (cumulated for all children) (KiB): 1401100

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.96
system time used= 3.31549
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2293811
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 162
involuntary context switches= 23941

runsolver used 1.9657 second user time and 4.6073 second system time

The end

Launcher Data 

Begin job on node102 at 2011-04-29 21:50:46
IDJOB=3265466
IDBENCH=85640
IDSOLVER=1605
FILE ID=node102/3265466-1304106645
RUNJOBID= node102-1304105437-20555
PBS_JOBID= 13170630
Free space on /tmp= 71548 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT05/crafted/lynce05/social-golfer-problem/sgp_5-6-8.shuffled-as.sat05-2669.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3265466-1304106645/watcher-3265466-1304106645 -o /tmp/evaluation-result-3265466-1304106645/solver-3265466-1304106645 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3265466-1304106645.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4229175ff4382a4625ce92a19d20dde4
RANDOM SEED=1417002290

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28124596 kB
Buffers:        597212 kB
Cached:        1269288 kB
SwapCached:          0 kB
Active:        2608080 kB
Inactive:      1797576 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28124596 kB
SwapTotal:    67111528 kB
SwapFree:     67111416 kB
Dirty:           12636 kB
Writeback:           0 kB
AnonPages:     2539480 kB
Mapped:          15352 kB
Slab:           352240 kB
PageTables:       9908 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  2788224 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71548 MiB
End job on node102 at 2011-04-29 22:10:50