Trace number 3265906

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.15 1201.73

General information on the benchmark

NameSAT05/crafted/sorge05/QG7/
gensys-icl007.shuffled-as.sat05-3133.cnf
MD5SUM88361752c7b0c05e849791aafdd7bdba
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark220.275
Satisfiable
(Un)Satisfiability was proved
Number of variables762
Number of clauses17262
Sum of the clauses size76511
Maximum clause length13
Minimum clause length1
Number of clauses of size 142
Number of clauses of size 21135
Number of clauses of size 38742
Number of clauses of size 4236
Number of clauses of size 5256
Number of clauses of size over 56851

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3265906-1304107594/watcher-3265906-1304107594 -o /tmp/evaluation-result-3265906-1304107594/solver-3265906-1304107594 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3265906-1304107594.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.89 7.83 7.91 1/182 6289
/proc/meminfo: memFree=30256028/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=8728 CPUtime=0 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 215 0 0 0 0 0 0 0 21 0 1 0 600990128 8937472 146 33554432000 4194304 4417332 140733295110128 18446744073709551615 260905393920 0 0 4096 0 18446744071562362840 0 0 17 1 0 0 0
/proc/6289/statm: 2182 146 122 55 0 68 0

[startup+0.0376381 s]
/proc/loadavg: 6.89 7.83 7.91 1/182 6289
/proc/meminfo: memFree=30256028/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=8728 CPUtime=0 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 215 0 0 0 0 0 0 0 21 0 1 0 600990128 8937472 146 33554432000 4194304 4417332 140733295110128 18446744073709551615 260905393920 0 0 4096 0 18446744071562362840 0 0 17 1 0 0 0
/proc/6289/statm: 2182 146 122 55 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8728

[startup+0.197609 s]
/proc/loadavg: 6.89 7.83 7.91 1/182 6289
/proc/meminfo: memFree=30256028/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=121248 CPUtime=0.5 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 1880 1255 0 5 50 0 0 0 21 0 5 0 600990128 124157952 1747 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 30312 1747 181 55 0 28198 0
Current children cumulated CPU time (s) 0.5
Current children cumulated vsize (KiB) 121248

[startup+0.300589 s]
/proc/loadavg: 6.89 7.83 7.91 1/182 6289
/proc/meminfo: memFree=30256028/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=122040 CPUtime=0.91 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 2059 1255 0 5 91 0 0 0 21 0 5 0 600990128 124968960 1926 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 30510 1926 181 55 0 28396 0
Current children cumulated CPU time (s) 0.91
Current children cumulated vsize (KiB) 122040

[startup+0.700517 s]
/proc/loadavg: 6.89 7.83 7.91 1/182 6289
/proc/meminfo: memFree=30256028/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=123280 CPUtime=2.51 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 3550 1255 0 5 251 0 0 0 21 0 5 0 600990128 126238720 2277 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 30820 2277 181 55 0 28706 0
Current children cumulated CPU time (s) 2.51
Current children cumulated vsize (KiB) 123280

[startup+1.50037 s]
/proc/loadavg: 6.89 7.83 7.91 10/186 6339
/proc/meminfo: memFree=30236920/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=126736 CPUtime=5.71 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 7170 1255 0 5 570 1 0 0 21 0 5 0 600990128 129777664 3140 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 31684 3140 181 55 0 29570 0
[pid=6289/tid=6300] ppid=6287 vsize=126736 CPUtime=1.42 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 1450 1255 0 5 142 0 0 0 25 0 5 0 600990135 129777664 3140 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364529 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=126736 CPUtime=1.41 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 1517 1255 0 5 141 0 0 0 25 0 5 0 600990135 129777664 3140 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364664 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=126736 CPUtime=1.42 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 818 1255 0 5 142 0 0 0 25 0 5 0 600990135 129777664 3140 33554432000 4194304 4417332 140733295110128 18446744073709551615 4232566 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=126736 CPUtime=1.42 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 1722 1255 0 5 142 0 0 0 25 0 5 0 600990135 129777664 3140 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.71
Current children cumulated vsize (KiB) 126736

[startup+3.10108 s]
/proc/loadavg: 6.89 7.83 7.91 9/186 6339
/proc/meminfo: memFree=30227740/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=130900 CPUtime=12.11 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 20335 1255 0 5 1208 3 0 0 21 0 5 0 600990128 134041600 4156 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 32725 4156 181 55 0 30611 0
[pid=6289/tid=6300] ppid=6287 vsize=130900 CPUtime=3.01 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 5095 1255 0 5 301 0 0 0 25 0 5 0 600990135 134041600 4156 33554432000 4194304 4417332 140733295110128 18446744073709551615 4365986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=130900 CPUtime=3 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 6688 1255 0 5 300 0 0 0 25 0 5 0 600990135 134041600 4156 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=130900 CPUtime=3.01 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 3758 1255 0 5 301 0 0 0 25 0 5 0 600990135 134041600 4156 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=130900 CPUtime=3.02 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 3131 1255 0 5 302 0 0 0 25 0 5 0 600990135 134041600 4156 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.11
Current children cumulated vsize (KiB) 130900

[startup+6.30049 s]
/proc/loadavg: 6.98 7.83 7.91 9/186 6339
/proc/meminfo: memFree=30211992/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=142588 CPUtime=24.89 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 35511 1255 0 5 2484 5 0 0 21 0 5 0 600990128 146010112 7113 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 35647 7113 181 55 0 33533 0
[pid=6289/tid=6300] ppid=6287 vsize=142588 CPUtime=6.22 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 9199 1255 0 5 621 1 0 0 25 0 5 0 600990135 146010112 7113 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=142588 CPUtime=6.18 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 10615 1255 0 5 617 1 0 0 25 0 5 0 600990135 146010112 7113 33554432000 4194304 4417332 140733295110128 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=142588 CPUtime=6.22 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 8156 1255 0 5 621 1 0 0 25 0 5 0 600990135 146010112 7113 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=142588 CPUtime=6.21 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 5878 1255 0 5 621 0 0 0 25 0 5 0 600990135 146010112 7113 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364590 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.89
Current children cumulated vsize (KiB) 142588

[startup+12.7003 s]
/proc/loadavg: 7.06 7.83 7.91 9/186 6339
/proc/meminfo: memFree=30196132/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=155064 CPUtime=50.45 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 65076 1255 0 5 5035 10 0 0 21 0 5 0 600990128 158785536 10200 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 38766 10200 181 55 0 36652 0
[pid=6289/tid=6300] ppid=6287 vsize=155064 CPUtime=12.61 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 18672 1255 0 5 1259 2 0 0 25 0 5 0 600990135 158785536 10200 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=155064 CPUtime=12.55 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 23928 1255 0 5 1252 3 0 0 25 0 5 0 600990135 158785536 10200 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364512 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=155064 CPUtime=12.61 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 11117 1255 0 5 1260 1 0 0 25 0 5 0 600990135 158785536 10200 33554432000 4194304 4417332 140733295110128 18446744073709551615 4251160 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=155064 CPUtime=12.61 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 9696 1255 0 5 1260 1 0 0 25 0 5 0 600990135 158785536 10200 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.45
Current children cumulated vsize (KiB) 155064

[startup+25.501 s]
/proc/loadavg: 7.33 7.86 7.92 9/186 6340
/proc/meminfo: memFree=30161676/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=171388 CPUtime=101.57 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 133729 1255 0 5 10136 21 0 0 21 0 5 0 600990128 175501312 14304 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 42847 14304 181 55 0 40733 0
[pid=6289/tid=6300] ppid=6287 vsize=171388 CPUtime=25.42 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 38440 1255 0 5 2537 5 0 0 25 0 5 0 600990135 175501312 14304 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=171388 CPUtime=25.27 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 45937 1255 0 5 2521 6 0 0 25 0 5 0 600990135 175501312 14304 33554432000 4194304 4417332 140733295110128 18446744073709551615 4354385 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=171388 CPUtime=25.41 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 32417 1255 0 5 2536 5 0 0 25 0 5 0 600990135 175501312 14304 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=171388 CPUtime=25.42 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 15272 1255 0 5 2539 3 0 0 25 0 5 0 600990135 175501312 14304 33554432000 4194304 4417332 140733295110128 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.57
Current children cumulated vsize (KiB) 171388

[startup+51.1003 s]
/proc/loadavg: 7.56 7.87 7.92 9/186 6340
/proc/meminfo: memFree=30141188/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=183064 CPUtime=203.84 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 301215 1255 0 5 20338 46 0 0 21 0 5 0 600990128 187457536 17200 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 45766 17200 181 55 0 43652 0
[pid=6289/tid=6300] ppid=6287 vsize=183064 CPUtime=51.02 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 84423 1255 0 5 5091 11 0 0 25 0 5 0 600990135 187457536 17200 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=183064 CPUtime=50.74 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 109293 1255 0 5 5059 15 0 0 25 0 5 0 600990135 187457536 17200 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=183064 CPUtime=51.01 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 79449 1255 0 5 5088 13 0 0 25 0 5 0 600990135 187457536 17200 33554432000 4194304 4417332 140733295110128 18446744073709551615 4358652 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=183064 CPUtime=51.02 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 26387 1255 0 5 5097 5 0 0 25 0 5 0 600990135 187457536 17200 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.84
Current children cumulated vsize (KiB) 183064

[startup+102.307 s]
/proc/loadavg: 7.92 7.92 7.93 9/186 6342
/proc/meminfo: memFree=30092060/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=207012 CPUtime=408.39 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 464406 1255 0 5 40770 69 0 0 21 0 5 0 600990128 211980288 23187 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 51753 23187 181 55 0 49639 0
[pid=6289/tid=6300] ppid=6287 vsize=207012 CPUtime=102.23 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 137778 1255 0 5 10204 19 0 0 25 0 5 0 600990135 211980288 23187 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=207012 CPUtime=101.66 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 151782 1255 0 5 10145 21 0 0 25 0 5 0 600990135 211980288 23187 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=207012 CPUtime=102.22 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 129960 1255 0 5 10202 20 0 0 25 0 5 0 600990135 211980288 23187 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=207012 CPUtime=102.22 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 43223 1255 0 5 10215 7 0 0 25 0 5 0 600990135 211980288 23187 33554432000 4194304 4417332 140733295110128 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 408.39
Current children cumulated vsize (KiB) 207012

[startup+162.301 s]
/proc/loadavg: 8.08 7.96 7.94 9/186 6343
/proc/meminfo: memFree=29985252/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=249392 CPUtime=648.05 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 646656 1255 0 5 64709 96 0 0 21 0 5 0 600990128 255377408 33782 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 62348 33782 181 55 0 60234 0
[pid=6289/tid=6300] ppid=6287 vsize=249392 CPUtime=162.22 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 217736 1255 0 5 16192 30 0 0 25 0 5 0 600990135 255377408 33782 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364951 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=249392 CPUtime=161.34 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 189417 1255 0 5 16107 27 0 0 25 0 5 0 600990135 255377408 33782 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=249392 CPUtime=162.21 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 176147 1255 0 5 16195 26 0 0 25 0 5 0 600990135 255377408 33782 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=249392 CPUtime=162.21 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 61693 1255 0 5 16211 10 0 0 25 0 5 0 600990135 255377408 33782 33554432000 4194304 4417332 140733295110128 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 648.05
Current children cumulated vsize (KiB) 249392


################
# More data... #
################

[pid=6289/tid=6301] ppid=6287 vsize=413912 CPUtime=758.08 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 616080 1255 0 5 75722 86 0 0 25 0 5 0 600990135 423845888 74912 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=413912 CPUtime=762.23 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 483226 1255 0 5 76152 71 0 0 25 0 5 0 600990135 423845888 74912 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=413912 CPUtime=762.24 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 235115 1255 0 5 76186 38 0 0 25 0 5 0 600990135 423845888 74912 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3044.86
Current children cumulated vsize (KiB) 413912

[startup+822.301 s]
/proc/loadavg: 8.12 8.04 7.97 9/186 6361
/proc/meminfo: memFree=29691676/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=438232 CPUtime=3284.51 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 2178231 1255 0 5 328138 313 0 0 21 0 5 0 600990128 448749568 80992 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 109558 80992 181 55 0 107444 0
[pid=6289/tid=6300] ppid=6287 vsize=438232 CPUtime=822.25 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 662668 1255 0 5 82130 95 0 0 25 0 5 0 600990135 448749568 80992 33554432000 4194304 4417332 140733295110128 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=438232 CPUtime=817.76 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 763536 1255 0 5 81672 104 0 0 25 0 5 0 600990135 448749568 80992 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364656 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=438232 CPUtime=822.23 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 504152 1255 0 5 82149 74 0 0 25 0 5 0 600990135 448749568 80992 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364938 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=438232 CPUtime=822.24 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 246212 1255 0 5 82185 39 0 0 25 0 5 0 600990135 448749568 80992 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3284.51
Current children cumulated vsize (KiB) 438232

[startup+882.301 s]
/proc/loadavg: 8.04 8.03 7.97 9/186 6363
/proc/meminfo: memFree=29748656/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=384984 CPUtime=3524.18 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 2307718 1255 0 5 352087 331 0 0 21 0 5 0 600990128 394223616 67680 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 96246 67680 181 55 0 94132 0
[pid=6289/tid=6300] ppid=6287 vsize=384984 CPUtime=882.24 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 715916 1255 0 5 88123 101 0 0 25 0 5 0 600990135 394223616 67680 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364887 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=384984 CPUtime=877.42 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 813672 1255 0 5 87631 111 0 0 25 0 5 0 600990135 394223616 67680 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=384984 CPUtime=882.22 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 518511 1255 0 5 88146 76 0 0 25 0 5 0 600990135 394223616 67680 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=384984 CPUtime=882.24 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 257956 1255 0 5 88183 41 0 0 25 0 5 0 600990135 394223616 67680 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3524.18
Current children cumulated vsize (KiB) 384984

[startup+942.301 s]
/proc/loadavg: 8.03 8.02 7.97 9/186 6400
/proc/meminfo: memFree=29938928/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=384152 CPUtime=3763.87 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 2436666 1255 0 5 376040 347 0 0 21 0 5 0 600990128 393371648 67472 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 96038 67472 181 55 0 93924 0
[pid=6289/tid=6300] ppid=6287 vsize=384152 CPUtime=942.24 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 826508 1255 0 5 94109 115 0 0 25 0 5 0 600990135 393371648 67472 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=384152 CPUtime=937.11 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 816001 1255 0 5 93599 112 0 0 25 0 5 0 600990135 393371648 67472 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=384152 CPUtime=942.23 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 526703 1255 0 5 94146 77 0 0 25 0 5 0 600990135 393371648 67472 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=384152 CPUtime=942.24 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 265791 1255 0 5 94182 42 0 0 25 0 5 0 600990135 393371648 67472 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3763.87
Current children cumulated vsize (KiB) 384152

[startup+1002.3 s]
/proc/loadavg: 8.13 8.05 7.98 9/186 6402
/proc/meminfo: memFree=29978428/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=353852 CPUtime=4003.55 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 2504663 1255 0 5 399999 356 0 0 21 0 5 0 600990128 362344448 59897 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 88463 59897 181 55 0 86349 0
[pid=6289/tid=6300] ppid=6287 vsize=353852 CPUtime=1002.24 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 856314 1255 0 5 100105 119 0 0 25 0 5 0 600990135 362344448 59897 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=353852 CPUtime=996.78 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 816001 1255 0 5 99566 112 0 0 25 0 5 0 600990135 362344448 59897 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=353852 CPUtime=1002.23 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 555375 1255 0 5 100143 80 0 0 25 0 5 0 600990135 362344448 59897 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=353852 CPUtime=1002.24 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 275310 1255 0 5 100181 43 0 0 25 0 5 0 600990135 362344448 59897 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4003.55
Current children cumulated vsize (KiB) 353852

[startup+1062.3 s]
/proc/loadavg: 8.15 8.07 7.99 9/186 6403
/proc/meminfo: memFree=29918992/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=401284 CPUtime=4243.23 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 2603840 1255 0 5 423954 369 0 0 21 0 5 0 600990128 410914816 71755 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 100321 71755 181 55 0 98207 0
[pid=6289/tid=6300] ppid=6287 vsize=401284 CPUtime=1062.25 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 863666 1255 0 5 106105 120 0 0 25 0 5 0 600990135 410914816 71755 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=401284 CPUtime=1056.46 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 830631 1255 0 5 105532 114 0 0 25 0 5 0 600990135 410914816 71755 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=401284 CPUtime=1062.22 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 623959 1255 0 5 106133 89 0 0 25 0 5 0 600990135 410914816 71755 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=401284 CPUtime=1062.24 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 283921 1255 0 5 106180 44 0 0 25 0 5 0 600990135 410914816 71755 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364639 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4243.23
Current children cumulated vsize (KiB) 401284

[startup+1122.3 s]
/proc/loadavg: 8.15 8.08 8.00 9/186 6405
/proc/meminfo: memFree=29860796/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=429116 CPUtime=4482.91 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 2738611 1255 0 5 447903 388 0 0 21 0 5 0 600990128 439414784 78745 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 107279 78745 181 55 0 105165 0
[pid=6289/tid=6300] ppid=6287 vsize=429116 CPUtime=1122.25 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 867762 1255 0 5 112105 120 0 0 25 0 5 0 600990135 439414784 78745 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=429116 CPUtime=1116.13 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 851111 1255 0 5 111496 117 0 0 25 0 5 0 600990135 439414784 78745 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=429116 CPUtime=1122.22 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 715950 1255 0 5 112121 101 0 0 25 0 5 0 600990135 439414784 78745 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364919 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=429116 CPUtime=1122.24 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 302125 1255 0 5 112177 47 0 0 25 0 5 0 600990135 439414784 78745 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4482.91
Current children cumulated vsize (KiB) 429116

[startup+1182.3 s]
/proc/loadavg: 8.14 8.09 8.01 9/186 6407
/proc/meminfo: memFree=29836196/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=488228 CPUtime=4722.59 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 2890313 1255 0 5 471853 406 0 0 21 0 5 0 600990128 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 122057 93523 181 55 0 119943 0
[pid=6289/tid=6300] ppid=6287 vsize=488228 CPUtime=1182.25 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 884146 1255 0 5 118103 122 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=488228 CPUtime=1175.8 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 878419 1255 0 5 117460 120 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364664 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=488228 CPUtime=1182.22 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 818350 1255 0 5 118109 113 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=488228 CPUtime=1182.25 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 307735 1255 0 5 118177 48 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4722.59
Current children cumulated vsize (KiB) 488228



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.17 8.10 8.01 9/186 6407
/proc/meminfo: memFree=29820800/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=488228 CPUtime=4800.1 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 2955849 1255 0 5 479596 414 0 0 21 0 5 0 600990128 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 122057 93523 181 55 0 119943 0
[pid=6289/tid=6300] ppid=6287 vsize=488228 CPUtime=1201.66 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 884146 1255 0 5 120044 122 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=488228 CPUtime=1195.09 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 911187 1255 0 5 119386 123 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=488228 CPUtime=1201.63 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 847022 1255 0 5 120046 117 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=488228 CPUtime=1201.66 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 311831 1255 0 5 120117 49 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 488228

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.17 8.10 8.01 9/186 6407
/proc/meminfo: memFree=29820800/32950928 swapFree=67054472/67111528
[pid=6289] ppid=6287 vsize=488228 CPUtime=4800.1 cores=1,3,5,7
/proc/6289/stat : 6289 (plingeling) S 6287 6289 5950 0 -1 4202496 2955849 1255 0 5 479596 414 0 0 21 0 5 0 600990128 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/6289/statm: 122057 93523 181 55 0 119943 0
[pid=6289/tid=6300] ppid=6287 vsize=488228 CPUtime=1201.66 cores=1,3,5,7
/proc/6289/task/6300/stat : 6300 (plingeling) R 6287 6289 5950 0 -1 4202560 884146 1255 0 5 120044 122 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6289/tid=6301] ppid=6287 vsize=488228 CPUtime=1195.09 cores=1,3,5,7
/proc/6289/task/6301/stat : 6301 (plingeling) R 6287 6289 5950 0 -1 4202560 911187 1255 0 5 119386 123 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6289/tid=6302] ppid=6287 vsize=488228 CPUtime=1201.63 cores=1,3,5,7
/proc/6289/task/6302/stat : 6302 (plingeling) R 6287 6289 5950 0 -1 4202560 847022 1255 0 5 120046 117 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6289/tid=6303] ppid=6287 vsize=488228 CPUtime=1201.66 cores=1,3,5,7
/proc/6289/task/6303/stat : 6303 (plingeling) R 6287 6289 5950 0 -1 4202560 311831 1255 0 5 120117 49 0 0 25 0 5 0 600990135 499945472 93523 33554432000 4194304 4417332 140733295110128 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 488228

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.73
CPU time (s): 4800.15
CPU user time (s): 4795.98
CPU system time (s): 4.16037
CPU usage (%): 399.437
Max. virtual memory (cumulated for all children) (KiB): 520996

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.98
system time used= 4.16037
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2957105
page faults= 5
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 147
involuntary context switches= 36444

runsolver used 1.76773 second user time and 4.79627 second system time

The end

Launcher Data 

Begin job on node116 at 2011-04-29 22:06:35
IDJOB=3265906
IDBENCH=85826
IDSOLVER=1605
FILE ID=node116/3265906-1304107594
RUNJOBID= node116-1304107594-6265
PBS_JOBID= 13170643
Free space on /tmp= 72516 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT05/crafted/sorge05/QG7/gensys-icl007.shuffled-as.sat05-3133.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3265906-1304107594/watcher-3265906-1304107594 -o /tmp/evaluation-result-3265906-1304107594/solver-3265906-1304107594 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3265906-1304107594.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 88361752c7b0c05e849791aafdd7bdba
RANDOM SEED=1857231166

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30256184 kB
Buffers:        975716 kB
Cached:        1361172 kB
SwapCached:       9656 kB
Active:          52228 kB
Inactive:      2303772 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30256184 kB
SwapTotal:    67111528 kB
SwapFree:     67054472 kB
Dirty:             936 kB
Writeback:           0 kB
AnonPages:       17004 kB
Mapped:          13004 kB
Slab:           275000 kB
PageTables:       4636 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   210316 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72516 MiB
End job on node116 at 2011-04-29 22:26:38