Trace number 3257282

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.12 1201.46

General information on the benchmark

NameCRAFTED/edgematching/
compact/em_7_3_6_cmp.cnf
MD5SUMc848a5766cfcc1d1c3f26c7818e48eb2
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark11.7412
Satisfiable
(Un)Satisfiability was proved
Number of variables1473
Number of clauses11563
Sum of the clauses size37576
Maximum clause length25
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22381
Number of clauses of size 37024
Number of clauses of size 4708
Number of clauses of size 51300
Number of clauses of size over 5150

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3257282-1304043604/watcher-3257282-1304043604 -o /tmp/evaluation-result-3257282-1304043604/solver-3257282-1304043604 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3257282-1304043604.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.29 4.98 6.16 3/174 692
/proc/meminfo: memFree=20029116/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=8728 CPUtime=0 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 215 0 0 0 0 0 0 0 22 0 1 0 515960158 8937472 146 33554432000 4194304 4417332 140734379289744 18446744073709551615 237278879488 0 0 4096 0 18446744071562362840 0 0 17 2 0 0 0
/proc/692/statm: 2182 146 122 55 0 68 0

[startup+0.126217 s]
/proc/loadavg: 4.29 4.98 6.16 3/174 692
/proc/meminfo: memFree=20029116/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=54720 CPUtime=0.4 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 1586 1249 0 0 40 0 0 0 22 0 5 0 515960158 56033280 1486 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 13680 1486 177 55 0 11566 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 54720

[startup+0.200204 s]
/proc/loadavg: 4.29 4.98 6.16 3/174 692
/proc/meminfo: memFree=20029116/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=54552 CPUtime=0.7 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 1745 1249 0 0 70 0 0 0 22 0 5 0 515960158 55861248 1448 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 13638 1448 181 55 0 11524 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 54552

[startup+0.300187 s]
/proc/loadavg: 4.29 4.98 6.16 3/174 692
/proc/meminfo: memFree=20029116/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=56384 CPUtime=1.1 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 2297 1249 0 0 110 0 0 0 22 0 5 0 515960158 57737216 1921 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 14096 1921 181 55 0 11982 0
Current children cumulated CPU time (s) 1.1
Current children cumulated vsize (KiB) 56384

[startup+0.700118 s]
/proc/loadavg: 4.29 4.98 6.16 3/174 692
/proc/meminfo: memFree=20029116/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=61704 CPUtime=2.69 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 4322 1249 0 0 269 0 0 0 22 0 5 0 515960158 63184896 3226 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 15426 3226 181 55 0 13312 0
Current children cumulated CPU time (s) 2.69
Current children cumulated vsize (KiB) 61704

[startup+1.50098 s]
/proc/loadavg: 4.29 4.98 6.16 9/186 717
/proc/meminfo: memFree=19978064/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=67936 CPUtime=5.9 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 8945 1249 0 0 589 1 0 0 22 0 5 0 515960158 69566464 4813 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 16984 4813 181 55 0 14870 0
[pid=692/tid=699] ppid=690 vsize=67936 CPUtime=1.48 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 1516 1249 0 0 148 0 0 0 25 0 5 0 515960159 69566464 4813 33554432000 4194304 4417332 140734379289744 18446744073709551615 4263067 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=67936 CPUtime=1.46 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 1452 1249 0 0 146 0 0 0 25 0 5 0 515960159 69566464 4813 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=67936 CPUtime=1.46 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 1566 1249 0 0 146 0 0 0 25 0 5 0 515960159 69566464 4813 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=67936 CPUtime=1.46 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 3347 1249 0 0 146 0 0 0 25 0 5 0 515960159 69566464 4813 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.9
Current children cumulated vsize (KiB) 67936

[startup+3.10069 s]
/proc/loadavg: 4.29 4.98 6.16 10/186 718
/proc/meminfo: memFree=19966068/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=74456 CPUtime=12.29 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 20919 1249 0 0 1226 3 0 0 22 0 5 0 515960158 76242944 6452 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 18614 6452 181 55 0 16500 0
[pid=692/tid=699] ppid=690 vsize=74456 CPUtime=3.07 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 5133 1249 0 0 307 0 0 0 25 0 5 0 515960159 76242944 6452 33554432000 4194304 4417332 140734379289744 18446744073709551615 4250927 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=74456 CPUtime=3.06 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 3844 1249 0 0 306 0 0 0 25 0 5 0 515960159 76242944 6452 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=74456 CPUtime=3.05 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 5163 1249 0 0 305 0 0 0 25 0 5 0 515960159 76242944 6452 33554432000 4194304 4417332 140734379289744 18446744073709551615 4264909 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=74456 CPUtime=3.06 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 5715 1249 0 0 306 0 0 0 25 0 5 0 515960159 76242944 6452 33554432000 4194304 4417332 140734379289744 18446744073709551615 4354352 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.29
Current children cumulated vsize (KiB) 74456

[startup+6.30113 s]
/proc/loadavg: 4.59 5.03 6.17 10/186 718
/proc/meminfo: memFree=19966448/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=81080 CPUtime=25.07 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 33951 1249 0 0 2502 5 0 0 22 0 5 0 515960158 83025920 8108 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 20270 8108 181 55 0 18156 0
[pid=692/tid=699] ppid=690 vsize=81080 CPUtime=6.27 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 7726 1249 0 0 626 1 0 0 25 0 5 0 515960159 83025920 8108 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=81080 CPUtime=6.26 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 6266 1249 0 0 626 0 0 0 25 0 5 0 515960159 83025920 8108 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=81080 CPUtime=6.25 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 8147 1249 0 0 625 0 0 0 25 0 5 0 515960159 83025920 8108 33554432000 4194304 4417332 140734379289744 18446744073709551615 4309899 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=81080 CPUtime=6.24 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 10748 1249 0 0 623 1 0 0 25 0 5 0 515960159 83025920 8108 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.07
Current children cumulated vsize (KiB) 81080

[startup+12.701 s]
/proc/loadavg: 4.86 5.08 6.18 9/186 718
/proc/meminfo: memFree=19953264/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=94888 CPUtime=50.63 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 80067 1249 0 0 5052 11 0 0 22 0 5 0 515960158 97165312 11528 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 23722 11528 181 55 0 21608 0
[pid=692/tid=699] ppid=690 vsize=94888 CPUtime=12.67 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 22244 1249 0 0 1264 3 0 0 25 0 5 0 515960159 97165312 11528 33554432000 4194304 4417332 140734379289744 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=94888 CPUtime=12.66 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 16485 1249 0 0 1264 2 0 0 25 0 5 0 515960159 97165312 11528 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=94888 CPUtime=12.65 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 21299 1249 0 0 1263 2 0 0 25 0 5 0 515960159 97165312 11528 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=94888 CPUtime=12.6 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 18975 1249 0 0 1258 2 0 0 25 0 5 0 515960159 97165312 11528 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.63
Current children cumulated vsize (KiB) 94888

[startup+25.5007 s]
/proc/loadavg: 5.63 5.24 6.22 10/186 718
/proc/meminfo: memFree=19915176/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=129708 CPUtime=101.77 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 115133 1249 0 0 10160 17 0 0 22 0 5 0 515960158 132820992 20233 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 32427 20233 181 55 0 30313 0
[pid=692/tid=699] ppid=690 vsize=129708 CPUtime=25.47 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 29653 1249 0 0 2543 4 0 0 25 0 5 0 515960159 132820992 20233 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=129708 CPUtime=25.46 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 21727 1249 0 0 2543 3 0 0 25 0 5 0 515960159 132820992 20233 33554432000 4194304 4417332 140734379289744 18446744073709551615 4343680 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=129708 CPUtime=25.45 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 32293 1249 0 0 2541 4 0 0 25 0 5 0 515960159 132820992 20233 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=129708 CPUtime=25.34 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 30396 1249 0 0 2530 4 0 0 25 0 5 0 515960159 132820992 20233 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364919 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.77
Current children cumulated vsize (KiB) 129708

[startup+51.1012 s]
/proc/loadavg: 6.50 5.48 6.27 9/186 719
/proc/meminfo: memFree=19841984/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=198828 CPUtime=204.04 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 169207 1249 0 0 20379 25 0 0 22 0 5 0 515960158 203599872 37513 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 49707 37513 181 55 0 47593 0
[pid=692/tid=699] ppid=690 vsize=198828 CPUtime=51.07 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 42711 1249 0 0 5101 6 0 0 25 0 5 0 515960159 203599872 37513 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=198828 CPUtime=51.06 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 31523 1249 0 0 5101 5 0 0 25 0 5 0 515960159 203599872 37513 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=198828 CPUtime=51.06 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 51795 1249 0 0 5099 7 0 0 25 0 5 0 515960159 203599872 37513 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=198828 CPUtime=50.8 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 42114 1249 0 0 5075 5 0 0 25 0 5 0 515960159 203599872 37513 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 204.04
Current children cumulated vsize (KiB) 198828

[startup+102.301 s]
/proc/loadavg: 5.58 5.42 6.21 5/176 737
/proc/meminfo: memFree=19827960/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=252756 CPUtime=408.61 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 231320 1249 0 0 40825 36 0 0 22 0 5 0 515960158 258822144 50995 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 63189 50995 181 55 0 61075 0
[pid=692/tid=699] ppid=690 vsize=252756 CPUtime=102.28 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 55988 1249 0 0 10220 8 0 0 25 0 5 0 515960159 258822144 50995 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=252756 CPUtime=102.26 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 49682 1249 0 0 10218 8 0 0 25 0 5 0 515960159 258822144 50995 33554432000 4194304 4417332 140734379289744 18446744073709551615 237278937514 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=252756 CPUtime=102.26 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 63433 1249 0 0 10217 9 0 0 25 0 5 0 515960159 258822144 50995 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=252756 CPUtime=101.76 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 61153 1249 0 0 10168 8 0 0 25 0 5 0 515960159 258822144 50995 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.61
Current children cumulated vsize (KiB) 252756

[startup+162.3 s]
/proc/loadavg: 4.63 5.18 6.07 5/176 739
/proc/meminfo: memFree=19727360/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=353004 CPUtime=648.32 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 306788 1249 0 0 64785 47 0 0 22 0 5 0 515960158 361476096 76057 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 88251 76057 181 55 0 86137 0
[pid=692/tid=699] ppid=690 vsize=353004 CPUtime=162.28 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 70970 1249 0 0 16218 10 0 0 25 0 5 0 515960159 361476096 76057 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=353004 CPUtime=162.26 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 58852 1249 0 0 16216 10 0 0 25 0 5 0 515960159 361476096 76057 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=353004 CPUtime=162.25 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 84462 1249 0 0 16213 12 0 0 25 0 5 0 515960159 361476096 76057 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=353004 CPUtime=161.49 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 91440 1249 0 0 16136 13 0 0 25 0 5 0 515960159 361476096 76057 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 648.32
Current children cumulated vsize (KiB) 353004


################
# More data... #
################

[pid=692/tid=700] ppid=690 vsize=843652 CPUtime=762.29 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 142463 1249 0 0 76203 26 0 0 25 0 5 0 515960159 863899648 198719 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=843652 CPUtime=762.27 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 207013 1249 0 0 76197 30 0 0 25 0 5 0 515960159 863899648 198719 33554432000 4194304 4417332 140734379289744 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=843652 CPUtime=758.74 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 212236 1249 0 0 75842 32 0 0 25 0 5 0 515960159 863899648 198719 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3045.63
Current children cumulated vsize (KiB) 843652

[startup+822.301 s]
/proc/loadavg: 4.10 4.18 5.03 5/176 757
/proc/meminfo: memFree=19098888/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=980208 CPUtime=3285.35 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 786074 1249 0 0 328414 121 0 0 22 0 5 0 515960158 1003732992 232858 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 245052 232858 181 55 0 242938 0
[pid=692/tid=699] ppid=690 vsize=980208 CPUtime=822.3 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 164044 1249 0 0 82208 22 0 0 25 0 5 0 515960159 1003732992 232858 33554432000 4194304 4417332 140734379289744 18446744073709551615 4263206 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=980208 CPUtime=822.28 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 161735 1249 0 0 82200 28 0 0 25 0 5 0 515960159 1003732992 232858 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=980208 CPUtime=822.27 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 227153 1249 0 0 82193 34 0 0 25 0 5 0 515960159 1003732992 232858 33554432000 4194304 4417332 140734379289744 18446744073709551615 4366053 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=980208 CPUtime=818.47 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 232078 1249 0 0 81811 36 0 0 25 0 5 0 515960159 1003732992 232858 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3285.35
Current children cumulated vsize (KiB) 980208

[startup+882.307 s]
/proc/loadavg: 4.10 4.16 4.97 5/176 759
/proc/meminfo: memFree=19033732/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=1045324 CPUtime=3525.1 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 813844 1249 0 0 352385 125 0 0 22 0 5 0 515960158 1070411776 249137 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 261331 249137 181 55 0 259217 0
[pid=692/tid=699] ppid=690 vsize=1045324 CPUtime=882.31 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 164044 1249 0 0 88209 22 0 0 25 0 5 0 515960159 1070411776 249137 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=1045324 CPUtime=882.28 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 169601 1249 0 0 88199 29 0 0 25 0 5 0 515960159 1070411776 249137 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364990 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=1045324 CPUtime=882.27 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 239557 1249 0 0 88192 35 0 0 25 0 5 0 515960159 1070411776 249137 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=1045324 CPUtime=878.19 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 239578 1249 0 0 87782 37 0 0 25 0 5 0 515960159 1070411776 249137 33554432000 4194304 4417332 140734379289744 18446744073709551615 4366029 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3525.1
Current children cumulated vsize (KiB) 1045324

[startup+942.301 s]
/proc/loadavg: 4.03 4.13 4.90 5/176 761
/proc/meminfo: memFree=19094312/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=984988 CPUtime=3764.8 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 830605 1249 0 0 376353 127 0 0 22 0 5 0 515960158 1008627712 234053 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 246247 234053 181 55 0 244133 0
[pid=692/tid=699] ppid=690 vsize=984988 CPUtime=942.3 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 169304 1249 0 0 94207 23 0 0 25 0 5 0 515960159 1008627712 234053 33554432000 4194304 4417332 140734379289744 18446744073709551615 4251258 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=984988 CPUtime=942.28 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 172910 1249 0 0 94198 30 0 0 25 0 5 0 515960159 1008627712 234053 33554432000 4194304 4417332 140734379289744 18446744073709551615 4309982 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=984988 CPUtime=942.26 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 239557 1249 0 0 94191 35 0 0 25 0 5 0 515960159 1008627712 234053 33554432000 4194304 4417332 140734379289744 18446744073709551615 4343506 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=984988 CPUtime=937.92 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 247770 1249 0 0 93754 38 0 0 25 0 5 0 515960159 1008627712 234053 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364590 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3764.8
Current children cumulated vsize (KiB) 984988

[startup+1002.3 s]
/proc/loadavg: 4.01 4.10 4.84 5/176 762
/proc/meminfo: memFree=19261168/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=818572 CPUtime=4004.53 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 863835 1249 0 0 400318 135 0 0 22 0 5 0 515960158 838217728 192449 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 204643 192449 181 55 0 202529 0
[pid=692/tid=699] ppid=690 vsize=818572 CPUtime=1002.3 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 169304 1249 0 0 100207 23 0 0 25 0 5 0 515960159 838217728 192449 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=818572 CPUtime=1002.29 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 202124 1249 0 0 100193 36 0 0 25 0 5 0 515960159 838217728 192449 33554432000 4194304 4417332 140734379289744 18446744073709551615 4278271 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=818572 CPUtime=1002.26 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 239557 1249 0 0 100191 35 0 0 25 0 5 0 515960159 838217728 192449 33554432000 4194304 4417332 140734379289744 18446744073709551615 4366002 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=818572 CPUtime=997.63 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 251786 1249 0 0 99724 39 0 0 25 0 5 0 515960159 838217728 192449 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4004.53
Current children cumulated vsize (KiB) 818572

[startup+1062.3 s]
/proc/loadavg: 4.00 4.08 4.79 5/176 764
/proc/meminfo: memFree=19259628/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=818956 CPUtime=4244.26 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 887196 1249 0 0 424287 139 0 0 22 0 5 0 515960158 838610944 192545 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 204739 192545 181 55 0 202625 0
[pid=692/tid=699] ppid=690 vsize=818956 CPUtime=1062.3 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 178900 1249 0 0 106205 25 0 0 25 0 5 0 515960159 838610944 192545 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=818956 CPUtime=1062.28 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 209905 1249 0 0 106191 37 0 0 25 0 5 0 515960159 838610944 192545 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=818956 CPUtime=1062.27 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 239557 1249 0 0 106192 35 0 0 25 0 5 0 515960159 838610944 192545 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=818956 CPUtime=1057.36 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 257770 1249 0 0 105696 40 0 0 25 0 5 0 515960159 838610944 192545 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4244.26
Current children cumulated vsize (KiB) 818956

[startup+1122.3 s]
/proc/loadavg: 4.00 4.06 4.73 5/176 765
/proc/meminfo: memFree=19171140/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=907880 CPUtime=4483.98 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 913523 1249 0 0 448256 142 0 0 22 0 5 0 515960158 929669120 214776 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 226970 214776 181 55 0 224856 0
[pid=692/tid=699] ppid=690 vsize=907880 CPUtime=1122.3 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 182996 1249 0 0 112205 25 0 0 25 0 5 0 515960159 929669120 214776 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=907880 CPUtime=1122.28 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 209905 1249 0 0 112191 37 0 0 25 0 5 0 515960159 929669120 214776 33554432000 4194304 4417332 140734379289744 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=907880 CPUtime=1122.27 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 252403 1249 0 0 112190 37 0 0 25 0 5 0 515960159 929669120 214776 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=907880 CPUtime=1117.08 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 267155 1249 0 0 111666 42 0 0 25 0 5 0 515960159 929669120 214776 33554432000 4194304 4417332 140734379289744 18446744073709551615 4365975 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4483.98
Current children cumulated vsize (KiB) 907880

[startup+1182.3 s]
/proc/loadavg: 4.05 4.06 4.69 5/176 767
/proc/meminfo: memFree=19050320/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=1028936 CPUtime=4723.72 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 943787 1249 0 0 472225 147 0 0 22 0 5 0 515960158 1053630464 245040 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 257234 245040 181 55 0 255120 0
[pid=692/tid=699] ppid=690 vsize=1028936 CPUtime=1182.3 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 192216 1249 0 0 118204 26 0 0 25 0 5 0 515960159 1053630464 245040 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=1028936 CPUtime=1182.29 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 215604 1249 0 0 118191 38 0 0 25 0 5 0 515960159 1053630464 245040 33554432000 4194304 4417332 140734379289744 18446744073709551615 4236634 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=1028936 CPUtime=1182.27 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 267748 1249 0 0 118188 39 0 0 25 0 5 0 515960159 1053630464 245040 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=1028936 CPUtime=1176.81 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 267155 1249 0 0 117639 42 0 0 25 0 5 0 515960159 1053630464 245040 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4723.72
Current children cumulated vsize (KiB) 1028936



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.4 s]
/proc/loadavg: 4.03 4.06 4.68 5/176 767
/proc/meminfo: memFree=18974912/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=1104080 CPUtime=4800.03 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 962573 1249 0 0 479853 150 0 0 22 0 5 0 515960158 1130577920 263826 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 276020 263826 181 55 0 273906 0
[pid=692/tid=699] ppid=690 vsize=1104080 CPUtime=1201.41 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 199034 1249 0 0 120114 27 0 0 25 0 5 0 515960159 1130577920 263826 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=1104080 CPUtime=1201.39 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 215604 1249 0 0 120101 38 0 0 25 0 5 0 515960159 1130577920 263826 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=1104080 CPUtime=1201.38 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 267748 1249 0 0 120099 39 0 0 25 0 5 0 515960159 1130577920 263826 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=1104080 CPUtime=1195.81 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 279123 1249 0 0 119537 44 0 0 25 0 5 0 515960159 1130577920 263826 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.03
Current children cumulated vsize (KiB) 1104080

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.4 s]
/proc/loadavg: 4.03 4.06 4.68 5/176 767
/proc/meminfo: memFree=18974912/32950904 swapFree=67082284/67111528
[pid=692] ppid=690 vsize=1104080 CPUtime=4800.03 cores=0,2,4,6
/proc/692/stat : 692 (plingeling) S 690 692 31281 0 -1 4202496 962573 1249 0 0 479853 150 0 0 22 0 5 0 515960158 1130577920 263826 33554432000 4194304 4417332 140734379289744 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/692/statm: 276020 263826 181 55 0 273906 0
[pid=692/tid=699] ppid=690 vsize=1104080 CPUtime=1201.41 cores=0,2,4,6
/proc/692/task/699/stat : 699 (plingeling) R 690 692 31281 0 -1 4202560 199034 1249 0 0 120114 27 0 0 25 0 5 0 515960159 1130577920 263826 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=692/tid=700] ppid=690 vsize=1104080 CPUtime=1201.39 cores=0,2,4,6
/proc/692/task/700/stat : 700 (plingeling) R 690 692 31281 0 -1 4202560 215604 1249 0 0 120101 38 0 0 25 0 5 0 515960159 1130577920 263826 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=692/tid=701] ppid=690 vsize=1104080 CPUtime=1201.38 cores=0,2,4,6
/proc/692/task/701/stat : 701 (plingeling) R 690 692 31281 0 -1 4202560 267748 1249 0 0 120099 39 0 0 25 0 5 0 515960159 1130577920 263826 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=692/tid=702] ppid=690 vsize=1104080 CPUtime=1195.81 cores=0,2,4,6
/proc/692/task/702/stat : 702 (plingeling) R 690 692 31281 0 -1 4202560 279123 1249 0 0 119537 44 0 0 25 0 5 0 515960159 1130577920 263826 33554432000 4194304 4417332 140734379289744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.03
Current children cumulated vsize (KiB) 1104080

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.46
CPU time (s): 4800.12
CPU user time (s): 4798.56
CPU system time (s): 1.55776
CPU usage (%): 399.525
Max. virtual memory (cumulated for all children) (KiB): 1104080

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.56
system time used= 1.55776
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 963822
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 141
involuntary context switches= 20091

runsolver used 1.76073 second user time and 3.83642 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-29 04:20:04
IDJOB=3257282
IDBENCH=70907
IDSOLVER=1605
FILE ID=node121/3257282-1304043604
RUNJOBID= node121-1304043604-678
PBS_JOBID= 13170331
Free space on /tmp= 72656 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT09/CRAFTED/edgematching/compact/em_7_3_6_cmp.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3257282-1304043604/watcher-3257282-1304043604 -o /tmp/evaluation-result-3257282-1304043604/solver-3257282-1304043604 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3257282-1304043604.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c848a5766cfcc1d1c3f26c7818e48eb2
RANDOM SEED=1387183670

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      20029644 kB
Buffers:       2178676 kB
Cached:       10182248 kB
SwapCached:       2776 kB
Active:        9087392 kB
Inactive:      3315160 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      20029644 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:             476 kB
Writeback:           0 kB
AnonPages:       39256 kB
Mapped:          13528 kB
Slab:           454836 kB
PageTables:       4336 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   191740 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72656 MiB
End job on node121 at 2011-04-29 04:40:07