Trace number 3265686

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.26 1201.74

General information on the benchmark

NameSAT05/crafted/sorge05/QG7a/
gensys-icl005.shuffled-as.sat05-3826.cnf
MD5SUM5d8489e52ec1ef9c7431a7fd60f9ff86
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark455.087
Satisfiable
(Un)Satisfiability was proved
Number of variables2703
Number of clauses18312
Sum of the clauses size128119
Maximum clause length13
Minimum clause length1
Number of clauses of size 156
Number of clauses of size 2533
Number of clauses of size 32417
Number of clauses of size 4522
Number of clauses of size 5685
Number of clauses of size over 514099

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3265686-1304107056/watcher-3265686-1304107056 -o /tmp/evaluation-result-3265686-1304107056/solver-3265686-1304107056 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3265686-1304107056.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.12 8.06 7.78 5/181 7755
/proc/meminfo: memFree=18862128/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=9692 CPUtime=0 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) R 7753 7755 7523 0 -1 4202496 516 1255 0 0 0 0 0 0 25 0 1 0 522305320 9924608 445 33554432000 4194304 4417332 140734319037520 18446744073709551615 237278879488 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/7755/statm: 2423 445 147 55 0 309 0

[startup+0.015663 s]
/proc/loadavg: 8.12 8.06 7.78 5/181 7755
/proc/meminfo: memFree=18862128/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=11908 CPUtime=0 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) R 7753 7755 7523 0 -1 4202496 1103 1255 0 0 0 0 0 0 25 0 1 0 522305320 12193792 1000 33554432000 4194304 4417332 140734319037520 18446744073709551615 237278879488 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/7755/statm: 2977 1000 148 55 0 863 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 11908

[startup+0.153641 s]
/proc/loadavg: 8.12 8.06 7.78 5/181 7755
/proc/meminfo: memFree=18862128/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=57136 CPUtime=0.46 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 3013 1255 0 0 46 0 0 0 25 0 5 0 522305320 58507264 2082 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 14284 2082 176 55 0 12170 0
Current children cumulated CPU time (s) 0.46
Current children cumulated vsize (KiB) 57136

[startup+0.300615 s]
/proc/loadavg: 8.12 8.06 7.78 5/181 7755
/proc/meminfo: memFree=18862128/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=59140 CPUtime=1.05 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 3838 1255 0 0 105 0 0 0 25 0 5 0 522305320 60559360 2604 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 14785 2604 180 55 0 12671 0
Current children cumulated CPU time (s) 1.05
Current children cumulated vsize (KiB) 59140

[startup+0.700546 s]
/proc/loadavg: 8.12 8.06 7.78 5/181 7755
/proc/meminfo: memFree=18862128/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=62704 CPUtime=2.65 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 6325 1255 0 0 264 1 0 0 25 0 5 0 522305320 64208896 3475 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 15676 3475 180 55 0 13562 0
Current children cumulated CPU time (s) 2.65
Current children cumulated vsize (KiB) 62704

[startup+1.5004 s]
/proc/loadavg: 8.11 8.06 7.78 9/186 7766
/proc/meminfo: memFree=18843924/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=67420 CPUtime=5.85 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 11911 1255 0 0 583 2 0 0 25 0 5 0 522305320 69038080 4654 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 16855 4654 180 55 0 14741 0
[pid=7755/tid=7762] ppid=7753 vsize=67420 CPUtime=1.45 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 1942 1255 0 0 145 0 0 0 25 0 5 0 522305324 69038080 4654 33554432000 4194304 4417332 140734319037520 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=67420 CPUtime=1.45 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 2102 1255 0 0 145 0 0 0 25 0 5 0 522305324 69038080 4654 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=67420 CPUtime=1.44 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 2641 1255 0 0 144 0 0 0 25 0 5 0 522305324 69038080 4654 33554432000 4194304 4417332 140734319037520 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=67420 CPUtime=1.44 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 2893 1255 0 0 144 0 0 0 25 0 5 0 522305324 69038080 4654 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.85
Current children cumulated vsize (KiB) 67420

[startup+3.10112 s]
/proc/loadavg: 8.11 8.06 7.78 9/186 7766
/proc/meminfo: memFree=18834996/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=77876 CPUtime=12.24 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 22572 1255 0 0 1220 4 0 0 25 0 5 0 522305320 79745024 7268 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 19469 7268 180 55 0 17355 0
[pid=7755/tid=7762] ppid=7753 vsize=77876 CPUtime=3.04 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 4426 1255 0 0 304 0 0 0 25 0 5 0 522305324 79745024 7268 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=77876 CPUtime=3.04 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 4991 1255 0 0 304 0 0 0 25 0 5 0 522305324 79745024 7268 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=77876 CPUtime=3.03 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 5509 1255 0 0 303 0 0 0 25 0 5 0 522305324 79745024 7268 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=77876 CPUtime=3.05 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 5313 1255 0 0 304 1 0 0 25 0 5 0 522305324 79745024 7268 33554432000 4194304 4417332 140734319037520 18446744073709551615 4250633 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.24
Current children cumulated vsize (KiB) 77876

[startup+6.30055 s]
/proc/loadavg: 8.11 8.06 7.78 9/186 7766
/proc/meminfo: memFree=18826412/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=83948 CPUtime=25.02 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 36587 1255 0 0 2496 6 0 0 25 0 5 0 522305320 85962752 8792 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 20987 8792 180 55 0 18873 0
[pid=7755/tid=7762] ppid=7753 vsize=83948 CPUtime=6.25 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 7485 1255 0 0 624 1 0 0 25 0 5 0 522305324 85962752 8792 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=83948 CPUtime=6.24 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 9040 1255 0 0 624 0 0 0 25 0 5 0 522305324 85962752 8792 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=83948 CPUtime=6.21 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 9435 1255 0 0 620 1 0 0 25 0 5 0 522305324 85962752 8792 33554432000 4194304 4417332 140734319037520 18446744073709551615 4308243 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=83948 CPUtime=6.25 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 8294 1255 0 0 623 2 0 0 25 0 5 0 522305324 85962752 8792 33554432000 4194304 4417332 140734319037520 18446744073709551615 4352233 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.02
Current children cumulated vsize (KiB) 83948

[startup+12.7004 s]
/proc/loadavg: 8.09 8.05 7.79 9/186 7766
/proc/meminfo: memFree=18880964/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=115472 CPUtime=50.58 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 59751 1255 0 0 5048 10 0 0 25 0 5 0 522305320 118243328 16674 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 28868 16674 180 55 0 26754 0
[pid=7755/tid=7762] ppid=7753 vsize=115472 CPUtime=12.64 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 15489 1255 0 0 1262 2 0 0 25 0 5 0 522305324 118243328 16674 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=115472 CPUtime=12.64 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 14901 1255 0 0 1263 1 0 0 25 0 5 0 522305324 118243328 16674 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=115472 CPUtime=12.58 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 14164 1255 0 0 1256 2 0 0 25 0 5 0 522305324 118243328 16674 33554432000 4194304 4417332 140734319037520 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=115472 CPUtime=12.65 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 12864 1255 0 0 1262 3 0 0 25 0 5 0 522305324 118243328 16674 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364614 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.58
Current children cumulated vsize (KiB) 115472

[startup+25.5011 s]
/proc/loadavg: 8.08 8.05 7.79 9/186 7766
/proc/meminfo: memFree=18833368/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=149388 CPUtime=101.71 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 88172 1255 0 0 10156 15 0 0 25 0 5 0 522305320 152973312 25152 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 37347 25152 180 55 0 35233 0
[pid=7755/tid=7762] ppid=7753 vsize=149388 CPUtime=25.45 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 22614 1255 0 0 2541 4 0 0 25 0 5 0 522305324 152973312 25152 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=149388 CPUtime=25.44 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 23279 1255 0 0 2541 3 0 0 25 0 5 0 522305324 152973312 25152 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=149388 CPUtime=25.31 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 21893 1255 0 0 2528 3 0 0 25 0 5 0 522305324 152973312 25152 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=149388 CPUtime=25.44 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 18053 1255 0 0 2541 3 0 0 25 0 5 0 522305324 152973312 25152 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.71
Current children cumulated vsize (KiB) 149388

[startup+51.1006 s]
/proc/loadavg: 8.12 8.06 7.80 9/186 7767
/proc/meminfo: memFree=18695828/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=193804 CPUtime=203.98 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 132103 1255 0 0 20376 22 0 0 25 0 5 0 522305320 198455296 36256 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 48451 36256 180 55 0 46337 0
[pid=7755/tid=7762] ppid=7753 vsize=193804 CPUtime=51.05 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 33877 1255 0 0 5099 6 0 0 25 0 5 0 522305324 198455296 36256 33554432000 4194304 4417332 140734319037520 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=193804 CPUtime=51.04 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 32928 1255 0 0 5100 4 0 0 25 0 5 0 522305324 198455296 36256 33554432000 4194304 4417332 140734319037520 18446744073709551615 4232664 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=193804 CPUtime=50.77 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 36709 1255 0 0 5072 5 0 0 25 0 5 0 522305324 198455296 36256 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364498 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=193804 CPUtime=51.04 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 26256 1255 0 0 5100 4 0 0 25 0 5 0 522305324 198455296 36256 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.98
Current children cumulated vsize (KiB) 193804

[startup+102.306 s]
/proc/loadavg: 8.18 8.08 7.82 9/186 7768
/proc/meminfo: memFree=18685028/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=274112 CPUtime=408.53 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 193283 1255 0 0 40819 34 0 0 25 0 5 0 522305320 280690688 56333 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 68528 56333 180 55 0 66414 0
[pid=7755/tid=7762] ppid=7753 vsize=274112 CPUtime=102.26 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 50239 1255 0 0 10216 10 0 0 25 0 5 0 522305324 280690688 56333 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=274112 CPUtime=102.25 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 50299 1255 0 0 10218 7 0 0 25 0 5 0 522305324 280690688 56333 33554432000 4194304 4417332 140734319037520 18446744073709551615 4320892 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=274112 CPUtime=101.69 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 49751 1255 0 0 10161 8 0 0 25 0 5 0 522305324 280690688 56333 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=274112 CPUtime=102.26 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 40661 1255 0 0 10219 7 0 0 25 0 5 0 522305324 280690688 56333 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.53
Current children cumulated vsize (KiB) 274112

[startup+162.301 s]
/proc/loadavg: 8.18 8.10 7.84 9/186 7770
/proc/meminfo: memFree=18335096/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=331236 CPUtime=648.19 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 241136 1255 0 0 64777 42 0 0 25 0 5 0 522305320 339185664 70614 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 82809 70614 180 55 0 80695 0
[pid=7755/tid=7762] ppid=7753 vsize=331236 CPUtime=162.25 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 67972 1255 0 0 16212 13 0 0 25 0 5 0 522305324 339185664 70614 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=331236 CPUtime=162.25 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 58109 1255 0 0 16216 9 0 0 25 0 5 0 522305324 339185664 70614 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=331236 CPUtime=161.36 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 61011 1255 0 0 16127 9 0 0 25 0 5 0 522305324 339185664 70614 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=331236 CPUtime=162.25 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 51711 1255 0 0 16216 9 0 0 25 0 5 0 522305324 339185664 70614 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 648.19
Current children cumulated vsize (KiB) 331236


################
# More data... #
################

[pid=7755/tid=7763] ppid=7753 vsize=591192 CPUtime=762.27 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 148392 1255 0 0 76203 24 0 0 25 0 5 0 522305324 605380608 135603 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=591192 CPUtime=758.1 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 142356 1255 0 0 75786 24 0 0 25 0 5 0 522305324 605380608 135603 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=591192 CPUtime=762.27 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 114173 1255 0 0 76206 21 0 0 25 0 5 0 522305324 605380608 135603 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3044.96
Current children cumulated vsize (KiB) 591192

[startup+822.301 s]
/proc/loadavg: 8.17 8.12 7.96 9/186 7836
/proc/meminfo: memFree=18914148/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=581316 CPUtime=3284.62 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 553592 1255 0 0 328365 97 0 0 25 0 5 0 522305320 595267584 133134 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 145329 133134 180 55 0 143215 0
[pid=7755/tid=7762] ppid=7753 vsize=581316 CPUtime=822.24 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 137686 1255 0 0 82200 24 0 0 25 0 5 0 522305324 595267584 133134 33554432000 4194304 4417332 140734319037520 18446744073709551615 4365977 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=581316 CPUtime=822.26 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 148688 1255 0 0 82202 24 0 0 25 0 5 0 522305324 595267584 133134 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=581316 CPUtime=817.78 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 150712 1255 0 0 81752 26 0 0 25 0 5 0 522305324 595267584 133134 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=581316 CPUtime=822.26 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 114173 1255 0 0 82205 21 0 0 25 0 5 0 522305324 595267584 133134 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3284.62
Current children cumulated vsize (KiB) 581316

[startup+882.301 s]
/proc/loadavg: 8.12 8.11 7.96 9/186 7838
/proc/meminfo: memFree=18881508/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=606056 CPUtime=3524.29 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 572693 1255 0 0 352329 100 0 0 25 0 5 0 522305320 620601344 139319 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 151514 139319 180 55 0 149400 0
[pid=7755/tid=7762] ppid=7753 vsize=606056 CPUtime=882.24 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 137686 1255 0 0 88200 24 0 0 25 0 5 0 522305324 620601344 139319 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=606056 CPUtime=882.26 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 162367 1255 0 0 88200 26 0 0 25 0 5 0 522305324 620601344 139319 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=606056 CPUtime=877.45 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 150712 1255 0 0 87719 26 0 0 25 0 5 0 522305324 620601344 139319 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=606056 CPUtime=882.26 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 119595 1255 0 0 88204 22 0 0 25 0 5 0 522305324 620601344 139319 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3524.29
Current children cumulated vsize (KiB) 606056

[startup+942.3 s]
/proc/loadavg: 8.09 8.10 7.97 9/186 7840
/proc/meminfo: memFree=18759232/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=690008 CPUtime=3763.97 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 611169 1255 0 0 376290 107 0 0 25 0 5 0 522305320 706568192 160307 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 172502 160307 180 55 0 170388 0
[pid=7755/tid=7762] ppid=7753 vsize=690008 CPUtime=942.24 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 159778 1255 0 0 94195 29 0 0 25 0 5 0 522305324 706568192 160307 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=690008 CPUtime=942.26 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 170559 1255 0 0 94199 27 0 0 25 0 5 0 522305324 706568192 160307 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=690008 CPUtime=937.13 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 158904 1255 0 0 93686 27 0 0 25 0 5 0 522305324 706568192 160307 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=690008 CPUtime=942.26 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 119595 1255 0 0 94204 22 0 0 25 0 5 0 522305324 706568192 160307 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3763.97
Current children cumulated vsize (KiB) 690008

[startup+1002.3 s]
/proc/loadavg: 8.03 8.08 7.97 9/186 7841
/proc/meminfo: memFree=18653188/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=722776 CPUtime=4003.65 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 619361 1255 0 0 400257 108 0 0 25 0 5 0 522305320 740122624 168499 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 180694 168499 180 55 0 178580 0
[pid=7755/tid=7762] ppid=7753 vsize=722776 CPUtime=1002.24 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 167970 1255 0 0 100194 30 0 0 25 0 5 0 522305324 740122624 168499 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364919 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=722776 CPUtime=1002.26 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 170559 1255 0 0 100199 27 0 0 25 0 5 0 522305324 740122624 168499 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=722776 CPUtime=996.8 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 158904 1255 0 0 99653 27 0 0 25 0 5 0 522305324 740122624 168499 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364498 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=722776 CPUtime=1002.26 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 119595 1255 0 0 100204 22 0 0 25 0 5 0 522305324 740122624 168499 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4003.65
Current children cumulated vsize (KiB) 722776

[startup+1062.3 s]
/proc/loadavg: 8.01 8.06 7.97 9/186 7843
/proc/meminfo: memFree=18589556/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=753500 CPUtime=4243.32 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 627042 1255 0 0 424223 109 0 0 25 0 5 0 522305320 771584000 176180 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 188375 176180 180 55 0 186261 0
[pid=7755/tid=7762] ppid=7753 vsize=753500 CPUtime=1062.24 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 167970 1255 0 0 106194 30 0 0 25 0 5 0 522305324 771584000 176180 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=753500 CPUtime=1062.27 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 170559 1255 0 0 106200 27 0 0 25 0 5 0 522305324 771584000 176180 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=753500 CPUtime=1056.48 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 158904 1255 0 0 105621 27 0 0 25 0 5 0 522305324 771584000 176180 33554432000 4194304 4417332 140734319037520 18446744073709551615 4309869 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=753500 CPUtime=1062.27 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 127276 1255 0 0 106203 24 0 0 25 0 5 0 522305324 771584000 176180 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4243.32
Current children cumulated vsize (KiB) 753500

[startup+1122.3 s]
/proc/loadavg: 8.05 8.06 7.97 9/186 7844
/proc/meminfo: memFree=18486000/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=786860 CPUtime=4483 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 665498 1255 0 0 448183 117 0 0 25 0 5 0 522305320 805744640 184520 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 196715 184520 180 55 0 194601 0
[pid=7755/tid=7762] ppid=7753 vsize=786860 CPUtime=1122.24 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 167970 1255 0 0 112194 30 0 0 25 0 5 0 522305324 805744640 184520 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=786860 CPUtime=1122.26 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 187939 1255 0 0 112196 30 0 0 25 0 5 0 522305324 805744640 184520 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=786860 CPUtime=1116.15 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 179980 1255 0 0 111584 31 0 0 25 0 5 0 522305324 805744640 184520 33554432000 4194304 4417332 140734319037520 18446744073709551615 4365007 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=786860 CPUtime=1122.27 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 127276 1255 0 0 112203 24 0 0 25 0 5 0 522305324 805744640 184520 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4483
Current children cumulated vsize (KiB) 786860

[startup+1182.3 s]
/proc/loadavg: 8.06 8.06 7.98 9/186 7846
/proc/meminfo: memFree=18657472/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=684396 CPUtime=4722.68 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 673184 1255 0 0 472149 119 0 0 25 0 5 0 522305320 700821504 158494 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 171099 158494 180 55 0 168985 0
[pid=7755/tid=7762] ppid=7753 vsize=684396 CPUtime=1182.24 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 167970 1255 0 0 118194 30 0 0 25 0 5 0 522305324 700821504 158494 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364957 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=684396 CPUtime=1182.27 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 195625 1255 0 0 118195 32 0 0 25 0 5 0 522305324 700821504 158494 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=684396 CPUtime=1175.83 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 179980 1255 0 0 117552 31 0 0 25 0 5 0 522305324 700821504 158494 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=684396 CPUtime=1182.27 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 127276 1255 0 0 118203 24 0 0 25 0 5 0 522305324 700821504 158494 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4722.68
Current children cumulated vsize (KiB) 684396



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.12 8.07 7.98 9/186 7847
/proc/meminfo: memFree=18658072/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=692052 CPUtime=4800.2 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 675098 1255 0 0 479901 119 0 0 25 0 5 0 522305320 708661248 160408 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 173013 160408 180 55 0 170899 0
[pid=7755/tid=7762] ppid=7753 vsize=692052 CPUtime=1201.65 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 167970 1255 0 0 120135 30 0 0 25 0 5 0 522305324 708661248 160408 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=692052 CPUtime=1201.68 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 197539 1255 0 0 120136 32 0 0 25 0 5 0 522305324 708661248 160408 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=692052 CPUtime=1195.12 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 179980 1255 0 0 119481 31 0 0 25 0 5 0 522305324 708661248 160408 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=692052 CPUtime=1201.68 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 127276 1255 0 0 120144 24 0 0 25 0 5 0 522305324 708661248 160408 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 692052

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.12 8.07 7.98 9/186 7847
/proc/meminfo: memFree=18658072/32950904 swapFree=67082284/67111528
[pid=7755] ppid=7753 vsize=692052 CPUtime=4800.2 cores=1,3,5,7
/proc/7755/stat : 7755 (plingeling) S 7753 7755 7523 0 -1 4202496 675098 1255 0 0 479901 119 0 0 25 0 5 0 522305320 708661248 160408 33554432000 4194304 4417332 140734319037520 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/7755/statm: 173013 160408 180 55 0 170899 0
[pid=7755/tid=7762] ppid=7753 vsize=692052 CPUtime=1201.65 cores=1,3,5,7
/proc/7755/task/7762/stat : 7762 (plingeling) R 7753 7755 7523 0 -1 4202560 167970 1255 0 0 120135 30 0 0 25 0 5 0 522305324 708661248 160408 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=7755/tid=7763] ppid=7753 vsize=692052 CPUtime=1201.68 cores=1,3,5,7
/proc/7755/task/7763/stat : 7763 (plingeling) R 7753 7755 7523 0 -1 4202560 197539 1255 0 0 120136 32 0 0 25 0 5 0 522305324 708661248 160408 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=7755/tid=7764] ppid=7753 vsize=692052 CPUtime=1195.12 cores=1,3,5,7
/proc/7755/task/7764/stat : 7764 (plingeling) R 7753 7755 7523 0 -1 4202560 179980 1255 0 0 119481 31 0 0 25 0 5 0 522305324 708661248 160408 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=7755/tid=7765] ppid=7753 vsize=692052 CPUtime=1201.68 cores=1,3,5,7
/proc/7755/task/7765/stat : 7765 (plingeling) R 7753 7755 7523 0 -1 4202560 127276 1255 0 0 120144 24 0 0 25 0 5 0 522305324 708661248 160408 33554432000 4194304 4417332 140734319037520 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 692052

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.74
CPU time (s): 4800.26
CPU user time (s): 4799.03
CPU system time (s): 1.22381
CPU usage (%): 399.442
Max. virtual memory (cumulated for all children) (KiB): 786860

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.03
system time used= 1.22381
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 676353
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 111
involuntary context switches= 36621

runsolver used 1.81272 second user time and 4.75428 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-29 21:57:36
IDJOB=3265686
IDBENCH=85799
IDSOLVER=1605
FILE ID=node121/3265686-1304107056
RUNJOBID= node121-1304105551-7542
PBS_JOBID= 13170657
Free space on /tmp= 72652 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT05/crafted/sorge05/QG7a/gensys-icl005.shuffled-as.sat05-3826.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3265686-1304107056/watcher-3265686-1304107056 -o /tmp/evaluation-result-3265686-1304107056/solver-3265686-1304107056 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3265686-1304107056.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5d8489e52ec1ef9c7431a7fd60f9ff86
RANDOM SEED=344273536

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      18862408 kB
Buffers:       2184176 kB
Cached:       10273844 kB
SwapCached:       2776 kB
Active:       10202604 kB
Inactive:      3365672 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      18862408 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:             788 kB
Writeback:           0 kB
AnonPages:     1107784 kB
Mapped:          14336 kB
Slab:           455884 kB
PageTables:       6396 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:  1322276 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72652 MiB
End job on node121 at 2011-04-29 22:17:39