Trace number 3262914

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.19 1201.66

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_26_40_6-dir.shuffled-as.sat03-163.cnf
MD5SUMc06088cac8521bfe72bbb4c9ad8d39fb
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables780
Number of clauses66810
Sum of the clauses size134348
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 266784
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 526

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3262914-1304098590/watcher-3262914-1304098590 -o /tmp/evaluation-result-3262914-1304098590/solver-3262914-1304098590 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3262914-1304098590.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.07 8.07 7.93 5/181 1875
/proc/meminfo: memFree=25281212/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=8728 CPUtime=0 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) R 1873 1875 1454 0 -1 4202496 219 1257 0 0 0 0 0 0 25 0 1 0 502274515 8937472 149 33554432000 4194304 4417332 140734828431328 18446744073709551615 228095494279 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1875/statm: 2182 149 125 55 0 68 0

[startup+0.120428 s]
/proc/loadavg: 8.07 8.07 7.93 5/181 1875
/proc/meminfo: memFree=25281212/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=126864 CPUtime=0.31 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 4154 1257 0 0 31 0 0 0 25 0 5 0 502274515 129908736 3129 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 31972 3145 177 55 0 29858 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 126864

[startup+0.200804 s]
/proc/loadavg: 8.07 8.07 7.93 5/181 1875
/proc/meminfo: memFree=25281212/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=127264 CPUtime=0.64 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 5164 1257 0 0 64 0 0 0 25 0 5 0 502274515 130318336 3229 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 31816 3229 177 55 0 29702 0
Current children cumulated CPU time (s) 0.64
Current children cumulated vsize (KiB) 127264

[startup+0.300785 s]
/proc/loadavg: 8.07 8.07 7.93 5/181 1875
/proc/meminfo: memFree=25281212/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=129828 CPUtime=1.04 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 5896 1257 0 0 104 0 0 0 25 0 5 0 502274515 132943872 3874 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 32457 3874 181 55 0 30343 0
Current children cumulated CPU time (s) 1.04
Current children cumulated vsize (KiB) 129828

[startup+0.700709 s]
/proc/loadavg: 8.07 8.07 7.93 5/181 1875
/proc/meminfo: memFree=25281212/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=133984 CPUtime=2.63 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 7576 1257 0 0 263 0 0 0 25 0 5 0 502274515 137199616 4913 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 33496 4913 181 55 0 31382 0
Current children cumulated CPU time (s) 2.63
Current children cumulated vsize (KiB) 133984

[startup+1.50056 s]
/proc/loadavg: 8.07 8.07 7.93 9/186 1885
/proc/meminfo: memFree=25273120/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=138640 CPUtime=5.83 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 9863 1257 0 0 582 1 0 0 25 0 5 0 502274515 141967360 6077 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 34660 6077 181 55 0 32546 0
[pid=1875/tid=1882] ppid=1873 vsize=138640 CPUtime=1.45 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 867 1257 0 0 145 0 0 0 25 0 5 0 502274520 141967360 6077 33554432000 4194304 4417332 140734828431328 18446744073709551615 4250082 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=138640 CPUtime=1.44 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 623 1257 0 0 144 0 0 0 25 0 5 0 502274520 141967360 6077 33554432000 4194304 4417332 140734828431328 18446744073709551615 4337230 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=138640 CPUtime=1.44 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 687 1257 0 0 144 0 0 0 25 0 5 0 502274520 141967360 6077 33554432000 4194304 4417332 140734828431328 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=138640 CPUtime=1.44 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 5198 1257 0 0 143 1 0 0 25 0 5 0 502274520 141967360 6077 33554432000 4194304 4417332 140734828431328 18446744073709551615 4250532 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.83
Current children cumulated vsize (KiB) 138640

[startup+3.10027 s]
/proc/loadavg: 8.07 8.07 7.93 9/186 1885
/proc/meminfo: memFree=25259480/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=149332 CPUtime=12.23 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 16105 1257 0 0 1221 2 0 0 25 0 5 0 502274515 152915968 8792 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 37333 8792 181 55 0 35219 0
[pid=1875/tid=1882] ppid=1873 vsize=149332 CPUtime=3.05 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 1271 1257 0 0 305 0 0 0 25 0 5 0 502274520 152915968 8792 33554432000 4194304 4417332 140734828431328 18446744073709551615 4250058 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=149332 CPUtime=3.04 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 1027 1257 0 0 304 0 0 0 25 0 5 0 502274520 152915968 8792 33554432000 4194304 4417332 140734828431328 18446744073709551615 4250010 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=149332 CPUtime=3.04 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 1207 1257 0 0 304 0 0 0 25 0 5 0 502274520 152915968 8792 33554432000 4194304 4417332 140734828431328 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=149332 CPUtime=3.02 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 10112 1257 0 0 301 1 0 0 25 0 5 0 502274520 152915968 8792 33554432000 4194304 4417332 140734828431328 18446744073709551615 4352309 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.23
Current children cumulated vsize (KiB) 149332

[startup+6.30068 s]
/proc/loadavg: 8.06 8.06 7.93 9/186 1885
/proc/meminfo: memFree=25259364/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=163644 CPUtime=25.02 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 28301 1257 0 0 2498 4 0 0 25 0 5 0 502274515 167571456 12359 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 40911 12359 181 55 0 38797 0
[pid=1875/tid=1882] ppid=1873 vsize=163644 CPUtime=6.25 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 1619 1257 0 0 625 0 0 0 25 0 5 0 502274520 167571456 12359 33554432000 4194304 4417332 140734828431328 18446744073709551615 4365039 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=163644 CPUtime=6.24 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 1272 1257 0 0 624 0 0 0 25 0 5 0 502274520 167571456 12359 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364487 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=163644 CPUtime=6.24 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 4190 1257 0 0 624 0 0 0 25 0 5 0 502274520 167571456 12359 33554432000 4194304 4417332 140734828431328 18446744073709551615 4366303 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=163644 CPUtime=6.22 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 18732 1257 0 0 619 3 0 0 25 0 5 0 502274520 167571456 12359 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.02
Current children cumulated vsize (KiB) 163644

[startup+12.7005 s]
/proc/loadavg: 8.14 8.08 7.93 9/186 1885
/proc/meminfo: memFree=25248440/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=179932 CPUtime=50.58 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 51550 1257 0 0 5051 7 0 0 25 0 5 0 502274515 184250368 16431 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 44983 16431 181 55 0 42869 0
[pid=1875/tid=1882] ppid=1873 vsize=179932 CPUtime=12.64 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 6754 1257 0 0 1264 0 0 0 25 0 5 0 502274520 184250368 16431 33554432000 4194304 4417332 140734828431328 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=179932 CPUtime=12.64 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 4289 1257 0 0 1264 0 0 0 25 0 5 0 502274520 184250368 16431 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=179932 CPUtime=12.64 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 8881 1257 0 0 1263 1 0 0 25 0 5 0 502274520 184250368 16431 33554432000 4194304 4417332 140734828431328 18446744073709551615 4258589 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=179932 CPUtime=12.59 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 29138 1257 0 0 1254 5 0 0 25 0 5 0 502274520 184250368 16431 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364957 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.58
Current children cumulated vsize (KiB) 179932

[startup+25.5011 s]
/proc/loadavg: 8.11 8.08 7.93 9/186 1886
/proc/meminfo: memFree=25184208/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=236884 CPUtime=101.72 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 91777 1257 0 0 10158 14 0 0 25 0 5 0 502274515 242569216 30669 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 59221 30669 181 55 0 57107 0
[pid=1875/tid=1882] ppid=1873 vsize=236884 CPUtime=25.44 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 14136 1257 0 0 2542 2 0 0 25 0 5 0 502274520 242569216 30669 33554432000 4194304 4417332 140734828431328 18446744073709551615 4290678 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=236884 CPUtime=25.45 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 14685 1257 0 0 2543 2 0 0 25 0 5 0 502274520 242569216 30669 33554432000 4194304 4417332 140734828431328 18446744073709551615 4236559 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=236884 CPUtime=25.44 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 17100 1257 0 0 2542 2 0 0 25 0 5 0 502274520 242569216 30669 33554432000 4194304 4417332 140734828431328 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=236884 CPUtime=25.32 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 43368 1257 0 0 2525 7 0 0 25 0 5 0 502274520 242569216 30669 33554432000 4194304 4417332 140734828431328 18446744073709551615 4356864 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.72
Current children cumulated vsize (KiB) 236884

[startup+51.1004 s]
/proc/loadavg: 8.07 8.07 7.93 9/186 1886
/proc/meminfo: memFree=25115340/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=303424 CPUtime=203.99 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 156779 1257 0 0 20375 24 0 0 25 0 5 0 502274515 310706176 47304 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 75856 47304 181 55 0 73742 0
[pid=1875/tid=1882] ppid=1873 vsize=303424 CPUtime=51.04 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 22054 1257 0 0 5102 2 0 0 25 0 5 0 502274520 310706176 47304 33554432000 4194304 4417332 140734828431328 18446744073709551615 4357456 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=303424 CPUtime=51.04 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 31913 1257 0 0 5099 5 0 0 25 0 5 0 502274520 310706176 47304 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=303424 CPUtime=51.04 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 37851 1257 0 0 5098 6 0 0 25 0 5 0 502274520 310706176 47304 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=303424 CPUtime=50.8 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 62473 1257 0 0 5070 10 0 0 25 0 5 0 502274520 310706176 47304 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.99
Current children cumulated vsize (KiB) 303424

[startup+102.301 s]
/proc/loadavg: 8.14 8.09 7.94 9/186 1888
/proc/meminfo: memFree=24939124/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=432448 CPUtime=408.55 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 288766 1257 0 0 40812 43 0 0 25 0 5 0 502274515 442826752 79560 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 108112 79560 181 55 0 105998 0
[pid=1875/tid=1882] ppid=1873 vsize=432448 CPUtime=102.24 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 55270 1257 0 0 10217 7 0 0 25 0 5 0 502274520 442826752 79560 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=432448 CPUtime=102.25 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 62797 1257 0 0 10216 9 0 0 25 0 5 0 502274520 442826752 79560 33554432000 4194304 4417332 140734828431328 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=432448 CPUtime=102.25 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 79036 1257 0 0 10213 12 0 0 25 0 5 0 502274520 442826752 79560 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=432448 CPUtime=101.74 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 89175 1257 0 0 10161 13 0 0 25 0 5 0 502274520 442826752 79560 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.55
Current children cumulated vsize (KiB) 432448

[startup+162.301 s]
/proc/loadavg: 8.11 8.08 7.95 9/186 1889
/proc/meminfo: memFree=24819816/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=508504 CPUtime=648.22 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 420571 1257 0 0 64757 65 0 0 25 0 5 0 502274515 520708096 98574 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 127126 98574 181 55 0 125012 0
[pid=1875/tid=1882] ppid=1873 vsize=508504 CPUtime=162.22 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 93205 1257 0 0 16209 13 0 0 25 0 5 0 502274520 520708096 98574 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=508504 CPUtime=162.25 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 99113 1257 0 0 16210 15 0 0 25 0 5 0 502274520 520708096 98574 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=508504 CPUtime=162.24 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 110328 1257 0 0 16207 17 0 0 25 0 5 0 502274520 520708096 98574 33554432000 4194304 4417332 140734828431328 18446744073709551615 4247481 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=508504 CPUtime=161.43 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 115437 1257 0 0 16125 18 0 0 25 0 5 0 502274520 520708096 98574 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 648.22
Current children cumulated vsize (KiB) 508504


################
# More data... #
################

[pid=1875/tid=1883] ppid=1873 vsize=1086040 CPUtime=762.27 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 459441 1257 0 0 76159 68 0 0 25 0 5 0 502274520 1112104960 242990 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=1086040 CPUtime=762.27 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 413234 1257 0 0 76164 63 0 0 25 0 5 0 502274520 1112104960 242990 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=1086040 CPUtime=758.29 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 270071 1257 0 0 75789 40 0 0 25 0 5 0 502274520 1112104960 242990 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3045.07
Current children cumulated vsize (KiB) 1086040

[startup+822.301 s]
/proc/loadavg: 8.13 8.09 8.00 9/186 1907
/proc/meminfo: memFree=23895172/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=1176436 CPUtime=3284.73 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 1537573 1257 0 0 328243 230 0 0 25 0 5 0 502274515 1204670464 265557 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 294109 265557 181 55 0 291995 0
[pid=1875/tid=1882] ppid=1873 vsize=1176436 CPUtime=822.16 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 365542 1257 0 0 82163 53 0 0 25 0 5 0 502274520 1204670464 265557 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=1176436 CPUtime=822.26 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 472691 1257 0 0 82157 69 0 0 25 0 5 0 502274520 1204670464 265557 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=1176436 CPUtime=822.27 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 424086 1257 0 0 82162 65 0 0 25 0 5 0 502274520 1204670464 265557 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=1176436 CPUtime=817.97 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 272766 1257 0 0 81756 41 0 0 25 0 5 0 502274520 1204670464 265557 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3284.73
Current children cumulated vsize (KiB) 1176436

[startup+882.307 s]
/proc/loadavg: 8.18 8.11 8.01 9/186 1909
/proc/meminfo: memFree=24007980/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=1010068 CPUtime=3524.43 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 1555829 1257 0 0 352210 233 0 0 25 0 5 0 502274515 1034309632 223965 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 252517 223965 181 55 0 250403 0
[pid=1875/tid=1882] ppid=1873 vsize=1010068 CPUtime=882.16 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 371909 1257 0 0 88162 54 0 0 25 0 5 0 502274520 1034309632 223965 33554432000 4194304 4417332 140734828431328 18446744073709551615 4307993 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=1010068 CPUtime=882.27 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 472691 1257 0 0 88158 69 0 0 25 0 5 0 502274520 1034309632 223965 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=1010068 CPUtime=882.28 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 433483 1257 0 0 88162 66 0 0 25 0 5 0 502274520 1034309632 223965 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=1010068 CPUtime=877.65 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 275258 1257 0 0 87723 42 0 0 25 0 5 0 502274520 1034309632 223965 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3524.43
Current children cumulated vsize (KiB) 1010068

[startup+942.301 s]
/proc/loadavg: 8.19 8.12 8.01 9/186 1910
/proc/meminfo: memFree=23781912/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=1252020 CPUtime=3764.1 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 1680380 1257 0 0 376158 252 0 0 25 0 5 0 502274515 1282068480 284483 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 313005 284483 181 55 0 310891 0
[pid=1875/tid=1882] ppid=1873 vsize=1252020 CPUtime=942.15 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 427946 1257 0 0 94153 62 0 0 25 0 5 0 502274520 1282068480 284483 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=1252020 CPUtime=942.26 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 506880 1257 0 0 94152 74 0 0 25 0 5 0 502274520 1282068480 284483 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=1252020 CPUtime=942.27 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 452549 1257 0 0 94159 68 0 0 25 0 5 0 502274520 1282068480 284483 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=1252020 CPUtime=937.34 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 290517 1257 0 0 93688 46 0 0 25 0 5 0 502274520 1282068480 284483 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3764.1
Current children cumulated vsize (KiB) 1252020

[startup+1002.3 s]
/proc/loadavg: 7.50 7.98 7.97 5/176 1930
/proc/meminfo: memFree=24350052/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=1387724 CPUtime=4003.78 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 1768390 1257 0 0 400112 266 0 0 25 0 5 0 502274515 1421029376 318409 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 346931 318409 181 55 0 344817 0
[pid=1875/tid=1882] ppid=1873 vsize=1387724 CPUtime=1002.14 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 444330 1257 0 0 100149 65 0 0 25 0 5 0 502274520 1421029376 318409 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=1387724 CPUtime=1002.26 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 533163 1257 0 0 100147 79 0 0 25 0 5 0 502274520 1421029376 318409 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=1387724 CPUtime=1002.27 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 477125 1257 0 0 100156 71 0 0 25 0 5 0 502274520 1421029376 318409 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=1387724 CPUtime=997.02 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 311284 1257 0 0 99654 48 0 0 25 0 5 0 502274520 1421029376 318409 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4003.78
Current children cumulated vsize (KiB) 1387724

[startup+1062.3 s]
/proc/loadavg: 5.34 7.27 7.73 5/176 1931
/proc/meminfo: memFree=24365556/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=1372112 CPUtime=4243.52 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 1846407 1257 0 0 424074 278 0 0 25 0 5 0 502274515 1405042688 314506 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 343028 314506 181 55 0 340914 0
[pid=1875/tid=1882] ppid=1873 vsize=1372112 CPUtime=1062.14 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 485290 1257 0 0 106143 71 0 0 25 0 5 0 502274520 1405042688 314506 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=1372112 CPUtime=1062.27 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 541355 1257 0 0 106146 81 0 0 25 0 5 0 502274520 1405042688 314506 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=1372112 CPUtime=1062.27 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 501701 1257 0 0 106152 75 0 0 25 0 5 0 502274520 1405042688 314506 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=1372112 CPUtime=1056.76 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 315573 1257 0 0 105627 49 0 0 25 0 5 0 502274520 1405042688 314506 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4243.52
Current children cumulated vsize (KiB) 1372112

[startup+1122.3 s]
/proc/loadavg: 4.49 6.67 7.49 5/176 1933
/proc/meminfo: memFree=24385312/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=1353400 CPUtime=4483.25 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 1895913 1257 0 0 448041 284 0 0 25 0 5 0 502274515 1385881600 309828 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 338350 309828 181 55 0 336236 0
[pid=1875/tid=1882] ppid=1873 vsize=1353400 CPUtime=1122.13 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 501674 1257 0 0 112140 73 0 0 25 0 5 0 502274520 1385881600 309828 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=1353400 CPUtime=1122.28 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 541709 1257 0 0 112146 82 0 0 25 0 5 0 502274520 1385881600 309828 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=1353400 CPUtime=1122.28 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 526277 1257 0 0 112150 78 0 0 25 0 5 0 502274520 1385881600 309828 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=1353400 CPUtime=1116.49 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 323765 1257 0 0 111599 50 0 0 25 0 5 0 502274520 1385881600 309828 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364590 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4483.25
Current children cumulated vsize (KiB) 1353400

[startup+1182.3 s]
/proc/loadavg: 4.23 6.19 7.27 5/176 1935
/proc/meminfo: memFree=24571856/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=1167516 CPUtime=4722.98 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 1925399 1257 0 0 472009 289 0 0 25 0 5 0 502274515 1195536384 263359 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 291879 263359 181 55 0 289765 0
[pid=1875/tid=1882] ppid=1873 vsize=1167516 CPUtime=1182.13 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 512464 1257 0 0 118137 76 0 0 25 0 5 0 502274520 1195536384 263359 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=1167516 CPUtime=1182.27 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 544021 1257 0 0 118145 82 0 0 25 0 5 0 502274520 1195536384 263359 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=1167516 CPUtime=1182.28 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 542661 1257 0 0 118148 80 0 0 25 0 5 0 502274520 1195536384 263359 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=1167516 CPUtime=1176.22 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 323765 1257 0 0 117572 50 0 0 25 0 5 0 502274520 1195536384 263359 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4722.98
Current children cumulated vsize (KiB) 1167516



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.6 s]
/proc/loadavg: 4.16 6.05 7.20 5/176 1935
/proc/meminfo: memFree=24548016/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=1190968 CPUtime=4800.09 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 1945444 1257 0 0 479717 292 0 0 25 0 5 0 502274515 1219551232 269222 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 297742 269222 181 55 0 295628 0
[pid=1875/tid=1882] ppid=1873 vsize=1190968 CPUtime=1201.43 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 512873 1257 0 0 120067 76 0 0 25 0 5 0 502274520 1219551232 269222 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=1190968 CPUtime=1201.58 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 563657 1257 0 0 120073 85 0 0 25 0 5 0 502274520 1219551232 269222 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=1190968 CPUtime=1201.59 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 542661 1257 0 0 120079 80 0 0 25 0 5 0 502274520 1219551232 269222 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=1190968 CPUtime=1195.43 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 323765 1257 0 0 119493 50 0 0 25 0 5 0 502274520 1219551232 269222 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 1190968

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.6 s]
/proc/loadavg: 4.16 6.05 7.20 5/176 1935
/proc/meminfo: memFree=24548016/32951124 swapFree=67111524/67111528
[pid=1875] ppid=1873 vsize=1190968 CPUtime=4800.09 cores=0,2,4,6
/proc/1875/stat : 1875 (plingeling) S 1873 1875 1454 0 -1 4202496 1945444 1257 0 0 479717 292 0 0 25 0 5 0 502274515 1219551232 269222 33554432000 4194304 4417332 140734828431328 18446744073709551615 228107253733 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/1875/statm: 297742 269222 181 55 0 295628 0
[pid=1875/tid=1882] ppid=1873 vsize=1190968 CPUtime=1201.43 cores=0,2,4,6
/proc/1875/task/1882/stat : 1882 (plingeling) R 1873 1875 1454 0 -1 4202560 512873 1257 0 0 120067 76 0 0 25 0 5 0 502274520 1219551232 269222 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=1875/tid=1883] ppid=1873 vsize=1190968 CPUtime=1201.58 cores=0,2,4,6
/proc/1875/task/1883/stat : 1883 (plingeling) R 1873 1875 1454 0 -1 4202560 563657 1257 0 0 120073 85 0 0 25 0 5 0 502274520 1219551232 269222 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1875/tid=1884] ppid=1873 vsize=1190968 CPUtime=1201.59 cores=0,2,4,6
/proc/1875/task/1884/stat : 1884 (plingeling) R 1873 1875 1454 0 -1 4202560 542661 1257 0 0 120079 80 0 0 25 0 5 0 502274520 1219551232 269222 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=1875/tid=1885] ppid=1873 vsize=1190968 CPUtime=1195.43 cores=0,2,4,6
/proc/1875/task/1885/stat : 1885 (plingeling) R 1873 1875 1454 0 -1 4202560 323765 1257 0 0 119493 50 0 0 25 0 5 0 502274520 1219551232 269222 33554432000 4194304 4417332 140734828431328 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 1190968

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.66
CPU time (s): 4800.19
CPU user time (s): 4797.21
CPU system time (s): 2.97955
CPU usage (%): 399.463
Max. virtual memory (cumulated for all children) (KiB): 1437648

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.21
system time used= 2.97955
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1946702
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 120
involuntary context switches= 23970

runsolver used 1.81472 second user time and 4.34734 second system time

The end

Launcher Data 

Begin job on node142 at 2011-04-29 19:36:30
IDJOB=3262914
IDBENCH=83903
IDSOLVER=1605
FILE ID=node142/3262914-1304098590
RUNJOBID= node142-1304095973-1472
PBS_JOBID= 13170602
Free space on /tmp= 71312 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_26_40_6-dir.shuffled-as.sat03-163.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3262914-1304098590/watcher-3262914-1304098590 -o /tmp/evaluation-result-3262914-1304098590/solver-3262914-1304098590 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3262914-1304098590.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c06088cac8521bfe72bbb4c9ad8d39fb
RANDOM SEED=854102810

node142.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5131.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25281492 kB
Buffers:       1679696 kB
Cached:        5039628 kB
SwapCached:          4 kB
Active:        1216456 kB
Inactive:      5911756 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25281492 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             776 kB
Writeback:           0 kB
AnonPages:      408708 kB
Mapped:          15248 kB
Slab:           477992 kB
PageTables:       5404 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   591660 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71312 MiB
End job on node142 at 2011-04-29 19:56:34