Trace number 3285297

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.36 1202.58

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf
MD5SUM36e8e2178d03f08fa4223da0e3d9beb5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark539.975
Satisfiable
(Un)Satisfiability was proved
Number of variables87884
Number of clauses1413816
Sum of the clauses size3227576
Maximum clause length78
Minimum clause length1
Number of clauses of size 1696
Number of clauses of size 21364160
Number of clauses of size 33840
Number of clauses of size 417760
Number of clauses of size 57680
Number of clauses of size over 519680

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3285297-1304059410/watcher-3285297-1304059410 -o /tmp/evaluation-result-3285297-1304059410/solver-3285297-1304059410 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3285297-1304059410.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.13 8.08 8.00 5/181 31286
/proc/meminfo: memFree=13880712/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=10712 CPUtime=0 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) R 31284 31286 31098 0 -1 4202496 735 1261 0 0 0 0 0 0 23 0 1 0 517540746 10969088 664 33554432000 4194304 4417332 140734537484736 18446744073709551615 274473328388 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/31286/statm: 2678 664 143 55 0 564 0

[startup+0.0799651 s]
/proc/loadavg: 8.13 8.08 8.00 5/181 31286
/proc/meminfo: memFree=13880712/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=16008 CPUtime=0.07 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) R 31284 31286 31098 0 -1 4202496 2108 1261 0 0 7 0 0 0 24 0 1 0 517540746 16392192 2025 33554432000 4194304 4417332 140734537484736 18446744073709551615 274473967360 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/31286/statm: 4002 2025 148 55 0 1888 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 16008

[startup+0.10096 s]
/proc/loadavg: 8.13 8.08 8.00 5/181 31286
/proc/meminfo: memFree=13880712/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=16200 CPUtime=0.09 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) R 31284 31286 31098 0 -1 4202496 2140 1261 0 0 9 0 0 0 24 0 1 0 517540746 16588800 2057 33554432000 4194304 4417332 140734537484736 18446744073709551615 274473586224 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/31286/statm: 4050 2057 148 55 0 1936 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 16200

[startup+0.30093 s]
/proc/loadavg: 8.13 8.08 8.00 5/181 31286
/proc/meminfo: memFree=13880712/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=40944 CPUtime=0.29 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) R 31284 31286 31098 0 -1 4202496 8350 1261 0 0 28 1 0 0 25 0 1 0 517540746 41926656 8259 33554432000 4194304 4417332 140734537484736 18446744073709551615 4323407 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/31286/statm: 10236 8259 148 55 0 8122 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 40944

[startup+0.700858 s]
/proc/loadavg: 8.13 8.08 8.00 5/181 31286
/proc/meminfo: memFree=13880712/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=68592 CPUtime=0.69 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) R 31284 31286 31098 0 -1 4202496 15262 1261 0 0 66 3 0 0 25 0 1 0 517540746 70238208 15171 33554432000 4194304 4417332 140734537484736 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/31286/statm: 17148 15171 148 55 0 15034 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 68592

[startup+1.50072 s]
/proc/loadavg: 8.13 8.08 8.00 6/182 31292
/proc/meminfo: memFree=13764656/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=213404 CPUtime=2.73 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 36270 1261 0 0 267 6 0 0 25 0 5 0 517540746 218525696 25563 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 53351 25563 173 55 0 51237 0
Current children cumulated CPU time (s) 2.73
Current children cumulated vsize (KiB) 213404

[startup+3.10044 s]
/proc/loadavg: 8.12 8.08 8.00 9/186 31297
/proc/meminfo: memFree=13767496/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=224788 CPUtime=9.12 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 41173 1261 0 0 906 6 0 0 25 0 5 0 517540746 230182912 28412 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 56197 28412 176 55 0 54083 0
[pid=31286/tid=31293] ppid=31284 vsize=224788 CPUtime=2.01 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 2731 1261 0 0 201 0 0 0 25 0 5 0 517540854 230182912 28412 33554432000 4194304 4417332 140734537484736 18446744073709551615 4281230 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=224788 CPUtime=2 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 3734 1261 0 0 200 0 0 0 25 0 5 0 517540854 230182912 28412 33554432000 4194304 4417332 140734537484736 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=224788 CPUtime=2 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 4322 1261 0 0 200 0 0 0 25 0 5 0 517540854 230182912 28412 33554432000 4194304 4417332 140734537484736 18446744073709551615 4317317 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=224788 CPUtime=2.01 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 1223 1261 0 0 201 0 0 0 25 0 5 0 517540854 230182912 28412 33554432000 4194304 4417332 140734537484736 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 9.12
Current children cumulated vsize (KiB) 224788

[startup+6.30088 s]
/proc/loadavg: 8.12 8.08 8.00 9/186 31297
/proc/meminfo: memFree=13754352/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=232224 CPUtime=21.91 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 50190 1261 0 0 2183 8 0 0 25 0 5 0 517540746 237797376 30007 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 58056 30007 180 55 0 55942 0
[pid=31286/tid=31293] ppid=31284 vsize=232224 CPUtime=5.21 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 10699 1261 0 0 520 1 0 0 25 0 5 0 517540854 237797376 30007 33554432000 4194304 4417332 140734537484736 18446744073709551615 4232680 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=232224 CPUtime=5.18 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 3756 1261 0 0 518 0 0 0 25 0 5 0 517540854 237797376 30007 33554432000 4194304 4417332 140734537484736 18446744073709551615 4357853 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=232224 CPUtime=5.2 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 5349 1261 0 0 520 0 0 0 25 0 5 0 517540854 237797376 30007 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=232224 CPUtime=5.21 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 1223 1261 0 0 521 0 0 0 25 0 5 0 517540854 237797376 30007 33554432000 4194304 4417332 140734537484736 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 21.91
Current children cumulated vsize (KiB) 232224

[startup+12.7008 s]
/proc/loadavg: 8.10 8.07 8.00 10/186 31297
/proc/meminfo: memFree=13745572/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=239008 CPUtime=47.47 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 53227 1261 0 0 4739 8 0 0 25 0 5 0 517540746 244744192 32806 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 59752 32806 180 55 0 57638 0
[pid=31286/tid=31293] ppid=31284 vsize=239008 CPUtime=11.6 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 11167 1261 0 0 1159 1 0 0 25 0 5 0 517540854 244744192 32806 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=239008 CPUtime=11.54 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 3950 1261 0 0 1154 0 0 0 25 0 5 0 517540854 244744192 32806 33554432000 4194304 4417332 140734537484736 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=239008 CPUtime=11.6 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 5844 1261 0 0 1160 0 0 0 25 0 5 0 517540854 244744192 32806 33554432000 4194304 4417332 140734537484736 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=239008 CPUtime=11.6 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 3103 1261 0 0 1160 0 0 0 25 0 5 0 517540854 244744192 32806 33554432000 4194304 4417332 140734537484736 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 47.47
Current children cumulated vsize (KiB) 239008

[startup+25.5005 s]
/proc/loadavg: 8.09 8.07 8.00 9/186 31297
/proc/meminfo: memFree=13691864/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=276128 CPUtime=98.6 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 62507 1261 0 0 9851 9 0 0 25 0 5 0 517540746 282755072 42022 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 69032 42022 180 55 0 66918 0
[pid=31286/tid=31293] ppid=31284 vsize=276128 CPUtime=24.4 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 12790 1261 0 0 2439 1 0 0 25 0 5 0 517540854 282755072 42022 33554432000 4194304 4417332 140734537484736 18446744073709551615 4251096 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=276128 CPUtime=24.27 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 4392 1261 0 0 2427 0 0 0 25 0 5 0 517540854 282755072 42022 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=276128 CPUtime=24.4 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 7544 1261 0 0 2440 0 0 0 25 0 5 0 517540854 282755072 42022 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=276128 CPUtime=24.41 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 8618 1261 0 0 2440 1 0 0 25 0 5 0 517540854 282755072 42022 33554432000 4194304 4417332 140734537484736 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 98.6
Current children cumulated vsize (KiB) 276128

[startup+51.101 s]
/proc/loadavg: 8.13 8.08 8.00 9/186 31298
/proc/meminfo: memFree=13631364/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=348320 CPUtime=200.86 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 80830 1261 0 0 20074 12 0 0 25 0 5 0 517540746 356679680 60071 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 87080 60071 181 55 0 84966 0
[pid=31286/tid=31293] ppid=31284 vsize=348320 CPUtime=50.01 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 17857 1261 0 0 4999 2 0 0 25 0 5 0 517540854 356679680 60071 33554432000 4194304 4417332 140734537484736 18446744073709551615 4357164 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=348320 CPUtime=49.74 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 7792 1261 0 0 4973 1 0 0 25 0 5 0 517540854 356679680 60071 33554432000 4194304 4417332 140734537484736 18446744073709551615 4358020 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=348320 CPUtime=50.01 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 8885 1261 0 0 5000 1 0 0 25 0 5 0 517540854 356679680 60071 33554432000 4194304 4417332 140734537484736 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=348320 CPUtime=50.01 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 17133 1261 0 0 4999 2 0 0 25 0 5 0 517540854 356679680 60071 33554432000 4194304 4417332 140734537484736 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 200.86
Current children cumulated vsize (KiB) 348320

[startup+102.307 s]
/proc/loadavg: 7.88 8.03 7.99 6/179 31321
/proc/meminfo: memFree=14807200/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=392028 CPUtime=405.4 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 94021 1261 0 0 40527 13 0 0 25 0 5 0 517540746 401436672 70998 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 98007 70998 181 55 0 95893 0
[pid=31286/tid=31293] ppid=31284 vsize=392028 CPUtime=101.21 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 19915 1261 0 0 10119 2 0 0 25 0 5 0 517540854 401436672 70998 33554432000 4194304 4417332 140734537484736 18446744073709551615 4250488 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=392028 CPUtime=100.66 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 8959 1261 0 0 10065 1 0 0 25 0 5 0 517540854 401436672 70998 33554432000 4194304 4417332 140734537484736 18446744073709551615 4250505 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=392028 CPUtime=101.21 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 14126 1261 0 0 10120 1 0 0 25 0 5 0 517540854 401436672 70998 33554432000 4194304 4417332 140734537484736 18446744073709551615 4356980 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=392028 CPUtime=101.21 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 21858 1261 0 0 10119 2 0 0 25 0 5 0 517540854 401436672 70998 33554432000 4194304 4417332 140734537484736 18446744073709551615 4356788 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 405.4
Current children cumulated vsize (KiB) 392028

[startup+162.3 s]
/proc/loadavg: 7.95 8.02 7.99 9/186 31338
/proc/meminfo: memFree=13955648/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=441072 CPUtime=645.06 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 113890 1261 0 0 64491 15 0 0 25 0 5 0 517540746 451657728 84391 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 110268 84391 181 55 0 108154 0
[pid=31286/tid=31293] ppid=31284 vsize=441072 CPUtime=161.21 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 27088 1261 0 0 16118 3 0 0 25 0 5 0 517540854 451657728 84391 33554432000 4194304 4417332 140734537484736 18446744073709551615 4365977 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=441072 CPUtime=160.33 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 12687 1261 0 0 16032 1 0 0 25 0 5 0 517540854 451657728 84391 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=441072 CPUtime=161.2 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 15604 1261 0 0 16119 1 0 0 25 0 5 0 517540854 451657728 84391 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=441072 CPUtime=161.21 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 29348 1261 0 0 16118 3 0 0 25 0 5 0 517540854 451657728 84391 33554432000 4194304 4417332 140734537484736 18446744073709551615 4356756 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 645.06
Current children cumulated vsize (KiB) 441072

[startup+222.301 s]
/proc/loadavg: 7.98 8.02 7.99 9/186 31339
/proc/meminfo: memFree=13796380/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=565772 CPUtime=884.73 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 157084 1261 0 0 88453 20 0 0 25 0 5 0 517540746 579350528 115175 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 141443 115175 181 55 0 139329 0
[pid=31286/tid=31293] ppid=31284 vsize=565772 CPUtime=221.21 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 39827 1261 0 0 22116 5 0 0 25 0 5 0 517540854 579350528 115175 33554432000 4194304 4417332 140734537484736 18446744073709551615 4309952 0 0 4096 17442 0 0 0 -1 1 0 0 0

################
# More data... #
################

[pid=31286/tid=31294] ppid=31284 vsize=1344280 CPUtime=757.07 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 36605 1261 0 0 75703 4 0 0 25 0 5 0 517540854 1376542720 311915 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=1344280 CPUtime=761.22 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 57845 1261 0 0 76116 6 0 0 25 0 5 0 517540854 1376542720 311915 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=1344280 CPUtime=761.22 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 496650 1261 0 0 76048 74 0 0 25 0 5 0 517540854 1376542720 311915 33554432000 4194304 4417332 140734537484736 18446744073709551615 4366475 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3041.85
Current children cumulated vsize (KiB) 1344280

[startup+822.3 s]
/proc/loadavg: 8.18 8.04 8.00 9/186 31391
/proc/meminfo: memFree=13047388/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=1344280 CPUtime=3281.5 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 739682 1261 0 0 328042 108 0 0 25 0 5 0 517540746 1376542720 311373 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 336070 311373 181 55 0 333956 0
[pid=31286/tid=31293] ppid=31284 vsize=1344280 CPUtime=821.22 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 119387 1261 0 0 82105 17 0 0 25 0 5 0 517540854 1376542720 311373 33554432000 4194304 4417332 140734537484736 18446744073709551615 4255662 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=1344280 CPUtime=816.74 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 36605 1261 0 0 81670 4 0 0 25 0 5 0 517540854 1376542720 311373 33554432000 4194304 4417332 140734537484736 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=1344280 CPUtime=821.21 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 57877 1261 0 0 82115 6 0 0 25 0 5 0 517540854 1376542720 311373 33554432000 4194304 4417332 140734537484736 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=1344280 CPUtime=821.22 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 496650 1261 0 0 82048 74 0 0 25 0 5 0 517540854 1376542720 311373 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3281.5
Current children cumulated vsize (KiB) 1344280

[startup+882.301 s]
/proc/loadavg: 8.19 8.06 8.01 9/186 31393
/proc/meminfo: memFree=12948532/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=1344400 CPUtime=3521.17 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 742224 1261 0 0 352009 108 0 0 25 0 5 0 517540746 1376665600 312110 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 336100 312110 181 55 0 333986 0
[pid=31286/tid=31293] ppid=31284 vsize=1344400 CPUtime=881.22 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 121893 1261 0 0 88105 17 0 0 25 0 5 0 517540854 1376665600 312110 33554432000 4194304 4417332 140734537484736 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=1344400 CPUtime=876.41 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 36641 1261 0 0 87637 4 0 0 25 0 5 0 517540854 1376665600 312110 33554432000 4194304 4417332 140734537484736 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=1344400 CPUtime=881.21 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 57877 1261 0 0 88115 6 0 0 25 0 5 0 517540854 1376665600 312110 33554432000 4194304 4417332 140734537484736 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=1344400 CPUtime=881.22 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 496650 1261 0 0 88048 74 0 0 25 0 5 0 517540854 1376665600 312110 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3521.17
Current children cumulated vsize (KiB) 1344400

[startup+942.301 s]
/proc/loadavg: 8.19 8.08 8.01 9/186 31395
/proc/meminfo: memFree=13406188/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=893120 CPUtime=3760.86 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 781466 1261 0 0 375968 118 0 0 25 0 5 0 517540746 914554880 199307 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 223280 199307 181 55 0 221166 0
[pid=31286/tid=31293] ppid=31284 vsize=893120 CPUtime=941.22 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 122703 1261 0 0 94105 17 0 0 25 0 5 0 517540854 914554880 199307 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=893120 CPUtime=936.09 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 36641 1261 0 0 93605 4 0 0 25 0 5 0 517540854 914554880 199307 33554432000 4194304 4417332 140734537484736 18446744073709551615 4358652 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=893120 CPUtime=941.21 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 57877 1261 0 0 94115 6 0 0 25 0 5 0 517540854 914554880 199307 33554432000 4194304 4417332 140734537484736 18446744073709551615 4307617 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=893120 CPUtime=941.23 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 535082 1261 0 0 94039 84 0 0 25 0 5 0 517540854 914554880 199307 33554432000 4194304 4417332 140734537484736 18446744073709551615 4251104 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3760.86
Current children cumulated vsize (KiB) 893120

[startup+1002.3 s]
/proc/loadavg: 8.12 8.08 8.01 9/186 31396
/proc/meminfo: memFree=13191656/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=1123960 CPUtime=4000.54 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 840403 1261 0 0 399930 124 0 0 25 0 5 0 517540746 1150935040 257187 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 280990 257187 181 55 0 278876 0
[pid=31286/tid=31293] ppid=31284 vsize=1123960 CPUtime=1001.22 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 128191 1261 0 0 100104 18 0 0 25 0 5 0 517540854 1150935040 257187 33554432000 4194304 4417332 140734537484736 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=1123960 CPUtime=995.76 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 48390 1261 0 0 99571 5 0 0 25 0 5 0 517540854 1150935040 257187 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=1123960 CPUtime=1001.22 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 57909 1261 0 0 100116 6 0 0 25 0 5 0 517540854 1150935040 257187 33554432000 4194304 4417332 140734537484736 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=1123960 CPUtime=1001.22 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 576750 1261 0 0 100034 88 0 0 25 0 5 0 517540854 1150935040 257187 33554432000 4194304 4417332 140734537484736 18446744073709551615 4250832 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4000.54
Current children cumulated vsize (KiB) 1123960

[startup+1062.3 s]
/proc/loadavg: 8.15 8.09 8.02 9/186 31407
/proc/meminfo: memFree=12692388/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=1391060 CPUtime=4240.2 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 932238 1261 0 0 423881 139 0 0 25 0 5 0 517540746 1424445440 323897 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 347765 323897 181 55 0 345651 0
[pid=31286/tid=31293] ppid=31284 vsize=1391060 CPUtime=1061.21 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 129910 1261 0 0 106103 18 0 0 25 0 5 0 517540854 1424445440 323897 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=1391060 CPUtime=1055.44 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 48423 1261 0 0 105539 5 0 0 25 0 5 0 517540854 1424445440 323897 33554432000 4194304 4417332 140734537484736 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=1391060 CPUtime=1061.22 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 57909 1261 0 0 106116 6 0 0 25 0 5 0 517540854 1424445440 323897 33554432000 4194304 4417332 140734537484736 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=1391060 CPUtime=1061.23 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 666833 1261 0 0 106020 103 0 0 25 0 5 0 517540854 1424445440 323897 33554432000 4194304 4417332 140734537484736 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4240.2
Current children cumulated vsize (KiB) 1391060

[startup+1122.3 s]
/proc/loadavg: 8.11 8.09 8.02 9/186 31408
/proc/meminfo: memFree=12838468/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=1393836 CPUtime=4479.87 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 959490 1261 0 0 447845 142 0 0 25 0 5 0 517540746 1427288064 324594 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 348459 324594 181 55 0 346345 0
[pid=31286/tid=31293] ppid=31284 vsize=1393836 CPUtime=1121.21 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 137451 1261 0 0 112102 19 0 0 25 0 5 0 517540854 1427288064 324594 33554432000 4194304 4417332 140734537484736 18446744073709551615 4251056 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=1393836 CPUtime=1115.11 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 48423 1261 0 0 111506 5 0 0 25 0 5 0 517540854 1427288064 324594 33554432000 4194304 4417332 140734537484736 18446744073709551615 4353412 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=1393836 CPUtime=1121.22 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 77620 1261 0 0 112113 9 0 0 25 0 5 0 517540854 1427288064 324594 33554432000 4194304 4417332 140734537484736 18446744073709551615 4232787 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=1393836 CPUtime=1121.23 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 666833 1261 0 0 112020 103 0 0 25 0 5 0 517540854 1427288064 324594 33554432000 4194304 4417332 140734537484736 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4479.87
Current children cumulated vsize (KiB) 1393836

[startup+1182.3 s]
/proc/loadavg: 8.14 8.10 8.02 9/186 31410
/proc/meminfo: memFree=12477484/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=1539400 CPUtime=4719.56 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 996753 1261 0 0 471807 149 0 0 25 0 5 0 517540746 1576345600 361034 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 384850 361034 181 55 0 382736 0
[pid=31286/tid=31293] ppid=31284 vsize=1539400 CPUtime=1181.21 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 138323 1261 0 0 118102 19 0 0 25 0 5 0 517540854 1576345600 361034 33554432000 4194304 4417332 140734537484736 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=1539400 CPUtime=1174.79 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 48423 1261 0 0 117474 5 0 0 25 0 5 0 517540854 1576345600 361034 33554432000 4194304 4417332 140734537484736 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=1539400 CPUtime=1181.22 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 80164 1261 0 0 118113 9 0 0 25 0 5 0 517540854 1576345600 361034 33554432000 4194304 4417332 140734537484736 18446744073709551615 4357912 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=1539400 CPUtime=1181.22 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 700680 1261 0 0 118013 109 0 0 25 0 5 0 517540854 1576345600 361034 33554432000 4194304 4417332 140734537484736 18446744073709551615 4355734 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4719.56
Current children cumulated vsize (KiB) 1539400



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.5 s]
/proc/loadavg: 8.10 8.09 8.02 9/186 31411
/proc/meminfo: memFree=11839252/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=1883168 CPUtime=4800.26 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 1083558 1261 0 0 479861 165 0 0 25 0 5 0 517540746 1928364032 446989 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 470792 446989 181 55 0 468678 0
[pid=31286/tid=31293] ppid=31284 vsize=1883168 CPUtime=1201.42 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 139218 1261 0 0 120123 19 0 0 25 0 5 0 517540854 1928364032 446989 33554432000 4194304 4417332 140734537484736 18446744073709551615 4357986 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=1883168 CPUtime=1194.87 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 66043 1261 0 0 119480 7 0 0 25 0 5 0 517540854 1928364032 446989 33554432000 4194304 4417332 140734537484736 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=1883168 CPUtime=1201.43 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 87652 1261 0 0 120133 10 0 0 25 0 5 0 517540854 1928364032 446989 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=1883168 CPUtime=1201.43 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 761482 1261 0 0 120021 122 0 0 25 0 5 0 517540854 1928364032 446989 33554432000 4194304 4417332 140734537484736 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.26
Current children cumulated vsize (KiB) 1883168

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.5 s]
/proc/loadavg: 8.10 8.09 8.02 9/186 31411
/proc/meminfo: memFree=11839252/32950928 swapFree=67111528/67111528
[pid=31286] ppid=31284 vsize=1883168 CPUtime=4800.26 cores=1,3,5,7
/proc/31286/stat : 31286 (plingeling) S 31284 31286 31098 0 -1 4202496 1083558 1261 0 0 479861 165 0 0 25 0 5 0 517540746 1928364032 446989 33554432000 4194304 4417332 140734537484736 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/31286/statm: 470792 446989 181 55 0 468678 0
[pid=31286/tid=31293] ppid=31284 vsize=1883168 CPUtime=1201.42 cores=1,3,5,7
/proc/31286/task/31293/stat : 31293 (plingeling) R 31284 31286 31098 0 -1 4202560 139218 1261 0 0 120123 19 0 0 25 0 5 0 517540854 1928364032 446989 33554432000 4194304 4417332 140734537484736 18446744073709551615 4357986 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31286/tid=31294] ppid=31284 vsize=1883168 CPUtime=1194.87 cores=1,3,5,7
/proc/31286/task/31294/stat : 31294 (plingeling) R 31284 31286 31098 0 -1 4202560 66043 1261 0 0 119480 7 0 0 25 0 5 0 517540854 1928364032 446989 33554432000 4194304 4417332 140734537484736 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=31286/tid=31295] ppid=31284 vsize=1883168 CPUtime=1201.43 cores=1,3,5,7
/proc/31286/task/31295/stat : 31295 (plingeling) R 31284 31286 31098 0 -1 4202560 87652 1261 0 0 120133 10 0 0 25 0 5 0 517540854 1928364032 446989 33554432000 4194304 4417332 140734537484736 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31286/tid=31296] ppid=31284 vsize=1883168 CPUtime=1201.43 cores=1,3,5,7
/proc/31286/task/31296/stat : 31296 (plingeling) R 31284 31286 31098 0 -1 4202560 761482 1261 0 0 120021 122 0 0 25 0 5 0 517540854 1928364032 446989 33554432000 4194304 4417332 140734537484736 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.26
Current children cumulated vsize (KiB) 1883168

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.58
CPU time (s): 4800.36
CPU user time (s): 4798.64
CPU system time (s): 1.72574
CPU usage (%): 399.172
Max. virtual memory (cumulated for all children) (KiB): 1883168

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.64
system time used= 1.72574
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1084819
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 156
involuntary context switches= 32511

runsolver used 1.80472 second user time and 4.76628 second system time

The end

Launcher Data 

Begin job on node125 at 2011-04-29 08:43:31
IDJOB=3285297
IDBENCH=82378
IDSOLVER=1605
FILE ID=node125/3285297-1304059410
RUNJOBID= node125-1304058205-31117
PBS_JOBID= 13170441
Free space on /tmp= 72584 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/rintanen/SATPlanning/sokoban-sequential-p145-microban-sequential.040-NOTKNOWN.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3285297-1304059410/watcher-3285297-1304059410 -o /tmp/evaluation-result-3285297-1304059410/solver-3285297-1304059410 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3285297-1304059410.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 36e8e2178d03f08fa4223da0e3d9beb5
RANDOM SEED=1849387772

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      13880868 kB
Buffers:       2218864 kB
Cached:       15161500 kB
SwapCached:          0 kB
Active:       10382592 kB
Inactive:      8153232 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      13880868 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           23516 kB
Writeback:          36 kB
AnonPages:     1154316 kB
Mapped:          15352 kB
Slab:           469284 kB
PageTables:       7048 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1403476 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72724 MiB
End job on node125 at 2011-04-29 09:03:35