Trace number 3284607

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.2 1202.74

General information on the benchmark

Nameapplication/fuhs/
AProVE11/AProVE11-06.cnf
MD5SUM6fd7d026c372988cefc364000243d13f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark4573.36
Satisfiable
(Un)Satisfiability was proved
Number of variables302076
Number of clauses1039056
Sum of the clauses size2729970
Maximum clause length978
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2420562
Number of clauses of size 3588399
Number of clauses of size 429561
Number of clauses of size 569
Number of clauses of size over 5464

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3284607-1304057314/watcher-3284607-1304057314 -o /tmp/evaluation-result-3284607-1304057314/solver-3284607-1304057314 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3284607-1304057314.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.36 7.89 7.86 2/174 29244
/proc/meminfo: memFree=19670692/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=20476 CPUtime=0 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) R 29242 29244 28898 0 -1 4202496 1449 1254 0 0 0 0 0 0 21 0 1 0 595962140 20967424 1378 33554432000 4194304 4417332 140736266436208 18446744073709551615 251367240797 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/29244/statm: 5119 1390 139 55 0 3005 0

[startup+0.025543 s]
/proc/loadavg: 7.36 7.89 7.86 2/174 29244
/proc/meminfo: memFree=19670692/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=46916 CPUtime=0.01 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) R 29242 29244 28898 0 -1 4202496 9822 1254 0 0 1 0 0 0 21 0 1 0 595962140 48041984 9751 33554432000 4194304 4417332 140736266436208 18446744073709551615 251367546624 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/29244/statm: 11729 9751 147 55 0 9615 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 46916

[startup+0.100533 s]
/proc/loadavg: 7.36 7.89 7.86 2/174 29244
/proc/meminfo: memFree=19670692/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=61288 CPUtime=0.08 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) R 29242 29244 28898 0 -1 4202496 13400 1254 0 0 8 0 0 0 21 0 1 0 595962140 62758912 13329 33554432000 4194304 4417332 140736266436208 18446744073709551615 4231547 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/29244/statm: 15322 13329 148 55 0 13208 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 61288

[startup+0.300487 s]
/proc/loadavg: 7.36 7.89 7.86 2/174 29244
/proc/meminfo: memFree=19670692/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=93564 CPUtime=0.29 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) R 29242 29244 28898 0 -1 4202496 21485 1254 0 0 27 2 0 0 22 0 1 0 595962140 95809536 21414 33554432000 4194304 4417332 140736266436208 18446744073709551615 251367546624 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/29244/statm: 23391 21414 148 55 0 21277 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 93564

[startup+0.700408 s]
/proc/loadavg: 7.36 7.89 7.86 2/174 29244
/proc/meminfo: memFree=19670692/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=171696 CPUtime=0.69 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) R 29242 29244 28898 0 -1 4202496 41074 1254 0 0 64 5 0 0 23 0 1 0 595962140 175816704 40947 33554432000 4194304 4417332 140736266436208 18446744073709551615 4274446 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/29244/statm: 42924 40947 148 55 0 40810 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 171696

[startup+1.50021 s]
/proc/loadavg: 6.85 7.78 7.82 3/175 29268
/proc/meminfo: memFree=19460488/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=287652 CPUtime=1.76 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 72712 1254 0 0 167 9 0 0 25 0 5 0 595962140 294555648 59709 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 71913 59709 157 55 0 69799 0
Current children cumulated CPU time (s) 1.76
Current children cumulated vsize (KiB) 287652

[startup+3.10093 s]
/proc/loadavg: 6.85 7.78 7.82 6/182 29283
/proc/meminfo: memFree=19329576/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=367424 CPUtime=8.15 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 129848 1254 0 0 797 18 0 0 25 0 5 0 595962140 376242176 72119 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 91856 72119 174 55 0 89742 0
[pid=29244/tid=29269] ppid=29242 vsize=367424 CPUtime=1.69 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 19972 1254 0 0 166 3 0 0 25 0 5 0 595962281 376242176 72119 33554432000 4194304 4417332 140736266436208 18446744073709551615 4265832 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=367424 CPUtime=1.68 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 16209 1254 0 0 166 2 0 0 20 0 5 0 595962281 376242176 72119 33554432000 4194304 4417332 140736266436208 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=367424 CPUtime=1.68 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 15600 1254 0 0 166 2 0 0 25 0 5 0 595962281 376242176 72119 33554432000 4194304 4417332 140736266436208 18446744073709551615 4283159 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=367424 CPUtime=1.68 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 5363 1254 0 0 167 1 0 0 25 0 5 0 595962281 376242176 72119 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 8.15
Current children cumulated vsize (KiB) 367424

[startup+6.30033 s]
/proc/loadavg: 6.85 7.78 7.82 9/186 29287
/proc/meminfo: memFree=18829476/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=413444 CPUtime=20.9 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 178523 1254 0 0 2064 26 0 0 25 0 5 0 595962140 423366656 75210 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 103361 75210 178 55 0 101247 0
[pid=29244/tid=29269] ppid=29242 vsize=413444 CPUtime=4.88 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 41631 1254 0 0 483 5 0 0 25 0 5 0 595962281 423366656 75210 33554432000 4194304 4417332 140736266436208 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=413444 CPUtime=4.88 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 31696 1254 0 0 484 4 0 0 25 0 5 0 595962281 423366656 75210 33554432000 4194304 4417332 140736266436208 18446744073709551615 4345964 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=413444 CPUtime=4.86 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 27129 1254 0 0 481 5 0 0 25 0 5 0 595962281 423366656 75210 33554432000 4194304 4417332 140736266436208 18446744073709551615 4270978 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=413444 CPUtime=4.86 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 5363 1254 0 0 485 1 0 0 25 0 5 0 595962281 423366656 75210 33554432000 4194304 4417332 140736266436208 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 20.9
Current children cumulated vsize (KiB) 413444

[startup+12.7011 s]
/proc/loadavg: 7.03 7.78 7.82 9/186 29323
/proc/meminfo: memFree=19279716/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=417232 CPUtime=46.47 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 185240 1254 0 0 4619 28 0 0 25 0 5 0 595962140 427245568 81909 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 104308 81909 181 55 0 102194 0
[pid=29244/tid=29269] ppid=29242 vsize=417232 CPUtime=11.28 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 47783 1254 0 0 1121 7 0 0 25 0 5 0 595962281 427245568 81909 33554432000 4194304 4417332 140736266436208 18446744073709551615 4240028 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=417232 CPUtime=11.28 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 32109 1254 0 0 1124 4 0 0 25 0 5 0 595962281 427245568 81909 33554432000 4194304 4417332 140736266436208 18446744073709551615 4240080 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=417232 CPUtime=11.26 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 27281 1254 0 0 1120 6 0 0 25 0 5 0 595962281 427245568 81909 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=417232 CPUtime=11.22 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 5363 1254 0 0 1121 1 0 0 25 0 5 0 595962281 427245568 81909 33554432000 4194304 4417332 140736266436208 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 46.47
Current children cumulated vsize (KiB) 417232

[startup+25.5007 s]
/proc/loadavg: 7.18 7.79 7.82 9/186 29323
/proc/meminfo: memFree=19165192/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=495808 CPUtime=97.61 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 206428 1254 0 0 9728 33 0 0 25 0 5 0 595962140 507707392 103091 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 123952 103091 181 55 0 121838 0
[pid=29244/tid=29269] ppid=29242 vsize=495808 CPUtime=24.08 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 59146 1254 0 0 2399 9 0 0 25 0 5 0 595962281 507707392 103091 33554432000 4194304 4417332 140736266436208 18446744073709551615 4252408 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=495808 CPUtime=24.08 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 41934 1254 0 0 2402 6 0 0 25 0 5 0 595962281 507707392 103091 33554432000 4194304 4417332 140736266436208 18446744073709551615 4252349 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=495808 CPUtime=24.06 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 27281 1254 0 0 2400 6 0 0 25 0 5 0 595962281 507707392 103091 33554432000 4194304 4417332 140736266436208 18446744073709551615 4237169 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=495808 CPUtime=23.95 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 5363 1254 0 0 2394 1 0 0 25 0 5 0 595962281 507707392 103091 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 97.61
Current children cumulated vsize (KiB) 495808

[startup+51.101 s]
/proc/loadavg: 7.46 7.81 7.82 6/182 29392
/proc/meminfo: memFree=19073304/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=522512 CPUtime=199.87 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 215741 1254 0 0 19950 37 0 0 25 0 5 0 595962140 535052288 111815 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 130628 111815 181 55 0 128514 0
[pid=29244/tid=29269] ppid=29242 vsize=522512 CPUtime=49.68 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 63371 1254 0 0 4956 12 0 0 25 0 5 0 595962281 535052288 111815 33554432000 4194304 4417332 140736266436208 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=522512 CPUtime=49.69 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 44716 1254 0 0 4962 7 0 0 25 0 5 0 595962281 535052288 111815 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=522512 CPUtime=49.66 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 29587 1254 0 0 4959 7 0 0 25 0 5 0 595962281 535052288 111815 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=522512 CPUtime=49.41 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 5363 1254 0 0 4940 1 0 0 25 0 5 0 595962281 535052288 111815 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 199.87
Current children cumulated vsize (KiB) 522512

[startup+102.307 s]
/proc/loadavg: 7.68 7.79 7.82 9/186 29397
/proc/meminfo: memFree=18902996/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=537320 CPUtime=404.4 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 219810 1254 0 0 40402 38 0 0 25 0 5 0 595962140 550215680 115517 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 134330 115517 181 55 0 132216 0
[pid=29244/tid=29269] ppid=29242 vsize=537320 CPUtime=100.89 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 63492 1254 0 0 10077 12 0 0 25 0 5 0 595962281 550215680 115517 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=537320 CPUtime=100.89 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 44837 1254 0 0 10082 7 0 0 25 0 5 0 595962281 550215680 115517 33554432000 4194304 4417332 140736266436208 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=537320 CPUtime=100.86 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 33414 1254 0 0 10078 8 0 0 25 0 5 0 595962281 550215680 115517 33554432000 4194304 4417332 140736266436208 18446744073709551615 4199421 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=537320 CPUtime=100.34 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 5363 1254 0 0 10033 1 0 0 25 0 5 0 595962281 550215680 115517 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 404.4
Current children cumulated vsize (KiB) 537320

[startup+162.3 s]
/proc/loadavg: 7.88 7.83 7.82 9/186 29399
/proc/meminfo: memFree=18831048/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=545472 CPUtime=644.06 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 230662 1254 0 0 64365 41 0 0 25 0 5 0 595962140 558563328 117587 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 136368 117587 181 55 0 134254 0
[pid=29244/tid=29269] ppid=29242 vsize=545472 CPUtime=160.88 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 65653 1254 0 0 16076 12 0 0 25 0 5 0 595962281 558563328 117587 33554432000 4194304 4417332 140736266436208 18446744073709551615 4252507 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=545472 CPUtime=160.89 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 44949 1254 0 0 16082 7 0 0 25 0 5 0 595962281 558563328 117587 33554432000 4194304 4417332 140736266436208 18446744073709551615 4253420 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=545472 CPUtime=160.85 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 41993 1254 0 0 16075 10 0 0 25 0 5 0 595962281 558563328 117587 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=545472 CPUtime=160.01 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 5363 1254 0 0 16000 1 0 0 25 0 5 0 595962281 558563328 117587 33554432000 4194304 4417332 140736266436208 18446744073709551615 4353519 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 644.06
Current children cumulated vsize (KiB) 545472

[startup+222.3 s]
/proc/loadavg: 8.02 7.87 7.84 9/186 29401
/proc/meminfo: memFree=18763052/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=569820 CPUtime=883.74 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 243274 1254 0 0 88332 42 0 0 25 0 5 0 595962140 583495680 123680 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 142455 123680 181 55 0 140341 0
[pid=29244/tid=29269] ppid=29242 vsize=569820 CPUtime=220.88 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 71053 1254 0 0 22075 13 0 0 25 0 5 0 595962281 583495680 123680 33554432000 4194304 4417332 140736266436208 18446744073709551615 4265465 0 0 4096 17442 0 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=29244/tid=29270] ppid=29242 vsize=516368 CPUtime=760.91 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 63267 1254 0 0 76081 10 0 0 25 0 5 0 595962281 528760832 110317 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=516368 CPUtime=760.87 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 48803 1254 0 0 76076 11 0 0 25 0 5 0 595962281 528760832 110317 33554432000 4194304 4417332 140736266436208 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=516368 CPUtime=756.76 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 5363 1254 0 0 75675 1 0 0 25 0 5 0 595962281 528760832 110317 33554432000 4194304 4417332 140736266436208 18446744073709551615 4250915 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3040.89
Current children cumulated vsize (KiB) 516368

[startup+822.3 s]
/proc/loadavg: 8.13 8.05 7.93 9/186 29417
/proc/meminfo: memFree=18399852/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=515992 CPUtime=3280.55 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 266112 1254 0 0 328008 47 0 0 25 0 5 0 595962140 528375808 110223 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 128998 110223 181 55 0 126884 0
[pid=29244/tid=29269] ppid=29242 vsize=515992 CPUtime=820.91 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 75880 1254 0 0 82077 14 0 0 25 0 5 0 595962281 528375808 110223 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=515992 CPUtime=820.91 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 63267 1254 0 0 82081 10 0 0 25 0 5 0 595962281 528375808 110223 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=515992 CPUtime=820.87 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 48898 1254 0 0 82076 11 0 0 25 0 5 0 595962281 528375808 110223 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=515992 CPUtime=816.43 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 5363 1254 0 0 81642 1 0 0 25 0 5 0 595962281 528375808 110223 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3280.55
Current children cumulated vsize (KiB) 515992

[startup+882.3 s]
/proc/loadavg: 8.05 8.03 7.93 9/186 29418
/proc/meminfo: memFree=18123044/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=549052 CPUtime=3520.22 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 275426 1254 0 0 351974 48 0 0 25 0 5 0 595962140 562229248 118488 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 137263 118488 181 55 0 135149 0
[pid=29244/tid=29269] ppid=29242 vsize=549052 CPUtime=880.91 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 77002 1254 0 0 88077 14 0 0 25 0 5 0 595962281 562229248 118488 33554432000 4194304 4417332 140736266436208 18446744073709551615 4330893 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=549052 CPUtime=880.91 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 63267 1254 0 0 88081 10 0 0 25 0 5 0 595962281 562229248 118488 33554432000 4194304 4417332 140736266436208 18446744073709551615 4366445 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=549052 CPUtime=880.87 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 48898 1254 0 0 88076 11 0 0 25 0 5 0 595962281 562229248 118488 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=549052 CPUtime=876.1 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 13555 1254 0 0 87608 2 0 0 25 0 5 0 595962281 562229248 118488 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3520.22
Current children cumulated vsize (KiB) 549052

[startup+942.301 s]
/proc/loadavg: 8.07 8.04 7.93 9/186 29420
/proc/meminfo: memFree=17747288/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=645104 CPUtime=3759.91 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 300573 1254 0 0 375940 51 0 0 25 0 5 0 595962140 660586496 142501 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 161276 142501 181 55 0 159162 0
[pid=29244/tid=29269] ppid=29242 vsize=645104 CPUtime=940.91 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 86310 1254 0 0 94076 15 0 0 25 0 5 0 595962281 660586496 142501 33554432000 4194304 4417332 140736266436208 18446744073709551615 4265403 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=645104 CPUtime=940.91 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 67743 1254 0 0 94081 10 0 0 25 0 5 0 595962281 660586496 142501 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=645104 CPUtime=940.87 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 60261 1254 0 0 94075 12 0 0 25 0 5 0 595962281 660586496 142501 33554432000 4194304 4417332 140736266436208 18446744073709551615 4277346 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=645104 CPUtime=935.78 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 13555 1254 0 0 93576 2 0 0 25 0 5 0 595962281 660586496 142501 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3759.91
Current children cumulated vsize (KiB) 645104

[startup+1002.3 s]
/proc/loadavg: 8.08 8.04 7.94 9/186 29421
/proc/meminfo: memFree=17892704/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=640628 CPUtime=3999.58 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 300667 1254 0 0 399907 51 0 0 25 0 5 0 595962140 656003072 141382 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 160157 141382 181 55 0 158043 0
[pid=29244/tid=29269] ppid=29242 vsize=640628 CPUtime=1000.91 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 86310 1254 0 0 100076 15 0 0 25 0 5 0 595962281 656003072 141382 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=640628 CPUtime=1000.91 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 67743 1254 0 0 100080 11 0 0 25 0 5 0 595962281 656003072 141382 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=640628 CPUtime=1000.87 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 60355 1254 0 0 100075 12 0 0 25 0 5 0 595962281 656003072 141382 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=640628 CPUtime=995.45 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 13555 1254 0 0 99543 2 0 0 25 0 5 0 595962281 656003072 141382 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364581 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3999.58
Current children cumulated vsize (KiB) 640628

[startup+1062.3 s]
/proc/loadavg: 8.08 8.05 7.94 9/186 29423
/proc/meminfo: memFree=18055840/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=640628 CPUtime=4239.27 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 300667 1254 0 0 423876 51 0 0 25 0 5 0 595962140 656003072 141382 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 160157 141382 181 55 0 158043 0
[pid=29244/tid=29269] ppid=29242 vsize=640628 CPUtime=1060.91 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 86310 1254 0 0 106076 15 0 0 25 0 5 0 595962281 656003072 141382 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236750 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=640628 CPUtime=1060.92 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 67743 1254 0 0 106081 11 0 0 25 0 5 0 595962281 656003072 141382 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=640628 CPUtime=1060.88 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 60355 1254 0 0 106076 12 0 0 25 0 5 0 595962281 656003072 141382 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=640628 CPUtime=1055.13 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 13555 1254 0 0 105511 2 0 0 25 0 5 0 595962281 656003072 141382 33554432000 4194304 4417332 140736266436208 18446744073709551615 4355145 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4239.27
Current children cumulated vsize (KiB) 640628

[startup+1122.3 s]
/proc/loadavg: 8.07 8.05 7.95 9/186 29425
/proc/meminfo: memFree=18135412/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=645032 CPUtime=4478.94 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 301771 1254 0 0 447843 51 0 0 25 0 5 0 595962140 660512768 142483 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 161258 142483 181 55 0 159144 0
[pid=29244/tid=29269] ppid=29242 vsize=645032 CPUtime=1120.91 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 86310 1254 0 0 112076 15 0 0 25 0 5 0 595962281 660512768 142483 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=645032 CPUtime=1120.92 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 68847 1254 0 0 112081 11 0 0 25 0 5 0 595962281 660512768 142483 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=645032 CPUtime=1120.88 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 60355 1254 0 0 112076 12 0 0 25 0 5 0 595962281 660512768 142483 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=645032 CPUtime=1114.8 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 13555 1254 0 0 111478 2 0 0 25 0 5 0 595962281 660512768 142483 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4478.94
Current children cumulated vsize (KiB) 645032

[startup+1182.3 s]
/proc/loadavg: 8.02 8.04 7.95 9/186 29426
/proc/meminfo: memFree=18052672/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=645780 CPUtime=4718.63 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 301960 1254 0 0 471812 51 0 0 25 0 5 0 595962140 661278720 142670 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 161445 142670 181 55 0 159331 0
[pid=29244/tid=29269] ppid=29242 vsize=645780 CPUtime=1180.92 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 86404 1254 0 0 118077 15 0 0 25 0 5 0 595962281 661278720 142670 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=645780 CPUtime=1180.92 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 68847 1254 0 0 118081 11 0 0 25 0 5 0 595962281 661278720 142670 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=645780 CPUtime=1180.88 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 60450 1254 0 0 118076 12 0 0 25 0 5 0 595962281 661278720 142670 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=645780 CPUtime=1174.48 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 13555 1254 0 0 117446 2 0 0 25 0 5 0 595962281 661278720 142670 33554432000 4194304 4417332 140736266436208 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4718.63
Current children cumulated vsize (KiB) 645780



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.7 s]
/proc/loadavg: 8.02 8.04 7.95 9/186 29427
/proc/meminfo: memFree=18104116/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=641724 CPUtime=4800.14 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 301960 1254 0 0 479962 52 0 0 25 0 5 0 595962140 657125376 141656 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 160431 141656 181 55 0 158317 0
[pid=29244/tid=29269] ppid=29242 vsize=641724 CPUtime=1201.32 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 86404 1254 0 0 120117 15 0 0 25 0 5 0 595962281 657125376 141656 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=641724 CPUtime=1201.33 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 68847 1254 0 0 120122 11 0 0 25 0 5 0 595962281 657125376 141656 33554432000 4194304 4417332 140736266436208 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=641724 CPUtime=1201.29 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 60450 1254 0 0 120117 12 0 0 25 0 5 0 595962281 657125376 141656 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=641724 CPUtime=1194.77 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 13555 1254 0 0 119475 2 0 0 25 0 5 0 595962281 657125376 141656 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.14
Current children cumulated vsize (KiB) 641724

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.7 s]
/proc/loadavg: 8.02 8.04 7.95 9/186 29427
/proc/meminfo: memFree=18104116/32950928 swapFree=67111364/67111528
[pid=29244] ppid=29242 vsize=641724 CPUtime=4800.14 cores=0,2,4,6
/proc/29244/stat : 29244 (plingeling) S 29242 29244 28898 0 -1 4202496 301960 1254 0 0 479962 52 0 0 25 0 5 0 595962140 657125376 141656 33554432000 4194304 4417332 140736266436208 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/29244/statm: 160431 141656 181 55 0 158317 0
[pid=29244/tid=29269] ppid=29242 vsize=641724 CPUtime=1201.32 cores=0,2,4,6
/proc/29244/task/29269/stat : 29269 (plingeling) R 29242 29244 28898 0 -1 4202560 86404 1254 0 0 120117 15 0 0 25 0 5 0 595962281 657125376 141656 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29244/tid=29270] ppid=29242 vsize=641724 CPUtime=1201.33 cores=0,2,4,6
/proc/29244/task/29270/stat : 29270 (plingeling) R 29242 29244 28898 0 -1 4202560 68847 1254 0 0 120122 11 0 0 25 0 5 0 595962281 657125376 141656 33554432000 4194304 4417332 140736266436208 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29244/tid=29271] ppid=29242 vsize=641724 CPUtime=1201.29 cores=0,2,4,6
/proc/29244/task/29271/stat : 29271 (plingeling) R 29242 29244 28898 0 -1 4202560 60450 1254 0 0 120117 12 0 0 25 0 5 0 595962281 657125376 141656 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29244/tid=29272] ppid=29242 vsize=641724 CPUtime=1194.77 cores=0,2,4,6
/proc/29244/task/29272/stat : 29272 (plingeling) R 29242 29244 28898 0 -1 4202560 13555 1254 0 0 119475 2 0 0 25 0 5 0 595962281 657125376 141656 33554432000 4194304 4417332 140736266436208 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.14
Current children cumulated vsize (KiB) 641724

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.74
CPU time (s): 4800.2
CPU user time (s): 4799.65
CPU system time (s): 0.550916
CPU usage (%): 399.105
Max. virtual memory (cumulated for all children) (KiB): 645780

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.65
system time used= 0.550916
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 303214
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 138
involuntary context switches= 25082

runsolver used 1.90971 second user time and 4.65529 second system time

The end

Launcher Data 

Begin job on node113 at 2011-04-29 08:08:35
IDJOB=3284607
IDBENCH=82354
IDSOLVER=1605
FILE ID=node113/3284607-1304057314
RUNJOBID= node113-1304056091-28916
PBS_JOBID= 13170432
Free space on /tmp= 71124 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/fuhs/AProVE11/AProVE11-06.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3284607-1304057314/watcher-3284607-1304057314 -o /tmp/evaluation-result-3284607-1304057314/solver-3284607-1304057314 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3284607-1304057314.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6fd7d026c372988cefc364000243d13f
RANDOM SEED=1300929653

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      19670848 kB
Buffers:       1743380 kB
Cached:       10872372 kB
SwapCached:        164 kB
Active:        6384048 kB
Inactive:      6304924 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      19670848 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           44088 kB
Writeback:           0 kB
AnonPages:       72700 kB
Mapped:          14928 kB
Slab:           528080 kB
PageTables:       4676 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   194860 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71104 MiB
End job on node113 at 2011-04-29 08:28:39