Trace number 3371149

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.39 1203.16

General information on the benchmark

NameCRAFTED/rbsat/crafted/
forced/rbsat-v1560c133795gyes1.cnf
MD5SUM118632220c6f3388c45a2582e9a2ac0e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark816.061
Satisfiable
(Un)Satisfiability was proved
Number of variables1560
Number of clauses133795
Sum of the clauses size269030
Maximum clause length26
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2133735
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 560

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371149-1305420539/watcher-3371149-1305420539 -o /tmp/evaluation-result-3371149-1305420539/solver-3371149-1305420539 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371149-1305420539.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.36 7.85 7.46 6/292 3460
/proc/meminfo: memFree=29317072/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=9004 CPUtime=0 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) R 3458 3460 2611 0 -1 4202496 319 1249 0 0 0 0 0 0 25 0 1 0 653651927 9220096 249 33554432000 4194304 4417452 140735359810064 18446744073709551615 228122713856 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/3460/statm: 2251 249 147 55 0 137 0

[startup+0.0758849 s]
/proc/loadavg: 7.36 7.85 7.46 6/292 3460
/proc/meminfo: memFree=29317072/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=25892 CPUtime=0.06 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) R 3458 3460 2611 0 -1 4202496 4534 1249 0 0 6 0 0 0 25 0 1 0 653651927 26513408 4464 33554432000 4194304 4417452 140735359810064 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/3460/statm: 6473 4464 148 55 0 4359 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 25892

[startup+0.197825 s]
/proc/loadavg: 7.36 7.85 7.46 6/292 3460
/proc/meminfo: memFree=29317072/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=69564 CPUtime=0.49 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 5495 1249 0 0 49 0 0 0 25 0 5 0 653651927 71233536 5205 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 17391 5205 175 55 0 15277 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 69564

[startup+0.300807 s]
/proc/loadavg: 7.36 7.85 7.46 6/292 3460
/proc/meminfo: memFree=29317072/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=71932 CPUtime=0.9 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 9464 1249 0 0 89 1 0 0 25 0 5 0 653651927 73658368 5747 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 17983 5747 177 55 0 15869 0
Current children cumulated CPU time (s) 0.9
Current children cumulated vsize (KiB) 71932

[startup+0.700735 s]
/proc/loadavg: 7.36 7.85 7.46 6/292 3460
/proc/meminfo: memFree=29317072/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=79376 CPUtime=2.5 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 13810 1249 0 0 248 2 0 0 25 0 5 0 653651927 81281024 7631 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 19844 7631 180 55 0 17730 0
Current children cumulated CPU time (s) 2.5
Current children cumulated vsize (KiB) 79376

[startup+1.50059 s]
/proc/loadavg: 7.36 7.85 7.46 10/297 3470
/proc/meminfo: memFree=29273640/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=88876 CPUtime=5.7 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 18209 1249 0 0 567 3 0 0 25 0 5 0 653651927 91009024 9796 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 22219 9796 180 55 0 20105 0
[pid=3460/tid=3467] ppid=3458 vsize=88876 CPUtime=1.4 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 1900 1249 0 0 140 0 0 0 25 0 5 0 653651937 91009024 9796 33554432000 4194304 4417452 140735359810064 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=88876 CPUtime=1.4 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 1874 1249 0 0 140 0 0 0 25 0 5 0 653651937 91009024 9796 33554432000 4194304 4417452 140735359810064 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=88876 CPUtime=1.39 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 1365 1249 0 0 139 0 0 0 25 0 5 0 653651937 91009024 9796 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=88876 CPUtime=1.4 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 8524 1249 0 0 139 1 0 0 25 0 5 0 653651937 91009024 9796 33554432000 4194304 4417452 140735359810064 18446744073709551615 4358947 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.7
Current children cumulated vsize (KiB) 88876

[startup+3.1003 s]
/proc/loadavg: 7.36 7.85 7.46 9/297 3470
/proc/meminfo: memFree=29263996/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=98992 CPUtime=12.08 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 27649 1249 0 0 1204 4 0 0 25 0 5 0 653651927 101367808 12355 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 24748 12355 180 55 0 22634 0
[pid=3460/tid=3467] ppid=3458 vsize=98992 CPUtime=3 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 2711 1249 0 0 300 0 0 0 25 0 5 0 653651937 101367808 12355 33554432000 4194304 4417452 140735359810064 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=98992 CPUtime=3 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 2685 1249 0 0 300 0 0 0 25 0 5 0 653651937 101367808 12355 33554432000 4194304 4417452 140735359810064 18446744073709551615 4258267 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=98992 CPUtime=2.98 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 1380 1249 0 0 298 0 0 0 25 0 5 0 653651937 101367808 12355 33554432000 4194304 4417452 140735359810064 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=98992 CPUtime=3 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 16327 1249 0 0 298 2 0 0 25 0 5 0 653651937 101367808 12355 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.08
Current children cumulated vsize (KiB) 98992

[startup+6.30072 s]
/proc/loadavg: 7.41 7.85 7.46 9/297 3470
/proc/meminfo: memFree=29258416/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=107184 CPUtime=24.86 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 39851 1249 0 0 2480 6 0 0 25 0 5 0 653651927 109756416 14403 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 26796 14403 180 55 0 24682 0
[pid=3460/tid=3467] ppid=3458 vsize=107184 CPUtime=6.2 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 2711 1249 0 0 620 0 0 0 25 0 5 0 653651937 109756416 14403 33554432000 4194304 4417452 140735359810064 18446744073709551615 4239438 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=107184 CPUtime=6.2 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 2685 1249 0 0 620 0 0 0 25 0 5 0 653651937 109756416 14403 33554432000 4194304 4417452 140735359810064 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=107184 CPUtime=6.15 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 1380 1249 0 0 615 0 0 0 25 0 5 0 653651937 109756416 14403 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=107184 CPUtime=6.2 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 28529 1249 0 0 616 4 0 0 25 0 5 0 653651937 109756416 14403 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.86
Current children cumulated vsize (KiB) 107184

[startup+12.7006 s]
/proc/loadavg: 7.46 7.85 7.47 9/297 3470
/proc/meminfo: memFree=29203344/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=125668 CPUtime=50.4 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 68614 1249 0 0 5030 10 0 0 25 0 5 0 653651927 128684032 19204 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 31417 19204 180 55 0 29303 0
[pid=3460/tid=3467] ppid=3458 vsize=125668 CPUtime=12.6 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 3521 1249 0 0 1260 0 0 0 25 0 5 0 653651937 128684032 19204 33554432000 4194304 4417452 140735359810064 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=125668 CPUtime=12.6 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 3495 1249 0 0 1260 0 0 0 25 0 5 0 653651937 128684032 19204 33554432000 4194304 4417452 140735359810064 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=125668 CPUtime=12.49 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 2033 1249 0 0 1249 0 0 0 25 0 5 0 653651937 128684032 19204 33554432000 4194304 4417452 140735359810064 18446744073709551615 4258354 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=125668 CPUtime=12.6 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 55019 1249 0 0 1252 8 0 0 25 0 5 0 653651937 128684032 19204 33554432000 4194304 4417452 140735359810064 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.4
Current children cumulated vsize (KiB) 125668

[startup+25.5003 s]
/proc/loadavg: 7.66 7.87 7.48 9/297 3470
/proc/meminfo: memFree=29100164/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=206480 CPUtime=101.46 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 111018 1249 0 0 10130 16 0 0 25 0 5 0 653651927 211435520 39407 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 51620 39407 180 55 0 49506 0
[pid=3460/tid=3467] ppid=3458 vsize=206480 CPUtime=25.39 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 5370 1249 0 0 2539 0 0 0 25 0 5 0 653651937 211435520 39407 33554432000 4194304 4417452 140735359810064 18446744073709551615 4309869 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=206480 CPUtime=25.4 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 4157 1249 0 0 2540 0 0 0 25 0 5 0 653651937 211435520 39407 33554432000 4194304 4417452 140735359810064 18446744073709551615 4282894 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=206480 CPUtime=25.16 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 7761 1249 0 0 2515 1 0 0 25 0 5 0 653651937 211435520 39407 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364699 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=206480 CPUtime=25.4 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 89184 1249 0 0 2527 13 0 0 25 0 5 0 653651937 211435520 39407 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.46
Current children cumulated vsize (KiB) 206480

[startup+51.1006 s]
/proc/loadavg: 7.84 7.90 7.50 9/297 3471
/proc/meminfo: memFree=29022380/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=223940 CPUtime=203.64 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 180754 1249 0 0 20338 26 0 0 25 0 5 0 653651927 229314560 43797 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 55985 43797 180 55 0 53871 0
[pid=3460/tid=3467] ppid=3458 vsize=223940 CPUtime=51 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 12784 1249 0 0 5099 1 0 0 25 0 5 0 653651937 229314560 43797 33554432000 4194304 4417452 140735359810064 18446744073709551615 4236755 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=223940 CPUtime=50.99 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 5439 1249 0 0 5099 0 0 0 25 0 5 0 653651937 229314560 43797 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=223940 CPUtime=50.53 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 14452 1249 0 0 5052 1 0 0 25 0 5 0 653651937 229314560 43797 33554432000 4194304 4417452 140735359810064 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=223940 CPUtime=50.99 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 143533 1249 0 0 5078 21 0 0 25 0 5 0 653651937 229314560 43797 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.64
Current children cumulated vsize (KiB) 223940

[startup+102.31 s]
/proc/loadavg: 7.98 7.93 7.53 9/297 3472
/proc/meminfo: memFree=28863900/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=397636 CPUtime=408.01 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 284731 1249 0 0 40759 42 0 0 25 0 5 0 653651927 407179264 70845 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 99409 70845 180 55 0 97295 0
[pid=3460/tid=3467] ppid=3458 vsize=397636 CPUtime=102.2 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 30521 1249 0 0 10217 3 0 0 25 0 5 0 653651937 407179264 70845 33554432000 4194304 4417452 140735359810064 18446744073709551615 4251063 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=397636 CPUtime=102.21 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 8976 1249 0 0 10220 1 0 0 25 0 5 0 653651937 407179264 70845 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=397636 CPUtime=101.27 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 31887 1249 0 0 10123 4 0 0 25 0 5 0 653651937 407179264 70845 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=397636 CPUtime=102.21 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 208801 1249 0 0 10189 32 0 0 25 0 5 0 653651937 407179264 70845 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 408.01
Current children cumulated vsize (KiB) 397636

[startup+162.301 s]
/proc/loadavg: 8.04 7.95 7.56 9/297 3474
/proc/meminfo: memFree=28523372/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=595116 CPUtime=647.42 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 369355 1249 0 0 64686 56 0 0 25 0 5 0 653651927 609398784 120215 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 148779 120215 180 55 0 146665 0
[pid=3460/tid=3467] ppid=3458 vsize=595116 CPUtime=162.19 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 48889 1249 0 0 16213 6 0 0 25 0 5 0 653651937 609398784 120215 33554432000 4194304 4417452 140735359810064 18446744073709551615 4263050 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=595116 CPUtime=162.2 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 13084 1249 0 0 16219 1 0 0 25 0 5 0 653651937 609398784 120215 33554432000 4194304 4417452 140735359810064 18446744073709551615 4366590 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=595116 CPUtime=160.71 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 45383 1249 0 0 16066 5 0 0 25 0 5 0 653651937 609398784 120215 33554432000 4194304 4417452 140735359810064 18446744073709551615 4259875 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=595116 CPUtime=162.21 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 257453 1249 0 0 16179 42 0 0 25 0 5 0 653651937 609398784 120215 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 647.42
Current children cumulated vsize (KiB) 595116


################
# More data... #
################

[pid=3460/tid=3468] ppid=3458 vsize=1418648 CPUtime=762.23 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 20648 1249 0 0 76221 2 0 0 25 0 5 0 653651937 1452695552 326098 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=1418648 CPUtime=755.18 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 91763 1249 0 0 75508 10 0 0 25 0 5 0 653651937 1452695552 326098 33554432000 4194304 4417452 140735359810064 18446744073709551615 4250858 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=1418648 CPUtime=762.23 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 600792 1249 0 0 76135 88 0 0 25 0 5 0 653651937 1452695552 326098 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3041.96
Current children cumulated vsize (KiB) 1418648

[startup+822.3 s]
/proc/loadavg: 8.15 8.12 7.84 9/297 3503
/proc/meminfo: memFree=27787304/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=945160 CPUtime=3281.37 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 896714 1249 0 0 328012 125 0 0 25 0 5 0 653651927 967843840 207726 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 236290 207726 180 55 0 234176 0
[pid=3460/tid=3467] ppid=3458 vsize=945160 CPUtime=822.18 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 99417 1249 0 0 82206 12 0 0 25 0 5 0 653651937 967843840 207726 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=945160 CPUtime=822.21 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 22098 1249 0 0 82219 2 0 0 25 0 5 0 653651937 967843840 207726 33554432000 4194304 4417452 140735359810064 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=945160 CPUtime=814.63 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 93811 1249 0 0 81452 11 0 0 25 0 5 0 653651937 967843840 207726 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=945160 CPUtime=822.22 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 676842 1249 0 0 82125 97 0 0 25 0 5 0 653651937 967843840 207726 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3281.37
Current children cumulated vsize (KiB) 945160

[startup+882.3 s]
/proc/loadavg: 8.12 8.11 7.85 9/297 3504
/proc/meminfo: memFree=27831288/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=969736 CPUtime=3520.81 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 906954 1249 0 0 351955 126 0 0 25 0 5 0 653651927 993009664 213870 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 242434 213870 180 55 0 240320 0
[pid=3460/tid=3467] ppid=3458 vsize=969736 CPUtime=882.19 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 103513 1249 0 0 88206 13 0 0 25 0 5 0 653651937 993009664 213870 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=969736 CPUtime=882.22 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 26194 1249 0 0 88219 3 0 0 25 0 5 0 653651937 993009664 213870 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=969736 CPUtime=874.07 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 95859 1249 0 0 87396 11 0 0 25 0 5 0 653651937 993009664 213870 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=969736 CPUtime=882.22 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 676842 1249 0 0 88125 97 0 0 25 0 5 0 653651937 993009664 213870 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3520.81
Current children cumulated vsize (KiB) 969736

[startup+942.301 s]
/proc/loadavg: 8.40 8.17 7.89 10/298 3511
/proc/meminfo: memFree=27756804/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=985456 CPUtime=3759.48 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 912932 1249 0 0 375821 127 0 0 25 0 5 0 653651927 1009106944 217800 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 246364 217800 180 55 0 244250 0
[pid=3460/tid=3467] ppid=3458 vsize=985456 CPUtime=942.18 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 107443 1249 0 0 94205 13 0 0 25 0 5 0 653651937 1009106944 217800 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=985456 CPUtime=942.07 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 28242 1249 0 0 94204 3 0 0 25 0 5 0 653651937 1009106944 217800 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=985456 CPUtime=933.51 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 95859 1249 0 0 93340 11 0 0 25 0 5 0 653651937 1009106944 217800 33554432000 4194304 4417452 140735359810064 18446744073709551615 4366271 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=985456 CPUtime=941.58 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 676842 1249 0 0 94061 97 0 0 25 0 5 0 653651937 1009106944 217800 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3759.48
Current children cumulated vsize (KiB) 985456

[startup+1002.3 s]
/proc/loadavg: 8.27 8.17 7.90 9/297 3512
/proc/meminfo: memFree=27391536/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=1250272 CPUtime=3998.92 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 979136 1249 0 0 399752 140 0 0 25 0 5 0 653651927 1280278528 284004 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 312568 284004 180 55 0 310454 0
[pid=3460/tid=3467] ppid=3458 vsize=1250272 CPUtime=1002.18 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 107443 1249 0 0 100205 13 0 0 25 0 5 0 653651937 1280278528 284004 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364500 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=1250272 CPUtime=1002.08 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 28242 1249 0 0 100205 3 0 0 25 0 5 0 653651937 1280278528 284004 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=1250272 CPUtime=992.96 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 95859 1249 0 0 99285 11 0 0 25 0 5 0 653651937 1280278528 284004 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=1250272 CPUtime=1001.58 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 743046 1249 0 0 100048 110 0 0 25 0 5 0 653651937 1280278528 284004 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3998.92
Current children cumulated vsize (KiB) 1250272

[startup+1062.3 s]
/proc/loadavg: 8.21 8.17 7.92 9/297 3514
/proc/meminfo: memFree=27316608/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=1330616 CPUtime=4238.37 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 1001270 1249 0 0 423693 144 0 0 25 0 5 0 653651927 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 332654 304090 180 55 0 330540 0
[pid=3460/tid=3467] ppid=3458 vsize=1330616 CPUtime=1062.18 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 107443 1249 0 0 106205 13 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=1330616 CPUtime=1062.08 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 28242 1249 0 0 106205 3 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4366102 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=1330616 CPUtime=1052.41 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 95859 1249 0 0 105230 11 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=1330616 CPUtime=1061.58 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 765180 1249 0 0 106044 114 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4238.37
Current children cumulated vsize (KiB) 1330616

[startup+1122.3 s]
/proc/loadavg: 8.18 8.16 7.93 9/297 3516
/proc/meminfo: memFree=27201740/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=1338808 CPUtime=4477.82 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 1003318 1249 0 0 447638 144 0 0 25 0 5 0 653651927 1370939392 306138 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 334702 306138 180 55 0 332588 0
[pid=3460/tid=3467] ppid=3458 vsize=1338808 CPUtime=1122.18 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 107443 1249 0 0 112205 13 0 0 25 0 5 0 653651937 1370939392 306138 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=1338808 CPUtime=1122.08 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 30290 1249 0 0 112205 3 0 0 25 0 5 0 653651937 1370939392 306138 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=1338808 CPUtime=1111.85 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 95859 1249 0 0 111174 11 0 0 25 0 5 0 653651937 1370939392 306138 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=1338808 CPUtime=1121.58 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 765180 1249 0 0 112044 114 0 0 25 0 5 0 653651937 1370939392 306138 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4477.82
Current children cumulated vsize (KiB) 1338808

[startup+1182.3 s]
/proc/loadavg: 8.16 8.16 7.94 9/297 3517
/proc/meminfo: memFree=27145912/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=1349252 CPUtime=4717.27 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 1021515 1249 0 0 471580 147 0 0 25 0 5 0 653651927 1381634048 308749 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 337313 308749 180 55 0 335199 0
[pid=3460/tid=3467] ppid=3458 vsize=1349252 CPUtime=1182.18 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 123592 1249 0 0 118202 16 0 0 25 0 5 0 653651937 1381634048 308749 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=1349252 CPUtime=1182.09 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 32338 1249 0 0 118205 4 0 0 25 0 5 0 653651937 1381634048 308749 33554432000 4194304 4417452 140735359810064 18446744073709551615 4278071 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=1349252 CPUtime=1171.3 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 95859 1249 0 0 117119 11 0 0 25 0 5 0 653651937 1381634048 308749 33554432000 4194304 4417452 140735359810064 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=1349252 CPUtime=1181.59 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 765180 1249 0 0 118044 115 0 0 25 0 5 0 653651937 1381634048 308749 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4717.27
Current children cumulated vsize (KiB) 1349252



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.1 s]
/proc/loadavg: 7.94 8.11 7.93 5/291 3519
/proc/meminfo: memFree=28106312/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=1330616 CPUtime=4800.3 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 1023563 1249 0 0 479882 148 0 0 25 0 5 0 653651927 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 332654 304090 180 55 0 330540 0
[pid=3460/tid=3467] ppid=3458 vsize=1330616 CPUtime=1202.99 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 123592 1249 0 0 120283 16 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=1330616 CPUtime=1202.89 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 34386 1249 0 0 120285 4 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=1330616 CPUtime=1191.91 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 95859 1249 0 0 119180 11 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4354448 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=1330616 CPUtime=1202.4 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 765180 1249 0 0 120125 115 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 1330616

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.1 s]
/proc/loadavg: 7.94 8.11 7.93 5/291 3519
/proc/meminfo: memFree=28106312/32951124 swapFree=54427468/67111528
[pid=3460] ppid=3458 vsize=1330616 CPUtime=4800.3 cores=0,2,4,6
/proc/3460/stat : 3460 (plingeling) S 3458 3460 2611 0 -1 4202496 1023563 1249 0 0 479882 148 0 0 25 0 5 0 653651927 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 228134516709 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/3460/statm: 332654 304090 180 55 0 330540 0
[pid=3460/tid=3467] ppid=3458 vsize=1330616 CPUtime=1202.99 cores=0,2,4,6
/proc/3460/task/3467/stat : 3467 (plingeling) R 3458 3460 2611 0 -1 4202560 123592 1249 0 0 120283 16 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3460/tid=3468] ppid=3458 vsize=1330616 CPUtime=1202.89 cores=0,2,4,6
/proc/3460/task/3468/stat : 3468 (plingeling) R 3458 3460 2611 0 -1 4202560 34386 1249 0 0 120285 4 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364657 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3460/tid=3469] ppid=3458 vsize=1330616 CPUtime=1191.91 cores=0,2,4,6
/proc/3460/task/3469/stat : 3469 (plingeling) R 3458 3460 2611 0 -1 4202560 95859 1249 0 0 119180 11 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4354448 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3460/tid=3470] ppid=3458 vsize=1330616 CPUtime=1202.4 cores=0,2,4,6
/proc/3460/task/3470/stat : 3470 (plingeling) R 3458 3460 2611 0 -1 4202560 765180 1249 0 0 120125 115 0 0 25 0 5 0 653651937 1362550784 304090 33554432000 4194304 4417452 140735359810064 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 1330616

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.16
CPU time (s): 4800.39
CPU user time (s): 4798.86
CPU system time (s): 1.52577
CPU usage (%): 398.983
Max. virtual memory (cumulated for all children) (KiB): 1451416

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.86
system time used= 1.52577
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1024812
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 82
involuntary context switches= 36887

runsolver used 3.24751 second user time and 7.69983 second system time

The end

Launcher Data 

Begin job on node138 at 2011-05-15 02:49:00
IDJOB=3371149
IDBENCH=71593
IDSOLVER=1848
FILE ID=node138/3371149-1305420539
RUNJOBID= node138-1305419334-3319
PBS_JOBID= 13324560
Free space on /tmp= 73344 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/forced/rbsat-v1560c133795gyes1.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371149-1305420539/watcher-3371149-1305420539 -o /tmp/evaluation-result-3371149-1305420539/solver-3371149-1305420539 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371149-1305420539.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 118632220c6f3388c45a2582e9a2ac0e
RANDOM SEED=432467662

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29317104 kB
Buffers:        255100 kB
Cached:        3130548 kB
SwapCached:      18472 kB
Active:         869088 kB
Inactive:      2551176 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29317104 kB
SwapTotal:    67111528 kB
SwapFree:     54427468 kB
Dirty:            2756 kB
Writeback:           0 kB
AnonPages:       28260 kB
Mapped:           9196 kB
Slab:           110448 kB
PageTables:      39776 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 39544480 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73344 MiB
End job on node138 at 2011-05-15 03:09:05