Trace number 3309702

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587UNSAT 2157.91 270.507

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf
MD5SUM9059f458d76edcc4dc5681746a6de6e5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark245.654
Satisfiable
(Un)Satisfiability was proved
Number of variables88352
Number of clauses262658
Sum of the clauses size612866
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2175104
Number of clauses of size 387552
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

2157.35/270.50	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309702-1304007897/watcher-3309702-1304007897 -o /tmp/evaluation-result-3309702-1304007897/solver-3309702-1304007897 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309702-1304007897.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.39 7.92 7.96 2/170 12937
/proc/meminfo: memFree=16801492/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=10636 CPUtime=0 cores=0-7
/proc/12937/stat : 12937 (plingeling) R 12935 12937 12723 0 -1 4202496 721 1252 0 0 0 0 0 0 25 0 1 0 591020274 10891264 649 33554432000 4194304 4417332 140734180848800 18446744073709551615 260020089803 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/12937/statm: 2659 649 147 55 0 545 0

[startup+0.0809101 s]
/proc/loadavg: 7.39 7.92 7.96 2/170 12937
/proc/meminfo: memFree=16801492/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=27808 CPUtime=0.06 cores=0-7
/proc/12937/stat : 12937 (plingeling) R 12935 12937 12723 0 -1 4202496 5065 1252 0 0 6 0 0 0 25 0 1 0 591020274 28475392 4975 33554432000 4194304 4417332 140734180848800 18446744073709551615 4210207 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/12937/statm: 6952 4975 148 55 0 4838 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 27808

[startup+0.100918 s]
/proc/loadavg: 7.39 7.92 7.96 2/170 12937
/proc/meminfo: memFree=16801492/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=27808 CPUtime=0.08 cores=0-7
/proc/12937/stat : 12937 (plingeling) R 12935 12937 12723 0 -1 4202496 5065 1252 0 0 8 0 0 0 25 0 1 0 591020274 28475392 4975 33554432000 4194304 4417332 140734180848800 18446744073709551615 260020014715 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/12937/statm: 6952 4975 148 55 0 4838 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 27808

[startup+0.300871 s]
/proc/loadavg: 7.39 7.92 7.96 2/170 12937
/proc/meminfo: memFree=16801492/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=80716 CPUtime=0.29 cores=0-7
/proc/12937/stat : 12937 (plingeling) R 12935 12937 12723 0 -1 4202496 18393 1252 0 0 27 2 0 0 25 0 1 0 591020274 82653184 18202 33554432000 4194304 4417332 140734180848800 18446744073709551615 4274358 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/12937/statm: 20179 18202 148 55 0 18065 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 80716

[startup+0.700762 s]
/proc/loadavg: 7.39 7.92 7.96 2/170 12937
/proc/meminfo: memFree=16801492/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=362972 CPUtime=1.2 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 53193 1252 0 0 113 7 0 0 18 0 9 0 591020274 371683328 38878 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 90743 38902 167 55 0 88629 0
Current children cumulated CPU time (s) 1.2
Current children cumulated vsize (KiB) 362972

[startup+1.50062 s]
/proc/loadavg: 7.39 7.92 7.96 9/179 12951
/proc/meminfo: memFree=16637400/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=386512 CPUtime=7.6 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 67760 1252 0 0 751 9 0 0 18 0 9 0 591020274 395788288 41555 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 96628 41555 172 55 0 94514 0
[pid=12937/tid=12944] ppid=12935 vsize=386512 CPUtime=0.86 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 4115 1252 0 0 86 0 0 0 19 0 9 0 591020336 395788288 41555 33554432000 4194304 4417332 140734180848800 18446744073709551615 4302020 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=386512 CPUtime=0.86 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 2855 1252 0 0 86 0 0 0 25 0 9 0 591020336 395788288 41555 33554432000 4194304 4417332 140734180848800 18446744073709551615 4234178 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=386512 CPUtime=0.86 cores=0-7
/proc/12937/task/12946/stat : 12946 (plingeling) R 12935 12937 12723 0 -1 4202560 3594 1252 0 0 86 0 0 0 25 0 9 0 591020336 395788288 41555 33554432000 4194304 4417332 140734180848800 18446744073709551615 4283557 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12937/tid=12947] ppid=12935 vsize=386512 CPUtime=0.87 cores=0-7
/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 2074 1252 0 0 87 0 0 0 25 0 9 0 591020336 395788288 41555 33554432000 4194304 4417332 140734180848800 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=386512 CPUtime=0.86 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 4843 1252 0 0 86 0 0 0 25 0 9 0 591020336 395788288 41555 33554432000 4194304 4417332 140734180848800 18446744073709551615 4306634 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=386512 CPUtime=0.86 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 3625 1252 0 0 86 0 0 0 18 0 9 0 591020337 395788288 41555 33554432000 4194304 4417332 140734180848800 18446744073709551615 4265832 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=386512 CPUtime=0.86 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 5818 1252 0 0 86 0 0 0 21 0 9 0 591020337 395788288 41555 33554432000 4194304 4417332 140734180848800 18446744073709551615 4302078 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=386512 CPUtime=0.86 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 4823 1252 0 0 86 0 0 0 21 0 9 0 591020337 395788288 41555 33554432000 4194304 4417332 140734180848800 18446744073709551615 4302448 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 7.6
Current children cumulated vsize (KiB) 386512

[startup+3.10132 s]
/proc/loadavg: 7.39 7.92 7.96 9/179 12951
/proc/meminfo: memFree=16634176/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=371904 CPUtime=20.4 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 96145 1252 0 0 2026 14 0 0 18 0 9 0 591020274 380829696 40687 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 92976 40687 176 55 0 90862 0
[pid=12937/tid=12944] ppid=12935 vsize=371904 CPUtime=2.47 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 10352 1252 0 0 245 2 0 0 22 0 9 0 591020336 380829696 40687 33554432000 4194304 4417332 140734180848800 18446744073709551615 4346375 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=371904 CPUtime=2.46 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 4527 1252 0 0 246 0 0 0 25 0 9 0 591020336 380829696 40687 33554432000 4194304 4417332 140734180848800 18446744073709551615 4301955 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=371904 CPUtime=2.46 cores=0-7
/proc/12937/task/12946/stat : 12946 (plingeling) R 12935 12937 12723 0 -1 4202560 7073 1252 0 0 246 0 0 0 25 0 9 0 591020336 380829696 40687 33554432000 4194304 4417332 140734180848800 18446744073709551615 4346410 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12937/tid=12947] ppid=12935 vsize=371904 CPUtime=2.47 cores=0-7
/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 2076 1252 0 0 247 0 0 0 25 0 9 0 591020336 380829696 40687 33554432000 4194304 4417332 140734180848800 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=371904 CPUtime=2.45 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 11630 1252 0 0 244 1 0 0 25 0 9 0 591020336 380829696 40687 33554432000 4194304 4417332 140734180848800 18446744073709551615 4275501 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=371904 CPUtime=2.47 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 5102 1252 0 0 246 1 0 0 22 0 9 0 591020337 380829696 40687 33554432000 4194304 4417332 140734180848800 18446744073709551615 4234242 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=371904 CPUtime=2.46 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 10479 1252 0 0 245 1 0 0 25 0 9 0 591020337 380829696 40687 33554432000 4194304 4417332 140734180848800 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=371904 CPUtime=2.46 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 8893 1252 0 0 245 1 0 0 25 0 9 0 591020337 380829696 40687 33554432000 4194304 4417332 140734180848800 18446744073709551615 4317340 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 20.4
Current children cumulated vsize (KiB) 371904

[startup+6.30073 s]
/proc/loadavg: 7.44 7.92 7.96 9/179 12951
/proc/meminfo: memFree=16564488/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=457452 CPUtime=45.98 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 127664 1252 0 0 4579 19 0 0 18 0 9 0 591020274 468430848 63797 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 114363 63797 180 55 0 112249 0
[pid=12937/tid=12944] ppid=12935 vsize=457452 CPUtime=5.67 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 14527 1252 0 0 565 2 0 0 25 0 9 0 591020336 468430848 63797 33554432000 4194304 4417332 140734180848800 18446744073709551615 4252539 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=457452 CPUtime=5.67 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 8277 1252 0 0 565 2 0 0 25 0 9 0 591020336 468430848 63797 33554432000 4194304 4417332 140734180848800 18446744073709551615 4252188 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=457452 CPUtime=5.67 cores=0-7
/proc/12937/task/12946/stat : 12946 (plingeling) R 12935 12937 12723 0 -1 4202560 10284 1252 0 0 566 1 0 0 25 0 9 0 591020336 468430848 63797 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364575 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12937/tid=12947] ppid=12935 vsize=457452 CPUtime=5.66 cores=0-7
/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 2751 1252 0 0 566 0 0 0 25 0 9 0 591020336 468430848 63797 33554432000 4194304 4417332 140734180848800 18446744073709551615 4354555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=457452 CPUtime=5.64 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 17839 1252 0 0 562 2 0 0 25 0 9 0 591020336 468430848 63797 33554432000 4194304 4417332 140734180848800 18446744073709551615 4252365 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=457452 CPUtime=5.66 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 10483 1252 0 0 565 1 0 0 25 0 9 0 591020337 468430848 63797 33554432000 4194304 4417332 140734180848800 18446744073709551615 4252176 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=457452 CPUtime=5.66 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 13469 1252 0 0 565 1 0 0 25 0 9 0 591020337 468430848 63797 33554432000 4194304 4417332 140734180848800 18446744073709551615 4232623 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=457452 CPUtime=5.65 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 14021 1252 0 0 564 1 0 0 25 0 9 0 591020337 468430848 63797 33554432000 4194304 4417332 140734180848800 18446744073709551615 4252379 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 45.98
Current children cumulated vsize (KiB) 457452

[startup+12.7006 s]
/proc/loadavg: 7.49 7.92 7.96 9/179 12951
/proc/meminfo: memFree=16613856/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=406536 CPUtime=97.14 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 130289 1252 0 0 9694 20 0 0 18 0 9 0 591020274 416292864 47016 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 101634 47016 181 55 0 99520 0
[pid=12937/tid=12944] ppid=12935 vsize=406536 CPUtime=12.07 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 14541 1252 0 0 1205 2 0 0 25 0 9 0 591020336 416292864 47016 33554432000 4194304 4417332 140734180848800 18446744073709551615 4330435 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=406536 CPUtime=12.07 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 8292 1252 0 0 1205 2 0 0 25 0 9 0 591020336 416292864 47016 33554432000 4194304 4417332 140734180848800 18446744073709551615 4331683 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=406536 CPUtime=12.07 cores=0-7
/proc/12937/task/12946/stat : 12946 (plingeling) R 12935 12937 12723 0 -1 4202560 10334 1252 0 0 1206 1 0 0 25 0 9 0 591020336 416292864 47016 33554432000 4194304 4417332 140734180848800 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12937/tid=12947] ppid=12935 vsize=406536 CPUtime=12.06 cores=0-7
/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 2751 1252 0 0 1206 0 0 0 25 0 9 0 591020336 416292864 47016 33554432000 4194304 4417332 140734180848800 18446744073709551615 4265415 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=406536 CPUtime=12 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 18902 1252 0 0 1198 2 0 0 25 0 9 0 591020336 416292864 47016 33554432000 4194304 4417332 140734180848800 18446744073709551615 4253787 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=406536 CPUtime=12.07 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 11467 1252 0 0 1205 2 0 0 25 0 9 0 591020337 416292864 47016 33554432000 4194304 4417332 140734180848800 18446744073709551615 4253198 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=406536 CPUtime=12.06 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 13518 1252 0 0 1205 1 0 0 25 0 9 0 591020337 416292864 47016 33554432000 4194304 4417332 140734180848800 18446744073709551615 4275873 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=406536 CPUtime=12.05 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 14471 1252 0 0 1204 1 0 0 25 0 9 0 591020337 416292864 47016 33554432000 4194304 4417332 140734180848800 18446744073709551615 4330453 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 97.14
Current children cumulated vsize (KiB) 406536

[startup+25.5012 s]
/proc/loadavg: 7.68 7.94 7.97 9/179 12951
/proc/meminfo: memFree=16617512/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=397908 CPUtime=199.47 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 134170 1252 0 0 19927 20 0 0 18 0 9 0 591020274 407457792 46150 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 99477 46150 181 55 0 97363 0
[pid=12937/tid=12944] ppid=12935 vsize=397908 CPUtime=24.87 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 15077 1252 0 0 2485 2 0 0 25 0 9 0 591020336 407457792 46150 33554432000 4194304 4417332 140734180848800 18446744073709551615 4253228 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=397908 CPUtime=24.87 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 8306 1252 0 0 2485 2 0 0 25 0 9 0 591020336 407457792 46150 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364289 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=397908 CPUtime=24.87 cores=0-7
/proc/12937/task/12946/stat : 12946 (plingeling) R 12935 12937 12723 0 -1 4202560 10334 1252 0 0 2486 1 0 0 25 0 9 0 591020336 407457792 46150 33554432000 4194304 4417332 140734180848800 18446744073709551615 4250936 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12937/tid=12947] ppid=12935 vsize=397908 CPUtime=24.87 cores=0-7
/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 2751 1252 0 0 2487 0 0 0 25 0 9 0 591020336 407457792 46150 33554432000 4194304 4417332 140734180848800 18446744073709551615 4237194 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=397908 CPUtime=24.73 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 19163 1252 0 0 2471 2 0 0 25 0 9 0 591020336 407457792 46150 33554432000 4194304 4417332 140734180848800 18446744073709551615 4253228 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=397908 CPUtime=24.87 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 11482 1252 0 0 2485 2 0 0 25 0 9 0 591020337 407457792 46150 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=397908 CPUtime=24.86 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 13518 1252 0 0 2485 1 0 0 25 0 9 0 591020337 407457792 46150 33554432000 4194304 4417332 140734180848800 18446744073709551615 4239008 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=397908 CPUtime=24.86 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 17526 1252 0 0 2484 2 0 0 25 0 9 0 591020337 407457792 46150 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 199.47
Current children cumulated vsize (KiB) 397908

[startup+51.1005 s]
/proc/loadavg: 7.79 7.94 7.97 9/179 12952
/proc/meminfo: memFree=16598848/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=423312 CPUtime=404.13 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 145736 1252 0 0 40391 22 0 0 18 0 9 0 591020274 433471488 51070 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 105828 51070 181 55 0 103714 0
[pid=12937/tid=12944] ppid=12935 vsize=423312 CPUtime=50.47 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 15090 1252 0 0 5045 2 0 0 25 0 9 0 591020336 433471488 51070 33554432000 4194304 4417332 140734180848800 18446744073709551615 4365894 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=423312 CPUtime=50.47 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 8316 1252 0 0 5045 2 0 0 25 0 9 0 591020336 433471488 51070 33554432000 4194304 4417332 140734180848800 18446744073709551615 4260519 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=423312 CPUtime=50.46 cores=0-7

################
# More data... #
################

/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 16942 1252 0 0 22965 2 0 0 25 0 9 0 591020336 604344320 92902 33554432000 4194304 4417332 140734180848800 18446744073709551615 4352400 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=590180 CPUtime=228.42 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 33067 1252 0 0 22837 5 0 0 25 0 9 0 591020336 604344320 92902 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364504 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=590180 CPUtime=229.67 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 24096 1252 0 0 22963 4 0 0 25 0 9 0 591020337 604344320 92902 33554432000 4194304 4417332 140734180848800 18446744073709551615 4265387 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=590180 CPUtime=229.67 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 24543 1252 0 0 22964 3 0 0 25 0 9 0 591020337 604344320 92902 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=590180 CPUtime=229.65 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 41762 1252 0 0 22960 5 0 0 25 0 9 0 591020337 604344320 92902 33554432000 4194304 4417332 140734180848800 18446744073709551615 4331770 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1836.76
Current children cumulated vsize (KiB) 590180

[startup+255.901 s]
/proc/loadavg: 8.03 8.00 7.98 9/179 12957
/proc/meminfo: memFree=16441192/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=582900 CPUtime=2041.42 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 268570 1252 0 0 204102 40 0 0 18 0 9 0 591020274 596889600 90971 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 145725 90971 181 55 0 143611 0
[pid=12937/tid=12944] ppid=12935 vsize=582900 CPUtime=255.28 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 32216 1252 0 0 25524 4 0 0 25 0 9 0 591020336 596889600 90971 33554432000 4194304 4417332 140734180848800 18446744073709551615 4263050 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=582900 CPUtime=255.25 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 22128 1252 0 0 25521 4 0 0 25 0 9 0 591020336 596889600 90971 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=582900 CPUtime=255.27 cores=0-7
/proc/12937/task/12946/stat : 12946 (plingeling) R 12935 12937 12723 0 -1 4202560 23784 1252 0 0 25524 3 0 0 25 0 9 0 591020336 596889600 90971 33554432000 4194304 4417332 140734180848800 18446744073709551615 4275960 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12937/tid=12947] ppid=12935 vsize=582900 CPUtime=255.27 cores=0-7
/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 23353 1252 0 0 25524 3 0 0 25 0 9 0 591020336 596889600 90971 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=582900 CPUtime=253.88 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 33465 1252 0 0 25383 5 0 0 25 0 9 0 591020336 596889600 90971 33554432000 4194304 4417332 140734180848800 18446744073709551615 4358064 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=582900 CPUtime=255.27 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 26301 1252 0 0 25522 5 0 0 25 0 9 0 591020337 596889600 90971 33554432000 4194304 4417332 140734180848800 18446744073709551615 4366233 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=582900 CPUtime=255.26 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 26591 1252 0 0 25523 3 0 0 25 0 9 0 591020337 596889600 90971 33554432000 4194304 4417332 140734180848800 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=582900 CPUtime=255.26 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 44719 1252 0 0 25520 6 0 0 25 0 9 0 591020337 596889600 90971 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2041.42
Current children cumulated vsize (KiB) 582900

[startup+262.301 s]
/proc/loadavg: 8.03 8.00 7.98 9/179 12958
/proc/meminfo: memFree=16424576/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=598208 CPUtime=2092.59 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 274116 1252 0 0 209218 41 0 0 18 0 9 0 591020274 612564992 94798 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 149552 94798 181 55 0 147438 0
[pid=12937/tid=12944] ppid=12935 vsize=598208 CPUtime=261.68 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 32648 1252 0 0 26164 4 0 0 25 0 9 0 591020336 612564992 94798 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=598208 CPUtime=261.65 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 22128 1252 0 0 26161 4 0 0 25 0 9 0 591020336 612564992 94798 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=598208 CPUtime=261.66 cores=0-7
/proc/12937/task/12946/stat : 12946 (plingeling) R 12935 12937 12723 0 -1 4202560 25967 1252 0 0 26163 3 0 0 25 0 9 0 591020336 612564992 94798 33554432000 4194304 4417332 140734180848800 18446744073709551615 4353416 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12937/tid=12947] ppid=12935 vsize=598208 CPUtime=261.67 cores=0-7
/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 23927 1252 0 0 26164 3 0 0 25 0 9 0 591020336 612564992 94798 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=598208 CPUtime=260.24 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 33465 1252 0 0 26019 5 0 0 25 0 9 0 591020336 612564992 94798 33554432000 4194304 4417332 140734180848800 18446744073709551615 4264909 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=598208 CPUtime=261.67 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 27326 1252 0 0 26162 5 0 0 25 0 9 0 591020337 612564992 94798 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=598208 CPUtime=261.66 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 26591 1252 0 0 26163 3 0 0 25 0 9 0 591020337 612564992 94798 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=598208 CPUtime=261.66 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 46051 1252 0 0 26160 6 0 0 25 0 9 0 591020337 612564992 94798 33554432000 4194304 4417332 140734180848800 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2092.59
Current children cumulated vsize (KiB) 598208

[startup+265.501 s]
/proc/loadavg: 8.03 8.00 7.98 9/179 12958
/proc/meminfo: memFree=16426932/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=584688 CPUtime=2118.17 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 275162 1252 0 0 211776 41 0 0 18 0 9 0 591020274 598720512 91418 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 146172 91418 181 55 0 144058 0
[pid=12937/tid=12944] ppid=12935 vsize=584688 CPUtime=264.88 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 32648 1252 0 0 26484 4 0 0 25 0 9 0 591020336 598720512 91418 33554432000 4194304 4417332 140734180848800 18446744073709551615 4232404 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=584688 CPUtime=264.85 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 22128 1252 0 0 26481 4 0 0 25 0 9 0 591020336 598720512 91418 33554432000 4194304 4417332 140734180848800 18446744073709551615 4232609 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=584688 CPUtime=264.86 cores=0-7
/proc/12937/task/12946/stat : 12946 (plingeling) R 12935 12937 12723 0 -1 4202560 25967 1252 0 0 26483 3 0 0 25 0 9 0 591020336 598720512 91418 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12937/tid=12947] ppid=12935 vsize=584688 CPUtime=264.88 cores=0-7
/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 24821 1252 0 0 26484 4 0 0 25 0 9 0 591020336 598720512 91418 33554432000 4194304 4417332 140734180848800 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=584688 CPUtime=263.43 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 33465 1252 0 0 26338 5 0 0 25 0 9 0 591020336 598720512 91418 33554432000 4194304 4417332 140734180848800 18446744073709551615 4356788 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=584688 CPUtime=264.87 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 27478 1252 0 0 26482 5 0 0 25 0 9 0 591020337 598720512 91418 33554432000 4194304 4417332 140734180848800 18446744073709551615 4365915 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=584688 CPUtime=264.86 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 26591 1252 0 0 26483 3 0 0 25 0 9 0 591020337 598720512 91418 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=584688 CPUtime=264.86 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 46051 1252 0 0 26480 6 0 0 25 0 9 0 591020337 598720512 91418 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2118.17
Current children cumulated vsize (KiB) 584688

[startup+268.7 s]
/proc/loadavg: 8.03 8.00 7.98 9/179 12958
/proc/meminfo: memFree=16435740/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=586808 CPUtime=2143.75 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 275694 1252 0 0 214334 41 0 0 18 0 9 0 591020274 600891392 91948 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 146702 91948 181 55 0 144588 0
[pid=12937/tid=12944] ppid=12935 vsize=586808 CPUtime=268.08 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 32648 1252 0 0 26804 4 0 0 25 0 9 0 591020336 600891392 91948 33554432000 4194304 4417332 140734180848800 18446744073709551615 18446744073699065971 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=586808 CPUtime=268.05 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 22128 1252 0 0 26801 4 0 0 25 0 9 0 591020336 600891392 91948 33554432000 4194304 4417332 140734180848800 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=586808 CPUtime=268.06 cores=0-7
/proc/12937/task/12946/stat : 12946 (plingeling) R 12935 12937 12723 0 -1 4202560 25967 1252 0 0 26803 3 0 0 25 0 9 0 591020336 600891392 91948 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12937/tid=12947] ppid=12935 vsize=586808 CPUtime=268.08 cores=0-7
/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 25190 1252 0 0 26804 4 0 0 25 0 9 0 591020336 600891392 91948 33554432000 4194304 4417332 140734180848800 18446744073709551615 4265025 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=586808 CPUtime=266.61 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 33465 1252 0 0 26656 5 0 0 25 0 9 0 591020336 600891392 91948 33554432000 4194304 4417332 140734180848800 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=586808 CPUtime=268.07 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 27631 1252 0 0 26802 5 0 0 25 0 9 0 591020337 600891392 91948 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=586808 CPUtime=268.06 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 26601 1252 0 0 26803 3 0 0 25 0 9 0 591020337 600891392 91948 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=586808 CPUtime=268.06 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 46051 1252 0 0 26800 6 0 0 25 0 9 0 591020337 600891392 91948 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364452 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2143.75
Current children cumulated vsize (KiB) 586808

[startup+269.506 s]
/proc/loadavg: 8.02 8.00 7.98 9/179 12958
/proc/meminfo: memFree=16435488/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=587592 CPUtime=2150.19 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 275890 1252 0 0 214978 41 0 0 18 0 9 0 591020274 601694208 92144 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 146898 92144 181 55 0 144784 0
[pid=12937/tid=12944] ppid=12935 vsize=587592 CPUtime=268.89 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 32648 1252 0 0 26885 4 0 0 25 0 9 0 591020336 601694208 92144 33554432000 4194304 4417332 140734180848800 18446744073709551615 4250938 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=587592 CPUtime=268.85 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 22128 1252 0 0 26881 4 0 0 25 0 9 0 591020336 601694208 92144 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=587592 CPUtime=268.87 cores=0-7
/proc/12937/task/12946/stat : 12946 (plingeling) R 12935 12937 12723 0 -1 4202560 25967 1252 0 0 26884 3 0 0 25 0 9 0 591020336 601694208 92144 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12937/tid=12947] ppid=12935 vsize=587592 CPUtime=268.88 cores=0-7
/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 25386 1252 0 0 26884 4 0 0 25 0 9 0 591020336 601694208 92144 33554432000 4194304 4417332 140734180848800 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=587592 CPUtime=267.41 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 33465 1252 0 0 26736 5 0 0 25 0 9 0 591020336 601694208 92144 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=587592 CPUtime=268.88 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 27631 1252 0 0 26883 5 0 0 25 0 9 0 591020337 601694208 92144 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=587592 CPUtime=268.87 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 26601 1252 0 0 26884 3 0 0 25 0 9 0 591020337 601694208 92144 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=587592 CPUtime=268.87 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 46051 1252 0 0 26881 6 0 0 25 0 9 0 591020337 601694208 92144 33554432000 4194304 4417332 140734180848800 18446744073709551615 4366610 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2150.19
Current children cumulated vsize (KiB) 587592

[startup+270.301 s]
/proc/loadavg: 8.02 8.00 7.98 9/179 12958
/proc/meminfo: memFree=16435488/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=589172 CPUtime=2156.55 cores=0-7
/proc/12937/stat : 12937 (plingeling) S 12935 12937 12723 0 -1 4202496 276286 1252 0 0 215614 41 0 0 18 0 9 0 591020274 603312128 92539 33554432000 4194304 4417332 140734180848800 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12937/statm: 147293 92539 181 55 0 145179 0
[pid=12937/tid=12944] ppid=12935 vsize=589172 CPUtime=269.68 cores=0-7
/proc/12937/task/12944/stat : 12944 (plingeling) R 12935 12937 12723 0 -1 4202560 32648 1252 0 0 26964 4 0 0 25 0 9 0 591020336 603312128 92539 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12937/tid=12945] ppid=12935 vsize=589172 CPUtime=269.65 cores=0-7
/proc/12937/task/12945/stat : 12945 (plingeling) R 12935 12937 12723 0 -1 4202560 22128 1252 0 0 26961 4 0 0 25 0 9 0 591020336 603312128 92539 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12937/tid=12946] ppid=12935 vsize=589172 CPUtime=269.66 cores=0-7
/proc/12937/task/12946/stat : 12946 (plingeling) R 12935 12937 12723 0 -1 4202560 25978 1252 0 0 26963 3 0 0 25 0 9 0 591020336 603312128 92539 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12937/tid=12947] ppid=12935 vsize=589172 CPUtime=269.68 cores=0-7
/proc/12937/task/12947/stat : 12947 (plingeling) R 12935 12937 12723 0 -1 4202560 25465 1252 0 0 26964 4 0 0 25 0 9 0 591020336 603312128 92539 33554432000 4194304 4417332 140734180848800 18446744073709551615 4281683 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12937/tid=12948] ppid=12935 vsize=589172 CPUtime=268.2 cores=0-7
/proc/12937/task/12948/stat : 12948 (plingeling) R 12935 12937 12723 0 -1 4202560 33465 1252 0 0 26815 5 0 0 25 0 9 0 591020336 603312128 92539 33554432000 4194304 4417332 140734180848800 18446744073709551615 4355734 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12937/tid=12949] ppid=12935 vsize=589172 CPUtime=269.67 cores=0-7
/proc/12937/task/12949/stat : 12949 (plingeling) R 12935 12937 12723 0 -1 4202560 27937 1252 0 0 26962 5 0 0 25 0 9 0 591020337 603312128 92539 33554432000 4194304 4417332 140734180848800 18446744073709551615 4353408 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12937/tid=12950] ppid=12935 vsize=589172 CPUtime=269.66 cores=0-7
/proc/12937/task/12950/stat : 12950 (plingeling) R 12935 12937 12723 0 -1 4202560 26601 1252 0 0 26963 3 0 0 25 0 9 0 591020337 603312128 92539 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12937/tid=12951] ppid=12935 vsize=589172 CPUtime=269.66 cores=0-7
/proc/12937/task/12951/stat : 12951 (plingeling) R 12935 12937 12723 0 -1 4202560 46051 1252 0 0 26960 6 0 0 25 0 9 0 591020337 603312128 92539 33554432000 4194304 4417332 140734180848800 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2156.55
Current children cumulated vsize (KiB) 589172

[startup+270.501 s]
/proc/loadavg: 8.02 8.00 7.98 2/171 12958
/proc/meminfo: memFree=16748768/32951124 swapFree=67111528/67111528
[pid=12937] ppid=12935 vsize=0 CPUtime=2157.89 cores=0-7
/proc/12937/stat : 12937 (plingeling) Z 12935 12937 12723 0 -1 4202524 276290 1252 0 0 215746 43 0 0 17 0 1 0 591020274 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/12937/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 2157.89
Current children cumulated vsize (KiB) 0

Child status: 20
Real time (s): 270.507
CPU time (s): 2157.91
CPU user time (s): 2157.47
CPU system time (s): 0.438933
CPU usage (%): 797.726
Max. virtual memory (cumulated for all children) (KiB): 604984

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2157.47
system time used= 0.438933
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 277542
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 441
involuntary context switches= 10297

runsolver used 0.45693 second user time and 1.02584 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-28 18:24:57
IDJOB=3309702
IDBENCH=82469
IDSOLVER=1695
FILE ID=node110/3309702-1304007897
RUNJOBID= node110-1304002891-12737
PBS_JOBID= 13168799
Free space on /tmp= 72836 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309702-1304007897/watcher-3309702-1304007897 -o /tmp/evaluation-result-3309702-1304007897/solver-3309702-1304007897 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309702-1304007897.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 9059f458d76edcc4dc5681746a6de6e5
RANDOM SEED=1050125242

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16801648 kB
Buffers:       2331724 kB
Cached:       13180320 kB
SwapCached:          0 kB
Active:        7778372 kB
Inactive:      7798468 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16801648 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            4668 kB
Writeback:           0 kB
AnonPages:       63976 kB
Mapped:          14676 kB
Slab:           505696 kB
PageTables:       4280 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   186992 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72836 MiB
End job on node110 at 2011-04-28 18:29:28