Trace number 3372572

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)UNSAT 13214.1 1653.27

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf
MD5SUMee159af2e208d290f7f3fefd15c344f2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark630.529
Satisfiable
(Un)Satisfiability was proved
Number of variables44692
Number of clauses129620
Sum of the clauses size302444
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 286412
Number of clauses of size 343206
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

13214.03/1653.23	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372572-1307662036/watcher-3372572-1307662036 -o /tmp/evaluation-result-3372572-1307662036/solver-3372572-1307662036 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372572-1307662036.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.03 5.02 6.57 1/170 3824
/proc/meminfo: memFree=32016368/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=9840 CPUtime=0 cores=0-7
/proc/3824/stat : 3824 (plingeling) R 3822 3824 3313 0 -1 4202496 525 1251 0 0 0 0 0 0 22 0 1 0 877804405 10076160 454 33554432000 4194304 4417452 140736769302560 18446744073709551615 222921470952 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/3824/statm: 2460 454 147 55 0 346 0

[startup+0.102879 s]
/proc/loadavg: 5.03 5.02 6.57 1/170 3824
/proc/meminfo: memFree=32016368/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=29972 CPUtime=0.09 cores=0-7
/proc/3824/stat : 3824 (plingeling) R 3822 3824 3313 0 -1 4202496 5572 1251 0 0 9 0 0 0 22 0 1 0 877804405 30691328 5501 33554432000 4194304 4417452 140736769302560 18446744073709551615 222921776896 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/3824/statm: 7493 5501 149 55 0 5379 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 29972

[startup+0.200861 s]
/proc/loadavg: 5.03 5.02 6.57 1/170 3824
/proc/meminfo: memFree=32016368/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=44704 CPUtime=0.19 cores=0-7
/proc/3824/stat : 3824 (plingeling) R 3822 3824 3313 0 -1 4202496 9271 1251 0 0 18 1 0 0 23 0 1 0 877804405 45776896 9200 33554432000 4194304 4417452 140736769302560 18446744073709551615 4231626 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/3824/statm: 11176 9200 149 55 0 9062 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 44704

[startup+0.300843 s]
/proc/loadavg: 5.03 5.02 6.57 1/170 3824
/proc/meminfo: memFree=32016368/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=63764 CPUtime=0.29 cores=0-7
/proc/3824/stat : 3824 (plingeling) R 3822 3824 3313 0 -1 4202496 14048 1251 0 0 27 2 0 0 23 0 1 0 877804405 65294336 13965 33554432000 4194304 4417452 140736769302560 18446744073709551615 4264940 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/3824/statm: 15941 13965 149 55 0 13827 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 63764

[startup+1.21864 s]
/proc/loadavg: 5.03 5.02 6.57 1/170 3824
/proc/meminfo: memFree=32016368/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=299216 CPUtime=7.47 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 36387 1251 0 0 743 4 0 0 18 0 9 0 877804405 306397184 20807 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 74804 20807 174 55 0 72690 0
Current children cumulated CPU time (s) 7.47
Current children cumulated vsize (KiB) 299216

[startup+1.50059 s]
/proc/loadavg: 5.03 5.02 6.57 1/170 3824
/proc/meminfo: memFree=32016368/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=293984 CPUtime=9.73 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 38855 1251 0 0 968 5 0 0 18 0 9 0 877804405 301039616 19609 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 73496 19612 174 55 0 71382 0
Current children cumulated CPU time (s) 9.73
Current children cumulated vsize (KiB) 293984

[startup+3.10629 s]
/proc/loadavg: 5.27 5.07 6.58 9/179 3838
/proc/meminfo: memFree=31933736/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=298120 CPUtime=22.56 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 58080 1251 0 0 2249 7 0 0 18 0 9 0 877804405 305274880 20479 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 74530 20479 179 55 0 72416 0
[pid=3824/tid=3831] ppid=3822 vsize=298120 CPUtime=2.78 cores=0-7
/proc/3824/task/3831/stat : 3831 (plingeling) R 3822 3824 3313 0 -1 4202560 7531 1251 0 0 277 1 0 0 25 0 9 0 877804437 305274880 20479 33554432000 4194304 4417452 140736769302560 18446744073709551615 4257084 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3824/tid=3832] ppid=3822 vsize=298120 CPUtime=2.74 cores=0-7
/proc/3824/task/3832/stat : 3832 (plingeling) R 3822 3824 3313 0 -1 4202560 5301 1251 0 0 274 0 0 0 25 0 9 0 877804437 305274880 20479 33554432000 4194304 4417452 140736769302560 18446744073709551615 4233530 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3824/tid=3833] ppid=3822 vsize=298120 CPUtime=2.78 cores=0-7
/proc/3824/task/3833/stat : 3833 (plingeling) R 3822 3824 3313 0 -1 4202560 8518 1251 0 0 278 0 0 0 25 0 9 0 877804437 305274880 20479 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3824/tid=3834] ppid=3822 vsize=298120 CPUtime=2.78 cores=0-7
/proc/3824/task/3834/stat : 3834 (plingeling) R 3822 3824 3313 0 -1 4202560 790 1251 0 0 278 0 0 0 23 0 9 0 877804437 305274880 20479 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3824/tid=3835] ppid=3822 vsize=298120 CPUtime=2.77 cores=0-7
/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 4559 1251 0 0 277 0 0 0 23 0 9 0 877804437 305274880 20479 33554432000 4194304 4417452 140736769302560 18446744073709551615 4253167 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=298120 CPUtime=2.77 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 4986 1251 0 0 277 0 0 0 23 0 9 0 877804437 305274880 20479 33554432000 4194304 4417452 140736769302560 18446744073709551615 4240047 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=298120 CPUtime=2.78 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 3365 1251 0 0 278 0 0 0 23 0 9 0 877804437 305274880 20479 33554432000 4194304 4417452 140736769302560 18446744073709551615 4237672 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=298120 CPUtime=2.78 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 4869 1251 0 0 278 0 0 0 23 0 9 0 877804437 305274880 20479 33554432000 4194304 4417452 140736769302560 18446744073709551615 4240311 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 22.56
Current children cumulated vsize (KiB) 298120

[startup+6.30071 s]
/proc/loadavg: 5.27 5.07 6.58 9/179 3839
/proc/meminfo: memFree=31920756/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=309044 CPUtime=48.14 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 66534 1251 0 0 4805 9 0 0 18 0 9 0 877804405 316461056 23728 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 77261 23728 179 55 0 75147 0
[pid=3824/tid=3831] ppid=3822 vsize=309044 CPUtime=5.98 cores=0-7
/proc/3824/task/3831/stat : 3831 (plingeling) R 3822 3824 3313 0 -1 4202560 9067 1251 0 0 597 1 0 0 25 0 9 0 877804437 316461056 23728 33554432000 4194304 4417452 140736769302560 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3824/tid=3832] ppid=3822 vsize=309044 CPUtime=5.94 cores=0-7
/proc/3824/task/3832/stat : 3832 (plingeling) R 3822 3824 3313 0 -1 4202560 7099 1251 0 0 594 0 0 0 25 0 9 0 877804437 316461056 23728 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3824/tid=3833] ppid=3822 vsize=309044 CPUtime=5.98 cores=0-7
/proc/3824/task/3833/stat : 3833 (plingeling) R 3822 3824 3313 0 -1 4202560 8518 1251 0 0 598 0 0 0 25 0 9 0 877804437 316461056 23728 33554432000 4194304 4417452 140736769302560 18446744073709551615 4236693 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3824/tid=3834] ppid=3822 vsize=309044 CPUtime=5.98 cores=0-7
/proc/3824/task/3834/stat : 3834 (plingeling) R 3822 3824 3313 0 -1 4202560 790 1251 0 0 598 0 0 0 25 0 9 0 877804437 316461056 23728 33554432000 4194304 4417452 140736769302560 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3824/tid=3835] ppid=3822 vsize=309044 CPUtime=5.98 cores=0-7
/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 6095 1251 0 0 597 1 0 0 25 0 9 0 877804437 316461056 23728 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=309044 CPUtime=5.95 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 6778 1251 0 0 595 0 0 0 25 0 9 0 877804437 316461056 23728 33554432000 4194304 4417452 140736769302560 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=309044 CPUtime=5.98 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 3365 1251 0 0 598 0 0 0 25 0 9 0 877804437 316461056 23728 33554432000 4194304 4417452 140736769302560 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=309044 CPUtime=5.97 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 6661 1251 0 0 597 0 0 0 25 0 9 0 877804437 316461056 23728 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 48.14
Current children cumulated vsize (KiB) 309044

[startup+12.7005 s]
/proc/loadavg: 5.48 5.12 6.59 9/179 3839
/proc/meminfo: memFree=31910984/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=326384 CPUtime=99.27 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 70980 1251 0 0 9917 10 0 0 18 0 9 0 877804405 334217216 28064 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 81596 28064 180 55 0 79482 0
[pid=3824/tid=3831] ppid=3822 vsize=326384 CPUtime=12.37 cores=0-7
/proc/3824/task/3831/stat : 3831 (plingeling) R 3822 3824 3313 0 -1 4202560 9596 1251 0 0 1236 1 0 0 25 0 9 0 877804437 334217216 28064 33554432000 4194304 4417452 140736769302560 18446744073709551615 4365162 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3824/tid=3832] ppid=3822 vsize=326384 CPUtime=12.33 cores=0-7
/proc/3824/task/3832/stat : 3832 (plingeling) R 3822 3824 3313 0 -1 4202560 8330 1251 0 0 1233 0 0 0 25 0 9 0 877804437 334217216 28064 33554432000 4194304 4417452 140736769302560 18446744073709551615 4264403 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3824/tid=3833] ppid=3822 vsize=326384 CPUtime=12.37 cores=0-7
/proc/3824/task/3833/stat : 3833 (plingeling) R 3822 3824 3313 0 -1 4202560 8611 1251 0 0 1237 0 0 0 25 0 9 0 877804437 334217216 28064 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3824/tid=3834] ppid=3822 vsize=326384 CPUtime=12.38 cores=0-7
/proc/3824/task/3834/stat : 3834 (plingeling) R 3822 3824 3313 0 -1 4202560 1064 1251 0 0 1238 0 0 0 25 0 9 0 877804437 334217216 28064 33554432000 4194304 4417452 140736769302560 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3824/tid=3835] ppid=3822 vsize=326384 CPUtime=12.37 cores=0-7
/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 6785 1251 0 0 1236 1 0 0 25 0 9 0 877804437 334217216 28064 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364583 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=326384 CPUtime=12.31 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 7533 1251 0 0 1231 0 0 0 25 0 9 0 877804437 334217216 28064 33554432000 4194304 4417452 140736769302560 18446744073709551615 4279057 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=326384 CPUtime=12.37 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 3727 1251 0 0 1237 0 0 0 25 0 9 0 877804437 334217216 28064 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=326384 CPUtime=12.37 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 7173 1251 0 0 1237 0 0 0 25 0 9 0 877804437 334217216 28064 33554432000 4194304 4417452 140736769302560 18446744073709551615 4271035 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 99.27
Current children cumulated vsize (KiB) 326384

[startup+25.5012 s]
/proc/loadavg: 6.04 5.26 6.61 9/179 3839
/proc/meminfo: memFree=31861912/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=378148 CPUtime=201.6 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 98307 1251 0 0 20146 14 0 0 18 0 9 0 877804405 387223552 41017 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 94537 41017 180 55 0 92423 0
[pid=3824/tid=3831] ppid=3822 vsize=378148 CPUtime=25.17 cores=0-7
/proc/3824/task/3831/stat : 3831 (plingeling) R 3822 3824 3313 0 -1 4202560 13245 1251 0 0 2516 1 0 0 25 0 9 0 877804437 387223552 41017 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364752 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3824/tid=3832] ppid=3822 vsize=378148 CPUtime=25.13 cores=0-7
/proc/3824/task/3832/stat : 3832 (plingeling) R 3822 3824 3313 0 -1 4202560 12176 1251 0 0 2512 1 0 0 25 0 9 0 877804437 387223552 41017 33554432000 4194304 4417452 140736769302560 18446744073709551615 4357879 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3824/tid=3833] ppid=3822 vsize=378148 CPUtime=25.18 cores=0-7
/proc/3824/task/3833/stat : 3833 (plingeling) R 3822 3824 3313 0 -1 4202560 10868 1251 0 0 2517 1 0 0 25 0 9 0 877804437 387223552 41017 33554432000 4194304 4417452 140736769302560 18446744073709551615 4252389 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3824/tid=3834] ppid=3822 vsize=378148 CPUtime=25.17 cores=0-7
/proc/3824/task/3834/stat : 3834 (plingeling) R 3822 3824 3313 0 -1 4202560 3122 1251 0 0 2517 0 0 0 25 0 9 0 877804437 387223552 41017 33554432000 4194304 4417452 140736769302560 18446744073709551615 4358865 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3824/tid=3835] ppid=3822 vsize=378148 CPUtime=25.17 cores=0-7
/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 9939 1251 0 0 2516 1 0 0 25 0 9 0 877804437 387223552 41017 33554432000 4194304 4417452 140736769302560 18446744073709551615 4365973 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=378148 CPUtime=25.04 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 9432 1251 0 0 2503 1 0 0 25 0 9 0 877804437 387223552 41017 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=378148 CPUtime=25.17 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 7096 1251 0 0 2516 1 0 0 25 0 9 0 877804437 387223552 41017 33554432000 4194304 4417452 140736769302560 18446744073709551615 4251833 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=378148 CPUtime=25.17 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 14268 1251 0 0 2515 2 0 0 25 0 9 0 877804437 387223552 41017 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 201.6
Current children cumulated vsize (KiB) 378148

[startup+51.1005 s]
/proc/loadavg: 6.77 5.50 6.65 9/179 3840
/proc/meminfo: memFree=31770192/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=463824 CPUtime=406.25 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 154039 1251 0 0 40603 22 0 0 18 0 9 0 877804405 474955776 62948 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 115956 62948 180 55 0 113842 0
[pid=3824/tid=3831] ppid=3822 vsize=463824 CPUtime=50.77 cores=0-7
/proc/3824/task/3831/stat : 3831 (plingeling) R 3822 3824 3313 0 -1 4202560 22389 1251 0 0 5074 3 0 0 25 0 9 0 877804437 474955776 62948 33554432000 4194304 4417452 140736769302560 18446744073709551615 4366698 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3824/tid=3832] ppid=3822 vsize=463824 CPUtime=50.74 cores=0-7
/proc/3824/task/3832/stat : 3832 (plingeling) R 3822 3824 3313 0 -1 4202560 19862 1251 0 0 5071 3 0 0 25 0 9 0 877804437 474955776 62948 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3824/tid=3833] ppid=3822 vsize=463824 CPUtime=50.77 cores=0-7
/proc/3824/task/3833/stat : 3833 (plingeling) R 3822 3824 3313 0 -1 4202560 15496 1251 0 0 5076 1 0 0 25 0 9 0 877804437 474955776 62948 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364583 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3824/tid=3834] ppid=3822 vsize=463824 CPUtime=50.77 cores=0-7
/proc/3824/task/3834/stat : 3834 (plingeling) R 3822 3824 3313 0 -1 4202560 8142 1251 0 0 5076 1 0 0 25 0 9 0 877804437 474955776 62948 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3824/tid=3835] ppid=3822 vsize=463824 CPUtime=50.77 cores=0-7
/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 21961 1251 0 0 5074 3 0 0 25 0 9 0 877804437 474955776 62948 33554432000 4194304 4417452 140736769302560 18446744073709551615 4353585 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=463824 CPUtime=50.51 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 14346 1251 0 0 5050 1 0 0 25 0 9 0 877804437 474955776 62948 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=463824 CPUtime=50.78 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 10278 1251 0 0 5076 2 0 0 25 0 9 0 877804437 474955776 62948 33554432000 4194304 4417452 140736769302560 18446744073709551615 4320936 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=463824 CPUtime=50.77 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 23404 1251 0 0 5074 3 0 0 25 0 9 0 877804437 474955776 62948 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 406.25
Current children cumulated vsize (KiB) 463824

[startup+102.301 s]
/proc/loadavg: 7.52 5.90 6.72 9/179 3841

################
# More data... #
################

/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 110998 1251 0 0 161309 18 0 0 25 0 9 0 877804437 1680736256 356848 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=1641344 CPUtime=1604.55 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 159632 1251 0 0 160429 26 0 0 25 0 9 0 877804437 1680736256 356848 33554432000 4194304 4417452 140736769302560 18446744073709551615 4365120 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=1641344 CPUtime=1613.31 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 375325 1251 0 0 161264 67 0 0 25 0 9 0 877804437 1680736256 356848 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=1641344 CPUtime=1613.16 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 142719 1251 0 0 161298 18 0 0 25 0 9 0 877804437 1680736256 356848 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12897.8
Current children cumulated vsize (KiB) 1641344

[startup+1639.2 s]
/proc/loadavg: 8.00 8.00 7.76 9/179 3882
/proc/meminfo: memFree=30814948/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=1418592 CPUtime=13102.5 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 1579183 1251 0 0 1309990 256 0 0 18 0 9 0 877804405 1452638208 301160 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 354648 301160 180 55 0 352534 0
[pid=3824/tid=3831] ppid=3822 vsize=1418592 CPUtime=1638.91 cores=0-7
/proc/3824/task/3831/stat : 3831 (plingeling) R 3822 3824 3313 0 -1 4202560 283770 1251 0 0 163843 48 0 0 25 0 9 0 877804437 1452638208 301160 33554432000 4194304 4417452 140736769302560 18446744073709551615 4251107 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3824/tid=3832] ppid=3822 vsize=1418592 CPUtime=1638.81 cores=0-7
/proc/3824/task/3832/stat : 3832 (plingeling) R 3822 3824 3313 0 -1 4202560 120968 1251 0 0 163866 15 0 0 25 0 9 0 877804437 1452638208 301160 33554432000 4194304 4417452 140736769302560 18446744073709551615 4354517 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3824/tid=3833] ppid=3822 vsize=1418592 CPUtime=1638.91 cores=0-7
/proc/3824/task/3833/stat : 3833 (plingeling) R 3822 3824 3313 0 -1 4202560 212175 1251 0 0 163856 35 0 0 25 0 9 0 877804437 1452638208 301160 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3824/tid=3834] ppid=3822 vsize=1418592 CPUtime=1638.91 cores=0-7
/proc/3824/task/3834/stat : 3834 (plingeling) R 3822 3824 3313 0 -1 4202560 151139 1251 0 0 163869 22 0 0 25 0 9 0 877804437 1452638208 301160 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3824/tid=3835] ppid=3822 vsize=1418592 CPUtime=1638.87 cores=0-7
/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 110998 1251 0 0 163869 18 0 0 25 0 9 0 877804437 1452638208 301160 33554432000 4194304 4417452 140736769302560 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=1418592 CPUtime=1630.01 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 159632 1251 0 0 162975 26 0 0 25 0 9 0 877804437 1452638208 301160 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=1418592 CPUtime=1638.91 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 379621 1251 0 0 163823 68 0 0 25 0 9 0 877804437 1452638208 301160 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=1418592 CPUtime=1638.76 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 142719 1251 0 0 163858 18 0 0 25 0 9 0 877804437 1452638208 301160 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 13102.5
Current children cumulated vsize (KiB) 1418592

[startup+1645.6 s]
/proc/loadavg: 8.00 8.00 7.76 9/179 3882
/proc/meminfo: memFree=30812096/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=1421416 CPUtime=13153.6 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 1579889 1251 0 0 1315106 256 0 0 18 0 9 0 877804405 1455529984 301866 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 355354 301866 180 55 0 353240 0
[pid=3824/tid=3831] ppid=3822 vsize=1421416 CPUtime=1645.31 cores=0-7
/proc/3824/task/3831/stat : 3831 (plingeling) R 3822 3824 3313 0 -1 4202560 284116 1251 0 0 164483 48 0 0 25 0 9 0 877804437 1455529984 301866 33554432000 4194304 4417452 140736769302560 18446744073709551615 4250945 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3824/tid=3832] ppid=3822 vsize=1421416 CPUtime=1645.21 cores=0-7
/proc/3824/task/3832/stat : 3832 (plingeling) R 3822 3824 3313 0 -1 4202560 120968 1251 0 0 164506 15 0 0 25 0 9 0 877804437 1455529984 301866 33554432000 4194304 4417452 140736769302560 18446744073709551615 4354323 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3824/tid=3833] ppid=3822 vsize=1421416 CPUtime=1645.31 cores=0-7
/proc/3824/task/3833/stat : 3833 (plingeling) R 3822 3824 3313 0 -1 4202560 212175 1251 0 0 164496 35 0 0 25 0 9 0 877804437 1455529984 301866 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3824/tid=3834] ppid=3822 vsize=1421416 CPUtime=1645.31 cores=0-7
/proc/3824/task/3834/stat : 3834 (plingeling) R 3822 3824 3313 0 -1 4202560 151139 1251 0 0 164509 22 0 0 25 0 9 0 877804437 1455529984 301866 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3824/tid=3835] ppid=3822 vsize=1421416 CPUtime=1645.27 cores=0-7
/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 110998 1251 0 0 164509 18 0 0 25 0 9 0 877804437 1455529984 301866 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=1421416 CPUtime=1636.38 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 159632 1251 0 0 163612 26 0 0 25 0 9 0 877804437 1455529984 301866 33554432000 4194304 4417452 140736769302560 18446744073709551615 4237326 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=1421416 CPUtime=1645.31 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 379981 1251 0 0 164463 68 0 0 25 0 9 0 877804437 1455529984 301866 33554432000 4194304 4417452 140736769302560 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=1421416 CPUtime=1645.15 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 142719 1251 0 0 164497 18 0 0 25 0 9 0 877804437 1455529984 301866 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 13153.6
Current children cumulated vsize (KiB) 1421416

[startup+1648.8 s]
/proc/loadavg: 8.00 8.00 7.76 9/179 3882
/proc/meminfo: memFree=30806020/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=1427472 CPUtime=13179.2 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 1581403 1251 0 0 1317665 257 0 0 18 0 9 0 877804405 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 356868 303380 180 55 0 354754 0
[pid=3824/tid=3831] ppid=3822 vsize=1427472 CPUtime=1648.51 cores=0-7
/proc/3824/task/3831/stat : 3831 (plingeling) R 3822 3824 3313 0 -1 4202560 284116 1251 0 0 164803 48 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3824/tid=3832] ppid=3822 vsize=1427472 CPUtime=1648.41 cores=0-7
/proc/3824/task/3832/stat : 3832 (plingeling) R 3822 3824 3313 0 -1 4202560 120968 1251 0 0 164826 15 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3824/tid=3833] ppid=3822 vsize=1427472 CPUtime=1648.51 cores=0-7
/proc/3824/task/3833/stat : 3833 (plingeling) R 3822 3824 3313 0 -1 4202560 212175 1251 0 0 164816 35 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3824/tid=3834] ppid=3822 vsize=1427472 CPUtime=1648.51 cores=0-7
/proc/3824/task/3834/stat : 3834 (plingeling) R 3822 3824 3313 0 -1 4202560 152653 1251 0 0 164828 23 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4250936 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3824/tid=3835] ppid=3822 vsize=1427472 CPUtime=1648.47 cores=0-7
/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 110998 1251 0 0 164829 18 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=1427472 CPUtime=1639.56 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 159632 1251 0 0 163930 26 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4366500 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=1427472 CPUtime=1648.51 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 379981 1251 0 0 164783 68 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=1427472 CPUtime=1648.35 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 142719 1251 0 0 164817 18 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 13179.2
Current children cumulated vsize (KiB) 1427472

[startup+1650.4 s]
/proc/loadavg: 8.00 8.00 7.76 9/179 3882
/proc/meminfo: memFree=30806020/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=1427472 CPUtime=13192 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 1581403 1251 0 0 1318944 257 0 0 18 0 9 0 877804405 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 356868 303380 180 55 0 354754 0
[pid=3824/tid=3831] ppid=3822 vsize=1427472 CPUtime=1650.11 cores=0-7
/proc/3824/task/3831/stat : 3831 (plingeling) R 3822 3824 3313 0 -1 4202560 284116 1251 0 0 164963 48 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3824/tid=3832] ppid=3822 vsize=1427472 CPUtime=1650.01 cores=0-7
/proc/3824/task/3832/stat : 3832 (plingeling) R 3822 3824 3313 0 -1 4202560 120968 1251 0 0 164986 15 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3824/tid=3833] ppid=3822 vsize=1427472 CPUtime=1650.11 cores=0-7
/proc/3824/task/3833/stat : 3833 (plingeling) R 3822 3824 3313 0 -1 4202560 212175 1251 0 0 164976 35 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3824/tid=3834] ppid=3822 vsize=1427472 CPUtime=1650.11 cores=0-7
/proc/3824/task/3834/stat : 3834 (plingeling) R 3822 3824 3313 0 -1 4202560 152653 1251 0 0 164988 23 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4352402 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3824/tid=3835] ppid=3822 vsize=1427472 CPUtime=1650.07 cores=0-7
/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 110998 1251 0 0 164989 18 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=1427472 CPUtime=1641.15 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 159632 1251 0 0 164089 26 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=1427472 CPUtime=1650.11 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 379981 1251 0 0 164943 68 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=1427472 CPUtime=1649.95 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 142719 1251 0 0 164977 18 0 0 25 0 9 0 877804437 1461731328 303380 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 13192
Current children cumulated vsize (KiB) 1427472

[startup+1652.01 s]
/proc/loadavg: 8.00 8.00 7.76 9/179 3882
/proc/meminfo: memFree=30819032/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=1413856 CPUtime=13204.8 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 1582095 1251 0 0 1320227 257 0 0 18 0 9 0 877804405 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 353464 299976 180 55 0 351350 0
[pid=3824/tid=3831] ppid=3822 vsize=1413856 CPUtime=1651.71 cores=0-7
/proc/3824/task/3831/stat : 3831 (plingeling) R 3822 3824 3313 0 -1 4202560 284808 1251 0 0 165123 48 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3824/tid=3832] ppid=3822 vsize=1413856 CPUtime=1651.61 cores=0-7
/proc/3824/task/3832/stat : 3832 (plingeling) R 3822 3824 3313 0 -1 4202560 120968 1251 0 0 165146 15 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3824/tid=3833] ppid=3822 vsize=1413856 CPUtime=1651.71 cores=0-7
/proc/3824/task/3833/stat : 3833 (plingeling) R 3822 3824 3313 0 -1 4202560 212175 1251 0 0 165136 35 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3824/tid=3834] ppid=3822 vsize=1413856 CPUtime=1651.72 cores=0-7
/proc/3824/task/3834/stat : 3834 (plingeling) R 3822 3824 3313 0 -1 4202560 152653 1251 0 0 165149 23 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3824/tid=3835] ppid=3822 vsize=1413856 CPUtime=1651.68 cores=0-7
/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 110998 1251 0 0 165150 18 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4250555 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=1413856 CPUtime=1642.75 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 159632 1251 0 0 164249 26 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=1413856 CPUtime=1651.72 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 379981 1251 0 0 165104 68 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4365965 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=1413856 CPUtime=1651.56 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 142719 1251 0 0 165138 18 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 13204.8
Current children cumulated vsize (KiB) 1413856

[startup+1652.8 s]
/proc/loadavg: 8.00 8.00 7.76 9/179 3882
/proc/meminfo: memFree=30819032/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=1413856 CPUtime=13211.2 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 1582095 1251 0 0 1320862 257 0 0 18 0 9 0 877804405 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 353464 299976 180 55 0 351350 0
[pid=3824/tid=3831] ppid=3822 vsize=1413856 CPUtime=1652.51 cores=0-7
/proc/3824/task/3831/stat : 3831 (plingeling) R 3822 3824 3313 0 -1 4202560 284808 1251 0 0 165203 48 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3824/tid=3832] ppid=3822 vsize=1413856 CPUtime=1652.41 cores=0-7
/proc/3824/task/3832/stat : 3832 (plingeling) R 3822 3824 3313 0 -1 4202560 120968 1251 0 0 165226 15 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3824/tid=3833] ppid=3822 vsize=1413856 CPUtime=1652.51 cores=0-7
/proc/3824/task/3833/stat : 3833 (plingeling) R 3822 3824 3313 0 -1 4202560 212175 1251 0 0 165216 35 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3824/tid=3834] ppid=3822 vsize=1413856 CPUtime=1652.51 cores=0-7
/proc/3824/task/3834/stat : 3834 (plingeling) R 3822 3824 3313 0 -1 4202560 152653 1251 0 0 165228 23 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4354483 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3824/tid=3835] ppid=3822 vsize=1413856 CPUtime=1652.47 cores=0-7
/proc/3824/task/3835/stat : 3835 (plingeling) R 3822 3824 3313 0 -1 4202560 110998 1251 0 0 165229 18 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3824/tid=3836] ppid=3822 vsize=1413856 CPUtime=1643.54 cores=0-7
/proc/3824/task/3836/stat : 3836 (plingeling) R 3822 3824 3313 0 -1 4202560 159632 1251 0 0 164328 26 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3824/tid=3837] ppid=3822 vsize=1413856 CPUtime=1652.51 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 379981 1251 0 0 165183 68 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3824/tid=3838] ppid=3822 vsize=1413856 CPUtime=1652.35 cores=0-7
/proc/3824/task/3838/stat : 3838 (plingeling) R 3822 3824 3313 0 -1 4202560 142719 1251 0 0 165217 18 0 0 25 0 9 0 877804437 1447788544 299976 33554432000 4194304 4417452 140736769302560 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 13211.2
Current children cumulated vsize (KiB) 1413856

[startup+1653.2 s]
/proc/loadavg: 8.08 8.02 7.77 9/179 3882
/proc/meminfo: memFree=30819032/32951124 swapFree=67056684/67111528
[pid=3824] ppid=3822 vsize=1383100 CPUtime=13214 cores=0-7
/proc/3824/stat : 3824 (plingeling) S 3822 3824 3313 0 -1 4202496 1582096 1251 0 0 1321146 257 0 0 17 0 2 0 877804405 1416294400 299947 33554432000 4194304 4417452 140736769302560 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/3824/statm: 345775 299947 181 55 0 343661 0
[pid=3824/tid=3837] ppid=3822 vsize=1383100 CPUtime=1652.91 cores=0-7
/proc/3824/task/3837/stat : 3837 (plingeling) R 3822 3824 3313 0 -1 4202560 379981 1251 0 0 165223 68 0 0 25 0 2 0 877804437 1416294400 299947 33554432000 4194304 4417452 140736769302560 18446744073709551615 4364619 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 13214
Current children cumulated vsize (KiB) 1383100

Child status: 20
Real time (s): 1653.27
CPU time (s): 13214.1
CPU user time (s): 13211.5
CPU system time (s): 2.6296
CPU usage (%): 799.271
Max. virtual memory (cumulated for all children) (KiB): 1669864

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 13211.5
system time used= 2.6296
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1583350
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 658
involuntary context switches= 63694

runsolver used 2.57161 second user time and 6.38603 second system time

The end

Launcher Data 

Begin job on node109 at 2011-06-10 01:27:17
IDJOB=3372572
IDBENCH=82466
IDSOLVER=1851
FILE ID=node109/3372572-1307662036
RUNJOBID= node109-1307656747-3328
PBS_JOBID= 13549423
Free space on /tmp= 74200 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k45-bobsmhdlc2-tseitin.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372572-1307662036/watcher-3372572-1307662036 -o /tmp/evaluation-result-3372572-1307662036/solver-3372572-1307662036 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372572-1307662036.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ee159af2e208d290f7f3fefd15c344f2
RANDOM SEED=1595785500

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      32016664 kB
Buffers:        253996 kB
Cached:         431376 kB
SwapCached:       8608 kB
Active:         366048 kB
Inactive:       337228 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      32016664 kB
SwapTotal:    67111528 kB
SwapFree:     67056684 kB
Dirty:            2952 kB
Writeback:          20 kB
AnonPages:       15372 kB
Mapped:          12588 kB
Slab:           162524 kB
PageTables:       4336 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   186224 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74200 MiB
End job on node109 at 2011-06-10 01:54:50