Trace number 3309786

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40000.3 5004.27

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom26.cnf
MD5SUM98fee1752ddf8cd7cd77925ecf4bfe6e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables73074
Number of clauses245746
Sum of the clauses size628346
Maximum clause length2232
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2124096
Number of clauses of size 3120415
Number of clauses of size 4350
Number of clauses of size 524
Number of clauses of size over 5860

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309786-1304008794/watcher-3309786-1304008794 -o /tmp/evaluation-result-3309786-1304008794/solver-3309786-1304008794 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309786-1304008794.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.46 7.94 7.96 1/170 8705
/proc/meminfo: memFree=14167396/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=17800 CPUtime=0 cores=0-7
/proc/8705/stat : 8705 (plingeling) R 8703 8705 8679 0 -1 4202496 2220 1253 0 0 0 0 0 0 18 0 1 0 512479190 18227200 2150 33554432000 4194304 4417332 140736443226544 18446744073709551615 248089392221 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/8705/statm: 4450 2163 140 55 0 2336 0

[startup+0.070833 s]
/proc/loadavg: 7.46 7.94 7.96 1/170 8705
/proc/meminfo: memFree=14167396/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=38496 CPUtime=0.06 cores=0-7
/proc/8705/stat : 8705 (plingeling) R 8703 8705 8679 0 -1 4202496 7750 1253 0 0 5 1 0 0 18 0 1 0 512479190 39419904 7647 33554432000 4194304 4417332 140736443226544 18446744073709551615 4231557 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/8705/statm: 9624 7647 148 55 0 7510 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 38496

[startup+0.100829 s]
/proc/loadavg: 7.46 7.94 7.96 1/170 8705
/proc/meminfo: memFree=14167396/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=49280 CPUtime=0.09 cores=0-7
/proc/8705/stat : 8705 (plingeling) R 8703 8705 8679 0 -1 4202496 10416 1253 0 0 8 1 0 0 18 0 1 0 512479190 50462720 10313 33554432000 4194304 4417332 140736443226544 18446744073709551615 248089392109 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/8705/statm: 12320 10343 148 55 0 10206 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 49280

[startup+0.300793 s]
/proc/loadavg: 7.46 7.94 7.96 1/170 8705
/proc/meminfo: memFree=14167396/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=89760 CPUtime=0.28 cores=0-7
/proc/8705/stat : 8705 (plingeling) R 8703 8705 8679 0 -1 4202496 20566 1253 0 0 26 2 0 0 19 0 1 0 512479190 91914240 20463 33554432000 4194304 4417332 140736443226544 18446744073709551615 4259665 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/8705/statm: 22440 20463 148 55 0 20326 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 89760

[startup+1.23492 s]
/proc/loadavg: 7.46 7.94 7.96 1/170 8705
/proc/meminfo: memFree=14167396/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=349424 CPUtime=5.03 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 57361 1253 0 0 496 7 0 0 18 0 9 0 512479190 357810176 36365 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 87356 36365 174 55 0 85242 0
Current children cumulated CPU time (s) 5.03
Current children cumulated vsize (KiB) 349424

[startup+1.50059 s]
/proc/loadavg: 7.46 7.94 7.96 9/179 8719
/proc/meminfo: memFree=14014936/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=355496 CPUtime=7.2 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 61460 1253 0 0 712 8 0 0 18 0 9 0 512479190 364027904 37968 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 88874 37968 174 55 0 86760 0
[pid=8705/tid=8712] ppid=8703 vsize=355496 CPUtime=0.88 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 2206 1253 0 0 88 0 0 0 23 0 9 0 512479252 364027904 37968 33554432000 4194304 4417332 140736443226544 18446744073709551615 4287111 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=355496 CPUtime=0.87 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 2905 1253 0 0 87 0 0 0 23 0 9 0 512479252 364027904 37968 33554432000 4194304 4417332 140736443226544 18446744073709551615 4284626 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=355496 CPUtime=0.65 cores=0-7
/proc/8705/task/8714/stat : 8714 (plingeling) R 8703 8705 8679 0 -1 4202560 2907 1253 0 0 65 0 0 0 22 0 9 0 512479252 364027904 37968 33554432000 4194304 4417332 140736443226544 18446744073709551615 4288920 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=355496 CPUtime=0.86 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4202560 1112 1253 0 0 86 0 0 0 21 0 9 0 512479252 364027904 37968 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364482 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8705/tid=8716] ppid=8703 vsize=355496 CPUtime=0.88 cores=0-7
/proc/8705/task/8716/stat : 8716 (plingeling) R 8703 8705 8679 0 -1 4202560 4540 1253 0 0 88 0 0 0 21 0 9 0 512479252 364027904 37968 33554432000 4194304 4417332 140736443226544 18446744073709551615 4289675 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8705/tid=8717] ppid=8703 vsize=355496 CPUtime=0.87 cores=0-7
/proc/8705/task/8717/stat : 8717 (plingeling) R 8703 8705 8679 0 -1 4202560 3468 1253 0 0 87 0 0 0 19 0 9 0 512479252 364027904 37968 33554432000 4194304 4417332 140736443226544 18446744073709551615 4291006 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8705/tid=8718] ppid=8703 vsize=355496 CPUtime=0.87 cores=0-7
/proc/8705/task/8718/stat : 8718 (plingeling) R 8703 8705 8679 0 -1 4202560 5788 1253 0 0 87 0 0 0 18 0 9 0 512479252 364027904 37968 33554432000 4194304 4417332 140736443226544 18446744073709551615 4291231 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8705/tid=8719] ppid=8703 vsize=355496 CPUtime=0.63 cores=0-7
/proc/8705/task/8719/stat : 8719 (plingeling) R 8703 8705 8679 0 -1 4202560 2460 1253 0 0 63 0 0 0 20 0 9 0 512479252 364027904 37968 33554432000 4194304 4417332 140736443226544 18446744073709551615 4284341 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 7.2
Current children cumulated vsize (KiB) 355496

[startup+3.1013 s]
/proc/loadavg: 7.50 7.94 7.96 9/179 8719
/proc/meminfo: memFree=14009108/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=372056 CPUtime=19.96 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 76771 1253 0 0 1986 10 0 0 18 0 9 0 512479190 380985344 41500 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 93014 41500 177 55 0 90900 0
[pid=8705/tid=8712] ppid=8703 vsize=372056 CPUtime=2.47 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 3559 1253 0 0 247 0 0 0 25 0 9 0 512479252 380985344 41500 33554432000 4194304 4417332 140736443226544 18446744073709551615 4275960 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=372056 CPUtime=2.47 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 3436 1253 0 0 247 0 0 0 25 0 9 0 512479252 380985344 41500 33554432000 4194304 4417332 140736443226544 18446744073709551615 4346594 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=372056 CPUtime=2.24 cores=0-7
/proc/8705/task/8714/stat : 8714 (plingeling) R 8703 8705 8679 0 -1 4202560 4869 1253 0 0 224 0 0 0 25 0 9 0 512479252 380985344 41500 33554432000 4194304 4417332 140736443226544 18446744073709551615 4346410 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=372056 CPUtime=2.46 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4202560 1112 1253 0 0 246 0 0 0 25 0 9 0 512479252 380985344 41500 33554432000 4194304 4417332 140736443226544 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8705/tid=8716] ppid=8703 vsize=372056 CPUtime=2.47 cores=0-7
/proc/8705/task/8716/stat : 8716 (plingeling) R 8703 8705 8679 0 -1 4202560 8510 1253 0 0 247 0 0 0 25 0 9 0 512479252 380985344 41500 33554432000 4194304 4417332 140736443226544 18446744073709551615 4261330 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8705/tid=8717] ppid=8703 vsize=372056 CPUtime=2.46 cores=0-7
/proc/8705/task/8717/stat : 8717 (plingeling) R 8703 8705 8679 0 -1 4202560 4837 1253 0 0 246 0 0 0 22 0 9 0 512479252 380985344 41500 33554432000 4194304 4417332 140736443226544 18446744073709551615 4268878 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8705/tid=8718] ppid=8703 vsize=372056 CPUtime=2.47 cores=0-7
/proc/8705/task/8718/stat : 8718 (plingeling) R 8703 8705 8679 0 -1 4202560 9218 1253 0 0 246 1 0 0 22 0 9 0 512479252 380985344 41500 33554432000 4194304 4417332 140736443226544 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8705/tid=8719] ppid=8703 vsize=372056 CPUtime=2.23 cores=0-7
/proc/8705/task/8719/stat : 8719 (plingeling) R 8703 8705 8679 0 -1 4202560 5156 1253 0 0 223 0 0 0 25 0 9 0 512479252 380985344 41500 33554432000 4194304 4417332 140736443226544 18446744073709551615 4275781 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 19.96
Current children cumulated vsize (KiB) 372056

[startup+6.30073 s]
/proc/loadavg: 7.50 7.94 7.96 9/179 8719
/proc/meminfo: memFree=13990020/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=384580 CPUtime=45.54 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 86198 1253 0 0 4543 11 0 0 18 0 9 0 512479190 393809920 44204 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 96145 44204 181 55 0 94031 0
[pid=8705/tid=8712] ppid=8703 vsize=384580 CPUtime=5.67 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 5552 1253 0 0 567 0 0 0 25 0 9 0 512479252 393809920 44204 33554432000 4194304 4417332 140736443226544 18446744073709551615 4250022 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=384580 CPUtime=5.67 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 4465 1253 0 0 567 0 0 0 25 0 9 0 512479252 393809920 44204 33554432000 4194304 4417332 140736443226544 18446744073709551615 4236012 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=384580 CPUtime=5.44 cores=0-7
/proc/8705/task/8714/stat : 8714 (plingeling) R 8703 8705 8679 0 -1 4202560 5893 1253 0 0 544 0 0 0 25 0 9 0 512479252 393809920 44204 33554432000 4194304 4417332 140736443226544 18446744073709551615 4264843 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=384580 CPUtime=5.66 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4202560 1112 1253 0 0 566 0 0 0 25 0 9 0 512479252 393809920 44204 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8705/tid=8716] ppid=8703 vsize=384580 CPUtime=5.67 cores=0-7
/proc/8705/task/8716/stat : 8716 (plingeling) R 8703 8705 8679 0 -1 4202560 8516 1253 0 0 567 0 0 0 25 0 9 0 512479252 393809920 44204 33554432000 4194304 4417332 140736443226544 18446744073709551615 4258211 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8705/tid=8717] ppid=8703 vsize=384580 CPUtime=5.65 cores=0-7
/proc/8705/task/8717/stat : 8717 (plingeling) R 8703 8705 8679 0 -1 4202560 5867 1253 0 0 565 0 0 0 25 0 9 0 512479252 393809920 44204 33554432000 4194304 4417332 140736443226544 18446744073709551615 4235968 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8705/tid=8718] ppid=8703 vsize=384580 CPUtime=5.67 cores=0-7
/proc/8705/task/8718/stat : 8718 (plingeling) R 8703 8705 8679 0 -1 4202560 11535 1253 0 0 566 1 0 0 25 0 9 0 512479252 393809920 44204 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8705/tid=8719] ppid=8703 vsize=384580 CPUtime=5.42 cores=0-7
/proc/8705/task/8719/stat : 8719 (plingeling) R 8703 8705 8679 0 -1 4202560 7184 1253 0 0 542 0 0 0 25 0 9 0 512479252 393809920 44204 33554432000 4194304 4417332 140736443226544 18446744073709551615 4248242 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 45.54
Current children cumulated vsize (KiB) 384580

[startup+12.7006 s]
/proc/loadavg: 7.58 7.94 7.96 9/179 8719
/proc/meminfo: memFree=13984960/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=390664 CPUtime=96.7 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 88089 1253 0 0 9659 11 0 0 18 0 9 0 512479190 400039936 45725 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 97666 45725 181 55 0 95552 0
[pid=8705/tid=8712] ppid=8703 vsize=390664 CPUtime=12.07 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 5572 1253 0 0 1207 0 0 0 25 0 9 0 512479252 400039936 45725 33554432000 4194304 4417332 140736443226544 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=390664 CPUtime=12.07 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 4486 1253 0 0 1207 0 0 0 25 0 9 0 512479252 400039936 45725 33554432000 4194304 4417332 140736443226544 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=390664 CPUtime=11.85 cores=0-7
/proc/8705/task/8714/stat : 8714 (plingeling) R 8703 8705 8679 0 -1 4202560 6546 1253 0 0 1184 1 0 0 25 0 9 0 512479252 400039936 45725 33554432000 4194304 4417332 140736443226544 18446744073709551615 4321656 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=390664 CPUtime=12.05 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4202560 1591 1253 0 0 1205 0 0 0 25 0 9 0 512479252 400039936 45725 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8705/tid=8716] ppid=8703 vsize=390664 CPUtime=12.08 cores=0-7
/proc/8705/task/8716/stat : 8716 (plingeling) R 8703 8705 8679 0 -1 4202560 8537 1253 0 0 1207 1 0 0 25 0 9 0 512479252 400039936 45725 33554432000 4194304 4417332 140736443226544 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8705/tid=8717] ppid=8703 vsize=390664 CPUtime=12.01 cores=0-7
/proc/8705/task/8717/stat : 8717 (plingeling) R 8703 8705 8679 0 -1 4202560 5887 1253 0 0 1201 0 0 0 25 0 9 0 512479252 400039936 45725 33554432000 4194304 4417332 140736443226544 18446744073709551615 4232612 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8705/tid=8718] ppid=8703 vsize=390664 CPUtime=12.07 cores=0-7
/proc/8705/task/8718/stat : 8718 (plingeling) R 8703 8705 8679 0 -1 4202560 12191 1253 0 0 1206 1 0 0 25 0 9 0 512479252 400039936 45725 33554432000 4194304 4417332 140736443226544 18446744073709551615 248089803295 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8705/tid=8719] ppid=8703 vsize=390664 CPUtime=11.82 cores=0-7
/proc/8705/task/8719/stat : 8719 (plingeling) R 8703 8705 8679 0 -1 4202560 7205 1253 0 0 1182 0 0 0 25 0 9 0 512479252 400039936 45725 33554432000 4194304 4417332 140736443226544 18446744073709551615 248089803295 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 96.7
Current children cumulated vsize (KiB) 390664

[startup+25.5003 s]
/proc/loadavg: 7.64 7.94 7.96 9/179 8720
/proc/meminfo: memFree=13957404/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=426472 CPUtime=199.04 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 100957 1253 0 0 19890 14 0 0 18 0 9 0 512479190 436707328 54689 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 106618 54689 181 55 0 104504 0
[pid=8705/tid=8712] ppid=8703 vsize=426472 CPUtime=24.87 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 6649 1253 0 0 2487 0 0 0 25 0 9 0 512479252 436707328 54689 33554432000 4194304 4417332 140736443226544 18446744073709551615 4352306 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=426472 CPUtime=24.87 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 5566 1253 0 0 2487 0 0 0 25 0 9 0 512479252 436707328 54689 33554432000 4194304 4417332 140736443226544 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=426472 CPUtime=24.64 cores=0-7
/proc/8705/task/8714/stat : 8714 (plingeling) R 8703 8705 8679 0 -1 4202560 10251 1253 0 0 2463 1 0 0 25 0 9 0 512479252 436707328 54689 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=426472 CPUtime=24.86 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4202560 5867 1253 0 0 2485 1 0 0 25 0 9 0 512479252 436707328 54689 33554432000 4194304 4417332 140736443226544 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8705/tid=8716] ppid=8703 vsize=426472 CPUtime=24.88 cores=0-7
/proc/8705/task/8716/stat : 8716 (plingeling) R 8703 8705 8679 0 -1 4202560 8737 1253 0 0 2487 1 0 0 25 0 9 0 512479252 436707328 54689 33554432000 4194304 4417332 140736443226544 18446744073709551615 4354054 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8705/tid=8717] ppid=8703 vsize=426472 CPUtime=24.75 cores=0-7
/proc/8705/task/8717/stat : 8717 (plingeling) R 8703 8705 8679 0 -1 4202560 6819 1253 0 0 2475 0 0 0 25 0 9 0 512479252 436707328 54689 33554432000 4194304 4417332 140736443226544 18446744073709551615 4356706 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8705/tid=8718] ppid=8703 vsize=426472 CPUtime=24.87 cores=0-7
/proc/8705/task/8718/stat : 8718 (plingeling) R 8703 8705 8679 0 -1 4202560 13505 1253 0 0 2485 2 0 0 25 0 9 0 512479252 436707328 54689 33554432000 4194304 4417332 140736443226544 18446744073709551615 4365918 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8705/tid=8719] ppid=8703 vsize=426472 CPUtime=24.62 cores=0-7
/proc/8705/task/8719/stat : 8719 (plingeling) R 8703 8705 8679 0 -1 4202560 7489 1253 0 0 2462 0 0 0 25 0 9 0 512479252 436707328 54689 33554432000 4194304 4417332 140736443226544 18446744073709551615 4278271 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 199.04
Current children cumulated vsize (KiB) 426472

[startup+51.1068 s]
/proc/loadavg: 7.76 7.94 7.96 9/179 8720
/proc/meminfo: memFree=13910220/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=467352 CPUtime=403.76 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 113249 1253 0 0 40360 16 0 0 18 0 9 0 512479190 478568448 65047 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 116838 65047 181 55 0 114724 0
[pid=8705/tid=8712] ppid=8703 vsize=467352 CPUtime=50.48 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 7306 1253 0 0 5047 1 0 0 25 0 9 0 512479252 478568448 65047 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=467352 CPUtime=50.47 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 7498 1253 0 0 5047 0 0 0 25 0 9 0 512479252 478568448 65047 33554432000 4194304 4417332 140736443226544 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=467352 CPUtime=50.25 cores=0-7

################
# More data... #
################


[startup+4722.3 s]
/proc/loadavg: 8.00 8.02 8.00 9/179 8857
/proc/meminfo: memFree=11913588/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=2461680 CPUtime=37747.2 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 4311799 1253 0 0 3774070 651 0 0 18 0 9 0 512479190 2520760320 563356 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 615420 563356 181 55 0 613306 0
[pid=8705/tid=8712] ppid=8703 vsize=2461680 CPUtime=4721.74 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 391251 1253 0 0 472115 59 0 0 25 0 9 0 512479252 2520760320 563356 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=2461680 CPUtime=4721.76 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 456577 1253 0 0 472101 75 0 0 25 0 9 0 512479252 2520760320 563356 33554432000 4194304 4417332 140736443226544 18446744073709551615 4353502 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=2461680 CPUtime=4721.41 cores=0-7
/proc/8705/task/8714/stat : 8714 (plingeling) R 8703 8705 8679 0 -1 4202560 1383422 1253 0 0 471950 191 0 0 25 0 9 0 512479252 2520760320 563356 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=2461680 CPUtime=4706.54 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4202560 637051 1253 0 0 470554 100 0 0 25 0 9 0 512479252 2520760320 563356 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8705/tid=8716] ppid=8703 vsize=2461680 CPUtime=4721.6 cores=0-7
/proc/8705/task/8716/stat : 8716 (plingeling) R 8703 8705 8679 0 -1 4202560 341931 1253 0 0 472103 57 0 0 25 0 9 0 512479252 2520760320 563356 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8705/tid=8717] ppid=8703 vsize=2461680 CPUtime=4711.3 cores=0-7
/proc/8705/task/8717/stat : 8717 (plingeling) R 8703 8705 8679 0 -1 4202560 378964 1253 0 0 471069 61 0 0 25 0 9 0 512479252 2520760320 563356 33554432000 4194304 4417332 140736443226544 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8705/tid=8718] ppid=8703 vsize=2461680 CPUtime=4721.29 cores=0-7
/proc/8705/task/8718/stat : 8718 (plingeling) R 8703 8705 8679 0 -1 4202560 299546 1253 0 0 472082 47 0 0 25 0 9 0 512479252 2520760320 563356 33554432000 4194304 4417332 140736443226544 18446744073709551615 4365021 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8705/tid=8719] ppid=8703 vsize=2461680 CPUtime=4720.87 cores=0-7
/proc/8705/task/8719/stat : 8719 (plingeling) R 8703 8705 8679 0 -1 4202560 386983 1253 0 0 472036 51 0 0 25 0 9 0 512479252 2520760320 563356 33554432000 4194304 4417332 140736443226544 18446744073709551615 4353472 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37747.2
Current children cumulated vsize (KiB) 2461680

[startup+4782.3 s]
/proc/loadavg: 8.00 8.02 8.00 9/179 8858
/proc/meminfo: memFree=11504252/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=2870112 CPUtime=38226.9 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 4503359 1253 0 0 3821996 691 0 0 18 0 9 0 512479190 2938994688 665464 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 717528 665464 181 55 0 715414 0
[pid=8705/tid=8712] ppid=8703 vsize=2870112 CPUtime=4781.75 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 415828 1253 0 0 478112 63 0 0 25 0 9 0 512479252 2938994688 665464 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=2870112 CPUtime=4781.76 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 469617 1253 0 0 478097 79 0 0 25 0 9 0 512479252 2938994688 665464 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=2870112 CPUtime=4781.4 cores=0-7
/proc/8705/task/8714/stat : 8714 (plingeling) R 8703 8705 8679 0 -1 4202560 1404999 1253 0 0 477946 194 0 0 25 0 9 0 512479252 2938994688 665464 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=2870112 CPUtime=4766.21 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4202560 639466 1253 0 0 476520 101 0 0 25 0 9 0 512479252 2938994688 665464 33554432000 4194304 4417332 140736443226544 18446744073709551615 4237157 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8705/tid=8716] ppid=8703 vsize=2870112 CPUtime=4781.6 cores=0-7
/proc/8705/task/8716/stat : 8716 (plingeling) R 8703 8705 8679 0 -1 4202560 393201 1253 0 0 478094 66 0 0 25 0 9 0 512479252 2938994688 665464 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8705/tid=8717] ppid=8703 vsize=2870112 CPUtime=4771.31 cores=0-7
/proc/8705/task/8717/stat : 8717 (plingeling) R 8703 8705 8679 0 -1 4202560 387156 1253 0 0 477067 64 0 0 25 0 9 0 512479252 2938994688 665464 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8705/tid=8718] ppid=8703 vsize=2870112 CPUtime=4781.28 cores=0-7
/proc/8705/task/8718/stat : 8718 (plingeling) R 8703 8705 8679 0 -1 4202560 342939 1253 0 0 478071 57 0 0 25 0 9 0 512479252 2938994688 665464 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8705/tid=8719] ppid=8703 vsize=2870112 CPUtime=4780.87 cores=0-7
/proc/8705/task/8719/stat : 8719 (plingeling) R 8703 8705 8679 0 -1 4202560 414079 1253 0 0 478028 59 0 0 25 0 9 0 512479252 2938994688 665464 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38226.9
Current children cumulated vsize (KiB) 2870112

[startup+4842.3 s]
/proc/loadavg: 8.00 8.01 8.00 9/179 8860
/proc/meminfo: memFree=11433556/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=2947332 CPUtime=38706.6 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 4555449 1253 0 0 3869951 704 0 0 18 0 9 0 512479190 3018067968 684769 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 736833 684769 181 55 0 734719 0
[pid=8705/tid=8712] ppid=8703 vsize=2947332 CPUtime=4841.75 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 423652 1253 0 0 484110 65 0 0 25 0 9 0 512479252 3018067968 684769 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=2947332 CPUtime=4841.76 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 479313 1253 0 0 484094 82 0 0 25 0 9 0 512479252 3018067968 684769 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=2947332 CPUtime=4841.4 cores=0-7
/proc/8705/task/8714/stat : 8714 (plingeling) R 8703 8705 8679 0 -1 4202560 1411359 1253 0 0 483945 195 0 0 25 0 9 0 512479252 3018067968 684769 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=2947332 CPUtime=4825.89 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4202560 641882 1253 0 0 482488 101 0 0 25 0 9 0 512479252 3018067968 684769 33554432000 4194304 4417332 140736443226544 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8705/tid=8716] ppid=8703 vsize=2947332 CPUtime=4841.6 cores=0-7
/proc/8705/task/8716/stat : 8716 (plingeling) R 8703 8705 8679 0 -1 4202560 408273 1253 0 0 484091 69 0 0 25 0 9 0 512479252 3018067968 684769 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8705/tid=8717] ppid=8703 vsize=2947332 CPUtime=4831.31 cores=0-7
/proc/8705/task/8717/stat : 8717 (plingeling) R 8703 8705 8679 0 -1 4202560 397862 1253 0 0 483064 67 0 0 25 0 9 0 512479252 3018067968 684769 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8705/tid=8718] ppid=8703 vsize=2947332 CPUtime=4841.28 cores=0-7
/proc/8705/task/8718/stat : 8718 (plingeling) R 8703 8705 8679 0 -1 4202560 342939 1253 0 0 484071 57 0 0 25 0 9 0 512479252 3018067968 684769 33554432000 4194304 4417332 140736443226544 18446744073709551615 4263230 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8705/tid=8719] ppid=8703 vsize=2947332 CPUtime=4840.87 cores=0-7
/proc/8705/task/8719/stat : 8719 (plingeling) R 8703 8705 8679 0 -1 4202560 414095 1253 0 0 484028 59 0 0 25 0 9 0 512479252 3018067968 684769 33554432000 4194304 4417332 140736443226544 18446744073709551615 4356944 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38706.6
Current children cumulated vsize (KiB) 2947332

[startup+4902.3 s]
/proc/loadavg: 8.00 8.01 8.00 9/179 8871
/proc/meminfo: memFree=11174112/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=3198560 CPUtime=39186.2 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 4636643 1253 0 0 3917896 723 0 0 18 0 9 0 512479190 3275325440 747576 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 799640 747576 181 55 0 797526 0
[pid=8705/tid=8712] ppid=8703 vsize=3198560 CPUtime=4901.75 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 436213 1253 0 0 490107 68 0 0 25 0 9 0 512479252 3275325440 747576 33554432000 4194304 4417332 140736443226544 18446744073709551615 4353463 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=3198560 CPUtime=4901.76 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 479330 1253 0 0 490094 82 0 0 25 0 9 0 512479252 3275325440 747576 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=3198560 CPUtime=4901.39 cores=0-7
/proc/8705/task/8714/stat : 8714 (plingeling) R 8703 8705 8679 0 -1 4202560 1411359 1253 0 0 489944 195 0 0 25 0 9 0 512479252 3275325440 747576 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=3198560 CPUtime=4885.56 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4202560 657824 1253 0 0 488452 104 0 0 25 0 9 0 512479252 3275325440 747576 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8705/tid=8716] ppid=8703 vsize=3198560 CPUtime=4901.6 cores=0-7
/proc/8705/task/8716/stat : 8716 (plingeling) R 8703 8705 8679 0 -1 4202560 425154 1253 0 0 490086 74 0 0 25 0 9 0 512479252 3275325440 747576 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8705/tid=8717] ppid=8703 vsize=3198560 CPUtime=4891.31 cores=0-7
/proc/8705/task/8717/stat : 8717 (plingeling) R 8703 8705 8679 0 -1 4202560 397862 1253 0 0 489064 67 0 0 25 0 9 0 512479252 3275325440 747576 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8705/tid=8718] ppid=8703 vsize=3198560 CPUtime=4901.28 cores=0-7
/proc/8705/task/8718/stat : 8718 (plingeling) R 8703 8705 8679 0 -1 4202560 365467 1253 0 0 490063 65 0 0 25 0 9 0 512479252 3275325440 747576 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8705/tid=8719] ppid=8703 vsize=3198560 CPUtime=4900.87 cores=0-7
/proc/8705/task/8719/stat : 8719 (plingeling) R 8703 8705 8679 0 -1 4202560 427360 1253 0 0 490027 60 0 0 25 0 9 0 512479252 3275325440 747576 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39186.2
Current children cumulated vsize (KiB) 3198560

[startup+4962.3 s]
/proc/loadavg: 8.00 8.00 8.00 9/179 8872
/proc/meminfo: memFree=10773440/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=3599432 CPUtime=39665.9 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 4743842 1253 0 0 3965837 750 0 0 18 0 9 0 512479190 3685818368 847794 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 899858 847794 181 55 0 897744 0
[pid=8705/tid=8712] ppid=8703 vsize=3599432 CPUtime=4961.75 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 448389 1253 0 0 496106 69 0 0 25 0 9 0 512479252 3685818368 847794 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=3599432 CPUtime=4961.76 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 490402 1253 0 0 496091 85 0 0 25 0 9 0 512479252 3685818368 847794 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=3599432 CPUtime=4961.4 cores=0-7
/proc/8705/task/8714/stat : 8714 (plingeling) R 8703 8705 8679 0 -1 4202560 1419839 1253 0 0 495942 198 0 0 25 0 9 0 512479252 3685818368 847794 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=3599432 CPUtime=4945.23 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4202560 669394 1253 0 0 494417 106 0 0 25 0 9 0 512479252 3685818368 847794 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8705/tid=8716] ppid=8703 vsize=3599432 CPUtime=4961.6 cores=0-7
/proc/8705/task/8716/stat : 8716 (plingeling) R 8703 8705 8679 0 -1 4202560 433346 1253 0 0 496084 76 0 0 25 0 9 0 512479252 3685818368 847794 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8705/tid=8717] ppid=8703 vsize=3599432 CPUtime=4951.31 cores=0-7
/proc/8705/task/8717/stat : 8717 (plingeling) R 8703 8705 8679 0 -1 4202560 420931 1253 0 0 495059 72 0 0 25 0 9 0 512479252 3685818368 847794 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8705/tid=8718] ppid=8703 vsize=3599432 CPUtime=4961.28 cores=0-7
/proc/8705/task/8718/stat : 8718 (plingeling) R 8703 8705 8679 0 -1 4202560 365467 1253 0 0 496063 65 0 0 25 0 9 0 512479252 3685818368 847794 33554432000 4194304 4417332 140736443226544 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8705/tid=8719] ppid=8703 vsize=3599432 CPUtime=4960.87 cores=0-7
/proc/8705/task/8719/stat : 8719 (plingeling) R 8703 8705 8679 0 -1 4202560 460000 1253 0 0 496017 70 0 0 25 0 9 0 512479252 3685818368 847794 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39665.9
Current children cumulated vsize (KiB) 3599432



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5004.1 s]
/proc/loadavg: 8.00 8.00 8.00 9/179 8873
/proc/meminfo: memFree=10697768/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=3674792 CPUtime=40000.1 cores=0-7
/proc/8705/stat : 8705 (plingeling) S 8703 8705 8679 0 -1 4202496 4843557 1253 0 0 3999230 778 0 0 18 0 9 0 512479190 3762987008 866634 33554432000 4194304 4417332 140736443226544 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 918698 866634 181 55 0 916584 0
[pid=8705/tid=8712] ppid=8703 vsize=3674792 CPUtime=5003.55 cores=0-7
/proc/8705/task/8712/stat : 8712 (plingeling) R 8703 8705 8679 0 -1 4202560 455333 1253 0 0 500285 70 0 0 25 0 9 0 512479252 3762987008 866634 33554432000 4194304 4417332 140736443226544 18446744073709551615 4353618 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8705/tid=8713] ppid=8703 vsize=3674792 CPUtime=5003.57 cores=0-7
/proc/8705/task/8713/stat : 8713 (plingeling) R 8703 8705 8679 0 -1 4202560 501154 1253 0 0 500268 89 0 0 25 0 9 0 512479252 3762987008 866634 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8705/tid=8714] ppid=8703 vsize=3674792 CPUtime=5003.19 cores=0-7
/proc/8705/task/8714/stat : 8714 (plingeling) R 8703 8705 8679 0 -1 4202560 1436242 1253 0 0 500120 199 0 0 25 0 9 0 512479252 3762987008 866634 33554432000 4194304 4417332 140736443226544 18446744073709551615 4352306 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=3674792 CPUtime=4986.8 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4202560 674666 1253 0 0 498573 107 0 0 25 0 9 0 512479252 3762987008 866634 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8705/tid=8716] ppid=8703 vsize=3674792 CPUtime=5003.41 cores=0-7
/proc/8705/task/8716/stat : 8716 (plingeling) R 8703 8705 8679 0 -1 4202560 475557 1253 0 0 500251 90 0 0 25 0 9 0 512479252 3762987008 866634 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8705/tid=8717] ppid=8703 vsize=3674792 CPUtime=4993.12 cores=0-7
/proc/8705/task/8717/stat : 8717 (plingeling) R 8703 8705 8679 0 -1 4202560 420931 1253 0 0 499240 72 0 0 25 0 9 0 512479252 3762987008 866634 33554432000 4194304 4417332 140736443226544 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=8705/tid=8718] ppid=8703 vsize=3674792 CPUtime=5003.08 cores=0-7
/proc/8705/task/8718/stat : 8718 (plingeling) R 8703 8705 8679 0 -1 4202560 365467 1253 0 0 500243 65 0 0 25 0 9 0 512479252 3762987008 866634 33554432000 4194304 4417332 140736443226544 18446744073709551615 4263155 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8705/tid=8719] ppid=8703 vsize=3674792 CPUtime=5002.67 cores=0-7
/proc/8705/task/8719/stat : 8719 (plingeling) R 8703 8705 8679 0 -1 4202560 478133 1253 0 0 500190 77 0 0 25 0 9 0 512479252 3762987008 866634 33554432000 4194304 4417332 140736443226544 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.1
Current children cumulated vsize (KiB) 3674792

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5004.21 s]
/proc/loadavg: 8.00 8.00 8.00 9/179 8873
/proc/meminfo: memFree=10697768/32950928 swapFree=67111528/67111528
[pid=8705] ppid=8703 vsize=0 CPUtime=40000.2 cores=0-7
/proc/8705/stat : 8705 (plingeling) Z 8703 8705 8679 0 -1 4203548 4843557 1253 0 0 3999235 788 0 0 18 0 2 0 512479190 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/8705/statm: 0 0 0 0 0 0 0
[pid=8705/tid=8715] ppid=8703 vsize=0 CPUtime=4986.91 cores=0-7
/proc/8705/task/8715/stat : 8715 (plingeling) R 8703 8705 8679 0 -1 4203588 674666 1253 0 0 498574 117 0 0 25 0 2 0 512479252 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5004.27
CPU time (s): 40000.3
CPU user time (s): 39992.4
CPU system time (s): 7.93779
CPU usage (%): 799.324
Max. virtual memory (cumulated for all children) (KiB): 3821612

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39992.4
system time used= 7.93779
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4844810
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 793
involuntary context switches= 193557

runsolver used 8.15476 second user time and 19.0631 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-28 18:39:54
IDJOB=3309786
IDBENCH=83107
IDSOLVER=1695
FILE ID=node123/3309786-1304008794
RUNJOBID= node123-1304008794-8693
PBS_JOBID= 13168843
Free space on /tmp= 72812 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom26.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309786-1304008794/watcher-3309786-1304008794 -o /tmp/evaluation-result-3309786-1304008794/solver-3309786-1304008794 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309786-1304008794.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 98fee1752ddf8cd7cd77925ecf4bfe6e
RANDOM SEED=953704440

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14167552 kB
Buffers:       2189464 kB
Cached:       15979472 kB
SwapCached:          0 kB
Active:        8878124 kB
Inactive:      9354620 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14167552 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            4704 kB
Writeback:           0 kB
AnonPages:       63388 kB
Mapped:          14492 kB
Slab:           485620 kB
PageTables:       4940 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   184388 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72812 MiB
End job on node123 at 2011-04-28 20:03:20