Trace number 3394394

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)SAT 16135.5 2023.8

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n180-s34713902-sat.cnf
MD5SUM19292459de25c4f5e9e6f187c00d549d
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.223965
Satisfiable
(Un)Satisfiability was proved
Number of variables180
Number of clauses432
Sum of the clauses size1080
Maximum clause length5
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2360
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 572
Number of clauses of size over 50

Solver Data 

16135.41/2023.79	s SATISFIABLE
16135.41/2023.79	v 1 -2 -3 4 5 -6 -7
16135.41/2023.79	v 8 9 -10 -11 -12 -13 14 -15
16135.41/2023.79	v 16 -17 18 -19 20 -21 22 -23
16135.41/2023.79	v -24 -25 -26 27 -28 29 30 31
16135.41/2023.79	v -32 33 -34 35 -36 -37 38 39
16135.41/2023.79	v -40 -41 42 -43 44 -45 46 47
16135.41/2023.79	v 48 49 50 51 -52 53 54 55
16135.41/2023.79	v -56 57 58 59 60 -61 62 -63
16135.41/2023.79	v -64 -65 66 67 -68 -69 -70 71
16135.41/2023.79	v -72 -73 74 -75 76 77 78 -79
16135.41/2023.79	v 80 81 -82 83 84 -85 86 -87
16135.41/2023.79	v 88 -89 90 -91 -92 -93 94 -95
16135.41/2023.79	v 96 -97 98 -99 100 101 102 103
16135.41/2023.79	v 104 -105 106 -107 108 -109 110 -111
16135.41/2023.79	v -112 113 -114 115 -116 -117 118 -119
16135.41/2023.79	v 120 121 122 123 124 125 126 -127
16135.41/2023.79	v -128 -129 -130 -131 132 -133 134 -135
16135.41/2023.79	v 136 -137 -138 -139 -140 141 -142 -143
16135.41/2023.79	v 144 145 146 -147 -148 149 -150 151
16135.41/2023.79	v -152 -153 -154 -155 -156 157 -158 -159
16135.41/2023.79	v 160 161 -162 163 -164 165 166 -167
16135.41/2023.79	v 168 169 -170 171 -172 173 -174 -175
16135.41/2023.79	v 176 177 -178 -179 180
16135.41/2023.79	v 0

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394394-1306095070/watcher-3394394-1306095070 -o /tmp/evaluation-result-3394394-1306095070/solver-3394394-1306095070 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394394-1306095070.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.96 5.20 3.33 1/457 29487
/proc/meminfo: memFree=10113836/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=8728 CPUtime=0 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 215 0 0 0 0 0 0 0 23 0 1 0 721106768 8937472 146 33554432000 4194304 4417452 140734809399040 18446744073709551615 248089698048 0 0 4096 0 18446744071562362840 0 0 17 6 0 0 0
/proc/29487/statm: 2182 146 122 55 0 68 0

[startup+0.0587381 s]
/proc/loadavg: 7.96 5.20 3.33 1/457 29487
/proc/meminfo: memFree=10113836/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=223536 CPUtime=0.12 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 887 1250 0 2 12 0 0 0 25 0 9 0 721106768 228900864 773 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 55884 773 180 55 0 53770 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 223536

[startup+0.100729 s]
/proc/loadavg: 7.96 5.20 3.33 1/457 29487
/proc/meminfo: memFree=10113836/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=225964 CPUtime=0.41 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 1501 1250 0 2 41 0 0 0 25 0 9 0 721106768 231387136 1387 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 56491 1387 180 55 0 54377 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 225964

[startup+0.300695 s]
/proc/loadavg: 7.96 5.20 3.33 1/457 29487
/proc/meminfo: memFree=10113836/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=230952 CPUtime=2.01 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 4530 1250 0 2 201 0 0 0 25 0 9 0 721106768 236494848 2672 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 57738 2672 180 55 0 55624 0
Current children cumulated CPU time (s) 2.01
Current children cumulated vsize (KiB) 230952

[startup+0.700626 s]
/proc/loadavg: 7.96 5.20 3.33 1/457 29487
/proc/meminfo: memFree=10113836/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=236788 CPUtime=5.21 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 11399 1250 0 2 519 2 0 0 25 0 9 0 721106768 242470912 4156 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 59197 4156 180 55 0 57083 0
Current children cumulated CPU time (s) 5.21
Current children cumulated vsize (KiB) 236788

[startup+1.50049 s]
/proc/loadavg: 7.96 5.20 3.33 9/466 29501
/proc/meminfo: memFree=10094184/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=242700 CPUtime=11.59 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 21665 1250 0 2 1155 4 0 0 25 0 9 0 721106768 248524800 5633 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 60675 5633 180 55 0 58561 0
[pid=29487/tid=29494] ppid=29485 vsize=242700 CPUtime=1.42 cores=0-7
/proc/29487/task/29494/stat : 29494 (plingeling) R 29485 29487 29387 0 -1 4202560 2711 1250 0 2 142 0 0 0 25 0 9 0 721106772 248524800 5633 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29487/tid=29495] ppid=29485 vsize=242700 CPUtime=1.45 cores=0-7
/proc/29487/task/29495/stat : 29495 (plingeling) R 29485 29487 29387 0 -1 4202560 2592 1250 0 2 145 0 0 0 25 0 9 0 721106772 248524800 5633 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29487/tid=29496] ppid=29485 vsize=242700 CPUtime=1.45 cores=0-7
/proc/29487/task/29496/stat : 29496 (plingeling) R 29485 29487 29387 0 -1 4202560 2719 1250 0 2 145 0 0 0 25 0 9 0 721106772 248524800 5633 33554432000 4194304 4417452 140734809399040 18446744073709551615 4357714 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29487/tid=29497] ppid=29485 vsize=242700 CPUtime=1.45 cores=0-7
/proc/29487/task/29497/stat : 29497 (plingeling) R 29485 29487 29387 0 -1 4202560 3342 1250 0 2 145 0 0 0 25 0 9 0 721106772 248524800 5633 33554432000 4194304 4417452 140734809399040 18446744073709551615 4365042 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29487/tid=29498] ppid=29485 vsize=242700 CPUtime=1.4 cores=0-7
/proc/29487/task/29498/stat : 29498 (plingeling) R 29485 29487 29387 0 -1 4202560 2173 1250 0 2 140 0 0 0 25 0 9 0 721106772 248524800 5633 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29487/tid=29499] ppid=29485 vsize=242700 CPUtime=1.45 cores=0-7
/proc/29487/task/29499/stat : 29499 (plingeling) R 29485 29487 29387 0 -1 4202560 2441 1250 0 2 145 0 0 0 25 0 9 0 721106772 248524800 5633 33554432000 4194304 4417452 140734809399040 18446744073709551615 4366074 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29487/tid=29500] ppid=29485 vsize=242700 CPUtime=1.45 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 2577 1250 0 2 145 0 0 0 25 0 9 0 721106772 248524800 5633 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29487/tid=29501] ppid=29485 vsize=242700 CPUtime=1.45 cores=0-7
/proc/29487/task/29501/stat : 29501 (plingeling) R 29485 29487 29387 0 -1 4202560 2768 1250 0 2 145 0 0 0 25 0 9 0 721106772 248524800 5633 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11.59
Current children cumulated vsize (KiB) 242700

[startup+3.1012 s]
/proc/loadavg: 7.96 5.20 3.33 9/466 29501
/proc/meminfo: memFree=10087736/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=253732 CPUtime=24.38 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 39196 1250 0 2 2431 7 0 0 25 0 9 0 721106768 259821568 8391 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 63433 8391 180 55 0 61319 0
[pid=29487/tid=29494] ppid=29485 vsize=253732 CPUtime=3 cores=0-7
/proc/29487/task/29494/stat : 29494 (plingeling) R 29485 29487 29387 0 -1 4202560 4552 1250 0 2 300 0 0 0 25 0 9 0 721106772 259821568 8391 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29487/tid=29495] ppid=29485 vsize=253732 CPUtime=3.05 cores=0-7
/proc/29487/task/29495/stat : 29495 (plingeling) R 29485 29487 29387 0 -1 4202560 5144 1250 0 2 305 0 0 0 25 0 9 0 721106772 259821568 8391 33554432000 4194304 4417452 140734809399040 18446744073709551615 4366813 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29487/tid=29496] ppid=29485 vsize=253732 CPUtime=3.05 cores=0-7
/proc/29487/task/29496/stat : 29496 (plingeling) R 29485 29487 29387 0 -1 4202560 4769 1250 0 2 304 1 0 0 25 0 9 0 721106772 259821568 8391 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29487/tid=29497] ppid=29485 vsize=253732 CPUtime=3.05 cores=0-7
/proc/29487/task/29497/stat : 29497 (plingeling) R 29485 29487 29387 0 -1 4202560 5304 1250 0 2 305 0 0 0 25 0 9 0 721106772 259821568 8391 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29487/tid=29498] ppid=29485 vsize=253732 CPUtime=3 cores=0-7
/proc/29487/task/29498/stat : 29498 (plingeling) R 29485 29487 29387 0 -1 4202560 4231 1250 0 2 299 1 0 0 25 0 9 0 721106772 259821568 8391 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29487/tid=29499] ppid=29485 vsize=253732 CPUtime=3.05 cores=0-7
/proc/29487/task/29499/stat : 29499 (plingeling) R 29485 29487 29387 0 -1 4202560 4945 1250 0 2 305 0 0 0 25 0 9 0 721106772 259821568 8391 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29487/tid=29500] ppid=29485 vsize=253732 CPUtime=3.04 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 4931 1250 0 2 304 0 0 0 25 0 9 0 721106772 259821568 8391 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29487/tid=29501] ppid=29485 vsize=253732 CPUtime=3.05 cores=0-7
/proc/29487/task/29501/stat : 29501 (plingeling) R 29485 29487 29387 0 -1 4202560 4978 1250 0 2 305 0 0 0 25 0 9 0 721106772 259821568 8391 33554432000 4194304 4417452 140734809399040 18446744073709551615 4309899 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.38
Current children cumulated vsize (KiB) 253732

[startup+6.30064 s]
/proc/loadavg: 7.96 5.25 3.36 9/466 29501
/proc/meminfo: memFree=10077760/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=260248 CPUtime=49.93 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 64745 1250 0 2 4981 12 0 0 25 0 9 0 721106768 266493952 10020 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 65062 10020 180 55 0 62948 0
[pid=29487/tid=29494] ppid=29485 vsize=260248 CPUtime=6.15 cores=0-7
/proc/29487/task/29494/stat : 29494 (plingeling) R 29485 29487 29387 0 -1 4202560 7407 1250 0 2 615 0 0 0 25 0 9 0 721106772 266493952 10020 33554432000 4194304 4417452 140734809399040 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29487/tid=29495] ppid=29485 vsize=260248 CPUtime=6.25 cores=0-7
/proc/29487/task/29495/stat : 29495 (plingeling) R 29485 29487 29387 0 -1 4202560 8254 1250 0 2 624 1 0 0 25 0 9 0 721106772 266493952 10020 33554432000 4194304 4417452 140734809399040 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29487/tid=29496] ppid=29485 vsize=260248 CPUtime=6.25 cores=0-7
/proc/29487/task/29496/stat : 29496 (plingeling) R 29485 29487 29387 0 -1 4202560 8089 1250 0 2 624 1 0 0 25 0 9 0 721106772 266493952 10020 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29487/tid=29497] ppid=29485 vsize=260248 CPUtime=6.25 cores=0-7
/proc/29487/task/29497/stat : 29497 (plingeling) R 29485 29487 29387 0 -1 4202560 8833 1250 0 2 624 1 0 0 25 0 9 0 721106772 266493952 10020 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29487/tid=29498] ppid=29485 vsize=260248 CPUtime=6.2 cores=0-7
/proc/29487/task/29498/stat : 29498 (plingeling) R 29485 29487 29387 0 -1 4202560 6988 1250 0 2 619 1 0 0 25 0 9 0 721106772 266493952 10020 33554432000 4194304 4417452 140734809399040 18446744073709551615 4366102 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29487/tid=29499] ppid=29485 vsize=260248 CPUtime=6.25 cores=0-7
/proc/29487/task/29499/stat : 29499 (plingeling) R 29485 29487 29387 0 -1 4202560 8326 1250 0 2 624 1 0 0 25 0 9 0 721106772 266493952 10020 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29487/tid=29500] ppid=29485 vsize=260248 CPUtime=6.25 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 7928 1250 0 2 624 1 0 0 25 0 9 0 721106772 266493952 10020 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29487/tid=29501] ppid=29485 vsize=260248 CPUtime=6.25 cores=0-7
/proc/29487/task/29501/stat : 29501 (plingeling) R 29485 29487 29387 0 -1 4202560 8578 1250 0 2 624 1 0 0 25 0 9 0 721106772 266493952 10020 33554432000 4194304 4417452 140734809399040 18446744073709551615 4344138 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 49.93
Current children cumulated vsize (KiB) 260248

[startup+12.7005 s]
/proc/loadavg: 7.97 5.30 3.38 9/466 29501
/proc/meminfo: memFree=10054744/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=261412 CPUtime=101.02 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 105089 1250 0 2 10082 20 0 0 25 0 9 0 721106768 267685888 10287 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 65353 10287 180 55 0 63239 0
[pid=29487/tid=29494] ppid=29485 vsize=261412 CPUtime=12.45 cores=0-7
/proc/29487/task/29494/stat : 29494 (plingeling) R 29485 29487 29387 0 -1 4202560 13197 1250 0 2 1243 2 0 0 25 0 9 0 721106772 267685888 10287 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29487/tid=29495] ppid=29485 vsize=261412 CPUtime=12.65 cores=0-7
/proc/29487/task/29495/stat : 29495 (plingeling) R 29485 29487 29387 0 -1 4202560 13015 1250 0 2 1263 2 0 0 25 0 9 0 721106772 267685888 10287 33554432000 4194304 4417452 140734809399040 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29487/tid=29496] ppid=29485 vsize=261412 CPUtime=12.65 cores=0-7
/proc/29487/task/29496/stat : 29496 (plingeling) R 29485 29487 29387 0 -1 4202560 13065 1250 0 2 1263 2 0 0 25 0 9 0 721106772 267685888 10287 33554432000 4194304 4417452 140734809399040 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29487/tid=29497] ppid=29485 vsize=261412 CPUtime=12.65 cores=0-7
/proc/29487/task/29497/stat : 29497 (plingeling) R 29485 29487 29387 0 -1 4202560 13833 1250 0 2 1263 2 0 0 25 0 9 0 721106772 267685888 10287 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29487/tid=29498] ppid=29485 vsize=261412 CPUtime=12.61 cores=0-7
/proc/29487/task/29498/stat : 29498 (plingeling) R 29485 29487 29387 0 -1 4202560 11808 1250 0 2 1258 3 0 0 25 0 9 0 721106772 267685888 10287 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29487/tid=29499] ppid=29485 vsize=261412 CPUtime=12.65 cores=0-7
/proc/29487/task/29499/stat : 29499 (plingeling) R 29485 29487 29387 0 -1 4202560 12771 1250 0 2 1263 2 0 0 25 0 9 0 721106772 267685888 10287 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29487/tid=29500] ppid=29485 vsize=261412 CPUtime=12.64 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 13230 1250 0 2 1263 1 0 0 25 0 9 0 721106772 267685888 10287 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29487/tid=29501] ppid=29485 vsize=261412 CPUtime=12.64 cores=0-7
/proc/29487/task/29501/stat : 29501 (plingeling) R 29485 29487 29387 0 -1 4202560 13828 1250 0 2 1262 2 0 0 25 0 9 0 721106772 267685888 10287 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.02
Current children cumulated vsize (KiB) 261412

[startup+25.5012 s]
/proc/loadavg: 7.97 5.43 3.46 9/466 29501
/proc/meminfo: memFree=10055712/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=278280 CPUtime=203.23 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 157690 1250 0 2 20292 31 0 0 25 0 9 0 721106768 284958720 14495 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 69570 14495 180 55 0 67456 0
[pid=29487/tid=29494] ppid=29485 vsize=278280 CPUtime=25.05 cores=0-7
/proc/29487/task/29494/stat : 29494 (plingeling) R 29485 29487 29387 0 -1 4202560 20370 1250 0 2 2502 3 0 0 25 0 9 0 721106772 284958720 14495 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364693 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29487/tid=29495] ppid=29485 vsize=278280 CPUtime=25.45 cores=0-7
/proc/29487/task/29495/stat : 29495 (plingeling) R 29485 29487 29387 0 -1 4202560 19354 1250 0 2 2542 3 0 0 25 0 9 0 721106772 284958720 14495 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29487/tid=29496] ppid=29485 vsize=278280 CPUtime=25.46 cores=0-7
/proc/29487/task/29496/stat : 29496 (plingeling) R 29485 29487 29387 0 -1 4202560 20997 1250 0 2 2542 4 0 0 25 0 9 0 721106772 284958720 14495 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29487/tid=29497] ppid=29485 vsize=278280 CPUtime=25.45 cores=0-7
/proc/29487/task/29497/stat : 29497 (plingeling) R 29485 29487 29387 0 -1 4202560 20290 1250 0 2 2542 3 0 0 25 0 9 0 721106772 284958720 14495 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29487/tid=29498] ppid=29485 vsize=278280 CPUtime=25.41 cores=0-7
/proc/29487/task/29498/stat : 29498 (plingeling) R 29485 29487 29387 0 -1 4202560 18903 1250 0 2 2536 5 0 0 25 0 9 0 721106772 284958720 14495 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29487/tid=29499] ppid=29485 vsize=278280 CPUtime=25.45 cores=0-7
/proc/29487/task/29499/stat : 29499 (plingeling) R 29485 29487 29387 0 -1 4202560 18993 1250 0 2 2542 3 0 0 25 0 9 0 721106772 284958720 14495 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29487/tid=29500] ppid=29485 vsize=278280 CPUtime=25.45 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 18630 1250 0 2 2542 3 0 0 25 0 9 0 721106772 284958720 14495 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29487/tid=29501] ppid=29485 vsize=278280 CPUtime=25.45 cores=0-7
/proc/29487/task/29501/stat : 29501 (plingeling) R 29485 29487 29387 0 -1 4202560 19811 1250 0 2 2541 4 0 0 25 0 9 0 721106772 284958720 14495 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.23
Current children cumulated vsize (KiB) 278280

[startup+51.1007 s]
/proc/loadavg: 7.98 5.63 3.58 9/466 29502
/proc/meminfo: memFree=10037056/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=295444 CPUtime=407.62 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 251655 1250 0 2 40713 49 0 0 25 0 9 0 721106768 302534656 18787 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 73861 18787 180 55 0 71747 0
[pid=29487/tid=29494] ppid=29485 vsize=295444 CPUtime=50.26 cores=0-7
/proc/29487/task/29494/stat : 29494 (plingeling) R 29485 29487 29387 0 -1 4202560 32545 1250 0 2 5021 5 0 0 25 0 9 0 721106772 302534656 18787 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29487/tid=29495] ppid=29485 vsize=295444 CPUtime=51.05 cores=0-7
/proc/29487/task/29495/stat : 29495 (plingeling) R 29485 29487 29387 0 -1 4202560 29760 1250 0 2 5100 5 0 0 25 0 9 0 721106772 302534656 18787 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29487/tid=29496] ppid=29485 vsize=295444 CPUtime=51.05 cores=0-7

################
# More data... #
################

[startup+1722.3 s]
/proc/loadavg: 8.05 8.03 7.28 9/466 29547
/proc/meminfo: memFree=9828116/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=506416 CPUtime=13751.3 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 2393585 1250 0 2 1374676 450 0 0 25 0 9 0 721106768 518569984 71504 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 126604 71504 180 55 0 124490 0
[pid=29487/tid=29494] ppid=29485 vsize=506416 CPUtime=1695.67 cores=0-7
/proc/29487/task/29494/stat : 29494 (plingeling) R 29485 29487 29387 0 -1 4202560 309496 1250 0 2 169516 51 0 0 25 0 9 0 721106772 518569984 71504 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29487/tid=29495] ppid=29485 vsize=506416 CPUtime=1722.29 cores=0-7
/proc/29487/task/29495/stat : 29495 (plingeling) R 29485 29487 29387 0 -1 4202560 288390 1250 0 2 172178 51 0 0 25 0 9 0 721106772 518569984 71504 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29487/tid=29496] ppid=29485 vsize=506416 CPUtime=1722.29 cores=0-7
/proc/29487/task/29496/stat : 29496 (plingeling) R 29485 29487 29387 0 -1 4202560 302224 1250 0 2 172174 55 0 0 25 0 9 0 721106772 518569984 71504 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29487/tid=29497] ppid=29485 vsize=506416 CPUtime=1722.29 cores=0-7
/proc/29487/task/29497/stat : 29497 (plingeling) R 29485 29487 29387 0 -1 4202560 332807 1250 0 2 172165 64 0 0 25 0 9 0 721106772 518569984 71504 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29487/tid=29498] ppid=29485 vsize=506416 CPUtime=1722.2 cores=0-7
/proc/29487/task/29498/stat : 29498 (plingeling) R 29485 29487 29387 0 -1 4202560 298185 1250 0 2 172162 58 0 0 25 0 9 0 721106772 518569984 71504 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29487/tid=29499] ppid=29485 vsize=506416 CPUtime=1722.29 cores=0-7
/proc/29487/task/29499/stat : 29499 (plingeling) R 29485 29487 29387 0 -1 4202560 288360 1250 0 2 172172 57 0 0 25 0 9 0 721106772 518569984 71504 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29487/tid=29500] ppid=29485 vsize=506416 CPUtime=1721.85 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 291872 1250 0 2 172128 57 0 0 25 0 9 0 721106772 518569984 71504 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29487/tid=29501] ppid=29485 vsize=506416 CPUtime=1722.29 cores=0-7
/proc/29487/task/29501/stat : 29501 (plingeling) R 29485 29487 29387 0 -1 4202560 281909 1250 0 2 172177 52 0 0 25 0 9 0 721106772 518569984 71504 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 13751.3
Current children cumulated vsize (KiB) 506416

[startup+1782.3 s]
/proc/loadavg: 8.02 8.02 7.32 9/466 29548
/proc/meminfo: memFree=9787676/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=546136 CPUtime=14230.3 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 2437101 1250 0 2 1422574 458 0 0 25 0 9 0 721106768 559243264 81438 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 136534 81438 180 55 0 134420 0
[pid=29487/tid=29494] ppid=29485 vsize=546136 CPUtime=1754.74 cores=0-7
/proc/29487/task/29494/stat : 29494 (plingeling) R 29485 29487 29387 0 -1 4202560 313361 1250 0 2 175422 52 0 0 25 0 9 0 721106772 559243264 81438 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29487/tid=29495] ppid=29485 vsize=546136 CPUtime=1782.29 cores=0-7
/proc/29487/task/29495/stat : 29495 (plingeling) R 29485 29487 29387 0 -1 4202560 296271 1250 0 2 178176 53 0 0 25 0 9 0 721106772 559243264 81438 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29487/tid=29496] ppid=29485 vsize=546136 CPUtime=1782.29 cores=0-7
/proc/29487/task/29496/stat : 29496 (plingeling) R 29485 29487 29387 0 -1 4202560 304950 1250 0 2 178173 56 0 0 25 0 9 0 721106772 559243264 81438 33554432000 4194304 4417452 140734809399040 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29487/tid=29497] ppid=29485 vsize=546136 CPUtime=1782.3 cores=0-7
/proc/29487/task/29497/stat : 29497 (plingeling) R 29485 29487 29387 0 -1 4202560 337089 1250 0 2 178165 65 0 0 25 0 9 0 721106772 559243264 81438 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29487/tid=29498] ppid=29485 vsize=546136 CPUtime=1782.2 cores=0-7
/proc/29487/task/29498/stat : 29498 (plingeling) R 29485 29487 29387 0 -1 4202560 302902 1250 0 2 178161 59 0 0 25 0 9 0 721106772 559243264 81438 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29487/tid=29499] ppid=29485 vsize=546136 CPUtime=1782.29 cores=0-7
/proc/29487/task/29499/stat : 29499 (plingeling) R 29485 29487 29387 0 -1 4202560 298276 1250 0 2 178171 58 0 0 25 0 9 0 721106772 559243264 81438 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29487/tid=29500] ppid=29485 vsize=546136 CPUtime=1781.84 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 298174 1250 0 2 178125 59 0 0 25 0 9 0 721106772 559243264 81438 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29487/tid=29501] ppid=29485 vsize=546136 CPUtime=1782.29 cores=0-7
/proc/29487/task/29501/stat : 29501 (plingeling) R 29485 29487 29387 0 -1 4202560 285736 1250 0 2 178177 52 0 0 25 0 9 0 721106772 559243264 81438 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 14230.3
Current children cumulated vsize (KiB) 546136

[startup+1842.3 s]
/proc/loadavg: 8.05 8.03 7.37 9/466 29550
/proc/meminfo: memFree=9785304/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=548868 CPUtime=14709.4 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 2482929 1250 0 2 1470473 467 0 0 25 0 9 0 721106768 562040832 82110 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 137217 82110 180 55 0 135103 0
[pid=29487/tid=29494] ppid=29485 vsize=548868 CPUtime=1813.82 cores=0-7
/proc/29487/task/29494/stat : 29494 (plingeling) R 29485 29487 29387 0 -1 4202560 319809 1250 0 2 181330 52 0 0 25 0 9 0 721106772 562040832 82110 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29487/tid=29495] ppid=29485 vsize=548868 CPUtime=1842.3 cores=0-7
/proc/29487/task/29495/stat : 29495 (plingeling) R 29485 29487 29387 0 -1 4202560 302052 1250 0 2 184175 55 0 0 25 0 9 0 721106772 562040832 82110 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29487/tid=29496] ppid=29485 vsize=548868 CPUtime=1842.3 cores=0-7
/proc/29487/task/29496/stat : 29496 (plingeling) R 29485 29487 29387 0 -1 4202560 312974 1250 0 2 184172 58 0 0 25 0 9 0 721106772 562040832 82110 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29487/tid=29497] ppid=29485 vsize=548868 CPUtime=1842.3 cores=0-7
/proc/29487/task/29497/stat : 29497 (plingeling) R 29485 29487 29387 0 -1 4202560 342984 1250 0 2 184164 66 0 0 25 0 9 0 721106772 562040832 82110 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29487/tid=29498] ppid=29485 vsize=548868 CPUtime=1842.2 cores=0-7
/proc/29487/task/29498/stat : 29498 (plingeling) R 29485 29487 29387 0 -1 4202560 314328 1250 0 2 184159 61 0 0 25 0 9 0 721106772 562040832 82110 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29487/tid=29499] ppid=29485 vsize=548868 CPUtime=1842.3 cores=0-7
/proc/29487/task/29499/stat : 29499 (plingeling) R 29485 29487 29387 0 -1 4202560 302013 1250 0 2 184170 60 0 0 25 0 9 0 721106772 562040832 82110 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29487/tid=29500] ppid=29485 vsize=548868 CPUtime=1841.83 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 299058 1250 0 2 184124 59 0 0 25 0 9 0 721106772 562040832 82110 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29487/tid=29501] ppid=29485 vsize=548868 CPUtime=1842.29 cores=0-7
/proc/29487/task/29501/stat : 29501 (plingeling) R 29485 29487 29387 0 -1 4202560 289369 1250 0 2 184176 53 0 0 25 0 9 0 721106772 562040832 82110 33554432000 4194304 4417452 140734809399040 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 14709.4
Current children cumulated vsize (KiB) 548868

[startup+1902.3 s]
/proc/loadavg: 8.05 8.04 7.41 9/466 29551
/proc/meminfo: memFree=9776592/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=558584 CPUtime=15188.5 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 2520882 1250 0 2 1518372 473 0 0 25 0 9 0 721106768 571990016 84539 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 139646 84539 180 55 0 137532 0
[pid=29487/tid=29494] ppid=29485 vsize=558584 CPUtime=1872.89 cores=0-7
/proc/29487/task/29494/stat : 29494 (plingeling) R 29485 29487 29387 0 -1 4202560 325816 1250 0 2 187236 53 0 0 25 0 9 0 721106772 571990016 84539 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29487/tid=29495] ppid=29485 vsize=558584 CPUtime=1902.3 cores=0-7
/proc/29487/task/29495/stat : 29495 (plingeling) R 29485 29487 29387 0 -1 4202560 310283 1250 0 2 190174 56 0 0 25 0 9 0 721106772 571990016 84539 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29487/tid=29496] ppid=29485 vsize=558584 CPUtime=1902.29 cores=0-7
/proc/29487/task/29496/stat : 29496 (plingeling) R 29485 29487 29387 0 -1 4202560 317888 1250 0 2 190171 58 0 0 25 0 9 0 721106772 571990016 84539 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29487/tid=29497] ppid=29485 vsize=558584 CPUtime=1902.3 cores=0-7
/proc/29487/task/29497/stat : 29497 (plingeling) R 29485 29487 29387 0 -1 4202560 351242 1250 0 2 190162 68 0 0 25 0 9 0 721106772 571990016 84539 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29487/tid=29498] ppid=29485 vsize=558584 CPUtime=1902.19 cores=0-7
/proc/29487/task/29498/stat : 29498 (plingeling) R 29485 29487 29387 0 -1 4202560 317483 1250 0 2 190158 61 0 0 25 0 9 0 721106772 571990016 84539 33554432000 4194304 4417452 140734809399040 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29487/tid=29499] ppid=29485 vsize=558584 CPUtime=1902.3 cores=0-7
/proc/29487/task/29499/stat : 29499 (plingeling) R 29485 29487 29387 0 -1 4202560 302013 1250 0 2 190170 60 0 0 25 0 9 0 721106772 571990016 84539 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364703 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29487/tid=29500] ppid=29485 vsize=558584 CPUtime=1901.81 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 303275 1250 0 2 190121 60 0 0 25 0 9 0 721106772 571990016 84539 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29487/tid=29501] ppid=29485 vsize=558584 CPUtime=1902.3 cores=0-7
/proc/29487/task/29501/stat : 29501 (plingeling) R 29485 29487 29387 0 -1 4202560 292540 1250 0 2 190176 54 0 0 25 0 9 0 721106772 571990016 84539 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 15188.5
Current children cumulated vsize (KiB) 558584

[startup+1962.3 s]
/proc/loadavg: 8.09 8.05 7.46 9/466 29553
/proc/meminfo: memFree=9759948/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=575184 CPUtime=15667.7 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 2573058 1250 0 2 1566284 481 0 0 25 0 9 0 721106768 588988416 88689 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 143796 88689 180 55 0 141682 0
[pid=29487/tid=29494] ppid=29485 vsize=575184 CPUtime=1931.98 cores=0-7
/proc/29487/task/29494/stat : 29494 (plingeling) R 29485 29487 29387 0 -1 4202560 331382 1250 0 2 193144 54 0 0 25 0 9 0 721106772 588988416 88689 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29487/tid=29495] ppid=29485 vsize=575184 CPUtime=1962.32 cores=0-7
/proc/29487/task/29495/stat : 29495 (plingeling) R 29485 29487 29387 0 -1 4202560 316085 1250 0 2 196175 57 0 0 25 0 9 0 721106772 588988416 88689 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29487/tid=29496] ppid=29485 vsize=575184 CPUtime=1962.31 cores=0-7
/proc/29487/task/29496/stat : 29496 (plingeling) R 29485 29487 29387 0 -1 4202560 320691 1250 0 2 196172 59 0 0 25 0 9 0 721106772 588988416 88689 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29487/tid=29497] ppid=29485 vsize=575184 CPUtime=1962.32 cores=0-7
/proc/29487/task/29497/stat : 29497 (plingeling) R 29485 29487 29387 0 -1 4202560 359761 1250 0 2 196163 69 0 0 25 0 9 0 721106772 588988416 88689 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29487/tid=29498] ppid=29485 vsize=575184 CPUtime=1962.22 cores=0-7
/proc/29487/task/29498/stat : 29498 (plingeling) R 29485 29487 29387 0 -1 4202560 324123 1250 0 2 196159 63 0 0 25 0 9 0 721106772 588988416 88689 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29487/tid=29499] ppid=29485 vsize=575184 CPUtime=1962.32 cores=0-7
/proc/29487/task/29499/stat : 29499 (plingeling) R 29485 29487 29387 0 -1 4202560 311781 1250 0 2 196170 62 0 0 25 0 9 0 721106772 588988416 88689 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29487/tid=29500] ppid=29485 vsize=575184 CPUtime=1961.82 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 312214 1250 0 2 196121 61 0 0 25 0 9 0 721106772 588988416 88689 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29487/tid=29501] ppid=29485 vsize=575184 CPUtime=1962.31 cores=0-7
/proc/29487/task/29501/stat : 29501 (plingeling) R 29485 29487 29387 0 -1 4202560 296679 1250 0 2 196177 54 0 0 25 0 9 0 721106772 588988416 88689 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 15667.6
Current children cumulated vsize (KiB) 575184

[startup+2022.3 s]
/proc/loadavg: 8.06 8.06 7.49 3/460 29555
/proc/meminfo: memFree=9770520/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=533836 CPUtime=16134 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 2612572 1250 0 2 1612912 489 0 0 18 0 2 0 721106768 546648064 86015 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 133459 86015 181 55 0 131345 0
[pid=29487/tid=29500] ppid=29485 vsize=533836 CPUtime=2021.79 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 316058 1250 0 2 202118 61 0 0 25 0 2 0 721106772 546648064 86015 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16134
Current children cumulated vsize (KiB) 533836

Solver just ended. Dumping a history of the last processes samples

[startup+2023.1 s]
/proc/loadavg: 7.50 7.94 7.46 2/459 29555
/proc/meminfo: memFree=9770552/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=533836 CPUtime=16134.8 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 2612572 1250 0 2 1612992 489 0 0 18 0 2 0 721106768 546648064 86015 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 133459 86015 181 55 0 131345 0
[pid=29487/tid=29500] ppid=29485 vsize=533836 CPUtime=2022.59 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 316058 1250 0 2 202198 61 0 0 25 0 2 0 721106772 546648064 86015 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16134.8
Current children cumulated vsize (KiB) 533836

[startup+2023.5 s]
/proc/loadavg: 7.50 7.94 7.46 2/459 29555
/proc/meminfo: memFree=9770552/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=533836 CPUtime=16135.2 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 2612572 1250 0 2 1613032 489 0 0 18 0 2 0 721106768 546648064 86015 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 133459 86015 181 55 0 131345 0
[pid=29487/tid=29500] ppid=29485 vsize=533836 CPUtime=2022.99 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 316058 1250 0 2 202238 61 0 0 25 0 2 0 721106772 546648064 86015 33554432000 4194304 4417452 140734809399040 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16135.2
Current children cumulated vsize (KiB) 533836

[startup+2023.7 s]
/proc/loadavg: 7.50 7.94 7.46 2/459 29555
/proc/meminfo: memFree=9770552/32950928 swapFree=62427732/67111528
[pid=29487] ppid=29485 vsize=533836 CPUtime=16135.4 cores=0-7
/proc/29487/stat : 29487 (plingeling) S 29485 29487 29387 0 -1 4202496 2612572 1250 0 2 1613052 489 0 0 18 0 2 0 721106768 546648064 86015 33554432000 4194304 4417452 140734809399040 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29487/statm: 133459 86015 181 55 0 131345 0
[pid=29487/tid=29500] ppid=29485 vsize=533836 CPUtime=2023.19 cores=0-7
/proc/29487/task/29500/stat : 29500 (plingeling) R 29485 29487 29387 0 -1 4202560 316058 1250 0 2 202258 61 0 0 25 0 2 0 721106772 546648064 86015 33554432000 4194304 4417452 140734809399040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16135.4
Current children cumulated vsize (KiB) 533836

Child status: 10
Real time (s): 2023.8
CPU time (s): 16135.5
CPU user time (s): 16130.6
CPU system time (s): 4.91425
CPU usage (%): 797.29
Max. virtual memory (cumulated for all children) (KiB): 621868

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 16130.6
system time used= 4.91425
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2613836
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 387
involuntary context switches= 76476

runsolver used 8.43772 second user time and 22.8385 second system time

The end

Launcher Data 

Begin job on node123 at 2011-05-22 22:11:10
IDJOB=3394394
IDBENCH=83141
IDSOLVER=1851
FILE ID=node123/3394394-1306095070
RUNJOBID= node123-1306094851-29401
PBS_JOBID= 13387962
Free space on /tmp= 73124 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n180-s34713902-sat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394394-1306095070/watcher-3394394-1306095070 -o /tmp/evaluation-result-3394394-1306095070/solver-3394394-1306095070 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394394-1306095070.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 19292459de25c4f5e9e6f187c00d549d
RANDOM SEED=2114813171

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      10114248 kB
Buffers:        183020 kB
Cached:        3564580 kB
SwapCached:      76116 kB
Active:        8179456 kB
Inactive:     14389204 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      10114248 kB
SwapTotal:    67111528 kB
SwapFree:     62427732 kB
Dirty:              36 kB
Writeback:           0 kB
AnonPages:    18753352 kB
Mapped:          31136 kB
Slab:           118484 kB
PageTables:      77604 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 133350428 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73124 MiB
End job on node123 at 2011-05-22 22:44:54