Trace number 3381081

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)SAT 12973.1 1624.59

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-23_506.cnf
MD5SUM3c65ff80757b12edd41f8ee6da874877
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark77.5062
Satisfiable
(Un)Satisfiability was proved
Number of variables253
Number of clauses34386
Sum of the clauses size155873
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 284
Number of clauses of size 331656
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52646

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...503495/instance-3381081-1305503495.cnf
0.19/0.26	c Solving...
12972.60/1624.44	c Answer: 1
12972.60/1624.44	v 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 -23 -24 25 26
12972.60/1624.44	v 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 -43 44 45 -46 47 48 49
12972.60/1624.44	v 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 -66 67 68 69 -70 71 72
12972.60/1624.44	v -73 74 75 76 77 78 79 80 81 -82 -83 84 85 86 87 88 89 90 91 92 93 94 95
12972.60/1624.44	v 96 97 98 99 100 101 -102 103 104 105 106 107 108 109 110 111 -112 113 114
12972.60/1624.44	v 115 116 117 118 119 120 121 122 123 124 -125 126 127 -128 -129 130 131
12972.60/1624.44	v 132 133 134 135 136 137 138 -139 140 141 142 143 144 145 146 147 148 149
12972.60/1624.44	v 150 151 152 153 154 155 156 157 158 -159 160 161 -162 163 -164 165 166
12972.60/1624.44	v 167 168 169 170 -171 172 173 174 175 176 177 178 179 180 181 -182 183 184
12972.60/1624.44	v 185 186 -187 188 189 190 191 192 193 194 195 196 197 -198 199 200 201 202
12972.60/1624.44	v 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 -218 219 -220
12972.60/1624.44	v -221 222 223 224 225 226 227 -228 229 230 231 232 233 234 235 236 237 238
12972.60/1624.44	v 239 240 241 242 -243 244 245 246 247 248 249 250 251 252 253 0
12973.02/1624.58	s SATISFIABLE
12973.02/1624.58	
12973.02/1624.58	c Models        : 1+    
12973.02/1624.58	c Time          : 1624.444s (Solving: 1624.19s 1st Model: 1624.19s Unsat: 0.00s)
12973.02/1624.58	c CPU Time      : 12972.970s

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3381081-1305503495/watcher-3381081-1305503495 -o /tmp/evaluation-result-3381081-1305503495/solver-3381081-1305503495 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3381081-1305503495.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.78 7.78 7.91 1/347 29171
/proc/meminfo: memFree=20207844/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=22920 CPUtime=0 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 1093 0 0 0 0 0 0 0 25 0 1 0 661947454 23470080 934 33554432000 4194304 4964800 140735819410096 18446744073709551615 228122713856 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/29171/statm: 5730 935 386 189 0 604 0

[startup+0.051399 s]
/proc/loadavg: 6.78 7.78 7.91 1/347 29171
/proc/meminfo: memFree=20207844/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=24376 CPUtime=0.04 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 1482 0 0 0 4 0 0 0 25 0 1 0 661947454 24961024 1322 33554432000 4194304 4964800 140735819410096 18446744073709551615 4607664 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/29171/statm: 6094 1322 399 189 0 968 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 24376

[startup+0.100397 s]
/proc/loadavg: 6.78 7.78 7.91 1/347 29171
/proc/meminfo: memFree=20207844/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=24376 CPUtime=0.09 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 1482 0 0 0 9 0 0 0 25 0 1 0 661947454 24961024 1322 33554432000 4194304 4964800 140735819410096 18446744073709551615 4607513 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/29171/statm: 6094 1322 399 189 0 968 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 24376

[startup+0.300315 s]
/proc/loadavg: 6.78 7.78 7.91 1/347 29171
/proc/meminfo: memFree=20207844/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=252664 CPUtime=0.52 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 2302 0 0 0 51 1 0 0 20 0 8 0 661947454 258727936 2068 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670321 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 63166 2068 464 189 0 57515 0
Current children cumulated CPU time (s) 0.52
Current children cumulated vsize (KiB) 252664

[startup+0.700243 s]
/proc/loadavg: 6.78 7.78 7.91 1/347 29171
/proc/meminfo: memFree=20207844/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=255396 CPUtime=3.72 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 5038 0 0 0 370 2 0 0 20 0 8 0 661947454 261525504 4804 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670357 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 63849 4804 464 189 0 58198 0
Current children cumulated CPU time (s) 3.72
Current children cumulated vsize (KiB) 255396

[startup+1.5011 s]
/proc/loadavg: 6.78 7.78 7.91 9/355 29179
/proc/meminfo: memFree=20186336/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=256824 CPUtime=10.12 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 6792 0 0 0 1009 3 0 0 22 0 8 0 661947454 262987776 6558 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670295 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 64206 6558 464 189 0 58555 0
[pid=29171/tid=29173] ppid=29169 vsize=256824 CPUtime=1.23 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 624 0 0 0 123 0 0 0 19 0 8 0 661947481 262987776 6558 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627304 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=256824 CPUtime=1.23 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 866 0 0 0 123 0 0 0 19 0 8 0 661947481 262987776 6558 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=256824 CPUtime=1.22 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 585 0 0 0 122 0 0 0 19 0 8 0 661947481 262987776 6558 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=256824 CPUtime=1.22 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 624 0 0 0 122 0 0 0 19 0 8 0 661947481 262987776 6558 33554432000 4194304 4964800 140735819410096 18446744073709551615 4653146 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=256824 CPUtime=1.23 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 478 0 0 0 123 0 0 0 19 0 8 0 661947481 262987776 6558 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=256824 CPUtime=1.22 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 701 0 0 0 122 0 0 0 22 0 8 0 661947481 262987776 6558 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=256824 CPUtime=1.21 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 812 0 0 0 121 0 0 0 19 0 8 0 661947481 262987776 6558 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670496 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 10.12
Current children cumulated vsize (KiB) 256824

[startup+3.10081 s]
/proc/loadavg: 6.78 7.78 7.91 9/355 29179
/proc/meminfo: memFree=20181136/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=258432 CPUtime=22.89 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 8428 0 0 0 2285 4 0 0 25 0 8 0 661947454 264634368 8194 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670368 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 64608 8194 466 189 0 58957 0
[pid=29171/tid=29173] ppid=29169 vsize=258432 CPUtime=2.83 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 786 0 0 0 283 0 0 0 23 0 8 0 661947481 264634368 8194 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=258432 CPUtime=2.82 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 1227 0 0 0 282 0 0 0 24 0 8 0 661947481 264634368 8194 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670496 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=258432 CPUtime=2.82 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 721 0 0 0 282 0 0 0 19 0 8 0 661947481 264634368 8194 33554432000 4194304 4964800 140735819410096 18446744073709551615 4668770 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=258432 CPUtime=2.82 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 796 0 0 0 282 0 0 0 23 0 8 0 661947481 264634368 8194 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=258432 CPUtime=2.82 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 667 0 0 0 282 0 0 0 24 0 8 0 661947481 264634368 8194 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670295 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=258432 CPUtime=2.82 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 850 0 0 0 282 0 0 0 25 0 8 0 661947481 264634368 8194 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627309 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=258432 CPUtime=2.8 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 1078 0 0 0 280 0 0 0 23 0 8 0 661947481 264634368 8194 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 22.89
Current children cumulated vsize (KiB) 258432

[startup+6.30124 s]
/proc/loadavg: 6.87 7.78 7.91 9/355 29179
/proc/meminfo: memFree=20169268/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=261516 CPUtime=48.44 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 10845 0 0 0 4838 6 0 0 25 0 8 0 661947454 267792384 10611 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670403 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 65379 10611 466 189 0 59728 0
[pid=29171/tid=29173] ppid=29169 vsize=261516 CPUtime=6.02 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 1073 0 0 0 602 0 0 0 25 0 8 0 661947481 267792384 10611 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=261516 CPUtime=6.02 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 1708 0 0 0 602 0 0 0 25 0 8 0 661947481 267792384 10611 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627365 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=261516 CPUtime=6.02 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 949 0 0 0 602 0 0 0 25 0 8 0 661947481 267792384 10611 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627281 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=261516 CPUtime=6.02 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 1069 0 0 0 602 0 0 0 25 0 8 0 661947481 267792384 10611 33554432000 4194304 4964800 140735819410096 18446744073709551615 4321020 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=261516 CPUtime=6.02 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 848 0 0 0 602 0 0 0 25 0 8 0 661947481 267792384 10611 33554432000 4194304 4964800 140735819410096 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=261516 CPUtime=6.03 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 1262 0 0 0 602 1 0 0 25 0 8 0 661947481 267792384 10611 33554432000 4194304 4964800 140735819410096 18446744073709551615 4684063 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=261516 CPUtime=5.96 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 1406 0 0 0 596 0 0 0 25 0 8 0 661947481 267792384 10611 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627356 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 48.44
Current children cumulated vsize (KiB) 261516

[startup+12.7011 s]
/proc/loadavg: 7.04 7.80 7.92 9/355 29179
/proc/meminfo: memFree=20147732/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=267976 CPUtime=99.55 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 16768 0 0 0 9946 9 0 0 25 0 8 0 661947454 274407424 16413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4333381 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 66994 16413 466 189 0 61343 0
[pid=29171/tid=29173] ppid=29169 vsize=267976 CPUtime=12.42 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 1773 0 0 0 1242 0 0 0 25 0 8 0 661947481 274407424 16413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4362301 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=267976 CPUtime=12.42 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 2933 0 0 0 1241 1 0 0 25 0 8 0 661947481 274407424 16413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=267976 CPUtime=12.42 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 1503 0 0 0 1242 0 0 0 19 0 8 0 661947481 274407424 16413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4668753 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=267976 CPUtime=12.41 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 1977 0 0 0 1241 0 0 0 25 0 8 0 661947481 274407424 16413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=267976 CPUtime=12.41 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 1399 0 0 0 1241 0 0 0 25 0 8 0 661947481 274407424 16413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=267976 CPUtime=12.42 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 1822 0 0 0 1241 1 0 0 25 0 8 0 661947481 274407424 16413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670427 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=267976 CPUtime=12.28 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 2387 0 0 0 1227 1 0 0 25 0 8 0 661947481 274407424 16413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4321038 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 99.55
Current children cumulated vsize (KiB) 267976

[startup+25.5008 s]
/proc/loadavg: 7.25 7.81 7.92 9/355 29180
/proc/meminfo: memFree=20122992/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=274916 CPUtime=201.79 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 22640 0 0 0 20166 13 0 0 25 0 8 0 661947454 281513984 22104 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 68729 22104 466 189 0 63078 0
[pid=29171/tid=29173] ppid=29169 vsize=274916 CPUtime=25.22 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 2340 0 0 0 2521 1 0 0 25 0 8 0 661947481 281513984 22104 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670417 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=274916 CPUtime=25.22 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 4918 0 0 0 2520 2 0 0 25 0 8 0 661947481 281513984 22104 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=274916 CPUtime=25.21 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 1952 0 0 0 2521 0 0 0 25 0 8 0 661947481 281513984 22104 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=274916 CPUtime=25.22 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 2686 0 0 0 2521 1 0 0 25 0 8 0 661947481 281513984 22104 33554432000 4194304 4964800 140735819410096 18446744073709551615 4364544 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=274916 CPUtime=25.22 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 1994 0 0 0 2521 1 0 0 25 0 8 0 661947481 281513984 22104 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627461 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=274916 CPUtime=25.22 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 2274 0 0 0 2520 2 0 0 25 0 8 0 661947481 281513984 22104 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670295 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=274916 CPUtime=24.93 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 3138 0 0 0 2491 2 0 0 25 0 8 0 661947481 281513984 22104 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627536 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 201.79
Current children cumulated vsize (KiB) 274916

[startup+51.1012 s]
/proc/loadavg: 7.51 7.83 7.92 9/355 29180
/proc/meminfo: memFree=20093928/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=281560 CPUtime=406.25 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 29935 0 0 0 40607 18 0 0 25 0 8 0 661947454 288317440 29367 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 70390 29367 466 189 0 64739 0
[pid=29171/tid=29173] ppid=29169 vsize=281560 CPUtime=50.81 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 3289 0 0 0 5079 2 0 0 25 0 8 0 661947481 288317440 29367 33554432000 4194304 4964800 140735819410096 18446744073709551615 4362184 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=281560 CPUtime=50.82 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 6901 0 0 0 5079 3 0 0 23 0 8 0 661947481 288317440 29367 33554432000 4194304 4964800 140735819410096 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=281560 CPUtime=50.82 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 2514 0 0 0 5081 1 0 0 25 0 8 0 661947481 288317440 29367 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=281560 CPUtime=50.81 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 3547 0 0 0 5080 1 0 0 25 0 8 0 661947481 288317440 29367 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627301 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=281560 CPUtime=50.8 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 2969 0 0 0 5079 1 0 0 25 0 8 0 661947481 288317440 29367 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=281560 CPUtime=50.82 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 2944 0 0 0 5080 2 0 0 25 0 8 0 661947481 288317440 29367 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=281560 CPUtime=50.25 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 3908 0 0 0 5022 3 0 0 25 0 8 0 661947481 288317440 29367 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 406.25

################
# More data... #
################

/proc/loadavg: 8.01 8.04 8.00 9/355 29232
/proc/meminfo: memFree=19891724/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=536900 CPUtime=12316.8 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 85383 0 0 0 1231529 150 0 0 25 0 8 0 661947454 549785600 79609 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670534 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 134225 79609 466 189 0 128574 0
[pid=29171/tid=29173] ppid=29169 vsize=536900 CPUtime=1534.62 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 15575 0 0 0 153441 21 0 0 25 0 8 0 661947481 549785600 79609 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=536900 CPUtime=1541.86 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 19840 0 0 0 154164 22 0 0 25 0 8 0 661947481 549785600 79609 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=536900 CPUtime=1541.61 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 5673 0 0 0 154148 13 0 0 25 0 8 0 661947481 549785600 79609 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670361 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=536900 CPUtime=1538.2 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 10826 0 0 0 153804 16 0 0 25 0 8 0 661947481 549785600 79609 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=536900 CPUtime=1539.45 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 10706 0 0 0 153929 16 0 0 25 0 8 0 661947481 549785600 79609 33554432000 4194304 4964800 140735819410096 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=536900 CPUtime=1541.63 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 6564 0 0 0 154144 19 0 0 25 0 8 0 661947481 549785600 79609 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627272 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=536900 CPUtime=1537.4 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 9818 0 0 0 153714 26 0 0 25 0 8 0 661947481 549785600 79609 33554432000 4194304 4964800 140735819410096 18446744073709551615 4644900 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12316.8
Current children cumulated vsize (KiB) 536900

[startup+1602.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/355 29234
/proc/meminfo: memFree=19889096/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=537648 CPUtime=12796.1 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 86324 0 0 0 1279453 154 0 0 25 0 8 0 661947454 550551552 80266 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670295 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 134412 80266 466 189 0 128761 0
[pid=29171/tid=29173] ppid=29169 vsize=537648 CPUtime=1593.94 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 15972 0 0 0 159373 21 0 0 25 0 8 0 661947481 550551552 80266 33554432000 4194304 4964800 140735819410096 18446744073709551615 4668748 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=537648 CPUtime=1601.86 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 20142 0 0 0 160163 23 0 0 25 0 8 0 661947481 550551552 80266 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=537648 CPUtime=1601.61 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 5684 0 0 0 160147 14 0 0 25 0 8 0 661947481 550551552 80266 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=537648 CPUtime=1598.19 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 10910 0 0 0 159803 16 0 0 25 0 8 0 661947481 550551552 80266 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=537648 CPUtime=1599.45 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 10720 0 0 0 159928 17 0 0 25 0 8 0 661947481 550551552 80266 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=537648 CPUtime=1601.61 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 6635 0 0 0 160142 19 0 0 25 0 8 0 661947481 550551552 80266 33554432000 4194304 4964800 140735819410096 18446744073709551615 4668709 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=537648 CPUtime=1597.38 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 9838 0 0 0 159712 26 0 0 25 0 8 0 661947481 550551552 80266 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12796.1
Current children cumulated vsize (KiB) 537648

Solver just ended. Dumping a history of the last processes samples

[startup+1612.7 s]
/proc/loadavg: 8.00 8.03 8.00 9/355 29234
/proc/meminfo: memFree=19888588/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=538076 CPUtime=12879.1 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 86518 0 0 0 1287759 155 0 0 25 0 8 0 661947454 550989824 80413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4668734 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 134519 80413 466 189 0 128868 0
[pid=29171/tid=29173] ppid=29169 vsize=538076 CPUtime=1604.22 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 16051 0 0 0 160400 22 0 0 25 0 8 0 661947481 550989824 80413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=538076 CPUtime=1612.26 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 20257 0 0 0 161203 23 0 0 25 0 8 0 661947481 550989824 80413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=538076 CPUtime=1612.01 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 5684 0 0 0 161187 14 0 0 25 0 8 0 661947481 550989824 80413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=538076 CPUtime=1608.59 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 10910 0 0 0 160843 16 0 0 25 0 8 0 661947481 550989824 80413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=538076 CPUtime=1609.85 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 10720 0 0 0 160968 17 0 0 25 0 8 0 661947481 550989824 80413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627338 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=538076 CPUtime=1612.01 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 6635 0 0 0 161182 19 0 0 25 0 8 0 661947481 550989824 80413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4644892 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=538076 CPUtime=1607.78 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 9838 0 0 0 160752 26 0 0 25 0 8 0 661947481 550989824 80413 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12879.1
Current children cumulated vsize (KiB) 538076

[startup+1619.1 s]
/proc/loadavg: 8.00 8.03 8.00 9/355 29234
/proc/meminfo: memFree=19888092/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=538716 CPUtime=12930.4 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 86638 0 0 0 1292880 156 0 0 25 0 8 0 661947454 551645184 80533 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 134679 80533 466 189 0 129028 0
[pid=29171/tid=29173] ppid=29169 vsize=538716 CPUtime=1610.56 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 16051 0 0 0 161034 22 0 0 25 0 8 0 661947481 551645184 80533 33554432000 4194304 4964800 140735819410096 18446744073709551615 4668715 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=538716 CPUtime=1618.67 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 20377 0 0 0 161844 23 0 0 25 0 8 0 661947481 551645184 80533 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=538716 CPUtime=1618.42 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 5684 0 0 0 161828 14 0 0 25 0 8 0 661947481 551645184 80533 33554432000 4194304 4964800 140735819410096 18446744073709551615 4312130 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=538716 CPUtime=1615 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 10910 0 0 0 161484 16 0 0 25 0 8 0 661947481 551645184 80533 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627536 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=538716 CPUtime=1616.26 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 10720 0 0 0 161609 17 0 0 25 0 8 0 661947481 551645184 80533 33554432000 4194304 4964800 140735819410096 18446744073709551615 4669978 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=538716 CPUtime=1618.42 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 6635 0 0 0 161823 19 0 0 25 0 8 0 661947481 551645184 80533 33554432000 4194304 4964800 140735819410096 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=538716 CPUtime=1614.19 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 9838 0 0 0 161393 26 0 0 25 0 8 0 661947481 551645184 80533 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12930.4
Current children cumulated vsize (KiB) 538716

[startup+1622.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/355 29234
/proc/meminfo: memFree=19888092/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=538716 CPUtime=12955.8 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 86697 0 0 0 1295426 157 0 0 25 0 8 0 661947454 551645184 80592 33554432000 4194304 4964800 140735819410096 18446744073709551615 4659391 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 134679 80592 466 189 0 129028 0
[pid=29171/tid=29173] ppid=29169 vsize=538716 CPUtime=1613.72 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 16051 0 0 0 161350 22 0 0 25 0 8 0 661947481 551645184 80592 33554432000 4194304 4964800 140735819410096 18446744073709551615 228122372992 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=538716 CPUtime=1621.85 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 20381 0 0 0 162162 23 0 0 25 0 8 0 661947481 551645184 80592 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=538716 CPUtime=1621.61 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 5739 0 0 0 162147 14 0 0 25 0 8 0 661947481 551645184 80592 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=538716 CPUtime=1618.19 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 10910 0 0 0 161803 16 0 0 25 0 8 0 661947481 551645184 80592 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=538716 CPUtime=1619.44 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 10720 0 0 0 161927 17 0 0 25 0 8 0 661947481 551645184 80592 33554432000 4194304 4964800 140735819410096 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=538716 CPUtime=1621.61 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 6635 0 0 0 162142 19 0 0 25 0 8 0 661947481 551645184 80592 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=538716 CPUtime=1617.38 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) S 29169 29171 29145 0 -1 4202560 9838 0 0 0 161711 27 0 0 25 0 8 0 661947481 551645184 80592 33554432000 4194304 4964800 140735819410096 18446744073709551615 228122819054 0 0 4096 18946 18446604451713926144 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12955.8
Current children cumulated vsize (KiB) 538716

[startup+1623.9 s]
/proc/loadavg: 8.00 8.03 8.00 9/355 29234
/proc/meminfo: memFree=19887968/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=538716 CPUtime=12968.6 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 86701 0 0 0 1296703 157 0 0 25 0 8 0 661947454 551645184 80596 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627185 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 134679 80596 466 189 0 129028 0
[pid=29171/tid=29173] ppid=29169 vsize=538716 CPUtime=1615.3 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 16051 0 0 0 161508 22 0 0 25 0 8 0 661947481 551645184 80596 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=538716 CPUtime=1623.45 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 20381 0 0 0 162322 23 0 0 25 0 8 0 661947481 551645184 80596 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=538716 CPUtime=1623.21 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 5743 0 0 0 162307 14 0 0 25 0 8 0 661947481 551645184 80596 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=538716 CPUtime=1619.79 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 10910 0 0 0 161963 16 0 0 25 0 8 0 661947481 551645184 80596 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=538716 CPUtime=1621.04 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 10720 0 0 0 162087 17 0 0 25 0 8 0 661947481 551645184 80596 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670330 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=538716 CPUtime=1623.21 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 6635 0 0 0 162302 19 0 0 25 0 8 0 661947481 551645184 80596 33554432000 4194304 4964800 140735819410096 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=538716 CPUtime=1618.97 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 9838 0 0 0 161870 27 0 0 25 0 8 0 661947481 551645184 80596 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12968.6
Current children cumulated vsize (KiB) 538716

[startup+1624.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/355 29234
/proc/meminfo: memFree=19887968/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=538716 CPUtime=12971.8 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 86702 0 0 0 1297023 157 0 0 25 0 8 0 661947454 551645184 80597 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670357 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/29171/statm: 134679 80597 466 189 0 129028 0
[pid=29171/tid=29173] ppid=29169 vsize=538716 CPUtime=1615.7 cores=0-7
/proc/29171/task/29173/stat : 29173 (claspmt) R 29169 29171 29145 0 -1 4202560 16051 0 0 0 161548 22 0 0 25 0 8 0 661947481 551645184 80597 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627540 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29171/tid=29174] ppid=29169 vsize=538716 CPUtime=1623.85 cores=0-7
/proc/29171/task/29174/stat : 29174 (claspmt) R 29169 29171 29145 0 -1 4202560 20381 0 0 0 162362 23 0 0 25 0 8 0 661947481 551645184 80597 33554432000 4194304 4964800 140735819410096 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29171/tid=29175] ppid=29169 vsize=538716 CPUtime=1623.61 cores=0-7
/proc/29171/task/29175/stat : 29175 (claspmt) R 29169 29171 29145 0 -1 4202560 5743 0 0 0 162347 14 0 0 25 0 8 0 661947481 551645184 80597 33554432000 4194304 4964800 140735819410096 18446744073709551615 4644900 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29171/tid=29176] ppid=29169 vsize=538716 CPUtime=1620.19 cores=0-7
/proc/29171/task/29176/stat : 29176 (claspmt) R 29169 29171 29145 0 -1 4202560 10910 0 0 0 162003 16 0 0 25 0 8 0 661947481 551645184 80597 33554432000 4194304 4964800 140735819410096 18446744073709551615 228122381243 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29171/tid=29177] ppid=29169 vsize=538716 CPUtime=1621.44 cores=0-7
/proc/29171/task/29177/stat : 29177 (claspmt) R 29169 29171 29145 0 -1 4202560 10720 0 0 0 162127 17 0 0 25 0 8 0 661947481 551645184 80597 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29171/tid=29178] ppid=29169 vsize=538716 CPUtime=1623.61 cores=0-7
/proc/29171/task/29178/stat : 29178 (claspmt) R 29169 29171 29145 0 -1 4202560 6636 0 0 0 162342 19 0 0 25 0 8 0 661947481 551645184 80597 33554432000 4194304 4964800 140735819410096 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29171/tid=29179] ppid=29169 vsize=538716 CPUtime=1619.37 cores=0-7
/proc/29171/task/29179/stat : 29179 (claspmt) R 29169 29171 29145 0 -1 4202560 9838 0 0 0 161910 27 0 0 25 0 8 0 661947481 551645184 80597 33554432000 4194304 4964800 140735819410096 18446744073709551615 4321054 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12971.8
Current children cumulated vsize (KiB) 538716

[startup+1624.5 s]
/proc/loadavg: 8.00 8.03 8.00 9/355 29234
/proc/meminfo: memFree=19887968/32951124 swapFree=54427468/67111528
[pid=29171] ppid=29169 vsize=536548 CPUtime=12973 cores=0-7
/proc/29171/stat : 29171 (claspmt) R 29169 29171 29145 0 -1 4202496 86716 0 0 0 1297145 157 0 0 25 0 1 0 661947454 549425152 80177 33554432000 4194304 4964800 140735819410096 18446744073709551615 4646607 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/29171/statm: 134137 80177 476 189 0 128486 0
Current children cumulated CPU time (s) 12973
Current children cumulated vsize (KiB) 536548

Child status: 10
Real time (s): 1624.59
CPU time (s): 12973.1
CPU user time (s): 12971.5
CPU system time (s): 1.59576
CPU usage (%): 798.547
Max. virtual memory (cumulated for all children) (KiB): 538716

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 12971.5
system time used= 1.59576
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 86717
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 102123
involuntary context switches= 61463

runsolver used 5.2402 second user time and 12.87 second system time

The end

Launcher Data 

Begin job on node138 at 2011-05-16 01:51:35
IDJOB=3381081
IDBENCH=83280
IDSOLVER=1865
FILE ID=node138/3381081-1305503495
RUNJOBID= node138-1305503495-29159
PBS_JOBID= 13325471
Free space on /tmp= 73552 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/VanDerWaerden_pd_2-3-23_506.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3381081-1305503495/watcher-3381081-1305503495 -o /tmp/evaluation-result-3381081-1305503495/solver-3381081-1305503495 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3381081-1305503495.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3c65ff80757b12edd41f8ee6da874877
RANDOM SEED=2065347966

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20208372 kB
Buffers:        299992 kB
Cached:        4021156 kB
SwapCached:      18496 kB
Active:        9362052 kB
Inactive:      3122096 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20208372 kB
SwapTotal:    67111528 kB
SwapFree:     54427468 kB
Dirty:            1660 kB
Writeback:           0 kB
AnonPages:     8155832 kB
Mapped:          15656 kB
Slab:           128828 kB
PageTables:      64664 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 77114488 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73552 MiB
End job on node138 at 2011-05-16 02:18:39