Trace number 3221199

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 1251.96 156.607

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v450-c1917-S1406921020-013.UNKNOWN.cnf
MD5SUM9869c5a4d8c5bed5ea530735320738db
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark153.377
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses1917
Sum of the clauses size5751
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31917
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
1251.86/156.60	s UNSATISFIABLE
1251.86/156.60	solver [4] march_hi 2009 answered
1251.86/156.60	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3221199-1304161040/watcher-3221199-1304161040 -o /tmp/evaluation-result-3221199-1304161040/solver-3221199-1304161040 -C 40000 -W 5000 -M 31000 ppfolio HOME/instance-3221199-1304161040.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.60 7.95 7.97 2/170 1211
/proc/meminfo: memFree=30088648/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (ppfolio) R 1209 1211 1020 0 -1 4194304 489 0 0 0 0 0 0 0 25 0 1 0 527701077 18763776 387 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476515221 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/1211/statm: 4581 387 339 23 0 91 0

[startup+0.057475 s]
/proc/loadavg: 7.60 7.95 7.97 2/170 1211
/proc/meminfo: memFree=30088648/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (ppfolio) R 1209 1211 1020 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100467 s]
/proc/loadavg: 7.60 7.95 7.97 2/170 1211
/proc/meminfo: memFree=30088648/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (ppfolio) R 1209 1211 1020 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300429 s]
/proc/loadavg: 7.60 7.95 7.97 2/170 1211
/proc/meminfo: memFree=30088648/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700352 s]
/proc/loadavg: 7.60 7.95 7.97 2/170 1211
/proc/meminfo: memFree=30088648/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 0 0 0 21 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.5012 s]
/proc/loadavg: 7.63 7.95 7.97 9/180 1226
/proc/meminfo: memFree=30072944/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
[pid=1212] ppid=1211 vsize=968288 CPUtime=1.49 cores=0
/proc/1212/stat : 1212 (cryptominisat) R 1211 1211 1020 0 -1 4202496 3421 0 0 0 149 0 0 0 20 0 1 0 527701077 991526912 2345 33554432000 4194304 4587354 140733534646624 18446744073709551615 4238477 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1212/statm: 242072 2345 337 96 0 238634 0
[pid=1213] ppid=1211 vsize=14032 CPUtime=1.49 cores=1
/proc/1213/stat : 1213 (clasp) R 1211 1211 1020 0 -1 4202496 957 0 0 0 149 0 0 0 20 0 1 0 527701077 14368768 845 33554432000 4194304 4785740 140734030836864 18446744073709551615 4552970 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1213/statm: 3508 845 340 145 0 553 0
[pid=1214] ppid=1211 vsize=455824 CPUtime=1.49 cores=2
/proc/1214/stat : 1214 (TNM) R 1211 1211 1020 0 -1 4202496 329 0 0 0 149 0 0 0 20 0 1 0 527701077 466763776 226 33554432000 134512640 134534564 4293058224 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1214/statm: 113956 226 95 6 0 112622 0
[pid=1215] ppid=1211 vsize=7624 CPUtime=1.49 cores=3
/proc/1215/stat : 1215 (march_hi) R 1211 1211 1020 0 -1 4202496 526 0 0 0 149 0 0 0 20 0 1 0 527701077 7806976 419 33554432000 4194304 4331988 140734953692768 18446744073709551615 4240211 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1215/statm: 1906 419 172 34 0 348 0
[pid=1216] ppid=1211 vsize=122920 CPUtime=5.92 cores=4-7
/proc/1216/stat : 1216 (plingeling) S 1211 1211 1020 0 -1 4202496 4053 1246 0 0 592 0 0 0 18 0 5 0 527701077 125870080 2844 33554432000 4194304 4356188 140736818030384 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/1216/statm: 30730 2844 164 40 0 29274 0
[pid=1216/tid=1223] ppid=1211 vsize=122920 CPUtime=1.48 cores=4-7
/proc/1216/task/1223/stat : 1223 (plingeling) R 1211 1211 1020 0 -1 4202560 924 1246 0 0 148 0 0 0 20 0 5 0 527701078 125870080 2844 33554432000 4194304 4356188 140736818030384 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1216/tid=1224] ppid=1211 vsize=122920 CPUtime=1.45 cores=4-7
/proc/1216/task/1224/stat : 1224 (plingeling) R 1211 1211 1020 0 -1 4202560 913 1246 0 0 145 0 0 0 23 0 5 0 527701078 125870080 2844 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331072 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1216/tid=1225] ppid=1211 vsize=122920 CPUtime=1.48 cores=4-7
/proc/1216/task/1225/stat : 1225 (plingeling) R 1211 1211 1020 0 -1 4202560 853 1246 0 0 148 0 0 0 23 0 5 0 527701078 125870080 2844 33554432000 4194304 4356188 140736818030384 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1216/tid=1226] ppid=1211 vsize=122920 CPUtime=1.48 cores=4-7
/proc/1216/task/1226/stat : 1226 (plingeling) R 1211 1211 1020 0 -1 4202560 862 1246 0 0 148 0 0 0 23 0 5 0 527701078 125870080 2844 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331355 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.88
Current children cumulated vsize (KiB) 1587012

[startup+3.10089 s]
/proc/loadavg: 7.63 7.95 7.97 9/180 1226
/proc/meminfo: memFree=30065876/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
[pid=1212] ppid=1211 vsize=966836 CPUtime=3.09 cores=0
/proc/1212/stat : 1212 (cryptominisat) R 1211 1211 1020 0 -1 4202496 4493 0 0 0 309 0 0 0 25 0 1 0 527701077 990040064 2268 33554432000 4194304 4587354 140733534646624 18446744073709551615 4244895 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1212/statm: 241709 2268 337 96 0 238271 0
[pid=1213] ppid=1211 vsize=14700 CPUtime=3.09 cores=1
/proc/1213/stat : 1213 (clasp) R 1211 1211 1020 0 -1 4202496 1140 0 0 0 309 0 0 0 25 0 1 0 527701077 15052800 1028 33554432000 4194304 4785740 140734030836864 18446744073709551615 4546313 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1213/statm: 3675 1028 340 145 0 720 0
[pid=1214] ppid=1211 vsize=455824 CPUtime=3.09 cores=2
/proc/1214/stat : 1214 (TNM) R 1211 1211 1020 0 -1 4202496 329 0 0 0 309 0 0 0 25 0 1 0 527701077 466763776 226 33554432000 134512640 134534564 4293058224 18446744073709551615 134529253 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1214/statm: 113956 226 95 6 0 112622 0
[pid=1215] ppid=1211 vsize=7780 CPUtime=3.09 cores=3
/proc/1215/stat : 1215 (march_hi) R 1211 1211 1020 0 -1 4202496 548 0 0 0 309 0 0 0 25 0 1 0 527701077 7966720 441 33554432000 4194304 4331988 140734953692768 18446744073709551615 4229592 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1215/statm: 1945 441 172 34 0 387 0
[pid=1216] ppid=1211 vsize=123444 CPUtime=12.31 cores=4-7
/proc/1216/stat : 1216 (plingeling) S 1211 1211 1020 0 -1 4202496 5368 1246 0 0 1231 0 0 0 18 0 5 0 527701077 126406656 2975 33554432000 4194304 4356188 140736818030384 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/1216/statm: 30861 2975 164 40 0 29405 0
[pid=1216/tid=1223] ppid=1211 vsize=123444 CPUtime=3.08 cores=4-7
/proc/1216/task/1223/stat : 1223 (plingeling) R 1211 1211 1020 0 -1 4202560 1245 1246 0 0 308 0 0 0 25 0 5 0 527701078 126406656 2975 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331392 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1216/tid=1224] ppid=1211 vsize=123444 CPUtime=3.05 cores=4-7
/proc/1216/task/1224/stat : 1224 (plingeling) R 1211 1211 1020 0 -1 4202560 1265 1246 0 0 305 0 0 0 25 0 5 0 527701078 126406656 2975 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331168 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1216/tid=1225] ppid=1211 vsize=123444 CPUtime=3.08 cores=4-7
/proc/1216/task/1225/stat : 1225 (plingeling) R 1211 1211 1020 0 -1 4202560 1109 1246 0 0 308 0 0 0 25 0 5 0 527701078 126406656 2975 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1216/tid=1226] ppid=1211 vsize=123444 CPUtime=3.08 cores=4-7
/proc/1216/task/1226/stat : 1226 (plingeling) R 1211 1211 1020 0 -1 4202560 1248 1246 0 0 308 0 0 0 25 0 5 0 527701078 126406656 2975 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.67
Current children cumulated vsize (KiB) 1586908

[startup+6.30128 s]
/proc/loadavg: 7.63 7.95 7.97 9/180 1226
/proc/meminfo: memFree=30057320/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
[pid=1212] ppid=1211 vsize=967672 CPUtime=6.29 cores=0
/proc/1212/stat : 1212 (cryptominisat) R 1211 1211 1020 0 -1 4202496 6309 0 0 0 629 0 0 0 25 0 1 0 527701077 990896128 2639 33554432000 4194304 4587354 140733534646624 18446744073709551615 4238568 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1212/statm: 241918 2639 337 96 0 238480 0
[pid=1213] ppid=1211 vsize=15668 CPUtime=6.29 cores=1
/proc/1213/stat : 1213 (clasp) R 1211 1211 1020 0 -1 4202496 1369 0 0 0 629 0 0 0 25 0 1 0 527701077 16044032 1257 33554432000 4194304 4785740 140734030836864 18446744073709551615 4550319 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1213/statm: 3917 1257 340 145 0 962 0
[pid=1214] ppid=1211 vsize=455824 CPUtime=6.29 cores=2
/proc/1214/stat : 1214 (TNM) R 1211 1211 1020 0 -1 4202496 329 0 0 0 629 0 0 0 25 0 1 0 527701077 466763776 226 33554432000 134512640 134534564 4293058224 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1214/statm: 113956 226 95 6 0 112622 0
[pid=1215] ppid=1211 vsize=7780 CPUtime=6.29 cores=3
/proc/1215/stat : 1215 (march_hi) R 1211 1211 1020 0 -1 4202496 559 0 0 0 629 0 0 0 25 0 1 0 527701077 7966720 452 33554432000 4194304 4331988 140734953692768 18446744073709551615 4211519 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1215/statm: 1945 452 172 34 0 387 0
[pid=1216] ppid=1211 vsize=129020 CPUtime=25.1 cores=4-7
/proc/1216/stat : 1216 (plingeling) S 1211 1211 1020 0 -1 4202496 9534 1246 0 0 2509 1 0 0 18 0 5 0 527701077 132116480 4369 33554432000 4194304 4356188 140736818030384 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/1216/statm: 32255 4369 164 40 0 30799 0
[pid=1216/tid=1223] ppid=1211 vsize=129020 CPUtime=6.28 cores=4-7
/proc/1216/task/1223/stat : 1223 (plingeling) R 1211 1211 1020 0 -1 4202560 2270 1246 0 0 628 0 0 0 25 0 5 0 527701078 132116480 4369 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331355 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1216/tid=1224] ppid=1211 vsize=129020 CPUtime=6.23 cores=4-7
/proc/1216/task/1224/stat : 1224 (plingeling) R 1211 1211 1020 0 -1 4202560 2227 1246 0 0 623 0 0 0 25 0 5 0 527701078 132116480 4369 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331760 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1216/tid=1225] ppid=1211 vsize=129020 CPUtime=6.28 cores=4-7
/proc/1216/task/1225/stat : 1225 (plingeling) R 1211 1211 1020 0 -1 4202560 2232 1246 0 0 628 0 0 0 25 0 5 0 527701078 132116480 4369 33554432000 4194304 4356188 140736818030384 18446744073709551615 4279755 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1216/tid=1226] ppid=1211 vsize=129020 CPUtime=6.28 cores=4-7
/proc/1216/task/1226/stat : 1226 (plingeling) R 1211 1211 1020 0 -1 4202560 2304 1246 0 0 628 0 0 0 25 0 5 0 527701078 132116480 4369 33554432000 4194304 4356188 140736818030384 18446744073709551615 4210575 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.26
Current children cumulated vsize (KiB) 1594288

[startup+12.7011 s]
/proc/loadavg: 7.69 7.95 7.97 9/180 1226
/proc/meminfo: memFree=30052144/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
[pid=1212] ppid=1211 vsize=978836 CPUtime=12.69 cores=0
/proc/1212/stat : 1212 (cryptominisat) R 1211 1211 1020 0 -1 4202496 9414 0 0 0 1268 1 0 0 25 0 1 0 527701077 1002328064 3723 33554432000 4194304 4587354 140733534646624 18446744073709551615 4238618 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1212/statm: 244709 3723 337 96 0 241271 0
[pid=1213] ppid=1211 vsize=16760 CPUtime=12.69 cores=1
/proc/1213/stat : 1213 (clasp) R 1211 1211 1020 0 -1 4202496 1640 0 0 0 1269 0 0 0 25 0 1 0 527701077 17162240 1528 33554432000 4194304 4785740 140734030836864 18446744073709551615 4312749 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1213/statm: 4190 1528 340 145 0 1235 0
[pid=1214] ppid=1211 vsize=455824 CPUtime=12.69 cores=2
/proc/1214/stat : 1214 (TNM) R 1211 1211 1020 0 -1 4202496 329 0 0 0 1269 0 0 0 25 0 1 0 527701077 466763776 226 33554432000 134512640 134534564 4293058224 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1214/statm: 113956 226 95 6 0 112622 0
[pid=1215] ppid=1211 vsize=7924 CPUtime=12.69 cores=3
/proc/1215/stat : 1215 (march_hi) R 1211 1211 1020 0 -1 4202496 617 0 0 0 1269 0 0 0 25 0 1 0 527701077 8114176 508 33554432000 4194304 4331988 140734953692768 18446744073709551615 4228896 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1215/statm: 1981 508 172 34 0 423 0
[pid=1216] ppid=1211 vsize=131460 CPUtime=50.67 cores=4-7
/proc/1216/stat : 1216 (plingeling) S 1211 1211 1020 0 -1 4202496 14496 1246 0 0 5065 2 0 0 18 0 5 0 527701077 134615040 4979 33554432000 4194304 4356188 140736818030384 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/1216/statm: 32865 4979 164 40 0 31409 0
[pid=1216/tid=1223] ppid=1211 vsize=131460 CPUtime=12.68 cores=4-7
/proc/1216/task/1223/stat : 1223 (plingeling) R 1211 1211 1020 0 -1 4202560 3390 1246 0 0 1268 0 0 0 25 0 5 0 527701078 134615040 4979 33554432000 4194304 4356188 140736818030384 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1216/tid=1224] ppid=1211 vsize=131460 CPUtime=12.6 cores=4-7
/proc/1216/task/1224/stat : 1224 (plingeling) R 1211 1211 1020 0 -1 4202560 3411 1246 0 0 1260 0 0 0 25 0 5 0 527701078 134615040 4979 33554432000 4194304 4356188 140736818030384 18446744073709551615 4234260 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1216/tid=1225] ppid=1211 vsize=131460 CPUtime=12.68 cores=4-7
/proc/1216/task/1225/stat : 1225 (plingeling) R 1211 1211 1020 0 -1 4202560 3736 1246 0 0 1268 0 0 0 25 0 5 0 527701078 134615040 4979 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1216/tid=1226] ppid=1211 vsize=131460 CPUtime=12.68 cores=4-7
/proc/1216/task/1226/stat : 1226 (plingeling) R 1211 1211 1020 0 -1 4202560 3458 1246 0 0 1268 0 0 0 25 0 5 0 527701078 134615040 4979 33554432000 4194304 4356188 140736818030384 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.43
Current children cumulated vsize (KiB) 1609128

[startup+25.5006 s]
/proc/loadavg: 7.74 7.95 7.97 9/180 1226
/proc/meminfo: memFree=30044420/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
[pid=1212] ppid=1211 vsize=979096 CPUtime=25.48 cores=0
/proc/1212/stat : 1212 (cryptominisat) R 1211 1211 1020 0 -1 4202496 14439 0 0 0 2546 2 0 0 25 0 1 0 527701077 1002594304 3669 33554432000 4194304 4587354 140733534646624 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=1216/tid=1223] ppid=1211 vsize=172148 CPUtime=153.48 cores=4-7
/proc/1216/task/1223/stat : 1223 (plingeling) R 1211 1211 1020 0 -1 4202560 27425 1246 0 0 15343 5 0 0 25 0 5 0 527701078 176279552 15151 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1216/tid=1224] ppid=1211 vsize=172148 CPUtime=152.66 cores=4-7
/proc/1216/task/1224/stat : 1224 (plingeling) R 1211 1211 1020 0 -1 4202560 26837 1246 0 0 15262 4 0 0 25 0 5 0 527701078 176279552 15151 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331111 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1216/tid=1225] ppid=1211 vsize=172148 CPUtime=153.49 cores=4-7
/proc/1216/task/1225/stat : 1225 (plingeling) R 1211 1211 1020 0 -1 4202560 27225 1246 0 0 15344 5 0 0 25 0 5 0 527701078 176279552 15151 33554432000 4194304 4356188 140736818030384 18446744073709551615 4332125 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1216/tid=1226] ppid=1211 vsize=172148 CPUtime=153.46 cores=4-7
/proc/1216/task/1226/stat : 1226 (plingeling) R 1211 1211 1020 0 -1 4202560 26852 1246 0 0 15340 6 0 0 25 0 5 0 527701078 176279552 15151 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1227.1
Current children cumulated vsize (KiB) 1682068

[startup+155.107 s]
/proc/loadavg: 8.05 7.99 7.98 9/180 1230
/proc/meminfo: memFree=29975600/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0.01 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 1 0 0 15 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
[pid=1212] ppid=1211 vsize=994240 CPUtime=155.1 cores=0
/proc/1212/stat : 1212 (cryptominisat) R 1211 1211 1020 0 -1 4202496 46992 0 0 0 15498 12 0 0 25 0 1 0 527701077 1018101760 9115 33554432000 4194304 4587354 140733534646624 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1212/statm: 248560 9115 337 96 0 245122 0
[pid=1213] ppid=1211 vsize=25076 CPUtime=155.09 cores=1
/proc/1213/stat : 1213 (clasp) R 1211 1211 1020 0 -1 4202496 3613 0 0 0 15509 0 0 0 25 0 1 0 527701077 25677824 3501 33554432000 4194304 4785740 140734030836864 18446744073709551615 4286964 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1213/statm: 6269 3501 341 145 0 3314 0
[pid=1214] ppid=1211 vsize=455824 CPUtime=155.1 cores=2
/proc/1214/stat : 1214 (TNM) R 1211 1211 1020 0 -1 4202496 329 0 0 0 15510 0 0 0 25 0 1 0 527701077 466763776 226 33554432000 134512640 134534564 4293058224 18446744073709551615 134529758 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1214/statm: 113956 226 95 6 0 112622 0
[pid=1215] ppid=1211 vsize=16504 CPUtime=155.1 cores=3
/proc/1215/stat : 1215 (march_hi) R 1211 1211 1020 0 -1 4202496 2201 0 0 0 15509 1 0 0 25 0 1 0 527701077 16900096 2092 33554432000 4194304 4331988 140734953692768 18446744073709551615 4240488 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1215/statm: 4126 2092 173 34 0 2568 0
[pid=1216] ppid=1211 vsize=172660 CPUtime=619.52 cores=4-7
/proc/1216/stat : 1216 (plingeling) S 1211 1211 1020 0 -1 4202496 109672 1246 0 0 61931 21 0 0 18 0 5 0 527701077 176803840 15279 33554432000 4194304 4356188 140736818030384 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/1216/statm: 43165 15279 164 40 0 41709 0
[pid=1216/tid=1223] ppid=1211 vsize=172660 CPUtime=155.09 cores=4-7
/proc/1216/task/1223/stat : 1223 (plingeling) R 1211 1211 1020 0 -1 4202560 27425 1246 0 0 15504 5 0 0 25 0 5 0 527701078 176803840 15279 33554432000 4194304 4356188 140736818030384 18446744073709551615 4281760 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1216/tid=1224] ppid=1211 vsize=172660 CPUtime=154.25 cores=4-7
/proc/1216/task/1224/stat : 1224 (plingeling) R 1211 1211 1020 0 -1 4202560 27157 1246 0 0 15421 4 0 0 25 0 5 0 527701078 176803840 15279 33554432000 4194304 4356188 140736818030384 18446744073709551615 4233969 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1216/tid=1225] ppid=1211 vsize=172660 CPUtime=155.09 cores=4-7
/proc/1216/task/1225/stat : 1225 (plingeling) R 1211 1211 1020 0 -1 4202560 27545 1246 0 0 15504 5 0 0 25 0 5 0 527701078 176803840 15279 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1216/tid=1226] ppid=1211 vsize=172660 CPUtime=155.06 cores=4-7
/proc/1216/task/1226/stat : 1226 (plingeling) R 1211 1211 1020 0 -1 4202560 27044 1246 0 0 15500 6 0 0 25 0 5 0 527701078 176803840 15279 33554432000 4194304 4356188 140736818030384 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1239.92
Current children cumulated vsize (KiB) 1682628

[startup+155.901 s]
/proc/loadavg: 8.05 7.99 7.98 9/180 1230
/proc/meminfo: memFree=29975600/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0.01 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 1 0 0 15 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
[pid=1212] ppid=1211 vsize=994240 CPUtime=155.89 cores=0
/proc/1212/stat : 1212 (cryptominisat) R 1211 1211 1020 0 -1 4202496 47119 0 0 0 15577 12 0 0 25 0 1 0 527701077 1018101760 9237 33554432000 4194304 4587354 140733534646624 18446744073709551615 4238944 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1212/statm: 248560 9237 337 96 0 245122 0
[pid=1213] ppid=1211 vsize=25232 CPUtime=155.89 cores=1
/proc/1213/stat : 1213 (clasp) R 1211 1211 1020 0 -1 4202496 3631 0 0 0 15589 0 0 0 25 0 1 0 527701077 25837568 3519 33554432000 4194304 4785740 140734030836864 18446744073709551615 4278070 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1213/statm: 6308 3519 341 145 0 3353 0
[pid=1214] ppid=1211 vsize=455824 CPUtime=155.89 cores=2
/proc/1214/stat : 1214 (TNM) R 1211 1211 1020 0 -1 4202496 329 0 0 0 15589 0 0 0 25 0 1 0 527701077 466763776 226 33554432000 134512640 134534564 4293058224 18446744073709551615 134530407 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1214/statm: 113956 226 95 6 0 112622 0
[pid=1215] ppid=1211 vsize=16504 CPUtime=155.89 cores=3
/proc/1215/stat : 1215 (march_hi) R 1211 1211 1020 0 -1 4202496 2216 0 0 0 15588 1 0 0 25 0 1 0 527701077 16900096 2107 33554432000 4194304 4331988 140734953692768 18446744073709551615 4292195 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1215/statm: 4126 2107 173 34 0 2568 0
[pid=1216] ppid=1211 vsize=169844 CPUtime=622.7 cores=4-7
/proc/1216/stat : 1216 (plingeling) S 1211 1211 1020 0 -1 4202496 109672 1246 0 0 62249 21 0 0 18 0 5 0 527701077 173920256 14575 33554432000 4194304 4356188 140736818030384 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/1216/statm: 42461 14575 164 40 0 41005 0
[pid=1216/tid=1223] ppid=1211 vsize=169844 CPUtime=155.88 cores=4-7
/proc/1216/task/1223/stat : 1223 (plingeling) R 1211 1211 1020 0 -1 4202560 27425 1246 0 0 15583 5 0 0 25 0 5 0 527701078 173920256 14575 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1216/tid=1224] ppid=1211 vsize=169844 CPUtime=155.04 cores=4-7
/proc/1216/task/1224/stat : 1224 (plingeling) R 1211 1211 1020 0 -1 4202560 27157 1246 0 0 15500 4 0 0 25 0 5 0 527701078 173920256 14575 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1216/tid=1225] ppid=1211 vsize=169844 CPUtime=155.89 cores=4-7
/proc/1216/task/1225/stat : 1225 (plingeling) R 1211 1211 1020 0 -1 4202560 27545 1246 0 0 15584 5 0 0 25 0 5 0 527701078 173920256 14575 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1216/tid=1226] ppid=1211 vsize=169844 CPUtime=155.85 cores=4-7
/proc/1216/task/1226/stat : 1226 (plingeling) R 1211 1211 1020 0 -1 4202560 27044 1246 0 0 15579 6 0 0 25 0 5 0 527701078 173920256 14575 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1246.27
Current children cumulated vsize (KiB) 1679968

[startup+156.301 s]
/proc/loadavg: 8.04 7.99 7.98 9/180 1230
/proc/meminfo: memFree=29977088/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0.01 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 1 0 0 15 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
[pid=1212] ppid=1211 vsize=994240 CPUtime=156.29 cores=0
/proc/1212/stat : 1212 (cryptominisat) R 1211 1211 1020 0 -1 4202496 47172 0 0 0 15617 12 0 0 25 0 1 0 527701077 1018101760 9288 33554432000 4194304 4587354 140733534646624 18446744073709551615 239476391417 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1212/statm: 248560 9288 337 96 0 245122 0
[pid=1213] ppid=1211 vsize=25232 CPUtime=156.29 cores=1
/proc/1213/stat : 1213 (clasp) R 1211 1211 1020 0 -1 4202496 3631 0 0 0 15629 0 0 0 25 0 1 0 527701077 25837568 3519 33554432000 4194304 4785740 140734030836864 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1213/statm: 6308 3519 341 145 0 3353 0
[pid=1214] ppid=1211 vsize=455824 CPUtime=156.29 cores=2
/proc/1214/stat : 1214 (TNM) R 1211 1211 1020 0 -1 4202496 329 0 0 0 15629 0 0 0 25 0 1 0 527701077 466763776 226 33554432000 134512640 134534564 4293058224 18446744073709551615 134530571 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1214/statm: 113956 226 95 6 0 112622 0
[pid=1215] ppid=1211 vsize=16504 CPUtime=156.29 cores=3
/proc/1215/stat : 1215 (march_hi) R 1211 1211 1020 0 -1 4202496 2223 0 0 0 15628 1 0 0 25 0 1 0 527701077 16900096 2114 33554432000 4194304 4331988 140734953692768 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1215/statm: 4126 2114 173 34 0 2568 0
[pid=1216] ppid=1211 vsize=169844 CPUtime=624.29 cores=4-7
/proc/1216/stat : 1216 (plingeling) S 1211 1211 1020 0 -1 4202496 109672 1246 0 0 62408 21 0 0 18 0 5 0 527701077 173920256 14575 33554432000 4194304 4356188 140736818030384 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/1216/statm: 42461 14575 164 40 0 41005 0
[pid=1216/tid=1223] ppid=1211 vsize=169844 CPUtime=156.28 cores=4-7
/proc/1216/task/1223/stat : 1223 (plingeling) R 1211 1211 1020 0 -1 4202560 27425 1246 0 0 15623 5 0 0 25 0 5 0 527701078 173920256 14575 33554432000 4194304 4356188 140736818030384 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1216/tid=1224] ppid=1211 vsize=169844 CPUtime=155.44 cores=4-7
/proc/1216/task/1224/stat : 1224 (plingeling) R 1211 1211 1020 0 -1 4202560 27157 1246 0 0 15540 4 0 0 25 0 5 0 527701078 173920256 14575 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1216/tid=1225] ppid=1211 vsize=169844 CPUtime=156.29 cores=4-7
/proc/1216/task/1225/stat : 1225 (plingeling) R 1211 1211 1020 0 -1 4202560 27545 1246 0 0 15624 5 0 0 25 0 5 0 527701078 173920256 14575 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331992 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1216/tid=1226] ppid=1211 vsize=169844 CPUtime=156.25 cores=4-7
/proc/1216/task/1226/stat : 1226 (plingeling) R 1211 1211 1020 0 -1 4202560 27044 1246 0 0 15619 6 0 0 25 0 5 0 527701078 173920256 14575 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1249.46
Current children cumulated vsize (KiB) 1679968

[startup+156.501 s]
/proc/loadavg: 8.04 7.99 7.98 9/180 1230
/proc/meminfo: memFree=29977088/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0.01 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 1 0 0 15 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
[pid=1212] ppid=1211 vsize=994240 CPUtime=156.49 cores=0
/proc/1212/stat : 1212 (cryptominisat) R 1211 1211 1020 0 -1 4202496 47196 0 0 0 15637 12 0 0 25 0 1 0 527701077 1018101760 9312 33554432000 4194304 4587354 140733534646624 18446744073709551615 4238739 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1212/statm: 248560 9312 337 96 0 245122 0
[pid=1213] ppid=1211 vsize=25232 CPUtime=156.49 cores=1
/proc/1213/stat : 1213 (clasp) R 1211 1211 1020 0 -1 4202496 3631 0 0 0 15649 0 0 0 25 0 1 0 527701077 25837568 3519 33554432000 4194304 4785740 140734030836864 18446744073709551615 4550422 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1213/statm: 6308 3519 341 145 0 3353 0
[pid=1214] ppid=1211 vsize=455824 CPUtime=156.49 cores=2
/proc/1214/stat : 1214 (TNM) R 1211 1211 1020 0 -1 4202496 329 0 0 0 15649 0 0 0 25 0 1 0 527701077 466763776 226 33554432000 134512640 134534564 4293058224 18446744073709551615 134528906 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1214/statm: 113956 226 95 6 0 112622 0
[pid=1215] ppid=1211 vsize=16504 CPUtime=156.49 cores=3
/proc/1215/stat : 1215 (march_hi) R 1211 1211 1020 0 -1 4202496 2227 0 0 0 15648 1 0 0 25 0 1 0 527701077 16900096 2118 33554432000 4194304 4331988 140734953692768 18446744073709551615 4226448 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1215/statm: 4126 2118 173 34 0 2568 0
[pid=1216] ppid=1211 vsize=170612 CPUtime=625.09 cores=4-7
/proc/1216/stat : 1216 (plingeling) S 1211 1211 1020 0 -1 4202496 109864 1246 0 0 62488 21 0 0 18 0 5 0 527701077 174706688 14767 33554432000 4194304 4356188 140736818030384 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/1216/statm: 42653 14767 164 40 0 41197 0
[pid=1216/tid=1223] ppid=1211 vsize=170612 CPUtime=156.48 cores=4-7
/proc/1216/task/1223/stat : 1223 (plingeling) R 1211 1211 1020 0 -1 4202560 27489 1246 0 0 15643 5 0 0 25 0 5 0 527701078 174706688 14767 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331168 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1216/tid=1224] ppid=1211 vsize=170612 CPUtime=155.64 cores=4-7
/proc/1216/task/1224/stat : 1224 (plingeling) R 1211 1211 1020 0 -1 4202560 27285 1246 0 0 15560 4 0 0 25 0 5 0 527701078 174706688 14767 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331971 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1216/tid=1225] ppid=1211 vsize=170612 CPUtime=156.49 cores=4-7
/proc/1216/task/1225/stat : 1225 (plingeling) R 1211 1211 1020 0 -1 4202560 27545 1246 0 0 15644 5 0 0 25 0 5 0 527701078 174706688 14767 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331984 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1216/tid=1226] ppid=1211 vsize=170612 CPUtime=156.45 cores=4-7
/proc/1216/task/1226/stat : 1226 (plingeling) R 1211 1211 1020 0 -1 4202560 27044 1246 0 0 15639 6 0 0 25 0 5 0 527701078 174706688 14767 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331337 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1251.06
Current children cumulated vsize (KiB) 1680736

[startup+156.601 s]
/proc/loadavg: 8.04 7.99 7.98 9/180 1230
/proc/meminfo: memFree=29977088/32950928 swapFree=67086612/67111528
[pid=1211] ppid=1209 vsize=18324 CPUtime=0.01 cores=0-7
/proc/1211/stat : 1211 (ppfolio) S 1209 1211 1020 0 -1 4202496 518 0 0 0 0 1 0 0 15 0 1 0 527701077 18763776 389 33554432000 4194304 4287625 140735570529392 18446744073709551615 239476715023 0 0 4096 65536 1478614582674063359 0 0 17 4 0 0 0
/proc/1211/statm: 4581 389 341 23 0 91 0
[pid=1212] ppid=1211 vsize=994240 CPUtime=156.59 cores=0
/proc/1212/stat : 1212 (cryptominisat) R 1211 1211 1020 0 -1 4202496 47209 0 0 0 15647 12 0 0 25 0 1 0 527701077 1018101760 9325 33554432000 4194304 4587354 140733534646624 18446744073709551615 4238947 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1212/statm: 248560 9325 337 96 0 245122 0
[pid=1213] ppid=1211 vsize=25232 CPUtime=156.59 cores=1
/proc/1213/stat : 1213 (clasp) R 1211 1211 1020 0 -1 4202496 3631 0 0 0 15659 0 0 0 25 0 1 0 527701077 25837568 3519 33554432000 4194304 4785740 140734030836864 18446744073709551615 4278093 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1213/statm: 6308 3519 341 145 0 3353 0
[pid=1214] ppid=1211 vsize=455824 CPUtime=156.59 cores=2
/proc/1214/stat : 1214 (TNM) R 1211 1211 1020 0 -1 4202496 329 0 0 0 15659 0 0 0 25 0 1 0 527701077 466763776 226 33554432000 134512640 134534564 4293058224 18446744073709551615 134529031 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1214/statm: 113956 226 95 6 0 112622 0
[pid=1215] ppid=1211 vsize=16504 CPUtime=156.59 cores=3
/proc/1215/stat : 1215 (march_hi) R 1211 1211 1020 0 -1 4202496 2228 0 0 0 15658 1 0 0 25 0 1 0 527701077 16900096 2119 33554432000 4194304 4331988 140734953692768 18446744073709551615 239476694912 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1215/statm: 4126 2119 173 34 0 2568 0
[pid=1216] ppid=1211 vsize=170868 CPUtime=625.49 cores=4-7
/proc/1216/stat : 1216 (plingeling) S 1211 1211 1020 0 -1 4202496 109928 1246 0 0 62528 21 0 0 18 0 5 0 527701077 174968832 14831 33554432000 4194304 4356188 140736818030384 18446744073709551615 239488497637 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/1216/statm: 42717 14831 164 40 0 41261 0
[pid=1216/tid=1223] ppid=1211 vsize=170868 CPUtime=156.58 cores=4-7
/proc/1216/task/1223/stat : 1223 (plingeling) R 1211 1211 1020 0 -1 4202560 27489 1246 0 0 15653 5 0 0 25 0 5 0 527701078 174968832 14831 33554432000 4194304 4356188 140736818030384 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1216/tid=1224] ppid=1211 vsize=170868 CPUtime=155.74 cores=4-7
/proc/1216/task/1224/stat : 1224 (plingeling) R 1211 1211 1020 0 -1 4202560 27349 1246 0 0 15570 4 0 0 25 0 5 0 527701078 174968832 14831 33554432000 4194304 4356188 140736818030384 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=1216/tid=1225] ppid=1211 vsize=170868 CPUtime=156.59 cores=4-7
/proc/1216/task/1225/stat : 1225 (plingeling) R 1211 1211 1020 0 -1 4202560 27545 1246 0 0 15654 5 0 0 25 0 5 0 527701078 174968832 14831 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1216/tid=1226] ppid=1211 vsize=170868 CPUtime=156.55 cores=4-7
/proc/1216/task/1226/stat : 1226 (plingeling) R 1211 1211 1020 0 -1 4202560 27044 1246 0 0 15649 6 0 0 25 0 5 0 527701078 174968832 14831 33554432000 4194304 4356188 140736818030384 18446744073709551615 4331792 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1251.86
Current children cumulated vsize (KiB) 1680992

Child status: 0
Real time (s): 156.607
CPU time (s): 1251.96
CPU user time (s): 1251.56
CPU system time (s): 0.395939
CPU usage (%): 799.429
Max. virtual memory (cumulated for all children) (KiB): 1694156

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1251.56
system time used= 0.395939
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 165109
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1457
involuntary context switches= 6288

runsolver used 0.247962 second user time and 0.578911 second system time

The end

Launcher Data 

Begin job on node148 at 2011-04-30 12:57:20
IDJOB=3221199
IDBENCH=82883
IDSOLVER=1638
FILE ID=node148/3221199-1304161040
RUNJOBID= node148-1304161030-1034
PBS_JOBID= 13170928
Free space on /tmp= 72964 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v450-c1917-S1406921020-013.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3221199-1304161040/watcher-3221199-1304161040 -o /tmp/evaluation-result-3221199-1304161040/solver-3221199-1304161040 -C 40000 -W 5000 -M 31000  ppfolio HOME/instance-3221199-1304161040.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 9869c5a4d8c5bed5ea530735320738db
RANDOM SEED=191987116

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30088680 kB
Buffers:        764728 kB
Cached:        1681276 kB
SwapCached:       3696 kB
Active:         158576 kB
Inactive:      2329088 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30088680 kB
SwapTotal:    67111528 kB
SwapFree:     67086612 kB
Dirty:           10624 kB
Writeback:           0 kB
AnonPages:       40376 kB
Mapped:          13756 kB
Slab:           305780 kB
PageTables:       4884 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   186556 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72952 MiB
End job on node148 at 2011-04-30 12:59:57