Trace number 3310179

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 2175.88 275.352

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_L150_coli.sat.cnf
MD5SUMba6884aaa746378e56c38fd8b3d0255e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark44.7592
Satisfiable
(Un)Satisfiability was proved
Number of variables486992
Number of clauses2456708
Sum of the clauses size7147094
Maximum clause length11
Minimum clause length1
Number of clauses of size 145577
Number of clauses of size 2599727
Number of clauses of size 31431108
Number of clauses of size 4295435
Number of clauses of size 584412
Number of clauses of size over 5449

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
2175.68/275.30	s UNSATISFIABLE
2175.68/275.35	solver [5] plingeling 276-6264d55-100731 answered
2175.68/275.35	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310179-1304003395/watcher-3310179-1304003395 -o /tmp/evaluation-result-3310179-1304003395/solver-3310179-1304003395 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310179-1304003395.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.54 7.96 7.97 1/168 4429
/proc/meminfo: memFree=23286972/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 517 0 0 0 0 0 0 0 23 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 2826088480824 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0

[startup+0.064018 s]
/proc/loadavg: 7.54 7.96 7.97 1/168 4429
/proc/meminfo: memFree=23286972/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 2826088513535 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.101009 s]
/proc/loadavg: 7.54 7.96 7.97 1/168 4429
/proc/meminfo: memFree=23286972/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 2826088513535 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300972 s]
/proc/loadavg: 7.54 7.96 7.97 1/168 4429
/proc/meminfo: memFree=23286972/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 2826088513535 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700906 s]
/proc/loadavg: 7.54 7.96 7.97 1/168 4429
/proc/meminfo: memFree=23286972/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 2826088513535 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50077 s]
/proc/loadavg: 7.54 7.96 7.97 6/174 4441
/proc/meminfo: memFree=22475220/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 18 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 16150708849949540351 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
[pid=4430] ppid=4429 vsize=262112 CPUtime=1.48 cores=0
/proc/4430/stat : 4430 (cryptominisat) R 4429 4429 4279 0 -1 4202496 58115 0 0 0 138 10 0 0 20 0 1 0 511938342 268402688 55942 33554432000 4194304 4587354 140734375109824 18446744073709551615 4238752 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4430/statm: 65528 55942 306 96 0 62090 0
[pid=4431] ppid=4429 vsize=271396 CPUtime=1.49 cores=1
/proc/4431/stat : 4431 (clasp) R 4429 4429 4279 0 -1 4202496 77260 0 0 0 138 11 0 0 20 0 1 0 511938342 277909504 63582 33554432000 4194304 4785740 140733958103936 18446744073709551615 4495638 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4431/statm: 67849 63582 318 145 0 64894 0
[pid=4432] ppid=4429 vsize=489884 CPUtime=1.49 cores=2
/proc/4432/stat : 4432 (TNM) R 4429 4429 4279 0 -1 4202496 14889 0 0 0 147 2 0 0 20 0 1 0 511938342 501641216 14787 33554432000 134512640 134534564 4291500656 18446744073709551615 8971772 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4432/statm: 122471 14787 90 6 0 121137 0
[pid=4433] ppid=4429 vsize=156356 CPUtime=1.49 cores=3
/proc/4433/stat : 4433 (march_hi) R 4429 4429 4279 0 -1 4194304 37084 0 0 0 143 6 0 0 20 0 1 0 511938342 160108544 36979 33554432000 4194304 4331988 140737042362272 18446744073709551615 242970211013 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4433/statm: 39089 36979 113 34 0 37531 0
[pid=4434] ppid=4429 vsize=300144 CPUtime=1.49 cores=4-7
/proc/4434/stat : 4434 (plingeling) R 4429 4429 4279 0 -1 4202496 73994 1248 0 0 141 8 0 0 21 0 1 0 511938342 307347456 73698 33554432000 4194304 4356188 140733238004688 18446744073709551615 242970550016 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/4434/statm: 75036 73698 132 40 0 73580 0
Current children cumulated CPU time (s) 7.44
Current children cumulated vsize (KiB) 1498216

[startup+3.10049 s]
/proc/loadavg: 7.54 7.96 7.97 6/174 4441
/proc/meminfo: memFree=21917592/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 16150708849949540351 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
[pid=4430] ppid=4429 vsize=434524 CPUtime=3.08 cores=0
/proc/4430/stat : 4430 (cryptominisat) R 4429 4429 4279 0 -1 4202496 100384 0 0 0 292 16 0 0 25 0 1 0 511938342 444952576 98211 33554432000 4194304 4587354 140734375109824 18446744073709551615 4357642 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4430/statm: 108631 98211 311 96 0 105193 0
[pid=4431] ppid=4429 vsize=280060 CPUtime=3.08 cores=1
/proc/4431/stat : 4431 (clasp) R 4429 4429 4279 0 -1 4202496 79156 0 0 0 297 11 0 0 25 0 1 0 511938342 286781440 65478 33554432000 4194304 4785740 140733958103936 18446744073709551615 4484230 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4431/statm: 70015 65478 319 145 0 67060 0
[pid=4432] ppid=4429 vsize=617668 CPUtime=3.09 cores=2
/proc/4432/stat : 4432 (TNM) R 4429 4429 4279 0 -1 4202496 53671 0 0 0 302 7 0 0 25 0 1 0 511938342 632492032 53568 33554432000 134512640 134534564 4291500656 18446744073709551615 134524464 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4432/statm: 154417 53568 91 6 0 153083 0
[pid=4433] ppid=4429 vsize=411248 CPUtime=3.08 cores=3
/proc/4433/stat : 4433 (march_hi) R 4429 4429 4279 0 -1 4194304 98531 0 0 0 294 14 0 0 25 0 1 0 511938342 421117952 76455 33554432000 4194304 4331988 140737042362272 18446744073709551615 4252200 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4433/statm: 102812 76455 185 34 0 101254 0
[pid=4434] ppid=4429 vsize=431216 CPUtime=3.05 cores=4-7
/proc/4434/stat : 4434 (plingeling) R 4429 4429 4279 0 -1 4202496 106762 1248 0 0 291 14 0 0 25 0 1 0 511938342 441565184 106466 33554432000 4194304 4356188 140733238004688 18446744073709551615 242970550016 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/4434/statm: 107804 106466 132 40 0 106348 0
Current children cumulated CPU time (s) 15.38
Current children cumulated vsize (KiB) 2193040

[startup+6.30091 s]
/proc/loadavg: 7.73 8.00 7.98 11/178 4445
/proc/meminfo: memFree=21738636/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 16150708849949540351 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
[pid=4430] ppid=4429 vsize=434524 CPUtime=6.28 cores=0
/proc/4430/stat : 4430 (cryptominisat) R 4429 4429 4279 0 -1 4202496 100384 0 0 0 612 16 0 0 25 0 1 0 511938342 444952576 98211 33554432000 4194304 4587354 140734375109824 18446744073709551615 4357662 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4430/statm: 108631 98211 311 96 0 105193 0
[pid=4431] ppid=4429 vsize=266172 CPUtime=6.29 cores=1
/proc/4431/stat : 4431 (clasp) R 4429 4429 4279 0 -1 4202496 85217 0 0 0 616 13 0 0 25 0 1 0 511938342 272560128 62225 33554432000 4194304 4785740 140733958103936 18446744073709551615 4538824 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4431/statm: 66543 62225 333 145 0 63588 0
[pid=4432] ppid=4429 vsize=617668 CPUtime=6.29 cores=2
/proc/4432/stat : 4432 (TNM) R 4429 4429 4279 0 -1 4202496 53674 0 0 0 622 7 0 0 25 0 1 0 511938342 632492032 53571 33554432000 134512640 134534564 4291500656 18446744073709551615 134524491 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4432/statm: 154417 53571 91 6 0 153083 0
[pid=4433] ppid=4429 vsize=324684 CPUtime=6.29 cores=3
/proc/4433/stat : 4433 (march_hi) R 4429 4429 4279 0 -1 4194304 170540 0 0 0 604 25 0 0 25 0 1 0 511938342 332476416 56028 33554432000 4194304 4331988 140737042362272 18446744073709551615 242970210843 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4433/statm: 81171 56028 129 34 0 79613 0
[pid=4434] ppid=4429 vsize=549336 CPUtime=12.81 cores=4-7
/proc/4434/stat : 4434 (plingeling) S 4429 4429 4279 0 -1 4202496 240722 1248 0 0 1195 86 0 0 18 0 5 0 511938342 562520064 107889 33554432000 4194304 4356188 140733238004688 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4434/statm: 137334 107889 156 40 0 135878 0
[pid=4434/tid=4442] ppid=4429 vsize=549336 CPUtime=1.91 cores=4-7
/proc/4434/task/4442/stat : 4442 (plingeling) R 4429 4429 4279 0 -1 4202560 34967 1248 0 0 176 15 0 0 25 0 5 0 511938661 562520064 107889 33554432000 4194304 4356188 140733238004688 18446744073709551615 242970244164 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4434/tid=4443] ppid=4429 vsize=549336 CPUtime=2.61 cores=4-7
/proc/4434/task/4443/stat : 4443 (plingeling) R 4429 4429 4279 0 -1 4202560 37946 1248 0 0 247 14 0 0 25 0 5 0 511938661 562520064 107889 33554432000 4194304 4356188 140733238004688 18446744073709551615 4322248 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4434/tid=4444] ppid=4429 vsize=549336 CPUtime=3.06 cores=4-7
/proc/4434/task/4444/stat : 4444 (plingeling) R 4429 4429 4279 0 -1 4202560 37241 1248 0 0 286 20 0 0 25 0 5 0 511938661 562520064 107889 33554432000 4194304 4356188 140733238004688 18446744073709551615 4322016 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4434/tid=4445] ppid=4429 vsize=549336 CPUtime=2.04 cores=4-7
/proc/4434/task/4445/stat : 4445 (plingeling) R 4429 4429 4279 0 -1 4202560 23794 1248 0 0 183 21 0 0 25 0 5 0 511938661 562520064 107889 33554432000 4194304 4356188 140733238004688 18446744073709551615 4213005 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37.96
Current children cumulated vsize (KiB) 2210708

[startup+12.7008 s]
/proc/loadavg: 8.08 8.06 8.00 10/178 4445
/proc/meminfo: memFree=21737308/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 16150708849949540351 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
[pid=4430] ppid=4429 vsize=437496 CPUtime=12.68 cores=0
/proc/4430/stat : 4430 (cryptominisat) R 4429 4429 4279 0 -1 4202496 101149 0 0 0 1252 16 0 0 25 0 1 0 511938342 447995904 98976 33554432000 4194304 4587354 140734375109824 18446744073709551615 4357668 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4430/statm: 109374 98976 315 96 0 105936 0
[pid=4431] ppid=4429 vsize=266172 CPUtime=12.68 cores=1
/proc/4431/stat : 4431 (clasp) R 4429 4429 4279 0 -1 4202496 85239 0 0 0 1255 13 0 0 25 0 1 0 511938342 272560128 62247 33554432000 4194304 4785740 140733958103936 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4431/statm: 66543 62247 340 145 0 63588 0
[pid=4432] ppid=4429 vsize=617668 CPUtime=12.69 cores=2
/proc/4432/stat : 4432 (TNM) R 4429 4429 4279 0 -1 4202496 53676 0 0 0 1262 7 0 0 25 0 1 0 511938342 632492032 53573 33554432000 134512640 134534564 4291500656 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4432/statm: 154417 53573 91 6 0 153083 0
[pid=4433] ppid=4429 vsize=326576 CPUtime=12.68 cores=3
/proc/4433/stat : 4433 (march_hi) R 4429 4429 4279 0 -1 4202496 354612 0 0 0 1216 52 0 0 25 0 1 0 511938342 334413824 56490 33554432000 4194304 4331988 140737042362272 18446744073709551615 4251920 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4433/statm: 81644 56490 150 34 0 80086 0
[pid=4434] ppid=4429 vsize=603928 CPUtime=32.4 cores=4-7
/proc/4434/stat : 4434 (plingeling) S 4429 4429 4279 0 -1 4202496 255990 1248 0 0 3108 132 0 0 18 0 5 0 511938342 618422272 123074 33554432000 4194304 4356188 140733238004688 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4434/statm: 150982 123074 163 40 0 149526 0
[pid=4434/tid=4442] ppid=4429 vsize=603928 CPUtime=4.76 cores=4-7
/proc/4434/task/4442/stat : 4442 (plingeling) R 4429 4429 4279 0 -1 4202560 39672 1248 0 0 426 50 0 0 25 0 5 0 511938661 618422272 123074 33554432000 4194304 4356188 140733238004688 18446744073709551615 4214464 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4434/tid=4443] ppid=4429 vsize=603928 CPUtime=6.99 cores=4-7
/proc/4434/task/4443/stat : 4443 (plingeling) R 4429 4429 4279 0 -1 4202560 42048 1248 0 0 678 21 0 0 25 0 5 0 511938661 618422272 123074 33554432000 4194304 4356188 140733238004688 18446744073709551615 4301704 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4434/tid=4444] ppid=4429 vsize=603928 CPUtime=9.42 cores=4-7
/proc/4434/task/4444/stat : 4444 (plingeling) R 4429 4429 4279 0 -1 4202560 41347 1248 0 0 919 23 0 0 25 0 5 0 511938661 618422272 123074 33554432000 4194304 4356188 140733238004688 18446744073709551615 4217337 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4434/tid=4445] ppid=4429 vsize=603928 CPUtime=8.04 cores=4-7
/proc/4434/task/4445/stat : 4445 (plingeling) R 4429 4429 4279 0 -1 4202560 26149 1248 0 0 782 22 0 0 25 0 5 0 511938661 618422272 123074 33554432000 4194304 4356188 140733238004688 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 83.13
Current children cumulated vsize (KiB) 2270164

[startup+25.5006 s]
/proc/loadavg: 8.48 8.16 8.03 9/178 4445
/proc/meminfo: memFree=21607496/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 16150708849949540351 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
[pid=4430] ppid=4429 vsize=474116 CPUtime=25.48 cores=0
/proc/4430/stat : 4430 (cryptominisat) R 4429 4429 4279 0 -1 4202496 160261 0 0 0 2522 26 0 0 25 0 1 0 511938342 485494784 101246 33554432000 4194304 4587354 140734375109824 18446744073709551615 4521996 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4430/statm: 118529 101246 333 96 0 115091 0
[pid=4431] ppid=4429 vsize=266172 CPUtime=21.09 cores=1
/proc/4431/stat : 4431 (clasp) R 4429 4429 4279 0 -1 4202496 85240 0 0 0 2059 50 0 0 25 0 1 0 511938342 272560128 62248 33554432000 4194304 4785740 140733958103936 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4431/statm: 66543 62248 340 145 0 63588 0
[pid=4432] ppid=4429 vsize=617668 CPUtime=25.48 cores=2
/proc/4432/stat : 4432 (TNM) R 4429 4429 4279 0 -1 4202496 53679 0 0 0 2541 7 0 0 25 0 1 0 511938342 632492032 53576 33554432000 134512640 134534564 4291500656 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4432/statm: 154417 53576 91 6 0 153083 0
[pid=4433] ppid=4429 vsize=443856 CPUtime=25.48 cores=3
/proc/4433/stat : 4433 (march_hi) R 4429 4429 4279 0 -1 4202496 400744 0 0 0 2489 59 0 0 25 0 1 0 511938342 454508544 83976 33554432000 4194304 4331988 140737042362272 18446744073709551615 4271154 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4433/statm: 110964 83977 151 34 0 109406 0
[pid=4434] ppid=4429 vsize=588232 CPUtime=82.67 cores=4-7
/proc/4434/stat : 4434 (plingeling) S 4429 4429 4279 0 -1 4202496 266424 1248 0 0 8133 134 0 0 18 0 5 0 511938342 602349568 119150 33554432000 4194304 4356188 140733238004688 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4434/statm: 147058 119150 163 40 0 145602 0
[pid=4434/tid=4442] ppid=4429 vsize=588232 CPUtime=17.12 cores=4-7
/proc/4434/task/4442/stat : 4442 (plingeling) R 4429 4429 4279 0 -1 4202560 39672 1248 0 0 1662 50 0 0 25 0 5 0 511938661 602349568 119150 33554432000 4194304 4356188 140733238004688 18446744073709551615 4244731 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4434/tid=4443] ppid=4429 vsize=588232 CPUtime=19.38 cores=4-7

################
# More data... #
################

/proc/4430/stat : 4430 (cryptominisat) R 4429 4429 4279 0 -1 4202496 295401 0 0 0 26818 51 0 0 25 0 1 0 511938342 1742647296 107951 33554432000 4194304 4587354 140734375109824 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4430/statm: 425451 107951 340 96 0 422013 0
[pid=4431] ppid=4429 vsize=354168 CPUtime=264.24 cores=1
/proc/4431/stat : 4431 (clasp) R 4429 4429 4279 0 -1 4202496 106555 0 0 0 26357 67 0 0 25 0 1 0 511938342 362668032 83563 33554432000 4194304 4785740 140733958103936 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4431/statm: 88542 83563 340 145 0 85587 0
[pid=4432] ppid=4429 vsize=617668 CPUtime=268.67 cores=2
/proc/4432/stat : 4432 (TNM) R 4429 4429 4279 0 -1 4202496 53697 0 0 0 26857 10 0 0 25 0 1 0 511938342 632492032 53594 33554432000 134512640 134534564 4291500656 18446744073709551615 134524491 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4432/statm: 154417 53594 91 6 0 153083 0
[pid=4433] ppid=4429 vsize=1008600 CPUtime=268.66 cores=3
/proc/4433/stat : 4433 (march_hi) R 4429 4429 4279 0 -1 4202496 535286 0 0 0 26754 112 0 0 25 0 1 0 511938342 1032806400 218518 33554432000 4194304 4331988 140737042362272 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4433/statm: 252150 218518 151 34 0 250592 0
[pid=4434] ppid=4429 vsize=573028 CPUtime=1054.01 cores=4-7
/proc/4434/stat : 4434 (plingeling) S 4429 4429 4279 0 -1 4202496 295626 1248 0 0 105262 139 0 0 18 0 5 0 511938342 586780672 115350 33554432000 4194304 4356188 140733238004688 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4434/statm: 143257 115350 164 40 0 141801 0
[pid=4434/tid=4442] ppid=4429 vsize=573028 CPUtime=260.31 cores=4-7
/proc/4434/task/4442/stat : 4442 (plingeling) R 4429 4429 4279 0 -1 4202560 40918 1248 0 0 25981 50 0 0 25 0 5 0 511938661 586780672 115350 33554432000 4194304 4356188 140733238004688 18446744073709551615 4284161 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4434/tid=4443] ppid=4429 vsize=573028 CPUtime=262.51 cores=4-7
/proc/4434/task/4443/stat : 4443 (plingeling) R 4429 4429 4279 0 -1 4202560 50747 1248 0 0 26228 23 0 0 25 0 5 0 511938661 586780672 115350 33554432000 4194304 4356188 140733238004688 18446744073709551615 4210992 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4434/tid=4444] ppid=4429 vsize=573028 CPUtime=264.04 cores=4-7
/proc/4434/task/4444/stat : 4444 (plingeling) R 4429 4429 4279 0 -1 4202560 41785 1248 0 0 26380 24 0 0 25 0 5 0 511938661 586780672 115350 33554432000 4194304 4356188 140733238004688 18446744073709551615 4331371 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4434/tid=4445] ppid=4429 vsize=573028 CPUtime=263.96 cores=4-7
/proc/4434/task/4445/stat : 4445 (plingeling) R 4429 4429 4279 0 -1 4202560 55402 1248 0 0 26370 26 0 0 25 0 5 0 511938661 586780672 115350 33554432000 4194304 4356188 140733238004688 18446744073709551615 4244402 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2124.27
Current children cumulated vsize (KiB) 4273592

[startup+271.901 s]
/proc/loadavg: 8.08 8.11 8.03 10/178 4452
/proc/meminfo: memFree=20970168/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 16150708849949540351 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
[pid=4430] ppid=4429 vsize=1701804 CPUtime=271.89 cores=0
/proc/4430/stat : 4430 (cryptominisat) R 4429 4429 4279 0 -1 4202496 295595 0 0 0 27138 51 0 0 25 0 1 0 511938342 1742647296 108137 33554432000 4194304 4587354 140734375109824 18446744073709551615 4238297 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4430/statm: 425451 108137 340 96 0 422013 0
[pid=4431] ppid=4429 vsize=354644 CPUtime=267.45 cores=1
/proc/4431/stat : 4431 (clasp) R 4429 4429 4279 0 -1 4202496 106661 0 0 0 26678 67 0 0 25 0 1 0 511938342 363155456 83669 33554432000 4194304 4785740 140733958103936 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4431/statm: 88661 83669 340 145 0 85706 0
[pid=4432] ppid=4429 vsize=617668 CPUtime=271.87 cores=2
/proc/4432/stat : 4432 (TNM) R 4429 4429 4279 0 -1 4202496 53698 0 0 0 27177 10 0 0 25 0 1 0 511938342 632492032 53595 33554432000 134512640 134534564 4291500656 18446744073709551615 134524491 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4432/statm: 154417 53595 91 6 0 153083 0
[pid=4433] ppid=4429 vsize=1008732 CPUtime=271.87 cores=3
/proc/4433/stat : 4433 (march_hi) R 4429 4429 4279 0 -1 4202496 535357 0 0 0 27074 113 0 0 25 0 1 0 511938342 1032941568 218589 33554432000 4194304 4331988 140737042362272 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4433/statm: 252183 218589 151 34 0 250625 0
[pid=4434] ppid=4429 vsize=573012 CPUtime=1066.79 cores=4-7
/proc/4434/stat : 4434 (plingeling) S 4429 4429 4279 0 -1 4202496 295626 1248 0 0 106540 139 0 0 18 0 5 0 511938342 586764288 115346 33554432000 4194304 4356188 140733238004688 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4434/statm: 143253 115346 164 40 0 141797 0
[pid=4434/tid=4442] ppid=4429 vsize=573012 CPUtime=263.52 cores=4-7
/proc/4434/task/4442/stat : 4442 (plingeling) R 4429 4429 4279 0 -1 4202560 40918 1248 0 0 26302 50 0 0 25 0 5 0 511938661 586764288 115346 33554432000 4194304 4356188 140733238004688 18446744073709551615 4331039 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4434/tid=4443] ppid=4429 vsize=573012 CPUtime=265.7 cores=4-7
/proc/4434/task/4443/stat : 4443 (plingeling) R 4429 4429 4279 0 -1 4202560 50747 1248 0 0 26547 23 0 0 25 0 5 0 511938661 586764288 115346 33554432000 4194304 4356188 140733238004688 18446744073709551615 4210704 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4434/tid=4444] ppid=4429 vsize=573012 CPUtime=267.22 cores=4-7
/proc/4434/task/4444/stat : 4444 (plingeling) R 4429 4429 4279 0 -1 4202560 41785 1248 0 0 26698 24 0 0 25 0 5 0 511938661 586764288 115346 33554432000 4194304 4356188 140733238004688 18446744073709551615 4322024 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4434/tid=4445] ppid=4429 vsize=573012 CPUtime=267.16 cores=4-7
/proc/4434/task/4445/stat : 4445 (plingeling) R 4429 4429 4279 0 -1 4202560 55402 1248 0 0 26690 26 0 0 25 0 5 0 511938661 586764288 115346 33554432000 4194304 4356188 140733238004688 18446744073709551615 4210992 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2149.87
Current children cumulated vsize (KiB) 4274184

[startup+273.501 s]
/proc/loadavg: 8.08 8.11 8.03 9/178 4452
/proc/meminfo: memFree=20969672/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 16150708849949540351 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
[pid=4430] ppid=4429 vsize=1701804 CPUtime=273.48 cores=0
/proc/4430/stat : 4430 (cryptominisat) R 4429 4429 4279 0 -1 4202496 295689 0 0 0 27297 51 0 0 25 0 1 0 511938342 1742647296 108228 33554432000 4194304 4587354 140734375109824 18446744073709551615 4238224 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4430/statm: 425451 108228 340 96 0 422013 0
[pid=4431] ppid=4429 vsize=355196 CPUtime=269.05 cores=1
/proc/4431/stat : 4431 (clasp) R 4429 4429 4279 0 -1 4202496 106763 0 0 0 26838 67 0 0 25 0 1 0 511938342 363720704 83771 33554432000 4194304 4785740 140733958103936 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4431/statm: 88799 83771 340 145 0 85844 0
[pid=4432] ppid=4429 vsize=617668 CPUtime=273.47 cores=2
/proc/4432/stat : 4432 (TNM) R 4429 4429 4279 0 -1 4202496 53698 0 0 0 27336 11 0 0 25 0 1 0 511938342 632492032 53595 33554432000 134512640 134534564 4291500656 18446744073709551615 134524568 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4432/statm: 154417 53595 91 6 0 153083 0
[pid=4433] ppid=4429 vsize=1009128 CPUtime=273.47 cores=3
/proc/4433/stat : 4433 (march_hi) R 4429 4429 4279 0 -1 4202496 535487 0 0 0 27234 113 0 0 25 0 1 0 511938342 1033347072 218719 33554432000 4194304 4331988 140737042362272 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4433/statm: 252282 218719 151 34 0 250724 0
[pid=4434] ppid=4429 vsize=572988 CPUtime=1073.18 cores=4-7
/proc/4434/stat : 4434 (plingeling) S 4429 4429 4279 0 -1 4202496 295626 1248 0 0 107179 139 0 0 18 0 5 0 511938342 586739712 115340 33554432000 4194304 4356188 140733238004688 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4434/statm: 143247 115340 164 40 0 141791 0
[pid=4434/tid=4442] ppid=4429 vsize=572988 CPUtime=265.11 cores=4-7
/proc/4434/task/4442/stat : 4442 (plingeling) R 4429 4429 4279 0 -1 4202560 40918 1248 0 0 26461 50 0 0 25 0 5 0 511938661 586739712 115340 33554432000 4194304 4356188 140733238004688 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4434/tid=4443] ppid=4429 vsize=572988 CPUtime=267.3 cores=4-7
/proc/4434/task/4443/stat : 4443 (plingeling) R 4429 4429 4279 0 -1 4202560 50747 1248 0 0 26707 23 0 0 25 0 5 0 511938661 586739712 115340 33554432000 4194304 4356188 140733238004688 18446744073709551615 4237364 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4434/tid=4444] ppid=4429 vsize=572988 CPUtime=268.82 cores=4-7
/proc/4434/task/4444/stat : 4444 (plingeling) R 4429 4429 4279 0 -1 4202560 41785 1248 0 0 26858 24 0 0 25 0 5 0 511938661 586739712 115340 33554432000 4194304 4356188 140733238004688 18446744073709551615 4232896 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4434/tid=4445] ppid=4429 vsize=572988 CPUtime=268.76 cores=4-7
/proc/4434/task/4445/stat : 4445 (plingeling) R 4429 4429 4279 0 -1 4202560 55402 1248 0 0 26850 26 0 0 25 0 5 0 511938661 586739712 115340 33554432000 4194304 4356188 140733238004688 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2162.65
Current children cumulated vsize (KiB) 4275108

[startup+274.301 s]
/proc/loadavg: 8.08 8.11 8.03 9/178 4452
/proc/meminfo: memFree=20965828/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 16150708849949540351 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
[pid=4430] ppid=4429 vsize=1701804 CPUtime=274.28 cores=0
/proc/4430/stat : 4430 (cryptominisat) R 4429 4429 4279 0 -1 4202496 295725 0 0 0 27377 51 0 0 25 0 1 0 511938342 1742647296 108263 33554432000 4194304 4587354 140734375109824 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4430/statm: 425451 108263 340 96 0 422013 0
[pid=4431] ppid=4429 vsize=355196 CPUtime=269.85 cores=1
/proc/4431/stat : 4431 (clasp) R 4429 4429 4279 0 -1 4202496 106764 0 0 0 26918 67 0 0 25 0 1 0 511938342 363720704 83772 33554432000 4194304 4785740 140733958103936 18446744073709551615 4290595 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4431/statm: 88799 83772 340 145 0 85844 0
[pid=4432] ppid=4429 vsize=617668 CPUtime=274.27 cores=2
/proc/4432/stat : 4432 (TNM) R 4429 4429 4279 0 -1 4202496 53698 0 0 0 27416 11 0 0 25 0 1 0 511938342 632492032 53595 33554432000 134512640 134534564 4291500656 18446744073709551615 134524500 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4432/statm: 154417 53595 91 6 0 153083 0
[pid=4433] ppid=4429 vsize=1013088 CPUtime=274.27 cores=3
/proc/4433/stat : 4433 (march_hi) R 4429 4429 4279 0 -1 4202496 536853 0 0 0 27314 113 0 0 25 0 1 0 511938342 1037402112 220085 33554432000 4194304 4331988 140737042362272 18446744073709551615 4226647 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4433/statm: 253272 220085 151 34 0 251714 0
[pid=4434] ppid=4429 vsize=573796 CPUtime=1076.38 cores=4-7
/proc/4434/stat : 4434 (plingeling) S 4429 4429 4279 0 -1 4202496 295828 1248 0 0 107499 139 0 0 18 0 5 0 511938342 587567104 115542 33554432000 4194304 4356188 140733238004688 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4434/statm: 143449 115542 164 40 0 141993 0
[pid=4434/tid=4442] ppid=4429 vsize=573796 CPUtime=265.91 cores=4-7
/proc/4434/task/4442/stat : 4442 (plingeling) R 4429 4429 4279 0 -1 4202560 40918 1248 0 0 26541 50 0 0 25 0 5 0 511938661 587567104 115542 33554432000 4194304 4356188 140733238004688 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4434/tid=4443] ppid=4429 vsize=573796 CPUtime=268.1 cores=4-7
/proc/4434/task/4443/stat : 4443 (plingeling) R 4429 4429 4279 0 -1 4202560 50747 1248 0 0 26787 23 0 0 25 0 5 0 511938661 587567104 115542 33554432000 4194304 4356188 140733238004688 18446744073709551615 4236939 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4434/tid=4444] ppid=4429 vsize=573796 CPUtime=269.61 cores=4-7
/proc/4434/task/4444/stat : 4444 (plingeling) R 4429 4429 4279 0 -1 4202560 41987 1248 0 0 26937 24 0 0 25 0 5 0 511938661 587567104 115542 33554432000 4194304 4356188 140733238004688 18446744073709551615 4216565 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4434/tid=4445] ppid=4429 vsize=573796 CPUtime=269.56 cores=4-7
/proc/4434/task/4445/stat : 4445 (plingeling) R 4429 4429 4279 0 -1 4202560 55402 1248 0 0 26930 26 0 0 25 0 5 0 511938661 587567104 115542 33554432000 4194304 4356188 140733238004688 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2169.05
Current children cumulated vsize (KiB) 4279876

[startup+275.101 s]
/proc/loadavg: 8.07 8.10 8.03 6/175 4452
/proc/meminfo: memFree=20960272/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 16150708849949540351 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
[pid=4430] ppid=4429 vsize=1701804 CPUtime=275.08 cores=0
/proc/4430/stat : 4430 (cryptominisat) R 4429 4429 4279 0 -1 4202496 295766 0 0 0 27457 51 0 0 25 0 1 0 511938342 1742647296 108303 33554432000 4194304 4587354 140734375109824 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4430/statm: 425451 108303 340 96 0 422013 0
[pid=4431] ppid=4429 vsize=355196 CPUtime=270.64 cores=1
/proc/4431/stat : 4431 (clasp) R 4429 4429 4279 0 -1 4202496 106770 0 0 0 26997 67 0 0 25 0 1 0 511938342 363720704 83778 33554432000 4194304 4785740 140733958103936 18446744073709551615 4552553 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4431/statm: 88799 83778 340 145 0 85844 0
[pid=4432] ppid=4429 vsize=617668 CPUtime=275.07 cores=2
/proc/4432/stat : 4432 (TNM) R 4429 4429 4279 0 -1 4202496 53698 0 0 0 27496 11 0 0 25 0 1 0 511938342 632492032 53595 33554432000 134512640 134534564 4291500656 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4432/statm: 154417 53595 91 6 0 153083 0
[pid=4433] ppid=4429 vsize=1016124 CPUtime=275.07 cores=3
/proc/4433/stat : 4433 (march_hi) R 4429 4429 4279 0 -1 4202496 537871 0 0 0 27394 113 0 0 25 0 1 0 511938342 1040510976 221103 33554432000 4194304 4331988 140737042362272 18446744073709551615 242970211013 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4433/statm: 254031 221103 151 34 0 252473 0
[pid=4434] ppid=4429 vsize=573796 CPUtime=1078.82 cores=4-7
/proc/4434/stat : 4434 (plingeling) S 4429 4429 4279 0 -1 4202496 295829 1248 0 0 107743 139 0 0 17 0 2 0 511938342 587567104 115543 33554432000 4194304 4356188 140733238004688 18446744073709551615 242982352869 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/4434/statm: 143449 115543 165 40 0 141993 0
[pid=4434/tid=4444] ppid=4429 vsize=573796 CPUtime=270.41 cores=4-7
/proc/4434/task/4444/stat : 4444 (plingeling) R 4429 4429 4279 0 -1 4202560 41987 1248 0 0 27017 24 0 0 25 0 2 0 511938661 587567104 115543 33554432000 4194304 4356188 140733238004688 18446744073709551615 4208763 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2174.68
Current children cumulated vsize (KiB) 4282912

[startup+275.301 s]
/proc/loadavg: 8.07 8.10 8.03 6/175 4452
/proc/meminfo: memFree=20960272/32951132 swapFree=67111364/67111528
[pid=4429] ppid=4427 vsize=18324 CPUtime=0 cores=0-7
/proc/4429/stat : 4429 (ppfolio) S 4427 4429 4279 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 511938342 18763776 389 33554432000 4194304 4287625 140734336961120 18446744073709551615 242970570255 0 0 4096 65536 16150708849949540351 0 0 17 4 0 0 0
/proc/4429/statm: 4581 389 341 23 0 91 0
[pid=4430] ppid=4429 vsize=1701804 CPUtime=275.28 cores=0
/proc/4430/stat : 4430 (cryptominisat) R 4429 4429 4279 0 -1 4202496 295776 0 0 0 27477 51 0 0 25 0 1 0 511938342 1742647296 108313 33554432000 4194304 4587354 140734375109824 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/4430/statm: 425451 108313 340 96 0 422013 0
[pid=4431] ppid=4429 vsize=355196 CPUtime=270.84 cores=1
/proc/4431/stat : 4431 (clasp) R 4429 4429 4279 0 -1 4202496 106770 0 0 0 27017 67 0 0 25 0 1 0 511938342 363720704 83778 33554432000 4194304 4785740 140733958103936 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/4431/statm: 88799 83778 340 145 0 85844 0
[pid=4432] ppid=4429 vsize=617668 CPUtime=275.27 cores=2
/proc/4432/stat : 4432 (TNM) R 4429 4429 4279 0 -1 4202496 53698 0 0 0 27516 11 0 0 25 0 1 0 511938342 632492032 53595 33554432000 134512640 134534564 4291500656 18446744073709551615 134524536 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/4432/statm: 154417 53595 91 6 0 153083 0
[pid=4433] ppid=4429 vsize=1017444 CPUtime=275.27 cores=3
/proc/4433/stat : 4433 (march_hi) R 4429 4429 4279 0 -1 4202496 538325 0 0 0 27414 113 0 0 25 0 1 0 511938342 1041862656 221557 33554432000 4194304 4331988 140737042362272 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/4433/statm: 254361 221557 151 34 0 252803 0
[pid=4434] ppid=4429 vsize=286844 CPUtime=1079.02 cores=4-7
/proc/4434/stat : 4434 (plingeling) R 4429 4429 4279 0 -1 4202496 295829 1248 0 0 107762 140 0 0 15 0 1 0 511938342 293728256 37231 33554432000 4194304 4356188 140733238004688 18446744073709551615 242970575978 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/4434/statm: 71711 37231 165 40 0 70255 0
Current children cumulated CPU time (s) 2175.68
Current children cumulated vsize (KiB) 3997280

Child status: 0
Real time (s): 275.352
CPU time (s): 2175.88
CPU user time (s): 2171.92
CPU system time (s): 3.9614
CPU usage (%): 790.221
Max. virtual memory (cumulated for all children) (KiB): 5552636

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2171.92
system time used= 3.9614
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1292204
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 755
involuntary context switches= 10259

runsolver used 0.39294 second user time and 1.10183 second system time

The end

Launcher Data 

Begin job on node128 at 2011-04-28 17:09:57
IDJOB=3310179
IDBENCH=70961
IDSOLVER=1638
FILE ID=node128/3310179-1304003395
RUNJOBID= node128-1304002189-4293
PBS_JOBID= 13168789
Free space on /tmp= 66928 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_L150_coli.sat.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310179-1304003395/watcher-3310179-1304003395 -o /tmp/evaluation-result-3310179-1304003395/solver-3310179-1304003395 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310179-1304003395.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ba6884aaa746378e56c38fd8b3d0255e
RANDOM SEED=1441782205

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      23287128 kB
Buffers:       1359344 kB
Cached:        7614884 kB
SwapCached:        160 kB
Active:        2222016 kB
Inactive:      6816436 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      23287128 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           59472 kB
Writeback:           0 kB
AnonPages:       63960 kB
Mapped:          14808 kB
Slab:           561092 kB
PageTables:       4292 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   186932 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66916 MiB
End job on node128 at 2011-04-28 17:14:32