Trace number 3310212

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 36572.6 4575.32

General information on the benchmark

Nameapplication/fuhs/
AProVE11/AProVE11-06.cnf
MD5SUM6fd7d026c372988cefc364000243d13f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1455.4
Satisfiable
(Un)Satisfiability was proved
Number of variables302076
Number of clauses1039056
Sum of the clauses size2729970
Maximum clause length978
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2420562
Number of clauses of size 3588399
Number of clauses of size 429561
Number of clauses of size 569
Number of clauses of size over 5464

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
36571.79/4575.27	s UNSATISFIABLE
36572.51/4575.31	solver [1] cryptominisat 2.7.1 answered
36572.51/4575.31	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310212-1304004212/watcher-3310212-1304004212 -o /tmp/evaluation-result-3310212-1304004212/solver-3310212-1304004212 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310212-1304004212.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.39 6.59 6.40 1/170 8508
/proc/meminfo: memFree=14134548/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) R 8506 8508 8141 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0

[startup+0.062375 s]
/proc/loadavg: 4.39 6.59 6.40 1/170 8508
/proc/meminfo: memFree=14134548/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 2826088513535 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100367 s]
/proc/loadavg: 4.39 6.59 6.40 1/170 8508
/proc/meminfo: memFree=14134548/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 2826088513535 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300334 s]
/proc/loadavg: 4.39 6.59 6.40 1/170 8508
/proc/meminfo: memFree=14134548/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 2826088513535 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700266 s]
/proc/loadavg: 4.39 6.59 6.40 1/170 8508
/proc/meminfo: memFree=14134548/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 21 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 4597384400101965823 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50112 s]
/proc/loadavg: 4.39 6.59 6.40 6/176 8519
/proc/meminfo: memFree=13474568/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 21 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 4597384400101965823 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
[pid=8509] ppid=8508 vsize=163084 CPUtime=1.49 cores=0
/proc/8509/stat : 8509 (cryptominisat) R 8508 8508 8141 0 -1 4202496 29816 0 0 0 145 4 0 0 25 0 1 0 512021130 166998016 28628 33554432000 4194304 4587354 140735696427200 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8509/statm: 40771 28628 306 96 0 37333 0
[pid=8510] ppid=8508 vsize=182960 CPUtime=1.48 cores=1
/proc/8510/stat : 8510 (clasp) R 8508 8508 8141 0 -1 4202496 49848 0 0 0 142 6 0 0 20 0 1 0 512021130 187351040 42223 33554432000 4194304 4785740 140736532907024 18446744073709551615 248089359045 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8510/statm: 45740 42224 319 145 0 42785 0
[pid=8511] ppid=8508 vsize=518788 CPUtime=1.49 cores=2
/proc/8511/stat : 8511 (TNM) R 8508 8508 8141 0 -1 4202496 22515 0 0 0 146 3 0 0 25 0 1 0 512021130 531238912 22412 33554432000 134512640 134534564 4289862400 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8511/statm: 129697 22412 91 6 0 128363 0
[pid=8512] ppid=8508 vsize=164744 CPUtime=1.49 cores=3
/proc/8512/stat : 8512 (march_hi) R 8508 8508 8141 0 -1 4194304 62633 0 0 0 141 8 0 0 20 0 1 0 512021130 168697856 29620 33554432000 4194304 4331988 140736607630560 18446744073709551615 4256736 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8512/statm: 41186 29620 129 34 0 39628 0
[pid=8513] ppid=8508 vsize=257852 CPUtime=1.77 cores=4-7
/proc/8513/stat : 8513 (plingeling) S 8508 8508 8141 0 -1 4202496 66814 1258 0 0 169 8 0 0 22 0 5 0 512021130 264040448 52898 33554432000 4194304 4356188 140735216724992 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8513/statm: 64463 52898 141 40 0 63007 0
Current children cumulated CPU time (s) 7.72
Current children cumulated vsize (KiB) 1305752

[startup+3.10084 s]
/proc/loadavg: 4.39 6.59 6.40 9/180 8523
/proc/meminfo: memFree=13237944/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 4597384400101965823 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
[pid=8509] ppid=8508 vsize=322792 CPUtime=3.09 cores=0
/proc/8509/stat : 8509 (cryptominisat) R 8508 8508 8141 0 -1 4202496 70365 0 0 0 300 9 0 0 25 0 1 0 512021130 330539008 66817 33554432000 4194304 4587354 140735696427200 18446744073709551615 4369760 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8509/statm: 80698 66821 317 96 0 77260 0
[pid=8510] ppid=8508 vsize=187616 CPUtime=3.09 cores=1
/proc/8510/stat : 8510 (clasp) R 8508 8508 8141 0 -1 4202496 56080 0 0 0 302 7 0 0 25 0 1 0 512021130 192118784 43482 33554432000 4194304 4785740 140736532907024 18446744073709551615 4536814 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8510/statm: 46904 43482 332 145 0 43949 0
[pid=8511] ppid=8508 vsize=529224 CPUtime=3.09 cores=2
/proc/8511/stat : 8511 (TNM) R 8508 8508 8141 0 -1 4202496 36534 0 0 0 304 5 0 0 25 0 1 0 512021130 541925376 36431 33554432000 134512640 134534564 4289862400 18446744073709551615 134529957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8511/statm: 132306 36431 95 6 0 130972 0
[pid=8512] ppid=8508 vsize=164664 CPUtime=3.08 cores=3
/proc/8512/stat : 8512 (march_hi) R 8508 8508 8141 0 -1 4202496 121999 0 0 0 291 17 0 0 25 0 1 0 512021130 168615936 29732 33554432000 4194304 4331988 140736607630560 18446744073709551615 4220137 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8512/statm: 41166 29732 148 34 0 39608 0
[pid=8513] ppid=8508 vsize=389020 CPUtime=8.15 cores=4-7
/proc/8513/stat : 8513 (plingeling) S 8508 8508 8141 0 -1 4202496 145670 1258 0 0 797 18 0 0 22 0 5 0 512021130 398356480 73248 33554432000 4194304 4356188 140735216724992 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8513/statm: 97255 73248 153 40 0 95799 0
[pid=8513/tid=8520] ppid=8508 vsize=389020 CPUtime=1.69 cores=4-7
/proc/8513/task/8520/stat : 8520 (plingeling) R 8508 8508 8141 0 -1 4202560 20944 1258 0 0 167 2 0 0 20 0 5 0 512021269 398356480 73248 33554432000 4194304 4356188 140735216724992 18446744073709551615 4260256 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8513/tid=8521] ppid=8508 vsize=389020 CPUtime=1.68 cores=4-7
/proc/8513/task/8521/stat : 8521 (plingeling) R 8508 8508 8141 0 -1 4202560 24915 1258 0 0 165 3 0 0 20 0 5 0 512021269 398356480 73248 33554432000 4194304 4356188 140735216724992 18446744073709551615 4244442 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8513/tid=8522] ppid=8508 vsize=389020 CPUtime=1.69 cores=4-7
/proc/8513/task/8522/stat : 8522 (plingeling) R 8508 8508 8141 0 -1 4202560 21468 1258 0 0 167 2 0 0 25 0 5 0 512021269 398356480 73248 33554432000 4194304 4356188 140735216724992 18446744073709551615 4244968 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8513/tid=8523] ppid=8508 vsize=389020 CPUtime=1.66 cores=4-7
/proc/8513/task/8523/stat : 8523 (plingeling) R 8508 8508 8141 0 -1 4202560 12190 1258 0 0 165 1 0 0 25 0 5 0 512021269 398356480 73248 33554432000 4194304 4356188 140735216724992 18446744073709551615 4259314 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 20.5
Current children cumulated vsize (KiB) 1611640

[startup+6.30127 s]
/proc/loadavg: 4.67 6.61 6.41 9/180 8523
/proc/meminfo: memFree=13134756/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 4597384400101965823 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
[pid=8509] ppid=8508 vsize=327760 CPUtime=6.29 cores=0
/proc/8509/stat : 8509 (cryptominisat) R 8508 8508 8141 0 -1 4202496 97399 0 0 0 615 14 0 0 25 0 1 0 512021130 335626240 69146 33554432000 4194304 4587354 140735696427200 18446744073709551615 4238254 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8509/statm: 81940 69146 330 96 0 78502 0
[pid=8510] ppid=8508 vsize=187616 CPUtime=6.29 cores=1
/proc/8510/stat : 8510 (clasp) R 8508 8508 8141 0 -1 4202496 56116 0 0 0 622 7 0 0 25 0 1 0 512021130 192118784 43518 33554432000 4194304 4785740 140736532907024 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8510/statm: 46904 43518 340 145 0 43949 0
[pid=8511] ppid=8508 vsize=529224 CPUtime=6.29 cores=2
/proc/8511/stat : 8511 (TNM) R 8508 8508 8141 0 -1 4202496 36534 0 0 0 624 5 0 0 25 0 1 0 512021130 541925376 36431 33554432000 134512640 134534564 4289862400 18446744073709551615 134529366 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8511/statm: 132306 36431 95 6 0 130972 0
[pid=8512] ppid=8508 vsize=189624 CPUtime=6.28 cores=3
/proc/8512/stat : 8512 (march_hi) R 8508 8508 8141 0 -1 4202496 318743 0 0 0 582 46 0 0 25 0 1 0 512021130 194174976 36370 33554432000 4194304 4331988 140736607630560 18446744073709551615 248089359045 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8512/statm: 47406 36370 149 34 0 45848 0
[pid=8513] ppid=8508 vsize=395152 CPUtime=20.93 cores=4-7
/proc/8513/stat : 8513 (plingeling) S 8508 8508 8141 0 -1 4202496 147229 1258 0 0 2075 18 0 0 22 0 5 0 512021130 404635648 70878 33554432000 4194304 4356188 140735216724992 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8513/statm: 98788 70878 164 40 0 97332 0
[pid=8513/tid=8520] ppid=8508 vsize=395152 CPUtime=4.9 cores=4-7
/proc/8513/task/8520/stat : 8520 (plingeling) R 8508 8508 8141 0 -1 4202560 21396 1258 0 0 488 2 0 0 25 0 5 0 512021269 404635648 70878 33554432000 4194304 4356188 140735216724992 18446744073709551615 4232894 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8513/tid=8521] ppid=8508 vsize=395152 CPUtime=4.89 cores=4-7
/proc/8513/task/8521/stat : 8521 (plingeling) R 8508 8508 8141 0 -1 4202560 25371 1258 0 0 485 4 0 0 25 0 5 0 512021269 404635648 70878 33554432000 4194304 4356188 140735216724992 18446744073709551615 4303196 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8513/tid=8522] ppid=8508 vsize=395152 CPUtime=4.89 cores=4-7
/proc/8513/task/8522/stat : 8522 (plingeling) R 8508 8508 8141 0 -1 4202560 21923 1258 0 0 487 2 0 0 25 0 5 0 512021269 404635648 70878 33554432000 4194304 4356188 140735216724992 18446744073709551615 4293997 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8513/tid=8523] ppid=8508 vsize=395152 CPUtime=4.84 cores=4-7
/proc/8513/task/8523/stat : 8523 (plingeling) R 8508 8508 8141 0 -1 4202560 12386 1258 0 0 483 1 0 0 25 0 5 0 512021269 404635648 70878 33554432000 4194304 4356188 140735216724992 18446744073709551615 4279717 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 46.08
Current children cumulated vsize (KiB) 1647700

[startup+12.7011 s]
/proc/loadavg: 4.94 6.64 6.41 9/180 8523
/proc/meminfo: memFree=12836684/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 4597384400101965823 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
[pid=8509] ppid=8508 vsize=327760 CPUtime=12.69 cores=0
/proc/8509/stat : 8509 (cryptominisat) R 8508 8508 8141 0 -1 4202496 97623 0 0 0 1255 14 0 0 25 0 1 0 512021130 335626240 69363 33554432000 4194304 4587354 140735696427200 18446744073709551615 4230266 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8509/statm: 81940 69363 331 96 0 78502 0
[pid=8510] ppid=8508 vsize=187616 CPUtime=12.69 cores=1
/proc/8510/stat : 8510 (clasp) R 8508 8508 8141 0 -1 4202496 56116 0 0 0 1262 7 0 0 25 0 1 0 512021130 192118784 43518 33554432000 4194304 4785740 140736532907024 18446744073709551615 4553296 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8510/statm: 46904 43518 340 145 0 43949 0
[pid=8511] ppid=8508 vsize=529224 CPUtime=12.69 cores=2
/proc/8511/stat : 8511 (TNM) R 8508 8508 8141 0 -1 4202496 36534 0 0 0 1264 5 0 0 25 0 1 0 512021130 541925376 36431 33554432000 134512640 134534564 4289862400 18446744073709551615 134529964 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8511/statm: 132306 36431 95 6 0 130972 0
[pid=8512] ppid=8508 vsize=609804 CPUtime=12.68 cores=3
/proc/8512/stat : 8512 (march_hi) R 8508 8508 8141 0 -1 4202496 432474 0 0 0 1206 62 0 0 25 0 1 0 512021130 624439296 75260 33554432000 4194304 4331988 140736607630560 18446744073709551615 4226434 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8512/statm: 152451 75260 466 34 0 150893 0
[pid=8513] ppid=8508 vsize=515948 CPUtime=46.49 cores=4-7
/proc/8513/stat : 8513 (plingeling) S 8508 8508 8141 0 -1 4202496 177431 1258 0 0 4625 24 0 0 22 0 5 0 512021130 528330752 101080 33554432000 4194304 4356188 140735216724992 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8513/statm: 128987 101080 164 40 0 127531 0
[pid=8513/tid=8520] ppid=8508 vsize=515948 CPUtime=11.29 cores=4-7
/proc/8513/task/8520/stat : 8520 (plingeling) R 8508 8508 8141 0 -1 4202560 31378 1258 0 0 1126 3 0 0 25 0 5 0 512021269 528330752 101080 33554432000 4194304 4356188 140735216724992 18446744073709551615 4216217 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8513/tid=8521] ppid=8508 vsize=515948 CPUtime=11.29 cores=4-7
/proc/8513/task/8521/stat : 8521 (plingeling) R 8508 8508 8141 0 -1 4202560 35353 1258 0 0 1123 6 0 0 25 0 5 0 512021269 528330752 101080 33554432000 4194304 4356188 140735216724992 18446744073709551615 4233203 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8513/tid=8522] ppid=8508 vsize=515948 CPUtime=11.29 cores=4-7
/proc/8513/task/8522/stat : 8522 (plingeling) R 8508 8508 8141 0 -1 4202560 31905 1258 0 0 1125 4 0 0 25 0 5 0 512021269 528330752 101080 33554432000 4194304 4356188 140735216724992 18446744073709551615 4301704 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8513/tid=8523] ppid=8508 vsize=515948 CPUtime=11.21 cores=4-7
/proc/8513/task/8523/stat : 8523 (plingeling) R 8508 8508 8141 0 -1 4202560 12642 1258 0 0 1120 1 0 0 25 0 5 0 512021269 528330752 101080 33554432000 4194304 4356188 140735216724992 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 97.24
Current children cumulated vsize (KiB) 2188676

[startup+25.5009 s]
/proc/loadavg: 5.62 6.70 6.44 9/180 8523
/proc/meminfo: memFree=12781292/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 4597384400101965823 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
[pid=8509] ppid=8508 vsize=327760 CPUtime=25.49 cores=0
/proc/8509/stat : 8509 (cryptominisat) R 8508 8508 8141 0 -1 4202496 97797 0 0 0 2535 14 0 0 25 0 1 0 512021130 335626240 69535 33554432000 4194304 4587354 140735696427200 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8509/statm: 81940 69535 331 96 0 78502 0
[pid=8510] ppid=8508 vsize=187616 CPUtime=25.49 cores=1
/proc/8510/stat : 8510 (clasp) R 8508 8508 8141 0 -1 4202496 56129 0 0 0 2542 7 0 0 25 0 1 0 512021130 192118784 43531 33554432000 4194304 4785740 140736532907024 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8510/statm: 46904 43531 340 145 0 43949 0
[pid=8511] ppid=8508 vsize=529224 CPUtime=25.48 cores=2
/proc/8511/stat : 8511 (TNM) R 8508 8508 8141 0 -1 4202496 36534 0 0 0 2543 5 0 0 25 0 1 0 512021130 541925376 36431 33554432000 134512640 134534564 4289862400 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8511/statm: 132306 36431 95 6 0 130972 0
[pid=8512] ppid=8508 vsize=641716 CPUtime=25.49 cores=3

################
# More data... #
################

[pid=8510] ppid=8508 vsize=731252 CPUtime=4563.05 cores=1
/proc/8510/stat : 8510 (clasp) R 8508 8508 8141 0 -1 4202496 190696 0 0 0 456222 83 0 0 25 0 1 0 512021130 748802048 178098 33554432000 4194304 4785740 140736532907024 18446744073709551615 4552993 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8510/statm: 182813 178098 340 145 0 179858 0
[pid=8511] ppid=8508 vsize=529228 CPUtime=4562.75 cores=2
/proc/8511/stat : 8511 (TNM) R 8508 8508 8141 0 -1 4202496 36544 0 0 0 456269 6 0 0 25 0 1 0 512021130 541929472 36441 33554432000 134512640 134534564 4289862400 18446744073709551615 134526128 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8511/statm: 132307 36441 103 6 0 130973 0
[pid=8512] ppid=8508 vsize=711048 CPUtime=4563.2 cores=3
/proc/8512/stat : 8512 (march_hi) R 8508 8508 8141 0 -1 4202496 458156 0 0 0 456251 69 0 0 25 0 1 0 512021130 728113152 100648 33554432000 4194304 4331988 140736607630560 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8512/statm: 177762 100648 175 34 0 176204 0
[pid=8513] ppid=8508 vsize=636320 CPUtime=18223 cores=4-7
/proc/8513/stat : 8513 (plingeling) S 8508 8508 8141 0 -1 4202496 234567 1258 0 0 1822267 34 0 0 22 0 5 0 512021130 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8513/statm: 159080 131173 164 40 0 157624 0
[pid=8513/tid=8520] ppid=8508 vsize=636320 CPUtime=4561.8 cores=4-7
/proc/8513/task/8520/stat : 8520 (plingeling) R 8508 8508 8141 0 -1 4202560 38608 1258 0 0 456176 4 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8513/tid=8521] ppid=8508 vsize=636320 CPUtime=4561.12 cores=4-7
/proc/8513/task/8521/stat : 8521 (plingeling) R 8508 8508 8141 0 -1 4202560 47992 1258 0 0 456102 10 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4331144 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8513/tid=8522] ppid=8508 vsize=636320 CPUtime=4561.8 cores=4-7
/proc/8513/task/8522/stat : 8522 (plingeling) R 8508 8508 8141 0 -1 4202560 44786 1258 0 0 456173 7 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8513/tid=8523] ppid=8508 vsize=636320 CPUtime=4536.88 cores=4-7
/proc/8513/task/8523/stat : 8523 (plingeling) R 8508 8508 8141 0 -1 4202560 37028 1258 0 0 453684 4 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 36475.1
Current children cumulated vsize (KiB) 4201480

[startup+4569.5 s]
/proc/loadavg: 8.12 8.07 8.00 9/180 8657
/proc/meminfo: memFree=12022860/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 4597384400101965823 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
[pid=8509] ppid=8508 vsize=1575308 CPUtime=4569.44 cores=0
/proc/8509/stat : 8509 (cryptominisat) R 8508 8508 8141 0 -1 4202496 536290 0 0 0 456769 175 0 0 25 0 1 0 512021130 1613115392 82429 33554432000 4194304 4587354 140735696427200 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8509/statm: 393827 82429 337 96 0 390389 0
[pid=8510] ppid=8508 vsize=731252 CPUtime=4569.45 cores=1
/proc/8510/stat : 8510 (clasp) R 8508 8508 8141 0 -1 4202496 190696 0 0 0 456862 83 0 0 25 0 1 0 512021130 748802048 178098 33554432000 4194304 4785740 140736532907024 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8510/statm: 182813 178098 340 145 0 179858 0
[pid=8511] ppid=8508 vsize=529228 CPUtime=4569.15 cores=2
/proc/8511/stat : 8511 (TNM) R 8508 8508 8141 0 -1 4202496 36544 0 0 0 456909 6 0 0 25 0 1 0 512021130 541929472 36441 33554432000 134512640 134534564 4289862400 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8511/statm: 132307 36441 103 6 0 130973 0
[pid=8512] ppid=8508 vsize=711048 CPUtime=4569.6 cores=3
/proc/8512/stat : 8512 (march_hi) R 8508 8508 8141 0 -1 4202496 458158 0 0 0 456891 69 0 0 25 0 1 0 512021130 728113152 100650 33554432000 4194304 4331988 140736607630560 18446744073709551615 4237182 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8512/statm: 177762 100650 175 34 0 176204 0
[pid=8513] ppid=8508 vsize=636320 CPUtime=18248.6 cores=4-7
/proc/8513/stat : 8513 (plingeling) S 8508 8508 8141 0 -1 4202496 234567 1258 0 0 1824823 34 0 0 22 0 5 0 512021130 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8513/statm: 159080 131173 164 40 0 157624 0
[pid=8513/tid=8520] ppid=8508 vsize=636320 CPUtime=4568.2 cores=4-7
/proc/8513/task/8520/stat : 8520 (plingeling) R 8508 8508 8141 0 -1 4202560 38608 1258 0 0 456816 4 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8513/tid=8521] ppid=8508 vsize=636320 CPUtime=4567.52 cores=4-7
/proc/8513/task/8521/stat : 8521 (plingeling) R 8508 8508 8141 0 -1 4202560 47992 1258 0 0 456742 10 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4331045 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8513/tid=8522] ppid=8508 vsize=636320 CPUtime=4568.2 cores=4-7
/proc/8513/task/8522/stat : 8522 (plingeling) R 8508 8508 8141 0 -1 4202560 44786 1258 0 0 456813 7 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8513/tid=8523] ppid=8508 vsize=636320 CPUtime=4543.25 cores=4-7
/proc/8513/task/8523/stat : 8523 (plingeling) R 8508 8508 8141 0 -1 4202560 37028 1258 0 0 454321 4 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4331971 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 36526.2
Current children cumulated vsize (KiB) 4201480

[startup+4572.71 s]
/proc/loadavg: 8.12 8.07 8.00 9/180 8657
/proc/meminfo: memFree=12022612/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 4597384400101965823 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
[pid=8509] ppid=8508 vsize=1575308 CPUtime=4572.65 cores=0
/proc/8509/stat : 8509 (cryptominisat) R 8508 8508 8141 0 -1 4202496 536343 0 0 0 457090 175 0 0 25 0 1 0 512021130 1613115392 82479 33554432000 4194304 4587354 140735696427200 18446744073709551615 4238525 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8509/statm: 393827 82479 337 96 0 390389 0
[pid=8510] ppid=8508 vsize=731252 CPUtime=4572.66 cores=1
/proc/8510/stat : 8510 (clasp) R 8508 8508 8141 0 -1 4202496 190696 0 0 0 457183 83 0 0 25 0 1 0 512021130 748802048 178098 33554432000 4194304 4785740 140736532907024 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8510/statm: 182813 178098 340 145 0 179858 0
[pid=8511] ppid=8508 vsize=529228 CPUtime=4572.36 cores=2
/proc/8511/stat : 8511 (TNM) R 8508 8508 8141 0 -1 4202496 36544 0 0 0 457230 6 0 0 25 0 1 0 512021130 541929472 36441 33554432000 134512640 134534564 4289862400 18446744073709551615 134529031 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8511/statm: 132307 36441 103 6 0 130973 0
[pid=8512] ppid=8508 vsize=711048 CPUtime=4572.81 cores=3
/proc/8512/stat : 8512 (march_hi) R 8508 8508 8141 0 -1 4202496 458159 0 0 0 457212 69 0 0 25 0 1 0 512021130 728113152 100651 33554432000 4194304 4331988 140736607630560 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8512/statm: 177762 100651 175 34 0 176204 0
[pid=8513] ppid=8508 vsize=636320 CPUtime=18261.4 cores=4-7
/proc/8513/stat : 8513 (plingeling) S 8508 8508 8141 0 -1 4202496 234567 1258 0 0 1826104 34 0 0 22 0 5 0 512021130 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8513/statm: 159080 131173 164 40 0 157624 0
[pid=8513/tid=8520] ppid=8508 vsize=636320 CPUtime=4571.41 cores=4-7
/proc/8513/task/8520/stat : 8520 (plingeling) R 8508 8508 8141 0 -1 4202560 38608 1258 0 0 457137 4 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4210823 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8513/tid=8521] ppid=8508 vsize=636320 CPUtime=4570.73 cores=4-7
/proc/8513/task/8521/stat : 8521 (plingeling) R 8508 8508 8141 0 -1 4202560 47992 1258 0 0 457063 10 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8513/tid=8522] ppid=8508 vsize=636320 CPUtime=4571.4 cores=4-7
/proc/8513/task/8522/stat : 8522 (plingeling) R 8508 8508 8141 0 -1 4202560 44786 1258 0 0 457133 7 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8513/tid=8523] ppid=8508 vsize=636320 CPUtime=4546.44 cores=4-7
/proc/8513/task/8523/stat : 8523 (plingeling) R 8508 8508 8141 0 -1 4202560 37028 1258 0 0 454640 4 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 36551.9
Current children cumulated vsize (KiB) 4201480

[startup+4574.3 s]
/proc/loadavg: 8.11 8.07 8.00 9/180 8657
/proc/meminfo: memFree=12022736/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 4597384400101965823 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
[pid=8509] ppid=8508 vsize=1575308 CPUtime=4574.24 cores=0
/proc/8509/stat : 8509 (cryptominisat) R 8508 8508 8141 0 -1 4202496 536349 0 0 0 457249 175 0 0 25 0 1 0 512021130 1613115392 82485 33554432000 4194304 4587354 140735696427200 18446744073709551615 4237695 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8509/statm: 393827 82485 337 96 0 390389 0
[pid=8510] ppid=8508 vsize=731252 CPUtime=4574.25 cores=1
/proc/8510/stat : 8510 (clasp) R 8508 8508 8141 0 -1 4202496 190696 0 0 0 457342 83 0 0 25 0 1 0 512021130 748802048 178098 33554432000 4194304 4785740 140736532907024 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8510/statm: 182813 178098 340 145 0 179858 0
[pid=8511] ppid=8508 vsize=529228 CPUtime=4573.95 cores=2
/proc/8511/stat : 8511 (TNM) R 8508 8508 8141 0 -1 4202496 36544 0 0 0 457389 6 0 0 25 0 1 0 512021130 541929472 36441 33554432000 134512640 134534564 4289862400 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8511/statm: 132307 36441 103 6 0 130973 0
[pid=8512] ppid=8508 vsize=711048 CPUtime=4574.4 cores=3
/proc/8512/stat : 8512 (march_hi) R 8508 8508 8141 0 -1 4202496 458159 0 0 0 457371 69 0 0 25 0 1 0 512021130 728113152 100651 33554432000 4194304 4331988 140736607630560 18446744073709551615 4228475 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8512/statm: 177762 100651 175 34 0 176204 0
[pid=8513] ppid=8508 vsize=636320 CPUtime=18267.8 cores=4-7
/proc/8513/stat : 8513 (plingeling) S 8508 8508 8141 0 -1 4202496 234567 1258 0 0 1826741 34 0 0 22 0 5 0 512021130 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8513/statm: 159080 131173 164 40 0 157624 0
[pid=8513/tid=8520] ppid=8508 vsize=636320 CPUtime=4573 cores=4-7
/proc/8513/task/8520/stat : 8520 (plingeling) R 8508 8508 8141 0 -1 4202560 38608 1258 0 0 457296 4 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8513/tid=8521] ppid=8508 vsize=636320 CPUtime=4572.32 cores=4-7
/proc/8513/task/8521/stat : 8521 (plingeling) R 8508 8508 8141 0 -1 4202560 47992 1258 0 0 457222 10 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8513/tid=8522] ppid=8508 vsize=636320 CPUtime=4573 cores=4-7
/proc/8513/task/8522/stat : 8522 (plingeling) R 8508 8508 8141 0 -1 4202560 44786 1258 0 0 457293 7 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8513/tid=8523] ppid=8508 vsize=636320 CPUtime=4548.02 cores=4-7
/proc/8513/task/8523/stat : 8523 (plingeling) R 8508 8508 8141 0 -1 4202560 37028 1258 0 0 454798 4 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 36564.6
Current children cumulated vsize (KiB) 4201480

[startup+4575.1 s]
/proc/loadavg: 8.11 8.07 8.00 9/180 8657
/proc/meminfo: memFree=12022736/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=0 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 512021130 18763776 389 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 4597384400101965823 0 0 17 6 0 0 0
/proc/8508/statm: 4581 389 341 23 0 91 0
[pid=8509] ppid=8508 vsize=1573256 CPUtime=4575.04 cores=0
/proc/8509/stat : 8509 (cryptominisat) R 8508 8508 8141 0 -1 4202496 536368 0 0 0 457329 175 0 0 25 0 1 0 512021130 1611014144 82208 33554432000 4194304 4587354 140735696427200 18446744073709551615 4287220 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/8509/statm: 393314 82208 352 96 0 389876 0
[pid=8510] ppid=8508 vsize=731252 CPUtime=4575.05 cores=1
/proc/8510/stat : 8510 (clasp) R 8508 8508 8141 0 -1 4202496 190696 0 0 0 457422 83 0 0 25 0 1 0 512021130 748802048 178098 33554432000 4194304 4785740 140736532907024 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/8510/statm: 182813 178098 340 145 0 179858 0
[pid=8511] ppid=8508 vsize=529228 CPUtime=4574.75 cores=2
/proc/8511/stat : 8511 (TNM) R 8508 8508 8141 0 -1 4202496 36544 0 0 0 457469 6 0 0 25 0 1 0 512021130 541929472 36441 33554432000 134512640 134534564 4289862400 18446744073709551615 134525873 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/8511/statm: 132307 36441 103 6 0 130973 0
[pid=8512] ppid=8508 vsize=711048 CPUtime=4575.2 cores=3
/proc/8512/stat : 8512 (march_hi) R 8508 8508 8141 0 -1 4202496 458160 0 0 0 457451 69 0 0 25 0 1 0 512021130 728113152 100652 33554432000 4194304 4331988 140736607630560 18446744073709551615 4297280 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/8512/statm: 177762 100652 175 34 0 176204 0
[pid=8513] ppid=8508 vsize=636320 CPUtime=18270.9 cores=4-7
/proc/8513/stat : 8513 (plingeling) S 8508 8508 8141 0 -1 4202496 234567 1258 0 0 1827061 34 0 0 22 0 5 0 512021130 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8513/statm: 159080 131173 164 40 0 157624 0
[pid=8513/tid=8520] ppid=8508 vsize=636320 CPUtime=4573.8 cores=4-7
/proc/8513/task/8520/stat : 8520 (plingeling) R 8508 8508 8141 0 -1 4202560 38608 1258 0 0 457376 4 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4279535 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8513/tid=8521] ppid=8508 vsize=636320 CPUtime=4573.12 cores=4-7
/proc/8513/task/8521/stat : 8521 (plingeling) R 8508 8508 8141 0 -1 4202560 47992 1258 0 0 457302 10 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4331407 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8513/tid=8522] ppid=8508 vsize=636320 CPUtime=4573.8 cores=4-7
/proc/8513/task/8522/stat : 8522 (plingeling) R 8508 8508 8141 0 -1 4202560 44786 1258 0 0 457373 7 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8513/tid=8523] ppid=8508 vsize=636320 CPUtime=4548.82 cores=4-7
/proc/8513/task/8523/stat : 8523 (plingeling) R 8508 8508 8141 0 -1 4202560 37028 1258 0 0 454878 4 0 0 25 0 5 0 512021269 651591680 131173 33554432000 4194304 4356188 140735216724992 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 36571
Current children cumulated vsize (KiB) 4199428

[startup+4575.3 s]
/proc/loadavg: 8.11 8.07 8.00 9/180 8657
/proc/meminfo: memFree=12022736/32950928 swapFree=67111528/67111528
[pid=8508] ppid=8506 vsize=18324 CPUtime=9150.18 cores=0-7
/proc/8508/stat : 8508 (ppfolio) S 8506 8508 8141 0 -1 4202496 521 572913 0 0 0 0 914834 184 15 0 1 0 512021130 18763776 391 33554432000 4194304 4287625 140735637621216 18446744073709551615 248089718287 0 0 4096 65536 3034545817990987776 0 0 17 6 0 0 0
/proc/8508/statm: 4581 391 342 23 0 91 0
[pid=8510] ppid=8508 vsize=0 CPUtime=4575.25 cores=1
/proc/8510/stat : 8510 (clasp) R 8508 8508 8141 0 -1 4203524 190696 0 0 0 457440 85 0 0 25 0 1 0 512021130 0 0 33554432000 0 0 0 0 0 0 0 4096 16386 18446744073709551615 0 0 17 1 0 0 0
/proc/8510/statm: 0 0 0 0 0 0 0
[pid=8512] ppid=8508 vsize=0 CPUtime=4575.4 cores=3
/proc/8512/stat : 8512 (march_hi) R 8508 8508 8141 0 -1 4203524 458160 0 0 0 457469 71 0 0 25 0 1 0 512021130 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/8512/statm: 0 0 0 0 0 0 0
[pid=8513] ppid=8508 vsize=0 CPUtime=18271.7 cores=4-7
/proc/8513/stat : 8513 (plingeling) Z 8508 8508 8141 0 -1 4203548 234567 1258 0 0 1827132 36 0 0 18 0 2 0 512021130 0 0 33554432000 0 0 0 0 0 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8513/statm: 0 0 0 0 0 0 0
[pid=8513/tid=8521] ppid=8508 vsize=0 CPUtime=4573.32 cores=4-7
/proc/8513/task/8521/stat : 8521 (plingeling) R 8508 8508 8141 0 -1 4203588 47992 1258 0 0 457320 12 0 0 25 0 2 0 512021269 0 0 33554432000 0 0 0 0 0 0 0 4096 17442 18446744073709551615 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 36572.5
Current children cumulated vsize (KiB) 18324

Child status: 0
Real time (s): 4575.32
CPU time (s): 36572.6
CPU user time (s): 36568.8
CPU system time (s): 3.82242
CPU usage (%): 799.345
Max. virtual memory (cumulated for all children) (KiB): 5837548

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 36568.8
system time used= 3.82242
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1458132
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 717
involuntary context switches= 171108

runsolver used 7.18091 second user time and 17.7783 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-28 17:23:33
IDJOB=3310212
IDBENCH=82354
IDSOLVER=1638
FILE ID=node123/3310212-1304004212
RUNJOBID= node123-1304002518-8155
PBS_JOBID= 13168793
Free space on /tmp= 72796 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/AProVE11/AProVE11-06.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310212-1304004212/watcher-3310212-1304004212 -o /tmp/evaluation-result-3310212-1304004212/solver-3310212-1304004212 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310212-1304004212.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6fd7d026c372988cefc364000243d13f
RANDOM SEED=138438674

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14134952 kB
Buffers:       2189432 kB
Cached:       16005700 kB
SwapCached:          0 kB
Active:        8907936 kB
Inactive:      9355864 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14134952 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           31316 kB
Writeback:           0 kB
AnonPages:       68052 kB
Mapped:          14492 kB
Slab:           486704 kB
PageTables:       4632 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   189632 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72788 MiB
End job on node123 at 2011-04-28 18:39:49