Trace number 3220959

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 1048.15 131.117

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v450-c1917-S1910317962-059.UNKNOWN.cnf
MD5SUMdc676a8dc341229efc4ee05b1ab19ceb
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark129.859
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses1917
Sum of the clauses size5751
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 31917
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
1047.99/131.11	s UNSATISFIABLE
1047.99/131.11	solver [4] march_hi 2009 answered
1047.99/131.11	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3220959-1304160561/watcher-3220959-1304160561 -o /tmp/evaluation-result-3220959-1304160561/solver-3220959-1304160561 -C 40000 -W 5000 -M 31000 ppfolio HOME/instance-3220959-1304160561.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.11 8.08 8.02 1/170 28754
/proc/meminfo: memFree=30490388/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 6 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0

[startup+0.09625 s]
/proc/loadavg: 8.11 8.08 8.02 1/170 28754
/proc/meminfo: memFree=30490388/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) R 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100249 s]
/proc/loadavg: 8.11 8.08 8.02 1/170 28754
/proc/meminfo: memFree=30490388/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) R 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300212 s]
/proc/loadavg: 8.11 8.08 8.02 1/170 28754
/proc/meminfo: memFree=30490388/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 24 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 7 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700138 s]
/proc/loadavg: 8.11 8.08 8.02 1/170 28754
/proc/meminfo: memFree=30490388/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 22 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 7 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50099 s]
/proc/loadavg: 8.11 8.08 8.02 9/180 28769
/proc/meminfo: memFree=30474808/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 7 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
[pid=28755] ppid=28754 vsize=676776 CPUtime=1.48 cores=0
/proc/28755/stat : 28755 (cryptominisat) R 28754 28754 28388 0 -1 4202496 3420 0 0 0 148 0 0 0 20 0 1 0 606286676 693018624 2343 33554432000 4194304 4587354 140736095065552 18446744073709551615 4238406 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28755/statm: 169194 2343 337 96 0 165756 0
[pid=28756] ppid=28754 vsize=13896 CPUtime=1.49 cores=1
/proc/28756/stat : 28756 (clasp) R 28754 28754 28388 0 -1 4202496 938 0 0 0 149 0 0 0 19 0 1 0 606286676 14229504 826 33554432000 4194304 4785740 140736148989584 18446744073709551615 4553090 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28756/statm: 3474 826 340 145 0 519 0
[pid=28757] ppid=28754 vsize=455832 CPUtime=1.49 cores=2
/proc/28757/stat : 28757 (TNM) R 28754 28754 28388 0 -1 4202496 329 0 0 0 149 0 0 0 20 0 1 0 606286676 466771968 226 33554432000 134512640 134534564 4293355200 18446744073709551615 134528652 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28757/statm: 113958 226 95 6 0 112624 0
[pid=28758] ppid=28754 vsize=7624 CPUtime=1.49 cores=3
/proc/28758/stat : 28758 (march_hi) R 28754 28754 28388 0 -1 4202496 520 0 0 0 149 0 0 0 20 0 1 0 606286676 7806976 413 33554432000 4194304 4331988 140735634453344 18446744073709551615 4226434 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28758/statm: 1906 413 172 34 0 348 0
[pid=28759] ppid=28754 vsize=122444 CPUtime=5.93 cores=4-7
/proc/28759/stat : 28759 (plingeling) S 28754 28754 28388 0 -1 4202496 4089 1251 0 0 593 0 0 0 18 0 5 0 606286676 125382656 2796 33554432000 4194304 4356188 140735298773648 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28759/statm: 30611 2796 164 40 0 29155 0
[pid=28759/tid=28766] ppid=28754 vsize=122444 CPUtime=1.48 cores=4-7
/proc/28759/task/28766/stat : 28766 (plingeling) R 28754 28754 28388 0 -1 4202560 920 1251 0 0 148 0 0 0 19 0 5 0 606286677 125382656 2796 33554432000 4194304 4356188 140735298773648 18446744073709551615 4332026 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28759/tid=28767] ppid=28754 vsize=122444 CPUtime=1.48 cores=4-7
/proc/28759/task/28767/stat : 28767 (plingeling) R 28754 28754 28388 0 -1 4202560 963 1251 0 0 148 0 0 0 23 0 5 0 606286677 125382656 2796 33554432000 4194304 4356188 140735298773648 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28759/tid=28768] ppid=28754 vsize=122444 CPUtime=1.48 cores=4-7
/proc/28759/task/28768/stat : 28768 (plingeling) R 28754 28754 28388 0 -1 4202560 840 1251 0 0 148 0 0 0 25 0 5 0 606286677 125382656 2796 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28759/tid=28769] ppid=28754 vsize=122444 CPUtime=1.46 cores=4-7
/proc/28759/task/28769/stat : 28769 (plingeling) R 28754 28754 28388 0 -1 4202560 865 1251 0 0 146 0 0 0 25 0 5 0 606286677 125382656 2796 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.88
Current children cumulated vsize (KiB) 1294896

[startup+3.1007 s]
/proc/loadavg: 8.10 8.08 8.02 9/180 28769
/proc/meminfo: memFree=30467492/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 7 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
[pid=28755] ppid=28754 vsize=679668 CPUtime=3.09 cores=0
/proc/28755/stat : 28755 (cryptominisat) R 28754 28754 28388 0 -1 4202496 4977 0 0 0 308 1 0 0 25 0 1 0 606286676 695980032 3106 33554432000 4194304 4587354 140736095065552 18446744073709551615 4238271 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28755/statm: 169917 3106 337 96 0 166479 0
[pid=28756] ppid=28754 vsize=14568 CPUtime=3.09 cores=1
/proc/28756/stat : 28756 (clasp) R 28754 28754 28388 0 -1 4202496 1116 0 0 0 309 0 0 0 25 0 1 0 606286676 14917632 1004 33554432000 4194304 4785740 140736148989584 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28756/statm: 3642 1004 340 145 0 687 0
[pid=28757] ppid=28754 vsize=455832 CPUtime=3.09 cores=2
/proc/28757/stat : 28757 (TNM) R 28754 28754 28388 0 -1 4202496 329 0 0 0 309 0 0 0 25 0 1 0 606286676 466771968 226 33554432000 134512640 134534564 4293355200 18446744073709551615 134528275 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28757/statm: 113958 226 95 6 0 112624 0
[pid=28758] ppid=28754 vsize=7624 CPUtime=3.09 cores=3
/proc/28758/stat : 28758 (march_hi) R 28754 28754 28388 0 -1 4202496 529 0 0 0 309 0 0 0 25 0 1 0 606286676 7806976 422 33554432000 4194304 4331988 140735634453344 18446744073709551615 4211493 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28758/statm: 1906 422 172 34 0 348 0
[pid=28759] ppid=28754 vsize=123880 CPUtime=12.32 cores=4-7
/proc/28759/stat : 28759 (plingeling) S 28754 28754 28388 0 -1 4202496 5654 1251 0 0 1232 0 0 0 18 0 5 0 606286676 126853120 3093 33554432000 4194304 4356188 140735298773648 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28759/statm: 30970 3093 164 40 0 29514 0
[pid=28759/tid=28766] ppid=28754 vsize=123880 CPUtime=3.08 cores=4-7
/proc/28759/task/28766/stat : 28766 (plingeling) R 28754 28754 28388 0 -1 4202560 1359 1251 0 0 308 0 0 0 25 0 5 0 606286677 126853120 3093 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331072 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28759/tid=28767] ppid=28754 vsize=123880 CPUtime=3.08 cores=4-7
/proc/28759/task/28767/stat : 28767 (plingeling) R 28754 28754 28388 0 -1 4202560 1316 1251 0 0 308 0 0 0 25 0 5 0 606286677 126853120 3093 33554432000 4194304 4356188 140735298773648 18446744073709551615 4210992 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28759/tid=28768] ppid=28754 vsize=123880 CPUtime=3.08 cores=4-7
/proc/28759/task/28768/stat : 28768 (plingeling) R 28754 28754 28388 0 -1 4202560 1291 1251 0 0 308 0 0 0 25 0 5 0 606286677 126853120 3093 33554432000 4194304 4356188 140735298773648 18446744073709551615 4334564 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28759/tid=28769] ppid=28754 vsize=123880 CPUtime=3.05 cores=4-7
/proc/28759/task/28769/stat : 28769 (plingeling) R 28754 28754 28388 0 -1 4202560 1187 1251 0 0 305 0 0 0 25 0 5 0 606286677 126853120 3093 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331340 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.68
Current children cumulated vsize (KiB) 1299896

[startup+6.30111 s]
/proc/loadavg: 8.10 8.08 8.02 9/180 28769
/proc/meminfo: memFree=30456836/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 3 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
[pid=28755] ppid=28754 vsize=679900 CPUtime=6.29 cores=0
/proc/28755/stat : 28755 (cryptominisat) R 28754 28754 28388 0 -1 4202496 6860 0 0 0 628 1 0 0 25 0 1 0 606286676 696217600 2974 33554432000 4194304 4587354 140736095065552 18446744073709551615 4238307 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28755/statm: 169975 2974 337 96 0 166537 0
[pid=28756] ppid=28754 vsize=15396 CPUtime=6.29 cores=1
/proc/28756/stat : 28756 (clasp) R 28754 28754 28388 0 -1 4202496 1303 0 0 0 629 0 0 0 25 0 1 0 606286676 15765504 1191 33554432000 4194304 4785740 140736148989584 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28756/statm: 3849 1191 340 145 0 894 0
[pid=28757] ppid=28754 vsize=455832 CPUtime=6.29 cores=2
/proc/28757/stat : 28757 (TNM) R 28754 28754 28388 0 -1 4202496 329 0 0 0 629 0 0 0 25 0 1 0 606286676 466771968 226 33554432000 134512640 134534564 4293355200 18446744073709551615 134528212 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28757/statm: 113958 226 95 6 0 112624 0
[pid=28758] ppid=28754 vsize=7788 CPUtime=6.29 cores=3
/proc/28758/stat : 28758 (march_hi) R 28754 28754 28388 0 -1 4202496 551 0 0 0 629 0 0 0 25 0 1 0 606286676 7974912 444 33554432000 4194304 4331988 140735634453344 18446744073709551615 4211431 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28758/statm: 1947 444 172 34 0 389 0
[pid=28759] ppid=28754 vsize=129012 CPUtime=25.11 cores=4-7
/proc/28759/stat : 28759 (plingeling) S 28754 28754 28388 0 -1 4202496 9673 1251 0 0 2510 1 0 0 18 0 5 0 606286676 132108288 4392 33554432000 4194304 4356188 140735298773648 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28759/statm: 32253 4392 164 40 0 30797 0
[pid=28759/tid=28766] ppid=28754 vsize=129012 CPUtime=6.28 cores=4-7
/proc/28759/task/28766/stat : 28766 (plingeling) R 28754 28754 28388 0 -1 4202560 2329 1251 0 0 628 0 0 0 25 0 5 0 606286677 132108288 4392 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331281 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28759/tid=28767] ppid=28754 vsize=129012 CPUtime=6.28 cores=4-7
/proc/28759/task/28767/stat : 28767 (plingeling) R 28754 28754 28388 0 -1 4202560 2309 1251 0 0 628 0 0 0 25 0 5 0 606286677 132108288 4392 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331416 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28759/tid=28768] ppid=28754 vsize=129012 CPUtime=6.28 cores=4-7
/proc/28759/task/28768/stat : 28768 (plingeling) R 28754 28754 28388 0 -1 4202560 2258 1251 0 0 628 0 0 0 25 0 5 0 606286677 132108288 4392 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331199 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28759/tid=28769] ppid=28754 vsize=129012 CPUtime=6.24 cores=4-7
/proc/28759/task/28769/stat : 28769 (plingeling) R 28754 28754 28388 0 -1 4202560 2276 1251 0 0 624 0 0 0 25 0 5 0 606286677 132108288 4392 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331019 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.27
Current children cumulated vsize (KiB) 1306252

[startup+12.7009 s]
/proc/loadavg: 8.09 8.08 8.02 9/180 28769
/proc/meminfo: memFree=30452280/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 3 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
[pid=28755] ppid=28754 vsize=683984 CPUtime=12.69 cores=0
/proc/28755/stat : 28755 (cryptominisat) R 28754 28754 28388 0 -1 4202496 10499 0 0 0 1267 2 0 0 25 0 1 0 606286676 700399616 3975 33554432000 4194304 4587354 140736095065552 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28755/statm: 170996 3975 337 96 0 167558 0
[pid=28756] ppid=28754 vsize=16636 CPUtime=12.69 cores=1
/proc/28756/stat : 28756 (clasp) R 28754 28754 28388 0 -1 4202496 1614 0 0 0 1269 0 0 0 25 0 1 0 606286676 17035264 1502 33554432000 4194304 4785740 140736148989584 18446744073709551615 4550449 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28756/statm: 4159 1502 340 145 0 1204 0
[pid=28757] ppid=28754 vsize=455832 CPUtime=12.69 cores=2
/proc/28757/stat : 28757 (TNM) R 28754 28754 28388 0 -1 4202496 329 0 0 0 1269 0 0 0 25 0 1 0 606286676 466771968 226 33554432000 134512640 134534564 4293355200 18446744073709551615 134529042 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28757/statm: 113958 226 95 6 0 112624 0
[pid=28758] ppid=28754 vsize=7788 CPUtime=12.69 cores=3
/proc/28758/stat : 28758 (march_hi) R 28754 28754 28388 0 -1 4202496 565 0 0 0 1269 0 0 0 25 0 1 0 606286676 7974912 458 33554432000 4194304 4331988 140735634453344 18446744073709551615 4211456 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28758/statm: 1947 458 172 34 0 389 0
[pid=28759] ppid=28754 vsize=131968 CPUtime=50.67 cores=4-7
/proc/28759/stat : 28759 (plingeling) S 28754 28754 28388 0 -1 4202496 15052 1251 0 0 5065 2 0 0 18 0 5 0 606286676 135135232 5131 33554432000 4194304 4356188 140735298773648 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28759/statm: 32992 5131 164 40 0 31536 0
[pid=28759/tid=28766] ppid=28754 vsize=131968 CPUtime=12.68 cores=4-7
/proc/28759/task/28766/stat : 28766 (plingeling) R 28754 28754 28388 0 -1 4202560 3769 1251 0 0 1268 0 0 0 25 0 5 0 606286677 135135232 5131 33554432000 4194304 4356188 140735298773648 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28759/tid=28767] ppid=28754 vsize=131968 CPUtime=12.68 cores=4-7
/proc/28759/task/28767/stat : 28767 (plingeling) R 28754 28754 28388 0 -1 4202560 3526 1251 0 0 1268 0 0 0 25 0 5 0 606286677 135135232 5131 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331309 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28759/tid=28768] ppid=28754 vsize=131968 CPUtime=12.68 cores=4-7
/proc/28759/task/28768/stat : 28768 (plingeling) R 28754 28754 28388 0 -1 4202560 3507 1251 0 0 1268 0 0 0 25 0 5 0 606286677 135135232 5131 33554432000 4194304 4356188 140735298773648 18446744073709551615 4334484 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28759/tid=28769] ppid=28754 vsize=131968 CPUtime=12.61 cores=4-7
/proc/28759/task/28769/stat : 28769 (plingeling) R 28754 28754 28388 0 -1 4202560 3749 1251 0 0 1260 1 0 0 25 0 5 0 606286677 135135232 5131 33554432000 4194304 4356188 140735298773648 18446744073709551615 4279694 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.43
Current children cumulated vsize (KiB) 1314532

[startup+25.5006 s]
/proc/loadavg: 8.07 8.08 8.02 9/180 28769
/proc/meminfo: memFree=30444080/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 3 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
[pid=28755] ppid=28754 vsize=687536 CPUtime=25.49 cores=0
/proc/28755/stat : 28755 (cryptominisat) R 28754 28754 28388 0 -1 4202496 16528 0 0 0 2546 3 0 0 25 0 1 0 606286676 704036864 4798 33554432000 4194304 4587354 140736095065552 18446744073709551615 4238423 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=28759/tid=28766] ppid=28754 vsize=168352 CPUtime=121.48 cores=4-7
/proc/28759/task/28766/stat : 28766 (plingeling) R 28754 28754 28388 0 -1 4202560 24315 1251 0 0 12144 4 0 0 25 0 5 0 606286677 172392448 14221 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28759/tid=28767] ppid=28754 vsize=168352 CPUtime=121.47 cores=4-7
/proc/28759/task/28767/stat : 28767 (plingeling) R 28754 28754 28388 0 -1 4202560 22952 1251 0 0 12144 3 0 0 25 0 5 0 606286677 172392448 14221 33554432000 4194304 4356188 140735298773648 18446744073709551615 4332149 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28759/tid=28768] ppid=28754 vsize=168352 CPUtime=121.48 cores=4-7
/proc/28759/task/28768/stat : 28768 (plingeling) R 28754 28754 28388 0 -1 4202560 23717 1251 0 0 12145 3 0 0 25 0 5 0 606286677 172392448 14221 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331984 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28759/tid=28769] ppid=28754 vsize=168352 CPUtime=120.82 cores=4-7
/proc/28759/task/28769/stat : 28769 (plingeling) R 28754 28754 28388 0 -1 4202560 24135 1251 0 0 12077 5 0 0 25 0 5 0 606286677 172392448 14221 33554432000 4194304 4356188 140735298773648 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 971.24
Current children cumulated vsize (KiB) 1380208

[startup+127.901 s]
/proc/loadavg: 8.05 8.06 8.01 9/180 28772
/proc/meminfo: memFree=30383584/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 3 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
[pid=28755] ppid=28754 vsize=702656 CPUtime=127.89 cores=0
/proc/28755/stat : 28755 (cryptominisat) R 28754 28754 28388 0 -1 4202496 45199 0 0 0 12777 12 0 0 25 0 1 0 606286676 719519744 8558 33554432000 4194304 4587354 140736095065552 18446744073709551615 4238608 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28755/statm: 175664 8558 337 96 0 172226 0
[pid=28756] ppid=28754 vsize=24168 CPUtime=127.89 cores=1
/proc/28756/stat : 28756 (clasp) R 28754 28754 28388 0 -1 4202496 3399 0 0 0 12789 0 0 0 25 0 1 0 606286676 24748032 3287 33554432000 4194304 4785740 140736148989584 18446744073709551615 4552961 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28756/statm: 6042 3287 340 145 0 3087 0
[pid=28757] ppid=28754 vsize=455832 CPUtime=127.89 cores=2
/proc/28757/stat : 28757 (TNM) R 28754 28754 28388 0 -1 4202496 329 0 0 0 12789 0 0 0 25 0 1 0 606286676 466771968 226 33554432000 134512640 134534564 4293355200 18446744073709551615 134528464 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28757/statm: 113958 226 95 6 0 112624 0
[pid=28758] ppid=28754 vsize=11748 CPUtime=127.89 cores=3
/proc/28758/stat : 28758 (march_hi) R 28754 28754 28388 0 -1 4202496 1486 0 0 0 12788 1 0 0 25 0 1 0 606286676 12029952 1379 33554432000 4194304 4331988 140735634453344 18446744073709551615 4226496 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28758/statm: 2937 1379 173 34 0 1379 0
[pid=28759] ppid=28754 vsize=174368 CPUtime=510.85 cores=4-7
/proc/28759/stat : 28759 (plingeling) S 28754 28754 28388 0 -1 4202496 98500 1251 0 0 51068 17 0 0 18 0 5 0 606286676 178552832 15725 33554432000 4194304 4356188 140735298773648 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28759/statm: 43592 15725 164 40 0 42136 0
[pid=28759/tid=28766] ppid=28754 vsize=174368 CPUtime=127.88 cores=4-7
/proc/28759/task/28766/stat : 28766 (plingeling) R 28754 28754 28388 0 -1 4202560 25339 1251 0 0 12784 4 0 0 25 0 5 0 606286677 178552832 15725 33554432000 4194304 4356188 140735298773648 18446744073709551615 4332272 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28759/tid=28767] ppid=28754 vsize=174368 CPUtime=127.87 cores=4-7
/proc/28759/task/28767/stat : 28767 (plingeling) R 28754 28754 28388 0 -1 4202560 23624 1251 0 0 12784 3 0 0 25 0 5 0 606286677 178552832 15725 33554432000 4194304 4356188 140735298773648 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28759/tid=28768] ppid=28754 vsize=174368 CPUtime=127.88 cores=4-7
/proc/28759/task/28768/stat : 28768 (plingeling) R 28754 28754 28388 0 -1 4202560 24389 1251 0 0 12785 3 0 0 25 0 5 0 606286677 178552832 15725 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28759/tid=28769] ppid=28754 vsize=174368 CPUtime=127.18 cores=4-7
/proc/28759/task/28769/stat : 28769 (plingeling) R 28754 28754 28388 0 -1 4202560 24647 1251 0 0 12713 5 0 0 25 0 5 0 606286677 178552832 15725 33554432000 4194304 4356188 140735298773648 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1022.41
Current children cumulated vsize (KiB) 1387096

[startup+129.501 s]
/proc/loadavg: 8.05 8.06 8.01 9/180 28772
/proc/meminfo: memFree=30385072/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 3 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
[pid=28755] ppid=28754 vsize=702656 CPUtime=129.49 cores=0
/proc/28755/stat : 28755 (cryptominisat) R 28754 28754 28388 0 -1 4202496 45393 0 0 0 12937 12 0 0 25 0 1 0 606286676 719519744 8744 33554432000 4194304 4587354 140736095065552 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28755/statm: 175664 8744 337 96 0 172226 0
[pid=28756] ppid=28754 vsize=24168 CPUtime=129.49 cores=1
/proc/28756/stat : 28756 (clasp) R 28754 28754 28388 0 -1 4202496 3405 0 0 0 12949 0 0 0 25 0 1 0 606286676 24748032 3293 33554432000 4194304 4785740 140736148989584 18446744073709551615 4553035 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28756/statm: 6042 3293 340 145 0 3087 0
[pid=28757] ppid=28754 vsize=455832 CPUtime=129.49 cores=2
/proc/28757/stat : 28757 (TNM) R 28754 28754 28388 0 -1 4202496 329 0 0 0 12949 0 0 0 25 0 1 0 606286676 466771968 226 33554432000 134512640 134534564 4293355200 18446744073709551615 134528926 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28757/statm: 113958 226 95 6 0 112624 0
[pid=28758] ppid=28754 vsize=11748 CPUtime=129.49 cores=3
/proc/28758/stat : 28758 (march_hi) R 28754 28754 28388 0 -1 4202496 1511 0 0 0 12948 1 0 0 25 0 1 0 606286676 12029952 1404 33554432000 4194304 4331988 140735634453344 18446744073709551615 4226304 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28758/statm: 2937 1404 173 34 0 1379 0
[pid=28759] ppid=28754 vsize=165920 CPUtime=517.24 cores=4-7
/proc/28759/stat : 28759 (plingeling) S 28754 28754 28388 0 -1 4202496 98692 1251 0 0 51707 17 0 0 18 0 5 0 606286676 169902080 13613 33554432000 4194304 4356188 140735298773648 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28759/statm: 41480 13613 164 40 0 40024 0
[pid=28759/tid=28766] ppid=28754 vsize=165920 CPUtime=129.48 cores=4-7
/proc/28759/task/28766/stat : 28766 (plingeling) R 28754 28754 28388 0 -1 4202560 25339 1251 0 0 12944 4 0 0 25 0 5 0 606286677 169902080 13613 33554432000 4194304 4356188 140735298773648 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28759/tid=28767] ppid=28754 vsize=165920 CPUtime=129.47 cores=4-7
/proc/28759/task/28767/stat : 28767 (plingeling) R 28754 28754 28388 0 -1 4202560 23624 1251 0 0 12944 3 0 0 25 0 5 0 606286677 169902080 13613 33554432000 4194304 4356188 140735298773648 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28759/tid=28768] ppid=28754 vsize=165920 CPUtime=129.48 cores=4-7
/proc/28759/task/28768/stat : 28768 (plingeling) R 28754 28754 28388 0 -1 4202560 24389 1251 0 0 12945 3 0 0 25 0 5 0 606286677 169902080 13613 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28759/tid=28769] ppid=28754 vsize=165920 CPUtime=128.77 cores=4-7
/proc/28759/task/28769/stat : 28769 (plingeling) R 28754 28754 28388 0 -1 4202560 24839 1251 0 0 12872 5 0 0 25 0 5 0 606286677 169902080 13613 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1035.2
Current children cumulated vsize (KiB) 1378648

[startup+130.301 s]
/proc/loadavg: 8.05 8.06 8.01 9/180 28772
/proc/meminfo: memFree=30388540/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 3 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
[pid=28755] ppid=28754 vsize=704144 CPUtime=130.29 cores=0
/proc/28755/stat : 28755 (cryptominisat) R 28754 28754 28388 0 -1 4202496 46041 0 0 0 13017 12 0 0 25 0 1 0 606286676 721043456 7756 33554432000 4194304 4587354 140736095065552 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28755/statm: 176036 7756 337 96 0 172598 0
[pid=28756] ppid=28754 vsize=24168 CPUtime=130.29 cores=1
/proc/28756/stat : 28756 (clasp) R 28754 28754 28388 0 -1 4202496 3405 0 0 0 13029 0 0 0 25 0 1 0 606286676 24748032 3293 33554432000 4194304 4785740 140736148989584 18446744073709551615 4553344 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28756/statm: 6042 3293 340 145 0 3087 0
[pid=28757] ppid=28754 vsize=455832 CPUtime=130.29 cores=2
/proc/28757/stat : 28757 (TNM) R 28754 28754 28388 0 -1 4202496 329 0 0 0 13029 0 0 0 25 0 1 0 606286676 466771968 226 33554432000 134512640 134534564 4293355200 18446744073709551615 134530586 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28757/statm: 113958 226 95 6 0 112624 0
[pid=28758] ppid=28754 vsize=11748 CPUtime=130.29 cores=3
/proc/28758/stat : 28758 (march_hi) R 28754 28754 28388 0 -1 4202496 1523 0 0 0 13028 1 0 0 25 0 1 0 606286676 12029952 1416 33554432000 4194304 4331988 140735634453344 18446744073709551615 4211519 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28758/statm: 2937 1416 173 34 0 1379 0
[pid=28759] ppid=28754 vsize=162848 CPUtime=520.44 cores=4-7
/proc/28759/stat : 28759 (plingeling) S 28754 28754 28388 0 -1 4202496 98948 1251 0 0 52027 17 0 0 18 0 5 0 606286676 166756352 12845 33554432000 4194304 4356188 140735298773648 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28759/statm: 40712 12845 164 40 0 39256 0
[pid=28759/tid=28766] ppid=28754 vsize=162848 CPUtime=130.28 cores=4-7
/proc/28759/task/28766/stat : 28766 (plingeling) R 28754 28754 28388 0 -1 4202560 25339 1251 0 0 13024 4 0 0 25 0 5 0 606286677 166756352 12845 33554432000 4194304 4356188 140735298773648 18446744073709551615 4330992 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28759/tid=28767] ppid=28754 vsize=162848 CPUtime=130.27 cores=4-7
/proc/28759/task/28767/stat : 28767 (plingeling) R 28754 28754 28388 0 -1 4202560 23624 1251 0 0 13024 3 0 0 25 0 5 0 606286677 166756352 12845 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331340 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28759/tid=28768] ppid=28754 vsize=162848 CPUtime=130.28 cores=4-7
/proc/28759/task/28768/stat : 28768 (plingeling) R 28754 28754 28388 0 -1 4202560 24389 1251 0 0 13025 3 0 0 25 0 5 0 606286677 166756352 12845 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28759/tid=28769] ppid=28754 vsize=162848 CPUtime=129.57 cores=4-7
/proc/28759/task/28769/stat : 28769 (plingeling) R 28754 28754 28388 0 -1 4202560 25095 1251 0 0 12952 5 0 0 25 0 5 0 606286677 166756352 12845 33554432000 4194304 4356188 140735298773648 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1041.6
Current children cumulated vsize (KiB) 1377064

[startup+130.701 s]
/proc/loadavg: 8.05 8.06 8.01 9/180 28772
/proc/meminfo: memFree=30388540/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 3 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
[pid=28755] ppid=28754 vsize=704144 CPUtime=130.69 cores=0
/proc/28755/stat : 28755 (cryptominisat) R 28754 28754 28388 0 -1 4202496 46128 0 0 0 13057 12 0 0 25 0 1 0 606286676 721043456 7839 33554432000 4194304 4587354 140736095065552 18446744073709551615 260020092606 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28755/statm: 176036 7839 337 96 0 172598 0
[pid=28756] ppid=28754 vsize=24348 CPUtime=130.69 cores=1
/proc/28756/stat : 28756 (clasp) R 28754 28754 28388 0 -1 4202496 3424 0 0 0 13069 0 0 0 25 0 1 0 606286676 24932352 3312 33554432000 4194304 4785740 140736148989584 18446744073709551615 4550336 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28756/statm: 6087 3312 340 145 0 3132 0
[pid=28757] ppid=28754 vsize=455832 CPUtime=130.69 cores=2
/proc/28757/stat : 28757 (TNM) R 28754 28754 28388 0 -1 4202496 329 0 0 0 13069 0 0 0 25 0 1 0 606286676 466771968 226 33554432000 134512640 134534564 4293355200 18446744073709551615 134529841 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28757/statm: 113958 226 95 6 0 112624 0
[pid=28758] ppid=28754 vsize=11748 CPUtime=130.69 cores=3
/proc/28758/stat : 28758 (march_hi) R 28754 28754 28388 0 -1 4202496 1530 0 0 0 13068 1 0 0 25 0 1 0 606286676 12029952 1423 33554432000 4194304 4331988 140735634453344 18446744073709551615 4226411 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28758/statm: 2937 1423 173 34 0 1379 0
[pid=28759] ppid=28754 vsize=163488 CPUtime=522.04 cores=4-7
/proc/28759/stat : 28759 (plingeling) S 28754 28754 28388 0 -1 4202496 99108 1251 0 0 52187 17 0 0 18 0 5 0 606286676 167411712 13005 33554432000 4194304 4356188 140735298773648 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28759/statm: 40872 13005 164 40 0 39416 0
[pid=28759/tid=28766] ppid=28754 vsize=163488 CPUtime=130.68 cores=4-7
/proc/28759/task/28766/stat : 28766 (plingeling) R 28754 28754 28388 0 -1 4202560 25339 1251 0 0 13064 4 0 0 25 0 5 0 606286677 167411712 13005 33554432000 4194304 4356188 140735298773648 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28759/tid=28767] ppid=28754 vsize=163488 CPUtime=130.67 cores=4-7
/proc/28759/task/28767/stat : 28767 (plingeling) R 28754 28754 28388 0 -1 4202560 23656 1251 0 0 13064 3 0 0 25 0 5 0 606286677 167411712 13005 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28759/tid=28768] ppid=28754 vsize=163488 CPUtime=130.68 cores=4-7
/proc/28759/task/28768/stat : 28768 (plingeling) R 28754 28754 28388 0 -1 4202560 24453 1251 0 0 13065 3 0 0 25 0 5 0 606286677 167411712 13005 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28759/tid=28769] ppid=28754 vsize=163488 CPUtime=129.97 cores=4-7
/proc/28759/task/28769/stat : 28769 (plingeling) R 28754 28754 28388 0 -1 4202560 25159 1251 0 0 12992 5 0 0 25 0 5 0 606286677 167411712 13005 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1044.8
Current children cumulated vsize (KiB) 1377884

[startup+131.101 s]
/proc/loadavg: 8.05 8.06 8.01 9/180 28772
/proc/meminfo: memFree=30394740/32951124 swapFree=67111464/67111528
[pid=28754] ppid=28752 vsize=18324 CPUtime=0 cores=0-7
/proc/28754/stat : 28754 (ppfolio) S 28752 28754 28388 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 606286676 18763776 390 33554432000 4194304 4287625 140737092837824 18446744073709551615 260020416015 0 0 4096 65536 4310437978653589503 0 0 17 3 0 0 0
/proc/28754/statm: 4581 390 341 23 0 91 0
[pid=28755] ppid=28754 vsize=704144 CPUtime=131.09 cores=0
/proc/28755/stat : 28755 (cryptominisat) R 28754 28754 28388 0 -1 4202496 46204 0 0 0 13097 12 0 0 25 0 1 0 606286676 721043456 7912 33554432000 4194304 4587354 140736095065552 18446744073709551615 4238538 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28755/statm: 176036 7912 337 96 0 172598 0
[pid=28756] ppid=28754 vsize=24348 CPUtime=131.09 cores=1
/proc/28756/stat : 28756 (clasp) R 28754 28754 28388 0 -1 4202496 3424 0 0 0 13109 0 0 0 25 0 1 0 606286676 24932352 3312 33554432000 4194304 4785740 140736148989584 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28756/statm: 6087 3312 340 145 0 3132 0
[pid=28757] ppid=28754 vsize=455832 CPUtime=131.09 cores=2
/proc/28757/stat : 28757 (TNM) R 28754 28754 28388 0 -1 4202496 329 0 0 0 13109 0 0 0 25 0 1 0 606286676 466771968 226 33554432000 134512640 134534564 4293355200 18446744073709551615 134528516 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28757/statm: 113958 226 95 6 0 112624 0
[pid=28758] ppid=28754 vsize=11748 CPUtime=131.09 cores=3
/proc/28758/stat : 28758 (march_hi) R 28754 28754 28388 0 -1 4202496 1536 0 0 0 13108 1 0 0 25 0 1 0 606286676 12029952 1429 33554432000 4194304 4331988 140735634453344 18446744073709551615 4229616 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28758/statm: 2937 1429 173 34 0 1379 0
[pid=28759] ppid=28754 vsize=164000 CPUtime=523.63 cores=4-7
/proc/28759/stat : 28759 (plingeling) S 28754 28754 28388 0 -1 4202496 99236 1251 0 0 52346 17 0 0 18 0 5 0 606286676 167936000 13133 33554432000 4194304 4356188 140735298773648 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28759/statm: 41000 13133 164 40 0 39544 0
[pid=28759/tid=28766] ppid=28754 vsize=164000 CPUtime=131.08 cores=4-7
/proc/28759/task/28766/stat : 28766 (plingeling) R 28754 28754 28388 0 -1 4202560 25339 1251 0 0 13104 4 0 0 25 0 5 0 606286677 167936000 13133 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28759/tid=28767] ppid=28754 vsize=164000 CPUtime=131.07 cores=4-7
/proc/28759/task/28767/stat : 28767 (plingeling) R 28754 28754 28388 0 -1 4202560 23656 1251 0 0 13104 3 0 0 25 0 5 0 606286677 167936000 13133 33554432000 4194304 4356188 140735298773648 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28759/tid=28768] ppid=28754 vsize=164000 CPUtime=131.08 cores=4-7
/proc/28759/task/28768/stat : 28768 (plingeling) R 28754 28754 28388 0 -1 4202560 24453 1251 0 0 13105 3 0 0 25 0 5 0 606286677 167936000 13133 33554432000 4194304 4356188 140735298773648 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28759/tid=28769] ppid=28754 vsize=164000 CPUtime=130.36 cores=4-7
/proc/28759/task/28769/stat : 28769 (plingeling) R 28754 28754 28388 0 -1 4202560 25287 1251 0 0 13031 5 0 0 25 0 5 0 606286677 167936000 13133 33554432000 4194304 4356188 140735298773648 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1047.99
Current children cumulated vsize (KiB) 1378396

Child status: 0
Real time (s): 131.117
CPU time (s): 1048.15
CPU user time (s): 1047.81
CPU system time (s): 0.345947
CPU usage (%): 799.405
Max. virtual memory (cumulated for all children) (KiB): 1388376

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1047.81
system time used= 0.345947
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 152524
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1726
involuntary context switches= 5320

runsolver used 0.228965 second user time and 0.486925 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-30 12:49:21
IDJOB=3220959
IDBENCH=82843
IDSOLVER=1638
FILE ID=node110/3220959-1304160561
RUNJOBID= node110-1304156062-28402
PBS_JOBID= 13170909
Free space on /tmp= 73476 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v450-c1917-S1910317962-059.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3220959-1304160561/watcher-3220959-1304160561 -o /tmp/evaluation-result-3220959-1304160561/solver-3220959-1304160561 -C 40000 -W 5000 -M 31000  ppfolio HOME/instance-3220959-1304160561.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= dc676a8dc341229efc4ee05b1ab19ceb
RANDOM SEED=1158266142

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30490544 kB
Buffers:        989628 kB
Cached:         990088 kB
SwapCached:         64 kB
Active:         289704 kB
Inactive:      1754228 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30490544 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:           10116 kB
Writeback:           0 kB
AnonPages:       64224 kB
Mapped:          14828 kB
Slab:           348844 kB
PageTables:       4656 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   189320 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73464 MiB
End job on node110 at 2011-04-30 12:51:32