Trace number 3310134

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 290.997 36.8602

General information on the benchmark

Nameindustrial/manolios/
manol-pipe-f7idw.cnf
MD5SUMe11b8f7666247454d93edb47f1646e2c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark19.0941
Satisfiable
(Un)Satisfiability was proved
Number of variables263022
Number of clauses782329
Sum of the clauses size1825433
Maximum clause length3
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2521552
Number of clauses of size 3260776
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
290.70/36.83	s UNSATISFIABLE
290.70/36.86	solver [5] plingeling 276-6264d55-100731 answered
290.70/36.86	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310134-1303991891/watcher-3310134-1303991891 -o /tmp/evaluation-result-3310134-1303991891/solver-3310134-1303991891 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310134-1303991891.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.98 7.97 7.91 3/170 28601
/proc/meminfo: memFree=11933896/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) R 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0

[startup+0.089525 s]
/proc/loadavg: 7.98 7.97 7.91 3/170 28601
/proc/meminfo: memFree=11933896/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100516 s]
/proc/loadavg: 7.98 7.97 7.91 3/170 28601
/proc/meminfo: memFree=11933896/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300484 s]
/proc/loadavg: 7.98 7.97 7.91 3/170 28601
/proc/meminfo: memFree=11933896/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700411 s]
/proc/loadavg: 7.98 7.97 7.91 3/170 28601
/proc/meminfo: memFree=11933896/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 22 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50124 s]
/proc/loadavg: 7.98 7.97 7.91 6/176 28612
/proc/meminfo: memFree=11422236/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 22 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
[pid=28602] ppid=28601 vsize=116688 CPUtime=1.48 cores=0
/proc/28602/stat : 28602 (cryptominisat) R 28601 28601 28322 0 -1 4202496 23390 0 0 0 145 3 0 0 20 0 1 0 510789603 119488512 22537 33554432000 4194304 4587354 140733267079232 18446744073709551615 4230299 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28602/statm: 29172 22537 306 96 0 25734 0
[pid=28603] ppid=28601 vsize=159988 CPUtime=1.49 cores=1
/proc/28603/stat : 28603 (clasp) R 28601 28601 28322 0 -1 4202496 42899 0 0 0 143 6 0 0 20 0 1 0 510789603 163827712 35950 33554432000 4194304 4785740 140735726067680 18446744073709551615 4489799 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28603/statm: 39997 35951 319 145 0 37042 0
[pid=28604] ppid=28601 vsize=506644 CPUtime=1.49 cores=2
/proc/28604/stat : 28604 (TNM) R 28601 28601 28322 0 -1 4202496 27077 0 0 0 145 4 0 0 20 0 1 0 510789603 518803456 26974 33554432000 134512640 134534564 4293932720 18446744073709551615 134529944 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28604/statm: 126661 26974 95 6 0 125327 0
[pid=28605] ppid=28601 vsize=135340 CPUtime=1.49 cores=3
/proc/28605/stat : 28605 (march_hi) R 28601 28601 28322 0 -1 4194304 56873 0 0 0 142 7 0 0 20 0 1 0 510789603 138588160 22967 33554432000 4194304 4331988 140733319386240 18446744073709551615 4251963 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28605/statm: 33835 22967 129 34 0 32277 0
[pid=28606] ppid=28601 vsize=178884 CPUtime=2.83 cores=4-7
/proc/28606/stat : 28606 (plingeling) S 28601 28601 28322 0 -1 4202496 49302 1250 0 0 277 6 0 0 18 0 5 0 510789603 183177216 33158 33554432000 4194304 4356188 140737123219104 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28606/statm: 44721 33158 143 40 0 43265 0
Current children cumulated CPU time (s) 8.78
Current children cumulated vsize (KiB) 1115868

[startup+3.10094 s]
/proc/loadavg: 7.98 7.97 7.91 9/180 28616
/proc/meminfo: memFree=11210784/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
[pid=28602] ppid=28601 vsize=176788 CPUtime=3.09 cores=0
/proc/28602/stat : 28602 (cryptominisat) R 28601 28601 28322 0 -1 4202496 40244 0 0 0 303 6 0 0 25 0 1 0 510789603 181030912 37330 33554432000 4194304 4587354 140733267079232 18446744073709551615 4388368 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28602/statm: 44197 37330 316 96 0 40759 0
[pid=28603] ppid=28601 vsize=176880 CPUtime=3.09 cores=1
/proc/28603/stat : 28603 (clasp) R 28601 28601 28322 0 -1 4202496 47120 0 0 0 302 7 0 0 25 0 1 0 510789603 181125120 40171 33554432000 4194304 4785740 140735726067680 18446744073709551615 4500162 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28603/statm: 44220 40171 319 145 0 41265 0
[pid=28604] ppid=28601 vsize=506644 CPUtime=3.09 cores=2
/proc/28604/stat : 28604 (TNM) R 28601 28601 28322 0 -1 4202496 27077 0 0 0 305 4 0 0 25 0 1 0 510789603 518803456 26974 33554432000 134512640 134534564 4293932720 18446744073709551615 134529352 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28604/statm: 126661 26974 95 6 0 125327 0
[pid=28605] ppid=28601 vsize=127096 CPUtime=3.09 cores=3
/proc/28605/stat : 28605 (march_hi) R 28601 28601 28322 0 -1 4202496 137822 0 0 0 288 21 0 0 25 0 1 0 510789603 130146304 22464 33554432000 4194304 4331988 140733319386240 18446744073709551615 4257036 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28605/statm: 31774 22464 143 34 0 30216 0
[pid=28606] ppid=28601 vsize=221504 CPUtime=9.23 cores=4-7
/proc/28606/stat : 28606 (plingeling) S 28601 28601 28322 0 -1 4202496 94234 1250 0 0 910 13 0 0 18 0 5 0 510789603 226820096 43798 33554432000 4194304 4356188 140737123219104 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28606/statm: 55376 43798 160 40 0 53920 0
[pid=28606/tid=28613] ppid=28601 vsize=221504 CPUtime=2.05 cores=4-7
/proc/28606/task/28613/stat : 28613 (plingeling) R 28601 28601 28322 0 -1 4202560 8447 1250 0 0 204 1 0 0 21 0 5 0 510789706 226820096 43798 33554432000 4194304 4356188 140737123219104 18446744073709551615 4314802 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28606/tid=28614] ppid=28601 vsize=221504 CPUtime=2.02 cores=4-7
/proc/28606/task/28614/stat : 28614 (plingeling) R 28601 28601 28322 0 -1 4202560 9464 1250 0 0 201 1 0 0 25 0 5 0 510789706 226820096 43798 33554432000 4194304 4356188 140737123219104 18446744073709551615 4315078 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28606/tid=28615] ppid=28601 vsize=221504 CPUtime=2.05 cores=4-7
/proc/28606/task/28615/stat : 28615 (plingeling) R 28601 28601 28322 0 -1 4202560 11299 1250 0 0 203 2 0 0 25 0 5 0 510789706 226820096 43798 33554432000 4194304 4356188 140737123219104 18446744073709551615 4322016 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28606/tid=28616] ppid=28601 vsize=221504 CPUtime=2.05 cores=4-7
/proc/28606/task/28616/stat : 28616 (plingeling) R 28601 28601 28322 0 -1 4202560 16292 1250 0 0 203 2 0 0 21 0 5 0 510789706 226820096 43798 33554432000 4194304 4356188 140737123219104 18446744073709551615 4211007 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 21.59
Current children cumulated vsize (KiB) 1227236

[startup+6.30136 s]
/proc/loadavg: 7.98 7.97 7.91 9/180 28616
/proc/meminfo: memFree=11013376/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
[pid=28602] ppid=28601 vsize=286588 CPUtime=6.28 cores=0
/proc/28602/stat : 28602 (cryptominisat) R 28601 28601 28322 0 -1 4202496 64767 0 0 0 619 9 0 0 25 0 1 0 510789603 293466112 58222 33554432000 4194304 4587354 140733267079232 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28602/statm: 71647 58222 330 96 0 68209 0
[pid=28603] ppid=28601 vsize=169628 CPUtime=6.28 cores=1
/proc/28603/stat : 28603 (clasp) R 28601 28601 28322 0 -1 4202496 49979 0 0 0 621 7 0 0 25 0 1 0 510789603 173699072 38933 33554432000 4194304 4785740 140735726067680 18446744073709551615 4319144 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28603/statm: 42407 38933 340 145 0 39452 0
[pid=28604] ppid=28601 vsize=506644 CPUtime=6.29 cores=2
/proc/28604/stat : 28604 (TNM) R 28601 28601 28322 0 -1 4202496 27077 0 0 0 625 4 0 0 25 0 1 0 510789603 518803456 26974 33554432000 134512640 134534564 4293932720 18446744073709551615 134529953 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28604/statm: 126661 26974 95 6 0 125327 0
[pid=28605] ppid=28601 vsize=504544 CPUtime=6.29 cores=3
/proc/28605/stat : 28605 (march_hi) R 28601 28601 28322 0 -1 4202496 234789 0 0 0 596 33 0 0 25 0 1 0 510789603 516653056 63697 33554432000 4194304 4331988 140733319386240 18446744073709551615 4299861 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28605/statm: 126136 63697 173 34 0 124578 0
[pid=28606] ppid=28601 vsize=281116 CPUtime=22.01 cores=4-7
/proc/28606/stat : 28606 (plingeling) S 28601 28601 28322 0 -1 4202496 109159 1250 0 0 2186 15 0 0 18 0 5 0 510789603 287862784 58723 33554432000 4194304 4356188 140737123219104 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28606/statm: 70279 58723 164 40 0 68823 0
[pid=28606/tid=28613] ppid=28601 vsize=281116 CPUtime=5.26 cores=4-7
/proc/28606/task/28613/stat : 28613 (plingeling) R 28601 28601 28322 0 -1 4202560 13299 1250 0 0 524 2 0 0 25 0 5 0 510789706 287862784 58723 33554432000 4194304 4356188 140737123219104 18446744073709551615 4231350 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28606/tid=28614] ppid=28601 vsize=281116 CPUtime=5.2 cores=4-7
/proc/28606/task/28614/stat : 28614 (plingeling) R 28601 28601 28322 0 -1 4202560 13566 1250 0 0 518 2 0 0 25 0 5 0 510789706 287862784 58723 33554432000 4194304 4356188 140737123219104 18446744073709551615 4320310 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28606/tid=28615] ppid=28601 vsize=281116 CPUtime=5.25 cores=4-7
/proc/28606/task/28615/stat : 28615 (plingeling) R 28601 28601 28322 0 -1 4202560 15405 1250 0 0 523 2 0 0 25 0 5 0 510789706 287862784 58723 33554432000 4194304 4356188 140737123219104 18446744073709551615 4301736 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28606/tid=28616] ppid=28601 vsize=281116 CPUtime=5.25 cores=4-7
/proc/28606/task/28616/stat : 28616 (plingeling) R 28601 28601 28322 0 -1 4202560 18157 1250 0 0 523 2 0 0 25 0 5 0 510789706 287862784 58723 33554432000 4194304 4356188 140737123219104 18446744073709551615 4258530 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 47.15
Current children cumulated vsize (KiB) 1766844

[startup+12.7012 s]
/proc/loadavg: 7.99 7.97 7.91 9/180 28616
/proc/meminfo: memFree=10727728/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
[pid=28602] ppid=28601 vsize=286588 CPUtime=12.69 cores=0
/proc/28602/stat : 28602 (cryptominisat) R 28601 28601 28322 0 -1 4202496 65070 0 0 0 1259 10 0 0 25 0 1 0 510789603 293466112 58512 33554432000 4194304 4587354 140733267079232 18446744073709551615 4238258 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28602/statm: 71647 58512 330 96 0 68209 0
[pid=28603] ppid=28601 vsize=169628 CPUtime=12.68 cores=1
/proc/28603/stat : 28603 (clasp) R 28601 28601 28322 0 -1 4202496 49979 0 0 0 1261 7 0 0 25 0 1 0 510789603 173699072 38933 33554432000 4194304 4785740 140735726067680 18446744073709551615 4319109 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28603/statm: 42407 38933 340 145 0 39452 0
[pid=28604] ppid=28601 vsize=506644 CPUtime=12.69 cores=2
/proc/28604/stat : 28604 (TNM) R 28601 28601 28322 0 -1 4202496 27077 0 0 0 1265 4 0 0 25 0 1 0 510789603 518803456 26974 33554432000 134512640 134534564 4293932720 18446744073709551615 134525904 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28604/statm: 126661 26974 95 6 0 125327 0
[pid=28605] ppid=28601 vsize=515072 CPUtime=12.69 cores=3
/proc/28605/stat : 28605 (march_hi) R 28601 28601 28322 0 -1 4202496 284330 0 0 0 1230 39 0 0 25 0 1 0 510789603 527433728 113238 33554432000 4194304 4331988 140733319386240 18446744073709551615 4229533 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28605/statm: 128768 113238 173 34 0 127210 0
[pid=28606] ppid=28601 vsize=286844 CPUtime=47.56 cores=4-7
/proc/28606/stat : 28606 (plingeling) S 28601 28601 28322 0 -1 4202496 123498 1250 0 0 4740 16 0 0 18 0 5 0 510789603 293728256 60155 33554432000 4194304 4356188 140737123219104 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28606/statm: 71711 60155 164 40 0 70255 0
[pid=28606/tid=28613] ppid=28601 vsize=286844 CPUtime=11.65 cores=4-7
/proc/28606/task/28613/stat : 28613 (plingeling) R 28601 28601 28322 0 -1 4202560 17396 1250 0 0 1163 2 0 0 25 0 5 0 510789706 293728256 60155 33554432000 4194304 4356188 140737123219104 18446744073709551615 4331738 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28606/tid=28614] ppid=28601 vsize=286844 CPUtime=11.56 cores=4-7
/proc/28606/task/28614/stat : 28614 (plingeling) R 28601 28601 28322 0 -1 4202560 19711 1250 0 0 1154 2 0 0 25 0 5 0 510789706 293728256 60155 33554432000 4194304 4356188 140737123219104 18446744073709551615 4250488 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28606/tid=28615] ppid=28601 vsize=286844 CPUtime=11.64 cores=4-7
/proc/28606/task/28615/stat : 28615 (plingeling) R 28601 28601 28322 0 -1 4202560 19502 1250 0 0 1162 2 0 0 25 0 5 0 510789706 293728256 60155 33554432000 4194304 4356188 140737123219104 18446744073709551615 4259367 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28606/tid=28616] ppid=28601 vsize=286844 CPUtime=11.65 cores=4-7
/proc/28606/task/28616/stat : 28616 (plingeling) R 28601 28601 28322 0 -1 4202560 18157 1250 0 0 1163 2 0 0 25 0 5 0 510789706 293728256 60155 33554432000 4194304 4356188 140737123219104 18446744073709551615 4334477 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 98.31
Current children cumulated vsize (KiB) 1783100

[startup+25.5008 s]
/proc/loadavg: 7.99 7.97 7.91 9/180 28616
/proc/meminfo: memFree=10756424/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
[pid=28602] ppid=28601 vsize=292044 CPUtime=25.49 cores=0
/proc/28602/stat : 28602 (cryptominisat) R 28601 28601 28322 0 -1 4202496 69120 0 0 0 2539 10 0 0 25 0 1 0 510789603 299053056 62255 33554432000 4194304 4587354 140733267079232 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28602/statm: 73011 62255 336 96 0 69573 0
[pid=28603] ppid=28601 vsize=169628 CPUtime=25.48 cores=1
/proc/28603/stat : 28603 (clasp) R 28601 28601 28322 0 -1 4202496 49979 0 0 0 2541 7 0 0 25 0 1 0 510789603 173699072 38933 33554432000 4194304 4785740 140735726067680 18446744073709551615 4286927 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28603/statm: 42407 38933 340 145 0 39452 0
[pid=28604] ppid=28601 vsize=506644 CPUtime=25.49 cores=2
/proc/28604/stat : 28604 (TNM) R 28601 28601 28322 0 -1 4202496 27077 0 0 0 2545 4 0 0 25 0 1 0 510789603 518803456 26974 33554432000 134512640 134534564 4293932720 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28604/statm: 126661 26974 95 6 0 125327 0
[pid=28605] ppid=28601 vsize=518008 CPUtime=25.49 cores=3

################
# More data... #
################

/proc/28604/stat : 28604 (TNM) R 28601 28601 28322 0 -1 4202496 27077 0 0 0 3185 4 0 0 25 0 1 0 510789603 518803456 26974 33554432000 134512640 134534564 4293932720 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28604/statm: 126661 26974 95 6 0 125327 0
[pid=28605] ppid=28601 vsize=518820 CPUtime=31.89 cores=3
/proc/28605/stat : 28605 (march_hi) R 28601 28601 28322 0 -1 4202496 285288 0 0 0 3150 39 0 0 25 0 1 0 510789603 531271680 114196 33554432000 4194304 4331988 140733319386240 18446744073709551615 4229599 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28605/statm: 129705 114196 173 34 0 128147 0
[pid=28606] ppid=28601 vsize=249784 CPUtime=124.29 cores=4-7
/proc/28606/stat : 28606 (plingeling) S 28601 28601 28322 0 -1 4202496 123498 1250 0 0 12412 17 0 0 18 0 5 0 510789603 255778816 50922 33554432000 4194304 4356188 140737123219104 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28606/statm: 62446 50922 164 40 0 60990 0
[pid=28606/tid=28613] ppid=28601 vsize=249784 CPUtime=30.86 cores=4-7
/proc/28606/task/28613/stat : 28613 (plingeling) R 28601 28601 28322 0 -1 4202560 17396 1250 0 0 3084 2 0 0 25 0 5 0 510789706 255778816 50922 33554432000 4194304 4356188 140737123219104 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28606/tid=28614] ppid=28601 vsize=249784 CPUtime=30.66 cores=4-7
/proc/28606/task/28614/stat : 28614 (plingeling) R 28601 28601 28322 0 -1 4202560 19711 1250 0 0 3064 2 0 0 25 0 5 0 510789706 255778816 50922 33554432000 4194304 4356188 140737123219104 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28606/tid=28615] ppid=28601 vsize=249784 CPUtime=30.85 cores=4-7
/proc/28606/task/28615/stat : 28615 (plingeling) R 28601 28601 28322 0 -1 4202560 19502 1250 0 0 3082 3 0 0 25 0 5 0 510789706 255778816 50922 33554432000 4194304 4356188 140737123219104 18446744073709551615 4331861 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28606/tid=28616] ppid=28601 vsize=249784 CPUtime=30.85 cores=4-7
/proc/28606/task/28616/stat : 28616 (plingeling) R 28601 28601 28322 0 -1 4202560 18157 1250 0 0 3083 2 0 0 25 0 5 0 510789706 255778816 50922 33554432000 4194304 4356188 140737123219104 18446744073709551615 4330889 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 251.86
Current children cumulated vsize (KiB) 1755376

[startup+35.1011 s]
/proc/loadavg: 7.99 7.97 7.91 9/180 28617
/proc/meminfo: memFree=10760888/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
[pid=28602] ppid=28601 vsize=292044 CPUtime=35.09 cores=0
/proc/28602/stat : 28602 (cryptominisat) R 28601 28601 28322 0 -1 4202496 69448 0 0 0 3499 10 0 0 25 0 1 0 510789603 299053056 62568 33554432000 4194304 4587354 140733267079232 18446744073709551615 4388261 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28602/statm: 73011 62568 336 96 0 69573 0
[pid=28603] ppid=28601 vsize=171236 CPUtime=35.1 cores=1
/proc/28603/stat : 28603 (clasp) R 28601 28601 28322 0 -1 4202496 50561 0 0 0 3502 8 0 0 25 0 1 0 510789603 175345664 39515 33554432000 4194304 4785740 140735726067680 18446744073709551615 4312619 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28603/statm: 42809 39515 340 145 0 39854 0
[pid=28604] ppid=28601 vsize=506644 CPUtime=35.09 cores=2
/proc/28604/stat : 28604 (TNM) R 28601 28601 28322 0 -1 4202496 27077 0 0 0 3505 4 0 0 25 0 1 0 510789603 518803456 26974 33554432000 134512640 134534564 4293932720 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28604/statm: 126661 26974 95 6 0 125327 0
[pid=28605] ppid=28601 vsize=519096 CPUtime=35.09 cores=3
/proc/28605/stat : 28605 (march_hi) R 28601 28601 28322 0 -1 4202496 285346 0 0 0 3470 39 0 0 25 0 1 0 510789603 531554304 114254 33554432000 4194304 4331988 140733319386240 18446744073709551615 4229439 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28605/statm: 129774 114254 173 34 0 128216 0
[pid=28606] ppid=28601 vsize=249768 CPUtime=137.07 cores=4-7
/proc/28606/stat : 28606 (plingeling) S 28601 28601 28322 0 -1 4202496 123498 1250 0 0 13690 17 0 0 18 0 5 0 510789603 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28606/statm: 62442 50918 164 40 0 60986 0
[pid=28606/tid=28613] ppid=28601 vsize=249768 CPUtime=34.06 cores=4-7
/proc/28606/task/28613/stat : 28613 (plingeling) R 28601 28601 28322 0 -1 4202560 17396 1250 0 0 3404 2 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4233438 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28606/tid=28614] ppid=28601 vsize=249768 CPUtime=33.84 cores=4-7
/proc/28606/task/28614/stat : 28614 (plingeling) R 28601 28601 28322 0 -1 4202560 19711 1250 0 0 3382 2 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4234276 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28606/tid=28615] ppid=28601 vsize=249768 CPUtime=34.05 cores=4-7
/proc/28606/task/28615/stat : 28615 (plingeling) R 28601 28601 28322 0 -1 4202560 19502 1250 0 0 3402 3 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4225618 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28606/tid=28616] ppid=28601 vsize=249768 CPUtime=34.05 cores=4-7
/proc/28606/task/28616/stat : 28616 (plingeling) R 28601 28601 28322 0 -1 4202560 18157 1250 0 0 3403 2 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4237379 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 277.44
Current children cumulated vsize (KiB) 1757112

[startup+35.9009 s]
/proc/loadavg: 7.99 7.97 7.91 9/180 28617
/proc/meminfo: memFree=10760888/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
[pid=28602] ppid=28601 vsize=292044 CPUtime=35.89 cores=0
/proc/28602/stat : 28602 (cryptominisat) R 28601 28601 28322 0 -1 4202496 69465 0 0 0 3579 10 0 0 25 0 1 0 510789603 299053056 62581 33554432000 4194304 4587354 140733267079232 18446744073709551615 4463504 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28602/statm: 73011 62581 336 96 0 69573 0
[pid=28603] ppid=28601 vsize=171236 CPUtime=35.89 cores=1
/proc/28603/stat : 28603 (clasp) R 28601 28601 28322 0 -1 4202496 50582 0 0 0 3581 8 0 0 25 0 1 0 510789603 175345664 39536 33554432000 4194304 4785740 140735726067680 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28603/statm: 42809 39536 340 145 0 39854 0
[pid=28604] ppid=28601 vsize=506644 CPUtime=35.88 cores=2
/proc/28604/stat : 28604 (TNM) R 28601 28601 28322 0 -1 4202496 27077 0 0 0 3584 4 0 0 25 0 1 0 510789603 518803456 26974 33554432000 134512640 134534564 4293932720 18446744073709551615 134530582 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28604/statm: 126661 26974 95 6 0 125327 0
[pid=28605] ppid=28601 vsize=519096 CPUtime=35.88 cores=3
/proc/28605/stat : 28605 (march_hi) R 28601 28601 28322 0 -1 4202496 285351 0 0 0 3549 39 0 0 25 0 1 0 510789603 531554304 114259 33554432000 4194304 4331988 140733319386240 18446744073709551615 4229471 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28605/statm: 129774 114259 173 34 0 128216 0
[pid=28606] ppid=28601 vsize=249768 CPUtime=140.25 cores=4-7
/proc/28606/stat : 28606 (plingeling) S 28601 28601 28322 0 -1 4202496 123498 1250 0 0 14008 17 0 0 18 0 5 0 510789603 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28606/statm: 62442 50918 164 40 0 60986 0
[pid=28606/tid=28613] ppid=28601 vsize=249768 CPUtime=34.85 cores=4-7
/proc/28606/task/28613/stat : 28613 (plingeling) R 28601 28601 28322 0 -1 4202560 17396 1250 0 0 3483 2 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4270898 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28606/tid=28614] ppid=28601 vsize=249768 CPUtime=34.63 cores=4-7
/proc/28606/task/28614/stat : 28614 (plingeling) R 28601 28601 28322 0 -1 4202560 19711 1250 0 0 3461 2 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4260245 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28606/tid=28615] ppid=28601 vsize=249768 CPUtime=34.85 cores=4-7
/proc/28606/task/28615/stat : 28615 (plingeling) R 28601 28601 28322 0 -1 4202560 19502 1250 0 0 3482 3 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28606/tid=28616] ppid=28601 vsize=249768 CPUtime=34.85 cores=4-7
/proc/28606/task/28616/stat : 28616 (plingeling) R 28601 28601 28322 0 -1 4202560 18157 1250 0 0 3483 2 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4331039 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 283.79
Current children cumulated vsize (KiB) 1757112

[startup+36.3069 s]
/proc/loadavg: 7.99 7.97 7.91 9/180 28617
/proc/meminfo: memFree=10760516/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
[pid=28602] ppid=28601 vsize=292044 CPUtime=36.29 cores=0
/proc/28602/stat : 28602 (cryptominisat) R 28601 28601 28322 0 -1 4202496 69468 0 0 0 3619 10 0 0 25 0 1 0 510789603 299053056 62584 33554432000 4194304 4587354 140733267079232 18446744073709551615 4238224 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28602/statm: 73011 62584 336 96 0 69573 0
[pid=28603] ppid=28601 vsize=171500 CPUtime=36.3 cores=1
/proc/28603/stat : 28603 (clasp) R 28601 28601 28322 0 -1 4202496 50650 0 0 0 3622 8 0 0 25 0 1 0 510789603 175616000 39604 33554432000 4194304 4785740 140735726067680 18446744073709551615 4312619 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28603/statm: 42875 39604 340 145 0 39920 0
[pid=28604] ppid=28601 vsize=506644 CPUtime=36.29 cores=2
/proc/28604/stat : 28604 (TNM) R 28601 28601 28322 0 -1 4202496 27077 0 0 0 3625 4 0 0 25 0 1 0 510789603 518803456 26974 33554432000 134512640 134534564 4293932720 18446744073709551615 134530126 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28604/statm: 126661 26974 95 6 0 125327 0
[pid=28605] ppid=28601 vsize=519096 CPUtime=36.29 cores=3
/proc/28605/stat : 28605 (march_hi) R 28601 28601 28322 0 -1 4202496 285354 0 0 0 3590 39 0 0 25 0 1 0 510789603 531554304 114262 33554432000 4194304 4331988 140733319386240 18446744073709551615 4263238 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28605/statm: 129774 114262 173 34 0 128216 0
[pid=28606] ppid=28601 vsize=249768 CPUtime=141.86 cores=4-7
/proc/28606/stat : 28606 (plingeling) S 28601 28601 28322 0 -1 4202496 123498 1250 0 0 14169 17 0 0 18 0 5 0 510789603 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28606/statm: 62442 50918 164 40 0 60986 0
[pid=28606/tid=28613] ppid=28601 vsize=249768 CPUtime=35.26 cores=4-7
/proc/28606/task/28613/stat : 28613 (plingeling) R 28601 28601 28322 0 -1 4202560 17396 1250 0 0 3524 2 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4261931 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28606/tid=28614] ppid=28601 vsize=249768 CPUtime=35.03 cores=4-7
/proc/28606/task/28614/stat : 28614 (plingeling) R 28601 28601 28322 0 -1 4202560 19711 1250 0 0 3501 2 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4303213 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28606/tid=28615] ppid=28601 vsize=249768 CPUtime=35.25 cores=4-7
/proc/28606/task/28615/stat : 28615 (plingeling) R 28601 28601 28322 0 -1 4202560 19502 1250 0 0 3522 3 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4225618 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28606/tid=28616] ppid=28601 vsize=249768 CPUtime=35.25 cores=4-7
/proc/28606/task/28616/stat : 28616 (plingeling) R 28601 28601 28322 0 -1 4202560 18157 1250 0 0 3523 2 0 0 25 0 5 0 510789706 255762432 50918 33554432000 4194304 4356188 140737123219104 18446744073709551615 4334538 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 287.03
Current children cumulated vsize (KiB) 1757376

[startup+36.7008 s]
/proc/loadavg: 7.99 7.97 7.91 9/180 28617
/proc/meminfo: memFree=10760516/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
[pid=28602] ppid=28601 vsize=292044 CPUtime=36.69 cores=0
/proc/28602/stat : 28602 (cryptominisat) R 28601 28601 28322 0 -1 4202496 69471 0 0 0 3659 10 0 0 25 0 1 0 510789603 299053056 62587 33554432000 4194304 4587354 140733267079232 18446744073709551615 4230288 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28602/statm: 73011 62587 336 96 0 69573 0
[pid=28603] ppid=28601 vsize=171632 CPUtime=36.69 cores=1
/proc/28603/stat : 28603 (clasp) R 28601 28601 28322 0 -1 4202496 50700 0 0 0 3661 8 0 0 25 0 1 0 510789603 175751168 39654 33554432000 4194304 4785740 140735726067680 18446744073709551615 4552646 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28603/statm: 42908 39654 340 145 0 39953 0
[pid=28604] ppid=28601 vsize=506644 CPUtime=36.68 cores=2
/proc/28604/stat : 28604 (TNM) R 28601 28601 28322 0 -1 4202496 27077 0 0 0 3664 4 0 0 25 0 1 0 510789603 518803456 26974 33554432000 134512640 134534564 4293932720 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28604/statm: 126661 26974 95 6 0 125327 0
[pid=28605] ppid=28601 vsize=519096 CPUtime=36.68 cores=3
/proc/28605/stat : 28605 (march_hi) R 28601 28601 28322 0 -1 4202496 285359 0 0 0 3629 39 0 0 25 0 1 0 510789603 531554304 114267 33554432000 4194304 4331988 140733319386240 18446744073709551615 4226457 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28605/statm: 129774 114267 173 34 0 128216 0
[pid=28606] ppid=28601 vsize=249756 CPUtime=143.43 cores=4-7
/proc/28606/stat : 28606 (plingeling) S 28601 28601 28322 0 -1 4202496 123499 1250 0 0 14326 17 0 0 18 0 4 0 510789603 255750144 50916 33554432000 4194304 4356188 140737123219104 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28606/statm: 62439 50916 165 40 0 60983 0
[pid=28606/tid=28613] ppid=28601 vsize=249756 CPUtime=35.65 cores=4-7
/proc/28606/task/28613/stat : 28613 (plingeling) R 28601 28601 28322 0 -1 4202560 17396 1250 0 0 3563 2 0 0 25 0 4 0 510789706 255750144 50916 33554432000 4194304 4356188 140737123219104 18446744073709551615 4338724 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28606/tid=28614] ppid=28601 vsize=249756 CPUtime=35.43 cores=4-7
/proc/28606/task/28614/stat : 28614 (plingeling) R 28601 28601 28322 0 -1 4202560 19711 1250 0 0 3541 2 0 0 25 0 4 0 510789706 255750144 50916 33554432000 4194304 4356188 140737123219104 18446744073709551615 4217717 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=28606/tid=28616] ppid=28601 vsize=249756 CPUtime=35.65 cores=4-7
/proc/28606/task/28616/stat : 28616 (plingeling) R 28601 28601 28322 0 -1 4202560 18157 1250 0 0 3563 2 0 0 25 0 4 0 510789706 255750144 50916 33554432000 4194304 4356188 140737123219104 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 290.17
Current children cumulated vsize (KiB) 1757496

[startup+36.8008 s]
/proc/loadavg: 7.99 7.97 7.91 9/180 28617
/proc/meminfo: memFree=10760516/32951124 swapFree=67111528/67111528
[pid=28601] ppid=28599 vsize=18324 CPUtime=0 cores=0-7
/proc/28601/stat : 28601 (ppfolio) S 28599 28601 28322 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 510789603 18763776 389 33554432000 4194304 4287625 140737308046032 18446744073709551615 230809185807 0 0 4096 65536 4578279560935636991 0 0 17 4 0 0 0
/proc/28601/statm: 4581 389 341 23 0 91 0
[pid=28602] ppid=28601 vsize=292044 CPUtime=36.79 cores=0
/proc/28602/stat : 28602 (cryptominisat) R 28601 28601 28322 0 -1 4202496 69472 0 0 0 3669 10 0 0 25 0 1 0 510789603 299053056 62588 33554432000 4194304 4587354 140733267079232 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28602/statm: 73011 62588 336 96 0 69573 0
[pid=28603] ppid=28601 vsize=171764 CPUtime=36.79 cores=1
/proc/28603/stat : 28603 (clasp) R 28601 28601 28322 0 -1 4202496 50716 0 0 0 3671 8 0 0 25 0 1 0 510789603 175886336 39670 33554432000 4194304 4785740 140735726067680 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28603/statm: 42941 39670 340 145 0 39986 0
[pid=28604] ppid=28601 vsize=506644 CPUtime=36.78 cores=2
/proc/28604/stat : 28604 (TNM) R 28601 28601 28322 0 -1 4202496 27077 0 0 0 3674 4 0 0 25 0 1 0 510789603 518803456 26974 33554432000 134512640 134534564 4293932720 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28604/statm: 126661 26974 95 6 0 125327 0
[pid=28605] ppid=28601 vsize=519096 CPUtime=36.78 cores=3
/proc/28605/stat : 28605 (march_hi) R 28601 28601 28322 0 -1 4202496 285368 0 0 0 3639 39 0 0 25 0 1 0 510789603 531554304 114276 33554432000 4194304 4331988 140733319386240 18446744073709551615 4263227 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28605/statm: 129774 114276 173 34 0 128216 0
[pid=28606] ppid=28601 vsize=249756 CPUtime=143.56 cores=4-7
/proc/28606/stat : 28606 (plingeling) S 28601 28601 28322 0 -1 4202496 123499 1250 0 0 14339 17 0 0 18 0 2 0 510789603 255750144 50916 33554432000 4194304 4356188 140737123219104 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/28606/statm: 62439 50916 165 40 0 60983 0
[pid=28606/tid=28614] ppid=28601 vsize=249756 CPUtime=35.53 cores=4-7
/proc/28606/task/28614/stat : 28614 (plingeling) R 28601 28601 28322 0 -1 4202560 19711 1250 0 0 3551 2 0 0 25 0 2 0 510789706 255750144 50916 33554432000 4194304 4356188 140737123219104 18446744073709551615 4250997 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 290.7
Current children cumulated vsize (KiB) 1757628

Child status: 0
Real time (s): 36.8602
CPU time (s): 290.997
CPU user time (s): 290.122
CPU system time (s): 0.874867
CPU usage (%): 789.461
Max. virtual memory (cumulated for all children) (KiB): 1833416

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 290.122
system time used= 0.874867
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 557925
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 531
involuntary context switches= 1394

runsolver used 0.05999 second user time and 0.144977 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-28 13:58:12
IDJOB=3310134
IDBENCH=20495
IDSOLVER=1638
FILE ID=node104/3310134-1303991891
RUNJOBID= node104-1303987384-28336
PBS_JOBID= 13168770
Free space on /tmp= 71536 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT07/industrial/manolios/manol-pipe-f7idw.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310134-1303991891/watcher-3310134-1303991891 -o /tmp/evaluation-result-3310134-1303991891/solver-3310134-1303991891 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310134-1303991891.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e11b8f7666247454d93edb47f1646e2c
RANDOM SEED=1622918080

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      11934300 kB
Buffers:       2306532 kB
Cached:       18053320 kB
SwapCached:          0 kB
Active:       11363016 kB
Inactive:      9062384 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      11934300 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           24104 kB
Writeback:           0 kB
AnonPages:       65572 kB
Mapped:          14844 kB
Slab:           526284 kB
PageTables:       4424 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   185120 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71524 MiB
End job on node104 at 2011-04-28 13:58:48