Trace number 3221001

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 2589.1 323.924

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v100-c2130-S1465579926-097.UNKNOWN.cnf
MD5SUMeb55252a6fac55d328f4d31fcc6e53bd
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark321.466
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of clauses2130
Sum of the clauses size10650
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 52130
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7
2588.89/323.91	s UNSATISFIABLE
2588.89/323.92	solver [4] march_hi 2009 answered
2588.89/323.92	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3221001-1304160692/watcher-3221001-1304160692 -o /tmp/evaluation-result-3221001-1304160692/solver-3221001-1304160692 -C 40000 -W 5000 -M 31000 ppfolio HOME/instance-3221001-1304160692.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.05 8.06 8.01 1/170 28798
/proc/meminfo: memFree=30492680/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 2826088513535 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0

[startup+0.0593831 s]
/proc/loadavg: 8.05 8.06 8.01 1/170 28798
/proc/meminfo: memFree=30492680/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 0 0 0 17 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100375 s]
/proc/loadavg: 8.05 8.06 8.01 1/170 28798
/proc/meminfo: memFree=30492680/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 0 0 0 17 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300339 s]
/proc/loadavg: 8.05 8.06 8.01 1/170 28798
/proc/meminfo: memFree=30492680/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700264 s]
/proc/loadavg: 8.05 8.06 8.01 1/170 28798
/proc/meminfo: memFree=30492680/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50112 s]
/proc/loadavg: 8.05 8.06 8.01 9/180 28813
/proc/meminfo: memFree=30477348/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
[pid=28799] ppid=28798 vsize=9113880 CPUtime=1.48 cores=0
/proc/28799/stat : 28799 (cryptominisat) R 28798 28798 28388 0 -1 4202496 3446 0 0 0 148 0 0 0 20 0 1 0 606299813 9332613120 2330 33554432000 4194304 4587354 140735537441200 18446744073709551615 260020092442 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28799/statm: 2278470 2330 337 96 0 2275032 0
[pid=28800] ppid=28798 vsize=13772 CPUtime=1.49 cores=1
/proc/28800/stat : 28800 (clasp) R 28798 28798 28388 0 -1 4202496 885 0 0 0 149 0 0 0 25 0 1 0 606299813 14102528 777 33554432000 4194304 4785740 140736313519776 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28800/statm: 3443 777 340 145 0 488 0
[pid=28801] ppid=28798 vsize=455960 CPUtime=1.49 cores=2
/proc/28801/stat : 28801 (TNM) R 28798 28798 28388 0 -1 4202496 339 0 0 0 149 0 0 0 20 0 1 0 606299813 466903040 236 33554432000 134512640 134534564 4294691200 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28801/statm: 113990 236 95 6 0 112656 0
[pid=28802] ppid=28798 vsize=7056 CPUtime=1.49 cores=3
/proc/28802/stat : 28802 (march_hi) R 28798 28798 28388 0 -1 4202496 421 0 0 0 149 0 0 0 20 0 1 0 606299813 7225344 314 33554432000 4194304 4331988 140737433924848 18446744073709551615 4226400 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28802/statm: 1764 314 174 34 0 206 0
[pid=28803] ppid=28798 vsize=122684 CPUtime=5.48 cores=4-7
/proc/28803/stat : 28803 (plingeling) S 28798 28798 28388 0 -1 4202496 4154 1258 0 0 547 1 0 0 18 0 5 0 606299813 125628416 2745 33554432000 4194304 4356188 140734608775920 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28803/statm: 30671 2745 161 40 0 29215 0
[pid=28803/tid=28810] ppid=28798 vsize=122684 CPUtime=1.48 cores=4-7
/proc/28803/task/28810/stat : 28810 (plingeling) R 28798 28798 28388 0 -1 4202560 992 1258 0 0 148 0 0 0 23 0 5 0 606299814 125628416 2745 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28803/tid=28811] ppid=28798 vsize=122684 CPUtime=1.31 cores=4-7
/proc/28803/task/28811/stat : 28811 (plingeling) R 28798 28798 28388 0 -1 4202560 922 1258 0 0 131 0 0 0 23 0 5 0 606299814 125628416 2745 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28803/tid=28812] ppid=28798 vsize=122684 CPUtime=1.48 cores=4-7
/proc/28803/task/28812/stat : 28812 (plingeling) R 28798 28798 28388 0 -1 4202560 966 1258 0 0 148 0 0 0 25 0 5 0 606299814 125628416 2745 33554432000 4194304 4356188 140734608775920 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28803/tid=28813] ppid=28798 vsize=122684 CPUtime=1.17 cores=4-7
/proc/28803/task/28813/stat : 28813 (plingeling) R 28798 28798 28388 0 -1 4202560 760 1258 0 0 117 0 0 0 25 0 5 0 606299814 125628416 2745 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331188 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.43
Current children cumulated vsize (KiB) 9731676

[startup+3.10082 s]
/proc/loadavg: 8.05 8.06 8.01 9/180 28813
/proc/meminfo: memFree=30466452/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
[pid=28799] ppid=28798 vsize=593720 CPUtime=3.09 cores=0
/proc/28799/stat : 28799 (cryptominisat) R 28798 28798 28388 0 -1 4202496 5302 0 0 0 308 1 0 0 25 0 1 0 606299813 607969280 2892 33554432000 4194304 4587354 140735537441200 18446744073709551615 4238449 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28799/statm: 148430 2892 337 96 0 144992 0
[pid=28800] ppid=28798 vsize=14208 CPUtime=3.09 cores=1
/proc/28800/stat : 28800 (clasp) R 28798 28798 28388 0 -1 4202496 1020 0 0 0 309 0 0 0 25 0 1 0 606299813 14548992 912 33554432000 4194304 4785740 140736313519776 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28800/statm: 3552 912 340 145 0 597 0
[pid=28801] ppid=28798 vsize=455960 CPUtime=3.09 cores=2
/proc/28801/stat : 28801 (TNM) R 28798 28798 28388 0 -1 4202496 339 0 0 0 309 0 0 0 25 0 1 0 606299813 466903040 236 33554432000 134512640 134534564 4294691200 18446744073709551615 134530619 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28801/statm: 113990 236 95 6 0 112656 0
[pid=28802] ppid=28798 vsize=7056 CPUtime=3.09 cores=3
/proc/28802/stat : 28802 (march_hi) R 28798 28798 28388 0 -1 4202496 428 0 0 0 309 0 0 0 25 0 1 0 606299813 7225344 321 33554432000 4194304 4331988 140737433924848 18446744073709551615 4212262 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28802/statm: 1764 321 174 34 0 206 0
[pid=28803] ppid=28798 vsize=127300 CPUtime=11.87 cores=4-7
/proc/28803/stat : 28803 (plingeling) S 28798 28798 28388 0 -1 4202496 6428 1258 0 0 1186 1 0 0 18 0 5 0 606299813 130355200 3899 33554432000 4194304 4356188 140734608775920 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28803/statm: 31825 3899 161 40 0 30369 0
[pid=28803/tid=28810] ppid=28798 vsize=127300 CPUtime=3.08 cores=4-7
/proc/28803/task/28810/stat : 28810 (plingeling) R 28798 28798 28388 0 -1 4202560 1504 1258 0 0 308 0 0 0 25 0 5 0 606299814 130355200 3899 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28803/tid=28811] ppid=28798 vsize=127300 CPUtime=2.91 cores=4-7
/proc/28803/task/28811/stat : 28811 (plingeling) R 28798 28798 28388 0 -1 4202560 1499 1258 0 0 291 0 0 0 25 0 5 0 606299814 130355200 3899 33554432000 4194304 4356188 140734608775920 18446744073709551615 4210567 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28803/tid=28812] ppid=28798 vsize=127300 CPUtime=3.08 cores=4-7
/proc/28803/task/28812/stat : 28812 (plingeling) R 28798 28798 28388 0 -1 4202560 1510 1258 0 0 308 0 0 0 25 0 5 0 606299814 130355200 3899 33554432000 4194304 4356188 140734608775920 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28803/tid=28813] ppid=28798 vsize=127300 CPUtime=2.77 cores=4-7
/proc/28803/task/28813/stat : 28813 (plingeling) R 28798 28798 28388 0 -1 4202560 1401 1258 0 0 277 0 0 0 25 0 5 0 606299814 130355200 3899 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.23
Current children cumulated vsize (KiB) 1216568

[startup+6.30123 s]
/proc/loadavg: 8.05 8.06 8.01 9/180 28813
/proc/meminfo: memFree=30459792/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
[pid=28799] ppid=28798 vsize=9117148 CPUtime=6.29 cores=0
/proc/28799/stat : 28799 (cryptominisat) R 28798 28798 28388 0 -1 4202496 7270 0 0 0 628 1 0 0 25 0 1 0 606299813 9335959552 3287 33554432000 4194304 4587354 140735537441200 18446744073709551615 4239308 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28799/statm: 2279287 3287 337 96 0 2275849 0
[pid=28800] ppid=28798 vsize=14900 CPUtime=6.29 cores=1
/proc/28800/stat : 28800 (clasp) R 28798 28798 28388 0 -1 4202496 1153 0 0 0 629 0 0 0 25 0 1 0 606299813 15257600 1045 33554432000 4194304 4785740 140736313519776 18446744073709551615 4553380 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28800/statm: 3725 1045 340 145 0 770 0
[pid=28801] ppid=28798 vsize=455960 CPUtime=6.29 cores=2
/proc/28801/stat : 28801 (TNM) R 28798 28798 28388 0 -1 4202496 339 0 0 0 629 0 0 0 25 0 1 0 606299813 466903040 236 33554432000 134512640 134534564 4294691200 18446744073709551615 134528944 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28801/statm: 113990 236 95 6 0 112656 0
[pid=28802] ppid=28798 vsize=7204 CPUtime=6.29 cores=3
/proc/28802/stat : 28802 (march_hi) R 28798 28798 28388 0 -1 4202496 435 0 0 0 629 0 0 0 25 0 1 0 606299813 7376896 328 33554432000 4194304 4331988 140737433924848 18446744073709551615 4210516 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28802/statm: 1801 328 174 34 0 243 0
[pid=28803] ppid=28798 vsize=129432 CPUtime=24.66 cores=4-7
/proc/28803/stat : 28803 (plingeling) S 28798 28798 28388 0 -1 4202496 9153 1258 0 0 2464 2 0 0 18 0 5 0 606299813 132538368 4416 33554432000 4194304 4356188 140734608775920 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28803/statm: 32358 4416 161 40 0 30902 0
[pid=28803/tid=28810] ppid=28798 vsize=129432 CPUtime=6.28 cores=4-7
/proc/28803/task/28810/stat : 28810 (plingeling) R 28798 28798 28388 0 -1 4202560 2290 1258 0 0 628 0 0 0 25 0 5 0 606299814 132538368 4416 33554432000 4194304 4356188 140734608775920 18446744073709551615 4330999 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28803/tid=28811] ppid=28798 vsize=129432 CPUtime=6.11 cores=4-7
/proc/28803/task/28811/stat : 28811 (plingeling) R 28798 28798 28388 0 -1 4202560 2075 1258 0 0 611 0 0 0 25 0 5 0 606299814 132538368 4416 33554432000 4194304 4356188 140734608775920 18446744073709551615 4332225 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28803/tid=28812] ppid=28798 vsize=129432 CPUtime=6.28 cores=4-7
/proc/28803/task/28812/stat : 28812 (plingeling) R 28798 28798 28388 0 -1 4202560 2248 1258 0 0 628 0 0 0 25 0 5 0 606299814 132538368 4416 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28803/tid=28813] ppid=28798 vsize=129432 CPUtime=5.95 cores=4-7
/proc/28803/task/28813/stat : 28813 (plingeling) R 28798 28798 28388 0 -1 4202560 2026 1258 0 0 595 0 0 0 25 0 5 0 606299814 132538368 4416 33554432000 4194304 4356188 140734608775920 18446744073709551615 4332260 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.82
Current children cumulated vsize (KiB) 9742968

[startup+12.7011 s]
/proc/loadavg: 8.04 8.06 8.01 9/180 28813
/proc/meminfo: memFree=30445792/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
[pid=28799] ppid=28798 vsize=596424 CPUtime=12.68 cores=0
/proc/28799/stat : 28799 (cryptominisat) R 28798 28798 28388 0 -1 4202496 11280 0 0 0 1267 1 0 0 25 0 1 0 606299813 610738176 3915 33554432000 4194304 4587354 140735537441200 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28799/statm: 149106 3915 337 96 0 145668 0
[pid=28800] ppid=28798 vsize=15772 CPUtime=12.69 cores=1
/proc/28800/stat : 28800 (clasp) R 28798 28798 28388 0 -1 4202496 1368 0 0 0 1269 0 0 0 25 0 1 0 606299813 16150528 1260 33554432000 4194304 4785740 140736313519776 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28800/statm: 3943 1260 340 145 0 988 0
[pid=28801] ppid=28798 vsize=455960 CPUtime=12.69 cores=2
/proc/28801/stat : 28801 (TNM) R 28798 28798 28388 0 -1 4202496 339 0 0 0 1269 0 0 0 25 0 1 0 606299813 466903040 236 33554432000 134512640 134534564 4294691200 18446744073709551615 134530339 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28801/statm: 113990 236 95 6 0 112656 0
[pid=28802] ppid=28798 vsize=7204 CPUtime=12.69 cores=3
/proc/28802/stat : 28802 (march_hi) R 28798 28798 28388 0 -1 4202496 446 0 0 0 1269 0 0 0 25 0 1 0 606299813 7376896 339 33554432000 4194304 4331988 140737433924848 18446744073709551615 4226642 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28802/statm: 1801 339 174 34 0 243 0
[pid=28803] ppid=28798 vsize=140328 CPUtime=50.22 cores=4-7
/proc/28803/stat : 28803 (plingeling) S 28798 28798 28388 0 -1 4202496 16837 1258 0 0 5019 3 0 0 18 0 5 0 606299813 143695872 7140 33554432000 4194304 4356188 140734608775920 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28803/statm: 35082 7140 161 40 0 33626 0
[pid=28803/tid=28810] ppid=28798 vsize=140328 CPUtime=12.67 cores=4-7
/proc/28803/task/28810/stat : 28810 (plingeling) R 28798 28798 28388 0 -1 4202560 4242 1258 0 0 1267 0 0 0 25 0 5 0 606299814 143695872 7140 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28803/tid=28811] ppid=28798 vsize=140328 CPUtime=12.51 cores=4-7
/proc/28803/task/28811/stat : 28811 (plingeling) R 28798 28798 28388 0 -1 4202560 3932 1258 0 0 1250 1 0 0 25 0 5 0 606299814 143695872 7140 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28803/tid=28812] ppid=28798 vsize=140328 CPUtime=12.68 cores=4-7
/proc/28803/task/28812/stat : 28812 (plingeling) R 28798 28798 28388 0 -1 4202560 4169 1258 0 0 1268 0 0 0 25 0 5 0 606299814 143695872 7140 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28803/tid=28813] ppid=28798 vsize=140328 CPUtime=12.32 cores=4-7
/proc/28803/task/28813/stat : 28813 (plingeling) R 28798 28798 28388 0 -1 4202560 3980 1258 0 0 1232 0 0 0 25 0 5 0 606299814 143695872 7140 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.97
Current children cumulated vsize (KiB) 1234012

[startup+25.5007 s]
/proc/loadavg: 8.03 8.06 8.01 9/180 28814
/proc/meminfo: memFree=30439508/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
[pid=28799] ppid=28798 vsize=9122396 CPUtime=25.49 cores=0
/proc/28799/stat : 28799 (cryptominisat) R 28798 28798 28388 0 -1 4202496 17302 0 0 0 2545 4 0 0 25 0 1 0 606299813 9341333504 4632 33554432000 4194304 4587354 140735537441200 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=28803/tid=28810] ppid=28798 vsize=218992 CPUtime=313.45 cores=4-7
/proc/28803/task/28810/stat : 28810 (plingeling) R 28798 28798 28388 0 -1 4202560 35448 1258 0 0 31341 4 0 0 25 0 5 0 606299814 224247808 26826 33554432000 4194304 4356188 140734608775920 18446744073709551615 4298607 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28803/tid=28811] ppid=28798 vsize=218992 CPUtime=313.33 cores=4-7
/proc/28803/task/28811/stat : 28811 (plingeling) R 28798 28798 28388 0 -1 4202560 35200 1258 0 0 31328 5 0 0 25 0 5 0 606299814 224247808 26826 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28803/tid=28812] ppid=28798 vsize=218992 CPUtime=313.49 cores=4-7
/proc/28803/task/28812/stat : 28812 (plingeling) R 28798 28798 28388 0 -1 4202560 36619 1258 0 0 31343 6 0 0 25 0 5 0 606299814 224247808 26826 33554432000 4194304 4356188 140734608775920 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28803/tid=28813] ppid=28798 vsize=218992 CPUtime=311.49 cores=4-7
/proc/28803/task/28813/stat : 28813 (plingeling) R 28798 28798 28388 0 -1 4202560 35676 1258 0 0 31143 6 0 0 25 0 5 0 606299814 224247808 26826 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331151 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2505.8
Current children cumulated vsize (KiB) 1368388

[startup+319.9 s]
/proc/loadavg: 8.00 8.04 8.00 9/180 28822
/proc/meminfo: memFree=30311372/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0.01 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 1 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
[pid=28799] ppid=28798 vsize=636368 CPUtime=319.9 cores=0
/proc/28799/stat : 28799 (cryptominisat) R 28798 28798 28388 0 -1 4202496 90087 0 0 0 31963 27 0 0 25 0 1 0 606299813 651640832 14441 33554432000 4194304 4587354 140735537441200 18446744073709551615 4238491 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28799/statm: 159092 14441 337 96 0 155654 0
[pid=28800] ppid=28798 vsize=23976 CPUtime=319.88 cores=1
/proc/28800/stat : 28800 (clasp) R 28798 28798 28388 0 -1 4202496 3267 0 0 0 31988 0 0 0 25 0 1 0 606299813 24551424 3159 33554432000 4194304 4785740 140736313519776 18446744073709551615 4553585 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28800/statm: 5994 3159 341 145 0 3039 0
[pid=28801] ppid=28798 vsize=455960 CPUtime=319.9 cores=2
/proc/28801/stat : 28801 (TNM) R 28798 28798 28388 0 -1 4202496 339 0 0 0 31990 0 0 0 25 0 1 0 606299813 466903040 236 33554432000 134512640 134534564 4294691200 18446744073709551615 134530339 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28801/statm: 113990 236 95 6 0 112656 0
[pid=28802] ppid=28798 vsize=14908 CPUtime=319.89 cores=3
/proc/28802/stat : 28802 (march_hi) R 28798 28798 28388 0 -1 4202496 1826 0 0 0 31988 1 0 0 25 0 1 0 606299813 15265792 1717 33554432000 4194304 4331988 140737433924848 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28802/statm: 3727 1717 175 34 0 2169 0
[pid=28803] ppid=28798 vsize=217840 CPUtime=1277.34 cores=4-7
/proc/28803/stat : 28803 (plingeling) S 28798 28798 28388 0 -1 4202496 146209 1258 0 0 127711 23 0 0 18 0 5 0 606299813 223068160 26538 33554432000 4194304 4356188 140734608775920 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28803/statm: 54460 26538 161 40 0 53004 0
[pid=28803/tid=28810] ppid=28798 vsize=217840 CPUtime=319.84 cores=4-7
/proc/28803/task/28810/stat : 28810 (plingeling) R 28798 28798 28388 0 -1 4202560 35576 1258 0 0 31980 4 0 0 25 0 5 0 606299814 223068160 26538 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28803/tid=28811] ppid=28798 vsize=217840 CPUtime=319.72 cores=4-7
/proc/28803/task/28811/stat : 28811 (plingeling) R 28798 28798 28388 0 -1 4202560 36320 1258 0 0 31967 5 0 0 25 0 5 0 606299814 223068160 26538 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28803/tid=28812] ppid=28798 vsize=217840 CPUtime=319.89 cores=4-7
/proc/28803/task/28812/stat : 28812 (plingeling) R 28798 28798 28388 0 -1 4202560 37259 1258 0 0 31983 6 0 0 25 0 5 0 606299814 223068160 26538 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28803/tid=28813] ppid=28798 vsize=217840 CPUtime=317.85 cores=4-7
/proc/28803/task/28813/stat : 28813 (plingeling) R 28798 28798 28388 0 -1 4202560 36540 1258 0 0 31779 6 0 0 25 0 5 0 606299814 223068160 26538 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2556.92
Current children cumulated vsize (KiB) 1367376

[startup+321.501 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 28822
/proc/meminfo: memFree=30311988/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0.01 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 1 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
[pid=28799] ppid=28798 vsize=636368 CPUtime=321.5 cores=0
/proc/28799/stat : 28799 (cryptominisat) R 28798 28798 28388 0 -1 4202496 90186 0 0 0 32123 27 0 0 25 0 1 0 606299813 651640832 14536 33554432000 4194304 4587354 140735537441200 18446744073709551615 4232256 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28799/statm: 159092 14536 337 96 0 155654 0
[pid=28800] ppid=28798 vsize=24116 CPUtime=321.49 cores=1
/proc/28800/stat : 28800 (clasp) R 28798 28798 28388 0 -1 4202496 3292 0 0 0 32149 0 0 0 25 0 1 0 606299813 24694784 3184 33554432000 4194304 4785740 140736313519776 18446744073709551615 4416810 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28800/statm: 6029 3184 341 145 0 3074 0
[pid=28801] ppid=28798 vsize=455960 CPUtime=321.5 cores=2
/proc/28801/stat : 28801 (TNM) R 28798 28798 28388 0 -1 4202496 339 0 0 0 32150 0 0 0 25 0 1 0 606299813 466903040 236 33554432000 134512640 134534564 4294691200 18446744073709551615 134528842 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28801/statm: 113990 236 95 6 0 112656 0
[pid=28802] ppid=28798 vsize=15084 CPUtime=321.49 cores=3
/proc/28802/stat : 28802 (march_hi) R 28798 28798 28388 0 -1 4202496 1847 0 0 0 32148 1 0 0 25 0 1 0 606299813 15446016 1738 33554432000 4194304 4331988 140737433924848 18446744073709551615 4228307 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28802/statm: 3771 1738 175 34 0 2213 0
[pid=28803] ppid=28798 vsize=214384 CPUtime=1283.73 cores=4-7
/proc/28803/stat : 28803 (plingeling) S 28798 28798 28388 0 -1 4202496 146337 1258 0 0 128350 23 0 0 18 0 5 0 606299813 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28803/statm: 53596 25674 161 40 0 52140 0
[pid=28803/tid=28810] ppid=28798 vsize=214384 CPUtime=321.44 cores=4-7
/proc/28803/task/28810/stat : 28810 (plingeling) R 28798 28798 28388 0 -1 4202560 35704 1258 0 0 32140 4 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28803/tid=28811] ppid=28798 vsize=214384 CPUtime=321.32 cores=4-7
/proc/28803/task/28811/stat : 28811 (plingeling) R 28798 28798 28388 0 -1 4202560 36320 1258 0 0 32127 5 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4332133 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28803/tid=28812] ppid=28798 vsize=214384 CPUtime=321.49 cores=4-7
/proc/28803/task/28812/stat : 28812 (plingeling) R 28798 28798 28388 0 -1 4202560 37259 1258 0 0 32143 6 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28803/tid=28813] ppid=28798 vsize=214384 CPUtime=319.44 cores=4-7
/proc/28803/task/28813/stat : 28813 (plingeling) R 28798 28798 28388 0 -1 4202560 36540 1258 0 0 31938 6 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331007 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2569.72
Current children cumulated vsize (KiB) 1364236

[startup+323.101 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 28822
/proc/meminfo: memFree=30320520/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0.01 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 1 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
[pid=28799] ppid=28798 vsize=636428 CPUtime=323.1 cores=0
/proc/28799/stat : 28799 (cryptominisat) R 28798 28798 28388 0 -1 4202496 91250 0 0 0 32283 27 0 0 25 0 1 0 606299813 651702272 13318 33554432000 4194304 4587354 140735537441200 18446744073709551615 4239308 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28799/statm: 159107 13318 337 96 0 155669 0
[pid=28800] ppid=28798 vsize=24116 CPUtime=323.08 cores=1
/proc/28800/stat : 28800 (clasp) R 28798 28798 28388 0 -1 4202496 3293 0 0 0 32308 0 0 0 25 0 1 0 606299813 24694784 3185 33554432000 4194304 4785740 140736313519776 18446744073709551615 4287055 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28800/statm: 6029 3185 341 145 0 3074 0
[pid=28801] ppid=28798 vsize=455960 CPUtime=323.1 cores=2
/proc/28801/stat : 28801 (TNM) R 28798 28798 28388 0 -1 4202496 339 0 0 0 32310 0 0 0 25 0 1 0 606299813 466903040 236 33554432000 134512640 134534564 4294691200 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28801/statm: 113990 236 95 6 0 112656 0
[pid=28802] ppid=28798 vsize=15084 CPUtime=323.1 cores=3
/proc/28802/stat : 28802 (march_hi) R 28798 28798 28388 0 -1 4202496 1869 0 0 0 32308 2 0 0 25 0 1 0 606299813 15446016 1760 33554432000 4194304 4331988 140737433924848 18446744073709551615 4246341 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28802/statm: 3771 1760 175 34 0 2213 0
[pid=28803] ppid=28798 vsize=214384 CPUtime=1290.12 cores=4-7
/proc/28803/stat : 28803 (plingeling) S 28798 28798 28388 0 -1 4202496 146337 1258 0 0 128989 23 0 0 18 0 5 0 606299813 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28803/statm: 53596 25674 161 40 0 52140 0
[pid=28803/tid=28810] ppid=28798 vsize=214384 CPUtime=323.04 cores=4-7
/proc/28803/task/28810/stat : 28810 (plingeling) R 28798 28798 28388 0 -1 4202560 35704 1258 0 0 32300 4 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28803/tid=28811] ppid=28798 vsize=214384 CPUtime=322.91 cores=4-7
/proc/28803/task/28811/stat : 28811 (plingeling) R 28798 28798 28388 0 -1 4202560 36320 1258 0 0 32286 5 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331023 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28803/tid=28812] ppid=28798 vsize=214384 CPUtime=323.09 cores=4-7
/proc/28803/task/28812/stat : 28812 (plingeling) R 28798 28798 28388 0 -1 4202560 37259 1258 0 0 32303 6 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28803/tid=28813] ppid=28798 vsize=214384 CPUtime=321.04 cores=4-7
/proc/28803/task/28813/stat : 28813 (plingeling) R 28798 28798 28388 0 -1 4202560 36540 1258 0 0 32098 6 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2582.51
Current children cumulated vsize (KiB) 1364296

[startup+323.501 s]
/proc/loadavg: 8.00 8.03 8.00 10/180 28822
/proc/meminfo: memFree=30320272/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0.01 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 1 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
[pid=28799] ppid=28798 vsize=636428 CPUtime=323.49 cores=0
/proc/28799/stat : 28799 (cryptominisat) R 28798 28798 28388 0 -1 4202496 91305 0 0 0 32322 27 0 0 25 0 1 0 606299813 651702272 13372 33554432000 4194304 4587354 140735537441200 18446744073709551615 4238763 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28799/statm: 159107 13372 337 96 0 155669 0
[pid=28800] ppid=28798 vsize=24116 CPUtime=323.48 cores=1
/proc/28800/stat : 28800 (clasp) R 28798 28798 28388 0 -1 4202496 3293 0 0 0 32348 0 0 0 25 0 1 0 606299813 24694784 3185 33554432000 4194304 4785740 140736313519776 18446744073709551615 4553411 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28800/statm: 6029 3185 341 145 0 3074 0
[pid=28801] ppid=28798 vsize=455960 CPUtime=323.5 cores=2
/proc/28801/stat : 28801 (TNM) R 28798 28798 28388 0 -1 4202496 339 0 0 0 32350 0 0 0 25 0 1 0 606299813 466903040 236 33554432000 134512640 134534564 4294691200 18446744073709551615 134528888 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28801/statm: 113990 236 95 6 0 112656 0
[pid=28802] ppid=28798 vsize=15084 CPUtime=323.5 cores=3
/proc/28802/stat : 28802 (march_hi) R 28798 28798 28388 0 -1 4202496 1874 0 0 0 32348 2 0 0 25 0 1 0 606299813 15446016 1765 33554432000 4194304 4331988 140737433924848 18446744073709551615 4210368 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28802/statm: 3771 1765 175 34 0 2213 0
[pid=28803] ppid=28798 vsize=214384 CPUtime=1291.71 cores=4-7
/proc/28803/stat : 28803 (plingeling) S 28798 28798 28388 0 -1 4202496 146337 1258 0 0 129148 23 0 0 18 0 5 0 606299813 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28803/statm: 53596 25674 161 40 0 52140 0
[pid=28803/tid=28810] ppid=28798 vsize=214384 CPUtime=323.44 cores=4-7
/proc/28803/task/28810/stat : 28810 (plingeling) R 28798 28798 28388 0 -1 4202560 35704 1258 0 0 32340 4 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28803/tid=28811] ppid=28798 vsize=214384 CPUtime=323.31 cores=4-7
/proc/28803/task/28811/stat : 28811 (plingeling) R 28798 28798 28388 0 -1 4202560 36320 1258 0 0 32326 5 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28803/tid=28812] ppid=28798 vsize=214384 CPUtime=323.49 cores=4-7
/proc/28803/task/28812/stat : 28812 (plingeling) R 28798 28798 28388 0 -1 4202560 37259 1258 0 0 32343 6 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28803/tid=28813] ppid=28798 vsize=214384 CPUtime=321.43 cores=4-7
/proc/28803/task/28813/stat : 28813 (plingeling) R 28798 28798 28388 0 -1 4202560 36540 1258 0 0 32137 6 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2585.69
Current children cumulated vsize (KiB) 1364296

[startup+323.901 s]
/proc/loadavg: 8.00 8.03 8.00 10/180 28822
/proc/meminfo: memFree=30320272/32951124 swapFree=67111464/67111528
[pid=28798] ppid=28796 vsize=18324 CPUtime=0.01 cores=0-7
/proc/28798/stat : 28798 (ppfolio) S 28796 28798 28388 0 -1 4202496 523 0 0 0 0 1 0 0 15 0 1 0 606299812 18763776 390 33554432000 4194304 4287625 140734782126336 18446744073709551615 260020416015 0 0 4096 65536 4438693673571450879 0 0 17 4 0 0 0
/proc/28798/statm: 4581 390 341 23 0 91 0
[pid=28799] ppid=28798 vsize=636428 CPUtime=323.89 cores=0
/proc/28799/stat : 28799 (cryptominisat) R 28798 28798 28388 0 -1 4202496 91357 0 0 0 32362 27 0 0 25 0 1 0 606299813 651702272 13422 33554432000 4194304 4587354 140735537441200 18446744073709551615 4238628 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/28799/statm: 159107 13422 337 96 0 155669 0
[pid=28800] ppid=28798 vsize=24116 CPUtime=323.88 cores=1
/proc/28800/stat : 28800 (clasp) R 28798 28798 28388 0 -1 4202496 3293 0 0 0 32388 0 0 0 25 0 1 0 606299813 24694784 3185 33554432000 4194304 4785740 140736313519776 18446744073709551615 4546069 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/28800/statm: 6029 3185 341 145 0 3074 0
[pid=28801] ppid=28798 vsize=455960 CPUtime=323.9 cores=2
/proc/28801/stat : 28801 (TNM) R 28798 28798 28388 0 -1 4202496 339 0 0 0 32390 0 0 0 25 0 1 0 606299813 466903040 236 33554432000 134512640 134534564 4294691200 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/28801/statm: 113990 236 95 6 0 112656 0
[pid=28802] ppid=28798 vsize=15084 CPUtime=323.9 cores=3
/proc/28802/stat : 28802 (march_hi) R 28798 28798 28388 0 -1 4202496 1880 0 0 0 32388 2 0 0 25 0 1 0 606299813 15446016 1771 33554432000 4194304 4331988 140737433924848 18446744073709551615 4298816 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/28802/statm: 3771 1771 175 34 0 2213 0
[pid=28803] ppid=28798 vsize=214384 CPUtime=1293.31 cores=4-7
/proc/28803/stat : 28803 (plingeling) S 28798 28798 28388 0 -1 4202496 146337 1258 0 0 129308 23 0 0 18 0 5 0 606299813 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/28803/statm: 53596 25674 161 40 0 52140 0
[pid=28803/tid=28810] ppid=28798 vsize=214384 CPUtime=323.83 cores=4-7
/proc/28803/task/28810/stat : 28810 (plingeling) R 28798 28798 28388 0 -1 4202560 35704 1258 0 0 32379 4 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=28803/tid=28811] ppid=28798 vsize=214384 CPUtime=323.71 cores=4-7
/proc/28803/task/28811/stat : 28811 (plingeling) R 28798 28798 28388 0 -1 4202560 36320 1258 0 0 32366 5 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=28803/tid=28812] ppid=28798 vsize=214384 CPUtime=323.89 cores=4-7
/proc/28803/task/28812/stat : 28812 (plingeling) R 28798 28798 28388 0 -1 4202560 37259 1258 0 0 32383 6 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=28803/tid=28813] ppid=28798 vsize=214384 CPUtime=321.83 cores=4-7
/proc/28803/task/28813/stat : 28813 (plingeling) R 28798 28798 28388 0 -1 4202560 36540 1258 0 0 32177 6 0 0 25 0 5 0 606299814 219529216 25674 33554432000 4194304 4356188 140734608775920 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2588.89
Current children cumulated vsize (KiB) 1364296

Child status: 0
Real time (s): 323.924
CPU time (s): 2589.1
CPU user time (s): 2588.52
CPU system time (s): 0.583911
CPU usage (%): 799.293
Max. virtual memory (cumulated for all children) (KiB): 18892368

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2588.52
system time used= 0.583911
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 245009
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1421
involuntary context switches= 12390

runsolver used 0.502923 second user time and 1.26281 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-30 12:51:32
IDJOB=3221001
IDBENCH=82850
IDSOLVER=1638
FILE ID=node110/3221001-1304160692
RUNJOBID= node110-1304156062-28402
PBS_JOBID= 13170909
Free space on /tmp= 73476 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v100-c2130-S1465579926-097.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3221001-1304160692/watcher-3221001-1304160692 -o /tmp/evaluation-result-3221001-1304160692/solver-3221001-1304160692 -C 40000 -W 5000 -M 31000  ppfolio HOME/instance-3221001-1304160692.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= eb55252a6fac55d328f4d31fcc6e53bd
RANDOM SEED=606681509

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30492836 kB
Buffers:        989816 kB
Cached:         990300 kB
SwapCached:         64 kB
Active:         289780 kB
Inactive:      1754376 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30492836 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:           10132 kB
Writeback:           0 kB
AnonPages:       63872 kB
Mapped:          14772 kB
Slab:           348872 kB
PageTables:       5020 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187340 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73464 MiB
End job on node110 at 2011-04-30 12:56:56