Trace number 3220497

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 39971.8 5000.02

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v80-c7120-S1818856267-075.UNKNOWN.cnf
MD5SUMff76c2a7684df6ebd90c6aa1ff48f56d
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables80
Number of clauses7120
Sum of the clauses size49840
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 57120

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3220497-1304157866/watcher-3220497-1304157866 -o /tmp/evaluation-result-3220497-1304157866/solver-3220497-1304157866 -C 40000 -W 5000 -M 31000 ppfolio HOME/instance-3220497-1304157866.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.01 8.05 8.00 2/170 26678
/proc/meminfo: memFree=21979636/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0

[startup+0.136581 s]
/proc/loadavg: 8.01 8.05 8.00 2/170 26678
/proc/meminfo: memFree=21979636/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 25 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.200568 s]
/proc/loadavg: 8.01 8.05 8.00 2/170 26678
/proc/meminfo: memFree=21979636/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) R 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 24 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300549 s]
/proc/loadavg: 8.01 8.05 8.00 2/170 26678
/proc/meminfo: memFree=21979636/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 24 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700475 s]
/proc/loadavg: 8.01 8.05 8.00 2/170 26678
/proc/meminfo: memFree=21979636/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) R 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 21 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50132 s]
/proc/loadavg: 8.01 8.05 8.00 9/180 26693
/proc/meminfo: memFree=21957484/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
[pid=26679] ppid=26678 vsize=10721496 CPUtime=1.49 cores=0
/proc/26679/stat : 26679 (cryptominisat) R 26678 26678 26652 0 -1 4202496 4615 0 0 0 149 0 0 0 25 0 1 0 508202196 10978811904 2793 33554432000 4194304 4587354 140734221971008 18446744073709551615 4357662 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26679/statm: 2680374 2793 336 96 0 2676936 0
[pid=26680] ppid=26678 vsize=15004 CPUtime=1.49 cores=1
/proc/26680/stat : 26680 (clasp) R 26678 26678 26652 0 -1 4202496 1195 0 0 0 149 0 0 0 25 0 1 0 508202196 15364096 1087 33554432000 4194304 4785740 140735219475552 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26680/statm: 3751 1087 341 145 0 796 0
[pid=26681] ppid=26678 vsize=456648 CPUtime=1.49 cores=2
/proc/26681/stat : 26681 (TNM) R 26678 26678 26652 0 -1 4202496 555 0 0 0 149 0 0 0 25 0 1 0 508202196 467607552 452 33554432000 134512640 134534564 4288314224 18446744073709551615 134530504 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26681/statm: 114162 452 95 6 0 112828 0
[pid=26682] ppid=26678 vsize=8580 CPUtime=1.49 cores=3
/proc/26682/stat : 26682 (march_hi) R 26678 26678 26652 0 -1 4202496 1555 0 0 0 149 0 0 0 20 0 1 0 508202196 8785920 627 33554432000 4194304 4331988 140735715498160 18446744073709551615 4226253 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26682/statm: 2145 627 174 34 0 587 0
[pid=26683] ppid=26678 vsize=61380 CPUtime=5.89 cores=4-7
/proc/26683/stat : 26683 (plingeling) S 26678 26678 26652 0 -1 4202496 4734 1250 0 0 589 0 0 0 18 0 5 0 508202196 62853120 3801 33554432000 4194304 4356188 140734364608144 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26683/statm: 15345 3801 162 40 0 13889 0
[pid=26683/tid=26690] ppid=26678 vsize=61380 CPUtime=1.48 cores=4-7
/proc/26683/task/26690/stat : 26690 (plingeling) R 26678 26678 26652 0 -1 4202560 928 1250 0 0 148 0 0 0 20 0 5 0 508202197 62853120 3801 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26683/tid=26691] ppid=26678 vsize=61380 CPUtime=1.47 cores=4-7
/proc/26683/task/26691/stat : 26691 (plingeling) R 26678 26678 26652 0 -1 4202560 951 1250 0 0 147 0 0 0 25 0 5 0 508202197 62853120 3801 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26683/tid=26692] ppid=26678 vsize=61380 CPUtime=1.46 cores=4-7
/proc/26683/task/26692/stat : 26692 (plingeling) R 26678 26678 26652 0 -1 4202560 869 1250 0 0 146 0 0 0 23 0 5 0 508202198 62853120 3801 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331019 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26683/tid=26693] ppid=26678 vsize=61380 CPUtime=1.45 cores=4-7
/proc/26683/task/26693/stat : 26693 (plingeling) R 26678 26678 26652 0 -1 4202560 801 1250 0 0 145 0 0 0 23 0 5 0 508202198 62853120 3801 33554432000 4194304 4356188 140734364608144 18446744073709551615 4332165 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.85
Current children cumulated vsize (KiB) 11281432

[startup+3.10102 s]
/proc/loadavg: 8.01 8.04 8.00 9/180 26693
/proc/meminfo: memFree=21946200/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
[pid=26679] ppid=26678 vsize=618884 CPUtime=3.08 cores=0
/proc/26679/stat : 26679 (cryptominisat) R 26678 26678 26652 0 -1 4202496 5874 0 0 0 308 0 0 0 25 0 1 0 508202196 633737216 3038 33554432000 4194304 4587354 140734221971008 18446744073709551615 264726101649 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26679/statm: 154721 3038 336 96 0 151283 0
[pid=26680] ppid=26678 vsize=15960 CPUtime=3.09 cores=1
/proc/26680/stat : 26680 (clasp) R 26678 26678 26652 0 -1 4202496 1420 0 0 0 309 0 0 0 25 0 1 0 508202196 16343040 1312 33554432000 4194304 4785740 140735219475552 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26680/statm: 3990 1312 341 145 0 1035 0
[pid=26681] ppid=26678 vsize=456648 CPUtime=3.09 cores=2
/proc/26681/stat : 26681 (TNM) R 26678 26678 26652 0 -1 4202496 555 0 0 0 309 0 0 0 25 0 1 0 508202196 467607552 452 33554432000 134512640 134534564 4288314224 18446744073709551615 134530504 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26681/statm: 114162 452 95 6 0 112828 0
[pid=26682] ppid=26678 vsize=8884 CPUtime=3.09 cores=3
/proc/26682/stat : 26682 (march_hi) R 26678 26678 26652 0 -1 4202496 1630 0 0 0 309 0 0 0 25 0 1 0 508202196 9097216 702 33554432000 4194304 4331988 140735715498160 18446744073709551615 4299282 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26682/statm: 2221 702 174 34 0 663 0
[pid=26683] ppid=26678 vsize=62172 CPUtime=12.28 cores=4-7
/proc/26683/stat : 26683 (plingeling) S 26678 26678 26652 0 -1 4202496 5476 1250 0 0 1228 0 0 0 18 0 5 0 508202196 63664128 3999 33554432000 4194304 4356188 140734364608144 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26683/statm: 15543 3999 162 40 0 14087 0
[pid=26683/tid=26690] ppid=26678 vsize=62172 CPUtime=3.08 cores=4-7
/proc/26683/task/26690/stat : 26690 (plingeling) R 26678 26678 26652 0 -1 4202560 1090 1250 0 0 308 0 0 0 25 0 5 0 508202197 63664128 3999 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331165 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26683/tid=26691] ppid=26678 vsize=62172 CPUtime=3.07 cores=4-7
/proc/26683/task/26691/stat : 26691 (plingeling) R 26678 26678 26652 0 -1 4202560 1176 1250 0 0 307 0 0 0 25 0 5 0 508202197 63664128 3999 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26683/tid=26692] ppid=26678 vsize=62172 CPUtime=3.06 cores=4-7
/proc/26683/task/26692/stat : 26692 (plingeling) R 26678 26678 26652 0 -1 4202560 998 1250 0 0 306 0 0 0 25 0 5 0 508202198 63664128 3999 33554432000 4194304 4356188 140734364608144 18446744073709551615 4332003 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26683/tid=26693] ppid=26678 vsize=62172 CPUtime=3.05 cores=4-7
/proc/26683/task/26693/stat : 26693 (plingeling) R 26678 26678 26652 0 -1 4202560 1027 1250 0 0 305 0 0 0 25 0 5 0 508202198 63664128 3999 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.63
Current children cumulated vsize (KiB) 1180872

[startup+6.30042 s]
/proc/loadavg: 8.01 8.04 8.00 9/180 26694
/proc/meminfo: memFree=21940980/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
[pid=26679] ppid=26678 vsize=620788 CPUtime=6.29 cores=0
/proc/26679/stat : 26679 (cryptominisat) R 26678 26678 26652 0 -1 4202496 7803 0 0 0 628 1 0 0 25 0 1 0 508202196 635686912 3785 33554432000 4194304 4587354 140734221971008 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26679/statm: 155197 3785 336 96 0 151759 0
[pid=26680] ppid=26678 vsize=17152 CPUtime=6.29 cores=1
/proc/26680/stat : 26680 (clasp) R 26678 26678 26652 0 -1 4202496 1714 0 0 0 629 0 0 0 25 0 1 0 508202196 17563648 1606 33554432000 4194304 4785740 140735219475552 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26680/statm: 4288 1606 341 145 0 1333 0
[pid=26681] ppid=26678 vsize=456648 CPUtime=6.29 cores=2
/proc/26681/stat : 26681 (TNM) R 26678 26678 26652 0 -1 4202496 555 0 0 0 629 0 0 0 25 0 1 0 508202196 467607552 452 33554432000 134512640 134534564 4288314224 18446744073709551615 134528842 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26681/statm: 114162 452 95 6 0 112828 0
[pid=26682] ppid=26678 vsize=9264 CPUtime=6.29 cores=3
/proc/26682/stat : 26682 (march_hi) R 26678 26678 26652 0 -1 4202496 1725 0 0 0 629 0 0 0 25 0 1 0 508202196 9486336 797 33554432000 4194304 4331988 140735715498160 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26682/statm: 2316 797 175 34 0 758 0
[pid=26683] ppid=26678 vsize=63080 CPUtime=25.07 cores=4-7
/proc/26683/stat : 26683 (plingeling) S 26678 26678 26652 0 -1 4202496 7015 1250 0 0 2506 1 0 0 18 0 5 0 508202196 64593920 4226 33554432000 4194304 4356188 140734364608144 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26683/statm: 15770 4226 162 40 0 14314 0
[pid=26683/tid=26690] ppid=26678 vsize=63080 CPUtime=6.27 cores=4-7
/proc/26683/task/26690/stat : 26690 (plingeling) R 26678 26678 26652 0 -1 4202560 1475 1250 0 0 627 0 0 0 25 0 5 0 508202197 64593920 4226 33554432000 4194304 4356188 140734364608144 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26683/tid=26691] ppid=26678 vsize=63080 CPUtime=6.27 cores=4-7
/proc/26683/task/26691/stat : 26691 (plingeling) R 26678 26678 26652 0 -1 4202560 1561 1250 0 0 627 0 0 0 25 0 5 0 508202197 64593920 4226 33554432000 4194304 4356188 140734364608144 18446744073709551615 4238662 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26683/tid=26692] ppid=26678 vsize=63080 CPUtime=6.24 cores=4-7
/proc/26683/task/26692/stat : 26692 (plingeling) R 26678 26678 26652 0 -1 4202560 1415 1250 0 0 624 0 0 0 25 0 5 0 508202198 64593920 4226 33554432000 4194304 4356188 140734364608144 18446744073709551615 4332030 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26683/tid=26693] ppid=26678 vsize=63080 CPUtime=6.25 cores=4-7
/proc/26683/task/26693/stat : 26693 (plingeling) R 26678 26678 26652 0 -1 4202560 1379 1250 0 0 625 0 0 0 25 0 5 0 508202198 64593920 4226 33554432000 4194304 4356188 140734364608144 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.23
Current children cumulated vsize (KiB) 1185256

[startup+12.7012 s]
/proc/loadavg: 8.00 8.04 8.00 9/180 26694
/proc/meminfo: memFree=21934264/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
[pid=26679] ppid=26678 vsize=621108 CPUtime=12.69 cores=0
/proc/26679/stat : 26679 (cryptominisat) R 26678 26678 26652 0 -1 4202496 11559 0 0 0 1268 1 0 0 25 0 1 0 508202196 636014592 3898 33554432000 4194304 4587354 140734221971008 18446744073709551615 4243888 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26679/statm: 155277 3898 336 96 0 151839 0
[pid=26680] ppid=26678 vsize=19076 CPUtime=12.69 cores=1
/proc/26680/stat : 26680 (clasp) R 26678 26678 26652 0 -1 4202496 2107 0 0 0 1269 0 0 0 25 0 1 0 508202196 19533824 1999 33554432000 4194304 4785740 140735219475552 18446744073709551615 4287088 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26680/statm: 4769 1999 341 145 0 1814 0
[pid=26681] ppid=26678 vsize=456648 CPUtime=12.69 cores=2
/proc/26681/stat : 26681 (TNM) R 26678 26678 26652 0 -1 4202496 555 0 0 0 1269 0 0 0 25 0 1 0 508202196 467607552 452 33554432000 134512640 134534564 4288314224 18446744073709551615 134530344 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26681/statm: 114162 452 95 6 0 112828 0
[pid=26682] ppid=26678 vsize=10116 CPUtime=12.69 cores=3
/proc/26682/stat : 26682 (march_hi) R 26678 26678 26652 0 -1 4202496 1912 0 0 0 1269 0 0 0 25 0 1 0 508202196 10358784 984 33554432000 4194304 4331988 140735715498160 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26682/statm: 2529 984 175 34 0 971 0
[pid=26683] ppid=26678 vsize=65516 CPUtime=50.63 cores=4-7
/proc/26683/stat : 26683 (plingeling) S 26678 26678 26652 0 -1 4202496 10088 1250 0 0 5062 1 0 0 18 0 5 0 508202196 67088384 4835 33554432000 4194304 4356188 140734364608144 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26683/statm: 16379 4835 162 40 0 14923 0
[pid=26683/tid=26690] ppid=26678 vsize=65516 CPUtime=12.68 cores=4-7
/proc/26683/task/26690/stat : 26690 (plingeling) R 26678 26678 26652 0 -1 4202560 2243 1250 0 0 1268 0 0 0 25 0 5 0 508202197 67088384 4835 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26683/tid=26691] ppid=26678 vsize=65516 CPUtime=12.67 cores=4-7
/proc/26683/task/26691/stat : 26691 (plingeling) R 26678 26678 26652 0 -1 4202560 2329 1250 0 0 1267 0 0 0 25 0 5 0 508202197 67088384 4835 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26683/tid=26692] ppid=26678 vsize=65516 CPUtime=12.6 cores=4-7
/proc/26683/task/26692/stat : 26692 (plingeling) R 26678 26678 26652 0 -1 4202560 2151 1250 0 0 1260 0 0 0 25 0 5 0 508202198 67088384 4835 33554432000 4194304 4356188 140734364608144 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26683/tid=26693] ppid=26678 vsize=65516 CPUtime=12.65 cores=4-7
/proc/26683/task/26693/stat : 26693 (plingeling) R 26678 26678 26652 0 -1 4202560 2180 1250 0 0 1265 0 0 0 25 0 5 0 508202198 67088384 4835 33554432000 4194304 4356188 140734364608144 18446744073709551615 4225684 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.39
Current children cumulated vsize (KiB) 1190788

[startup+25.5008 s]
/proc/loadavg: 8.00 8.04 8.00 9/180 26694
/proc/meminfo: memFree=21913932/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
[pid=26679] ppid=26678 vsize=47808 CPUtime=25.49 cores=0
/proc/26679/stat : 26679 (cryptominisat) R 26678 26678 26652 0 -1 4202496 18741 0 0 0 2547 2 0 0 25 0 1 0 508202196 48955392 6362 33554432000 4194304 4587354 140734221971008 18446744073709551615 4365356 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=26681] ppid=26678 vsize=456648 CPUtime=4842.44 cores=2
/proc/26681/stat : 26681 (TNM) R 26678 26678 26652 0 -1 4202496 555 0 0 0 484243 1 0 0 25 0 1 0 508202196 467607552 452 33554432000 134512640 134534564 4288314224 18446744073709551615 134528875 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26681/statm: 114162 452 95 6 0 112828 0
[pid=26682] ppid=26678 vsize=464524 CPUtime=4842.46 cores=3
/proc/26682/stat : 26682 (march_hi) R 26678 26678 26652 0 -1 4202496 115358 0 0 0 484160 86 0 0 25 0 1 0 508202196 475672576 114430 33554432000 4194304 4331988 140735715498160 18446744073709551615 4287517 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26682/statm: 116131 114430 175 34 0 114573 0
[pid=26683] ppid=26678 vsize=251824 CPUtime=19341.9 cores=4-7
/proc/26683/stat : 26683 (plingeling) S 26678 26678 26652 0 -1 4202496 595065 1250 0 0 1934096 95 0 0 18 0 5 0 508202196 257867776 51412 33554432000 4194304 4356188 140734364608144 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26683/statm: 62956 51412 162 40 0 61500 0
[pid=26683/tid=26690] ppid=26678 vsize=251824 CPUtime=4842.45 cores=4-7
/proc/26683/task/26690/stat : 26690 (plingeling) R 26678 26678 26652 0 -1 4202560 149447 1250 0 0 484221 24 0 0 25 0 5 0 508202197 257867776 51412 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26683/tid=26691] ppid=26678 vsize=251824 CPUtime=4841.6 cores=4-7
/proc/26683/task/26691/stat : 26691 (plingeling) R 26678 26678 26652 0 -1 4202560 145917 1250 0 0 484136 24 0 0 25 0 5 0 508202197 257867776 51412 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26683/tid=26692] ppid=26678 vsize=251824 CPUtime=4816.04 cores=4-7
/proc/26683/task/26692/stat : 26692 (plingeling) R 26678 26678 26652 0 -1 4202560 154860 1250 0 0 481581 23 0 0 25 0 5 0 508202198 257867776 51412 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26683/tid=26693] ppid=26678 vsize=251824 CPUtime=4841.78 cores=4-7
/proc/26683/task/26693/stat : 26693 (plingeling) R 26678 26678 26652 0 -1 4202560 143656 1250 0 0 484156 22 0 0 25 0 5 0 508202198 257867776 51412 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38711.7
Current children cumulated vsize (KiB) 1387652

[startup+4902.3 s]
/proc/loadavg: 8.14 8.09 8.02 9/180 26839
/proc/meminfo: memFree=21133240/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
[pid=26679] ppid=26678 vsize=137380 CPUtime=4902.46 cores=0
/proc/26679/stat : 26679 (cryptominisat) R 26678 26678 26652 0 -1 4202496 184023 0 0 0 490174 72 0 0 25 0 1 0 508202196 140677120 30417 33554432000 4194304 4587354 140734221971008 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26679/statm: 34345 30417 336 96 0 30907 0
[pid=26680] ppid=26678 vsize=58952 CPUtime=4902.44 cores=1
/proc/26680/stat : 26680 (clasp) R 26678 26678 26652 0 -1 4202496 12385 0 0 0 490242 2 0 0 25 0 1 0 508202196 60366848 10513 33554432000 4194304 4785740 140735219475552 18446744073709551615 264726102658 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26680/statm: 14738 10513 341 145 0 11783 0
[pid=26681] ppid=26678 vsize=456648 CPUtime=4902.42 cores=2
/proc/26681/stat : 26681 (TNM) R 26678 26678 26652 0 -1 4202496 555 0 0 0 490241 1 0 0 25 0 1 0 508202196 467607552 452 33554432000 134512640 134534564 4288314224 18446744073709551615 134528464 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26681/statm: 114162 452 95 6 0 112828 0
[pid=26682] ppid=26678 vsize=696700 CPUtime=4902.47 cores=3
/proc/26682/stat : 26682 (march_hi) R 26678 26678 26652 0 -1 4202496 116576 0 0 0 490160 87 0 0 25 0 1 0 508202196 713420800 115648 33554432000 4194304 4331988 140735715498160 18446744073709551615 4210438 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26682/statm: 174175 115648 175 34 0 172617 0
[pid=26683] ppid=26678 vsize=267952 CPUtime=19580.9 cores=4-7
/proc/26683/stat : 26683 (plingeling) S 26678 26678 26652 0 -1 4202496 601337 1250 0 0 1957992 96 0 0 18 0 5 0 508202196 274382848 55444 33554432000 4194304 4356188 140734364608144 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26683/statm: 66988 55444 162 40 0 65532 0
[pid=26683/tid=26690] ppid=26678 vsize=267952 CPUtime=4902.45 cores=4-7
/proc/26683/task/26690/stat : 26690 (plingeling) R 26678 26678 26652 0 -1 4202560 151751 1250 0 0 490221 24 0 0 25 0 5 0 508202197 274382848 55444 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26683/tid=26691] ppid=26678 vsize=267952 CPUtime=4901.56 cores=4-7
/proc/26683/task/26691/stat : 26691 (plingeling) R 26678 26678 26652 0 -1 4202560 148157 1250 0 0 490131 25 0 0 25 0 5 0 508202197 274382848 55444 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331996 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26683/tid=26692] ppid=26678 vsize=267952 CPUtime=4875.71 cores=4-7
/proc/26683/task/26692/stat : 26692 (plingeling) R 26678 26678 26652 0 -1 4202560 155308 1250 0 0 487548 23 0 0 25 0 5 0 508202198 274382848 55444 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26683/tid=26693] ppid=26678 vsize=267952 CPUtime=4901.11 cores=4-7
/proc/26683/task/26693/stat : 26693 (plingeling) R 26678 26678 26652 0 -1 4202560 144936 1250 0 0 490088 23 0 0 25 0 5 0 508202198 274382848 55444 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39190.7
Current children cumulated vsize (KiB) 1635956

[startup+4962.3 s]
/proc/loadavg: 8.05 8.07 8.01 9/180 26841
/proc/meminfo: memFree=21141268/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
[pid=26679] ppid=26678 vsize=211600 CPUtime=4962.47 cores=0
/proc/26679/stat : 26679 (cryptominisat) R 26678 26678 26652 0 -1 4202496 184732 0 0 0 496174 73 0 0 25 0 1 0 508202196 216678400 31108 33554432000 4194304 4587354 140734221971008 18446744073709551615 4238752 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26679/statm: 52900 31108 336 96 0 49462 0
[pid=26680] ppid=26678 vsize=59240 CPUtime=4962.44 cores=1
/proc/26680/stat : 26680 (clasp) R 26678 26678 26652 0 -1 4202496 12435 0 0 0 496242 2 0 0 25 0 1 0 508202196 60661760 10563 33554432000 4194304 4785740 140735219475552 18446744073709551615 4287249 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26680/statm: 14810 10563 341 145 0 11855 0
[pid=26681] ppid=26678 vsize=456648 CPUtime=4962.42 cores=2
/proc/26681/stat : 26681 (TNM) R 26678 26678 26652 0 -1 4202496 555 0 0 0 496241 1 0 0 25 0 1 0 508202196 467607552 452 33554432000 134512640 134534564 4288314224 18446744073709551615 134528464 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26681/statm: 114162 452 95 6 0 112828 0
[pid=26682] ppid=26678 vsize=696700 CPUtime=4962.47 cores=3
/proc/26682/stat : 26682 (march_hi) R 26678 26678 26652 0 -1 4202496 117856 0 0 0 496159 88 0 0 25 0 1 0 508202196 713420800 116928 33554432000 4194304 4331988 140735715498160 18446744073709551615 4228331 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26682/statm: 174175 116928 175 34 0 172617 0
[pid=26683] ppid=26678 vsize=251312 CPUtime=19820.5 cores=4-7
/proc/26683/stat : 26683 (plingeling) S 26678 26678 26652 0 -1 4202496 604089 1250 0 0 1981957 97 0 0 18 0 5 0 508202196 257343488 51284 33554432000 4194304 4356188 140734364608144 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26683/statm: 62828 51284 162 40 0 61372 0
[pid=26683/tid=26690] ppid=26678 vsize=251312 CPUtime=4962.45 cores=4-7
/proc/26683/task/26690/stat : 26690 (plingeling) R 26678 26678 26652 0 -1 4202560 151751 1250 0 0 496221 24 0 0 25 0 5 0 508202197 257343488 51284 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331168 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26683/tid=26691] ppid=26678 vsize=251312 CPUtime=4961.56 cores=4-7
/proc/26683/task/26691/stat : 26691 (plingeling) R 26678 26678 26652 0 -1 4202560 148157 1250 0 0 496131 25 0 0 25 0 5 0 508202197 257343488 51284 33554432000 4194304 4356188 140734364608144 18446744073709551615 4330995 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26683/tid=26692] ppid=26678 vsize=251312 CPUtime=4935.38 cores=4-7
/proc/26683/task/26692/stat : 26692 (plingeling) R 26678 26678 26652 0 -1 4202560 157100 1250 0 0 493515 23 0 0 25 0 5 0 508202198 257343488 51284 33554432000 4194304 4356188 140734364608144 18446744073709551615 4332023 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26683/tid=26693] ppid=26678 vsize=251312 CPUtime=4961.11 cores=4-7
/proc/26683/task/26693/stat : 26693 (plingeling) R 26678 26678 26652 0 -1 4202560 145896 1250 0 0 496088 23 0 0 25 0 5 0 508202198 257343488 51284 33554432000 4194304 4356188 140734364608144 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39670.3
Current children cumulated vsize (KiB) 1693824



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 8.02 8.06 8.01 9/180 26842
/proc/meminfo: memFree=21127976/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
[pid=26679] ppid=26678 vsize=137380 CPUtime=5000.17 cores=0
/proc/26679/stat : 26679 (cryptominisat) R 26678 26678 26652 0 -1 4202496 185498 0 0 0 499944 73 0 0 25 0 1 0 508202196 140677120 30418 33554432000 4194304 4587354 140734221971008 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26679/statm: 34345 30418 336 96 0 30907 0
[pid=26680] ppid=26678 vsize=59528 CPUtime=5000.15 cores=1
/proc/26680/stat : 26680 (clasp) R 26678 26678 26652 0 -1 4202496 12486 0 0 0 500013 2 0 0 25 0 1 0 508202196 60956672 10614 33554432000 4194304 4785740 140735219475552 18446744073709551615 4538896 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26680/statm: 14882 10614 341 145 0 11927 0
[pid=26681] ppid=26678 vsize=456648 CPUtime=5000.13 cores=2
/proc/26681/stat : 26681 (TNM) R 26678 26678 26652 0 -1 4202496 555 0 0 0 500012 1 0 0 25 0 1 0 508202196 467607552 452 33554432000 134512640 134534564 4288314224 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26681/statm: 114162 452 95 6 0 112828 0
[pid=26682] ppid=26678 vsize=696700 CPUtime=5000.18 cores=3
/proc/26682/stat : 26682 (march_hi) R 26678 26678 26652 0 -1 4202496 118710 0 0 0 499929 89 0 0 25 0 1 0 508202196 713420800 117782 33554432000 4194304 4331988 140735715498160 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26682/statm: 174175 117782 175 34 0 172617 0
[pid=26683] ppid=26678 vsize=264112 CPUtime=19971.2 cores=4-7
/proc/26683/stat : 26683 (plingeling) S 26678 26678 26652 0 -1 4202496 607289 1250 0 0 1997019 97 0 0 18 0 5 0 508202196 270450688 54484 33554432000 4194304 4356188 140734364608144 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26683/statm: 66028 54484 162 40 0 64572 0
[pid=26683/tid=26690] ppid=26678 vsize=264112 CPUtime=5000.16 cores=4-7
/proc/26683/task/26690/stat : 26690 (plingeling) R 26678 26678 26652 0 -1 4202560 152711 1250 0 0 499991 25 0 0 25 0 5 0 508202197 270450688 54484 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331984 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26683/tid=26691] ppid=26678 vsize=264112 CPUtime=4999.26 cores=4-7
/proc/26683/task/26691/stat : 26691 (plingeling) R 26678 26678 26652 0 -1 4202560 149117 1250 0 0 499901 25 0 0 25 0 5 0 508202197 270450688 54484 33554432000 4194304 4356188 140734364608144 18446744073709551615 4330999 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26683/tid=26692] ppid=26678 vsize=264112 CPUtime=4972.88 cores=4-7
/proc/26683/task/26692/stat : 26692 (plingeling) R 26678 26678 26652 0 -1 4202560 157100 1250 0 0 497265 23 0 0 25 0 5 0 508202198 270450688 54484 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26683/tid=26693] ppid=26678 vsize=264112 CPUtime=4998.82 cores=4-7
/proc/26683/task/26693/stat : 26693 (plingeling) R 26678 26678 26652 0 -1 4202560 147176 1250 0 0 499859 23 0 0 25 0 5 0 508202198 270450688 54484 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331111 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39971.8
Current children cumulated vsize (KiB) 1632692

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5000 s]
/proc/loadavg: 8.02 8.06 8.01 9/180 26842
/proc/meminfo: memFree=21127976/32951124 swapFree=67111524/67111528
[pid=26678] ppid=26676 vsize=18324 CPUtime=0 cores=0-7
/proc/26678/stat : 26678 (ppfolio) S 26676 26678 26652 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 508202195 18763776 390 33554432000 4194304 4287625 140735965744464 18446744073709551615 264726425103 0 0 4096 65536 2656279634391334911 0 0 17 6 0 0 0
/proc/26678/statm: 4581 390 341 23 0 91 0
[pid=26679] ppid=26678 vsize=137380 CPUtime=5000.17 cores=0
/proc/26679/stat : 26679 (cryptominisat) R 26678 26678 26652 0 -1 4202496 185498 0 0 0 499944 73 0 0 25 0 1 0 508202196 140677120 30418 33554432000 4194304 4587354 140734221971008 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26679/statm: 34345 30418 336 96 0 30907 0
[pid=26680] ppid=26678 vsize=59528 CPUtime=5000.15 cores=1
/proc/26680/stat : 26680 (clasp) R 26678 26678 26652 0 -1 4202496 12486 0 0 0 500013 2 0 0 25 0 1 0 508202196 60956672 10614 33554432000 4194304 4785740 140735219475552 18446744073709551615 4538896 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26680/statm: 14882 10614 341 145 0 11927 0
[pid=26681] ppid=26678 vsize=456648 CPUtime=5000.13 cores=2
/proc/26681/stat : 26681 (TNM) R 26678 26678 26652 0 -1 4202496 555 0 0 0 500012 1 0 0 25 0 1 0 508202196 467607552 452 33554432000 134512640 134534564 4288314224 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26681/statm: 114162 452 95 6 0 112828 0
[pid=26682] ppid=26678 vsize=696700 CPUtime=5000.18 cores=3
/proc/26682/stat : 26682 (march_hi) R 26678 26678 26652 0 -1 4202496 118710 0 0 0 499929 89 0 0 25 0 1 0 508202196 713420800 117782 33554432000 4194304 4331988 140735715498160 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26682/statm: 174175 117782 175 34 0 172617 0
[pid=26683] ppid=26678 vsize=264112 CPUtime=19971.2 cores=4-7
/proc/26683/stat : 26683 (plingeling) S 26678 26678 26652 0 -1 4202496 607289 1250 0 0 1997019 97 0 0 18 0 5 0 508202196 270450688 54484 33554432000 4194304 4356188 140734364608144 18446744073709551615 264738207717 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26683/statm: 66028 54484 162 40 0 64572 0
[pid=26683/tid=26690] ppid=26678 vsize=264112 CPUtime=5000.16 cores=4-7
/proc/26683/task/26690/stat : 26690 (plingeling) R 26678 26678 26652 0 -1 4202560 152711 1250 0 0 499991 25 0 0 25 0 5 0 508202197 270450688 54484 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331984 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26683/tid=26691] ppid=26678 vsize=264112 CPUtime=4999.26 cores=4-7
/proc/26683/task/26691/stat : 26691 (plingeling) R 26678 26678 26652 0 -1 4202560 149117 1250 0 0 499901 25 0 0 25 0 5 0 508202197 270450688 54484 33554432000 4194304 4356188 140734364608144 18446744073709551615 4330999 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26683/tid=26692] ppid=26678 vsize=264112 CPUtime=4972.88 cores=4-7
/proc/26683/task/26692/stat : 26692 (plingeling) R 26678 26678 26652 0 -1 4202560 157100 1250 0 0 497265 23 0 0 25 0 5 0 508202198 270450688 54484 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26683/tid=26693] ppid=26678 vsize=264112 CPUtime=4998.82 cores=4-7
/proc/26683/task/26693/stat : 26693 (plingeling) R 26678 26678 26652 0 -1 4202560 147176 1250 0 0 499859 23 0 0 25 0 5 0 508202198 270450688 54484 33554432000 4194304 4356188 140734364608144 18446744073709551615 4331111 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39971.8
Current children cumulated vsize (KiB) 1632692

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26678 and gives
#  childrusage.ru_utime.tv_sec=14999
#  childrusage.ru_utime.tv_usec=707697
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=789879
# CPU time returned by wait4() is 15000.5
# while last known CPU time is 39971.8
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5000.02
CPU time (s): 39971.8
CPU user time (s): 39969.2
CPU system time (s): 2.62
CPU usage (%): 799.433
Max. virtual memory (cumulated for all children) (KiB): 11407800

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 14999.7
system time used= 0.789879
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 199073
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 698
involuntary context switches= 35151

runsolver used 8.32473 second user time and 18.9531 second system time

The end

Launcher Data 

Begin job on node141 at 2011-04-30 12:04:26
IDJOB=3220497
IDBENCH=82766
IDSOLVER=1638
FILE ID=node141/3220497-1304157866
RUNJOBID= node141-1304157866-26666
PBS_JOBID= 13170914
Free space on /tmp= 72600 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k7-r89-v80-c7120-S1818856267-075.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3220497-1304157866/watcher-3220497-1304157866 -o /tmp/evaluation-result-3220497-1304157866/solver-3220497-1304157866 -C 40000 -W 5000 -M 31000  ppfolio HOME/instance-3220497-1304157866.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ff76c2a7684df6ebd90c6aa1ff48f56d
RANDOM SEED=1779997684

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21979792 kB
Buffers:       1408128 kB
Cached:        8923728 kB
SwapCached:          4 kB
Active:        2653828 kB
Inactive:      7740752 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21979792 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           10120 kB
Writeback:           0 kB
AnonPages:       62804 kB
Mapped:          14712 kB
Slab:           511236 kB
PageTables:       4656 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   181900 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72588 MiB
End job on node141 at 2011-04-30 13:27:48