Trace number 3219969

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 39972.3 5000.02

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S1859210562-077-UNKNOWN.cnf
MD5SUM3d96bca49fe954bb59442ef617e689bb
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3219969-1304155253/watcher-3219969-1304155253 -o /tmp/evaluation-result-3219969-1304155253/solver-3219969-1304155253 -C 40000 -W 5000 -M 31000 ppfolio HOME/instance-3219969-1304155253.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.03 8.05 8.00 1/170 27285
/proc/meminfo: memFree=30109308/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) R 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0

[startup+0.120592 s]
/proc/loadavg: 8.03 8.05 8.00 1/170 27285
/proc/meminfo: memFree=30109308/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.200435 s]
/proc/loadavg: 8.03 8.05 8.00 1/170 27285
/proc/meminfo: memFree=30109308/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300416 s]
/proc/loadavg: 8.03 8.05 8.00 1/170 27285
/proc/meminfo: memFree=30109308/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.70034 s]
/proc/loadavg: 8.03 8.05 8.00 1/170 27285
/proc/meminfo: memFree=30109308/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 19 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.5012 s]
/proc/loadavg: 8.03 8.05 8.00 9/180 27300
/proc/meminfo: memFree=30073144/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
[pid=27286] ppid=27285 vsize=1251444 CPUtime=1.49 cores=0
/proc/27286/stat : 27286 (cryptominisat) R 27285 27285 26830 0 -1 4202496 5449 0 0 0 149 0 0 0 20 0 1 0 527125740 1281478656 1853 33554432000 4194304 4587354 140733546595328 18446744073709551615 4237443 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27286/statm: 312861 1853 327 96 0 309423 0
[pid=27287] ppid=27285 vsize=21184 CPUtime=1.49 cores=1
/proc/27287/stat : 27287 (clasp) R 27285 27285 26830 0 -1 4202496 2825 0 0 0 149 0 0 0 20 0 1 0 527125740 21692416 2629 33554432000 4194304 4785740 140735120148320 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27287/statm: 5296 2629 340 145 0 2341 0
[pid=27288] ppid=27285 vsize=455032 CPUtime=1.49 cores=2
/proc/27288/stat : 27288 (TNM) R 27285 27285 26830 0 -1 4202496 1151 0 0 0 149 0 0 0 20 0 1 0 527125740 465952768 1047 33554432000 134512640 134534564 4293431648 18446744073709551615 134524672 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/27288/statm: 113758 1047 91 6 0 112424 0
[pid=27289] ppid=27285 vsize=10932 CPUtime=1.49 cores=3
/proc/27289/stat : 27289 (march_hi) R 27285 27285 26830 0 -1 4202496 4746 0 0 0 149 0 0 0 20 0 1 0 527125740 11194368 1065 33554432000 4194304 4331988 140736556005200 18446744073709551615 4271154 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/27289/statm: 2733 1065 150 34 0 1175 0
[pid=27290] ppid=27285 vsize=125192 CPUtime=5.8 cores=4-7
/proc/27290/stat : 27290 (plingeling) S 27285 27285 26830 0 -1 4202496 5975 1252 0 0 579 1 0 0 18 0 5 0 527125740 128196608 3364 33554432000 4194304 4356188 140733315793344 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/27290/statm: 31298 3364 161 40 0 29842 0
[pid=27290/tid=27297] ppid=27285 vsize=125192 CPUtime=1.43 cores=4-7
/proc/27290/task/27297/stat : 27297 (plingeling) R 27285 27285 26830 0 -1 4202560 598 1252 0 0 143 0 0 0 23 0 5 0 527125745 128196608 3364 33554432000 4194304 4356188 140733315793344 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27290/tid=27298] ppid=27285 vsize=125192 CPUtime=1.43 cores=4-7
/proc/27290/task/27298/stat : 27298 (plingeling) R 27285 27285 26830 0 -1 4202560 574 1252 0 0 143 0 0 0 23 0 5 0 527125745 128196608 3364 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331510 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27290/tid=27299] ppid=27285 vsize=125192 CPUtime=1.44 cores=4-7
/proc/27290/task/27299/stat : 27299 (plingeling) R 27285 27285 26830 0 -1 4202560 554 1252 0 0 144 0 0 0 23 0 5 0 527125745 128196608 3364 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331183 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27290/tid=27300] ppid=27285 vsize=125192 CPUtime=1.44 cores=4-7
/proc/27290/task/27300/stat : 27300 (plingeling) R 27285 27285 26830 0 -1 4202560 659 1252 0 0 144 0 0 0 23 0 5 0 527125745 128196608 3364 33554432000 4194304 4356188 140733315793344 18446744073709551615 4330992 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.76
Current children cumulated vsize (KiB) 1882108

[startup+3.1009 s]
/proc/loadavg: 8.03 8.05 8.00 9/180 27300
/proc/meminfo: memFree=30068460/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
[pid=27286] ppid=27285 vsize=1270736 CPUtime=3.09 cores=0
/proc/27286/stat : 27286 (cryptominisat) R 27285 27285 26830 0 -1 4202496 12262 0 0 0 308 1 0 0 25 0 1 0 527125740 1301233664 6559 33554432000 4194304 4587354 140733546595328 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27286/statm: 317684 6559 337 96 0 314246 0
[pid=27287] ppid=27285 vsize=22764 CPUtime=3.09 cores=1
/proc/27287/stat : 27287 (clasp) R 27285 27285 26830 0 -1 4202496 3209 0 0 0 309 0 0 0 25 0 1 0 527125740 23310336 3013 33554432000 4194304 4785740 140735120148320 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27287/statm: 5691 3013 340 145 0 2736 0
[pid=27288] ppid=27285 vsize=455032 CPUtime=3.09 cores=2
/proc/27288/stat : 27288 (TNM) R 27285 27285 26830 0 -1 4202496 1151 0 0 0 309 0 0 0 25 0 1 0 527125740 465952768 1047 33554432000 134512640 134534564 4293431648 18446744073709551615 134524568 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/27288/statm: 113758 1047 91 6 0 112424 0
[pid=27289] ppid=27285 vsize=14320 CPUtime=3.08 cores=3
/proc/27289/stat : 27289 (march_hi) R 27285 27285 26830 0 -1 4202496 5788 0 0 0 308 0 0 0 25 0 1 0 527125740 14663680 1732 33554432000 4194304 4331988 140736556005200 18446744073709551615 4237419 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/27289/statm: 3580 1732 174 34 0 2022 0
[pid=27290] ppid=27285 vsize=127032 CPUtime=12.19 cores=4-7
/proc/27290/stat : 27290 (plingeling) S 27285 27285 26830 0 -1 4202496 6442 1252 0 0 1218 1 0 0 18 0 5 0 527125740 130080768 3831 33554432000 4194304 4356188 140733315793344 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/27290/statm: 31758 3831 161 40 0 30302 0
[pid=27290/tid=27297] ppid=27285 vsize=127032 CPUtime=3.02 cores=4-7
/proc/27290/task/27297/stat : 27297 (plingeling) R 27285 27285 26830 0 -1 4202560 679 1252 0 0 302 0 0 0 25 0 5 0 527125745 130080768 3831 33554432000 4194304 4356188 140733315793344 18446744073709551615 4234093 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27290/tid=27298] ppid=27285 vsize=127032 CPUtime=3.03 cores=4-7
/proc/27290/task/27298/stat : 27298 (plingeling) R 27285 27285 26830 0 -1 4202560 751 1252 0 0 303 0 0 0 25 0 5 0 527125745 130080768 3831 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27290/tid=27299] ppid=27285 vsize=127032 CPUtime=3.04 cores=4-7
/proc/27290/task/27299/stat : 27299 (plingeling) R 27285 27285 26830 0 -1 4202560 660 1252 0 0 304 0 0 0 25 0 5 0 527125745 130080768 3831 33554432000 4194304 4356188 140733315793344 18446744073709551615 4281515 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27290/tid=27300] ppid=27285 vsize=127032 CPUtime=3.04 cores=4-7
/proc/27290/task/27300/stat : 27300 (plingeling) R 27285 27285 26830 0 -1 4202560 762 1252 0 0 304 0 0 0 25 0 5 0 527125745 130080768 3831 33554432000 4194304 4356188 140733315793344 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.54
Current children cumulated vsize (KiB) 1908208

[startup+6.30132 s]
/proc/loadavg: 8.03 8.05 8.00 9/180 27300
/proc/meminfo: memFree=30042916/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
[pid=27286] ppid=27285 vsize=1260632 CPUtime=6.29 cores=0
/proc/27286/stat : 27286 (cryptominisat) R 27285 27285 26830 0 -1 4202496 12977 0 0 0 628 1 0 0 25 0 1 0 527125740 1290887168 6049 33554432000 4194304 4587354 140733546595328 18446744073709551615 4245514 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27286/statm: 315158 6049 337 96 0 311720 0
[pid=27287] ppid=27285 vsize=25180 CPUtime=6.29 cores=1
/proc/27287/stat : 27287 (clasp) R 27285 27285 26830 0 -1 4202496 3811 0 0 0 628 1 0 0 25 0 1 0 527125740 25784320 3615 33554432000 4194304 4785740 140735120148320 18446744073709551615 4287143 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27287/statm: 6295 3615 340 145 0 3340 0
[pid=27288] ppid=27285 vsize=459288 CPUtime=6.29 cores=2
/proc/27288/stat : 27288 (TNM) R 27285 27285 26830 0 -1 4202496 1399 0 0 0 629 0 0 0 25 0 1 0 527125740 470310912 1295 33554432000 134512640 134534564 4293431648 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/27288/statm: 114822 1295 95 6 0 113488 0
[pid=27289] ppid=27285 vsize=14320 CPUtime=6.29 cores=3
/proc/27289/stat : 27289 (march_hi) R 27285 27285 26830 0 -1 4202496 5788 0 0 0 629 0 0 0 25 0 1 0 527125740 14663680 1732 33554432000 4194304 4331988 140736556005200 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/27289/statm: 3580 1732 174 34 0 2022 0
[pid=27290] ppid=27285 vsize=131168 CPUtime=24.98 cores=4-7
/proc/27290/stat : 27290 (plingeling) S 27285 27285 26830 0 -1 4202496 7476 1252 0 0 2497 1 0 0 18 0 5 0 527125740 134316032 4865 33554432000 4194304 4356188 140733315793344 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/27290/statm: 32792 4865 161 40 0 31336 0
[pid=27290/tid=27297] ppid=27285 vsize=131168 CPUtime=6.21 cores=4-7
/proc/27290/task/27297/stat : 27297 (plingeling) R 27285 27285 26830 0 -1 4202560 978 1252 0 0 621 0 0 0 25 0 5 0 527125745 134316032 4865 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331728 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27290/tid=27298] ppid=27285 vsize=131168 CPUtime=6.23 cores=4-7
/proc/27290/task/27298/stat : 27298 (plingeling) R 27285 27285 26830 0 -1 4202560 969 1252 0 0 623 0 0 0 25 0 5 0 527125745 134316032 4865 33554432000 4194304 4356188 140733315793344 18446744073709551615 4211567 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27290/tid=27299] ppid=27285 vsize=131168 CPUtime=6.23 cores=4-7
/proc/27290/task/27299/stat : 27299 (plingeling) R 27285 27285 26830 0 -1 4202560 918 1252 0 0 623 0 0 0 25 0 5 0 527125745 134316032 4865 33554432000 4194304 4356188 140733315793344 18446744073709551615 4238561 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27290/tid=27300] ppid=27285 vsize=131168 CPUtime=6.24 cores=4-7
/proc/27290/task/27300/stat : 27300 (plingeling) R 27285 27285 26830 0 -1 4202560 1021 1252 0 0 624 0 0 0 25 0 5 0 527125745 134316032 4865 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.14
Current children cumulated vsize (KiB) 1908912

[startup+12.7012 s]
/proc/loadavg: 8.03 8.05 8.00 9/180 27300
/proc/meminfo: memFree=30039220/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
[pid=27286] ppid=27285 vsize=1273712 CPUtime=12.69 cores=0
/proc/27286/stat : 27286 (cryptominisat) R 27285 27285 26830 0 -1 4202496 15223 0 0 0 1268 1 0 0 25 0 1 0 527125740 1304281088 6891 33554432000 4194304 4587354 140733546595328 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27286/statm: 318428 6891 337 96 0 314990 0
[pid=27287] ppid=27285 vsize=27876 CPUtime=12.69 cores=1
/proc/27287/stat : 27287 (clasp) R 27285 27285 26830 0 -1 4202496 4444 0 0 0 1268 1 0 0 25 0 1 0 527125740 28545024 4248 33554432000 4194304 4785740 140735120148320 18446744073709551615 4287140 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27287/statm: 6969 4248 340 145 0 4014 0
[pid=27288] ppid=27285 vsize=459288 CPUtime=12.69 cores=2
/proc/27288/stat : 27288 (TNM) R 27285 27285 26830 0 -1 4202496 1399 0 0 0 1269 0 0 0 25 0 1 0 527125740 470310912 1295 33554432000 134512640 134534564 4293431648 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/27288/statm: 114822 1295 95 6 0 113488 0
[pid=27289] ppid=27285 vsize=14320 CPUtime=12.69 cores=3
/proc/27289/stat : 27289 (march_hi) R 27285 27285 26830 0 -1 4202496 5788 0 0 0 1269 0 0 0 25 0 1 0 527125740 14663680 1732 33554432000 4194304 4331988 140736556005200 18446744073709551615 4299194 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/27289/statm: 3580 1732 174 34 0 2022 0
[pid=27290] ppid=27285 vsize=130796 CPUtime=50.54 cores=4-7
/proc/27290/stat : 27290 (plingeling) S 27285 27285 26830 0 -1 4202496 10072 1252 0 0 5052 2 0 0 18 0 5 0 527125740 133935104 4772 33554432000 4194304 4356188 140733315793344 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/27290/statm: 32699 4772 161 40 0 31243 0
[pid=27290/tid=27297] ppid=27285 vsize=130796 CPUtime=12.57 cores=4-7
/proc/27290/task/27297/stat : 27297 (plingeling) R 27285 27285 26830 0 -1 4202560 2099 1252 0 0 1257 0 0 0 25 0 5 0 527125745 133935104 4772 33554432000 4194304 4356188 140733315793344 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27290/tid=27298] ppid=27285 vsize=130796 CPUtime=12.63 cores=4-7
/proc/27290/task/27298/stat : 27298 (plingeling) R 27285 27285 26830 0 -1 4202560 1131 1252 0 0 1263 0 0 0 25 0 5 0 527125745 133935104 4772 33554432000 4194304 4356188 140733315793344 18446744073709551615 4281722 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27290/tid=27299] ppid=27285 vsize=130796 CPUtime=12.63 cores=4-7
/proc/27290/task/27299/stat : 27299 (plingeling) R 27285 27285 26830 0 -1 4202560 1527 1252 0 0 1263 0 0 0 25 0 5 0 527125745 133935104 4772 33554432000 4194304 4356188 140733315793344 18446744073709551615 4234220 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27290/tid=27300] ppid=27285 vsize=130796 CPUtime=12.64 cores=4-7
/proc/27290/task/27300/stat : 27300 (plingeling) R 27285 27285 26830 0 -1 4202560 1725 1252 0 0 1264 0 0 0 25 0 5 0 527125745 133935104 4772 33554432000 4194304 4356188 140733315793344 18446744073709551615 4330982 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.3
Current children cumulated vsize (KiB) 1924316

[startup+25.5008 s]
/proc/loadavg: 8.09 8.06 8.00 9/180 27300
/proc/meminfo: memFree=30012628/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
[pid=27286] ppid=27285 vsize=1273480 CPUtime=25.49 cores=0
/proc/27286/stat : 27286 (cryptominisat) R 27285 27285 26830 0 -1 4202496 20747 0 0 0 2547 2 0 0 25 0 1 0 527125740 1304043520 9031 33554432000 4194304 4587354 140733546595328 18446744073709551615 4238622 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=27288] ppid=27285 vsize=459288 CPUtime=4841.15 cores=2
/proc/27288/stat : 27288 (TNM) R 27285 27285 26830 0 -1 4202496 1399 0 0 0 484113 2 0 0 25 0 1 0 527125740 470310912 1295 33554432000 134512640 134534564 4293431648 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/27288/statm: 114822 1295 95 6 0 113488 0
[pid=27289] ppid=27285 vsize=697528 CPUtime=4842.44 cores=3
/proc/27289/stat : 27289 (march_hi) R 27285 27285 26830 0 -1 4202496 136813 0 0 0 484147 97 0 0 25 0 1 0 527125740 714268672 132757 33554432000 4194304 4331988 140736556005200 18446744073709551615 4226263 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/27289/statm: 174382 132757 175 34 0 172824 0
[pid=27290] ppid=27285 vsize=206296 CPUtime=19343.1 cores=4-7
/proc/27290/stat : 27290 (plingeling) S 27285 27285 26830 0 -1 4202496 412342 1252 0 0 1934250 56 0 0 18 0 5 0 527125740 211247104 23647 33554432000 4194304 4356188 140733315793344 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/27290/statm: 51574 23647 161 40 0 50118 0
[pid=27290/tid=27297] ppid=27285 vsize=206296 CPUtime=4815.97 cores=4-7
/proc/27290/task/27297/stat : 27297 (plingeling) R 27285 27285 26830 0 -1 4202560 107640 1252 0 0 481583 14 0 0 25 0 5 0 527125745 211247104 23647 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27290/tid=27298] ppid=27285 vsize=206296 CPUtime=4842.24 cores=4-7
/proc/27290/task/27298/stat : 27298 (plingeling) R 27285 27285 26830 0 -1 4202560 93425 1252 0 0 484211 13 0 0 25 0 5 0 527125745 211247104 23647 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27290/tid=27299] ppid=27285 vsize=206296 CPUtime=4842.38 cores=4-7
/proc/27290/task/27299/stat : 27299 (plingeling) R 27285 27285 26830 0 -1 4202560 94717 1252 0 0 484226 12 0 0 25 0 5 0 527125745 211247104 23647 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27290/tid=27300] ppid=27285 vsize=206296 CPUtime=4842.38 cores=4-7
/proc/27290/task/27300/stat : 27300 (plingeling) R 27285 27285 26830 0 -1 4202560 112970 1252 0 0 484224 14 0 0 25 0 5 0 527125745 211247104 23647 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38711.5
Current children cumulated vsize (KiB) 3101376

[startup+4902.3 s]
/proc/loadavg: 8.11 8.07 8.00 9/180 27442
/proc/meminfo: memFree=28998788/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
[pid=27286] ppid=27285 vsize=1552960 CPUtime=4902.43 cores=0
/proc/27286/stat : 27286 (cryptominisat) R 27285 27285 26830 0 -1 4202496 994989 0 0 0 489859 384 0 0 25 0 1 0 527125740 1590231040 83560 33554432000 4194304 4587354 140733546595328 18446744073709551615 4388277 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27286/statm: 388240 83560 337 96 0 384802 0
[pid=27287] ppid=27285 vsize=167836 CPUtime=4902.44 cores=1
/proc/27287/stat : 27287 (clasp) R 27285 27285 26830 0 -1 4202496 37238 0 0 0 490235 9 0 0 25 0 1 0 527125740 171864064 35681 33554432000 4194304 4785740 140735120148320 18446744073709551615 4309555 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27287/statm: 41959 35681 341 145 0 39004 0
[pid=27288] ppid=27285 vsize=459288 CPUtime=4901.14 cores=2
/proc/27288/stat : 27288 (TNM) R 27285 27285 26830 0 -1 4202496 1399 0 0 0 490112 2 0 0 25 0 1 0 527125740 470310912 1295 33554432000 134512640 134534564 4293431648 18446744073709551615 134528464 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/27288/statm: 114822 1295 95 6 0 113488 0
[pid=27289] ppid=27285 vsize=697528 CPUtime=4902.43 cores=3
/proc/27289/stat : 27289 (march_hi) R 27285 27285 26830 0 -1 4202496 138490 0 0 0 490145 98 0 0 25 0 1 0 527125740 714268672 134434 33554432000 4194304 4331988 140736556005200 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/27289/statm: 174382 134434 175 34 0 172824 0
[pid=27290] ppid=27285 vsize=205784 CPUtime=19582.7 cores=4-7
/proc/27290/stat : 27290 (plingeling) S 27285 27285 26830 0 -1 4202496 415702 1252 0 0 1958215 57 0 0 18 0 5 0 527125740 210722816 23519 33554432000 4194304 4356188 140733315793344 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/27290/statm: 51446 23519 161 40 0 49990 0
[pid=27290/tid=27297] ppid=27285 vsize=205784 CPUtime=4875.65 cores=4-7
/proc/27290/task/27297/stat : 27297 (plingeling) R 27285 27285 26830 0 -1 4202560 107640 1252 0 0 487550 15 0 0 25 0 5 0 527125745 210722816 23519 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331964 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27290/tid=27298] ppid=27285 vsize=205784 CPUtime=4902.23 cores=4-7
/proc/27290/task/27298/stat : 27298 (plingeling) R 27285 27285 26830 0 -1 4202560 93489 1252 0 0 490210 13 0 0 25 0 5 0 527125745 210722816 23519 33554432000 4194304 4356188 140733315793344 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27290/tid=27299] ppid=27285 vsize=205784 CPUtime=4902.37 cores=4-7
/proc/27290/task/27299/stat : 27299 (plingeling) R 27285 27285 26830 0 -1 4202560 94717 1252 0 0 490225 12 0 0 25 0 5 0 527125745 210722816 23519 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27290/tid=27300] ppid=27285 vsize=205784 CPUtime=4902.39 cores=4-7
/proc/27290/task/27300/stat : 27300 (plingeling) R 27285 27285 26830 0 -1 4202560 116266 1252 0 0 490224 15 0 0 25 0 5 0 527125745 210722816 23519 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39191.2
Current children cumulated vsize (KiB) 3101720

[startup+4962.3 s]
/proc/loadavg: 8.10 8.07 8.00 9/180 27444
/proc/meminfo: memFree=28992444/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
[pid=27286] ppid=27285 vsize=1552960 CPUtime=4962.43 cores=0
/proc/27286/stat : 27286 (cryptominisat) R 27285 27285 26830 0 -1 4202496 994989 0 0 0 495859 384 0 0 25 0 1 0 527125740 1590231040 83560 33554432000 4194304 4587354 140733546595328 18446744073709551615 4388352 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27286/statm: 388240 83560 337 96 0 384802 0
[pid=27287] ppid=27285 vsize=168260 CPUtime=4962.44 cores=1
/proc/27287/stat : 27287 (clasp) R 27285 27285 26830 0 -1 4202496 37330 0 0 0 496235 9 0 0 25 0 1 0 527125740 172298240 35773 33554432000 4194304 4785740 140735120148320 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27287/statm: 42065 35773 341 145 0 39110 0
[pid=27288] ppid=27285 vsize=459288 CPUtime=4961.13 cores=2
/proc/27288/stat : 27288 (TNM) R 27285 27285 26830 0 -1 4202496 1399 0 0 0 496111 2 0 0 25 0 1 0 527125740 470310912 1295 33554432000 134512640 134534564 4293431648 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/27288/statm: 114822 1295 95 6 0 113488 0
[pid=27289] ppid=27285 vsize=697528 CPUtime=4962.43 cores=3
/proc/27289/stat : 27289 (march_hi) R 27285 27285 26830 0 -1 4202496 140158 0 0 0 496144 99 0 0 25 0 1 0 527125740 714268672 136102 33554432000 4194304 4331988 140736556005200 18446744073709551615 4210459 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/27289/statm: 174382 136102 175 34 0 172824 0
[pid=27290] ppid=27285 vsize=206168 CPUtime=19822.4 cores=4-7
/proc/27290/stat : 27290 (plingeling) S 27285 27285 26830 0 -1 4202496 419286 1252 0 0 1982182 57 0 0 18 0 5 0 527125740 211116032 23615 33554432000 4194304 4356188 140733315793344 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/27290/statm: 51542 23615 161 40 0 50086 0
[pid=27290/tid=27297] ppid=27285 vsize=206168 CPUtime=4935.32 cores=4-7
/proc/27290/task/27297/stat : 27297 (plingeling) R 27285 27285 26830 0 -1 4202560 109048 1252 0 0 493517 15 0 0 25 0 5 0 527125745 211116032 23615 33554432000 4194304 4356188 140733315793344 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27290/tid=27298] ppid=27285 vsize=206168 CPUtime=4962.23 cores=4-7
/proc/27290/task/27298/stat : 27298 (plingeling) R 27285 27285 26830 0 -1 4202560 93745 1252 0 0 496210 13 0 0 25 0 5 0 527125745 211116032 23615 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27290/tid=27299] ppid=27285 vsize=206168 CPUtime=4962.37 cores=4-7
/proc/27290/task/27299/stat : 27299 (plingeling) R 27285 27285 26830 0 -1 4202560 96061 1252 0 0 496225 12 0 0 25 0 5 0 527125745 211116032 23615 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27290/tid=27300] ppid=27285 vsize=206168 CPUtime=4962.39 cores=4-7
/proc/27290/task/27300/stat : 27300 (plingeling) R 27285 27285 26830 0 -1 4202560 116842 1252 0 0 496224 15 0 0 25 0 5 0 527125745 211116032 23615 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331007 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39670.8
Current children cumulated vsize (KiB) 3102528



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 8.13 8.07 8.01 9/180 27445
/proc/meminfo: memFree=28973712/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
[pid=27286] ppid=27285 vsize=1552960 CPUtime=5000.13 cores=0
/proc/27286/stat : 27286 (cryptominisat) R 27285 27285 26830 0 -1 4202496 994989 0 0 0 499629 384 0 0 25 0 1 0 527125740 1590231040 83560 33554432000 4194304 4587354 140733546595328 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27286/statm: 388240 83560 337 96 0 384802 0
[pid=27287] ppid=27285 vsize=169540 CPUtime=5000.15 cores=1
/proc/27287/stat : 27287 (clasp) R 27285 27285 26830 0 -1 4202496 37598 0 0 0 500006 9 0 0 25 0 1 0 527125740 173608960 36041 33554432000 4194304 4785740 140735120148320 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27287/statm: 42385 36041 341 145 0 39430 0
[pid=27288] ppid=27285 vsize=459288 CPUtime=4998.84 cores=2
/proc/27288/stat : 27288 (TNM) R 27285 27285 26830 0 -1 4202496 1399 0 0 0 499882 2 0 0 25 0 1 0 527125740 470310912 1295 33554432000 134512640 134534564 4293431648 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/27288/statm: 114822 1295 95 6 0 113488 0
[pid=27289] ppid=27285 vsize=697528 CPUtime=5000.15 cores=3
/proc/27289/stat : 27289 (march_hi) R 27285 27285 26830 0 -1 4202496 141213 0 0 0 499915 100 0 0 25 0 1 0 527125740 714268672 137157 33554432000 4194304 4331988 140736556005200 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/27289/statm: 174382 137157 175 34 0 172824 0
[pid=27290] ppid=27285 vsize=219480 CPUtime=19973 cores=4-7
/proc/27290/stat : 27290 (plingeling) S 27285 27285 26830 0 -1 4202496 422614 1252 0 0 1997244 58 0 0 18 0 5 0 527125740 224747520 26943 33554432000 4194304 4356188 140733315793344 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/27290/statm: 54870 26943 161 40 0 53414 0
[pid=27290/tid=27297] ppid=27285 vsize=219480 CPUtime=4972.82 cores=4-7
/proc/27290/task/27297/stat : 27297 (plingeling) R 27285 27285 26830 0 -1 4202560 111128 1252 0 0 497267 15 0 0 25 0 5 0 527125745 224747520 26943 33554432000 4194304 4356188 140733315793344 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27290/tid=27298] ppid=27285 vsize=219480 CPUtime=4999.94 cores=4-7
/proc/27290/task/27298/stat : 27298 (plingeling) R 27285 27285 26830 0 -1 4202560 94897 1252 0 0 499981 13 0 0 25 0 5 0 527125745 224747520 26943 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27290/tid=27299] ppid=27285 vsize=219480 CPUtime=5000.08 cores=4-7
/proc/27290/task/27299/stat : 27299 (plingeling) R 27285 27285 26830 0 -1 4202560 96157 1252 0 0 499996 12 0 0 25 0 5 0 527125745 224747520 26943 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331106 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27290/tid=27300] ppid=27285 vsize=219480 CPUtime=5000.09 cores=4-7
/proc/27290/task/27300/stat : 27300 (plingeling) R 27285 27285 26830 0 -1 4202560 116842 1252 0 0 499994 15 0 0 25 0 5 0 527125745 224747520 26943 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39972.3
Current children cumulated vsize (KiB) 3117120

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5000 s]
/proc/loadavg: 8.13 8.07 8.01 9/180 27445
/proc/meminfo: memFree=28973712/32951124 swapFree=67111364/67111528
[pid=27285] ppid=27283 vsize=18324 CPUtime=0 cores=0-7
/proc/27285/stat : 27285 (ppfolio) S 27283 27285 26830 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 527125739 18763776 389 33554432000 4194304 4287625 140736989840416 18446744073709551615 253640879631 0 0 4096 65536 4528369979371814911 0 0 17 4 0 0 0
/proc/27285/statm: 4581 389 341 23 0 91 0
[pid=27286] ppid=27285 vsize=1552960 CPUtime=5000.13 cores=0
/proc/27286/stat : 27286 (cryptominisat) R 27285 27285 26830 0 -1 4202496 994989 0 0 0 499629 384 0 0 25 0 1 0 527125740 1590231040 83560 33554432000 4194304 4587354 140733546595328 18446744073709551615 4388336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/27286/statm: 388240 83560 337 96 0 384802 0
[pid=27287] ppid=27285 vsize=169540 CPUtime=5000.15 cores=1
/proc/27287/stat : 27287 (clasp) R 27285 27285 26830 0 -1 4202496 37598 0 0 0 500006 9 0 0 25 0 1 0 527125740 173608960 36041 33554432000 4194304 4785740 140735120148320 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/27287/statm: 42385 36041 341 145 0 39430 0
[pid=27288] ppid=27285 vsize=459288 CPUtime=4998.84 cores=2
/proc/27288/stat : 27288 (TNM) R 27285 27285 26830 0 -1 4202496 1399 0 0 0 499882 2 0 0 25 0 1 0 527125740 470310912 1295 33554432000 134512640 134534564 4293431648 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/27288/statm: 114822 1295 95 6 0 113488 0
[pid=27289] ppid=27285 vsize=697528 CPUtime=5000.15 cores=3
/proc/27289/stat : 27289 (march_hi) R 27285 27285 26830 0 -1 4202496 141213 0 0 0 499915 100 0 0 25 0 1 0 527125740 714268672 137157 33554432000 4194304 4331988 140736556005200 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/27289/statm: 174382 137157 175 34 0 172824 0
[pid=27290] ppid=27285 vsize=219480 CPUtime=19973 cores=4-7
/proc/27290/stat : 27290 (plingeling) S 27285 27285 26830 0 -1 4202496 422614 1252 0 0 1997244 58 0 0 18 0 5 0 527125740 224747520 26943 33554432000 4194304 4356188 140733315793344 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/27290/statm: 54870 26943 161 40 0 53414 0
[pid=27290/tid=27297] ppid=27285 vsize=219480 CPUtime=4972.82 cores=4-7
/proc/27290/task/27297/stat : 27297 (plingeling) R 27285 27285 26830 0 -1 4202560 111128 1252 0 0 497267 15 0 0 25 0 5 0 527125745 224747520 26943 33554432000 4194304 4356188 140733315793344 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27290/tid=27298] ppid=27285 vsize=219480 CPUtime=4999.94 cores=4-7
/proc/27290/task/27298/stat : 27298 (plingeling) R 27285 27285 26830 0 -1 4202560 94897 1252 0 0 499981 13 0 0 25 0 5 0 527125745 224747520 26943 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=27290/tid=27299] ppid=27285 vsize=219480 CPUtime=5000.08 cores=4-7
/proc/27290/task/27299/stat : 27299 (plingeling) R 27285 27285 26830 0 -1 4202560 96157 1252 0 0 499996 12 0 0 25 0 5 0 527125745 224747520 26943 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331106 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27290/tid=27300] ppid=27285 vsize=219480 CPUtime=5000.09 cores=4-7
/proc/27290/task/27300/stat : 27300 (plingeling) R 27285 27285 26830 0 -1 4202560 116842 1252 0 0 499994 15 0 0 25 0 5 0 527125745 224747520 26943 33554432000 4194304 4356188 140733315793344 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39972.3
Current children cumulated vsize (KiB) 3117120

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 27285 and gives
#  childrusage.ru_utime.tv_sec=9998
#  childrusage.ru_utime.tv_usec=886938
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=134979
# CPU time returned by wait4() is 9999.02
# while last known CPU time is 39972.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5000.02
CPU time (s): 39972.3
CPU user time (s): 39966.8
CPU system time (s): 5.53
CPU usage (%): 799.443
Max. virtual memory (cumulated for all children) (KiB): 4077740

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 9998.89
system time used= 0.134979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 39533
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 641
involuntary context switches= 81121

runsolver used 8.02778 second user time and 19.2511 second system time

The end

Launcher Data 

Begin job on node106 at 2011-04-30 11:20:53
IDJOB=3219969
IDBENCH=82678
IDSOLVER=1638
FILE ID=node106/3219969-1304155253
RUNJOBID= node106-1304145244-26844
PBS_JOBID= 13170873
Free space on /tmp= 72888 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S1859210562-077-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3219969-1304155253/watcher-3219969-1304155253 -o /tmp/evaluation-result-3219969-1304155253/solver-3219969-1304155253 -C 40000 -W 5000 -M 31000  ppfolio HOME/instance-3219969-1304155253.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3d96bca49fe954bb59442ef617e689bb
RANDOM SEED=1514601738

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30109464 kB
Buffers:        281372 kB
Cached:        2279308 kB
SwapCached:         88 kB
Active:         894828 kB
Inactive:      1729488 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30109464 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           10876 kB
Writeback:           0 kB
AnonPages:       63568 kB
Mapped:          14308 kB
Slab:           148340 kB
PageTables:       5452 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187920 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72876 MiB
End job on node106 at 2011-04-30 12:44:16