Trace number 3275246

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.5 5003.52

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n150-s89334302-unsat.cnf
MD5SUMe0b064ae815c6a8bb8a9898180562bec
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables153
Number of clauses316
Sum of the clauses size948
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3316
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275246-1304166019/watcher-3275246-1304166019 -o /tmp/evaluation-result-3275246-1304166019/solver-3275246-1304166019 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275246-1304166019.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.19 8.13 8.10 1/174 17892
/proc/meminfo: memFree=29975724/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 4 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0

[startup+0.093096 s]
/proc/loadavg: 8.19 8.13 8.10 1/174 17892
/proc/meminfo: memFree=29975724/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) R 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.101094 s]
/proc/loadavg: 8.19 8.13 8.10 1/174 17892
/proc/meminfo: memFree=29975724/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) R 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.301058 s]
/proc/loadavg: 8.19 8.13 8.10 1/174 17892
/proc/meminfo: memFree=29975724/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 24 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 4 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700984 s]
/proc/loadavg: 8.19 8.13 8.10 1/174 17892
/proc/meminfo: memFree=29975724/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 20 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 4 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50084 s]
/proc/loadavg: 8.19 8.13 8.10 9/184 17907
/proc/meminfo: memFree=29954704/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 4 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
[pid=17893] ppid=17892 vsize=6696780 CPUtime=1.48 cores=0
/proc/17893/stat : 17893 (cryptominisat) R 17892 17892 17494 0 -1 4202496 3813 0 0 0 148 0 0 0 25 0 1 0 528200110 6857502720 2064 33554432000 4194304 4587354 140735314713584 18446744073709551615 4238481 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17893/statm: 1674195 2064 337 96 0 1670757 0
[pid=17894] ppid=17892 vsize=12692 CPUtime=1.49 cores=1
/proc/17894/stat : 17894 (clasp) R 17892 17892 17494 0 -1 4202496 646 0 0 0 149 0 0 0 20 0 1 0 528200110 12996608 537 33554432000 4194304 4785740 140735714693488 18446744073709551615 4287088 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17894/statm: 3173 537 341 145 0 218 0
[pid=17895] ppid=17892 vsize=455696 CPUtime=1.49 cores=2
/proc/17895/stat : 17895 (TNM) R 17892 17892 17494 0 -1 4202496 272 0 0 0 149 0 0 0 20 0 1 0 528200110 466632704 169 33554432000 134512640 134534564 4291439200 18446744073709551615 134529870 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17895/statm: 113924 169 95 6 0 112590 0
[pid=17896] ppid=17892 vsize=8412 CPUtime=1.49 cores=3
/proc/17896/stat : 17896 (march_hi) R 17892 17892 17494 0 -1 4202496 668 0 0 0 149 0 0 0 20 0 1 0 528200110 8613888 561 33554432000 4194304 4331988 140737339267520 18446744073709551615 4315647 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17896/statm: 2103 561 173 34 0 545 0
[pid=17897] ppid=17892 vsize=128176 CPUtime=5.95 cores=4-7
/proc/17897/stat : 17897 (plingeling) S 17892 17892 17494 0 -1 4202496 5153 1259 0 0 594 1 0 0 25 0 5 0 528200110 131252224 4162 33554432000 4194304 4356188 140733253161552 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17897/statm: 32044 4162 163 40 0 30588 0
[pid=17897/tid=17904] ppid=17892 vsize=128176 CPUtime=1.49 cores=4-7
/proc/17897/task/17904/stat : 17904 (plingeling) R 17892 17892 17494 0 -1 4202560 1192 1259 0 0 149 0 0 0 20 0 5 0 528200110 131252224 4162 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17897/tid=17905] ppid=17892 vsize=128176 CPUtime=1.48 cores=4-7
/proc/17897/task/17905/stat : 17905 (plingeling) R 17892 17892 17494 0 -1 4202560 977 1259 0 0 148 0 0 0 25 0 5 0 528200110 131252224 4162 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331371 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17897/tid=17906] ppid=17892 vsize=128176 CPUtime=1.48 cores=4-7
/proc/17897/task/17906/stat : 17906 (plingeling) R 17892 17892 17494 0 -1 4202560 1424 1259 0 0 148 0 0 0 25 0 5 0 528200110 131252224 4162 33554432000 4194304 4356188 140733253161552 18446744073709551615 4330992 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17897/tid=17907] ppid=17892 vsize=128176 CPUtime=1.48 cores=4-7
/proc/17897/task/17907/stat : 17907 (plingeling) R 17892 17892 17494 0 -1 4202560 1230 1259 0 0 148 0 0 0 25 0 5 0 528200110 131252224 4162 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331050 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.9
Current children cumulated vsize (KiB) 7320080

[startup+3.10055 s]
/proc/loadavg: 8.19 8.13 8.10 9/184 17907
/proc/meminfo: memFree=29945280/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 4 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
[pid=17893] ppid=17892 vsize=1526760 CPUtime=3.09 cores=0
/proc/17893/stat : 17893 (cryptominisat) R 17892 17892 17494 0 -1 4202496 5746 0 0 0 308 1 0 0 25 0 1 0 528200110 1563402240 3056 33554432000 4194304 4587354 140735314713584 18446744073709551615 4244114 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17893/statm: 381690 3056 337 96 0 378252 0
[pid=17894] ppid=17892 vsize=12960 CPUtime=3.09 cores=1
/proc/17894/stat : 17894 (clasp) R 17892 17892 17494 0 -1 4202496 693 0 0 0 309 0 0 0 25 0 1 0 528200110 13271040 584 33554432000 4194304 4785740 140735714693488 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17894/statm: 3240 584 341 145 0 285 0
[pid=17895] ppid=17892 vsize=455696 CPUtime=3.09 cores=2
/proc/17895/stat : 17895 (TNM) R 17892 17892 17494 0 -1 4202496 272 0 0 0 309 0 0 0 25 0 1 0 528200110 466632704 169 33554432000 134512640 134534564 4291439200 18446744073709551615 3550209 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17895/statm: 113924 169 95 6 0 112590 0
[pid=17896] ppid=17892 vsize=9360 CPUtime=3.09 cores=3
/proc/17896/stat : 17896 (march_hi) R 17892 17892 17494 0 -1 4202496 979 0 0 0 309 0 0 0 25 0 1 0 528200110 9584640 872 33554432000 4194304 4331988 140737339267520 18446744073709551615 4246719 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17896/statm: 2340 872 173 34 0 782 0
[pid=17897] ppid=17892 vsize=128696 CPUtime=12.34 cores=4-7
/proc/17897/stat : 17897 (plingeling) S 17892 17892 17494 0 -1 4202496 6659 1259 0 0 1233 1 0 0 25 0 5 0 528200110 131784704 4292 33554432000 4194304 4356188 140733253161552 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17897/statm: 32174 4292 163 40 0 30718 0
[pid=17897/tid=17904] ppid=17892 vsize=128696 CPUtime=3.08 cores=4-7
/proc/17897/task/17904/stat : 17904 (plingeling) R 17892 17892 17494 0 -1 4202560 1640 1259 0 0 308 0 0 0 25 0 5 0 528200110 131784704 4292 33554432000 4194304 4356188 140733253161552 18446744073709551615 4234251 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17897/tid=17905] ppid=17892 vsize=128696 CPUtime=3.07 cores=4-7
/proc/17897/task/17905/stat : 17905 (plingeling) R 17892 17892 17494 0 -1 4202560 1394 1259 0 0 307 0 0 0 25 0 5 0 528200110 131784704 4292 33554432000 4194304 4356188 140733253161552 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17897/tid=17906] ppid=17892 vsize=128696 CPUtime=3.08 cores=4-7
/proc/17897/task/17906/stat : 17906 (plingeling) R 17892 17892 17494 0 -1 4202560 1681 1259 0 0 308 0 0 0 25 0 5 0 528200110 131784704 4292 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17897/tid=17907] ppid=17892 vsize=128696 CPUtime=3.08 cores=4-7
/proc/17897/task/17907/stat : 17907 (plingeling) R 17892 17892 17494 0 -1 4202560 1614 1259 0 0 308 0 0 0 25 0 5 0 528200110 131784704 4292 33554432000 4194304 4356188 140733253161552 18446744073709551615 4330827 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.7
Current children cumulated vsize (KiB) 2151796

[startup+6.30096 s]
/proc/loadavg: 8.17 8.13 8.10 10/184 17907
/proc/meminfo: memFree=29936564/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 4 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
[pid=17893] ppid=17892 vsize=1527268 CPUtime=6.29 cores=0
/proc/17893/stat : 17893 (cryptominisat) R 17892 17892 17494 0 -1 4202496 8858 0 0 0 628 1 0 0 25 0 1 0 528200110 1563922432 3047 33554432000 4194304 4587354 140735314713584 18446744073709551615 4238423 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17893/statm: 381817 3047 337 96 0 378379 0
[pid=17894] ppid=17892 vsize=13224 CPUtime=6.29 cores=1
/proc/17894/stat : 17894 (clasp) R 17892 17892 17494 0 -1 4202496 765 0 0 0 629 0 0 0 25 0 1 0 528200110 13541376 656 33554432000 4194304 4785740 140735714693488 18446744073709551615 4278129 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17894/statm: 3306 656 341 145 0 351 0
[pid=17895] ppid=17892 vsize=455696 CPUtime=6.29 cores=2
/proc/17895/stat : 17895 (TNM) R 17892 17892 17494 0 -1 4202496 272 0 0 0 629 0 0 0 25 0 1 0 528200110 466632704 169 33554432000 134512640 134534564 4291439200 18446744073709551615 134530820 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17895/statm: 113924 169 95 6 0 112590 0
[pid=17896] ppid=17892 vsize=12416 CPUtime=6.29 cores=3
/proc/17896/stat : 17896 (march_hi) R 17892 17892 17494 0 -1 4202496 1551 0 0 0 629 0 0 0 25 0 1 0 528200110 12713984 1444 33554432000 4194304 4331988 140737339267520 18446744073709551615 4316336 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17896/statm: 3104 1444 173 34 0 1546 0
[pid=17897] ppid=17892 vsize=138440 CPUtime=25.12 cores=4-7
/proc/17897/stat : 17897 (plingeling) S 17892 17892 17494 0 -1 4202496 11751 1259 0 0 2510 2 0 0 25 0 5 0 528200110 141762560 6728 33554432000 4194304 4356188 140733253161552 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17897/statm: 34610 6728 163 40 0 33154 0
[pid=17897/tid=17904] ppid=17892 vsize=138440 CPUtime=6.28 cores=4-7
/proc/17897/task/17904/stat : 17904 (plingeling) R 17892 17892 17494 0 -1 4202560 3305 1259 0 0 628 0 0 0 25 0 5 0 528200110 141762560 6728 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331355 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17897/tid=17905] ppid=17892 vsize=138440 CPUtime=6.25 cores=4-7
/proc/17897/task/17905/stat : 17905 (plingeling) R 17892 17892 17494 0 -1 4202560 2772 1259 0 0 625 0 0 0 25 0 5 0 528200110 141762560 6728 33554432000 4194304 4356188 140733253161552 18446744073709551615 4279650 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17897/tid=17906] ppid=17892 vsize=138440 CPUtime=6.28 cores=4-7
/proc/17897/task/17906/stat : 17906 (plingeling) R 17892 17892 17494 0 -1 4202560 3025 1259 0 0 628 0 0 0 25 0 5 0 528200110 141762560 6728 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17897/tid=17907] ppid=17892 vsize=138440 CPUtime=6.28 cores=4-7
/proc/17897/task/17907/stat : 17907 (plingeling) R 17892 17892 17494 0 -1 4202560 2319 1259 0 0 628 0 0 0 25 0 5 0 528200110 141762560 6728 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331352 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.28
Current children cumulated vsize (KiB) 2165368

[startup+12.7008 s]
/proc/loadavg: 8.16 8.13 8.09 9/184 17907
/proc/meminfo: memFree=29915548/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 4 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
[pid=17893] ppid=17892 vsize=6707524 CPUtime=12.69 cores=0
/proc/17893/stat : 17893 (cryptominisat) R 17892 17892 17494 0 -1 4202496 14884 0 0 0 1267 2 0 0 25 0 1 0 528200110 6868504576 4894 33554432000 4194304 4587354 140735314713584 18446744073709551615 4236532 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17893/statm: 1676881 4894 337 96 0 1673443 0
[pid=17894] ppid=17892 vsize=13492 CPUtime=12.69 cores=1
/proc/17894/stat : 17894 (clasp) R 17892 17892 17494 0 -1 4202496 844 0 0 0 1269 0 0 0 25 0 1 0 528200110 13815808 735 33554432000 4194304 4785740 140735714693488 18446744073709551615 4553423 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17894/statm: 3373 735 341 145 0 418 0
[pid=17895] ppid=17892 vsize=455696 CPUtime=12.69 cores=2
/proc/17895/stat : 17895 (TNM) R 17892 17892 17494 0 -1 4202496 272 0 0 0 1269 0 0 0 25 0 1 0 528200110 466632704 169 33554432000 134512640 134534564 4291439200 18446744073709551615 3550209 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17895/statm: 113924 169 95 6 0 112590 0
[pid=17896] ppid=17892 vsize=19244 CPUtime=12.69 cores=3
/proc/17896/stat : 17896 (march_hi) R 17892 17892 17494 0 -1 4202496 2686 0 0 0 1269 0 0 0 25 0 1 0 528200110 19705856 2579 33554432000 4194304 4331988 140737339267520 18446744073709551615 4211568 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17896/statm: 4811 2579 173 34 0 3253 0
[pid=17897] ppid=17892 vsize=143776 CPUtime=50.69 cores=4-7
/proc/17897/stat : 17897 (plingeling) S 17892 17892 17494 0 -1 4202496 18938 1259 0 0 5066 3 0 0 25 0 5 0 528200110 147226624 8075 33554432000 4194304 4356188 140733253161552 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17897/statm: 35944 8075 163 40 0 34488 0
[pid=17897/tid=17904] ppid=17892 vsize=143776 CPUtime=12.68 cores=4-7
/proc/17897/task/17904/stat : 17904 (plingeling) R 17892 17892 17494 0 -1 4202560 5002 1259 0 0 1268 0 0 0 25 0 5 0 528200110 147226624 8075 33554432000 4194304 4356188 140733253161552 18446744073709551615 4298332 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17897/tid=17905] ppid=17892 vsize=143776 CPUtime=12.62 cores=4-7
/proc/17897/task/17905/stat : 17905 (plingeling) R 17892 17892 17494 0 -1 4202560 4483 1259 0 0 1262 0 0 0 25 0 5 0 528200110 147226624 8075 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331392 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17897/tid=17906] ppid=17892 vsize=143776 CPUtime=12.69 cores=4-7
/proc/17897/task/17906/stat : 17906 (plingeling) R 17892 17892 17494 0 -1 4202560 4563 1259 0 0 1268 1 0 0 25 0 5 0 528200110 147226624 8075 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331697 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17897/tid=17907] ppid=17892 vsize=143776 CPUtime=12.67 cores=4-7
/proc/17897/task/17907/stat : 17907 (plingeling) R 17892 17892 17494 0 -1 4202560 4560 1259 0 0 1267 0 0 0 25 0 5 0 528200110 147226624 8075 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.45
Current children cumulated vsize (KiB) 7358056

[startup+25.5004 s]
/proc/loadavg: 8.12 8.12 8.09 9/184 17908
/proc/meminfo: memFree=29885624/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 4 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
[pid=17893] ppid=17892 vsize=1552108 CPUtime=25.49 cores=0
/proc/17893/stat : 17893 (cryptominisat) R 17892 17892 17494 0 -1 4202496 23277 0 0 0 2546 3 0 0 25 0 1 0 528200110 1589358592 8050 33554432000 4194304 4587354 140735314713584 18446744073709551615 4232088 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=17895] ppid=17892 vsize=455700 CPUtime=4842.16 cores=2
/proc/17895/stat : 17895 (TNM) R 17892 17892 17494 0 -1 4202496 281 0 0 0 484215 1 0 0 25 0 1 0 528200110 466636800 178 33554432000 134512640 134534564 4291439200 18446744073709551615 134529748 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17895/statm: 113925 178 103 6 0 112591 0
[pid=17896] ppid=17892 vsize=3775876 CPUtime=4842.43 cores=3
/proc/17896/stat : 17896 (march_hi) R 17892 17892 17494 0 -1 4202496 823217 0 0 0 483977 266 0 0 25 0 1 0 528200110 3866497024 823110 33554432000 4194304 4331988 140737339267520 18446744073709551615 4237154 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17896/statm: 943969 823110 173 34 0 942411 0
[pid=17897] ppid=17892 vsize=376428 CPUtime=19342.2 cores=4-7
/proc/17897/stat : 17897 (plingeling) S 17892 17892 17494 0 -1 4202496 1408904 1259 0 0 1934023 199 0 0 25 0 5 0 528200110 385462272 66228 33554432000 4194304 4356188 140733253161552 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17897/statm: 94107 66228 163 40 0 92651 0
[pid=17897/tid=17904] ppid=17892 vsize=376428 CPUtime=4842.43 cores=4-7
/proc/17897/task/17904/stat : 17904 (plingeling) R 17892 17892 17494 0 -1 4202560 378189 1259 0 0 484196 47 0 0 25 0 5 0 528200110 385462272 66228 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17897/tid=17905] ppid=17892 vsize=376428 CPUtime=4816 cores=4-7
/proc/17897/task/17905/stat : 17905 (plingeling) R 17892 17892 17494 0 -1 4202560 324102 1259 0 0 481560 40 0 0 25 0 5 0 528200110 385462272 66228 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331023 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17897/tid=17906] ppid=17892 vsize=376428 CPUtime=4842.41 cores=4-7
/proc/17897/task/17906/stat : 17906 (plingeling) R 17892 17892 17494 0 -1 4202560 346966 1259 0 0 484188 53 0 0 25 0 5 0 528200110 385462272 66228 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17897/tid=17907] ppid=17892 vsize=376428 CPUtime=4841.34 cores=4-7
/proc/17897/task/17907/stat : 17907 (plingeling) R 17892 17892 17494 0 -1 4202560 359317 1259 0 0 484077 57 0 0 25 0 5 0 528200110 385462272 66228 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331960 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38711.7
Current children cumulated vsize (KiB) 6324072

[startup+4902.3 s]
/proc/loadavg: 8.16 8.13 8.09 9/184 18050
/proc/meminfo: memFree=26188972/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 3 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
[pid=17893] ppid=17892 vsize=1681240 CPUtime=4902.42 cores=0
/proc/17893/stat : 17893 (cryptominisat) R 17892 17892 17494 0 -1 4202496 577829 0 0 0 490049 193 0 0 25 0 1 0 528200110 1721589760 46390 33554432000 4194304 4587354 140735314713584 18446744073709551615 4231884 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17893/statm: 420310 46390 337 96 0 416872 0
[pid=17894] ppid=17892 vsize=16032 CPUtime=4902.44 cores=1
/proc/17894/stat : 17894 (clasp) R 17892 17892 17494 0 -1 4202496 1470 0 0 0 490244 0 0 0 25 0 1 0 528200110 16416768 1361 33554432000 4194304 4785740 140735714693488 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17894/statm: 4008 1361 345 145 0 1053 0
[pid=17895] ppid=17892 vsize=455700 CPUtime=4902.16 cores=2
/proc/17895/stat : 17895 (TNM) R 17892 17892 17494 0 -1 4202496 281 0 0 0 490215 1 0 0 25 0 1 0 528200110 466636800 178 33554432000 134512640 134534564 4291439200 18446744073709551615 134530227 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17895/statm: 113925 178 103 6 0 112591 0
[pid=17896] ppid=17892 vsize=3775876 CPUtime=4902.43 cores=3
/proc/17896/stat : 17896 (march_hi) R 17892 17892 17494 0 -1 4202496 833444 0 0 0 489973 270 0 0 25 0 1 0 528200110 3866497024 833337 33554432000 4194304 4331988 140737339267520 18446744073709551615 4211568 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17896/statm: 943969 833337 173 34 0 942411 0
[pid=17897] ppid=17892 vsize=370796 CPUtime=19581.9 cores=4-7
/proc/17897/stat : 17897 (plingeling) S 17892 17892 17494 0 -1 4202496 1417000 1259 0 0 1957989 200 0 0 25 0 5 0 528200110 379695104 64820 33554432000 4194304 4356188 140733253161552 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17897/statm: 92699 64820 163 40 0 91243 0
[pid=17897/tid=17904] ppid=17892 vsize=370796 CPUtime=4902.43 cores=4-7
/proc/17897/task/17904/stat : 17904 (plingeling) R 17892 17892 17494 0 -1 4202560 380109 1259 0 0 490196 47 0 0 25 0 5 0 528200110 379695104 64820 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17897/tid=17905] ppid=17892 vsize=370796 CPUtime=4875.67 cores=4-7
/proc/17897/task/17905/stat : 17905 (plingeling) R 17892 17892 17494 0 -1 4202560 327750 1259 0 0 487527 40 0 0 25 0 5 0 528200110 379695104 64820 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331072 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17897/tid=17906] ppid=17892 vsize=370796 CPUtime=4902.42 cores=4-7
/proc/17897/task/17906/stat : 17906 (plingeling) R 17892 17892 17494 0 -1 4202560 348694 1259 0 0 490188 54 0 0 25 0 5 0 528200110 379695104 64820 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331345 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17897/tid=17907] ppid=17892 vsize=370796 CPUtime=4901.33 cores=4-7
/proc/17897/task/17907/stat : 17907 (plingeling) R 17892 17892 17494 0 -1 4202560 360117 1259 0 0 490076 57 0 0 25 0 5 0 528200110 379695104 64820 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331170 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39191.3
Current children cumulated vsize (KiB) 6317968

[startup+4962.3 s]
/proc/loadavg: 8.09 8.12 8.09 9/184 18051
/proc/meminfo: memFree=26154592/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 3 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
[pid=17893] ppid=17892 vsize=1681240 CPUtime=4962.43 cores=0
/proc/17893/stat : 17893 (cryptominisat) R 17892 17892 17494 0 -1 4202496 580597 0 0 0 496047 196 0 0 25 0 1 0 528200110 1721589760 46452 33554432000 4194304 4587354 140735314713584 18446744073709551615 4232230 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17893/statm: 420310 46452 337 96 0 416872 0
[pid=17894] ppid=17892 vsize=16032 CPUtime=4962.44 cores=1
/proc/17894/stat : 17894 (clasp) R 17892 17892 17494 0 -1 4202496 1470 0 0 0 496244 0 0 0 25 0 1 0 528200110 16416768 1361 33554432000 4194304 4785740 140735714693488 18446744073709551615 4552983 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17894/statm: 4008 1361 345 145 0 1053 0
[pid=17895] ppid=17892 vsize=455700 CPUtime=4962.16 cores=2
/proc/17895/stat : 17895 (TNM) R 17892 17892 17494 0 -1 4202496 281 0 0 0 496215 1 0 0 25 0 1 0 528200110 466636800 178 33554432000 134512640 134534564 4291439200 18446744073709551615 134530126 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17895/statm: 113925 178 103 6 0 112591 0
[pid=17896] ppid=17892 vsize=3775876 CPUtime=4962.44 cores=3
/proc/17896/stat : 17896 (march_hi) R 17892 17892 17494 0 -1 4202496 843627 0 0 0 495970 274 0 0 25 0 1 0 528200110 3866497024 843520 33554432000 4194304 4331988 140737339267520 18446744073709551615 4288674 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17896/statm: 943969 843520 173 34 0 942411 0
[pid=17897] ppid=17892 vsize=362988 CPUtime=19821.6 cores=4-7
/proc/17897/stat : 17897 (plingeling) S 17892 17892 17494 0 -1 4202496 1435976 1259 0 0 1981954 203 0 0 25 0 5 0 528200110 371699712 62868 33554432000 4194304 4356188 140733253161552 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17897/statm: 90747 62868 163 40 0 89291 0
[pid=17897/tid=17904] ppid=17892 vsize=362988 CPUtime=4962.43 cores=4-7
/proc/17897/task/17904/stat : 17904 (plingeling) R 17892 17892 17494 0 -1 4202560 387725 1259 0 0 496195 48 0 0 25 0 5 0 528200110 371699712 62868 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17897/tid=17905] ppid=17892 vsize=362988 CPUtime=4935.34 cores=4-7
/proc/17897/task/17905/stat : 17905 (plingeling) R 17892 17892 17494 0 -1 4202560 329190 1259 0 0 493494 40 0 0 25 0 5 0 528200110 371699712 62868 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17897/tid=17906] ppid=17892 vsize=362988 CPUtime=4962.42 cores=4-7
/proc/17897/task/17906/stat : 17906 (plingeling) R 17892 17892 17494 0 -1 4202560 351318 1259 0 0 496188 54 0 0 25 0 5 0 528200110 371699712 62868 33554432000 4194304 4356188 140733253161552 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17897/tid=17907] ppid=17892 vsize=362988 CPUtime=4961.33 cores=4-7
/proc/17897/task/17907/stat : 17907 (plingeling) R 17892 17892 17494 0 -1 4202560 367413 1259 0 0 496075 58 0 0 25 0 5 0 528200110 371699712 62868 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331045 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39671
Current children cumulated vsize (KiB) 6310160



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.5 s]
/proc/loadavg: 8.09 8.11 8.09 9/184 18052
/proc/meminfo: memFree=26124324/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 3 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
[pid=17893] ppid=17892 vsize=1742060 CPUtime=5003.64 cores=0
/proc/17893/stat : 17893 (cryptominisat) R 17892 17892 17494 0 -1 4202496 581788 0 0 0 500167 197 0 0 25 0 1 0 528200110 1783869440 44918 33554432000 4194304 4587354 140735314713584 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17893/statm: 435515 44918 337 96 0 432077 0
[pid=17894] ppid=17892 vsize=16032 CPUtime=5003.65 cores=1
/proc/17894/stat : 17894 (clasp) R 17892 17892 17494 0 -1 4202496 1470 0 0 0 500365 0 0 0 25 0 1 0 528200110 16416768 1361 33554432000 4194304 4785740 140735714693488 18446744073709551615 4553411 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17894/statm: 4008 1361 345 145 0 1053 0
[pid=17895] ppid=17892 vsize=455700 CPUtime=5003.37 cores=2
/proc/17895/stat : 17895 (TNM) R 17892 17892 17494 0 -1 4202496 281 0 0 0 500336 1 0 0 25 0 1 0 528200110 466636800 178 33554432000 134512640 134534564 4291439200 18446744073709551615 134528404 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17895/statm: 113925 178 103 6 0 112591 0
[pid=17896] ppid=17892 vsize=3775876 CPUtime=5003.64 cores=3
/proc/17896/stat : 17896 (march_hi) R 17892 17892 17494 0 -1 4202496 850649 0 0 0 500088 276 0 0 25 0 1 0 528200110 3866497024 850542 33554432000 4194304 4331988 140737339267520 18446744073709551615 4301182 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17896/statm: 943969 850542 173 34 0 942411 0
[pid=17897] ppid=17892 vsize=372588 CPUtime=19986.2 cores=4-7
/proc/17897/stat : 17897 (plingeling) S 17892 17892 17494 0 -1 4202496 1445992 1259 0 0 1998412 204 0 0 25 0 5 0 528200110 381530112 65268 33554432000 4194304 4356188 140733253161552 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17897/statm: 93147 65268 163 40 0 91691 0
[pid=17897/tid=17904] ppid=17892 vsize=372588 CPUtime=5003.64 cores=4-7
/proc/17897/task/17904/stat : 17904 (plingeling) R 17892 17892 17494 0 -1 4202560 390957 1259 0 0 500315 49 0 0 25 0 5 0 528200110 381530112 65268 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17897/tid=17905] ppid=17892 vsize=372588 CPUtime=4976.33 cores=4-7
/proc/17897/task/17905/stat : 17905 (plingeling) R 17892 17892 17494 0 -1 4202560 331366 1259 0 0 497592 41 0 0 25 0 5 0 528200110 381530112 65268 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17897/tid=17906] ppid=17892 vsize=372588 CPUtime=5003.63 cores=4-7
/proc/17897/task/17906/stat : 17906 (plingeling) R 17892 17892 17494 0 -1 4202560 353238 1259 0 0 500308 55 0 0 25 0 5 0 528200110 381530112 65268 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17897/tid=17907] ppid=17892 vsize=372588 CPUtime=5002.53 cores=4-7
/proc/17897/task/17907/stat : 17907 (plingeling) R 17892 17892 17494 0 -1 4202560 370101 1259 0 0 500195 58 0 0 25 0 5 0 528200110 381530112 65268 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 6380580

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5003.5 s]
/proc/loadavg: 8.09 8.11 8.09 9/184 18052
/proc/meminfo: memFree=26124324/32951124 swapFree=67102748/67111528
[pid=17892] ppid=17890 vsize=18324 CPUtime=0 cores=0-7
/proc/17892/stat : 17892 (ppfolio) S 17890 17892 17494 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 528200109 18763776 390 33554432000 4194304 4287625 140736292710464 18446744073709551615 246516854287 0 0 4096 65536 6314987726382825471 0 0 17 3 0 0 0
/proc/17892/statm: 4581 390 341 23 0 91 0
[pid=17893] ppid=17892 vsize=1742060 CPUtime=5003.64 cores=0
/proc/17893/stat : 17893 (cryptominisat) R 17892 17892 17494 0 -1 4202496 581788 0 0 0 500167 197 0 0 25 0 1 0 528200110 1783869440 44918 33554432000 4194304 4587354 140735314713584 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/17893/statm: 435515 44918 337 96 0 432077 0
[pid=17894] ppid=17892 vsize=16032 CPUtime=5003.65 cores=1
/proc/17894/stat : 17894 (clasp) R 17892 17892 17494 0 -1 4202496 1470 0 0 0 500365 0 0 0 25 0 1 0 528200110 16416768 1361 33554432000 4194304 4785740 140735714693488 18446744073709551615 4553411 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/17894/statm: 4008 1361 345 145 0 1053 0
[pid=17895] ppid=17892 vsize=455700 CPUtime=5003.37 cores=2
/proc/17895/stat : 17895 (TNM) R 17892 17892 17494 0 -1 4202496 281 0 0 0 500336 1 0 0 25 0 1 0 528200110 466636800 178 33554432000 134512640 134534564 4291439200 18446744073709551615 134528404 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/17895/statm: 113925 178 103 6 0 112591 0
[pid=17896] ppid=17892 vsize=3775876 CPUtime=5003.64 cores=3
/proc/17896/stat : 17896 (march_hi) R 17892 17892 17494 0 -1 4202496 850649 0 0 0 500088 276 0 0 25 0 1 0 528200110 3866497024 850542 33554432000 4194304 4331988 140737339267520 18446744073709551615 4301182 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/17896/statm: 943969 850542 173 34 0 942411 0
[pid=17897] ppid=17892 vsize=372588 CPUtime=19986.2 cores=4-7
/proc/17897/stat : 17897 (plingeling) S 17892 17892 17494 0 -1 4202496 1445992 1259 0 0 1998412 204 0 0 25 0 5 0 528200110 381530112 65268 33554432000 4194304 4356188 140733253161552 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/17897/statm: 93147 65268 163 40 0 91691 0
[pid=17897/tid=17904] ppid=17892 vsize=372588 CPUtime=5003.64 cores=4-7
/proc/17897/task/17904/stat : 17904 (plingeling) R 17892 17892 17494 0 -1 4202560 390957 1259 0 0 500315 49 0 0 25 0 5 0 528200110 381530112 65268 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=17897/tid=17905] ppid=17892 vsize=372588 CPUtime=4976.33 cores=4-7
/proc/17897/task/17905/stat : 17905 (plingeling) R 17892 17892 17494 0 -1 4202560 331366 1259 0 0 497592 41 0 0 25 0 5 0 528200110 381530112 65268 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=17897/tid=17906] ppid=17892 vsize=372588 CPUtime=5003.63 cores=4-7
/proc/17897/task/17906/stat : 17906 (plingeling) R 17892 17892 17494 0 -1 4202560 353238 1259 0 0 500308 55 0 0 25 0 5 0 528200110 381530112 65268 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=17897/tid=17907] ppid=17892 vsize=372588 CPUtime=5002.53 cores=4-7
/proc/17897/task/17907/stat : 17907 (plingeling) R 17892 17892 17494 0 -1 4202560 370101 1259 0 0 500195 58 0 0 25 0 5 0 528200110 381530112 65268 33554432000 4194304 4356188 140733253161552 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 6380580

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 17892 and gives
#  childrusage.ru_utime.tv_sec=15008
#  childrusage.ru_utime.tv_usec=690332
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=11694
# CPU time returned by wait4() is 15010.7
# while last known CPU time is 40000.5
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.52
CPU time (s): 40000.5
CPU user time (s): 39993.7
CPU system time (s): 6.78
CPU usage (%): 799.447
Max. virtual memory (cumulated for all children) (KiB): 15996612

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 15008.7
system time used= 2.01169
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 584079
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 767
involuntary context switches= 34254

runsolver used 8.21975 second user time and 19.0781 second system time

The end

Launcher Data 

Begin job on node134 at 2011-04-30 14:20:19
IDJOB=3275246
IDBENCH=83143
IDSOLVER=1638
FILE ID=node134/3275246-1304166019
RUNJOBID= node134-1304160700-17508
PBS_JOBID= 13170924
Free space on /tmp= 72512 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n150-s89334302-unsat.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275246-1304166019/watcher-3275246-1304166019 -o /tmp/evaluation-result-3275246-1304166019/solver-3275246-1304166019 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275246-1304166019.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e0b064ae815c6a8bb8a9898180562bec
RANDOM SEED=472160283

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29975880 kB
Buffers:       1033536 kB
Cached:        1480248 kB
SwapCached:       4600 kB
Active:         212500 kB
Inactive:      2360832 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29975880 kB
SwapTotal:    67111528 kB
SwapFree:     67102748 kB
Dirty:           10300 kB
Writeback:           0 kB
AnonPages:       57588 kB
Mapped:          14900 kB
Slab:           335380 kB
PageTables:       4808 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   185576 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72500 MiB
End job on node134 at 2011-04-30 15:43:45