Trace number 3310172

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.1 5003.52

General information on the benchmark

NameAPPLICATIONS/crypto/
desgen/gss-27-s100.cnf
MD5SUMf47c33d2a9a327da4633207adfef7b77
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark3141.43
Satisfiable
(Un)Satisfiability was proved
Number of variables31951
Number of clauses96161
Sum of the clauses size226837
Maximum clause length3
Minimum clause length1
Number of clauses of size 164
Number of clauses of size 261518
Number of clauses of size 334579
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310172-1304002891/watcher-3310172-1304002891 -o /tmp/evaluation-result-3310172-1304002891/solver-3310172-1304002891 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310172-1304002891.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.43 7.92 7.96 1/170 12749
/proc/meminfo: memFree=16795880/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 6 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0

[startup+0.038245 s]
/proc/loadavg: 7.43 7.92 7.96 1/170 12749
/proc/meminfo: memFree=16795880/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 6 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100238 s]
/proc/loadavg: 7.43 7.92 7.96 1/170 12749
/proc/meminfo: memFree=16795880/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300168 s]
/proc/loadavg: 7.43 7.92 7.96 1/170 12749
/proc/meminfo: memFree=16795880/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 23 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.701094 s]
/proc/loadavg: 7.43 7.92 7.96 1/170 12749
/proc/meminfo: memFree=16795880/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 19 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50095 s]
/proc/loadavg: 7.43 7.92 7.96 9/180 12764
/proc/meminfo: memFree=16675644/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
[pid=12750] ppid=12749 vsize=55360 CPUtime=1.48 cores=0
/proc/12750/stat : 12750 (cryptominisat) R 12749 12749 12723 0 -1 4202496 10148 0 0 0 147 1 0 0 20 0 1 0 590519681 56688640 8434 33554432000 4194304 4587354 140733428552736 18446744073709551615 4243404 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12750/statm: 13840 8434 335 96 0 10402 0
[pid=12751] ppid=12749 vsize=28764 CPUtime=1.48 cores=1
/proc/12751/stat : 12751 (clasp) R 12749 12749 12723 0 -1 4202496 5882 0 0 0 148 0 0 0 25 0 1 0 590519681 29454336 4455 33554432000 4194304 4785740 140735983493040 18446744073709551615 4552896 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12751/statm: 7191 4455 340 145 0 4236 0
[pid=12752] ppid=12749 vsize=458596 CPUtime=1.49 cores=2
/proc/12752/stat : 12752 (TNM) R 12749 12749 12723 0 -1 4202496 3565 0 0 0 149 0 0 0 20 0 1 0 590519681 469602304 3462 33554432000 134512640 134534564 4286795008 18446744073709551615 134528275 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12752/statm: 114649 3462 95 6 0 113315 0
[pid=12753] ppid=12749 vsize=69416 CPUtime=1.48 cores=3
/proc/12753/stat : 12753 (march_hi) R 12749 12749 12723 0 -1 4202496 48273 0 0 0 142 6 0 0 20 0 1 0 590519681 71081984 8014 33554432000 4194304 4331988 140736685195584 18446744073709551615 4297280 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12753/statm: 17354 8014 183 34 0 15796 0
[pid=12754] ppid=12749 vsize=78096 CPUtime=5.62 cores=4-7
/proc/12754/stat : 12754 (plingeling) S 12749 12749 12723 0 -1 4202496 15312 1249 0 0 560 2 0 0 25 0 5 0 590519681 79970304 7967 33554432000 4194304 4356188 140735771792368 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12754/statm: 19524 7967 164 40 0 18068 0
[pid=12754/tid=12761] ppid=12749 vsize=78096 CPUtime=1.36 cores=4-7
/proc/12754/task/12761/stat : 12761 (plingeling) R 12749 12749 12723 0 -1 4202560 2650 1249 0 0 136 0 0 0 25 0 5 0 590519692 79970304 7967 33554432000 4194304 4356188 140735771792368 18446744073709551615 4233360 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12754/tid=12762] ppid=12749 vsize=78096 CPUtime=1.37 cores=4-7
/proc/12754/task/12762/stat : 12762 (plingeling) R 12749 12749 12723 0 -1 4202560 3451 1249 0 0 137 0 0 0 25 0 5 0 590519692 79970304 7967 33554432000 4194304 4356188 140735771792368 18446744073709551615 4231359 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12754/tid=12763] ppid=12749 vsize=78096 CPUtime=1.37 cores=4-7
/proc/12754/task/12763/stat : 12763 (plingeling) R 12749 12749 12723 0 -1 4202560 2819 1249 0 0 137 0 0 0 25 0 5 0 590519692 79970304 7967 33554432000 4194304 4356188 140735771792368 18446744073709551615 4292848 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12754/tid=12764] ppid=12749 vsize=78096 CPUtime=1.37 cores=4-7
/proc/12754/task/12764/stat : 12764 (plingeling) R 12749 12749 12723 0 -1 4202560 1959 1249 0 0 137 0 0 0 25 0 5 0 590519692 79970304 7967 33554432000 4194304 4356188 140735771792368 18446744073709551615 4330876 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.55
Current children cumulated vsize (KiB) 708556

[startup+3.10065 s]
/proc/loadavg: 7.56 7.94 7.97 9/180 12764
/proc/meminfo: memFree=16660516/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
[pid=12750] ppid=12749 vsize=55540 CPUtime=3.08 cores=0
/proc/12750/stat : 12750 (cryptominisat) R 12749 12749 12723 0 -1 4202496 10202 0 0 0 307 1 0 0 25 0 1 0 590519681 56872960 8486 33554432000 4194304 4587354 140733428552736 18446744073709551615 4243671 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12750/statm: 13885 8486 335 96 0 10447 0
[pid=12751] ppid=12749 vsize=30876 CPUtime=3.08 cores=1
/proc/12751/stat : 12751 (clasp) R 12749 12749 12723 0 -1 4202496 6416 0 0 0 308 0 0 0 25 0 1 0 590519681 31617024 4989 33554432000 4194304 4785740 140735983493040 18446744073709551615 4309555 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12751/statm: 7719 4989 340 145 0 4764 0
[pid=12752] ppid=12749 vsize=458596 CPUtime=3.09 cores=2
/proc/12752/stat : 12752 (TNM) R 12749 12749 12723 0 -1 4202496 3565 0 0 0 309 0 0 0 25 0 1 0 590519681 469602304 3462 33554432000 134512640 134534564 4286795008 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12752/statm: 114649 3462 95 6 0 113315 0
[pid=12753] ppid=12749 vsize=72444 CPUtime=3.08 cores=3
/proc/12753/stat : 12753 (march_hi) R 12749 12749 12723 0 -1 4202496 49068 0 0 0 302 6 0 0 25 0 1 0 590519681 74182656 8799 33554432000 4194304 4331988 140736685195584 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12753/statm: 18111 8799 173 34 0 16553 0
[pid=12754] ppid=12749 vsize=80504 CPUtime=12 cores=4-7
/proc/12754/stat : 12754 (plingeling) S 12749 12749 12723 0 -1 4202496 17488 1249 0 0 1198 2 0 0 25 0 5 0 590519681 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12754/statm: 20126 8569 164 40 0 18670 0
[pid=12754/tid=12761] ppid=12749 vsize=80504 CPUtime=2.96 cores=4-7
/proc/12754/task/12761/stat : 12761 (plingeling) R 12749 12749 12723 0 -1 4202560 3290 1249 0 0 296 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4331716 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12754/tid=12762] ppid=12749 vsize=80504 CPUtime=2.97 cores=4-7
/proc/12754/task/12762/stat : 12762 (plingeling) R 12749 12749 12723 0 -1 4202560 3963 1249 0 0 297 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4330945 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12754/tid=12763] ppid=12749 vsize=80504 CPUtime=2.97 cores=4-7
/proc/12754/task/12763/stat : 12763 (plingeling) R 12749 12749 12723 0 -1 4202560 3843 1249 0 0 297 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4234087 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12754/tid=12764] ppid=12749 vsize=80504 CPUtime=2.97 cores=4-7
/proc/12754/task/12764/stat : 12764 (plingeling) R 12749 12749 12723 0 -1 4202560 1959 1249 0 0 297 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4330915 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.33
Current children cumulated vsize (KiB) 716284

[startup+6.30106 s]
/proc/loadavg: 7.56 7.94 7.97 9/180 12764
/proc/meminfo: memFree=16657440/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
[pid=12750] ppid=12749 vsize=55540 CPUtime=6.28 cores=0
/proc/12750/stat : 12750 (cryptominisat) R 12749 12749 12723 0 -1 4202496 10310 0 0 0 627 1 0 0 25 0 1 0 590519681 56872960 8590 33554432000 4194304 4587354 140733428552736 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12750/statm: 13885 8590 335 96 0 10447 0
[pid=12751] ppid=12749 vsize=34448 CPUtime=6.29 cores=1
/proc/12751/stat : 12751 (clasp) R 12749 12749 12723 0 -1 4202496 7311 0 0 0 628 1 0 0 25 0 1 0 590519681 35274752 5884 33554432000 4194304 4785740 140735983493040 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12751/statm: 8612 5884 340 145 0 5657 0
[pid=12752] ppid=12749 vsize=458596 CPUtime=6.29 cores=2
/proc/12752/stat : 12752 (TNM) R 12749 12749 12723 0 -1 4202496 3565 0 0 0 629 0 0 0 25 0 1 0 590519681 469602304 3462 33554432000 134512640 134534564 4286795008 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12752/statm: 114649 3462 95 6 0 113315 0
[pid=12753] ppid=12749 vsize=73236 CPUtime=6.28 cores=3
/proc/12753/stat : 12753 (march_hi) R 12749 12749 12723 0 -1 4202496 49276 0 0 0 622 6 0 0 25 0 1 0 590519681 74993664 9007 33554432000 4194304 4331988 140736685195584 18446744073709551615 260020092361 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12753/statm: 18309 9007 173 34 0 16751 0
[pid=12754] ppid=12749 vsize=80504 CPUtime=24.79 cores=4-7
/proc/12754/stat : 12754 (plingeling) S 12749 12749 12723 0 -1 4202496 17488 1249 0 0 2477 2 0 0 25 0 5 0 590519681 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12754/statm: 20126 8569 164 40 0 18670 0
[pid=12754/tid=12761] ppid=12749 vsize=80504 CPUtime=6.14 cores=4-7
/proc/12754/task/12761/stat : 12761 (plingeling) R 12749 12749 12723 0 -1 4202560 3290 1249 0 0 614 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12754/tid=12762] ppid=12749 vsize=80504 CPUtime=6.17 cores=4-7
/proc/12754/task/12762/stat : 12762 (plingeling) R 12749 12749 12723 0 -1 4202560 3963 1249 0 0 617 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4331383 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12754/tid=12763] ppid=12749 vsize=80504 CPUtime=6.17 cores=4-7
/proc/12754/task/12763/stat : 12763 (plingeling) R 12749 12749 12723 0 -1 4202560 3843 1249 0 0 617 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4234244 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12754/tid=12764] ppid=12749 vsize=80504 CPUtime=6.17 cores=4-7
/proc/12754/task/12764/stat : 12764 (plingeling) R 12749 12749 12723 0 -1 4202560 1959 1249 0 0 617 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.93
Current children cumulated vsize (KiB) 720648

[startup+12.7009 s]
/proc/loadavg: 7.63 7.94 7.97 9/180 12764
/proc/meminfo: memFree=16648460/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
[pid=12750] ppid=12749 vsize=55540 CPUtime=12.69 cores=0
/proc/12750/stat : 12750 (cryptominisat) R 12749 12749 12723 0 -1 4202496 10657 0 0 0 1267 2 0 0 25 0 1 0 590519681 56872960 8928 33554432000 4194304 4587354 140733428552736 18446744073709551615 4244156 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12750/statm: 13885 8928 335 96 0 10447 0
[pid=12751] ppid=12749 vsize=43188 CPUtime=12.69 cores=1
/proc/12751/stat : 12751 (clasp) R 12749 12749 12723 0 -1 4202496 9474 0 0 0 1266 3 0 0 25 0 1 0 590519681 44224512 8047 33554432000 4194304 4785740 140735983493040 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12751/statm: 10797 8047 340 145 0 7842 0
[pid=12752] ppid=12749 vsize=458596 CPUtime=12.69 cores=2
/proc/12752/stat : 12752 (TNM) R 12749 12749 12723 0 -1 4202496 3565 0 0 0 1269 0 0 0 25 0 1 0 590519681 469602304 3462 33554432000 134512640 134534564 4286795008 18446744073709551615 134529640 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12752/statm: 114649 3462 95 6 0 113315 0
[pid=12753] ppid=12749 vsize=73644 CPUtime=12.68 cores=3
/proc/12753/stat : 12753 (march_hi) R 12749 12749 12723 0 -1 4202496 49365 0 0 0 1262 6 0 0 25 0 1 0 590519681 75411456 9096 33554432000 4194304 4331988 140736685195584 18446744073709551615 4265477 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12753/statm: 18411 9096 173 34 0 16853 0
[pid=12754] ppid=12749 vsize=80504 CPUtime=50.35 cores=4-7
/proc/12754/stat : 12754 (plingeling) S 12749 12749 12723 0 -1 4202496 17488 1249 0 0 5033 2 0 0 25 0 5 0 590519681 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12754/statm: 20126 8569 164 40 0 18670 0
[pid=12754/tid=12761] ppid=12749 vsize=80504 CPUtime=12.5 cores=4-7
/proc/12754/task/12761/stat : 12761 (plingeling) R 12749 12749 12723 0 -1 4202560 3290 1249 0 0 1250 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12754/tid=12762] ppid=12749 vsize=80504 CPUtime=12.57 cores=4-7
/proc/12754/task/12762/stat : 12762 (plingeling) R 12749 12749 12723 0 -1 4202560 3963 1249 0 0 1257 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12754/tid=12763] ppid=12749 vsize=80504 CPUtime=12.57 cores=4-7
/proc/12754/task/12763/stat : 12763 (plingeling) R 12749 12749 12723 0 -1 4202560 3843 1249 0 0 1257 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4279435 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12754/tid=12764] ppid=12749 vsize=80504 CPUtime=12.57 cores=4-7
/proc/12754/task/12764/stat : 12764 (plingeling) R 12749 12749 12723 0 -1 4202560 1959 1249 0 0 1257 0 0 0 25 0 5 0 590519692 82436096 8569 33554432000 4194304 4356188 140735771792368 18446744073709551615 4234297 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.1
Current children cumulated vsize (KiB) 729796

[startup+25.5005 s]
/proc/loadavg: 7.68 7.94 7.97 9/180 12765
/proc/meminfo: memFree=16631196/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
[pid=12750] ppid=12749 vsize=55540 CPUtime=25.49 cores=0
/proc/12750/stat : 12750 (cryptominisat) R 12749 12749 12723 0 -1 4202496 11093 0 0 0 2547 2 0 0 25 0 1 0 590519681 56872960 9351 33554432000 4194304 4587354 140733428552736 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=12752] ppid=12749 vsize=458600 CPUtime=4841.17 cores=2
/proc/12752/stat : 12752 (TNM) R 12749 12749 12723 0 -1 4202496 3574 0 0 0 484116 1 0 0 25 0 1 0 590519681 469606400 3471 33554432000 134512640 134534564 4286795008 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12752/statm: 114650 3471 103 6 0 113316 0
[pid=12753] ppid=12749 vsize=142916 CPUtime=4842.44 cores=3
/proc/12753/stat : 12753 (march_hi) R 12749 12749 12723 0 -1 4202496 64980 0 0 0 484225 19 0 0 25 0 1 0 590519681 146345984 24711 33554432000 4194304 4331988 140736685195584 18446744073709551615 4299872 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12753/statm: 35729 24711 173 34 0 34171 0
[pid=12754] ppid=12749 vsize=121000 CPUtime=19343 cores=4-7
/proc/12754/stat : 12754 (plingeling) S 12749 12749 12723 0 -1 4202496 75484 1249 0 0 1934289 12 0 0 25 0 5 0 590519681 123904000 18693 33554432000 4194304 4356188 140735771792368 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12754/statm: 30250 18693 164 40 0 28794 0
[pid=12754/tid=12761] ppid=12749 vsize=121000 CPUtime=4815.91 cores=4-7
/proc/12754/task/12761/stat : 12761 (plingeling) R 12749 12749 12723 0 -1 4202560 19418 1249 0 0 481589 2 0 0 25 0 5 0 590519692 123904000 18693 33554432000 4194304 4356188 140735771792368 18446744073709551615 4210856 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12754/tid=12762] ppid=12749 vsize=121000 CPUtime=4842.33 cores=4-7
/proc/12754/task/12762/stat : 12762 (plingeling) R 12749 12749 12723 0 -1 4202560 23831 1249 0 0 484229 4 0 0 25 0 5 0 590519692 123904000 18693 33554432000 4194304 4356188 140735771792368 18446744073709551615 4332288 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12754/tid=12763] ppid=12749 vsize=121000 CPUtime=4842.31 cores=4-7
/proc/12754/task/12763/stat : 12763 (plingeling) R 12749 12749 12723 0 -1 4202560 23427 1249 0 0 484228 3 0 0 25 0 5 0 590519692 123904000 18693 33554432000 4194304 4356188 140735771792368 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12754/tid=12764] ppid=12749 vsize=121000 CPUtime=4842.32 cores=4-7
/proc/12754/task/12764/stat : 12764 (plingeling) R 12749 12749 12723 0 -1 4202560 4375 1249 0 0 484231 1 0 0 25 0 5 0 590519692 123904000 18693 33554432000 4194304 4356188 140735771792368 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38711.4
Current children cumulated vsize (KiB) 1261616

[startup+4902.3 s]
/proc/loadavg: 8.09 8.06 8.01 9/180 12907
/proc/meminfo: memFree=16254400/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
[pid=12750] ppid=12749 vsize=290496 CPUtime=4902.3 cores=0
/proc/12750/stat : 12750 (cryptominisat) R 12749 12749 12723 0 -1 4202496 117335 0 0 0 490184 46 0 0 25 0 1 0 590519681 297467904 30208 33554432000 4194304 4587354 140733428552736 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12750/statm: 72624 30208 342 96 0 69186 0
[pid=12751] ppid=12749 vsize=249456 CPUtime=4902.44 cores=1
/proc/12751/stat : 12751 (clasp) R 12749 12749 12723 0 -1 4202496 60788 0 0 0 490205 39 0 0 25 0 1 0 590519681 255442944 59361 33554432000 4194304 4785740 140735983493040 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12751/statm: 62364 59361 340 145 0 59409 0
[pid=12752] ppid=12749 vsize=458600 CPUtime=4901.16 cores=2
/proc/12752/stat : 12752 (TNM) R 12749 12749 12723 0 -1 4202496 3574 0 0 0 490115 1 0 0 25 0 1 0 590519681 469606400 3471 33554432000 134512640 134534564 4286795008 18446744073709551615 134529031 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12752/statm: 114650 3471 103 6 0 113316 0
[pid=12753] ppid=12749 vsize=142916 CPUtime=4902.44 cores=3
/proc/12753/stat : 12753 (march_hi) R 12749 12749 12723 0 -1 4202496 65150 0 0 0 490225 19 0 0 25 0 1 0 590519681 146345984 24881 33554432000 4194304 4331988 140736685195584 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12753/statm: 35729 24881 173 34 0 34171 0
[pid=12754] ppid=12749 vsize=121000 CPUtime=19582.7 cores=4-7
/proc/12754/stat : 12754 (plingeling) S 12749 12749 12723 0 -1 4202496 75740 1249 0 0 1958257 12 0 0 25 0 5 0 590519681 123904000 18693 33554432000 4194304 4356188 140735771792368 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12754/statm: 30250 18693 164 40 0 28794 0
[pid=12754/tid=12761] ppid=12749 vsize=121000 CPUtime=4875.59 cores=4-7
/proc/12754/task/12761/stat : 12761 (plingeling) R 12749 12749 12723 0 -1 4202560 19418 1249 0 0 487557 2 0 0 25 0 5 0 590519692 123904000 18693 33554432000 4194304 4356188 140735771792368 18446744073709551615 4332007 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12754/tid=12762] ppid=12749 vsize=121000 CPUtime=4902.33 cores=4-7
/proc/12754/task/12762/stat : 12762 (plingeling) R 12749 12749 12723 0 -1 4202560 24087 1249 0 0 490229 4 0 0 25 0 5 0 590519692 123904000 18693 33554432000 4194304 4356188 140735771792368 18446744073709551615 4212543 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12754/tid=12763] ppid=12749 vsize=121000 CPUtime=4902.31 cores=4-7
/proc/12754/task/12763/stat : 12763 (plingeling) R 12749 12749 12723 0 -1 4202560 23427 1249 0 0 490228 3 0 0 25 0 5 0 590519692 123904000 18693 33554432000 4194304 4356188 140735771792368 18446744073709551615 4331964 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12754/tid=12764] ppid=12749 vsize=121000 CPUtime=4902.32 cores=4-7
/proc/12754/task/12764/stat : 12764 (plingeling) R 12749 12749 12723 0 -1 4202560 4375 1249 0 0 490231 1 0 0 25 0 5 0 590519692 123904000 18693 33554432000 4194304 4356188 140735771792368 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39191
Current children cumulated vsize (KiB) 1280792

[startup+4962.3 s]
/proc/loadavg: 8.08 8.06 8.01 9/180 12908
/proc/meminfo: memFree=16243072/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
[pid=12750] ppid=12749 vsize=290496 CPUtime=4962.3 cores=0
/proc/12750/stat : 12750 (cryptominisat) R 12749 12749 12723 0 -1 4202496 118041 0 0 0 496184 46 0 0 25 0 1 0 590519681 297467904 30885 33554432000 4194304 4587354 140733428552736 18446744073709551615 4239304 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12750/statm: 72624 30885 342 96 0 69186 0
[pid=12751] ppid=12749 vsize=253152 CPUtime=4962.44 cores=1
/proc/12751/stat : 12751 (clasp) R 12749 12749 12723 0 -1 4202496 61702 0 0 0 496205 39 0 0 25 0 1 0 590519681 259227648 60275 33554432000 4194304 4785740 140735983493040 18446744073709551615 4287053 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12751/statm: 63288 60275 340 145 0 60333 0
[pid=12752] ppid=12749 vsize=458600 CPUtime=4961.16 cores=2
/proc/12752/stat : 12752 (TNM) R 12749 12749 12723 0 -1 4202496 3574 0 0 0 496115 1 0 0 25 0 1 0 590519681 469606400 3471 33554432000 134512640 134534564 4286795008 18446744073709551615 5748155 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12752/statm: 114650 3471 103 6 0 113316 0
[pid=12753] ppid=12749 vsize=143048 CPUtime=4962.44 cores=3
/proc/12753/stat : 12753 (march_hi) R 12749 12749 12723 0 -1 4202496 65312 0 0 0 496225 19 0 0 25 0 1 0 590519681 146481152 25043 33554432000 4194304 4331988 140736685195584 18446744073709551615 4263319 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12753/statm: 35762 25043 173 34 0 34204 0
[pid=12754] ppid=12749 vsize=125096 CPUtime=19822.4 cores=4-7
/proc/12754/stat : 12754 (plingeling) S 12749 12749 12723 0 -1 4202496 78044 1249 0 0 1982225 13 0 0 25 0 5 0 590519681 128098304 19717 33554432000 4194304 4356188 140735771792368 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12754/statm: 31274 19717 164 40 0 29818 0
[pid=12754/tid=12761] ppid=12749 vsize=125096 CPUtime=4935.26 cores=4-7
/proc/12754/task/12761/stat : 12761 (plingeling) R 12749 12749 12723 0 -1 4202560 19418 1249 0 0 493524 2 0 0 25 0 5 0 590519692 128098304 19717 33554432000 4194304 4356188 140735771792368 18446744073709551615 4234297 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12754/tid=12762] ppid=12749 vsize=125096 CPUtime=4962.32 cores=4-7
/proc/12754/task/12762/stat : 12762 (plingeling) R 12749 12749 12723 0 -1 4202560 26391 1249 0 0 496228 4 0 0 25 0 5 0 590519692 128098304 19717 33554432000 4194304 4356188 140735771792368 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12754/tid=12763] ppid=12749 vsize=125096 CPUtime=4962.31 cores=4-7
/proc/12754/task/12763/stat : 12763 (plingeling) R 12749 12749 12723 0 -1 4202560 23427 1249 0 0 496228 3 0 0 25 0 5 0 590519692 128098304 19717 33554432000 4194304 4356188 140735771792368 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12754/tid=12764] ppid=12749 vsize=125096 CPUtime=4962.33 cores=4-7
/proc/12754/task/12764/stat : 12764 (plingeling) R 12749 12749 12723 0 -1 4202560 4375 1249 0 0 496232 1 0 0 25 0 5 0 590519692 128098304 19717 33554432000 4194304 4356188 140735771792368 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39670.7
Current children cumulated vsize (KiB) 1288716



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.5 s]
/proc/loadavg: 8.04 8.05 8.00 9/180 12910
/proc/meminfo: memFree=16236968/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
[pid=12750] ppid=12749 vsize=290496 CPUtime=5003.5 cores=0
/proc/12750/stat : 12750 (cryptominisat) R 12749 12749 12723 0 -1 4202496 118486 0 0 0 500304 46 0 0 25 0 1 0 590519681 297467904 31313 33554432000 4194304 4587354 140733428552736 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12750/statm: 72624 31313 342 96 0 69186 0
[pid=12751] ppid=12749 vsize=253152 CPUtime=5003.65 cores=1
/proc/12751/stat : 12751 (clasp) R 12749 12749 12723 0 -1 4202496 61702 0 0 0 500326 39 0 0 25 0 1 0 590519681 259227648 60275 33554432000 4194304 4785740 140735983493040 18446744073709551615 4287088 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12751/statm: 63288 60275 340 145 0 60333 0
[pid=12752] ppid=12749 vsize=458600 CPUtime=5002.36 cores=2
/proc/12752/stat : 12752 (TNM) R 12749 12749 12723 0 -1 4202496 3574 0 0 0 500235 1 0 0 25 0 1 0 590519681 469606400 3471 33554432000 134512640 134534564 4286795008 18446744073709551615 134528348 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12752/statm: 114650 3471 103 6 0 113316 0
[pid=12753] ppid=12749 vsize=143048 CPUtime=5003.65 cores=3
/proc/12753/stat : 12753 (march_hi) R 12749 12749 12723 0 -1 4202496 65422 0 0 0 500346 19 0 0 25 0 1 0 590519681 146481152 25153 33554432000 4194304 4331988 140736685195584 18446744073709551615 4297280 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12753/statm: 35762 25153 173 34 0 34204 0
[pid=12754] ppid=12749 vsize=129704 CPUtime=19987 cores=4-7
/proc/12754/stat : 12754 (plingeling) S 12749 12749 12723 0 -1 4202496 79196 1249 0 0 1998685 13 0 0 25 0 5 0 590519681 132816896 20869 33554432000 4194304 4356188 140735771792368 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12754/statm: 32426 20869 164 40 0 30970 0
[pid=12754/tid=12761] ppid=12749 vsize=129704 CPUtime=4976.24 cores=4-7
/proc/12754/task/12761/stat : 12761 (plingeling) R 12749 12749 12723 0 -1 4202560 20570 1249 0 0 497622 2 0 0 25 0 5 0 590519692 132816896 20869 33554432000 4194304 4356188 140735771792368 18446744073709551615 4279677 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12754/tid=12762] ppid=12749 vsize=129704 CPUtime=5003.53 cores=4-7
/proc/12754/task/12762/stat : 12762 (plingeling) R 12749 12749 12723 0 -1 4202560 26391 1249 0 0 500349 4 0 0 25 0 5 0 590519692 132816896 20869 33554432000 4194304 4356188 140735771792368 18446744073709551615 4338290 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12754/tid=12763] ppid=12749 vsize=129704 CPUtime=5003.52 cores=4-7
/proc/12754/task/12763/stat : 12763 (plingeling) R 12749 12749 12723 0 -1 4202560 23427 1249 0 0 500349 3 0 0 25 0 5 0 590519692 132816896 20869 33554432000 4194304 4356188 140735771792368 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12754/tid=12764] ppid=12749 vsize=129704 CPUtime=5003.53 cores=4-7
/proc/12754/task/12764/stat : 12764 (plingeling) R 12749 12749 12723 0 -1 4202560 4375 1249 0 0 500352 1 0 0 25 0 5 0 590519692 132816896 20869 33554432000 4194304 4356188 140735771792368 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.1
Current children cumulated vsize (KiB) 1293324

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5003.5 s]
/proc/loadavg: 8.04 8.05 8.00 9/180 12910
/proc/meminfo: memFree=16236968/32951124 swapFree=67111528/67111528
[pid=12749] ppid=12747 vsize=18324 CPUtime=0 cores=0-7
/proc/12749/stat : 12749 (ppfolio) S 12747 12749 12723 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 590519680 18763776 390 33554432000 4194304 4287625 140736073944576 18446744073709551615 260020416015 0 0 4096 65536 5632226877100785663 0 0 17 4 0 0 0
/proc/12749/statm: 4581 390 341 23 0 91 0
[pid=12750] ppid=12749 vsize=290496 CPUtime=5003.5 cores=0
/proc/12750/stat : 12750 (cryptominisat) R 12749 12749 12723 0 -1 4202496 118486 0 0 0 500304 46 0 0 25 0 1 0 590519681 297467904 31313 33554432000 4194304 4587354 140733428552736 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/12750/statm: 72624 31313 342 96 0 69186 0
[pid=12751] ppid=12749 vsize=253152 CPUtime=5003.65 cores=1
/proc/12751/stat : 12751 (clasp) R 12749 12749 12723 0 -1 4202496 61702 0 0 0 500326 39 0 0 25 0 1 0 590519681 259227648 60275 33554432000 4194304 4785740 140735983493040 18446744073709551615 4287088 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/12751/statm: 63288 60275 340 145 0 60333 0
[pid=12752] ppid=12749 vsize=458600 CPUtime=5002.36 cores=2
/proc/12752/stat : 12752 (TNM) R 12749 12749 12723 0 -1 4202496 3574 0 0 0 500235 1 0 0 25 0 1 0 590519681 469606400 3471 33554432000 134512640 134534564 4286795008 18446744073709551615 134528348 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/12752/statm: 114650 3471 103 6 0 113316 0
[pid=12753] ppid=12749 vsize=143048 CPUtime=5003.65 cores=3
/proc/12753/stat : 12753 (march_hi) R 12749 12749 12723 0 -1 4202496 65422 0 0 0 500346 19 0 0 25 0 1 0 590519681 146481152 25153 33554432000 4194304 4331988 140736685195584 18446744073709551615 4297280 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/12753/statm: 35762 25153 173 34 0 34204 0
[pid=12754] ppid=12749 vsize=129704 CPUtime=19987 cores=4-7
/proc/12754/stat : 12754 (plingeling) S 12749 12749 12723 0 -1 4202496 79196 1249 0 0 1998685 13 0 0 25 0 5 0 590519681 132816896 20869 33554432000 4194304 4356188 140735771792368 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/12754/statm: 32426 20869 164 40 0 30970 0
[pid=12754/tid=12761] ppid=12749 vsize=129704 CPUtime=4976.24 cores=4-7
/proc/12754/task/12761/stat : 12761 (plingeling) R 12749 12749 12723 0 -1 4202560 20570 1249 0 0 497622 2 0 0 25 0 5 0 590519692 132816896 20869 33554432000 4194304 4356188 140735771792368 18446744073709551615 4279677 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12754/tid=12762] ppid=12749 vsize=129704 CPUtime=5003.53 cores=4-7
/proc/12754/task/12762/stat : 12762 (plingeling) R 12749 12749 12723 0 -1 4202560 26391 1249 0 0 500349 4 0 0 25 0 5 0 590519692 132816896 20869 33554432000 4194304 4356188 140735771792368 18446744073709551615 4338290 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12754/tid=12763] ppid=12749 vsize=129704 CPUtime=5003.52 cores=4-7
/proc/12754/task/12763/stat : 12763 (plingeling) R 12749 12749 12723 0 -1 4202560 23427 1249 0 0 500349 3 0 0 25 0 5 0 590519692 132816896 20869 33554432000 4194304 4356188 140735771792368 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12754/tid=12764] ppid=12749 vsize=129704 CPUtime=5003.53 cores=4-7
/proc/12754/task/12764/stat : 12764 (plingeling) R 12749 12749 12723 0 -1 4202560 4375 1249 0 0 500352 1 0 0 25 0 5 0 590519692 132816896 20869 33554432000 4194304 4356188 140735771792368 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.1
Current children cumulated vsize (KiB) 1293324

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 12749 and gives
#  childrusage.ru_utime.tv_sec=34995
#  childrusage.ru_utime.tv_usec=738839
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=834873
# CPU time returned by wait4() is 34996.6
# while last known CPU time is 40000.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.52
CPU time (s): 40000.1
CPU user time (s): 39999
CPU system time (s): 1.18
CPU usage (%): 799.44
Max. virtual memory (cumulated for all children) (KiB): 1427088

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 34995.7
system time used= 0.834873
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 268450
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 355
involuntary context switches= 164928

runsolver used 8.10577 second user time and 19.1921 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-28 17:01:31
IDJOB=3310172
IDBENCH=70849
IDSOLVER=1638
FILE ID=node110/3310172-1304002891
RUNJOBID= node110-1304002891-12737
PBS_JOBID= 13168799
Free space on /tmp= 72840 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/APPLICATIONS/crypto/desgen/gss-27-s100.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310172-1304002891/watcher-3310172-1304002891 -o /tmp/evaluation-result-3310172-1304002891/solver-3310172-1304002891 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310172-1304002891.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f47c33d2a9a327da4633207adfef7b77
RANDOM SEED=926621265

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16795788 kB
Buffers:       2331692 kB
Cached:       13186276 kB
SwapCached:          0 kB
Active:        7785028 kB
Inactive:      7797320 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16795788 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           11936 kB
Writeback:           0 kB
AnonPages:       64292 kB
Mapped:          14572 kB
Slab:           506264 kB
PageTables:       4404 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   185556 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72828 MiB
End job on node110 at 2011-04-28 18:24:57