Trace number 3275866

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.2 5003.62

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_50_30_20_1-log.shuffled-as.sat03-107.cnf
MD5SUM5f29341b29f4bbeb333d68befe08c7ae
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark949.86
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses56970
Sum of the clauses size569400
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 560
Number of clauses of size over 556910

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275866-1304171343/watcher-3275866-1304171343 -o /tmp/evaluation-result-3275866-1304171343/solver-3275866-1304171343 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275866-1304171343.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.41 7.92 7.96 2/170 26935
/proc/meminfo: memFree=30495480/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0

[startup+0.0546301 s]
/proc/loadavg: 7.41 7.92 7.96 2/170 26935
/proc/meminfo: memFree=30495480/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100619 s]
/proc/loadavg: 7.41 7.92 7.96 2/170 26935
/proc/meminfo: memFree=30495480/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300551 s]
/proc/loadavg: 7.41 7.92 7.96 2/170 26935
/proc/meminfo: memFree=30495480/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700473 s]
/proc/loadavg: 7.41 7.92 7.96 2/170 26935
/proc/meminfo: memFree=30495480/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50132 s]
/proc/loadavg: 7.41 7.92 7.96 9/180 26950
/proc/meminfo: memFree=30412064/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
[pid=26936] ppid=26935 vsize=28252 CPUtime=1.49 cores=0
/proc/26936/stat : 26936 (cryptominisat) R 26935 26935 26437 0 -1 4202496 2492 0 0 0 149 0 0 0 25 0 1 0 528736675 28930048 2317 33554432000 4194304 4587354 140736120066208 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26936/statm: 7063 2317 306 96 0 3625 0
[pid=26937] ppid=26935 vsize=19824 CPUtime=1.49 cores=1
/proc/26937/stat : 26937 (clasp) R 26935 26935 26437 0 -1 4202496 2537 0 0 0 149 0 0 0 20 0 1 0 528736675 20299776 2258 33554432000 4194304 4785740 140737269749936 18446744073709551615 4495534 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26937/statm: 4956 2258 314 145 0 2001 0
[pid=26938] ppid=26935 vsize=461528 CPUtime=1.49 cores=2
/proc/26938/stat : 26938 (TNM) R 26935 26935 26437 0 -1 4202496 2897 0 0 0 149 0 0 0 25 0 1 0 528736675 472604672 2794 33554432000 134512640 134534564 4292280688 18446744073709551615 134524552 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26938/statm: 115382 2794 91 6 0 114048 0
[pid=26939] ppid=26935 vsize=19636 CPUtime=1.49 cores=3
/proc/26939/stat : 26939 (march_hi) R 26935 26935 26437 0 -1 4202496 14940 0 0 0 147 2 0 0 20 0 1 0 528736675 20107264 2905 33554432000 4194304 4331988 140734858024576 18446744073709551615 4271136 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26939/statm: 4909 2905 150 34 0 3351 0
[pid=26940] ppid=26935 vsize=161884 CPUtime=5.54 cores=4-7
/proc/26940/stat : 26940 (plingeling) S 26935 26935 26437 0 -1 4202496 15693 1256 0 0 552 2 0 0 20 0 5 0 528736675 165769216 12512 33554432000 4194304 4356188 140735292210192 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26940/statm: 40471 12512 162 40 0 39015 0
[pid=26940/tid=26947] ppid=26935 vsize=161884 CPUtime=1.34 cores=4-7
/proc/26940/task/26947/stat : 26947 (plingeling) R 26935 26935 26437 0 -1 4202560 1848 1256 0 0 134 0 0 0 19 0 5 0 528736690 165769216 12512 33554432000 4194304 4356188 140735292210192 18446744073709551615 4270872 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26940/tid=26948] ppid=26935 vsize=161884 CPUtime=1.34 cores=4-7
/proc/26940/task/26948/stat : 26948 (plingeling) R 26935 26935 26437 0 -1 4202560 1873 1256 0 0 134 0 0 0 25 0 5 0 528736690 165769216 12512 33554432000 4194304 4356188 140735292210192 18446744073709551615 4312576 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26940/tid=26949] ppid=26935 vsize=161884 CPUtime=1.34 cores=4-7
/proc/26940/task/26949/stat : 26949 (plingeling) R 26935 26935 26437 0 -1 4202560 1806 1256 0 0 134 0 0 0 25 0 5 0 528736690 165769216 12512 33554432000 4194304 4356188 140735292210192 18446744073709551615 4248450 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26940/tid=26950] ppid=26935 vsize=161884 CPUtime=1.34 cores=4-7
/proc/26940/task/26950/stat : 26950 (plingeling) R 26935 26935 26437 0 -1 4202560 1497 1256 0 0 134 0 0 0 25 0 5 0 528736690 165769216 12512 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331803 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.5
Current children cumulated vsize (KiB) 709448

[startup+3.10102 s]
/proc/loadavg: 7.41 7.92 7.96 9/180 26950
/proc/meminfo: memFree=30408096/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 17 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
[pid=26936] ppid=26935 vsize=45688 CPUtime=3.09 cores=0
/proc/26936/stat : 26936 (cryptominisat) R 26935 26935 26437 0 -1 4202496 9686 0 0 0 308 1 0 0 25 0 1 0 528736675 46784512 6541 33554432000 4194304 4587354 140736120066208 18446744073709551615 4388248 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26936/statm: 11422 6541 315 96 0 7984 0
[pid=26937] ppid=26935 vsize=20188 CPUtime=3.09 cores=1
/proc/26937/stat : 26937 (clasp) R 26935 26935 26437 0 -1 4202496 2603 0 0 0 309 0 0 0 25 0 1 0 528736675 20672512 2324 33554432000 4194304 4785740 140737269749936 18446744073709551615 4495638 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26937/statm: 5047 2324 314 145 0 2092 0
[pid=26938] ppid=26935 vsize=461528 CPUtime=3.08 cores=2
/proc/26938/stat : 26938 (TNM) R 26935 26935 26437 0 -1 4202496 2897 0 0 0 308 0 0 0 25 0 1 0 528736675 472604672 2794 33554432000 134512640 134534564 4292280688 18446744073709551615 134524736 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26938/statm: 115382 2794 91 6 0 114048 0
[pid=26939] ppid=26935 vsize=19636 CPUtime=3.09 cores=3
/proc/26939/stat : 26939 (march_hi) R 26935 26935 26437 0 -1 4202496 14960 0 0 0 307 2 0 0 25 0 1 0 528736675 20107264 2925 33554432000 4194304 4331988 140734858024576 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26939/statm: 4909 2925 150 34 0 3351 0
[pid=26940] ppid=26935 vsize=150476 CPUtime=11.93 cores=4-7
/proc/26940/stat : 26940 (plingeling) S 26935 26935 26437 0 -1 4202496 16007 1256 0 0 1191 2 0 0 20 0 5 0 528736675 154087424 9660 33554432000 4194304 4356188 140735292210192 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26940/statm: 37619 9660 162 40 0 36163 0
[pid=26940/tid=26947] ppid=26935 vsize=150476 CPUtime=2.94 cores=4-7
/proc/26940/task/26947/stat : 26947 (plingeling) R 26935 26935 26437 0 -1 4202560 1880 1256 0 0 294 0 0 0 25 0 5 0 528736690 154087424 9660 33554432000 4194304 4356188 140735292210192 18446744073709551615 4332003 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26940/tid=26948] ppid=26935 vsize=150476 CPUtime=2.94 cores=4-7
/proc/26940/task/26948/stat : 26948 (plingeling) R 26935 26935 26437 0 -1 4202560 1929 1256 0 0 294 0 0 0 25 0 5 0 528736690 154087424 9660 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26940/tid=26949] ppid=26935 vsize=150476 CPUtime=2.94 cores=4-7
/proc/26940/task/26949/stat : 26949 (plingeling) R 26935 26935 26437 0 -1 4202560 1870 1256 0 0 294 0 0 0 25 0 5 0 528736690 154087424 9660 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26940/tid=26950] ppid=26935 vsize=150476 CPUtime=2.93 cores=4-7
/proc/26940/task/26950/stat : 26950 (plingeling) R 26935 26935 26437 0 -1 4202560 1659 1256 0 0 293 0 0 0 25 0 5 0 528736690 154087424 9660 33554432000 4194304 4356188 140735292210192 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.28
Current children cumulated vsize (KiB) 715840

[startup+6.30141 s]
/proc/loadavg: 7.46 7.92 7.96 9/180 26950
/proc/meminfo: memFree=30389584/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
[pid=26936] ppid=26935 vsize=48620 CPUtime=6.29 cores=0
/proc/26936/stat : 26936 (cryptominisat) R 26935 26935 26437 0 -1 4202496 17533 0 0 0 626 3 0 0 25 0 1 0 528736675 49786880 7803 33554432000 4194304 4587354 140736120066208 18446744073709551615 4364704 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26936/statm: 12155 7803 337 96 0 8717 0
[pid=26937] ppid=26935 vsize=23556 CPUtime=6.29 cores=1
/proc/26937/stat : 26937 (clasp) R 26935 26935 26437 0 -1 4202496 3647 0 0 0 629 0 0 0 25 0 1 0 528736675 24121344 3182 33554432000 4194304 4785740 140737269749936 18446744073709551615 4287129 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26937/statm: 5889 3182 340 145 0 2934 0
[pid=26938] ppid=26935 vsize=461528 CPUtime=6.28 cores=2
/proc/26938/stat : 26938 (TNM) R 26935 26935 26437 0 -1 4202496 2897 0 0 0 628 0 0 0 25 0 1 0 528736675 472604672 2794 33554432000 134512640 134534564 4292280688 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26938/statm: 115382 2794 91 6 0 114048 0
[pid=26939] ppid=26935 vsize=20020 CPUtime=6.29 cores=3
/proc/26939/stat : 26939 (march_hi) R 26935 26935 26437 0 -1 4202496 14984 0 0 0 627 2 0 0 25 0 1 0 528736675 20500480 2949 33554432000 4194304 4331988 140734858024576 18446744073709551615 4271136 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26939/statm: 5005 2949 150 34 0 3447 0
[pid=26940] ppid=26935 vsize=156780 CPUtime=24.71 cores=4-7
/proc/26940/stat : 26940 (plingeling) S 26935 26935 26437 0 -1 4202496 20271 1256 0 0 2468 3 0 0 20 0 5 0 528736675 160542720 11267 33554432000 4194304 4356188 140735292210192 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26940/statm: 39195 11267 162 40 0 37739 0
[pid=26940/tid=26947] ppid=26935 vsize=156780 CPUtime=6.14 cores=4-7
/proc/26940/task/26947/stat : 26947 (plingeling) R 26935 26935 26437 0 -1 4202560 2353 1256 0 0 614 0 0 0 25 0 5 0 528736690 160542720 11267 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331141 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26940/tid=26948] ppid=26935 vsize=156780 CPUtime=6.14 cores=4-7
/proc/26940/task/26948/stat : 26948 (plingeling) R 26935 26935 26437 0 -1 4202560 2508 1256 0 0 614 0 0 0 25 0 5 0 528736690 160542720 11267 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26940/tid=26949] ppid=26935 vsize=156780 CPUtime=6.14 cores=4-7
/proc/26940/task/26949/stat : 26949 (plingeling) R 26935 26935 26437 0 -1 4202560 3477 1256 0 0 614 0 0 0 25 0 5 0 528736690 160542720 11267 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331585 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26940/tid=26950] ppid=26935 vsize=156780 CPUtime=6.11 cores=4-7
/proc/26940/task/26950/stat : 26950 (plingeling) R 26935 26935 26437 0 -1 4202560 3264 1256 0 0 611 0 0 0 25 0 5 0 528736690 160542720 11267 33554432000 4194304 4356188 140735292210192 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.86
Current children cumulated vsize (KiB) 728828

[startup+12.7012 s]
/proc/loadavg: 7.50 7.92 7.96 9/180 26951
/proc/meminfo: memFree=30388380/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
[pid=26936] ppid=26935 vsize=32356 CPUtime=12.69 cores=0
/proc/26936/stat : 26936 (cryptominisat) R 26935 26935 26437 0 -1 4202496 21395 0 0 0 1266 3 0 0 25 0 1 0 528736675 33132544 3929 33554432000 4194304 4587354 140736120066208 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26936/statm: 8089 3929 337 96 0 4651 0
[pid=26937] ppid=26935 vsize=26428 CPUtime=12.69 cores=1
/proc/26937/stat : 26937 (clasp) R 26935 26935 26437 0 -1 4202496 4308 0 0 0 1269 0 0 0 25 0 1 0 528736675 27062272 3843 33554432000 4194304 4785740 140737269749936 18446744073709551615 4286998 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26937/statm: 6607 3843 340 145 0 3652 0
[pid=26938] ppid=26935 vsize=461528 CPUtime=12.68 cores=2
/proc/26938/stat : 26938 (TNM) R 26935 26935 26437 0 -1 4202496 2897 0 0 0 1268 0 0 0 25 0 1 0 528736675 472604672 2794 33554432000 134512640 134534564 4292280688 18446744073709551615 134524664 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26938/statm: 115382 2794 91 6 0 114048 0
[pid=26939] ppid=26935 vsize=21196 CPUtime=12.69 cores=3
/proc/26939/stat : 26939 (march_hi) R 26935 26935 26437 0 -1 4202496 15300 0 0 0 1267 2 0 0 25 0 1 0 528736675 21704704 3265 33554432000 4194304 4331988 140734858024576 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26939/statm: 5299 3265 150 34 0 3741 0
[pid=26940] ppid=26935 vsize=167032 CPUtime=50.27 cores=4-7
/proc/26940/stat : 26940 (plingeling) S 26935 26935 26437 0 -1 4202496 30794 1256 0 0 5022 5 0 0 20 0 5 0 528736675 171040768 13830 33554432000 4194304 4356188 140735292210192 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26940/statm: 41758 13830 162 40 0 40302 0
[pid=26940/tid=26947] ppid=26935 vsize=167032 CPUtime=12.55 cores=4-7
/proc/26940/task/26947/stat : 26947 (plingeling) R 26935 26935 26437 0 -1 4202560 5461 1256 0 0 1254 1 0 0 25 0 5 0 528736690 171040768 13830 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331355 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26940/tid=26948] ppid=26935 vsize=167032 CPUtime=12.54 cores=4-7
/proc/26940/task/26948/stat : 26948 (plingeling) R 26935 26935 26437 0 -1 4202560 5888 1256 0 0 1253 1 0 0 25 0 5 0 528736690 171040768 13830 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26940/tid=26949] ppid=26935 vsize=167032 CPUtime=12.54 cores=4-7
/proc/26940/task/26949/stat : 26949 (plingeling) R 26935 26935 26437 0 -1 4202560 5206 1256 0 0 1254 0 0 0 25 0 5 0 528736690 171040768 13830 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26940/tid=26950] ppid=26935 vsize=167032 CPUtime=12.47 cores=4-7
/proc/26940/task/26950/stat : 26950 (plingeling) R 26935 26935 26437 0 -1 4202560 5570 1256 0 0 1247 0 0 0 25 0 5 0 528736690 171040768 13830 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.02
Current children cumulated vsize (KiB) 726864

[startup+25.5008 s]
/proc/loadavg: 7.61 7.93 7.96 9/180 26951
/proc/meminfo: memFree=30354812/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
[pid=26936] ppid=26935 vsize=716676 CPUtime=25.49 cores=0
/proc/26936/stat : 26936 (cryptominisat) R 26935 26935 26437 0 -1 4202496 30007 0 0 0 2544 5 0 0 25 0 1 0 528736675 733876224 9862 33554432000 4194304 4587354 140736120066208 18446744073709551615 4244561 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=26938] ppid=26935 vsize=465524 CPUtime=4782 cores=2
/proc/26938/stat : 26938 (TNM) R 26935 26935 26437 0 -1 4202496 3232 0 0 0 478198 2 0 0 25 0 1 0 528736675 476696576 3129 33554432000 134512640 134534564 4292280688 18446744073709551615 134528902 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26938/statm: 116381 3129 95 6 0 115047 0
[pid=26939] ppid=26935 vsize=63880 CPUtime=4782.45 cores=3
/proc/26939/stat : 26939 (march_hi) R 26935 26935 26437 0 -1 4202496 35002 0 0 0 478238 7 0 0 25 0 1 0 528736675 65413120 11225 33554432000 4194304 4331988 140734858024576 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26939/statm: 15970 11225 175 34 0 14412 0
[pid=26940] ppid=26935 vsize=406984 CPUtime=19101.6 cores=4-7
/proc/26940/stat : 26940 (plingeling) S 26935 26935 26437 0 -1 4202496 1863290 1256 0 0 1909877 282 0 0 20 0 5 0 528736675 416751616 73819 33554432000 4194304 4356188 140735292210192 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26940/statm: 101746 73819 162 40 0 100290 0
[pid=26940/tid=26947] ppid=26935 vsize=406984 CPUtime=4782.19 cores=4-7
/proc/26940/task/26947/stat : 26947 (plingeling) R 26935 26935 26437 0 -1 4202560 454666 1256 0 0 478153 66 0 0 25 0 5 0 528736690 416751616 73819 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26940/tid=26948] ppid=26935 vsize=406984 CPUtime=4781.36 cores=4-7
/proc/26940/task/26948/stat : 26948 (plingeling) R 26935 26935 26437 0 -1 4202560 434024 1256 0 0 478070 66 0 0 25 0 5 0 528736690 416751616 73819 33554432000 4194304 4356188 140735292210192 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26940/tid=26949] ppid=26935 vsize=406984 CPUtime=4781.66 cores=4-7
/proc/26940/task/26949/stat : 26949 (plingeling) R 26935 26935 26437 0 -1 4202560 475619 1256 0 0 478090 76 0 0 25 0 5 0 528736690 416751616 73819 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26940/tid=26950] ppid=26935 vsize=406984 CPUtime=4756.22 cores=4-7
/proc/26940/task/26950/stat : 26950 (plingeling) R 26935 26935 26437 0 -1 4202560 490312 1256 0 0 475550 72 0 0 25 0 5 0 528736690 416751616 73819 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38231
Current children cumulated vsize (KiB) 1188508

[startup+4842.3 s]
/proc/loadavg: 8.00 8.05 8.01 9/180 27103
/proc/meminfo: memFree=29867580/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
[pid=26936] ppid=26935 vsize=216988 CPUtime=4842.46 cores=0
/proc/26936/stat : 26936 (cryptominisat) R 26935 26935 26437 0 -1 4202496 465568 0 0 0 484082 164 0 0 25 0 1 0 528736675 222195712 28913 33554432000 4194304 4587354 140736120066208 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26936/statm: 54247 28913 337 96 0 50809 0
[pid=26937] ppid=26935 vsize=108608 CPUtime=4842.46 cores=1
/proc/26937/stat : 26937 (clasp) R 26935 26935 26437 0 -1 4202496 22847 0 0 0 484240 6 0 0 25 0 1 0 528736675 111214592 22221 33554432000 4194304 4785740 140737269749936 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26937/statm: 27152 22221 340 145 0 24197 0
[pid=26938] ppid=26935 vsize=465524 CPUtime=4841.99 cores=2
/proc/26938/stat : 26938 (TNM) R 26935 26935 26437 0 -1 4202496 3232 0 0 0 484197 2 0 0 25 0 1 0 528736675 476696576 3129 33554432000 134512640 134534564 4292280688 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26938/statm: 116381 3129 95 6 0 115047 0
[pid=26939] ppid=26935 vsize=63880 CPUtime=4842.45 cores=3
/proc/26939/stat : 26939 (march_hi) R 26935 26935 26437 0 -1 4202496 35050 0 0 0 484238 7 0 0 25 0 1 0 528736675 65413120 11273 33554432000 4194304 4331988 140734858024576 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26939/statm: 15970 11273 175 34 0 14412 0
[pid=26940] ppid=26935 vsize=479944 CPUtime=19341.3 cores=4-7
/proc/26940/stat : 26940 (plingeling) S 26935 26935 26437 0 -1 4202496 1898522 1256 0 0 1933840 288 0 0 20 0 5 0 528736675 491462656 92059 33554432000 4194304 4356188 140735292210192 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26940/statm: 119986 92059 162 40 0 118530 0
[pid=26940/tid=26947] ppid=26935 vsize=479944 CPUtime=4842.19 cores=4-7
/proc/26940/task/26947/stat : 26947 (plingeling) R 26935 26935 26437 0 -1 4202560 465546 1256 0 0 484152 67 0 0 25 0 5 0 528736690 491462656 92059 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26940/tid=26948] ppid=26935 vsize=479944 CPUtime=4841.37 cores=4-7
/proc/26940/task/26948/stat : 26948 (plingeling) R 26935 26935 26437 0 -1 4202560 445416 1256 0 0 484068 69 0 0 25 0 5 0 528736690 491462656 92059 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26940/tid=26949] ppid=26935 vsize=479944 CPUtime=4841.66 cores=4-7
/proc/26940/task/26949/stat : 26949 (plingeling) R 26935 26935 26437 0 -1 4202560 477731 1256 0 0 484090 76 0 0 25 0 5 0 528736690 491462656 92059 33554432000 4194304 4356188 140735292210192 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26940/tid=26950] ppid=26935 vsize=479944 CPUtime=4815.89 cores=4-7
/proc/26940/task/26950/stat : 26950 (plingeling) R 26935 26935 26437 0 -1 4202560 501160 1256 0 0 481516 73 0 0 25 0 5 0 528736690 491462656 92059 33554432000 4194304 4356188 140735292210192 18446744073709551615 4332003 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38710.6
Current children cumulated vsize (KiB) 1353268

[startup+4902.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 27105
/proc/meminfo: memFree=29850064/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
[pid=26936] ppid=26935 vsize=148216 CPUtime=4902.47 cores=0
/proc/26936/stat : 26936 (cryptominisat) R 26935 26935 26437 0 -1 4202496 471582 0 0 0 490081 166 0 0 25 0 1 0 528736675 151773184 33746 33554432000 4194304 4587354 140736120066208 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26936/statm: 37054 33746 337 96 0 33616 0
[pid=26937] ppid=26935 vsize=108928 CPUtime=4902.47 cores=1
/proc/26937/stat : 26937 (clasp) R 26935 26935 26437 0 -1 4202496 23091 0 0 0 490241 6 0 0 25 0 1 0 528736675 111542272 22304 33554432000 4194304 4785740 140737269749936 18446744073709551615 4553375 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26937/statm: 27232 22304 340 145 0 24277 0
[pid=26938] ppid=26935 vsize=465524 CPUtime=4901.99 cores=2
/proc/26938/stat : 26938 (TNM) R 26935 26935 26437 0 -1 4202496 3232 0 0 0 490197 2 0 0 25 0 1 0 528736675 476696576 3129 33554432000 134512640 134534564 4292280688 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26938/statm: 116381 3129 95 6 0 115047 0
[pid=26939] ppid=26935 vsize=63880 CPUtime=4902.46 cores=3
/proc/26939/stat : 26939 (march_hi) R 26935 26935 26437 0 -1 4202496 35118 0 0 0 490239 7 0 0 25 0 1 0 528736675 65413120 11341 33554432000 4194304 4331988 140734858024576 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26939/statm: 15970 11341 175 34 0 14412 0
[pid=26940] ppid=26935 vsize=478024 CPUtime=19581 cores=4-7
/proc/26940/stat : 26940 (plingeling) S 26935 26935 26437 0 -1 4202496 1906746 1256 0 0 1957808 288 0 0 20 0 5 0 528736675 489496576 91579 33554432000 4194304 4356188 140735292210192 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26940/statm: 119506 91579 162 40 0 118050 0
[pid=26940/tid=26947] ppid=26935 vsize=478024 CPUtime=4902.19 cores=4-7
/proc/26940/task/26947/stat : 26947 (plingeling) R 26935 26935 26437 0 -1 4202560 467914 1256 0 0 490152 67 0 0 25 0 5 0 528736690 489496576 91579 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26940/tid=26948] ppid=26935 vsize=478024 CPUtime=4901.36 cores=4-7
/proc/26940/task/26948/stat : 26948 (plingeling) R 26935 26935 26437 0 -1 4202560 446696 1256 0 0 490067 69 0 0 25 0 5 0 528736690 489496576 91579 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26940/tid=26949] ppid=26935 vsize=478024 CPUtime=4901.66 cores=4-7
/proc/26940/task/26949/stat : 26949 (plingeling) R 26935 26935 26437 0 -1 4202560 479779 1256 0 0 490090 76 0 0 25 0 5 0 528736690 489496576 91579 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26940/tid=26950] ppid=26935 vsize=478024 CPUtime=4875.58 cores=4-7
/proc/26940/task/26950/stat : 26950 (plingeling) R 26935 26935 26437 0 -1 4202560 503688 1256 0 0 487484 74 0 0 25 0 5 0 528736690 489496576 91579 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39190.4
Current children cumulated vsize (KiB) 1282896

[startup+4962.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 27107
/proc/meminfo: memFree=29932756/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
[pid=26936] ppid=26935 vsize=125188 CPUtime=4962.47 cores=0
/proc/26936/stat : 26936 (cryptominisat) R 26935 26935 26437 0 -1 4202496 472848 0 0 0 496080 167 0 0 25 0 1 0 528736675 128192512 28146 33554432000 4194304 4587354 140736120066208 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26936/statm: 31297 28146 337 96 0 27859 0
[pid=26937] ppid=26935 vsize=109248 CPUtime=4962.47 cores=1
/proc/26937/stat : 26937 (clasp) R 26935 26935 26437 0 -1 4202496 23272 0 0 0 496241 6 0 0 25 0 1 0 528736675 111869952 22324 33554432000 4194304 4785740 140737269749936 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26937/statm: 27312 22324 340 145 0 24357 0
[pid=26938] ppid=26935 vsize=465524 CPUtime=4961.99 cores=2
/proc/26938/stat : 26938 (TNM) R 26935 26935 26437 0 -1 4202496 3232 0 0 0 496197 2 0 0 25 0 1 0 528736675 476696576 3129 33554432000 134512640 134534564 4292280688 18446744073709551615 134530158 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26938/statm: 116381 3129 95 6 0 115047 0
[pid=26939] ppid=26935 vsize=63880 CPUtime=4962.47 cores=3
/proc/26939/stat : 26939 (march_hi) R 26935 26935 26437 0 -1 4202496 35195 0 0 0 496239 8 0 0 25 0 1 0 528736675 65413120 11418 33554432000 4194304 4331988 140734858024576 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26939/statm: 15970 11418 175 34 0 14412 0
[pid=26940] ppid=26935 vsize=416968 CPUtime=19820.7 cores=4-7
/proc/26940/stat : 26940 (plingeling) S 26935 26935 26437 0 -1 4202496 1925402 1256 0 0 1981772 293 0 0 20 0 5 0 528736675 426975232 76315 33554432000 4194304 4356188 140735292210192 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26940/statm: 104242 76315 162 40 0 102786 0
[pid=26940/tid=26947] ppid=26935 vsize=416968 CPUtime=4962.18 cores=4-7
/proc/26940/task/26947/stat : 26947 (plingeling) R 26935 26935 26437 0 -1 4202560 472042 1256 0 0 496151 67 0 0 25 0 5 0 528736690 426975232 76315 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26940/tid=26948] ppid=26935 vsize=416968 CPUtime=4961.37 cores=4-7
/proc/26940/task/26948/stat : 26948 (plingeling) R 26935 26935 26437 0 -1 4202560 448232 1256 0 0 496067 70 0 0 25 0 5 0 528736690 426975232 76315 33554432000 4194304 4356188 140735292210192 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26940/tid=26949] ppid=26935 vsize=416968 CPUtime=4961.67 cores=4-7
/proc/26940/task/26949/stat : 26949 (plingeling) R 26935 26935 26437 0 -1 4202560 491267 1256 0 0 496088 79 0 0 25 0 5 0 528736690 426975232 76315 33554432000 4194304 4356188 140735292210192 18446744073709551615 4332037 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26940/tid=26950] ppid=26935 vsize=416968 CPUtime=4935.25 cores=4-7
/proc/26940/task/26950/stat : 26950 (plingeling) R 26935 26935 26437 0 -1 4202560 505192 1256 0 0 493451 74 0 0 25 0 5 0 528736690 426975232 76315 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39670.1
Current children cumulated vsize (KiB) 1199132



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.6 s]
/proc/loadavg: 8.00 8.02 8.00 9/180 27108
/proc/meminfo: memFree=29933104/32951124 swapFree=67111416/67111528
[pid=26935] ppid=26933 vsize=18324 CPUtime=0 cores=0-7
/proc/26935/stat : 26935 (ppfolio) S 26933 26935 26437 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 528736675 18763776 390 33554432000 4194304 4287625 140735286554800 18446744073709551615 212436037135 0 0 4096 65536 4579123985865768959 0 0 17 6 0 0 0
/proc/26935/statm: 4581 390 341 23 0 91 0
[pid=26936] ppid=26935 vsize=217580 CPUtime=5003.77 cores=0
/proc/26936/stat : 26936 (cryptominisat) R 26935 26935 26437 0 -1 4202496 473769 0 0 0 500210 167 0 0 25 0 1 0 528736675 222801920 29035 33554432000 4194304 4587354 140736120066208 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26936/statm: 54395 29035 337 96 0 50957 0
[pid=26937] ppid=26935 vsize=109888 CPUtime=5003.77 cores=1
/proc/26937/stat : 26937 (clasp) R 26935 26935 26437 0 -1 4202496 23435 0 0 0 500371 6 0 0 25 0 1 0 528736675 112525312 22487 33554432000 4194304 4785740 140737269749936 18446744073709551615 212435714674 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26937/statm: 27472 22487 340 145 0 24517 0
[pid=26938] ppid=26935 vsize=465524 CPUtime=5003.29 cores=2
/proc/26938/stat : 26938 (TNM) R 26935 26935 26437 0 -1 4202496 3232 0 0 0 500327 2 0 0 25 0 1 0 528736675 476696576 3129 33554432000 134512640 134534564 4292280688 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26938/statm: 116381 3129 95 6 0 115047 0
[pid=26939] ppid=26935 vsize=63880 CPUtime=5003.77 cores=3
/proc/26939/stat : 26939 (march_hi) R 26935 26935 26437 0 -1 4202496 35226 0 0 0 500369 8 0 0 25 0 1 0 528736675 65413120 11449 33554432000 4194304 4331988 140734858024576 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26939/statm: 15970 11449 175 34 0 14412 0
[pid=26940] ppid=26935 vsize=411840 CPUtime=19985.6 cores=4-7
/proc/26940/stat : 26940 (plingeling) S 26935 26935 26437 0 -1 4202496 1932666 1256 0 0 1998270 294 0 0 20 0 5 0 528736675 421724160 75033 33554432000 4194304 4356188 140735292210192 18446744073709551615 212447819749 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26940/statm: 102960 75033 162 40 0 101504 0
[pid=26940/tid=26947] ppid=26935 vsize=411840 CPUtime=5003.5 cores=4-7
/proc/26940/task/26947/stat : 26947 (plingeling) R 26935 26935 26437 0 -1 4202560 472298 1256 0 0 500282 68 0 0 25 0 5 0 528736690 421724160 75033 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26940/tid=26948] ppid=26935 vsize=411840 CPUtime=5002.67 cores=4-7
/proc/26940/task/26948/stat : 26948 (plingeling) R 26935 26935 26437 0 -1 4202560 450920 1256 0 0 500197 70 0 0 25 0 5 0 528736690 421724160 75033 33554432000 4194304 4356188 140735292210192 18446744073709551615 4330992 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26940/tid=26949] ppid=26935 vsize=411840 CPUtime=5002.97 cores=4-7
/proc/26940/task/26949/stat : 26949 (plingeling) R 26935 26935 26437 0 -1 4202560 493539 1256 0 0 500218 79 0 0 25 0 5 0 528736690 421724160 75033 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26940/tid=26950] ppid=26935 vsize=411840 CPUtime=4976.33 cores=4-7
/proc/26940/task/26950/stat : 26950 (plingeling) R 26935 26935 26437 0 -1 4202560 507240 1256 0 0 497559 74 0 0 25 0 5 0 528736690 421724160 75033 33554432000 4194304 4356188 140735292210192 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 1287036

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26935 and gives
#  childrusage.ru_utime.tv_sec=20012
#  childrusage.ru_utime.tv_usec=800591
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=869715
# CPU time returned by wait4() is 20014.7
# while last known CPU time is 40000.2
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.62
CPU time (s): 40000.2
CPU user time (s): 39995.5
CPU system time (s): 4.77
CPU usage (%): 799.427
Max. virtual memory (cumulated for all children) (KiB): 9479432

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20012.8
system time used= 1.86972
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 536200
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 576
involuntary context switches= 41588

runsolver used 7.98179 second user time and 19.3191 second system time

The end

Launcher Data 

Begin job on node102 at 2011-04-30 15:49:03
IDJOB=3275866
IDBENCH=83909
IDSOLVER=1638
FILE ID=node102/3275866-1304171343
RUNJOBID= node102-1304161221-26451
PBS_JOBID= 13170930
Free space on /tmp= 72468 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_50_30_20_1-log.shuffled-as.sat03-107.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275866-1304171343/watcher-3275866-1304171343 -o /tmp/evaluation-result-3275866-1304171343/solver-3275866-1304171343 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275866-1304171343.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 5f29341b29f4bbeb333d68befe08c7ae
RANDOM SEED=1051756025

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30495760 kB
Buffers:        630776 kB
Cached:        1342792 kB
SwapCached:          0 kB
Active:         200492 kB
Inactive:      1837036 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30495760 kB
SwapTotal:    67111528 kB
SwapFree:     67111416 kB
Dirty:           12048 kB
Writeback:           0 kB
AnonPages:       63568 kB
Mapped:          14708 kB
Slab:           352008 kB
PageTables:       4284 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   186672 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72456 MiB
End job on node102 at 2011-04-30 17:12:29