Trace number 3275251

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.6 5003.62

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n160-s73223945-unsat.cnf
MD5SUMebbfc0ffb6aa4fcba0d5ce3964018543
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables161
Number of clauses332
Sum of the clauses size996
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3332
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275251-1304166026/watcher-3275251-1304166026 -o /tmp/evaluation-result-3275251-1304166026/solver-3275251-1304166026 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275251-1304166026.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.08 8.03 8.01 2/170 29148
/proc/meminfo: memFree=30487880/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0

[startup+0.022191 s]
/proc/loadavg: 8.08 8.03 8.01 2/170 29148
/proc/meminfo: memFree=30487880/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 21 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.911042 s]
/proc/loadavg: 8.08 8.03 8.01 2/170 29148
/proc/meminfo: memFree=30487880/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 20 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.00103 s]
/proc/loadavg: 8.08 8.03 8.01 2/170 29148
/proc/meminfo: memFree=30487880/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 19 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.10101 s]
/proc/loadavg: 8.08 8.03 8.01 2/170 29148
/proc/meminfo: memFree=30487880/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 18 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50093 s]
/proc/loadavg: 8.08 8.03 8.01 2/170 29148
/proc/meminfo: memFree=30487880/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10064 s]
/proc/loadavg: 8.07 8.03 8.00 9/180 29163
/proc/meminfo: memFree=30452672/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
[pid=29149] ppid=29148 vsize=9118736 CPUtime=3.09 cores=0
/proc/29149/stat : 29149 (cryptominisat) R 29148 29148 28844 0 -1 4202496 6278 0 0 0 309 0 0 0 25 0 1 0 606833159 9337585664 3379 33554432000 4194304 4587354 140737229615712 18446744073709551615 4238431 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29149/statm: 2279684 3379 337 96 0 2276246 0
[pid=29150] ppid=29148 vsize=12956 CPUtime=3.09 cores=1
/proc/29150/stat : 29150 (clasp) R 29148 29148 28844 0 -1 4202496 708 0 0 0 309 0 0 0 25 0 1 0 606833159 13266944 600 33554432000 4194304 4785740 140734893644256 18446744073709551615 4552970 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29150/statm: 3239 600 340 145 0 284 0
[pid=29151] ppid=29148 vsize=455696 CPUtime=3.09 cores=2
/proc/29151/stat : 29151 (TNM) R 29148 29148 28844 0 -1 4202496 270 0 0 0 309 0 0 0 25 0 1 0 606833159 466632704 167 33554432000 134512640 134534564 4292118512 18446744073709551615 134528972 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29151/statm: 113924 167 95 6 0 112590 0
[pid=29152] ppid=29148 vsize=9328 CPUtime=3.09 cores=3
/proc/29152/stat : 29152 (march_hi) R 29148 29148 28844 0 -1 4202496 970 0 0 0 309 0 0 0 25 0 1 0 606833159 9551872 863 33554432000 4194304 4331988 140737237957856 18446744073709551615 4229806 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29152/statm: 2332 863 173 34 0 774 0
[pid=29153] ppid=29148 vsize=129176 CPUtime=12.34 cores=4-7
/proc/29153/stat : 29153 (plingeling) S 29148 29148 28844 0 -1 4202496 7036 1250 0 0 1233 1 0 0 20 0 5 0 606833159 132276224 4471 33554432000 4194304 4356188 140736001704512 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/29153/statm: 32294 4471 163 40 0 30838 0
[pid=29153/tid=29160] ppid=29148 vsize=129176 CPUtime=3.08 cores=4-7
/proc/29153/task/29160/stat : 29160 (plingeling) R 29148 29148 28844 0 -1 4202560 1728 1250 0 0 308 0 0 0 25 0 5 0 606833160 132276224 4471 33554432000 4194304 4356188 140736001704512 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29153/tid=29161] ppid=29148 vsize=129176 CPUtime=3.08 cores=4-7
/proc/29153/task/29161/stat : 29161 (plingeling) R 29148 29148 28844 0 -1 4202560 1616 1250 0 0 308 0 0 0 25 0 5 0 606833160 132276224 4471 33554432000 4194304 4356188 140736001704512 18446744073709551615 4330982 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29153/tid=29162] ppid=29148 vsize=129176 CPUtime=3.07 cores=4-7
/proc/29153/task/29162/stat : 29162 (plingeling) R 29148 29148 28844 0 -1 4202560 1726 1250 0 0 307 0 0 0 25 0 5 0 606833160 132276224 4471 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331340 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29153/tid=29163] ppid=29148 vsize=129176 CPUtime=3.08 cores=4-7
/proc/29153/task/29163/stat : 29163 (plingeling) R 29148 29148 28844 0 -1 4202560 1636 1250 0 0 308 0 0 0 25 0 5 0 606833160 132276224 4471 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.7
Current children cumulated vsize (KiB) 9744216

[startup+6.30705 s]
/proc/loadavg: 8.07 8.03 8.00 9/180 29164
/proc/meminfo: memFree=30441016/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
[pid=29149] ppid=29148 vsize=9119024 CPUtime=6.29 cores=0
/proc/29149/stat : 29149 (cryptominisat) R 29148 29148 28844 0 -1 4202496 9136 0 0 0 629 0 0 0 25 0 1 0 606833159 9337880576 3784 33554432000 4194304 4587354 140737229615712 18446744073709551615 4238571 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29149/statm: 2279756 3784 337 96 0 2276318 0
[pid=29150] ppid=29148 vsize=13352 CPUtime=6.3 cores=1
/proc/29150/stat : 29150 (clasp) R 29148 29148 28844 0 -1 4202496 781 0 0 0 630 0 0 0 25 0 1 0 606833159 13672448 673 33554432000 4194304 4785740 140734893644256 18446744073709551615 4560576 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29150/statm: 3338 673 340 145 0 383 0
[pid=29151] ppid=29148 vsize=455696 CPUtime=6.3 cores=2
/proc/29151/stat : 29151 (TNM) R 29148 29148 28844 0 -1 4202496 270 0 0 0 630 0 0 0 25 0 1 0 606833159 466632704 167 33554432000 134512640 134534564 4292118512 18446744073709551615 5749760 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29151/statm: 113924 167 95 6 0 112590 0
[pid=29152] ppid=29148 vsize=12364 CPUtime=6.29 cores=3
/proc/29152/stat : 29152 (march_hi) R 29148 29148 28844 0 -1 4202496 1543 0 0 0 629 0 0 0 25 0 1 0 606833159 12660736 1436 33554432000 4194304 4331988 140737237957856 18446744073709551615 4229357 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29152/statm: 3091 1436 173 34 0 1533 0
[pid=29153] ppid=29148 vsize=138276 CPUtime=25.15 cores=4-7
/proc/29153/stat : 29153 (plingeling) S 29148 29148 28844 0 -1 4202496 13023 1250 0 0 2513 2 0 0 20 0 5 0 606833159 141594624 6746 33554432000 4194304 4356188 140736001704512 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/29153/statm: 34569 6746 163 40 0 33113 0
[pid=29153/tid=29160] ppid=29148 vsize=138276 CPUtime=6.29 cores=4-7
/proc/29153/task/29160/stat : 29160 (plingeling) R 29148 29148 28844 0 -1 4202560 3328 1250 0 0 629 0 0 0 25 0 5 0 606833160 141594624 6746 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331141 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29153/tid=29161] ppid=29148 vsize=138276 CPUtime=6.29 cores=4-7
/proc/29153/task/29161/stat : 29161 (plingeling) R 29148 29148 28844 0 -1 4202560 3282 1250 0 0 629 0 0 0 25 0 5 0 606833160 141594624 6746 33554432000 4194304 4356188 140736001704512 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29153/tid=29162] ppid=29148 vsize=138276 CPUtime=6.26 cores=4-7
/proc/29153/task/29162/stat : 29162 (plingeling) R 29148 29148 28844 0 -1 4202560 2687 1250 0 0 626 0 0 0 25 0 5 0 606833160 141594624 6746 33554432000 4194304 4356188 140736001704512 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29153/tid=29163] ppid=29148 vsize=138276 CPUtime=6.28 cores=4-7
/proc/29153/task/29163/stat : 29163 (plingeling) R 29148 29148 28844 0 -1 4202560 3396 1250 0 0 628 0 0 0 25 0 5 0 606833160 141594624 6746 33554432000 4194304 4356188 140736001704512 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.33
Current children cumulated vsize (KiB) 9757036

[startup+12.7009 s]
/proc/loadavg: 8.06 8.03 8.00 9/180 29164
/proc/meminfo: memFree=30428268/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
[pid=29149] ppid=29148 vsize=1192556 CPUtime=12.68 cores=0
/proc/29149/stat : 29149 (cryptominisat) R 29148 29148 28844 0 -1 4202496 14706 0 0 0 1267 1 0 0 25 0 1 0 606833159 1221177344 5255 33554432000 4194304 4587354 140737229615712 18446744073709551615 4238752 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29149/statm: 298139 5255 337 96 0 294701 0
[pid=29150] ppid=29148 vsize=13620 CPUtime=12.69 cores=1
/proc/29150/stat : 29150 (clasp) R 29148 29148 28844 0 -1 4202496 867 0 0 0 1269 0 0 0 25 0 1 0 606833159 13946880 759 33554432000 4194304 4785740 140734893644256 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29150/statm: 3405 759 340 145 0 450 0
[pid=29151] ppid=29148 vsize=455696 CPUtime=12.69 cores=2
/proc/29151/stat : 29151 (TNM) R 29148 29148 28844 0 -1 4202496 270 0 0 0 1269 0 0 0 25 0 1 0 606833159 466632704 167 33554432000 134512640 134534564 4292118512 18446744073709551615 134528888 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29151/statm: 113924 167 95 6 0 112590 0
[pid=29152] ppid=29148 vsize=19152 CPUtime=12.68 cores=3
/proc/29152/stat : 29152 (march_hi) R 29148 29148 28844 0 -1 4202496 2669 0 0 0 1268 0 0 0 25 0 1 0 606833159 19611648 2562 33554432000 4194304 4331988 140737237957856 18446744073709551615 260019790887 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29152/statm: 4788 2562 173 34 0 3230 0
[pid=29153] ppid=29148 vsize=143056 CPUtime=50.69 cores=4-7
/proc/29153/stat : 29153 (plingeling) S 29148 29148 28844 0 -1 4202496 20450 1250 0 0 5065 4 0 0 20 0 5 0 606833159 146489344 7941 33554432000 4194304 4356188 140736001704512 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/29153/statm: 35764 7941 163 40 0 34308 0
[pid=29153/tid=29160] ppid=29148 vsize=143056 CPUtime=12.69 cores=4-7
/proc/29153/task/29160/stat : 29160 (plingeling) R 29148 29148 28844 0 -1 4202560 4992 1250 0 0 1268 1 0 0 25 0 5 0 606833160 146489344 7941 33554432000 4194304 4356188 140736001704512 18446744073709551615 4298380 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29153/tid=29161] ppid=29148 vsize=143056 CPUtime=12.68 cores=4-7
/proc/29153/task/29161/stat : 29161 (plingeling) R 29148 29148 28844 0 -1 4202560 4979 1250 0 0 1268 0 0 0 25 0 5 0 606833160 146489344 7941 33554432000 4194304 4356188 140736001704512 18446744073709551615 4282013 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29153/tid=29162] ppid=29148 vsize=143056 CPUtime=12.62 cores=4-7
/proc/29153/task/29162/stat : 29162 (plingeling) R 29148 29148 28844 0 -1 4202560 4864 1250 0 0 1262 0 0 0 25 0 5 0 606833160 146489344 7941 33554432000 4194304 4356188 140736001704512 18446744073709551615 4283920 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29153/tid=29163] ppid=29148 vsize=143056 CPUtime=12.68 cores=4-7
/proc/29153/task/29163/stat : 29163 (plingeling) R 29148 29148 28844 0 -1 4202560 5285 1250 0 0 1267 1 0 0 25 0 5 0 606833160 146489344 7941 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.43
Current children cumulated vsize (KiB) 1842404

[startup+25.5005 s]
/proc/loadavg: 8.12 8.04 8.01 9/180 29164
/proc/meminfo: memFree=30401032/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
[pid=29149] ppid=29148 vsize=9136888 CPUtime=25.49 cores=0
/proc/29149/stat : 29149 (cryptominisat) R 29148 29148 28844 0 -1 4202496 23189 0 0 0 2546 3 0 0 25 0 1 0 606833159 9356173312 7842 33554432000 4194304 4587354 140737229615712 18446744073709551615 4245472 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29149/statm: 2284222 7842 337 96 0 2280784 0
[pid=29150] ppid=29148 vsize=14152 CPUtime=25.49 cores=1
/proc/29150/stat : 29150 (clasp) R 29148 29148 28844 0 -1 4202496 988 0 0 0 2549 0 0 0 25 0 1 0 606833159 14491648 880 33554432000 4194304 4785740 140734893644256 18446744073709551615 4287058 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29150/statm: 3538 880 340 145 0 583 0
[pid=29151] ppid=29148 vsize=455696 CPUtime=25.49 cores=2
/proc/29151/stat : 29151 (TNM) R 29148 29148 28844 0 -1 4202496 270 0 0 0 2549 0 0 0 25 0 1 0 606833159 466632704 167 33554432000 134512640 134534564 4292118512 18446744073709551615 134530796 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29151/statm: 113924 167 95 6 0 112590 0
[pid=29152] ppid=29148 vsize=25608 CPUtime=25.49 cores=3
/proc/29152/stat : 29152 (march_hi) R 29148 29148 28844 0 -1 4202496 4915 0 0 0 2548 1 0 0 25 0 1 0 606833159 26222592 4808 33554432000 4194304 4331988 140737237957856 18446744073709551615 260019791244 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29152/statm: 6402 4808 173 34 0 4844 0
[pid=29153] ppid=29148 vsize=151120 CPUtime=101.82 cores=4-7
/proc/29153/stat : 29153 (plingeling) S 29148 29148 28844 0 -1 4202496 32610 1250 0 0 10175 7 0 0 20 0 5 0 606833159 154746880 9957 33554432000 4194304 4356188 140736001704512 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/29153/statm: 37780 9957 163 40 0 36324 0
[pid=29153/tid=29160] ppid=29148 vsize=151120 CPUtime=25.48 cores=4-7
/proc/29153/task/29160/stat : 29160 (plingeling) R 29148 29148 28844 0 -1 4202560 7520 1250 0 0 2547 1 0 0 25 0 5 0 606833160 154746880 9957 33554432000 4194304 4356188 140736001704512 18446744073709551615 4280845 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29153/tid=29161] ppid=29148 vsize=151120 CPUtime=25.49 cores=4-7
/proc/29153/task/29161/stat : 29161 (plingeling) R 29148 29148 28844 0 -1 4202560 7891 1250 0 0 2548 1 0 0 25 0 5 0 606833160 154746880 9957 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331337 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29153/tid=29162] ppid=29148 vsize=151120 CPUtime=25.35 cores=4-7
/proc/29153/task/29162/stat : 29162 (plingeling) R 29148 29148 28844 0 -1 4202560 7616 1250 0 0 2534 1 0 0 25 0 5 0 606833160 154746880 9957 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29153/tid=29163] ppid=29148 vsize=151120 CPUtime=25.48 cores=4-7
/proc/29153/task/29163/stat : 29163 (plingeling) R 29148 29148 28844 0 -1 4202560 9253 1250 0 0 2546 2 0 0 25 0 5 0 606833160 154746880 9957 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.78
Current children cumulated vsize (KiB) 9801788

################
# More data... #
################

[pid=29151] ppid=29148 vsize=455700 CPUtime=4782.42 cores=2
/proc/29151/stat : 29151 (TNM) R 29148 29148 28844 0 -1 4202496 279 0 0 0 478240 2 0 0 25 0 1 0 606833159 466636800 176 33554432000 134512640 134534564 4292118512 18446744073709551615 134528988 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29151/statm: 113925 176 103 6 0 112591 0
[pid=29152] ppid=29148 vsize=3731260 CPUtime=4782.44 cores=3
/proc/29152/stat : 29152 (march_hi) R 29148 29148 28844 0 -1 4202496 812813 0 0 0 477973 271 0 0 25 0 1 0 606833159 3820810240 812706 33554432000 4194304 4331988 140737237957856 18446744073709551615 260019790864 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29152/statm: 932815 812706 173 34 0 931257 0
[pid=29153] ppid=29148 vsize=386696 CPUtime=19101.7 cores=4-7
/proc/29153/stat : 29153 (plingeling) S 29148 29148 28844 0 -1 4202496 1552951 1250 0 0 1909942 225 0 0 20 0 5 0 606833159 395976704 68802 33554432000 4194304 4356188 140736001704512 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/29153/statm: 96674 68802 163 40 0 95218 0
[pid=29153/tid=29160] ppid=29148 vsize=386696 CPUtime=4782.43 cores=4-7
/proc/29153/task/29160/stat : 29160 (plingeling) R 29148 29148 28844 0 -1 4202560 358436 1250 0 0 478194 49 0 0 25 0 5 0 606833160 395976704 68802 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29153/tid=29161] ppid=29148 vsize=386696 CPUtime=4782.43 cores=4-7
/proc/29153/task/29161/stat : 29161 (plingeling) R 29148 29148 28844 0 -1 4202560 409654 1250 0 0 478180 63 0 0 25 0 5 0 606833160 395976704 68802 33554432000 4194304 4356188 140736001704512 18446744073709551615 4332003 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29153/tid=29162] ppid=29148 vsize=386696 CPUtime=4756.37 cores=4-7
/proc/29153/task/29162/stat : 29162 (plingeling) R 29148 29148 28844 0 -1 4202560 404515 1250 0 0 475584 53 0 0 25 0 5 0 606833160 395976704 68802 33554432000 4194304 4356188 140736001704512 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29153/tid=29163] ppid=29148 vsize=386696 CPUtime=4780.41 cores=4-7
/proc/29153/task/29163/stat : 29163 (plingeling) R 29148 29148 28844 0 -1 4202560 380016 1250 0 0 477982 59 0 0 25 0 5 0 606833160 395976704 68802 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38231.2
Current children cumulated vsize (KiB) 5929088

[startup+4842.3 s]
/proc/loadavg: 8.06 8.09 8.02 9/180 29308
/proc/meminfo: memFree=26765104/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
[pid=29149] ppid=29148 vsize=1340960 CPUtime=4842.43 cores=0
/proc/29149/stat : 29149 (cryptominisat) R 29148 29148 28844 0 -1 4202496 509609 0 0 0 484076 167 0 0 25 0 1 0 606833159 1373143040 38296 33554432000 4194304 4587354 140737229615712 18446744073709551615 4238755 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29149/statm: 335240 38296 337 96 0 331802 0
[pid=29150] ppid=29148 vsize=16292 CPUtime=4842.29 cores=1
/proc/29150/stat : 29150 (clasp) R 29148 29148 28844 0 -1 4202496 1530 0 0 0 484229 0 0 0 25 0 1 0 606833159 16683008 1422 33554432000 4194304 4785740 140734893644256 18446744073709551615 4553369 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29150/statm: 4073 1422 344 145 0 1118 0
[pid=29151] ppid=29148 vsize=455700 CPUtime=4842.42 cores=2
/proc/29151/stat : 29151 (TNM) R 29148 29148 28844 0 -1 4202496 279 0 0 0 484240 2 0 0 25 0 1 0 606833159 466636800 176 33554432000 134512640 134534564 4292118512 18446744073709551615 134530641 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29151/statm: 113925 176 103 6 0 112591 0
[pid=29152] ppid=29148 vsize=3731260 CPUtime=4842.44 cores=3
/proc/29152/stat : 29152 (march_hi) R 29148 29148 28844 0 -1 4202496 822888 0 0 0 483969 275 0 0 25 0 1 0 606833159 3820810240 822781 33554432000 4194304 4331988 140737237957856 18446744073709551615 4229294 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29152/statm: 932815 822781 173 34 0 931257 0
[pid=29153] ppid=29148 vsize=382216 CPUtime=19341.3 cores=4-7
/proc/29153/stat : 29153 (plingeling) S 29148 29148 28844 0 -1 4202496 1566103 1250 0 0 1933907 227 0 0 20 0 5 0 606833159 391389184 67682 33554432000 4194304 4356188 140736001704512 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/29153/statm: 95554 67682 163 40 0 94098 0
[pid=29153/tid=29160] ppid=29148 vsize=382216 CPUtime=4842.44 cores=4-7
/proc/29153/task/29160/stat : 29160 (plingeling) R 29148 29148 28844 0 -1 4202560 365668 1250 0 0 484194 50 0 0 25 0 5 0 606833160 391389184 67682 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29153/tid=29161] ppid=29148 vsize=382216 CPUtime=4842.43 cores=4-7
/proc/29153/task/29161/stat : 29161 (plingeling) R 29148 29148 28844 0 -1 4202560 411446 1250 0 0 484180 63 0 0 25 0 5 0 606833160 391389184 67682 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29153/tid=29162] ppid=29148 vsize=382216 CPUtime=4816.03 cores=4-7
/proc/29153/task/29162/stat : 29162 (plingeling) R 29148 29148 28844 0 -1 4202560 407491 1250 0 0 481550 53 0 0 25 0 5 0 606833160 391389184 67682 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29153/tid=29163] ppid=29148 vsize=382216 CPUtime=4840.4 cores=4-7
/proc/29153/task/29163/stat : 29163 (plingeling) R 29148 29148 28844 0 -1 4202560 381168 1250 0 0 483981 59 0 0 25 0 5 0 606833160 391389184 67682 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38710.9
Current children cumulated vsize (KiB) 5944752

[startup+4902.3 s]
/proc/loadavg: 8.02 8.07 8.01 9/180 29309
/proc/meminfo: memFree=26750036/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
[pid=29149] ppid=29148 vsize=1320816 CPUtime=4902.44 cores=0
/proc/29149/stat : 29149 (cryptominisat) R 29148 29148 28844 0 -1 4202496 511752 0 0 0 490074 170 0 0 25 0 1 0 606833159 1352515584 38567 33554432000 4194304 4587354 140737229615712 18446744073709551615 4238392 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29149/statm: 330204 38567 337 96 0 326766 0
[pid=29150] ppid=29148 vsize=16292 CPUtime=4902.3 cores=1
/proc/29150/stat : 29150 (clasp) R 29148 29148 28844 0 -1 4202496 1530 0 0 0 490230 0 0 0 25 0 1 0 606833159 16683008 1422 33554432000 4194304 4785740 140734893644256 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29150/statm: 4073 1422 344 145 0 1118 0
[pid=29151] ppid=29148 vsize=455700 CPUtime=4902.43 cores=2
/proc/29151/stat : 29151 (TNM) R 29148 29148 28844 0 -1 4202496 279 0 0 0 490241 2 0 0 25 0 1 0 606833159 466636800 176 33554432000 134512640 134534564 4292118512 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29151/statm: 113925 176 103 6 0 112591 0
[pid=29152] ppid=29148 vsize=3731260 CPUtime=4902.44 cores=3
/proc/29152/stat : 29152 (march_hi) R 29148 29148 28844 0 -1 4202496 832919 0 0 0 489965 279 0 0 25 0 1 0 606833159 3820810240 832812 33554432000 4194304 4331988 140737237957856 18446744073709551615 4211509 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29152/statm: 932815 832812 173 34 0 931257 0
[pid=29153] ppid=29148 vsize=353288 CPUtime=19581 cores=4-7
/proc/29153/stat : 29153 (plingeling) S 29148 29148 28844 0 -1 4202496 1579991 1250 0 0 1957874 229 0 0 20 0 5 0 606833159 361766912 60450 33554432000 4194304 4356188 140736001704512 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/29153/statm: 88322 60450 163 40 0 86866 0
[pid=29153/tid=29160] ppid=29148 vsize=353288 CPUtime=4902.44 cores=4-7
/proc/29153/task/29160/stat : 29160 (plingeling) R 29148 29148 28844 0 -1 4202560 367044 1250 0 0 490194 50 0 0 25 0 5 0 606833160 361766912 60450 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29153/tid=29161] ppid=29148 vsize=353288 CPUtime=4902.44 cores=4-7
/proc/29153/task/29161/stat : 29161 (plingeling) R 29148 29148 28844 0 -1 4202560 414134 1250 0 0 490180 64 0 0 25 0 5 0 606833160 361766912 60450 33554432000 4194304 4356188 140736001704512 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29153/tid=29162] ppid=29148 vsize=353288 CPUtime=4875.71 cores=4-7
/proc/29153/task/29162/stat : 29162 (plingeling) R 29148 29148 28844 0 -1 4202560 414563 1250 0 0 487517 54 0 0 25 0 5 0 606833160 361766912 60450 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29153/tid=29163] ppid=29148 vsize=353288 CPUtime=4900.41 cores=4-7
/proc/29153/task/29163/stat : 29163 (plingeling) R 29148 29148 28844 0 -1 4202560 383920 1250 0 0 489981 60 0 0 25 0 5 0 606833160 361766912 60450 33554432000 4194304 4356188 140736001704512 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39190.6
Current children cumulated vsize (KiB) 5895680

[startup+4962.3 s]
/proc/loadavg: 8.01 8.06 8.01 9/180 29311
/proc/meminfo: memFree=26672808/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
[pid=29149] ppid=29148 vsize=1363588 CPUtime=4962.43 cores=0
/proc/29149/stat : 29149 (cryptominisat) R 29148 29148 28844 0 -1 4202496 519371 0 0 0 496070 173 0 0 25 0 1 0 606833159 1396314112 44468 33554432000 4194304 4587354 140737229615712 18446744073709551615 4231911 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29149/statm: 340897 44468 337 96 0 337459 0
[pid=29150] ppid=29148 vsize=16292 CPUtime=4962.3 cores=1
/proc/29150/stat : 29150 (clasp) R 29148 29148 28844 0 -1 4202496 1530 0 0 0 496230 0 0 0 25 0 1 0 606833159 16683008 1422 33554432000 4194304 4785740 140734893644256 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29150/statm: 4073 1422 344 145 0 1118 0
[pid=29151] ppid=29148 vsize=455700 CPUtime=4962.43 cores=2
/proc/29151/stat : 29151 (TNM) R 29148 29148 28844 0 -1 4202496 279 0 0 0 496241 2 0 0 25 0 1 0 606833159 466636800 176 33554432000 134512640 134534564 4292118512 18446744073709551615 134528934 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29151/statm: 113925 176 103 6 0 112591 0
[pid=29152] ppid=29148 vsize=3731260 CPUtime=4962.45 cores=3
/proc/29152/stat : 29152 (march_hi) R 29148 29148 28844 0 -1 4202496 843033 0 0 0 495962 283 0 0 25 0 1 0 606833159 3820810240 842926 33554432000 4194304 4331988 140737237957856 18446744073709551615 4211487 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29152/statm: 932815 842926 173 34 0 931257 0
[pid=29153] ppid=29148 vsize=367368 CPUtime=19820.7 cores=4-7
/proc/29153/stat : 29153 (plingeling) S 29148 29148 28844 0 -1 4202496 1604535 1250 0 0 1981835 234 0 0 20 0 5 0 606833159 376184832 63970 33554432000 4194304 4356188 140736001704512 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/29153/statm: 91842 63970 163 40 0 90386 0
[pid=29153/tid=29160] ppid=29148 vsize=367368 CPUtime=4962.44 cores=4-7
/proc/29153/task/29160/stat : 29160 (plingeling) R 29148 29148 28844 0 -1 4202560 369220 1250 0 0 496194 50 0 0 25 0 5 0 606833160 376184832 63970 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29153/tid=29161] ppid=29148 vsize=367368 CPUtime=4962.43 cores=4-7
/proc/29153/task/29161/stat : 29161 (plingeling) R 29148 29148 28844 0 -1 4202560 425462 1250 0 0 496177 66 0 0 25 0 5 0 606833160 376184832 63970 33554432000 4194304 4356188 140736001704512 18446744073709551615 4332145 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29153/tid=29162] ppid=29148 vsize=367368 CPUtime=4935.39 cores=4-7
/proc/29153/task/29162/stat : 29162 (plingeling) R 29148 29148 28844 0 -1 4202560 418243 1250 0 0 493484 55 0 0 25 0 5 0 606833160 376184832 63970 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29153/tid=29163] ppid=29148 vsize=367368 CPUtime=4960.39 cores=4-7
/proc/29153/task/29163/stat : 29163 (plingeling) R 29148 29148 28844 0 -1 4202560 391280 1250 0 0 495978 61 0 0 25 0 5 0 606833160 376184832 63970 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331019 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39670.3
Current children cumulated vsize (KiB) 5952532



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.61 s]
/proc/loadavg: 8.00 8.05 8.00 9/180 29312
/proc/meminfo: memFree=26634084/32951124 swapFree=67111464/67111528
[pid=29148] ppid=29146 vsize=18324 CPUtime=0 cores=0-7
/proc/29148/stat : 29148 (ppfolio) S 29146 29148 28844 0 -1 4202496 521 0 0 0 0 0 0 0 15 0 1 0 606833159 18763776 389 33554432000 4194304 4287625 140733534589760 18446744073709551615 260020416015 0 0 4096 65536 4417687778800697343 0 0 17 6 0 0 0
/proc/29148/statm: 4581 389 341 23 0 91 0
[pid=29149] ppid=29148 vsize=1343444 CPUtime=5003.75 cores=0
/proc/29149/stat : 29149 (cryptominisat) R 29148 29148 28844 0 -1 4202496 520516 0 0 0 500201 174 0 0 25 0 1 0 606833159 1375686656 44095 33554432000 4194304 4587354 140737229615712 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/29149/statm: 335861 44095 337 96 0 332423 0
[pid=29150] ppid=29148 vsize=16292 CPUtime=5003.61 cores=1
/proc/29150/stat : 29150 (clasp) R 29148 29148 28844 0 -1 4202496 1530 0 0 0 500361 0 0 0 25 0 1 0 606833159 16683008 1422 33554432000 4194304 4785740 140734893644256 18446744073709551615 4553440 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/29150/statm: 4073 1422 344 145 0 1118 0
[pid=29151] ppid=29148 vsize=455700 CPUtime=5003.74 cores=2
/proc/29151/stat : 29151 (TNM) R 29148 29148 28844 0 -1 4202496 279 0 0 0 500372 2 0 0 25 0 1 0 606833159 466636800 176 33554432000 134512640 134534564 4292118512 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29151/statm: 113925 176 103 6 0 112591 0
[pid=29152] ppid=29148 vsize=3731260 CPUtime=5003.75 cores=3
/proc/29152/stat : 29152 (march_hi) R 29148 29148 28844 0 -1 4202496 850059 0 0 0 500090 285 0 0 25 0 1 0 606833159 3820810240 849952 33554432000 4194304 4331988 140737237957856 18446744073709551615 4229363 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/29152/statm: 932815 849952 173 34 0 931257 0
[pid=29153] ppid=29148 vsize=378248 CPUtime=19985.7 cores=4-7
/proc/29153/stat : 29153 (plingeling) S 29148 29148 28844 0 -1 4202496 1614519 1250 0 0 1998335 235 0 0 20 0 5 0 606833159 387325952 66690 33554432000 4194304 4356188 140736001704512 18446744073709551615 260032198629 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/29153/statm: 94562 66690 163 40 0 93106 0
[pid=29153/tid=29160] ppid=29148 vsize=378248 CPUtime=5003.75 cores=4-7
/proc/29153/task/29160/stat : 29160 (plingeling) R 29148 29148 28844 0 -1 4202560 372100 1250 0 0 500325 50 0 0 25 0 5 0 606833160 387325952 66690 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331326 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=29153/tid=29161] ppid=29148 vsize=378248 CPUtime=5003.75 cores=4-7
/proc/29153/task/29161/stat : 29161 (plingeling) R 29148 29148 28844 0 -1 4202560 429174 1250 0 0 500308 67 0 0 25 0 5 0 606833160 387325952 66690 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331002 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29153/tid=29162] ppid=29148 vsize=378248 CPUtime=4976.47 cores=4-7
/proc/29153/task/29162/stat : 29162 (plingeling) R 29148 29148 28844 0 -1 4202560 418755 1250 0 0 497592 55 0 0 25 0 5 0 606833160 387325952 66690 33554432000 4194304 4356188 140736001704512 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29153/tid=29163] ppid=29148 vsize=378248 CPUtime=5001.71 cores=4-7
/proc/29153/task/29163/stat : 29163 (plingeling) R 29148 29148 28844 0 -1 4202560 394160 1250 0 0 500109 62 0 0 25 0 5 0 606833160 387325952 66690 33554432000 4194304 4356188 140736001704512 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 5943268

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29148 and gives
#  childrusage.ru_utime.tv_sec=15009
#  childrusage.ru_utime.tv_usec=357230
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=783728
# CPU time returned by wait4() is 15011.1
# while last known CPU time is 40000.6
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.62
CPU time (s): 40000.6
CPU user time (s): 39993.6
CPU system time (s): 6.96
CPU usage (%): 799.432
Max. virtual memory (cumulated for all children) (KiB): 21745668

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 15009.4
system time used= 1.78373
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 522862
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 750
involuntary context switches= 79620

runsolver used 8.16376 second user time and 19.1311 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-30 14:20:26
IDJOB=3275251
IDBENCH=83144
IDSOLVER=1638
FILE ID=node110/3275251-1304166026
RUNJOBID= node110-1304161023-28858
PBS_JOBID= 13170927
Free space on /tmp= 73476 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n160-s73223945-unsat.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275251-1304166026/watcher-3275251-1304166026 -o /tmp/evaluation-result-3275251-1304166026/solver-3275251-1304166026 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275251-1304166026.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ebbfc0ffb6aa4fcba0d5ce3964018543
RANDOM SEED=1486786921

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30488408 kB
Buffers:        993960 kB
Cached:         990348 kB
SwapCached:         64 kB
Active:         290568 kB
Inactive:      1757832 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30488408 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:           10104 kB
Writeback:           0 kB
AnonPages:       64112 kB
Mapped:          14704 kB
Slab:           348900 kB
PageTables:       4656 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   190016 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73464 MiB
End job on node110 at 2011-04-30 15:43:51