Trace number 3310323

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 35512 5100.02

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom17.cnf
MD5SUMa6df2ce216327c64a0156683acb72fc2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables32733
Number of clauses109177
Sum of the clauses size278009
Maximum clause length1080
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 256533
Number of clauses of size 352066
Number of clauses of size 4152
Number of clauses of size 515
Number of clauses of size over 5410

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310323-1304011134/watcher-3310323-1304011134 -o /tmp/evaluation-result-3310323-1304011134/solver-3310323-1304011134 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310323-1304011134.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.08 8.04 7.89 2/170 3263
/proc/meminfo: memFree=19598980/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 520 0 0 0 0 0 0 0 24 0 1 0 493529529 18763776 389 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 2826088480827 0 0 17 4 0 0 0
/proc/3263/statm: 4581 389 341 23 0 91 0

[startup+0.0610879 s]
/proc/loadavg: 8.08 8.04 7.89 2/170 3263
/proc/meminfo: memFree=19598980/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 25 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.101079 s]
/proc/loadavg: 8.08 8.04 7.89 2/170 3263
/proc/meminfo: memFree=19598980/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 25 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.301045 s]
/proc/loadavg: 8.08 8.04 7.89 2/170 3263
/proc/meminfo: memFree=19598980/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 25 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.700973 s]
/proc/loadavg: 8.08 8.04 7.89 2/170 3263
/proc/meminfo: memFree=19598980/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 25 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+1.50083 s]
/proc/loadavg: 8.08 8.04 7.89 8/179 3279
/proc/meminfo: memFree=19488176/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 16 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
[pid=3264] ppid=3263 vsize=54812 CPUtime=1.49 cores=0
/proc/3264/stat : 3264 (cryptominisat) R 3263 3263 3001 0 -1 4202496 9918 0 0 0 148 1 0 0 20 0 1 0 493529530 56127488 8620 33554432000 4194304 4587354 140734060182832 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3264/statm: 13703 8620 330 96 0 10265 0
[pid=3265] ppid=3263 vsize=31496 CPUtime=1.48 cores=1
/proc/3265/stat : 3265 (clasp) R 3263 3263 3001 0 -1 4202496 6618 0 0 0 148 0 0 0 20 0 1 0 493529530 32251904 5159 33554432000 4194304 4785740 140733200912336 18446744073709551615 4552974 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3265/statm: 7874 5159 340 145 0 4919 0
[pid=3267] ppid=3263 vsize=76744 CPUtime=1.49 cores=3
/proc/3267/stat : 3267 (march_hi) R 3263 3263 3001 0 -1 4202496 39544 0 0 0 143 6 0 0 20 0 1 0 493529530 78585856 9446 33554432000 4194304 4331988 140737154137472 18446744073709551615 4237192 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3267/statm: 19186 9446 175 34 0 17628 0
[pid=3268] ppid=3263 vsize=143948 CPUtime=4.19 cores=4-7
/proc/3268/stat : 3268 (plingeling) S 3263 3263 3001 0 -1 4202496 11179 1255 0 0 418 1 0 0 18 0 5 0 493529530 147402752 8046 33554432000 4194304 4356188 140733868978016 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3268/statm: 35987 8046 163 40 0 34531 0
[pid=3268/tid=3276] ppid=3263 vsize=143948 CPUtime=1.35 cores=4-7
/proc/3268/task/3276/stat : 3276 (plingeling) R 3263 3263 3001 0 -1 4202560 2464 1255 0 0 135 0 0 0 25 0 5 0 493529544 147402752 8046 33554432000 4194304 4356188 140733868978016 18446744073709551615 4231387 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3268/tid=3277] ppid=3263 vsize=143948 CPUtime=0.64 cores=4-7
/proc/3268/task/3277/stat : 3277 (plingeling) R 3263 3263 3001 0 -1 4202560 354 1255 0 0 64 0 0 0 22 0 5 0 493529544 147402752 8046 33554432000 4194304 4356188 140733868978016 18446744073709551615 4321975 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3278] ppid=3263 vsize=143948 CPUtime=0.7 cores=4-7
/proc/3268/task/3278/stat : 3278 (plingeling) R 3263 3263 3001 0 -1 4202560 279 1255 0 0 70 0 0 0 21 0 5 0 493529544 147402752 8046 33554432000 4194304 4356188 140733868978016 18446744073709551615 4212137 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3279] ppid=3263 vsize=143948 CPUtime=1.35 cores=4-7
/proc/3268/task/3279/stat : 3279 (plingeling) R 3263 3263 3001 0 -1 4202560 1488 1255 0 0 135 0 0 0 19 0 5 0 493529544 147402752 8046 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331960 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 8.66
Current children cumulated vsize (KiB) 325324

[startup+3.10055 s]
/proc/loadavg: 8.08 8.04 7.89 8/179 3279
/proc/meminfo: memFree=19461036/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 15 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
[pid=3264] ppid=3263 vsize=55080 CPUtime=3.09 cores=0
/proc/3264/stat : 3264 (cryptominisat) R 3263 3263 3001 0 -1 4202496 10492 0 0 0 308 1 0 0 25 0 1 0 493529530 56401920 9183 33554432000 4194304 4587354 140734060182832 18446744073709551615 4237704 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3264/statm: 13770 9183 330 96 0 10332 0
[pid=3265] ppid=3263 vsize=34804 CPUtime=3.09 cores=1
/proc/3265/stat : 3265 (clasp) R 3263 3263 3001 0 -1 4202496 7465 0 0 0 308 1 0 0 25 0 1 0 493529530 35639296 6006 33554432000 4194304 4785740 140733200912336 18446744073709551615 4553296 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3265/statm: 8701 6006 340 145 0 5746 0
[pid=3267] ppid=3263 vsize=80460 CPUtime=3.09 cores=3
/proc/3267/stat : 3267 (march_hi) R 3263 3263 3001 0 -1 4202496 40515 0 0 0 302 7 0 0 25 0 1 0 493529530 82391040 10417 33554432000 4194304 4331988 140737154137472 18446744073709551615 4210940 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3267/statm: 20115 10417 175 34 0 18557 0
[pid=3268] ppid=3263 vsize=150132 CPUtime=9 cores=4-7
/proc/3268/stat : 3268 (plingeling) S 3263 3263 3001 0 -1 4202496 13262 1255 0 0 898 2 0 0 18 0 5 0 493529530 153735168 9598 33554432000 4194304 4356188 140733868978016 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3268/statm: 37533 9598 163 40 0 36077 0
[pid=3268/tid=3276] ppid=3263 vsize=150132 CPUtime=2.95 cores=4-7
/proc/3268/task/3276/stat : 3276 (plingeling) R 3263 3263 3001 0 -1 4202560 2464 1255 0 0 295 0 0 0 25 0 5 0 493529544 153735168 9598 33554432000 4194304 4356188 140733868978016 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3268/tid=3277] ppid=3263 vsize=150132 CPUtime=1.41 cores=4-7
/proc/3268/task/3277/stat : 3277 (plingeling) R 3263 3263 3001 0 -1 4202560 1241 1255 0 0 141 0 0 0 25 0 5 0 493529544 153735168 9598 33554432000 4194304 4356188 140733868978016 18446744073709551615 4276723 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3278] ppid=3263 vsize=150132 CPUtime=1.53 cores=4-7
/proc/3268/task/3278/stat : 3278 (plingeling) R 3263 3263 3001 0 -1 4202560 1130 1255 0 0 153 0 0 0 23 0 5 0 493529544 153735168 9598 33554432000 4194304 4356188 140733868978016 18446744073709551615 4211856 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3279] ppid=3263 vsize=150132 CPUtime=2.95 cores=4-7
/proc/3268/task/3279/stat : 3279 (plingeling) R 3263 3263 3001 0 -1 4202560 1833 1255 0 0 295 0 0 0 25 0 5 0 493529544 153735168 9598 33554432000 4194304 4356188 140733868978016 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 18.28
Current children cumulated vsize (KiB) 338800

[startup+6.30099 s]
/proc/loadavg: 8.00 8.02 7.89 8/179 3279
/proc/meminfo: memFree=19455216/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 15 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195738567704576 0 0 17 4 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
[pid=3264] ppid=3263 vsize=1071288 CPUtime=6.28 cores=0
/proc/3264/stat : 3264 (cryptominisat) R 3263 3263 3001 0 -1 4202496 12583 0 0 0 627 1 0 0 25 0 1 0 493529530 1096998912 9192 33554432000 4194304 4587354 140734060182832 18446744073709551615 47204430889046 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3264/statm: 267822 9192 336 96 0 264384 0
[pid=3265] ppid=3263 vsize=38564 CPUtime=6.29 cores=1
/proc/3265/stat : 3265 (clasp) R 3263 3263 3001 0 -1 4202496 8402 0 0 0 628 1 0 0 25 0 1 0 493529530 39489536 6943 33554432000 4194304 4785740 140733200912336 18446744073709551615 4553094 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3265/statm: 9641 6943 340 145 0 6686 0
[pid=3267] ppid=3263 vsize=81708 CPUtime=6.29 cores=3
/proc/3267/stat : 3267 (march_hi) R 3263 3263 3001 0 -1 4202496 40851 0 0 0 622 7 0 0 25 0 1 0 493529530 83668992 10753 33554432000 4194304 4331988 140737154137472 18446744073709551615 4226474 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3267/statm: 20427 10753 175 34 0 18869 0
[pid=3268] ppid=3263 vsize=150048 CPUtime=18.6 cores=4-7
/proc/3268/stat : 3268 (plingeling) S 3263 3263 3001 0 -1 4202496 14286 1255 0 0 1858 2 0 0 18 0 5 0 493529530 153649152 9577 33554432000 4194304 4356188 140733868978016 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3268/statm: 37512 9577 163 40 0 36056 0
[pid=3268/tid=3276] ppid=3263 vsize=150048 CPUtime=6.15 cores=4-7
/proc/3268/task/3276/stat : 3276 (plingeling) R 3263 3263 3001 0 -1 4202560 2976 1255 0 0 615 0 0 0 25 0 5 0 493529544 153649152 9577 33554432000 4194304 4356188 140733868978016 18446744073709551615 4281540 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3268/tid=3277] ppid=3263 vsize=150048 CPUtime=3.01 cores=4-7
/proc/3268/task/3277/stat : 3277 (plingeling) R 3263 3263 3001 0 -1 4202560 1241 1255 0 0 301 0 0 0 25 0 5 0 493529544 153649152 9577 33554432000 4194304 4356188 140733868978016 18446744073709551615 4260245 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3278] ppid=3263 vsize=150048 CPUtime=3.13 cores=4-7
/proc/3268/task/3278/stat : 3278 (plingeling) R 3263 3263 3001 0 -1 4202560 1642 1255 0 0 313 0 0 0 25 0 5 0 493529544 153649152 9577 33554432000 4194304 4356188 140733868978016 18446744073709551615 4280649 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3279] ppid=3263 vsize=150048 CPUtime=6.15 cores=4-7
/proc/3268/task/3279/stat : 3279 (plingeling) R 3263 3263 3001 0 -1 4202560 1833 1255 0 0 615 0 0 0 25 0 5 0 493529544 153649152 9577 33554432000 4194304 4356188 140733868978016 18446744073709551615 4283929 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37.47
Current children cumulated vsize (KiB) 1359932

[startup+12.7009 s]
/proc/loadavg: 7.92 8.01 7.88 8/179 3279
/proc/meminfo: memFree=19433208/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 15 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195742862639364 0 0 17 4 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
[pid=3264] ppid=3263 vsize=1048076 CPUtime=12.69 cores=0
/proc/3264/stat : 3264 (cryptominisat) R 3263 3263 3001 0 -1 4202496 17927 0 0 0 1266 3 0 0 25 0 1 0 493529530 1073229824 12048 33554432000 4194304 4587354 140734060182832 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3264/statm: 262019 12048 336 96 0 258581 0
[pid=3265] ppid=3263 vsize=42864 CPUtime=12.69 cores=1
/proc/3265/stat : 3265 (clasp) R 3263 3263 3001 0 -1 4202496 9447 0 0 0 1267 2 0 0 25 0 1 0 493529530 43892736 7988 33554432000 4194304 4785740 140733200912336 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3265/statm: 10716 7988 340 145 0 7761 0
[pid=3267] ppid=3263 vsize=84872 CPUtime=12.69 cores=3
/proc/3267/stat : 3267 (march_hi) R 3263 3263 3001 0 -1 4202496 41449 0 0 0 1262 7 0 0 25 0 1 0 493529530 86908928 11351 33554432000 4194304 4331988 140737154137472 18446744073709551615 255106429637 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3267/statm: 21218 11351 175 34 0 19660 0
[pid=3268] ppid=3263 vsize=153848 CPUtime=37.79 cores=4-7
/proc/3268/stat : 3268 (plingeling) S 3263 3263 3001 0 -1 4202496 15240 1255 0 0 3777 2 0 0 18 0 5 0 493529530 157540352 10527 33554432000 4194304 4356188 140733868978016 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3268/statm: 38462 10527 163 40 0 37006 0
[pid=3268/tid=3276] ppid=3263 vsize=153848 CPUtime=12.55 cores=4-7
/proc/3268/task/3276/stat : 3276 (plingeling) R 3263 3263 3001 0 -1 4202560 3017 1255 0 0 1255 0 0 0 25 0 5 0 493529544 157540352 10527 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3268/tid=3277] ppid=3263 vsize=153848 CPUtime=6.21 cores=4-7
/proc/3268/task/3277/stat : 3277 (plingeling) R 3263 3263 3001 0 -1 4202560 1971 1255 0 0 621 0 0 0 25 0 5 0 493529544 157540352 10527 33554432000 4194304 4356188 140733868978016 18446744073709551615 4330876 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3278] ppid=3263 vsize=153848 CPUtime=6.33 cores=4-7
/proc/3268/task/3278/stat : 3278 (plingeling) R 3263 3263 3001 0 -1 4202560 1642 1255 0 0 633 0 0 0 25 0 5 0 493529544 157540352 10527 33554432000 4194304 4356188 140733868978016 18446744073709551615 4225601 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3279] ppid=3263 vsize=153848 CPUtime=12.55 cores=4-7
/proc/3268/task/3279/stat : 3279 (plingeling) R 3263 3263 3001 0 -1 4202560 2016 1255 0 0 1255 0 0 0 25 0 5 0 493529544 157540352 10527 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331984 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 75.87
Current children cumulated vsize (KiB) 1347984

[startup+25.5006 s]
/proc/loadavg: 7.71 7.96 7.87 8/179 3279
/proc/meminfo: memFree=19387152/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 15 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
[pid=3264] ppid=3263 vsize=1081392 CPUtime=25.48 cores=0
/proc/3264/stat : 3264 (cryptominisat) R 3263 3263 3001 0 -1 4202496 29528 0 0 0 2543 5 0 0 25 0 1 0 493529530 1107345408 18869 33554432000 4194304 4587354 140734060182832 18446744073709551615 4365336 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3264/statm: 270348 18869 336 96 0 266910 0
[pid=3265] ppid=3263 vsize=51332 CPUtime=25.48 cores=1
/proc/3265/stat : 3265 (clasp) R 3263 3263 3001 0 -1 4202496 11470 0 0 0 2546 2 0 0 25 0 1 0 493529530 52563968 10011 33554432000 4194304 4785740 140733200912336 18446744073709551615 4278544 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3265/statm: 12833 10011 340 145 0 9878 0
[pid=3267] ppid=3263 vsize=88332 CPUtime=25.49 cores=3
/proc/3267/stat : 3267 (march_hi) R 3263 3263 3001 0 -1 4202496 42390 0 0 0 2542 7 0 0 25 0 1 0 493529530 90451968 12273 33554432000 4194304 4331988 140737154137472 18446744073709551615 4298560 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3267/statm: 22083 12273 175 34 0 20525 0
[pid=3268] ppid=3263 vsize=161564 CPUtime=76.2 cores=4-7
/proc/3268/stat : 3268 (plingeling) S 3263 3263 3001 0 -1 4202496 17170 1255 0 0 7617 3 0 0 18 0 5 0 493529530 165441536 12456 33554432000 4194304 4356188 140733868978016 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3268/statm: 40391 12456 163 40 0 38935 0
[pid=3268/tid=3276] ppid=3263 vsize=161564 CPUtime=20.32 cores=4-7
/proc/3268/task/3276/stat : 3276 (plingeling) R 3263 3263 3001 0 -1 4202560 3017 1255 0 0 2032 0 0 0 25 0 5 0 493529544 165441536 12456 33554432000 4194304 4356188 140733868978016 18446744073709551615 4234377 0 0 4096 17442 0 0 0 -1 4 0 0 0

################
# More data... #
################

Current children cumulated CPU time (s) 33709.5
Current children cumulated vsize (KiB) 2145360

[startup+4902.3 s]
/proc/loadavg: 7.06 7.03 7.00 8/179 3432
/proc/meminfo: memFree=18583276/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 15 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195738567704576 0 0 17 0 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
[pid=3264] ppid=3263 vsize=1233232 CPUtime=4902.26 cores=0
/proc/3264/stat : 3264 (cryptominisat) R 3263 3263 3001 0 -1 4202496 490305 0 0 0 490010 216 0 0 25 0 1 0 493529530 1262829568 60368 33554432000 4194304 4587354 140734060182832 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3264/statm: 308308 60368 336 96 0 304870 0
[pid=3265] ppid=3263 vsize=312668 CPUtime=4902.39 cores=1
/proc/3265/stat : 3265 (clasp) R 3263 3263 3001 0 -1 4202496 74129 0 0 0 490209 30 0 0 25 0 1 0 493529530 320172032 72670 33554432000 4194304 4785740 140733200912336 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3265/statm: 78167 72670 340 145 0 75212 0
[pid=3267] ppid=3263 vsize=307344 CPUtime=4902.4 cores=3
/proc/3267/stat : 3267 (march_hi) R 3263 3263 3001 0 -1 4202496 85338 0 0 0 490209 31 0 0 25 0 1 0 493529530 314720256 55199 33554432000 4194304 4331988 140737154137472 18446744073709551615 4243172 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3267/statm: 76836 55199 175 34 0 75278 0
[pid=3268] ppid=3263 vsize=375020 CPUtime=19422.1 cores=4-7
/proc/3268/stat : 3268 (plingeling) S 3263 3263 3001 0 -1 4202496 775079 1255 0 0 1942099 112 0 0 18 0 5 0 493529530 384020480 65848 33554432000 4194304 4356188 140733868978016 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3268/statm: 93755 65848 163 40 0 92299 0
[pid=3268/tid=3276] ppid=3263 vsize=375020 CPUtime=4829.27 cores=4-7
/proc/3268/task/3276/stat : 3276 (plingeling) R 3263 3263 3001 0 -1 4202560 239030 1255 0 0 482891 36 0 0 25 0 5 0 493529544 384020480 65848 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3268/tid=3277] ppid=3263 vsize=375020 CPUtime=4894.45 cores=4-7
/proc/3268/task/3277/stat : 3277 (plingeling) R 3263 3263 3001 0 -1 4202560 226679 1255 0 0 489414 31 0 0 25 0 5 0 493529544 384020480 65848 33554432000 4194304 4356188 140733868978016 18446744073709551615 4332260 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3278] ppid=3263 vsize=375020 CPUtime=4795.97 cores=4-7
/proc/3268/task/3278/stat : 3278 (plingeling) R 3263 3263 3001 0 -1 4202560 212208 1255 0 0 479569 28 0 0 25 0 5 0 493529544 384020480 65848 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3268/tid=3279] ppid=3263 vsize=375020 CPUtime=4902.25 cores=4-7
/proc/3268/task/3279/stat : 3279 (plingeling) R 3263 3263 3001 0 -1 4202560 90568 1255 0 0 490211 14 0 0 25 0 5 0 493529544 384020480 65848 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 34129.2
Current children cumulated vsize (KiB) 2246588

[startup+4962.3 s]
/proc/loadavg: 7.08 7.04 7.00 8/179 3434
/proc/meminfo: memFree=18586868/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 15 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
[pid=3264] ppid=3263 vsize=1320976 CPUtime=4962.26 cores=0
/proc/3264/stat : 3264 (cryptominisat) R 3263 3263 3001 0 -1 4202496 492913 0 0 0 496009 217 0 0 25 0 1 0 493529530 1352679424 56946 33554432000 4194304 4587354 140734060182832 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3264/statm: 330244 56946 336 96 0 326806 0
[pid=3265] ppid=3263 vsize=312668 CPUtime=4962.39 cores=1
/proc/3265/stat : 3265 (clasp) R 3263 3263 3001 0 -1 4202496 74129 0 0 0 496209 30 0 0 25 0 1 0 493529530 320172032 72670 33554432000 4194304 4785740 140733200912336 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3265/statm: 78167 72670 340 145 0 75212 0
[pid=3267] ppid=3263 vsize=307608 CPUtime=4962.41 cores=3
/proc/3267/stat : 3267 (march_hi) R 3263 3263 3001 0 -1 4202496 86310 0 0 0 496209 32 0 0 25 0 1 0 493529530 314990592 56171 33554432000 4194304 4331988 140737154137472 18446744073709551615 4211249 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3267/statm: 76902 56171 175 34 0 75344 0
[pid=3268] ppid=3263 vsize=380140 CPUtime=19661.8 cores=4-7
/proc/3268/stat : 3268 (plingeling) S 3263 3263 3001 0 -1 4202496 787111 1255 0 0 1966064 114 0 0 18 0 5 0 493529530 389263360 67128 33554432000 4194304 4356188 140733868978016 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3268/statm: 95035 67128 163 40 0 93579 0
[pid=3268/tid=3276] ppid=3263 vsize=380140 CPUtime=4889.28 cores=4-7
/proc/3268/task/3276/stat : 3276 (plingeling) R 3263 3263 3001 0 -1 4202560 240566 1255 0 0 488891 37 0 0 25 0 5 0 493529544 389263360 67128 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3268/tid=3277] ppid=3263 vsize=380140 CPUtime=4954.46 cores=4-7
/proc/3268/task/3277/stat : 3277 (plingeling) R 3263 3263 3001 0 -1 4202560 227959 1255 0 0 495414 32 0 0 25 0 5 0 493529544 389263360 67128 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331964 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3278] ppid=3263 vsize=380140 CPUtime=4855.64 cores=4-7
/proc/3268/task/3278/stat : 3278 (plingeling) R 3263 3263 3001 0 -1 4202560 218864 1255 0 0 485535 29 0 0 25 0 5 0 493529544 389263360 67128 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3268/tid=3279] ppid=3263 vsize=380140 CPUtime=4962.25 cores=4-7
/proc/3268/task/3279/stat : 3279 (plingeling) R 3263 3263 3001 0 -1 4202560 93128 1255 0 0 496211 14 0 0 25 0 5 0 493529544 389263360 67128 33554432000 4194304 4356188 140733868978016 18446744073709551615 4274268 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 34548.9
Current children cumulated vsize (KiB) 2339716

[startup+5022.3 s]
/proc/loadavg: 7.08 7.04 7.00 8/179 3435
/proc/meminfo: memFree=18597652/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 15 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
[pid=3264] ppid=3263 vsize=1320976 CPUtime=5022.26 cores=0
/proc/3264/stat : 3264 (cryptominisat) R 3263 3263 3001 0 -1 4202496 497852 0 0 0 502005 221 0 0 25 0 1 0 493529530 1352679424 61797 33554432000 4194304 4587354 140734060182832 18446744073709551615 4232088 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3264/statm: 330244 61797 336 96 0 326806 0
[pid=3265] ppid=3263 vsize=312668 CPUtime=5022.39 cores=1
/proc/3265/stat : 3265 (clasp) R 3263 3263 3001 0 -1 4202496 74129 0 0 0 502209 30 0 0 25 0 1 0 493529530 320172032 72670 33554432000 4194304 4785740 140733200912336 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3265/statm: 78167 72670 340 145 0 75212 0
[pid=3267] ppid=3263 vsize=307608 CPUtime=5022.41 cores=3
/proc/3267/stat : 3267 (march_hi) R 3263 3263 3001 0 -1 4202496 86780 0 0 0 502209 32 0 0 25 0 1 0 493529530 314990592 56641 33554432000 4194304 4331988 140737154137472 18446744073709551615 4243048 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3267/statm: 76902 56641 175 34 0 75344 0
[pid=3268] ppid=3263 vsize=348396 CPUtime=19901.5 cores=4-7
/proc/3268/stat : 3268 (plingeling) S 3263 3263 3001 0 -1 4202496 792999 1255 0 0 1990032 115 0 0 18 0 5 0 493529530 356757504 59192 33554432000 4194304 4356188 140733868978016 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3268/statm: 87099 59192 163 40 0 85643 0
[pid=3268/tid=3276] ppid=3263 vsize=348396 CPUtime=4949.27 cores=4-7
/proc/3268/task/3276/stat : 3276 (plingeling) R 3263 3263 3001 0 -1 4202560 241590 1255 0 0 494890 37 0 0 25 0 5 0 493529544 356757504 59192 33554432000 4194304 4356188 140733868978016 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3268/tid=3277] ppid=3263 vsize=348396 CPUtime=5014.46 cores=4-7
/proc/3268/task/3277/stat : 3277 (plingeling) R 3263 3263 3001 0 -1 4202560 231031 1255 0 0 501414 32 0 0 25 0 5 0 493529544 356757504 59192 33554432000 4194304 4356188 140733868978016 18446744073709551615 4332136 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3278] ppid=3263 vsize=348396 CPUtime=4915.32 cores=4-7
/proc/3268/task/3278/stat : 3278 (plingeling) R 3263 3263 3001 0 -1 4202560 220144 1255 0 0 491503 29 0 0 25 0 5 0 493529544 356757504 59192 33554432000 4194304 4356188 140733868978016 18446744073709551615 4330982 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3268/tid=3279] ppid=3263 vsize=348396 CPUtime=5022.25 cores=4-7
/proc/3268/task/3279/stat : 3279 (plingeling) R 3263 3263 3001 0 -1 4202560 93640 1255 0 0 502211 14 0 0 25 0 5 0 493529544 356757504 59192 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 34968.5
Current children cumulated vsize (KiB) 2307972

[startup+5082.3 s]
/proc/loadavg: 7.08 7.05 7.00 8/179 3437
/proc/meminfo: memFree=18601864/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 15 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
[pid=3264] ppid=3263 vsize=1514192 CPUtime=5082.26 cores=0
/proc/3264/stat : 3264 (cryptominisat) R 3263 3263 3001 0 -1 4202496 500541 0 0 0 508003 223 0 0 25 0 1 0 493529530 1550532608 58745 33554432000 4194304 4587354 140734060182832 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3264/statm: 378548 58745 336 96 0 375110 0
[pid=3265] ppid=3263 vsize=312668 CPUtime=5082.39 cores=1
/proc/3265/stat : 3265 (clasp) R 3263 3263 3001 0 -1 4202496 74136 0 0 0 508209 30 0 0 25 0 1 0 493529530 320172032 72677 33554432000 4194304 4785740 140733200912336 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3265/statm: 78167 72677 340 145 0 75212 0
[pid=3267] ppid=3263 vsize=307740 CPUtime=5082.4 cores=3
/proc/3267/stat : 3267 (march_hi) R 3263 3263 3001 0 -1 4202496 87182 0 0 0 508208 32 0 0 25 0 1 0 493529530 315125760 57043 33554432000 4194304 4331988 140737154137472 18446744073709551615 4226483 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3267/statm: 76935 57043 175 34 0 75377 0
[pid=3268] ppid=3263 vsize=354544 CPUtime=20141.1 cores=4-7
/proc/3268/stat : 3268 (plingeling) S 3263 3263 3001 0 -1 4202496 800168 1255 0 0 2013998 116 0 0 18 0 5 0 493529530 363053056 60729 33554432000 4194304 4356188 140733868978016 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3268/statm: 88636 60729 163 40 0 87180 0
[pid=3268/tid=3276] ppid=3263 vsize=354544 CPUtime=5009.27 cores=4-7
/proc/3268/task/3276/stat : 3276 (plingeling) R 3263 3263 3001 0 -1 4202560 243126 1255 0 0 500890 37 0 0 25 0 5 0 493529544 363053056 60729 33554432000 4194304 4356188 140733868978016 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3268/tid=3277] ppid=3263 vsize=354544 CPUtime=5074.45 cores=4-7
/proc/3268/task/3277/stat : 3277 (plingeling) R 3263 3263 3001 0 -1 4202560 232567 1255 0 0 507413 32 0 0 25 0 5 0 493529544 363053056 60729 33554432000 4194304 4356188 140733868978016 18446744073709551615 4330896 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3278] ppid=3263 vsize=354544 CPUtime=4974.99 cores=4-7
/proc/3268/task/3278/stat : 3278 (plingeling) R 3263 3263 3001 0 -1 4202560 222192 1255 0 0 497470 29 0 0 25 0 5 0 493529544 363053056 60729 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3268/tid=3279] ppid=3263 vsize=354544 CPUtime=5082.26 cores=4-7
/proc/3268/task/3279/stat : 3279 (plingeling) R 3263 3263 3001 0 -1 4202560 95689 1255 0 0 508211 15 0 0 25 0 5 0 493529544 363053056 60729 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 35388.2
Current children cumulated vsize (KiB) 2507468



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 7.05 7.04 7.00 8/179 3437
/proc/meminfo: memFree=18587480/32951124 swapFree=67111524/67111528
[pid=3263] ppid=3261 vsize=18324 CPUtime=0.01 cores=0-7
/proc/3263/stat : 3263 (ppfolio) S 3261 3263 3001 0 -1 4202496 522 1195 0 0 0 0 0 1 15 0 1 0 493529529 18763776 390 33554432000 4194304 4287625 140734692029408 18446744073709551615 255106788879 0 0 4096 65536 9224195742862639364 0 0 17 0 0 0 0
/proc/3263/statm: 4581 390 342 23 0 91 0
[pid=3264] ppid=3263 vsize=1514192 CPUtime=5099.96 cores=0
/proc/3264/stat : 3264 (cryptominisat) R 3263 3263 3001 0 -1 4202496 501772 0 0 0 509773 223 0 0 25 0 1 0 493529530 1550532608 59942 33554432000 4194304 4587354 140734060182832 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/3264/statm: 378548 59942 336 96 0 375110 0
[pid=3265] ppid=3263 vsize=312668 CPUtime=5100.09 cores=1
/proc/3265/stat : 3265 (clasp) R 3263 3263 3001 0 -1 4202496 74143 0 0 0 509979 30 0 0 25 0 1 0 493529530 320172032 72684 33554432000 4194304 4785740 140733200912336 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/3265/statm: 78167 72684 340 145 0 75212 0
[pid=3267] ppid=3263 vsize=307876 CPUtime=5100.11 cores=3
/proc/3267/stat : 3267 (march_hi) R 3263 3263 3001 0 -1 4202496 87327 0 0 0 509979 32 0 0 25 0 1 0 493529530 315265024 57188 33554432000 4194304 4331988 140737154137472 18446744073709551615 4226474 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/3267/statm: 76969 57188 175 34 0 75411 0
[pid=3268] ppid=3263 vsize=364784 CPUtime=20211.9 cores=4-7
/proc/3268/stat : 3268 (plingeling) S 3263 3263 3001 0 -1 4202496 802728 1255 0 0 2021070 117 0 0 18 0 5 0 493529530 373538816 63289 33554432000 4194304 4356188 140733868978016 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3268/statm: 91196 63289 163 40 0 89740 0
[pid=3268/tid=3276] ppid=3263 vsize=364784 CPUtime=5026.98 cores=4-7
/proc/3268/task/3276/stat : 3276 (plingeling) R 3263 3263 3001 0 -1 4202560 243126 1255 0 0 502661 37 0 0 25 0 5 0 493529544 373538816 63289 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3268/tid=3277] ppid=3263 vsize=364784 CPUtime=5092.16 cores=4-7
/proc/3268/task/3277/stat : 3277 (plingeling) R 3263 3263 3001 0 -1 4202560 233079 1255 0 0 509184 32 0 0 25 0 5 0 493529544 373538816 63289 33554432000 4194304 4356188 140733868978016 18446744073709551615 4279656 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3268/tid=3278] ppid=3263 vsize=364784 CPUtime=4992.59 cores=4-7
/proc/3268/task/3278/stat : 3278 (plingeling) R 3263 3263 3001 0 -1 4202560 223216 1255 0 0 499230 29 0 0 25 0 5 0 493529544 373538816 63289 33554432000 4194304 4356188 140733868978016 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3268/tid=3279] ppid=3263 vsize=364784 CPUtime=5099.96 cores=4-7
/proc/3268/task/3279/stat : 3279 (plingeling) R 3263 3263 3001 0 -1 4202560 96713 1255 0 0 509981 15 0 0 25 0 5 0 493529544 373538816 63289 33554432000 4194304 4356188 140733868978016 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 35512
Current children cumulated vsize (KiB) 2517844

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3263 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=3999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=18997
# CPU time returned by wait4() is 0.022996
# while last known CPU time is 35512
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5100.02
CPU time (s): 35512
CPU user time (s): 35508
CPU system time (s): 4.03
CPU usage (%): 696.312
Max. virtual memory (cumulated for all children) (KiB): 7786104

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.003999
system time used= 0.018997
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1717
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 551
involuntary context switches= 15

runsolver used 7.95779 second user time and 19.868 second system time

The end

Launcher Data 

Begin job on node144 at 2011-04-28 19:18:54
IDJOB=3310323
IDBENCH=83134
IDSOLVER=1638
FILE ID=node144/3310323-1304011134
RUNJOBID= node144-1304009411-3015
PBS_JOBID= 13168853
Free space on /tmp= 72408 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom17.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310323-1304011134/watcher-3310323-1304011134 -o /tmp/evaluation-result-3310323-1304011134/solver-3310323-1304011134 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310323-1304011134.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= a6df2ce216327c64a0156683acb72fc2
RANDOM SEED=156708253

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19599384 kB
Buffers:       2201868 kB
Cached:       10522064 kB
SwapCached:          4 kB
Active:        4549752 kB
Inactive:      8237400 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19599384 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           11796 kB
Writeback:           0 kB
AnonPages:       62928 kB
Mapped:          14476 kB
Slab:           498876 kB
PageTables:       4264 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   182192 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72396 MiB
End job on node144 at 2011-04-28 20:43:56