Trace number 3310221

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.6 5003.92

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
MD5SUM0385ba51f44fb47d0b0726e26312816f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables171676
Number of clauses858766
Sum of the clauses size2046721
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2847665
Number of clauses of size 32700
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58190

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310221-1304004388/watcher-3310221-1304004388 -o /tmp/evaluation-result-3310221-1304004388/solver-3310221-1304004388 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3310221-1304004388.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.14 3.66 2.22 2/170 24395
/proc/meminfo: memFree=12949728/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 0 0 0 0 24 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 2826088513535 0 0 17 6 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0

[startup+0.014558 s]
/proc/loadavg: 7.14 3.66 2.22 2/170 24395
/proc/meminfo: memFree=12949728/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 0 0 0 0 24 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 6 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100553 s]
/proc/loadavg: 7.14 3.66 2.22 2/170 24395
/proc/meminfo: memFree=12949728/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 0 0 0 0 24 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 6 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300508 s]
/proc/loadavg: 7.14 3.66 2.22 2/170 24395
/proc/meminfo: memFree=12949728/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 0 0 0 0 24 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 6 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700434 s]
/proc/loadavg: 7.14 3.66 2.22 2/170 24395
/proc/meminfo: memFree=12949728/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 0 0 0 0 21 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 6 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50122 s]
/proc/loadavg: 7.14 3.66 2.22 9/180 24410
/proc/meminfo: memFree=12573684/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 6 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
[pid=24396] ppid=24395 vsize=120740 CPUtime=1.49 cores=0
/proc/24396/stat : 24396 (cryptominisat) R 24395 24395 24162 0 -1 4202496 23504 0 0 0 146 3 0 0 20 0 1 0 590669570 123637760 23155 33554432000 4194304 4587354 140737166817584 18446744073709551615 4367358 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24396/statm: 30185 23155 312 96 0 26747 0
[pid=24397] ppid=24395 vsize=81748 CPUtime=1.49 cores=1
/proc/24397/stat : 24397 (clasp) R 24395 24395 24162 0 -1 4202496 24781 0 0 0 146 3 0 0 20 0 1 0 590669570 83709952 17235 33554432000 4194304 4785740 140735825680096 18446744073709551615 4319139 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24397/statm: 20437 17235 340 145 0 17482 0
[pid=24398] ppid=24395 vsize=500044 CPUtime=1.49 cores=2
/proc/24398/stat : 24398 (TNM) R 24395 24395 24162 0 -1 4202496 16488 0 0 0 147 2 0 0 20 0 1 0 590669570 512045056 16385 33554432000 134512640 134534564 4294029424 18446744073709551615 134524510 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/24398/statm: 125011 16385 91 6 0 123677 0
[pid=24399] ppid=24395 vsize=115348 CPUtime=1.49 cores=3
/proc/24399/stat : 24399 (march_hi) R 24395 24395 24162 0 -1 4194304 49404 0 0 0 142 7 0 0 20 0 1 0 590669570 118116352 17894 33554432000 4194304 4331988 140736855013328 18446744073709551615 251366942142 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24399/statm: 28837 17894 129 34 0 27279 0
[pid=24400] ppid=24395 vsize=130384 CPUtime=3.65 cores=4-7
/proc/24400/stat : 24400 (plingeling) S 24395 24395 24162 0 -1 4202496 27006 1253 0 0 362 3 0 0 18 0 5 0 590669570 133513216 21035 33554432000 4194304 4356188 140736320506128 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/24400/statm: 32596 21035 145 40 0 31140 0
[pid=24400/tid=24407] ppid=24395 vsize=130384 CPUtime=0.71 cores=4-7
/proc/24400/task/24407/stat : 24407 (plingeling) R 24395 24395 24162 0 -1 4202560 326 1253 0 0 71 0 0 0 25 0 5 0 590669647 133513216 21035 33554432000 4194304 4356188 140736320506128 18446744073709551615 4272760 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24400/tid=24408] ppid=24395 vsize=130384 CPUtime=0.72 cores=4-7
/proc/24400/task/24408/stat : 24408 (plingeling) R 24395 24395 24162 0 -1 4202560 325 1253 0 0 72 0 0 0 25 0 5 0 590669647 133513216 21035 33554432000 4194304 4356188 140736320506128 18446744073709551615 4237379 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24400/tid=24409] ppid=24395 vsize=130384 CPUtime=0.72 cores=4-7
/proc/24400/task/24409/stat : 24409 (plingeling) R 24395 24395 24162 0 -1 4202560 265 1253 0 0 72 0 0 0 21 0 5 0 590669647 133513216 21035 33554432000 4194304 4356188 140736320506128 18446744073709551615 4238339 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24400/tid=24410] ppid=24395 vsize=130384 CPUtime=0.72 cores=4-7
/proc/24400/task/24410/stat : 24410 (plingeling) R 24395 24395 24162 0 -1 4202560 259 1253 0 0 72 0 0 0 18 0 5 0 590669647 133513216 21035 33554432000 4194304 4356188 140736320506128 18446744073709551615 4208104 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 9.61
Current children cumulated vsize (KiB) 966588

[startup+3.10093 s]
/proc/loadavg: 7.21 3.73 2.25 9/180 24410
/proc/meminfo: memFree=12467788/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 6 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
[pid=24396] ppid=24395 vsize=120740 CPUtime=3.09 cores=0
/proc/24396/stat : 24396 (cryptominisat) R 24395 24395 24162 0 -1 4202496 23504 0 0 0 306 3 0 0 25 0 1 0 590669570 123637760 23155 33554432000 4194304 4587354 140737166817584 18446744073709551615 4421100 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24396/statm: 30185 23155 312 96 0 26747 0
[pid=24397] ppid=24395 vsize=82016 CPUtime=3.08 cores=1
/proc/24397/stat : 24397 (clasp) R 24395 24395 24162 0 -1 4202496 24942 0 0 0 305 3 0 0 25 0 1 0 590669570 83984384 17396 33554432000 4194304 4785740 140735825680096 18446744073709551615 4549837 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24397/statm: 20504 17396 340 145 0 17549 0
[pid=24398] ppid=24395 vsize=530404 CPUtime=3.09 cores=2
/proc/24398/stat : 24398 (TNM) R 24395 24395 24162 0 -1 4202496 30800 0 0 0 306 3 0 0 25 0 1 0 590669570 543133696 30697 33554432000 134512640 134534564 4294029424 18446744073709551615 134529352 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/24398/statm: 132601 30697 95 6 0 131267 0
[pid=24399] ppid=24395 vsize=118396 CPUtime=3.09 cores=3
/proc/24399/stat : 24399 (march_hi) R 24395 24395 24162 0 -1 4194304 96876 0 0 0 294 15 0 0 25 0 1 0 590669570 121237504 19781 33554432000 4194304 4331988 140736855013328 18446744073709551615 251367214036 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24399/statm: 29599 19781 129 34 0 28041 0
[pid=24400] ppid=24395 vsize=157584 CPUtime=10.03 cores=4-7
/proc/24400/stat : 24400 (plingeling) S 24395 24395 24162 0 -1 4202496 52179 1253 0 0 997 6 0 0 18 0 5 0 590669570 161366016 27830 33554432000 4194304 4356188 140736320506128 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/24400/statm: 39396 27830 164 40 0 37940 0
[pid=24400/tid=24407] ppid=24395 vsize=157584 CPUtime=2.29 cores=4-7
/proc/24400/task/24407/stat : 24407 (plingeling) R 24395 24395 24162 0 -1 4202560 6514 1253 0 0 229 0 0 0 25 0 5 0 590669647 161366016 27830 33554432000 4194304 4356188 140736320506128 18446744073709551615 4286832 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24400/tid=24408] ppid=24395 vsize=157584 CPUtime=2.31 cores=4-7
/proc/24400/task/24408/stat : 24408 (plingeling) R 24395 24395 24162 0 -1 4202560 6046 1253 0 0 230 1 0 0 25 0 5 0 590669647 161366016 27830 33554432000 4194304 4356188 140736320506128 18446744073709551615 4210596 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24400/tid=24409] ppid=24395 vsize=157584 CPUtime=2.31 cores=4-7
/proc/24400/task/24409/stat : 24409 (plingeling) R 24395 24395 24162 0 -1 4202560 9663 1253 0 0 231 0 0 0 25 0 5 0 590669647 161366016 27830 33554432000 4194304 4356188 140736320506128 18446744073709551615 4217776 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24400/tid=24410] ppid=24395 vsize=157584 CPUtime=2.31 cores=4-7
/proc/24400/task/24410/stat : 24410 (plingeling) R 24395 24395 24162 0 -1 4202560 4125 1253 0 0 231 0 0 0 21 0 5 0 590669647 161366016 27830 33554432000 4194304 4356188 140736320506128 18446744073709551615 4281652 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 22.38
Current children cumulated vsize (KiB) 1027464

[startup+6.30134 s]
/proc/loadavg: 7.21 3.73 2.25 9/180 24410
/proc/meminfo: memFree=12378480/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 0 0 0 0 16 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 6 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
[pid=24396] ppid=24395 vsize=163016 CPUtime=6.29 cores=0
/proc/24396/stat : 24396 (cryptominisat) R 24395 24395 24162 0 -1 4202496 46865 0 0 0 623 6 0 0 25 0 1 0 590669570 166928384 33702 33554432000 4194304 4587354 140737166817584 18446744073709551615 4236606 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24396/statm: 40754 33702 330 96 0 37316 0
[pid=24397] ppid=24395 vsize=126592 CPUtime=6.28 cores=1
/proc/24397/stat : 24397 (clasp) R 24395 24395 24162 0 -1 4202496 36078 0 0 0 623 5 0 0 25 0 1 0 590669570 129630208 28532 33554432000 4194304 4785740 140735825680096 18446744073709551615 4416773 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24397/statm: 31648 28532 340 145 0 28693 0
[pid=24398] ppid=24395 vsize=530404 CPUtime=6.29 cores=2
/proc/24398/stat : 24398 (TNM) R 24395 24395 24162 0 -1 4202496 30800 0 0 0 626 3 0 0 25 0 1 0 590669570 543133696 30697 33554432000 134512640 134534564 4294029424 18446744073709551615 134530659 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/24398/statm: 132601 30697 95 6 0 131267 0
[pid=24399] ppid=24395 vsize=118220 CPUtime=6.29 cores=3
/proc/24399/stat : 24399 (march_hi) R 24395 24395 24162 0 -1 4194304 190889 0 0 0 602 27 0 0 25 0 1 0 590669570 121057280 19737 33554432000 4194304 4331988 140736855013328 18446744073709551615 4256823 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24399/statm: 29555 19737 129 34 0 27997 0
[pid=24400] ppid=24395 vsize=176436 CPUtime=22.81 cores=4-7
/proc/24400/stat : 24400 (plingeling) S 24395 24395 24162 0 -1 4202496 57073 1253 0 0 2274 7 0 0 18 0 5 0 590669570 180670464 32553 33554432000 4194304 4356188 140736320506128 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/24400/statm: 44109 32553 164 40 0 42653 0
[pid=24400/tid=24407] ppid=24395 vsize=176436 CPUtime=5.47 cores=4-7
/proc/24400/task/24407/stat : 24407 (plingeling) R 24395 24395 24162 0 -1 4202560 9312 1253 0 0 547 0 0 0 25 0 5 0 590669647 180670464 32553 33554432000 4194304 4356188 140736320506128 18446744073709551615 4211042 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24400/tid=24408] ppid=24395 vsize=176436 CPUtime=5.51 cores=4-7
/proc/24400/task/24408/stat : 24408 (plingeling) R 24395 24395 24162 0 -1 4202560 6280 1253 0 0 550 1 0 0 25 0 5 0 590669647 180670464 32553 33554432000 4194304 4356188 140736320506128 18446744073709551615 4283965 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24400/tid=24409] ppid=24395 vsize=176436 CPUtime=5.51 cores=4-7
/proc/24400/task/24409/stat : 24409 (plingeling) R 24395 24395 24162 0 -1 4202560 9897 1253 0 0 550 1 0 0 25 0 5 0 590669647 180670464 32553 33554432000 4194304 4356188 140736320506128 18446744073709551615 4210605 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24400/tid=24410] ppid=24395 vsize=176436 CPUtime=5.51 cores=4-7
/proc/24400/task/24410/stat : 24410 (plingeling) R 24395 24395 24162 0 -1 4202560 5753 1253 0 0 551 0 0 0 25 0 5 0 590669647 180670464 32553 33554432000 4194304 4356188 140736320506128 18446744073709551615 4281583 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 47.96
Current children cumulated vsize (KiB) 1132992

[startup+12.7011 s]
/proc/loadavg: 7.33 3.87 2.31 9/180 24410
/proc/meminfo: memFree=12273872/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 0 0 0 0 16 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 6 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
[pid=24396] ppid=24395 vsize=163016 CPUtime=12.69 cores=0
/proc/24396/stat : 24396 (cryptominisat) R 24395 24395 24162 0 -1 4202496 47985 0 0 0 1263 6 0 0 25 0 1 0 590669570 166928384 34822 33554432000 4194304 4587354 140737166817584 18446744073709551615 4236606 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24396/statm: 40754 34822 330 96 0 37316 0
[pid=24397] ppid=24395 vsize=220316 CPUtime=12.68 cores=1
/proc/24397/stat : 24397 (clasp) R 24395 24395 24162 0 -1 4202496 59471 0 0 0 1257 11 0 0 25 0 1 0 590669570 225603584 51925 33554432000 4194304 4785740 140735825680096 18446744073709551615 4550000 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24397/statm: 55079 51925 340 145 0 52124 0
[pid=24398] ppid=24395 vsize=530404 CPUtime=12.69 cores=2
/proc/24398/stat : 24398 (TNM) R 24395 24395 24162 0 -1 4202496 30800 0 0 0 1266 3 0 0 25 0 1 0 590669570 543133696 30697 33554432000 134512640 134534564 4294029424 18446744073709551615 134525904 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/24398/statm: 132601 30697 95 6 0 131267 0
[pid=24399] ppid=24395 vsize=120844 CPUtime=12.69 cores=3
/proc/24399/stat : 24399 (march_hi) R 24395 24395 24162 0 -1 4194304 337473 0 0 0 1224 45 0 0 25 0 1 0 590669570 123744256 20393 33554432000 4194304 4331988 140736855013328 18446744073709551615 4257036 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24399/statm: 30211 20393 129 34 0 28653 0
[pid=24400] ppid=24395 vsize=176420 CPUtime=48.38 cores=4-7
/proc/24400/stat : 24400 (plingeling) S 24395 24395 24162 0 -1 4202496 57073 1253 0 0 4831 7 0 0 18 0 5 0 590669570 180654080 32549 33554432000 4194304 4356188 140736320506128 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/24400/statm: 44105 32549 164 40 0 42649 0
[pid=24400/tid=24407] ppid=24395 vsize=176420 CPUtime=11.84 cores=4-7
/proc/24400/task/24407/stat : 24407 (plingeling) R 24395 24395 24162 0 -1 4202560 9312 1253 0 0 1184 0 0 0 25 0 5 0 590669647 180654080 32549 33554432000 4194304 4356188 140736320506128 18446744073709551615 4284120 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24400/tid=24408] ppid=24395 vsize=176420 CPUtime=11.91 cores=4-7
/proc/24400/task/24408/stat : 24408 (plingeling) R 24395 24395 24162 0 -1 4202560 6280 1253 0 0 1190 1 0 0 25 0 5 0 590669647 180654080 32549 33554432000 4194304 4356188 140736320506128 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24400/tid=24409] ppid=24395 vsize=176420 CPUtime=11.91 cores=4-7
/proc/24400/task/24409/stat : 24409 (plingeling) R 24395 24395 24162 0 -1 4202560 9897 1253 0 0 1190 1 0 0 25 0 5 0 590669647 180654080 32549 33554432000 4194304 4356188 140736320506128 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24400/tid=24410] ppid=24395 vsize=176420 CPUtime=11.91 cores=4-7
/proc/24400/task/24410/stat : 24410 (plingeling) R 24395 24395 24162 0 -1 4202560 5753 1253 0 0 1191 0 0 0 25 0 5 0 590669647 180654080 32549 33554432000 4194304 4356188 140736320506128 18446744073709551615 4273238 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 99.13
Current children cumulated vsize (KiB) 1229324

[startup+25.5008 s]
/proc/loadavg: 7.43 4.01 2.37 9/180 24411
/proc/meminfo: memFree=11970180/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 0 0 0 0 15 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 6 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
[pid=24396] ppid=24395 vsize=200520 CPUtime=25.49 cores=0
/proc/24396/stat : 24396 (cryptominisat) R 24395 24395 24162 0 -1 4202496 51489 0 0 0 2541 8 0 0 25 0 1 0 590669570 205332480 38324 33554432000 4194304 4587354 140737166817584 18446744073709551615 4236870 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=24398] ppid=24395 vsize=530404 CPUtime=4841.8 cores=2
/proc/24398/stat : 24398 (TNM) R 24395 24395 24162 0 -1 4202496 30800 0 0 0 484176 4 0 0 25 0 1 0 590669570 543133696 30697 33554432000 134512640 134534564 4294029424 18446744073709551615 134525849 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/24398/statm: 132601 30697 95 6 0 131267 0
[pid=24399] ppid=24395 vsize=416720 CPUtime=4842.43 cores=3
/proc/24399/stat : 24399 (march_hi) R 24395 24395 24162 0 -1 4202496 443649 0 0 0 484180 63 0 0 25 0 1 0 590669570 426721280 54343 33554432000 4194304 4331988 140736855013328 18446744073709551615 4228268 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24399/statm: 104180 54343 175 34 0 102622 0
[pid=24400] ppid=24395 vsize=1134588 CPUtime=19339.6 cores=4-7
/proc/24400/stat : 24400 (plingeling) S 24395 24395 24162 0 -1 4202496 3349172 1253 0 0 1933464 496 0 0 18 0 5 0 590669570 1161818112 272091 33554432000 4194304 4356188 140736320506128 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/24400/statm: 283647 272091 164 40 0 282191 0
[pid=24400/tid=24407] ppid=24395 vsize=1134588 CPUtime=4815.26 cores=4-7
/proc/24400/task/24407/stat : 24407 (plingeling) R 24395 24395 24162 0 -1 4202560 824794 1253 0 0 481405 121 0 0 25 0 5 0 590669647 1161818112 272091 33554432000 4194304 4356188 140736320506128 18446744073709551615 4237401 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24400/tid=24408] ppid=24395 vsize=1134588 CPUtime=4840.85 cores=4-7
/proc/24400/task/24408/stat : 24408 (plingeling) R 24395 24395 24162 0 -1 4202560 839191 1253 0 0 483960 125 0 0 25 0 5 0 590669647 1161818112 272091 33554432000 4194304 4356188 140736320506128 18446744073709551615 4210596 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24400/tid=24409] ppid=24395 vsize=1134588 CPUtime=4841.01 cores=4-7
/proc/24400/task/24409/stat : 24409 (plingeling) R 24395 24395 24162 0 -1 4202560 865704 1253 0 0 483974 127 0 0 25 0 5 0 590669647 1161818112 272091 33554432000 4194304 4356188 140736320506128 18446744073709551615 4237379 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24400/tid=24410] ppid=24395 vsize=1134588 CPUtime=4841.67 cores=4-7
/proc/24400/task/24410/stat : 24410 (plingeling) R 24395 24395 24162 0 -1 4202560 793652 1253 0 0 484050 117 0 0 25 0 5 0 590669647 1161818112 272091 33554432000 4194304 4356188 140736320506128 18446744073709551615 4284205 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38708.6
Current children cumulated vsize (KiB) 8167756

[startup+4902.3 s]
/proc/loadavg: 8.00 8.04 8.00 9/180 24556
/proc/meminfo: memFree=6507896/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0.06 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 1 5 0 0 15 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 0 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
[pid=24396] ppid=24395 vsize=1917688 CPUtime=4902.39 cores=0
/proc/24396/stat : 24396 (cryptominisat) R 24395 24395 24162 0 -1 4202496 7479799 0 0 0 488700 1539 0 0 25 0 1 0 590669570 1963712512 185657 33554432000 4194304 4587354 140737166817584 18446744073709551615 4238525 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24396/statm: 479422 185657 340 96 0 475984 0
[pid=24397] ppid=24395 vsize=4476912 CPUtime=4902.3 cores=1
/proc/24397/stat : 24397 (clasp) R 24395 24395 24162 0 -1 4202496 1119471 0 0 0 489945 285 0 0 25 0 1 0 590669570 4584357888 1111925 33554432000 4194304 4785740 140735825680096 18446744073709551615 4279309 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24397/statm: 1119228 1111925 340 145 0 1116273 0
[pid=24398] ppid=24395 vsize=530404 CPUtime=4901.8 cores=2
/proc/24398/stat : 24398 (TNM) R 24395 24395 24162 0 -1 4202496 30800 0 0 0 490176 4 0 0 25 0 1 0 590669570 543133696 30697 33554432000 134512640 134534564 4294029424 18446744073709551615 134530379 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/24398/statm: 132601 30697 95 6 0 131267 0
[pid=24399] ppid=24395 vsize=416720 CPUtime=4902.44 cores=3
/proc/24399/stat : 24399 (march_hi) R 24395 24395 24162 0 -1 4202496 443696 0 0 0 490181 63 0 0 25 0 1 0 590669570 426721280 54390 33554432000 4194304 4331988 140736855013328 18446744073709551615 4263238 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24399/statm: 104180 54390 175 34 0 102622 0
[pid=24400] ppid=24395 vsize=962552 CPUtime=19579.3 cores=4-7
/proc/24400/stat : 24400 (plingeling) S 24395 24395 24162 0 -1 4202496 3406516 1253 0 0 1957423 505 0 0 18 0 5 0 590669570 985653248 229082 33554432000 4194304 4356188 140736320506128 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/24400/statm: 240638 229082 164 40 0 239182 0
[pid=24400/tid=24407] ppid=24395 vsize=962552 CPUtime=4874.94 cores=4-7
/proc/24400/task/24407/stat : 24407 (plingeling) R 24395 24395 24162 0 -1 4202560 849370 1253 0 0 487369 125 0 0 25 0 5 0 590669647 985653248 229082 33554432000 4194304 4356188 140736320506128 18446744073709551615 4236939 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24400/tid=24408] ppid=24395 vsize=962552 CPUtime=4900.85 cores=4-7
/proc/24400/task/24408/stat : 24408 (plingeling) R 24395 24395 24162 0 -1 4202560 845335 1253 0 0 489958 127 0 0 25 0 5 0 590669647 985653248 229082 33554432000 4194304 4356188 140736320506128 18446744073709551615 4274277 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24400/tid=24409] ppid=24395 vsize=962552 CPUtime=4901.02 cores=4-7
/proc/24400/task/24409/stat : 24409 (plingeling) R 24395 24395 24162 0 -1 4202560 884136 1253 0 0 489972 130 0 0 25 0 5 0 590669647 985653248 229082 33554432000 4194304 4356188 140736320506128 18446744073709551615 4282000 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24400/tid=24410] ppid=24395 vsize=962552 CPUtime=4901.67 cores=4-7
/proc/24400/task/24410/stat : 24410 (plingeling) R 24395 24395 24162 0 -1 4202560 801844 1253 0 0 490049 118 0 0 25 0 5 0 590669647 985653248 229082 33554432000 4194304 4356188 140736320506128 18446744073709551615 4281672 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39188.3
Current children cumulated vsize (KiB) 8322600

[startup+4962.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 24557
/proc/meminfo: memFree=6229368/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0.06 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 1 5 0 0 15 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 0 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
[pid=24396] ppid=24395 vsize=1917688 CPUtime=4962.39 cores=0
/proc/24396/stat : 24396 (cryptominisat) R 24395 24395 24162 0 -1 4202496 7509006 0 0 0 494688 1551 0 0 25 0 1 0 590669570 1963712512 214786 33554432000 4194304 4587354 140737166817584 18446744073709551615 4243968 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24396/statm: 479422 214786 340 96 0 475984 0
[pid=24397] ppid=24395 vsize=4518168 CPUtime=4962.3 cores=1
/proc/24397/stat : 24397 (clasp) R 24395 24395 24162 0 -1 4202496 1129809 0 0 0 495943 287 0 0 25 0 1 0 590669570 4626604032 1122263 33554432000 4194304 4785740 140735825680096 18446744073709551615 4278587 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24397/statm: 1129542 1122263 340 145 0 1126587 0
[pid=24398] ppid=24395 vsize=530404 CPUtime=4961.8 cores=2
/proc/24398/stat : 24398 (TNM) R 24395 24395 24162 0 -1 4202496 30800 0 0 0 496176 4 0 0 25 0 1 0 590669570 543133696 30697 33554432000 134512640 134534564 4294029424 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/24398/statm: 132601 30697 95 6 0 131267 0
[pid=24399] ppid=24395 vsize=416720 CPUtime=4962.44 cores=3
/proc/24399/stat : 24399 (march_hi) R 24395 24395 24162 0 -1 4202496 443741 0 0 0 496181 63 0 0 25 0 1 0 590669570 426721280 54435 33554432000 4194304 4331988 140736855013328 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24399/statm: 104180 54435 175 34 0 102622 0
[pid=24400] ppid=24395 vsize=1073144 CPUtime=19818.9 cores=4-7
/proc/24400/stat : 24400 (plingeling) S 24395 24395 24162 0 -1 4202496 3434164 1253 0 0 1981388 507 0 0 18 0 5 0 590669570 1098899456 256730 33554432000 4194304 4356188 140736320506128 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/24400/statm: 268286 256730 164 40 0 266830 0
[pid=24400/tid=24407] ppid=24395 vsize=1073144 CPUtime=4934.61 cores=4-7
/proc/24400/task/24407/stat : 24407 (plingeling) R 24395 24395 24162 0 -1 4202560 849370 1253 0 0 493336 125 0 0 25 0 5 0 590669647 1098899456 256730 33554432000 4194304 4356188 140736320506128 18446744073709551615 4334609 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24400/tid=24408] ppid=24395 vsize=1073144 CPUtime=4960.85 cores=4-7
/proc/24400/task/24408/stat : 24408 (plingeling) R 24395 24395 24162 0 -1 4202560 867863 1253 0 0 495956 129 0 0 25 0 5 0 590669647 1098899456 256730 33554432000 4194304 4356188 140736320506128 18446744073709551615 4210605 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24400/tid=24409] ppid=24395 vsize=1073144 CPUtime=4961.02 cores=4-7
/proc/24400/task/24409/stat : 24409 (plingeling) R 24395 24395 24162 0 -1 4202560 887208 1253 0 0 495972 130 0 0 25 0 5 0 590669647 1098899456 256730 33554432000 4194304 4356188 140736320506128 18446744073709551615 4283934 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24400/tid=24410] ppid=24395 vsize=1073144 CPUtime=4961.68 cores=4-7
/proc/24400/task/24410/stat : 24410 (plingeling) R 24395 24395 24162 0 -1 4202560 803892 1253 0 0 496049 119 0 0 25 0 5 0 590669647 1098899456 256730 33554432000 4194304 4356188 140736320506128 18446744073709551615 4331340 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39667.9
Current children cumulated vsize (KiB) 8474448



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.91 s]
/proc/loadavg: 8.00 8.02 8.00 9/180 24559
/proc/meminfo: memFree=6311204/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0.06 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 1 5 0 0 15 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 0 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
[pid=24396] ppid=24395 vsize=1919792 CPUtime=5004.01 cores=0
/proc/24396/stat : 24396 (cryptominisat) R 24395 24395 24162 0 -1 4202496 7523249 0 0 0 498843 1558 0 0 25 0 1 0 590669570 1965867008 187775 33554432000 4194304 4587354 140737166817584 18446744073709551615 4230266 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24396/statm: 479948 187775 340 96 0 476510 0
[pid=24397] ppid=24395 vsize=4518168 CPUtime=5003.91 cores=1
/proc/24397/stat : 24397 (clasp) R 24395 24395 24162 0 -1 4202496 1129813 0 0 0 500104 287 0 0 25 0 1 0 590669570 4626604032 1122267 33554432000 4194304 4785740 140735825680096 18446744073709551615 4309533 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24397/statm: 1129542 1122267 340 145 0 1126587 0
[pid=24398] ppid=24395 vsize=530404 CPUtime=5003.42 cores=2
/proc/24398/stat : 24398 (TNM) R 24395 24395 24162 0 -1 4202496 30800 0 0 0 500338 4 0 0 25 0 1 0 590669570 543133696 30697 33554432000 134512640 134534564 4294029424 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/24398/statm: 132601 30697 95 6 0 131267 0
[pid=24399] ppid=24395 vsize=416720 CPUtime=5004.05 cores=3
/proc/24399/stat : 24399 (march_hi) R 24395 24395 24162 0 -1 4202496 443776 0 0 0 500342 63 0 0 25 0 1 0 590669570 426721280 54470 33554432000 4194304 4331988 140736855013328 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24399/statm: 104180 54470 175 34 0 102622 0
[pid=24400] ppid=24395 vsize=1097724 CPUtime=19985.2 cores=4-7
/proc/24400/stat : 24400 (plingeling) S 24395 24395 24162 0 -1 4202496 3513013 1253 0 0 1997999 518 0 0 18 0 5 0 590669570 1124069376 262875 33554432000 4194304 4356188 140736320506128 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/24400/statm: 274431 262875 164 40 0 272975 0
[pid=24400/tid=24407] ppid=24395 vsize=1097724 CPUtime=4975.99 cores=4-7
/proc/24400/task/24407/stat : 24407 (plingeling) R 24395 24395 24162 0 -1 4202560 874970 1253 0 0 497471 128 0 0 25 0 5 0 590669647 1124069376 262875 33554432000 4194304 4356188 140736320506128 18446744073709551615 4331835 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24400/tid=24408] ppid=24395 vsize=1097724 CPUtime=5002.45 cores=4-7
/proc/24400/task/24408/stat : 24408 (plingeling) R 24395 24395 24162 0 -1 4202560 880152 1253 0 0 500115 130 0 0 25 0 5 0 590669647 1124069376 262875 33554432000 4194304 4356188 140736320506128 18446744073709551615 4242643 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24400/tid=24409] ppid=24395 vsize=1097724 CPUtime=5002.63 cores=4-7
/proc/24400/task/24409/stat : 24409 (plingeling) R 24395 24395 24162 0 -1 4202560 909736 1253 0 0 500129 134 0 0 25 0 5 0 590669647 1124069376 262875 33554432000 4194304 4356188 140736320506128 18446744073709551615 4281782 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24400/tid=24410] ppid=24395 vsize=1097724 CPUtime=5003.29 cores=4-7
/proc/24400/task/24410/stat : 24410 (plingeling) R 24395 24395 24162 0 -1 4202560 822324 1253 0 0 500208 121 0 0 25 0 5 0 590669647 1124069376 262875 33554432000 4194304 4356188 140736320506128 18446744073709551615 4281771 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 8501132

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5003.91 s]
/proc/loadavg: 8.00 8.02 8.00 9/180 24559
/proc/meminfo: memFree=6311204/32950928 swapFree=67111528/67111528
[pid=24395] ppid=24393 vsize=18324 CPUtime=0.06 cores=0-7
/proc/24395/stat : 24395 (ppfolio) S 24393 24395 24162 0 -1 4202496 519 0 0 0 1 5 0 0 15 0 1 0 590669569 18763776 389 33554432000 4194304 4287625 140733307648544 18446744073709551615 251367566863 0 0 4096 65536 4189429164874399743 0 0 17 0 0 0 0
/proc/24395/statm: 4581 389 341 23 0 91 0
[pid=24396] ppid=24395 vsize=1919792 CPUtime=5004.01 cores=0
/proc/24396/stat : 24396 (cryptominisat) R 24395 24395 24162 0 -1 4202496 7523249 0 0 0 498843 1558 0 0 25 0 1 0 590669570 1965867008 187775 33554432000 4194304 4587354 140737166817584 18446744073709551615 4230266 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/24396/statm: 479948 187775 340 96 0 476510 0
[pid=24397] ppid=24395 vsize=4518168 CPUtime=5003.91 cores=1
/proc/24397/stat : 24397 (clasp) R 24395 24395 24162 0 -1 4202496 1129813 0 0 0 500104 287 0 0 25 0 1 0 590669570 4626604032 1122267 33554432000 4194304 4785740 140735825680096 18446744073709551615 4309533 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/24397/statm: 1129542 1122267 340 145 0 1126587 0
[pid=24398] ppid=24395 vsize=530404 CPUtime=5003.42 cores=2
/proc/24398/stat : 24398 (TNM) R 24395 24395 24162 0 -1 4202496 30800 0 0 0 500338 4 0 0 25 0 1 0 590669570 543133696 30697 33554432000 134512640 134534564 4294029424 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/24398/statm: 132601 30697 95 6 0 131267 0
[pid=24399] ppid=24395 vsize=416720 CPUtime=5004.05 cores=3
/proc/24399/stat : 24399 (march_hi) R 24395 24395 24162 0 -1 4202496 443776 0 0 0 500342 63 0 0 25 0 1 0 590669570 426721280 54470 33554432000 4194304 4331988 140736855013328 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/24399/statm: 104180 54470 175 34 0 102622 0
[pid=24400] ppid=24395 vsize=1097724 CPUtime=19985.2 cores=4-7
/proc/24400/stat : 24400 (plingeling) S 24395 24395 24162 0 -1 4202496 3513013 1253 0 0 1997999 518 0 0 18 0 5 0 590669570 1124069376 262875 33554432000 4194304 4356188 140736320506128 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/24400/statm: 274431 262875 164 40 0 272975 0
[pid=24400/tid=24407] ppid=24395 vsize=1097724 CPUtime=4975.99 cores=4-7
/proc/24400/task/24407/stat : 24407 (plingeling) R 24395 24395 24162 0 -1 4202560 874970 1253 0 0 497471 128 0 0 25 0 5 0 590669647 1124069376 262875 33554432000 4194304 4356188 140736320506128 18446744073709551615 4331835 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=24400/tid=24408] ppid=24395 vsize=1097724 CPUtime=5002.45 cores=4-7
/proc/24400/task/24408/stat : 24408 (plingeling) R 24395 24395 24162 0 -1 4202560 880152 1253 0 0 500115 130 0 0 25 0 5 0 590669647 1124069376 262875 33554432000 4194304 4356188 140736320506128 18446744073709551615 4242643 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=24400/tid=24409] ppid=24395 vsize=1097724 CPUtime=5002.63 cores=4-7
/proc/24400/task/24409/stat : 24409 (plingeling) R 24395 24395 24162 0 -1 4202560 909736 1253 0 0 500129 134 0 0 25 0 5 0 590669647 1124069376 262875 33554432000 4194304 4356188 140736320506128 18446744073709551615 4281782 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=24400/tid=24410] ppid=24395 vsize=1097724 CPUtime=5003.29 cores=4-7
/proc/24400/task/24410/stat : 24410 (plingeling) R 24395 24395 24162 0 -1 4202560 822324 1253 0 0 500208 121 0 0 25 0 5 0 590669647 1124069376 262875 33554432000 4194304 4356188 140736320506128 18446744073709551615 4281771 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 8501132

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24395 and gives
#  childrusage.ru_utime.tv_sec=5003
#  childrusage.ru_utime.tv_usec=402367
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=108983
# CPU time returned by wait4() is 5003.51
# while last known CPU time is 40000.6
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.92
CPU time (s): 40000.6
CPU user time (s): 39976.3
CPU system time (s): 24.35
CPU usage (%): 799.385
Max. virtual memory (cumulated for all children) (KiB): 9306620

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5003.4
system time used= 0.108983
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 31321
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11612
involuntary context switches= 14932

runsolver used 8.14676 second user time and 19.1581 second system time

The end

Launcher Data 

Begin job on node113 at 2011-04-28 17:26:29
IDJOB=3310221
IDBENCH=82369
IDSOLVER=1638
FILE ID=node113/3310221-1304004388
RUNJOBID= node113-1304004200-24176
PBS_JOBID= 13168815
Free space on /tmp= 71152 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310221-1304004388/watcher-3310221-1304004388 -o /tmp/evaluation-result-3310221-1304004388/solver-3310221-1304004388 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3310221-1304004388.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 0385ba51f44fb47d0b0726e26312816f
RANDOM SEED=360638867

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12950256 kB
Buffers:       1871252 kB
Cached:       17464992 kB
SwapCached:          0 kB
Active:       10782860 kB
Inactive:      8616940 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12950256 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           25236 kB
Writeback:           0 kB
AnonPages:       63128 kB
Mapped:          14896 kB
Slab:           533948 kB
PageTables:       4512 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   184584 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71140 MiB
End job on node113 at 2011-04-28 18:49:55