Trace number 3275881

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.1 5003.62

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_50_30_20_5-log.shuffled-as.sat03-111.cnf
MD5SUMab60d1d6c6130bc12a1aa4855d06424a
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1606.57
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses55222
Sum of the clauses size551920
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 560
Number of clauses of size over 555162

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275881-1304171486/watcher-3275881-1304171486 -o /tmp/evaluation-result-3275881-1304171486/solver-3275881-1304171486 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275881-1304171486.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.00 8.03 8.00 1/170 30514
/proc/meminfo: memFree=30710120/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 6 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0

[startup+0.0487951 s]
/proc/loadavg: 8.00 8.03 8.00 1/170 30514
/proc/meminfo: memFree=30710120/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100788 s]
/proc/loadavg: 8.00 8.03 8.00 1/170 30514
/proc/meminfo: memFree=30710120/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300724 s]
/proc/loadavg: 8.00 8.03 8.00 1/170 30514
/proc/meminfo: memFree=30710120/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700655 s]
/proc/loadavg: 8.00 8.03 8.00 1/170 30514
/proc/meminfo: memFree=30710120/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50052 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 30529
/proc/meminfo: memFree=30627336/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
[pid=30515] ppid=30514 vsize=28108 CPUtime=1.49 cores=0
/proc/30515/stat : 30515 (cryptominisat) R 30514 30514 29580 0 -1 4202496 2450 0 0 0 149 0 0 0 20 0 1 0 607379266 28782592 2273 33554432000 4194304 4587354 140736380714032 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30515/statm: 7027 2273 306 96 0 3589 0
[pid=30516] ppid=30514 vsize=19364 CPUtime=1.49 cores=1
/proc/30516/stat : 30516 (clasp) R 30514 30514 29580 0 -1 4202496 2424 0 0 0 149 0 0 0 20 0 1 0 607379266 19828736 2144 33554432000 4194304 4785740 140737261780960 18446744073709551615 4495651 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30516/statm: 4841 2144 314 145 0 1886 0
[pid=30517] ppid=30514 vsize=461264 CPUtime=1.49 cores=2
/proc/30517/stat : 30517 (TNM) R 30514 30514 29580 0 -1 4202496 2814 0 0 0 149 0 0 0 20 0 1 0 607379266 472334336 2710 33554432000 134512640 134534564 4294897344 18446744073709551615 134524550 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30517/statm: 115316 2710 91 6 0 113982 0
[pid=30518] ppid=30514 vsize=19256 CPUtime=1.49 cores=3
/proc/30518/stat : 30518 (march_hi) R 30514 30514 29580 0 -1 4202496 14459 0 0 0 147 2 0 0 20 0 1 0 607379266 19718144 2828 33554432000 4194304 4331988 140735545282672 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30518/statm: 4814 2828 150 34 0 3256 0
[pid=30519] ppid=30514 vsize=95688 CPUtime=5.54 cores=4-7
/proc/30519/stat : 30519 (plingeling) S 30514 30514 29580 0 -1 4202496 15635 1249 0 0 552 2 0 0 20 0 5 0 607379266 97984512 12346 33554432000 4194304 4356188 140737447472912 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/30519/statm: 23922 12346 162 40 0 22466 0
[pid=30519/tid=30526] ppid=30514 vsize=95688 CPUtime=1.35 cores=4-7
/proc/30519/task/30526/stat : 30526 (plingeling) R 30514 30514 29580 0 -1 4202560 2315 1249 0 0 135 0 0 0 25 0 5 0 607379280 97984512 12346 33554432000 4194304 4356188 140737447472912 18446744073709551615 4276935 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30519/tid=30527] ppid=30514 vsize=95688 CPUtime=1.34 cores=4-7
/proc/30519/task/30527/stat : 30527 (plingeling) R 30514 30514 29580 0 -1 4202560 2330 1249 0 0 134 0 0 0 25 0 5 0 607379280 97984512 12346 33554432000 4194304 4356188 140737447472912 18446744073709551615 4248448 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30519/tid=30528] ppid=30514 vsize=95688 CPUtime=1.34 cores=4-7
/proc/30519/task/30528/stat : 30528 (plingeling) R 30514 30514 29580 0 -1 4202560 2337 1249 0 0 134 0 0 0 25 0 5 0 607379280 97984512 12346 33554432000 4194304 4356188 140737447472912 18446744073709551615 4248346 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30519/tid=30529] ppid=30514 vsize=95688 CPUtime=1.34 cores=4-7
/proc/30519/task/30529/stat : 30529 (plingeling) R 30514 30514 29580 0 -1 4202560 1991 1249 0 0 134 0 0 0 25 0 5 0 607379280 97984512 12346 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331337 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.5
Current children cumulated vsize (KiB) 642004

[startup+3.10125 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 30529
/proc/meminfo: memFree=30617168/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 17 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
[pid=30515] ppid=30514 vsize=45016 CPUtime=3.09 cores=0
/proc/30515/stat : 30515 (cryptominisat) R 30514 30514 29580 0 -1 4202496 9462 0 0 0 308 1 0 0 25 0 1 0 607379266 46096384 6301 33554432000 4194304 4587354 140736380714032 18446744073709551615 4388368 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30515/statm: 11254 6301 315 96 0 7816 0
[pid=30516] ppid=30514 vsize=19728 CPUtime=3.09 cores=1
/proc/30516/stat : 30516 (clasp) R 30514 30514 29580 0 -1 4202496 2491 0 0 0 309 0 0 0 25 0 1 0 607379266 20201472 2211 33554432000 4194304 4785740 140737261780960 18446744073709551615 4495525 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30516/statm: 4932 2211 314 145 0 1977 0
[pid=30517] ppid=30514 vsize=461264 CPUtime=3.08 cores=2
/proc/30517/stat : 30517 (TNM) R 30514 30514 29580 0 -1 4202496 2814 0 0 0 308 0 0 0 25 0 1 0 607379266 472334336 2710 33554432000 134512640 134534564 4294897344 18446744073709551615 134524664 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30517/statm: 115316 2710 91 6 0 113982 0
[pid=30518] ppid=30514 vsize=19256 CPUtime=3.09 cores=3
/proc/30518/stat : 30518 (march_hi) R 30514 30514 29580 0 -1 4202496 14459 0 0 0 307 2 0 0 25 0 1 0 607379266 19718144 2828 33554432000 4194304 4331988 140735545282672 18446744073709551615 4226642 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30518/statm: 4814 2828 150 34 0 3256 0
[pid=30519] ppid=30514 vsize=92372 CPUtime=11.94 cores=4-7
/proc/30519/stat : 30519 (plingeling) S 30514 30514 29580 0 -1 4202496 16980 1249 0 0 1192 2 0 0 20 0 5 0 607379266 94588928 11549 33554432000 4194304 4356188 140737447472912 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/30519/statm: 23093 11549 162 40 0 21637 0
[pid=30519/tid=30526] ppid=30514 vsize=92372 CPUtime=2.95 cores=4-7
/proc/30519/task/30526/stat : 30526 (plingeling) R 30514 30514 29580 0 -1 4202560 2315 1249 0 0 295 0 0 0 25 0 5 0 607379280 94588928 11549 33554432000 4194304 4356188 140737447472912 18446744073709551615 4277072 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30519/tid=30527] ppid=30514 vsize=92372 CPUtime=2.94 cores=4-7
/proc/30519/task/30527/stat : 30527 (plingeling) R 30514 30514 29580 0 -1 4202560 2472 1249 0 0 294 0 0 0 25 0 5 0 607379280 94588928 11549 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331119 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30519/tid=30528] ppid=30514 vsize=92372 CPUtime=2.94 cores=4-7
/proc/30519/task/30528/stat : 30528 (plingeling) R 30514 30514 29580 0 -1 4202560 2337 1249 0 0 294 0 0 0 25 0 5 0 607379280 94588928 11549 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331042 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30519/tid=30529] ppid=30514 vsize=92372 CPUtime=2.93 cores=4-7
/proc/30519/task/30529/stat : 30529 (plingeling) R 30514 30514 29580 0 -1 4202560 3194 1249 0 0 293 0 0 0 25 0 5 0 607379280 94588928 11549 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331281 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.29
Current children cumulated vsize (KiB) 655960

[startup+6.30072 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 30529
/proc/meminfo: memFree=30610476/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
[pid=30515] ppid=30514 vsize=3759568 CPUtime=6.29 cores=0
/proc/30515/stat : 30515 (cryptominisat) R 30514 30514 29580 0 -1 4202496 15039 0 0 0 627 2 0 0 25 0 1 0 607379266 3849797632 7022 33554432000 4194304 4587354 140736380714032 18446744073709551615 4365154 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30515/statm: 939892 7022 337 96 0 936454 0
[pid=30516] ppid=30514 vsize=24016 CPUtime=6.29 cores=1
/proc/30516/stat : 30516 (clasp) R 30514 30514 29580 0 -1 4202496 3706 0 0 0 629 0 0 0 25 0 1 0 607379266 24592384 3248 33554432000 4194304 4785740 140737261780960 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30516/statm: 6004 3248 340 145 0 3049 0
[pid=30517] ppid=30514 vsize=461264 CPUtime=6.28 cores=2
/proc/30517/stat : 30517 (TNM) R 30514 30514 29580 0 -1 4202496 2814 0 0 0 628 0 0 0 25 0 1 0 607379266 472334336 2710 33554432000 134512640 134534564 4294897344 18446744073709551615 134524573 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30517/statm: 115316 2710 91 6 0 113982 0
[pid=30518] ppid=30514 vsize=19512 CPUtime=6.29 cores=3
/proc/30518/stat : 30518 (march_hi) R 30514 30514 29580 0 -1 4202496 14503 0 0 0 627 2 0 0 25 0 1 0 607379266 19980288 2872 33554432000 4194304 4331988 140735545282672 18446744073709551615 4271184 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30518/statm: 4878 2872 150 34 0 3320 0
[pid=30519] ppid=30514 vsize=85780 CPUtime=24.72 cores=4-7
/proc/30519/stat : 30519 (plingeling) S 30514 30514 29580 0 -1 4202496 19385 1249 0 0 2469 3 0 0 20 0 5 0 607379266 87838720 9901 33554432000 4194304 4356188 140737447472912 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/30519/statm: 21445 9901 162 40 0 19989 0
[pid=30519/tid=30526] ppid=30514 vsize=85780 CPUtime=6.15 cores=4-7
/proc/30519/task/30526/stat : 30526 (plingeling) R 30514 30514 29580 0 -1 4202560 2813 1249 0 0 615 0 0 0 25 0 5 0 607379280 87838720 9901 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30519/tid=30527] ppid=30514 vsize=85780 CPUtime=6.14 cores=4-7
/proc/30519/task/30527/stat : 30527 (plingeling) R 30514 30514 29580 0 -1 4202560 2911 1249 0 0 614 0 0 0 25 0 5 0 607379280 87838720 9901 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331086 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30519/tid=30528] ppid=30514 vsize=85780 CPUtime=6.14 cores=4-7
/proc/30519/task/30528/stat : 30528 (plingeling) R 30514 30514 29580 0 -1 4202560 2710 1249 0 0 614 0 0 0 25 0 5 0 607379280 87838720 9901 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30519/tid=30529] ppid=30514 vsize=85780 CPUtime=6.12 cores=4-7
/proc/30519/task/30529/stat : 30529 (plingeling) R 30514 30514 29580 0 -1 4202560 4289 1249 0 0 611 1 0 0 25 0 5 0 607379280 87838720 9901 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331133 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.87
Current children cumulated vsize (KiB) 4368464

[startup+12.7007 s]
/proc/loadavg: 8.00 8.02 8.00 9/180 30529
/proc/meminfo: memFree=30590136/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
[pid=30515] ppid=30514 vsize=3759568 CPUtime=12.68 cores=0
/proc/30515/stat : 30515 (cryptominisat) R 30514 30514 29580 0 -1 4202496 15371 0 0 0 1266 2 0 0 25 0 1 0 607379266 3849797632 7341 33554432000 4194304 4587354 140736380714032 18446744073709551615 224284925824 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30515/statm: 939892 7341 337 96 0 936454 0
[pid=30516] ppid=30514 vsize=26884 CPUtime=12.69 cores=1
/proc/30516/stat : 30516 (clasp) R 30514 30514 29580 0 -1 4202496 4381 0 0 0 1269 0 0 0 25 0 1 0 607379266 27529216 3923 33554432000 4194304 4785740 140737261780960 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30516/statm: 6721 3923 340 145 0 3766 0
[pid=30517] ppid=30514 vsize=461264 CPUtime=12.68 cores=2
/proc/30517/stat : 30517 (TNM) R 30514 30514 29580 0 -1 4202496 2814 0 0 0 1268 0 0 0 25 0 1 0 607379266 472334336 2710 33554432000 134512640 134534564 4294897344 18446744073709551615 134524554 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30517/statm: 115316 2710 91 6 0 113982 0
[pid=30518] ppid=30514 vsize=20688 CPUtime=12.69 cores=3
/proc/30518/stat : 30518 (march_hi) R 30514 30514 29580 0 -1 4202496 14785 0 0 0 1267 2 0 0 25 0 1 0 607379266 21184512 3154 33554432000 4194304 4331988 140735545282672 18446744073709551615 4226645 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30518/statm: 5172 3154 150 34 0 3614 0
[pid=30519] ppid=30514 vsize=102256 CPUtime=50.28 cores=4-7
/proc/30519/stat : 30519 (plingeling) S 30514 30514 29580 0 -1 4202496 27049 1249 0 0 5024 4 0 0 20 0 5 0 607379266 104710144 14019 33554432000 4194304 4356188 140737447472912 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/30519/statm: 25564 14019 162 40 0 24108 0
[pid=30519/tid=30526] ppid=30514 vsize=102256 CPUtime=12.55 cores=4-7
/proc/30519/task/30526/stat : 30526 (plingeling) R 30514 30514 29580 0 -1 4202560 4798 1249 0 0 1255 0 0 0 25 0 5 0 607379280 104710144 14019 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30519/tid=30527] ppid=30514 vsize=102256 CPUtime=12.55 cores=4-7
/proc/30519/task/30527/stat : 30527 (plingeling) R 30514 30514 29580 0 -1 4202560 5489 1249 0 0 1254 1 0 0 25 0 5 0 607379280 104710144 14019 33554432000 4194304 4356188 140737447472912 18446744073709551615 4281652 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30519/tid=30528] ppid=30514 vsize=102256 CPUtime=12.54 cores=4-7
/proc/30519/task/30528/stat : 30528 (plingeling) R 30514 30514 29580 0 -1 4202560 4388 1249 0 0 1254 0 0 0 25 0 5 0 607379280 104710144 14019 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331792 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30519/tid=30529] ppid=30514 vsize=102256 CPUtime=12.48 cores=4-7
/proc/30519/task/30529/stat : 30529 (plingeling) R 30514 30514 29580 0 -1 4202560 5712 1249 0 0 1247 1 0 0 25 0 5 0 607379280 104710144 14019 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.02
Current children cumulated vsize (KiB) 4388984

[startup+25.5005 s]
/proc/loadavg: 8.00 8.02 8.00 9/180 30529
/proc/meminfo: memFree=30568356/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
[pid=30515] ppid=30514 vsize=54452 CPUtime=25.49 cores=0
/proc/30515/stat : 30515 (cryptominisat) R 30514 30514 29580 0 -1 4202496 19492 0 0 0 2546 3 0 0 25 0 1 0 607379266 55758848 10310 33554432000 4194304 4587354 140736380714032 18446744073709551615 4232120 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=30517] ppid=30514 vsize=465224 CPUtime=4782.34 cores=2
/proc/30517/stat : 30517 (TNM) R 30514 30514 29580 0 -1 4202496 3141 0 0 0 478232 2 0 0 25 0 1 0 607379266 476389376 3037 33554432000 134512640 134534564 4294897344 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30517/statm: 116306 3037 95 6 0 114972 0
[pid=30518] ppid=30514 vsize=63324 CPUtime=4782.19 cores=3
/proc/30518/stat : 30518 (march_hi) R 30514 30514 29580 0 -1 4202496 35347 0 0 0 478210 9 0 0 25 0 1 0 607379266 64843776 11924 33554432000 4194304 4331988 140735545282672 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30518/statm: 15831 11924 175 34 0 14273 0
[pid=30519] ppid=30514 vsize=309304 CPUtime=19101.7 cores=4-7
/proc/30519/stat : 30519 (plingeling) S 30514 30514 29580 0 -1 4202496 1788430 1249 0 0 1909902 263 0 0 20 0 5 0 607379266 316727296 65782 33554432000 4194304 4356188 140737447472912 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/30519/statm: 77326 65782 162 40 0 75870 0
[pid=30519/tid=30526] ppid=30514 vsize=309304 CPUtime=4782.21 cores=4-7
/proc/30519/task/30526/stat : 30526 (plingeling) R 30514 30514 29580 0 -1 4202560 442365 1249 0 0 478159 62 0 0 25 0 5 0 607379280 316727296 65782 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30519/tid=30527] ppid=30514 vsize=309304 CPUtime=4782.21 cores=4-7
/proc/30519/task/30527/stat : 30527 (plingeling) R 30514 30514 29580 0 -1 4202560 426841 1249 0 0 478157 64 0 0 25 0 5 0 607379280 316727296 65782 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30519/tid=30528] ppid=30514 vsize=309304 CPUtime=4781.75 cores=4-7
/proc/30519/task/30528/stat : 30528 (plingeling) R 30514 30514 29580 0 -1 4202560 448637 1249 0 0 478111 64 0 0 25 0 5 0 607379280 316727296 65782 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30519/tid=30529] ppid=30514 vsize=309304 CPUtime=4755.31 cores=4-7
/proc/30519/task/30529/stat : 30529 (plingeling) R 30514 30514 29580 0 -1 4202560 463925 1249 0 0 475460 71 0 0 25 0 5 0 607379280 316727296 65782 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38230.9
Current children cumulated vsize (KiB) 1033264

[startup+4842.3 s]
/proc/loadavg: 8.08 8.04 8.00 9/180 30680
/proc/meminfo: memFree=30252892/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
[pid=30515] ppid=30514 vsize=79528 CPUtime=4842.35 cores=0
/proc/30515/stat : 30515 (cryptominisat) R 30514 30514 29580 0 -1 4202496 577752 0 0 0 484008 227 0 0 25 0 1 0 607379266 81436672 15235 33554432000 4194304 4587354 140736380714032 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30515/statm: 19882 15235 337 96 0 16444 0
[pid=30516] ppid=30514 vsize=97636 CPUtime=4842.33 cores=1
/proc/30516/stat : 30516 (clasp) R 30514 30514 29580 0 -1 4202496 20750 0 0 0 484229 4 0 0 25 0 1 0 607379266 99979264 20131 33554432000 4194304 4785740 140737261780960 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30516/statm: 24409 20131 340 145 0 21454 0
[pid=30517] ppid=30514 vsize=465224 CPUtime=4842.34 cores=2
/proc/30517/stat : 30517 (TNM) R 30514 30514 29580 0 -1 4202496 3141 0 0 0 484232 2 0 0 25 0 1 0 607379266 476389376 3037 33554432000 134512640 134534564 4294897344 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30517/statm: 116306 3037 95 6 0 114972 0
[pid=30518] ppid=30514 vsize=63324 CPUtime=4842.18 cores=3
/proc/30518/stat : 30518 (march_hi) R 30514 30514 29580 0 -1 4202496 35391 0 0 0 484209 9 0 0 25 0 1 0 607379266 64843776 11968 33554432000 4194304 4331988 140735545282672 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30518/statm: 15831 11968 175 34 0 14273 0
[pid=30519] ppid=30514 vsize=304440 CPUtime=19341.3 cores=4-7
/proc/30519/stat : 30519 (plingeling) S 30514 30514 29580 0 -1 4202496 1807246 1249 0 0 1933865 267 0 0 20 0 5 0 607379266 311746560 64566 33554432000 4194304 4356188 140737447472912 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/30519/statm: 76110 64566 162 40 0 74654 0
[pid=30519/tid=30526] ppid=30514 vsize=304440 CPUtime=4842.21 cores=4-7
/proc/30519/task/30526/stat : 30526 (plingeling) R 30514 30514 29580 0 -1 4202560 445117 1249 0 0 484159 62 0 0 25 0 5 0 607379280 311746560 64566 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30519/tid=30527] ppid=30514 vsize=304440 CPUtime=4842.21 cores=4-7
/proc/30519/task/30527/stat : 30527 (plingeling) R 30514 30514 29580 0 -1 4202560 429657 1249 0 0 484157 64 0 0 25 0 5 0 607379280 311746560 64566 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30519/tid=30528] ppid=30514 vsize=304440 CPUtime=4841.74 cores=4-7
/proc/30519/task/30528/stat : 30528 (plingeling) R 30514 30514 29580 0 -1 4202560 459197 1249 0 0 484107 67 0 0 25 0 5 0 607379280 311746560 64566 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331002 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30519/tid=30529] ppid=30514 vsize=304440 CPUtime=4814.98 cores=4-7
/proc/30519/task/30529/stat : 30529 (plingeling) R 30514 30514 29580 0 -1 4202560 466613 1249 0 0 481426 72 0 0 25 0 5 0 607379280 311746560 64566 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331047 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38710.5
Current children cumulated vsize (KiB) 1028476

[startup+4902.3 s]
/proc/loadavg: 8.09 8.04 8.00 9/180 30682
/proc/meminfo: memFree=30220116/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
[pid=30515] ppid=30514 vsize=79592 CPUtime=4902.36 cores=0
/proc/30515/stat : 30515 (cryptominisat) R 30514 30514 29580 0 -1 4202496 583676 0 0 0 490006 230 0 0 25 0 1 0 607379266 81502208 14013 33554432000 4194304 4587354 140736380714032 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30515/statm: 19898 14013 337 96 0 16460 0
[pid=30516] ppid=30514 vsize=97956 CPUtime=4902.33 cores=1
/proc/30516/stat : 30516 (clasp) R 30514 30514 29580 0 -1 4202496 20980 0 0 0 490229 4 0 0 25 0 1 0 607379266 100306944 20200 33554432000 4194304 4785740 140737261780960 18446744073709551615 4538892 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30516/statm: 24489 20200 340 145 0 21534 0
[pid=30517] ppid=30514 vsize=465224 CPUtime=4902.34 cores=2
/proc/30517/stat : 30517 (TNM) R 30514 30514 29580 0 -1 4202496 3141 0 0 0 490232 2 0 0 25 0 1 0 607379266 476389376 3037 33554432000 134512640 134534564 4294897344 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30517/statm: 116306 3037 95 6 0 114972 0
[pid=30518] ppid=30514 vsize=63324 CPUtime=4902.19 cores=3
/proc/30518/stat : 30518 (march_hi) R 30514 30514 29580 0 -1 4202496 35453 0 0 0 490209 10 0 0 25 0 1 0 607379266 64843776 12030 33554432000 4194304 4331988 140735545282672 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30518/statm: 15831 12030 175 34 0 14273 0
[pid=30519] ppid=30514 vsize=339896 CPUtime=19581 cores=4-7
/proc/30519/stat : 30519 (plingeling) S 30514 30514 29580 0 -1 4202496 1825358 1249 0 0 1957829 271 0 0 20 0 5 0 607379266 348053504 73430 33554432000 4194304 4356188 140737447472912 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/30519/statm: 84974 73430 162 40 0 83518 0
[pid=30519/tid=30526] ppid=30514 vsize=339896 CPUtime=4902.21 cores=4-7
/proc/30519/task/30526/stat : 30526 (plingeling) R 30514 30514 29580 0 -1 4202560 448253 1249 0 0 490159 62 0 0 25 0 5 0 607379280 348053504 73430 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331151 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30519/tid=30527] ppid=30514 vsize=339896 CPUtime=4902.22 cores=4-7
/proc/30519/task/30527/stat : 30527 (plingeling) R 30514 30514 29580 0 -1 4202560 432409 1249 0 0 490157 65 0 0 25 0 5 0 607379280 348053504 73430 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30519/tid=30528] ppid=30514 vsize=339896 CPUtime=4901.73 cores=4-7
/proc/30519/task/30528/stat : 30528 (plingeling) R 30514 30514 29580 0 -1 4202560 462077 1249 0 0 490106 67 0 0 25 0 5 0 607379280 348053504 73430 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30519/tid=30529] ppid=30514 vsize=339896 CPUtime=4874.66 cores=4-7
/proc/30519/task/30529/stat : 30529 (plingeling) R 30514 30514 29580 0 -1 4202560 475957 1249 0 0 487392 74 0 0 25 0 5 0 607379280 348053504 73430 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331323 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39190.2
Current children cumulated vsize (KiB) 1064316

[startup+4962.3 s]
/proc/loadavg: 8.08 8.05 8.00 9/180 30682
/proc/meminfo: memFree=30224392/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
[pid=30515] ppid=30514 vsize=174896 CPUtime=4962.36 cores=0
/proc/30515/stat : 30515 (cryptominisat) R 30514 30514 29580 0 -1 4202496 587095 0 0 0 496004 232 0 0 25 0 1 0 607379266 179093504 17299 33554432000 4194304 4587354 140736380714032 18446744073709551615 4238692 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30515/statm: 43724 17299 337 96 0 40286 0
[pid=30516] ppid=30514 vsize=98276 CPUtime=4962.33 cores=1
/proc/30516/stat : 30516 (clasp) R 30514 30514 29580 0 -1 4202496 21154 0 0 0 496229 4 0 0 25 0 1 0 607379266 100634624 20213 33554432000 4194304 4785740 140737261780960 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30516/statm: 24569 20213 340 145 0 21614 0
[pid=30517] ppid=30514 vsize=465224 CPUtime=4962.35 cores=2
/proc/30517/stat : 30517 (TNM) R 30514 30514 29580 0 -1 4202496 3141 0 0 0 496233 2 0 0 25 0 1 0 607379266 476389376 3037 33554432000 134512640 134534564 4294897344 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30517/statm: 116306 3037 95 6 0 114972 0
[pid=30518] ppid=30514 vsize=72056 CPUtime=4962.19 cores=3
/proc/30518/stat : 30518 (march_hi) R 30514 30514 29580 0 -1 4202496 35497 0 0 0 496209 10 0 0 25 0 1 0 607379266 73785344 12074 33554432000 4194304 4331988 140735545282672 18446744073709551615 4239602 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30518/statm: 18014 12074 175 34 0 16456 0
[pid=30519] ppid=30514 vsize=325432 CPUtime=19820.7 cores=4-7
/proc/30519/stat : 30519 (plingeling) S 30514 30514 29580 0 -1 4202496 1835694 1249 0 0 1981794 272 0 0 20 0 5 0 607379266 333242368 69814 33554432000 4194304 4356188 140737447472912 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/30519/statm: 81358 69814 162 40 0 79902 0
[pid=30519/tid=30526] ppid=30514 vsize=325432 CPUtime=4962.22 cores=4-7
/proc/30519/task/30526/stat : 30526 (plingeling) R 30514 30514 29580 0 -1 4202560 450845 1249 0 0 496159 63 0 0 25 0 5 0 607379280 333242368 69814 33554432000 4194304 4356188 140737447472912 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30519/tid=30527] ppid=30514 vsize=325432 CPUtime=4962.22 cores=4-7
/proc/30519/task/30527/stat : 30527 (plingeling) R 30514 30514 29580 0 -1 4202560 435289 1249 0 0 496157 65 0 0 25 0 5 0 607379280 333242368 69814 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30519/tid=30528] ppid=30514 vsize=325432 CPUtime=4961.73 cores=4-7
/proc/30519/task/30528/stat : 30528 (plingeling) R 30514 30514 29580 0 -1 4202560 464125 1249 0 0 496106 67 0 0 25 0 5 0 607379280 333242368 69814 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331122 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30519/tid=30529] ppid=30514 vsize=325432 CPUtime=4934.33 cores=4-7
/proc/30519/task/30529/stat : 30529 (plingeling) R 30514 30514 29580 0 -1 4202560 478773 1249 0 0 493358 75 0 0 25 0 5 0 607379280 333242368 69814 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39669.9
Current children cumulated vsize (KiB) 1154208



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.6 s]
/proc/loadavg: 8.11 8.06 8.00 9/180 30684
/proc/meminfo: memFree=30211844/32951124 swapFree=67103364/67111528
[pid=30514] ppid=30512 vsize=18324 CPUtime=0 cores=0-7
/proc/30514/stat : 30514 (ppfolio) S 30512 30514 29580 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 607379266 18763776 390 33554432000 4194304 4287625 140733263336752 18446744073709551615 224284945935 0 0 4096 65536 11031004616463482879 0 0 17 4 0 0 0
/proc/30514/statm: 4581 390 341 23 0 91 0
[pid=30515] ppid=30514 vsize=79656 CPUtime=5003.66 cores=0
/proc/30515/stat : 30515 (cryptominisat) R 30514 30514 29580 0 -1 4202496 592460 0 0 0 500133 233 0 0 25 0 1 0 607379266 81567744 15498 33554432000 4194304 4587354 140736380714032 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/30515/statm: 19914 15498 337 96 0 16476 0
[pid=30516] ppid=30514 vsize=98276 CPUtime=5003.64 cores=1
/proc/30516/stat : 30516 (clasp) R 30514 30514 29580 0 -1 4202496 21154 0 0 0 500360 4 0 0 25 0 1 0 607379266 100634624 20213 33554432000 4194304 4785740 140737261780960 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/30516/statm: 24569 20213 340 145 0 21614 0
[pid=30517] ppid=30514 vsize=465224 CPUtime=5003.65 cores=2
/proc/30517/stat : 30517 (TNM) R 30514 30514 29580 0 -1 4202496 3141 0 0 0 500363 2 0 0 25 0 1 0 607379266 476389376 3037 33554432000 134512640 134534564 4294897344 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/30517/statm: 116306 3037 95 6 0 114972 0
[pid=30518] ppid=30514 vsize=72056 CPUtime=5003.5 cores=3
/proc/30518/stat : 30518 (march_hi) R 30514 30514 29580 0 -1 4202496 35534 0 0 0 500340 10 0 0 25 0 1 0 607379266 73785344 12111 33554432000 4194304 4331988 140735545282672 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/30518/statm: 18014 12111 175 34 0 16456 0
[pid=30519] ppid=30514 vsize=342840 CPUtime=19985.7 cores=4-7
/proc/30519/stat : 30519 (plingeling) S 30514 30514 29580 0 -1 4202496 1857422 1249 0 0 1998289 277 0 0 20 0 5 0 607379266 351068160 74166 33554432000 4194304 4356188 140737447472912 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/30519/statm: 85710 74166 162 40 0 84254 0
[pid=30519/tid=30526] ppid=30514 vsize=342840 CPUtime=5003.53 cores=4-7
/proc/30519/task/30526/stat : 30526 (plingeling) R 30514 30514 29580 0 -1 4202560 459773 1249 0 0 500288 65 0 0 25 0 5 0 607379280 351068160 74166 33554432000 4194304 4356188 140737447472912 18446744073709551615 4332260 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30519/tid=30527] ppid=30514 vsize=342840 CPUtime=5003.52 cores=4-7
/proc/30519/task/30527/stat : 30527 (plingeling) R 30514 30514 29580 0 -1 4202560 443737 1249 0 0 500285 67 0 0 25 0 5 0 607379280 351068160 74166 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30519/tid=30528] ppid=30514 vsize=342840 CPUtime=5003.04 cores=4-7
/proc/30519/task/30528/stat : 30528 (plingeling) R 30514 30514 29580 0 -1 4202560 466173 1249 0 0 500236 68 0 0 25 0 5 0 607379280 351068160 74166 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30519/tid=30529] ppid=30514 vsize=342840 CPUtime=4975.41 cores=4-7
/proc/30519/task/30529/stat : 30529 (plingeling) R 30514 30514 29580 0 -1 4202560 481077 1249 0 0 497466 75 0 0 25 0 5 0 607379280 351068160 74166 33554432000 4194304 4356188 140737447472912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.1
Current children cumulated vsize (KiB) 1076376

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30514 and gives
#  childrusage.ru_utime.tv_sec=20011
#  childrusage.ru_utime.tv_usec=981716
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=529615
# CPU time returned by wait4() is 20014.5
# while last known CPU time is 40000.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.62
CPU time (s): 40000.1
CPU user time (s): 39994.9
CPU system time (s): 5.26
CPU usage (%): 799.424
Max. virtual memory (cumulated for all children) (KiB): 4388984

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 20012
system time used= 2.52961
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 652827
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 804
involuntary context switches= 40512

runsolver used 7.65284 second user time and 19.645 second system time

The end

Launcher Data 

Begin job on node118 at 2011-04-30 15:51:26
IDJOB=3275881
IDBENCH=83930
IDSOLVER=1638
FILE ID=node118/3275881-1304171486
RUNJOBID= node118-1304160367-29594
PBS_JOBID= 13170921
Free space on /tmp= 71932 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_50_30_20_5-log.shuffled-as.sat03-111.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275881-1304171486/watcher-3275881-1304171486 -o /tmp/evaluation-result-3275881-1304171486/solver-3275881-1304171486 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275881-1304171486.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ab60d1d6c6130bc12a1aa4855d06424a
RANDOM SEED=2116139643

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30710400 kB
Buffers:        435796 kB
Cached:        1390372 kB
SwapCached:       2676 kB
Active:         170660 kB
Inactive:      1714900 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30710400 kB
SwapTotal:    67111528 kB
SwapFree:     67103364 kB
Dirty:           12072 kB
Writeback:           0 kB
AnonPages:       58580 kB
Mapped:          14688 kB
Slab:           289868 kB
PageTables:       4672 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188640 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71924 MiB
End job on node118 at 2011-04-30 17:14:52