Trace number 3276326

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.7 5003.62

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m47-q742.5-n45-p30-s17570390.cnf
MD5SUMba3b1702a651cd8da3e6cada8f2e97bc
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.255961
Satisfiable
(Un)Satisfiability was proved
Number of variables2088
Number of clauses405748
Sum of the clauses size813494
Maximum clause length47
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2405703
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3276326-1304175975/watcher-3276326-1304175975 -o /tmp/evaluation-result-3276326-1304175975/solver-3276326-1304175975 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3276326-1304175975.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.68 7.97 7.99 1/170 26790
/proc/meminfo: memFree=27705348/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) R 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0

[startup+0.0463979 s]
/proc/loadavg: 7.68 7.97 7.99 1/170 26790
/proc/meminfo: memFree=27705348/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 4 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100386 s]
/proc/loadavg: 7.68 7.97 7.99 1/170 26790
/proc/meminfo: memFree=27705348/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 4 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.30035 s]
/proc/loadavg: 7.68 7.97 7.99 1/170 26790
/proc/meminfo: memFree=27705348/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 23 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 6 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700275 s]
/proc/loadavg: 7.68 7.97 7.99 1/170 26790
/proc/meminfo: memFree=27705348/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 23 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 6 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50112 s]
/proc/loadavg: 7.68 7.97 7.99 10/180 26805
/proc/meminfo: memFree=27525956/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 6 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
[pid=26791] ppid=26790 vsize=85740 CPUtime=1.48 cores=0
/proc/26791/stat : 26791 (cryptominisat) R 26790 26790 26722 0 -1 4202496 23787 0 0 0 146 2 0 0 25 0 1 0 529197238 87797760 15431 33554432000 4194304 4587354 140734057289008 18446744073709551615 208079928984 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26791/statm: 21435 15431 325 96 0 17997 0
[pid=26792] ppid=26790 vsize=37068 CPUtime=1.49 cores=1
/proc/26792/stat : 26792 (clasp) R 26790 26790 26722 0 -1 4202496 8290 0 0 0 148 1 0 0 20 0 1 0 529197238 37957632 6405 33554432000 4194304 4785740 140736349536928 18446744073709551615 4495647 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26792/statm: 9267 6405 313 145 0 6312 0
[pid=26793] ppid=26790 vsize=470872 CPUtime=1.49 cores=2
/proc/26793/stat : 26793 (TNM) R 26790 26790 26722 0 -1 4202496 6592 0 0 0 149 0 0 0 20 0 1 0 529197238 482172928 6489 33554432000 134512640 134534564 4287785104 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26793/statm: 117718 6489 91 6 0 116384 0
[pid=26794] ppid=26790 vsize=60400 CPUtime=1.49 cores=3
/proc/26794/stat : 26794 (march_hi) R 26790 26790 26722 0 -1 4202496 31754 0 0 0 145 4 0 0 20 0 1 0 529197238 61849600 6933 33554432000 4194304 4331988 140737406139120 18446744073709551615 4226530 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26794/statm: 15100 6933 170 34 0 13542 0
[pid=26795] ppid=26790 vsize=163868 CPUtime=5.21 cores=4-7
/proc/26795/stat : 26795 (plingeling) S 26790 26790 26722 0 -1 4202496 21531 1251 0 0 518 3 0 0 20 0 5 0 529197238 167800832 13009 33554432000 4194304 4356188 140736257336592 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26795/statm: 40967 13009 163 40 0 39511 0
[pid=26795/tid=26802] ppid=26790 vsize=163868 CPUtime=1.24 cores=4-7
/proc/26795/task/26802/stat : 26802 (plingeling) R 26790 26790 26722 0 -1 4202560 3026 1251 0 0 124 0 0 0 25 0 5 0 529197263 167800832 13009 33554432000 4194304 4356188 140736257336592 18446744073709551615 4307072 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26795/tid=26803] ppid=26790 vsize=163868 CPUtime=1.23 cores=4-7
/proc/26795/task/26803/stat : 26803 (plingeling) R 26790 26790 26722 0 -1 4202560 3378 1251 0 0 123 0 0 0 25 0 5 0 529197263 167800832 13009 33554432000 4194304 4356188 140736257336592 18446744073709551615 4210579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26795/tid=26804] ppid=26790 vsize=163868 CPUtime=1.23 cores=4-7
/proc/26795/task/26804/stat : 26804 (plingeling) R 26790 26790 26722 0 -1 4202560 3303 1251 0 0 123 0 0 0 25 0 5 0 529197263 167800832 13009 33554432000 4194304 4356188 140736257336592 18446744073709551615 4210615 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26795/tid=26805] ppid=26790 vsize=163868 CPUtime=1.22 cores=4-7
/proc/26795/task/26805/stat : 26805 (plingeling) R 26790 26790 26722 0 -1 4202560 2938 1251 0 0 122 0 0 0 25 0 5 0 529197263 167800832 13009 33554432000 4194304 4356188 140736257336592 18446744073709551615 4297533 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.16
Current children cumulated vsize (KiB) 836272

[startup+3.10082 s]
/proc/loadavg: 7.68 7.97 7.99 9/180 26805
/proc/meminfo: memFree=27501776/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 6 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
[pid=26791] ppid=26790 vsize=85740 CPUtime=3.09 cores=0
/proc/26791/stat : 26791 (cryptominisat) R 26790 26790 26722 0 -1 4202496 24932 0 0 0 306 3 0 0 25 0 1 0 529197238 87797760 16562 33554432000 4194304 4587354 140734057289008 18446744073709551615 4238591 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26791/statm: 21435 16562 326 96 0 17997 0
[pid=26792] ppid=26790 vsize=39972 CPUtime=3.08 cores=1
/proc/26792/stat : 26792 (clasp) R 26790 26790 26722 0 -1 4202496 9027 0 0 0 307 1 0 0 25 0 1 0 529197238 40931328 7142 33554432000 4194304 4785740 140736349536928 18446744073709551615 4496159 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26792/statm: 9993 7142 316 145 0 7038 0
[pid=26793] ppid=26790 vsize=470872 CPUtime=3.09 cores=2
/proc/26793/stat : 26793 (TNM) R 26790 26790 26722 0 -1 4202496 6592 0 0 0 309 0 0 0 25 0 1 0 529197238 482172928 6489 33554432000 134512640 134534564 4287785104 18446744073709551615 134524591 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26793/statm: 117718 6489 91 6 0 116384 0
[pid=26794] ppid=26790 vsize=60400 CPUtime=3.09 cores=3
/proc/26794/stat : 26794 (march_hi) R 26790 26790 26722 0 -1 4202496 31773 0 0 0 305 4 0 0 25 0 1 0 529197238 61849600 6952 33554432000 4194304 4331988 140737406139120 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26794/statm: 15100 6952 171 34 0 13542 0
[pid=26795] ppid=26790 vsize=178716 CPUtime=11.6 cores=4-7
/proc/26795/stat : 26795 (plingeling) S 26790 26790 26722 0 -1 4202496 24220 1251 0 0 1157 3 0 0 20 0 5 0 529197238 183005184 15698 33554432000 4194304 4356188 140736257336592 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26795/statm: 44679 15698 163 40 0 43223 0
[pid=26795/tid=26802] ppid=26790 vsize=178716 CPUtime=2.84 cores=4-7
/proc/26795/task/26802/stat : 26802 (plingeling) R 26790 26790 26722 0 -1 4202560 3026 1251 0 0 284 0 0 0 25 0 5 0 529197263 183005184 15698 33554432000 4194304 4356188 140736257336592 18446744073709551615 4283885 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26795/tid=26803] ppid=26790 vsize=178716 CPUtime=2.83 cores=4-7
/proc/26795/task/26803/stat : 26803 (plingeling) R 26790 26790 26722 0 -1 4202560 3378 1251 0 0 283 0 0 0 25 0 5 0 529197263 183005184 15698 33554432000 4194304 4356188 140736257336592 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26795/tid=26804] ppid=26790 vsize=178716 CPUtime=2.83 cores=4-7
/proc/26795/task/26804/stat : 26804 (plingeling) R 26790 26790 26722 0 -1 4202560 3303 1251 0 0 283 0 0 0 25 0 5 0 529197263 183005184 15698 33554432000 4194304 4356188 140736257336592 18446744073709551615 4330995 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26795/tid=26805] ppid=26790 vsize=178716 CPUtime=2.81 cores=4-7
/proc/26795/task/26805/stat : 26805 (plingeling) R 26790 26790 26722 0 -1 4202560 5627 1251 0 0 281 0 0 0 25 0 5 0 529197263 183005184 15698 33554432000 4194304 4356188 140736257336592 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.95
Current children cumulated vsize (KiB) 854024

[startup+6.30121 s]
/proc/loadavg: 7.78 7.99 7.99 9/180 26805
/proc/meminfo: memFree=27478356/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 6 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
[pid=26791] ppid=26790 vsize=1866308 CPUtime=6.29 cores=0
/proc/26791/stat : 26791 (cryptominisat) R 26790 26790 26722 0 -1 4202496 27105 0 0 0 626 3 0 0 25 0 1 0 529197238 1911099392 16637 33554432000 4194304 4587354 140734057289008 18446744073709551615 4364488 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26791/statm: 466577 16637 337 96 0 463139 0
[pid=26792] ppid=26790 vsize=41392 CPUtime=6.29 cores=1
/proc/26792/stat : 26792 (clasp) R 26790 26790 26722 0 -1 4202496 10338 0 0 0 627 2 0 0 25 0 1 0 529197238 42385408 7660 33554432000 4194304 4785740 140736349536928 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26792/statm: 10348 7660 340 145 0 7393 0
[pid=26793] ppid=26790 vsize=474172 CPUtime=6.29 cores=2
/proc/26793/stat : 26793 (TNM) R 26790 26790 26722 0 -1 4202496 9543 0 0 0 628 1 0 0 25 0 1 0 529197238 485552128 9440 33554432000 134512640 134534564 4287785104 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26793/statm: 118543 9440 95 6 0 117209 0
[pid=26794] ppid=26790 vsize=61088 CPUtime=6.29 cores=3
/proc/26794/stat : 26794 (march_hi) R 26790 26790 26722 0 -1 4202496 31934 0 0 0 625 4 0 0 25 0 1 0 529197238 62554112 7113 33554432000 4194304 4331988 140737406139120 18446744073709551615 4291920 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26794/statm: 15272 7113 174 34 0 13714 0
[pid=26795] ppid=26790 vsize=194448 CPUtime=24.38 cores=4-7
/proc/26795/stat : 26795 (plingeling) S 26790 26790 26722 0 -1 4202496 40121 1251 0 0 2433 5 0 0 20 0 5 0 529197238 199114752 20654 33554432000 4194304 4356188 140736257336592 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26795/statm: 48612 20654 163 40 0 47156 0
[pid=26795/tid=26802] ppid=26790 vsize=194448 CPUtime=6.04 cores=4-7
/proc/26795/task/26802/stat : 26802 (plingeling) R 26790 26790 26722 0 -1 4202560 6321 1251 0 0 603 1 0 0 25 0 5 0 529197263 199114752 20654 33554432000 4194304 4356188 140736257336592 18446744073709551615 4310864 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26795/tid=26803] ppid=26790 vsize=194448 CPUtime=6.04 cores=4-7
/proc/26795/task/26803/stat : 26803 (plingeling) R 26790 26790 26722 0 -1 4202560 8367 1251 0 0 603 1 0 0 25 0 5 0 529197263 199114752 20654 33554432000 4194304 4356188 140736257336592 18446744073709551615 4211553 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26795/tid=26804] ppid=26790 vsize=194448 CPUtime=6.03 cores=4-7
/proc/26795/task/26804/stat : 26804 (plingeling) R 26790 26790 26722 0 -1 4202560 7879 1251 0 0 603 0 0 0 25 0 5 0 529197263 199114752 20654 33554432000 4194304 4356188 140736257336592 18446744073709551615 4261946 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26795/tid=26805] ppid=26790 vsize=194448 CPUtime=6 cores=4-7
/proc/26795/task/26805/stat : 26805 (plingeling) R 26790 26790 26722 0 -1 4202560 8668 1251 0 0 599 1 0 0 25 0 5 0 529197263 199114752 20654 33554432000 4194304 4356188 140736257336592 18446744073709551615 4210875 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.54
Current children cumulated vsize (KiB) 2655732

[startup+12.701 s]
/proc/loadavg: 7.80 7.99 7.99 9/180 26805
/proc/meminfo: memFree=27421008/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 6 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
[pid=26791] ppid=26790 vsize=1866308 CPUtime=12.69 cores=0
/proc/26791/stat : 26791 (cryptominisat) R 26790 26790 26722 0 -1 4202496 27105 0 0 0 1266 3 0 0 25 0 1 0 529197238 1911099392 16637 33554432000 4194304 4587354 140734057289008 18446744073709551615 4365352 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26791/statm: 466577 16637 337 96 0 463139 0
[pid=26792] ppid=26790 vsize=76444 CPUtime=12.69 cores=1
/proc/26792/stat : 26792 (clasp) R 26790 26790 26722 0 -1 4202496 18996 0 0 0 1265 4 0 0 25 0 1 0 529197238 78278656 16318 33554432000 4194304 4785740 140736349536928 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26792/statm: 19111 16318 340 145 0 16156 0
[pid=26793] ppid=26790 vsize=478004 CPUtime=12.69 cores=2
/proc/26793/stat : 26793 (TNM) R 26790 26790 26722 0 -1 4202496 9544 0 0 0 1268 1 0 0 25 0 1 0 529197238 489476096 9441 33554432000 134512640 134534564 4287785104 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26793/statm: 119501 9441 95 6 0 118167 0
[pid=26794] ppid=26790 vsize=61088 CPUtime=12.69 cores=3
/proc/26794/stat : 26794 (march_hi) R 26790 26790 26722 0 -1 4202496 31957 0 0 0 1265 4 0 0 25 0 1 0 529197238 62554112 7136 33554432000 4194304 4331988 140737406139120 18446744073709551615 4228224 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26794/statm: 15272 7136 174 34 0 13714 0
[pid=26795] ppid=26790 vsize=225608 CPUtime=49.94 cores=4-7
/proc/26795/stat : 26795 (plingeling) S 26790 26790 26722 0 -1 4202496 50953 1251 0 0 4988 6 0 0 20 0 5 0 529197238 231022592 27421 33554432000 4194304 4356188 140736257336592 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26795/statm: 56402 27421 163 40 0 54946 0
[pid=26795/tid=26802] ppid=26790 vsize=225608 CPUtime=12.44 cores=4-7
/proc/26795/task/26802/stat : 26802 (plingeling) R 26790 26790 26722 0 -1 4202560 8369 1251 0 0 1243 1 0 0 25 0 5 0 529197263 231022592 27421 33554432000 4194304 4356188 140736257336592 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26795/tid=26803] ppid=26790 vsize=225608 CPUtime=12.44 cores=4-7
/proc/26795/task/26803/stat : 26803 (plingeling) R 26790 26790 26722 0 -1 4202560 10416 1251 0 0 1243 1 0 0 25 0 5 0 529197263 231022592 27421 33554432000 4194304 4356188 140736257336592 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26795/tid=26804] ppid=26790 vsize=225608 CPUtime=12.43 cores=4-7
/proc/26795/task/26804/stat : 26804 (plingeling) R 26790 26790 26722 0 -1 4202560 10919 1251 0 0 1242 1 0 0 25 0 5 0 529197263 231022592 27421 33554432000 4194304 4356188 140736257336592 18446744073709551615 4244402 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26795/tid=26805] ppid=26790 vsize=225608 CPUtime=12.36 cores=4-7
/proc/26795/task/26805/stat : 26805 (plingeling) R 26790 26790 26722 0 -1 4202560 12363 1251 0 0 1235 1 0 0 25 0 5 0 529197263 231022592 27421 33554432000 4194304 4356188 140736257336592 18446744073709551615 4219472 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.7
Current children cumulated vsize (KiB) 2725776

[startup+25.5006 s]
/proc/loadavg: 7.84 7.99 7.99 9/180 26805
/proc/meminfo: memFree=27299704/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 6 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
[pid=26791] ppid=26790 vsize=1880788 CPUtime=25.49 cores=0
/proc/26791/stat : 26791 (cryptominisat) R 26790 26790 26722 0 -1 4202496 29908 0 0 0 2545 4 0 0 25 0 1 0 529197238 1925926912 19440 33554432000 4194304 4587354 140734057289008 18446744073709551615 4365370 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=26793] ppid=26790 vsize=478004 CPUtime=4782.01 cores=2
/proc/26793/stat : 26793 (TNM) R 26790 26790 26722 0 -1 4202496 9544 0 0 0 478199 2 0 0 25 0 1 0 529197238 489476096 9441 33554432000 134512640 134534564 4287785104 18446744073709551615 134530367 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26793/statm: 119501 9441 95 6 0 118167 0
[pid=26794] ppid=26790 vsize=61616 CPUtime=4781.65 cores=3
/proc/26794/stat : 26794 (march_hi) R 26790 26790 26722 0 -1 4202496 32070 0 0 0 478161 4 0 0 25 0 1 0 529197238 63094784 7249 33554432000 4194304 4331988 140737406139120 18446744073709551615 4228224 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26794/statm: 15404 7249 174 34 0 13846 0
[pid=26795] ppid=26790 vsize=801244 CPUtime=19102.9 cores=4-7
/proc/26795/stat : 26795 (plingeling) S 26790 26790 26722 0 -1 4202496 1791797 1251 0 0 1910050 238 0 0 20 0 5 0 529197238 820473856 172393 33554432000 4194304 4356188 140736257336592 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26795/statm: 200311 172393 163 40 0 198855 0
[pid=26795/tid=26802] ppid=26790 vsize=801244 CPUtime=4782.22 cores=4-7
/proc/26795/task/26802/stat : 26802 (plingeling) R 26790 26790 26722 0 -1 4202560 566975 1251 0 0 478148 74 0 0 25 0 5 0 529197263 820473856 172393 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26795/tid=26803] ppid=26790 vsize=801244 CPUtime=4782.2 cores=4-7
/proc/26795/task/26803/stat : 26803 (plingeling) R 26790 26790 26722 0 -1 4202560 206515 1251 0 0 478190 30 0 0 25 0 5 0 529197263 820473856 172393 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26795/tid=26804] ppid=26790 vsize=801244 CPUtime=4782.21 cores=4-7
/proc/26795/task/26804/stat : 26804 (plingeling) R 26790 26790 26722 0 -1 4202560 280999 1251 0 0 478182 39 0 0 25 0 5 0 529197263 820473856 172393 33554432000 4194304 4356188 140736257336592 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26795/tid=26805] ppid=26790 vsize=801244 CPUtime=4755.98 cores=4-7
/proc/26795/task/26805/stat : 26805 (plingeling) R 26790 26790 26722 0 -1 4202560 728422 1251 0 0 475504 94 0 0 25 0 5 0 529197263 820473856 172393 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38231.5
Current children cumulated vsize (KiB) 4342552

[startup+4842.3 s]
/proc/loadavg: 8.00 8.01 8.00 9/180 26946
/proc/meminfo: memFree=25844588/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 6 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
[pid=26791] ppid=26790 vsize=500216 CPUtime=4842.46 cores=0
/proc/26791/stat : 26791 (cryptominisat) R 26790 26790 26722 0 -1 4202496 917829 0 0 0 483812 434 0 0 25 0 1 0 529197238 512221184 85227 33554432000 4194304 4587354 140734057289008 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26791/statm: 125054 85227 337 96 0 121616 0
[pid=26792] ppid=26790 vsize=800128 CPUtime=4842.46 cores=1
/proc/26792/stat : 26792 (clasp) R 26790 26790 26722 0 -1 4202496 189937 0 0 0 484184 62 0 0 25 0 1 0 529197238 819331072 187259 33554432000 4194304 4785740 140736349536928 18446744073709551615 4277652 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26792/statm: 200032 187259 340 145 0 197077 0
[pid=26793] ppid=26790 vsize=478004 CPUtime=4842.01 cores=2
/proc/26793/stat : 26793 (TNM) R 26790 26790 26722 0 -1 4202496 9544 0 0 0 484199 2 0 0 25 0 1 0 529197238 489476096 9441 33554432000 134512640 134534564 4287785104 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26793/statm: 119501 9441 95 6 0 118167 0
[pid=26794] ppid=26790 vsize=61616 CPUtime=4841.65 cores=3
/proc/26794/stat : 26794 (march_hi) R 26790 26790 26722 0 -1 4202496 32071 0 0 0 484161 4 0 0 25 0 1 0 529197238 63094784 7250 33554432000 4194304 4331988 140737406139120 18446744073709551615 4287741 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26794/statm: 15404 7250 174 34 0 13846 0
[pid=26795] ppid=26790 vsize=817628 CPUtime=19342.6 cores=4-7
/proc/26795/stat : 26795 (plingeling) S 26790 26790 26722 0 -1 4202496 1810229 1251 0 0 1934015 240 0 0 20 0 5 0 529197238 837251072 176489 33554432000 4194304 4356188 140736257336592 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26795/statm: 204407 176489 163 40 0 202951 0
[pid=26795/tid=26802] ppid=26790 vsize=817628 CPUtime=4842.22 cores=4-7
/proc/26795/task/26802/stat : 26802 (plingeling) R 26790 26790 26722 0 -1 4202560 571071 1251 0 0 484148 74 0 0 25 0 5 0 529197263 837251072 176489 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26795/tid=26803] ppid=26790 vsize=817628 CPUtime=4842.2 cores=4-7
/proc/26795/task/26803/stat : 26803 (plingeling) R 26790 26790 26722 0 -1 4202560 207539 1251 0 0 484190 30 0 0 25 0 5 0 529197263 837251072 176489 33554432000 4194304 4356188 140736257336592 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26795/tid=26804] ppid=26790 vsize=817628 CPUtime=4842.21 cores=4-7
/proc/26795/task/26804/stat : 26804 (plingeling) R 26790 26790 26722 0 -1 4202560 280999 1251 0 0 484182 39 0 0 25 0 5 0 529197263 837251072 176489 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331019 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26795/tid=26805] ppid=26790 vsize=817628 CPUtime=4815.64 cores=4-7
/proc/26795/task/26805/stat : 26805 (plingeling) R 26790 26790 26722 0 -1 4202560 741734 1251 0 0 481469 95 0 0 25 0 5 0 529197263 837251072 176489 33554432000 4194304 4356188 140736257336592 18446744073709551615 4234276 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38711.1
Current children cumulated vsize (KiB) 2675916

[startup+4902.3 s]
/proc/loadavg: 8.06 8.02 8.00 9/180 26947
/proc/meminfo: memFree=25847168/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 6 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
[pid=26791] ppid=26790 vsize=2233992 CPUtime=4902.46 cores=0
/proc/26791/stat : 26791 (cryptominisat) R 26790 26790 26722 0 -1 4202496 927341 0 0 0 489806 440 0 0 25 0 1 0 529197238 2287607808 84613 33554432000 4194304 4587354 140734057289008 18446744073709551615 4237695 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26791/statm: 558498 84613 337 96 0 555060 0
[pid=26792] ppid=26790 vsize=801728 CPUtime=4902.47 cores=1
/proc/26792/stat : 26792 (clasp) R 26790 26790 26722 0 -1 4202496 190214 0 0 0 490185 62 0 0 25 0 1 0 529197238 820969472 187536 33554432000 4194304 4785740 140736349536928 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26792/statm: 200432 187536 340 145 0 197477 0
[pid=26793] ppid=26790 vsize=478004 CPUtime=4902.01 cores=2
/proc/26793/stat : 26793 (TNM) R 26790 26790 26722 0 -1 4202496 9544 0 0 0 490199 2 0 0 25 0 1 0 529197238 489476096 9441 33554432000 134512640 134534564 4287785104 18446744073709551615 134530344 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26793/statm: 119501 9441 95 6 0 118167 0
[pid=26794] ppid=26790 vsize=61616 CPUtime=4901.65 cores=3
/proc/26794/stat : 26794 (march_hi) R 26790 26790 26722 0 -1 4202496 32072 0 0 0 490161 4 0 0 25 0 1 0 529197238 63094784 7251 33554432000 4194304 4331988 140737406139120 18446744073709551615 4287907 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26794/statm: 15404 7251 174 34 0 13846 0
[pid=26795] ppid=26790 vsize=817628 CPUtime=19582.2 cores=4-7
/proc/26795/stat : 26795 (plingeling) S 26790 26790 26722 0 -1 4202496 1832757 1251 0 0 1957980 244 0 0 20 0 5 0 529197238 837251072 176489 33554432000 4194304 4356188 140736257336592 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26795/statm: 204407 176489 163 40 0 202951 0
[pid=26795/tid=26802] ppid=26790 vsize=817628 CPUtime=4902.23 cores=4-7
/proc/26795/task/26802/stat : 26802 (plingeling) R 26790 26790 26722 0 -1 4202560 574143 1251 0 0 490148 75 0 0 25 0 5 0 529197263 837251072 176489 33554432000 4194304 4356188 140736257336592 18446744073709551615 4298515 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26795/tid=26803] ppid=26790 vsize=817628 CPUtime=4902.21 cores=4-7
/proc/26795/task/26803/stat : 26803 (plingeling) R 26790 26790 26722 0 -1 4202560 207539 1251 0 0 490191 30 0 0 25 0 5 0 529197263 837251072 176489 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331141 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26795/tid=26804] ppid=26790 vsize=817628 CPUtime=4902.22 cores=4-7
/proc/26795/task/26804/stat : 26804 (plingeling) R 26790 26790 26722 0 -1 4202560 287143 1251 0 0 490182 40 0 0 25 0 5 0 529197263 837251072 176489 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26795/tid=26805] ppid=26790 vsize=817628 CPUtime=4875.32 cores=4-7
/proc/26795/task/26805/stat : 26805 (plingeling) R 26790 26790 26722 0 -1 4202560 755046 1251 0 0 487435 97 0 0 25 0 5 0 529197263 837251072 176489 33554432000 4194304 4356188 140736257336592 18446744073709551615 4210791 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39190.8
Current children cumulated vsize (KiB) 4411292

[startup+4962.3 s]
/proc/loadavg: 8.07 8.03 8.00 9/180 26949
/proc/meminfo: memFree=25832512/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 6 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
[pid=26791] ppid=26790 vsize=2214004 CPUtime=4962.47 cores=0
/proc/26791/stat : 26791 (cryptominisat) R 26790 26790 26722 0 -1 4202496 937777 0 0 0 495802 445 0 0 25 0 1 0 529197238 2267140096 84072 33554432000 4194304 4587354 140734057289008 18446744073709551615 4238578 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26791/statm: 553501 84072 337 96 0 550063 0
[pid=26792] ppid=26790 vsize=804160 CPUtime=4962.48 cores=1
/proc/26792/stat : 26792 (clasp) R 26790 26790 26722 0 -1 4202496 190779 0 0 0 496185 63 0 0 25 0 1 0 529197238 823459840 188101 33554432000 4194304 4785740 140736349536928 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26792/statm: 201040 188101 340 145 0 198085 0
[pid=26793] ppid=26790 vsize=478004 CPUtime=4962 cores=2
/proc/26793/stat : 26793 (TNM) R 26790 26790 26722 0 -1 4202496 9544 0 0 0 496198 2 0 0 25 0 1 0 529197238 489476096 9441 33554432000 134512640 134534564 4287785104 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26793/statm: 119501 9441 95 6 0 118167 0
[pid=26794] ppid=26790 vsize=61616 CPUtime=4961.65 cores=3
/proc/26794/stat : 26794 (march_hi) R 26790 26790 26722 0 -1 4202496 32072 0 0 0 496161 4 0 0 25 0 1 0 529197238 63094784 7251 33554432000 4194304 4331988 140737406139120 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26794/statm: 15404 7251 174 34 0 13846 0
[pid=26795] ppid=26790 vsize=829916 CPUtime=19821.9 cores=4-7
/proc/26795/stat : 26795 (plingeling) S 26790 26790 26722 0 -1 4202496 1862453 1251 0 0 1981944 247 0 0 20 0 5 0 529197238 849833984 179561 33554432000 4194304 4356188 140736257336592 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26795/statm: 207479 179561 163 40 0 206023 0
[pid=26795/tid=26802] ppid=26790 vsize=829916 CPUtime=4962.22 cores=4-7
/proc/26795/task/26802/stat : 26802 (plingeling) R 26790 26790 26722 0 -1 4202560 583359 1251 0 0 496147 75 0 0 25 0 5 0 529197263 849833984 179561 33554432000 4194304 4356188 140736257336592 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26795/tid=26803] ppid=26790 vsize=829916 CPUtime=4962.21 cores=4-7
/proc/26795/task/26803/stat : 26803 (plingeling) R 26790 26790 26722 0 -1 4202560 209587 1251 0 0 496191 30 0 0 25 0 5 0 529197263 849833984 179561 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26795/tid=26804] ppid=26790 vsize=829916 CPUtime=4962.22 cores=4-7
/proc/26795/task/26804/stat : 26804 (plingeling) R 26790 26790 26722 0 -1 4202560 287143 1251 0 0 496182 40 0 0 25 0 5 0 529197263 849833984 179561 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26795/tid=26805] ppid=26790 vsize=829916 CPUtime=4934.99 cores=4-7
/proc/26795/task/26805/stat : 26805 (plingeling) R 26790 26790 26722 0 -1 4202560 773478 1251 0 0 493399 100 0 0 25 0 5 0 529197263 849833984 179561 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39670.5
Current children cumulated vsize (KiB) 4406024



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.6 s]
/proc/loadavg: 8.09 8.04 8.00 9/180 26950
/proc/meminfo: memFree=25795160/32950928 swapFree=67111356/67111528
[pid=26790] ppid=26788 vsize=18324 CPUtime=0 cores=0-7
/proc/26790/stat : 26790 (ppfolio) S 26788 26790 26722 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 529197238 18763776 390 33554432000 4194304 4287625 140733752875024 18446744073709551615 208080252431 0 0 4096 65536 4606470076999139327 0 0 17 6 0 0 0
/proc/26790/statm: 4581 390 341 23 0 91 0
[pid=26791] ppid=26790 vsize=2214004 CPUtime=5003.77 cores=0
/proc/26791/stat : 26791 (cryptominisat) R 26790 26790 26722 0 -1 4202496 945974 0 0 0 499928 449 0 0 25 0 1 0 529197238 2267140096 92149 33554432000 4194304 4587354 140734057289008 18446744073709551615 4232256 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26791/statm: 553501 92149 337 96 0 550063 0
[pid=26792] ppid=26790 vsize=805124 CPUtime=5003.78 cores=1
/proc/26792/stat : 26792 (clasp) R 26790 26790 26722 0 -1 4202496 191018 0 0 0 500315 63 0 0 25 0 1 0 529197238 824446976 188340 33554432000 4194304 4785740 140736349536928 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26792/statm: 201281 188340 340 145 0 198326 0
[pid=26793] ppid=26790 vsize=478004 CPUtime=5003.31 cores=2
/proc/26793/stat : 26793 (TNM) R 26790 26790 26722 0 -1 4202496 9544 0 0 0 500329 2 0 0 25 0 1 0 529197238 489476096 9441 33554432000 134512640 134534564 4287785104 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26793/statm: 119501 9441 95 6 0 118167 0
[pid=26794] ppid=26790 vsize=61616 CPUtime=5002.96 cores=3
/proc/26794/stat : 26794 (march_hi) R 26790 26790 26722 0 -1 4202496 32072 0 0 0 500292 4 0 0 25 0 1 0 529197238 63094784 7251 33554432000 4194304 4331988 140737406139120 18446744073709551615 4246715 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26794/statm: 15404 7251 174 34 0 13846 0
[pid=26795] ppid=26790 vsize=834012 CPUtime=19986.9 cores=4-7
/proc/26795/stat : 26795 (plingeling) S 26790 26790 26722 0 -1 4202496 1876789 1251 0 0 1998442 250 0 0 20 0 5 0 529197238 854028288 180585 33554432000 4194304 4356188 140736257336592 18446744073709551615 208092035045 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26795/statm: 208503 180585 163 40 0 207047 0
[pid=26795/tid=26802] ppid=26790 vsize=834012 CPUtime=5003.53 cores=4-7
/proc/26795/task/26802/stat : 26802 (plingeling) R 26790 26790 26722 0 -1 4202560 589503 1251 0 0 500277 76 0 0 25 0 5 0 529197263 854028288 180585 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26795/tid=26803] ppid=26790 vsize=834012 CPUtime=5003.52 cores=4-7
/proc/26795/task/26803/stat : 26803 (plingeling) R 26790 26790 26722 0 -1 4202560 213683 1251 0 0 500321 31 0 0 25 0 5 0 529197263 854028288 180585 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26795/tid=26804] ppid=26790 vsize=834012 CPUtime=5003.52 cores=4-7
/proc/26795/task/26804/stat : 26804 (plingeling) R 26790 26790 26722 0 -1 4202560 289191 1251 0 0 500312 40 0 0 25 0 5 0 529197263 854028288 180585 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=26795/tid=26805] ppid=26790 vsize=834012 CPUtime=4976.07 cores=4-7
/proc/26795/task/26805/stat : 26805 (plingeling) R 26790 26790 26722 0 -1 4202560 775526 1251 0 0 497507 100 0 0 25 0 5 0 529197263 854028288 180585 33554432000 4194304 4356188 140736257336592 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 4411084

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26790 and gives
#  childrusage.ru_utime.tv_sec=10006
#  childrusage.ru_utime.tv_usec=219823
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=75988
# CPU time returned by wait4() is 10006.3
# while last known CPU time is 40000.7
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.62
CPU time (s): 40000.7
CPU user time (s): 39993.1
CPU system time (s): 7.68
CPU usage (%): 799.437
Max. virtual memory (cumulated for all children) (KiB): 6229348

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 10006.2
system time used= 0.075988
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 42140
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 590
involuntary context switches= 28260

runsolver used 8.21975 second user time and 19.0781 second system time

The end

Launcher Data 

Begin job on node127 at 2011-04-30 17:06:16
IDJOB=3276326
IDBENCH=88211
IDSOLVER=1638
FILE ID=node127/3276326-1304175975
RUNJOBID= node127-1304175958-26736
PBS_JOBID= 13170975
Free space on /tmp= 72732 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m47-q742.5-n45-p30-s17570390.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3276326-1304175975/watcher-3276326-1304175975 -o /tmp/evaluation-result-3276326-1304175975/solver-3276326-1304175975 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3276326-1304175975.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ba3b1702a651cd8da3e6cada8f2e97bc
RANDOM SEED=1641016641

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      27705628 kB
Buffers:       1314172 kB
Cached:        3402144 kB
SwapCached:          8 kB
Active:         274836 kB
Inactive:      4504528 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      27705628 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           15380 kB
Writeback:           0 kB
AnonPages:       63548 kB
Mapped:          14736 kB
Slab:           399544 kB
PageTables:       5108 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   184860 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72720 MiB
End job on node127 at 2011-04-30 18:29:41