Trace number 3222219

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 39971.4 5000.02

General information on the benchmark

Namerandom/medium/
unif-k7-r89-v70-c6230-S1960545292-083.UNKNOWN.cnf
MD5SUM54de6cac0499270ba5ca6b23e35899f2
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables70
Number of clauses6230
Sum of the clauses size43610
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 56230

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3222219-1304164817/watcher-3222219-1304164817 -o /tmp/evaluation-result-3222219-1304164817/solver-3222219-1304164817 -C 40000 -W 5000 -M 31000 ppfolio HOME/instance-3222219-1304164817.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.81 7.77 7.91 2/170 26890
/proc/meminfo: memFree=30372484/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 0 0 0 25 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 4 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0

[startup+0.82076 s]
/proc/loadavg: 6.81 7.77 7.91 2/170 26890
/proc/meminfo: memFree=30372484/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 0 0 0 18 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.900745 s]
/proc/loadavg: 6.81 7.77 7.91 2/170 26890
/proc/meminfo: memFree=30372484/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 0 0 0 17 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.00073 s]
/proc/loadavg: 6.81 7.77 7.91 2/170 26890
/proc/meminfo: memFree=30372484/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 0 0 0 16 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.10071 s]
/proc/loadavg: 6.81 7.77 7.91 2/170 26890
/proc/meminfo: memFree=30372484/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50064 s]
/proc/loadavg: 6.81 7.77 7.91 2/170 26890
/proc/meminfo: memFree=30372484/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10036 s]
/proc/loadavg: 6.90 7.77 7.91 9/180 26906
/proc/meminfo: memFree=30339816/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
[pid=26891] ppid=26890 vsize=12843780 CPUtime=3.08 cores=0
/proc/26891/stat : 26891 (cryptominisat) R 26890 26890 26823 0 -1 4202496 5325 0 0 0 308 0 0 0 25 0 1 0 528081521 13152030720 2798 33554432000 4194304 4587354 140734404739264 18446744073709551615 4238683 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26891/statm: 3210945 2798 336 96 0 3207507 0
[pid=26892] ppid=26890 vsize=15728 CPUtime=3.09 cores=1
/proc/26892/stat : 26892 (clasp) R 26890 26890 26823 0 -1 4202496 1353 0 0 0 309 0 0 0 25 0 1 0 528081521 16105472 1245 33554432000 4194304 4785740 140736816034352 18446744073709551615 4553423 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26892/statm: 3932 1245 341 145 0 977 0
[pid=26893] ppid=26890 vsize=456492 CPUtime=3.09 cores=2
/proc/26893/stat : 26893 (TNM) R 26890 26890 26823 0 -1 4202496 519 0 0 0 309 0 0 0 25 0 1 0 528081521 467447808 416 33554432000 134512640 134534564 4291643936 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26893/statm: 114123 416 95 6 0 112789 0
[pid=26894] ppid=26890 vsize=8640 CPUtime=3.09 cores=3
/proc/26894/stat : 26894 (march_hi) R 26890 26890 26823 0 -1 4202496 1519 0 0 0 309 0 0 0 25 0 1 0 528081521 8847360 644 33554432000 4194304 4331988 140735630774000 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26894/statm: 2160 644 174 34 0 602 0
[pid=26895] ppid=26890 vsize=127524 CPUtime=12.32 cores=4-7
/proc/26895/stat : 26895 (plingeling) S 26890 26890 26823 0 -1 4202496 5970 1249 0 0 1231 1 0 0 25 0 5 0 528081521 130584576 3959 33554432000 4194304 4356188 140736684537248 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26895/statm: 31881 3959 161 40 0 30425 0
[pid=26895/tid=26902] ppid=26890 vsize=127524 CPUtime=3.06 cores=4-7
/proc/26895/task/26902/stat : 26902 (plingeling) R 26890 26890 26823 0 -1 4202560 1084 1249 0 0 306 0 0 0 25 0 5 0 528081523 130584576 3959 33554432000 4194304 4356188 140736684537248 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26895/tid=26903] ppid=26890 vsize=127524 CPUtime=3.07 cores=4-7
/proc/26895/task/26903/stat : 26903 (plingeling) R 26890 26890 26823 0 -1 4202560 1272 1249 0 0 307 0 0 0 25 0 5 0 528081523 130584576 3959 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26895/tid=26904] ppid=26890 vsize=127524 CPUtime=3.07 cores=4-7
/proc/26895/task/26904/stat : 26904 (plingeling) R 26890 26890 26823 0 -1 4202560 1214 1249 0 0 307 0 0 0 25 0 5 0 528081523 130584576 3959 33554432000 4194304 4356188 140736684537248 18446744073709551615 4234169 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26895/tid=26905] ppid=26890 vsize=127524 CPUtime=3.07 cores=4-7
/proc/26895/task/26905/stat : 26905 (plingeling) R 26890 26890 26823 0 -1 4202560 1216 1249 0 0 307 0 0 0 25 0 5 0 528081523 130584576 3959 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.67
Current children cumulated vsize (KiB) 13470488

[startup+6.30679 s]
/proc/loadavg: 6.90 7.77 7.91 9/180 26906
/proc/meminfo: memFree=30335740/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
[pid=26891] ppid=26890 vsize=402968 CPUtime=6.29 cores=0
/proc/26891/stat : 26891 (cryptominisat) R 26890 26890 26823 0 -1 4202496 7214 0 0 0 629 0 0 0 25 0 1 0 528081521 412639232 3025 33554432000 4194304 4587354 140734404739264 18446744073709551615 4238431 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26891/statm: 100742 3025 336 96 0 97304 0
[pid=26892] ppid=26890 vsize=17132 CPUtime=6.3 cores=1
/proc/26892/stat : 26892 (clasp) R 26890 26890 26823 0 -1 4202496 1706 0 0 0 630 0 0 0 25 0 1 0 528081521 17543168 1598 33554432000 4194304 4785740 140736816034352 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26892/statm: 4283 1598 341 145 0 1328 0
[pid=26893] ppid=26890 vsize=456492 CPUtime=6.3 cores=2
/proc/26893/stat : 26893 (TNM) R 26890 26890 26823 0 -1 4202496 519 0 0 0 630 0 0 0 25 0 1 0 528081521 467447808 416 33554432000 134512640 134534564 4291643936 18446744073709551615 134530509 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26893/statm: 114123 416 95 6 0 112789 0
[pid=26894] ppid=26890 vsize=9020 CPUtime=6.3 cores=3
/proc/26894/stat : 26894 (march_hi) R 26890 26890 26823 0 -1 4202496 1609 0 0 0 630 0 0 0 25 0 1 0 528081521 9236480 734 33554432000 4194304 4331988 140735630774000 18446744073709551615 4239610 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26894/statm: 2255 734 175 34 0 697 0
[pid=26895] ppid=26890 vsize=129064 CPUtime=25.12 cores=4-7
/proc/26895/stat : 26895 (plingeling) S 26890 26890 26823 0 -1 4202496 8403 1249 0 0 2511 1 0 0 25 0 5 0 528081521 132161536 4344 33554432000 4194304 4356188 140736684537248 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26895/statm: 32266 4344 161 40 0 30810 0
[pid=26895/tid=26902] ppid=26890 vsize=129064 CPUtime=6.25 cores=4-7
/proc/26895/task/26902/stat : 26902 (plingeling) R 26890 26890 26823 0 -1 4202560 1628 1249 0 0 625 0 0 0 25 0 5 0 528081523 132161536 4344 33554432000 4194304 4356188 140736684537248 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26895/tid=26903] ppid=26890 vsize=129064 CPUtime=6.28 cores=4-7
/proc/26895/task/26903/stat : 26903 (plingeling) R 26890 26890 26823 0 -1 4202560 1880 1249 0 0 628 0 0 0 25 0 5 0 528081523 132161536 4344 33554432000 4194304 4356188 140736684537248 18446744073709551615 4237444 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26895/tid=26904] ppid=26890 vsize=129064 CPUtime=6.28 cores=4-7
/proc/26895/task/26904/stat : 26904 (plingeling) R 26890 26890 26823 0 -1 4202560 1822 1249 0 0 628 0 0 0 25 0 5 0 528081523 132161536 4344 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331183 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26895/tid=26905] ppid=26890 vsize=129064 CPUtime=6.27 cores=4-7
/proc/26895/task/26905/stat : 26905 (plingeling) R 26890 26890 26823 0 -1 4202560 1889 1249 0 0 627 0 0 0 25 0 5 0 528081523 132161536 4344 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.31
Current children cumulated vsize (KiB) 1033000

[startup+12.7007 s]
/proc/loadavg: 7.07 7.78 7.91 9/180 26906
/proc/meminfo: memFree=30319876/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
[pid=26891] ppid=26890 vsize=409400 CPUtime=12.69 cores=0
/proc/26891/stat : 26891 (cryptominisat) R 26890 26890 26823 0 -1 4202496 11496 0 0 0 1267 2 0 0 25 0 1 0 528081521 419225600 4526 33554432000 4194304 4587354 140734404739264 18446744073709551615 4238509 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26891/statm: 102350 4526 336 96 0 98912 0
[pid=26892] ppid=26890 vsize=18784 CPUtime=12.69 cores=1
/proc/26892/stat : 26892 (clasp) R 26890 26890 26823 0 -1 4202496 2071 0 0 0 1269 0 0 0 25 0 1 0 528081521 19234816 1963 33554432000 4194304 4785740 140736816034352 18446744073709551615 4287114 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26892/statm: 4696 1963 341 145 0 1741 0
[pid=26893] ppid=26890 vsize=456492 CPUtime=12.69 cores=2
/proc/26893/stat : 26893 (TNM) R 26890 26890 26823 0 -1 4202496 519 0 0 0 1269 0 0 0 25 0 1 0 528081521 467447808 416 33554432000 134512640 134534564 4291643936 18446744073709551615 134530144 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26893/statm: 114123 416 95 6 0 112789 0
[pid=26894] ppid=26890 vsize=9872 CPUtime=12.69 cores=3
/proc/26894/stat : 26894 (march_hi) R 26890 26890 26823 0 -1 4202496 1789 0 0 0 1269 0 0 0 25 0 1 0 528081521 10108928 914 33554432000 4194304 4331988 140735630774000 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26894/statm: 2468 914 175 34 0 910 0
[pid=26895] ppid=26890 vsize=138284 CPUtime=50.66 cores=4-7
/proc/26895/stat : 26895 (plingeling) S 26890 26890 26823 0 -1 4202496 14774 1249 0 0 5064 2 0 0 25 0 5 0 528081521 141602816 6649 33554432000 4194304 4356188 140736684537248 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26895/statm: 34571 6649 161 40 0 33115 0
[pid=26895/tid=26902] ppid=26890 vsize=138284 CPUtime=12.61 cores=4-7
/proc/26895/task/26902/stat : 26902 (plingeling) R 26890 26890 26823 0 -1 4202560 3261 1249 0 0 1261 0 0 0 25 0 5 0 528081523 141602816 6649 33554432000 4194304 4356188 140736684537248 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26895/tid=26903] ppid=26890 vsize=138284 CPUtime=12.67 cores=4-7
/proc/26895/task/26903/stat : 26903 (plingeling) R 26890 26890 26823 0 -1 4202560 3513 1249 0 0 1267 0 0 0 25 0 5 0 528081523 141602816 6649 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26895/tid=26904] ppid=26890 vsize=138284 CPUtime=12.67 cores=4-7
/proc/26895/task/26904/stat : 26904 (plingeling) R 26890 26890 26823 0 -1 4202560 3390 1249 0 0 1267 0 0 0 25 0 5 0 528081523 141602816 6649 33554432000 4194304 4356188 140736684537248 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26895/tid=26905] ppid=26890 vsize=138284 CPUtime=12.67 cores=4-7
/proc/26895/task/26905/stat : 26905 (plingeling) R 26890 26890 26823 0 -1 4202560 3426 1249 0 0 1267 0 0 0 25 0 5 0 528081523 141602816 6649 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.42
Current children cumulated vsize (KiB) 1051156

[startup+25.5004 s]
/proc/loadavg: 7.21 7.78 7.91 9/180 26906
/proc/meminfo: memFree=30306472/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 0 0 0 15 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
[pid=26891] ppid=26890 vsize=47296 CPUtime=25.49 cores=0
/proc/26891/stat : 26891 (cryptominisat) R 26890 26890 26823 0 -1 4202496 16824 0 0 0 2546 3 0 0 25 0 1 0 528081521 48431104 6420 33554432000 4194304 4587354 140734404739264 18446744073709551615 4238455 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26891/statm: 11824 6420 336 96 0 8386 0
[pid=26892] ppid=26890 vsize=20452 CPUtime=25.49 cores=1
/proc/26892/stat : 26892 (clasp) R 26890 26890 26823 0 -1 4202496 2435 0 0 0 2549 0 0 0 25 0 1 0 528081521 20942848 2327 33554432000 4194304 4785740 140736816034352 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26892/statm: 5113 2327 341 145 0 2158 0
[pid=26893] ppid=26890 vsize=456492 CPUtime=25.49 cores=2
/proc/26893/stat : 26893 (TNM) R 26890 26890 26823 0 -1 4202496 519 0 0 0 2549 0 0 0 25 0 1 0 528081521 467447808 416 33554432000 134512640 134534564 4291643936 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26893/statm: 114123 416 95 6 0 112789 0
[pid=26894] ppid=26890 vsize=11788 CPUtime=25.49 cores=3
/proc/26894/stat : 26894 (march_hi) R 26890 26890 26823 0 -1 4202496 2132 0 0 0 2549 0 0 0 25 0 1 0 528081521 12070912 1257 33554432000 4194304 4331988 140735630774000 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26894/statm: 2947 1257 175 34 0 1389 0
[pid=26895] ppid=26890 vsize=141620 CPUtime=101.8 cores=4-7
/proc/26895/stat : 26895 (plingeling) S 26890 26890 26823 0 -1 4202496 23192 1249 0 0 10177 3 0 0 25 0 5 0 528081521 145018880 7483 33554432000 4194304 4356188 140736684537248 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26895/statm: 35405 7483 161 40 0 33949 0
[pid=26895/tid=26902] ppid=26890 vsize=141620 CPUtime=25.35 cores=4-7
/proc/26895/task/26902/stat : 26902 (plingeling) R 26890 26890 26823 0 -1 4202560 5341 1249 0 0 2534 1 0 0 25 0 5 0 528081523 145018880 7483 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26895/tid=26903] ppid=26890 vsize=141620 CPUtime=25.47 cores=4-7
/proc/26895/task/26903/stat : 26903 (plingeling) R 26890 26890 26823 0 -1 4202560 5626 1249 0 0 2547 0 0 0 25 0 5 0 528081523 145018880 7483 33554432000 4194304 4356188 140736684537248 18446744073709551615 4332109 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26895/tid=26904] ppid=26890 vsize=141620 CPUtime=25.47 cores=4-7
/proc/26895/task/26904/stat : 26904 (plingeling) R 26890 26890 26823 0 -1 4202560 5447 1249 0 0 2547 0 0 0 25 0 5 0 528081523 145018880 7483 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331065 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26895/tid=26905] ppid=26890 vsize=141620 CPUtime=25.47 cores=4-7
/proc/26895/task/26905/stat : 26905 (plingeling) R 26890 26890 26823 0 -1 4202560 5594 1249 0 0 2546 1 0 0 25 0 5 0 528081523 145018880 7483 33554432000 4194304 4356188 140736684537248 18446744073709551615 4332125 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.76
Current children cumulated vsize (KiB) 695972

################
# More data... #
################

[pid=26893] ppid=26890 vsize=456492 CPUtime=4781.93 cores=2
/proc/26893/stat : 26893 (TNM) R 26890 26890 26823 0 -1 4202496 519 0 0 0 478191 2 0 0 25 0 1 0 528081521 467447808 416 33554432000 134512640 134534564 4291643936 18446744073709551615 134530652 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26893/statm: 114123 416 95 6 0 112789 0
[pid=26894] ppid=26890 vsize=463200 CPUtime=4782.41 cores=3
/proc/26894/stat : 26894 (march_hi) R 26890 26890 26823 0 -1 4202496 92456 0 0 0 478172 69 0 0 25 0 1 0 528081521 474316800 91581 33554432000 4194304 4331988 140735630774000 18446744073709551615 4299269 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26894/statm: 115800 91581 175 34 0 114242 0
[pid=26895] ppid=26890 vsize=338788 CPUtime=19101.8 cores=4-7
/proc/26895/stat : 26895 (plingeling) S 26890 26890 26823 0 -1 4202496 811748 1249 0 0 1910053 124 0 0 25 0 5 0 528081521 346918912 56775 33554432000 4194304 4356188 140736684537248 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26895/statm: 84697 56775 161 40 0 83241 0
[pid=26895/tid=26902] ppid=26890 vsize=338788 CPUtime=4754.73 cores=4-7
/proc/26895/task/26902/stat : 26902 (plingeling) R 26890 26890 26823 0 -1 4202560 205984 1249 0 0 475442 31 0 0 25 0 5 0 528081523 346918912 56775 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26895/tid=26903] ppid=26890 vsize=338788 CPUtime=4782.38 cores=4-7
/proc/26895/task/26903/stat : 26903 (plingeling) R 26890 26890 26823 0 -1 4202560 198589 1249 0 0 478207 31 0 0 25 0 5 0 528081523 346918912 56775 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331076 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26895/tid=26904] ppid=26890 vsize=338788 CPUtime=4782.26 cores=4-7
/proc/26895/task/26904/stat : 26904 (plingeling) R 26890 26890 26823 0 -1 4202560 209866 1249 0 0 478195 31 0 0 25 0 5 0 528081523 346918912 56775 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331045 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26895/tid=26905] ppid=26890 vsize=338788 CPUtime=4782.35 cores=4-7
/proc/26895/task/26905/stat : 26905 (plingeling) R 26890 26890 26823 0 -1 4202560 196125 1249 0 0 478207 28 0 0 25 0 5 0 528081523 346918912 56775 33554432000 4194304 4356188 140736684537248 18446744073709551615 4332225 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38230.9
Current children cumulated vsize (KiB) 1505372

[startup+4842.3 s]
/proc/loadavg: 8.03 8.06 8.00 9/180 27059
/proc/meminfo: memFree=29562392/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0.01 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 1 0 0 15 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
[pid=26891] ppid=26890 vsize=253248 CPUtime=4842.4 cores=0
/proc/26891/stat : 26891 (cryptominisat) R 26890 26890 26823 0 -1 4202496 252090 0 0 0 484136 104 0 0 25 0 1 0 528081521 259325952 40083 33554432000 4194304 4587354 140734404739264 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26891/statm: 63312 40083 336 96 0 59874 0
[pid=26892] ppid=26890 vsize=48948 CPUtime=4842.39 cores=1
/proc/26892/stat : 26892 (clasp) R 26890 26890 26823 0 -1 4202496 10069 0 0 0 484237 2 0 0 25 0 1 0 528081521 50122752 8598 33554432000 4194304 4785740 140736816034352 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26892/statm: 12237 8598 341 145 0 9282 0
[pid=26893] ppid=26890 vsize=456492 CPUtime=4841.92 cores=2
/proc/26893/stat : 26893 (TNM) R 26890 26890 26823 0 -1 4202496 519 0 0 0 484190 2 0 0 25 0 1 0 528081521 467447808 416 33554432000 134512640 134534564 4291643936 18446744073709551615 134528730 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26893/statm: 114123 416 95 6 0 112789 0
[pid=26894] ppid=26890 vsize=463200 CPUtime=4842.4 cores=3
/proc/26894/stat : 26894 (march_hi) R 26890 26890 26823 0 -1 4202496 93327 0 0 0 484171 69 0 0 25 0 1 0 528081521 474316800 92452 33554432000 4194304 4331988 140735630774000 18446744073709551615 4298615 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26894/statm: 115800 92452 175 34 0 114242 0
[pid=26895] ppid=26890 vsize=358756 CPUtime=19341.4 cores=4-7
/proc/26895/stat : 26895 (plingeling) S 26890 26890 26823 0 -1 4202496 819236 1249 0 0 1934020 125 0 0 25 0 5 0 528081521 367366144 61767 33554432000 4194304 4356188 140736684537248 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26895/statm: 89689 61767 161 40 0 88233 0
[pid=26895/tid=26902] ppid=26890 vsize=358756 CPUtime=4814.4 cores=4-7
/proc/26895/task/26902/stat : 26902 (plingeling) R 26890 26890 26823 0 -1 4202560 208480 1249 0 0 481409 31 0 0 25 0 5 0 528081523 367366144 61767 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331178 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26895/tid=26903] ppid=26890 vsize=358756 CPUtime=4842.39 cores=4-7
/proc/26895/task/26903/stat : 26903 (plingeling) R 26890 26890 26823 0 -1 4202560 201085 1249 0 0 484207 32 0 0 25 0 5 0 528081523 367366144 61767 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26895/tid=26904] ppid=26890 vsize=358756 CPUtime=4842.26 cores=4-7
/proc/26895/task/26904/stat : 26904 (plingeling) R 26890 26890 26823 0 -1 4202560 211402 1249 0 0 484194 32 0 0 25 0 5 0 528081523 367366144 61767 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26895/tid=26905] ppid=26890 vsize=358756 CPUtime=4842.36 cores=4-7
/proc/26895/task/26905/stat : 26905 (plingeling) R 26890 26890 26823 0 -1 4202560 197085 1249 0 0 484207 29 0 0 25 0 5 0 528081523 367366144 61767 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331069 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38710.6
Current children cumulated vsize (KiB) 1598968

[startup+4902.3 s]
/proc/loadavg: 8.01 8.05 8.00 9/180 27060
/proc/meminfo: memFree=29566428/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0.01 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 1 0 0 15 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
[pid=26891] ppid=26890 vsize=547740 CPUtime=4902.41 cores=0
/proc/26891/stat : 26891 (cryptominisat) R 26890 26890 26823 0 -1 4202496 252242 0 0 0 490137 104 0 0 25 0 1 0 528081521 560885760 39334 33554432000 4194304 4587354 140734404739264 18446744073709551615 4238423 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26891/statm: 136935 39334 336 96 0 133497 0
[pid=26892] ppid=26890 vsize=48948 CPUtime=4902.4 cores=1
/proc/26892/stat : 26892 (clasp) R 26890 26890 26823 0 -1 4202496 10074 0 0 0 490238 2 0 0 25 0 1 0 528081521 50122752 8603 33554432000 4194304 4785740 140736816034352 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26892/statm: 12237 8603 341 145 0 9282 0
[pid=26893] ppid=26890 vsize=456492 CPUtime=4901.92 cores=2
/proc/26893/stat : 26893 (TNM) R 26890 26890 26823 0 -1 4202496 519 0 0 0 490190 2 0 0 25 0 1 0 528081521 467447808 416 33554432000 134512640 134534564 4291643936 18446744073709551615 134530664 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26893/statm: 114123 416 95 6 0 112789 0
[pid=26894] ppid=26890 vsize=463200 CPUtime=4902.41 cores=3
/proc/26894/stat : 26894 (march_hi) R 26890 26890 26823 0 -1 4202496 94202 0 0 0 490172 69 0 0 25 0 1 0 528081521 474316800 93327 33554432000 4194304 4331988 140735630774000 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26894/statm: 115800 93327 175 34 0 114242 0
[pid=26895] ppid=26890 vsize=354148 CPUtime=19581.1 cores=4-7
/proc/26895/stat : 26895 (plingeling) S 26890 26890 26823 0 -1 4202496 825572 1249 0 0 1957989 125 0 0 25 0 5 0 528081521 362647552 60615 33554432000 4194304 4356188 140736684537248 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26895/statm: 88537 60615 161 40 0 87081 0
[pid=26895/tid=26902] ppid=26890 vsize=354148 CPUtime=4874.07 cores=4-7
/proc/26895/task/26902/stat : 26902 (plingeling) R 26890 26890 26823 0 -1 4202560 209056 1249 0 0 487376 31 0 0 25 0 5 0 528081523 362647552 60615 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26895/tid=26903] ppid=26890 vsize=354148 CPUtime=4902.4 cores=4-7
/proc/26895/task/26903/stat : 26903 (plingeling) R 26890 26890 26823 0 -1 4202560 201789 1249 0 0 490208 32 0 0 25 0 5 0 528081523 362647552 60615 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26895/tid=26904] ppid=26890 vsize=354148 CPUtime=4902.27 cores=4-7
/proc/26895/task/26904/stat : 26904 (plingeling) R 26890 26890 26823 0 -1 4202560 213898 1249 0 0 490195 32 0 0 25 0 5 0 528081523 362647552 60615 33554432000 4194304 4356188 140736684537248 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26895/tid=26905] ppid=26890 vsize=354148 CPUtime=4902.37 cores=4-7
/proc/26895/task/26905/stat : 26905 (plingeling) R 26890 26890 26823 0 -1 4202560 199645 1249 0 0 490208 29 0 0 25 0 5 0 528081523 362647552 60615 33554432000 4194304 4356188 140736684537248 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39190.3
Current children cumulated vsize (KiB) 1888852

[startup+4962.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 27062
/proc/meminfo: memFree=29564896/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0.01 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 1 0 0 15 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
[pid=26891] ppid=26890 vsize=179236 CPUtime=4962.4 cores=0
/proc/26891/stat : 26891 (cryptominisat) R 26890 26890 26823 0 -1 4202496 253199 0 0 0 496136 104 0 0 25 0 1 0 528081521 183537664 39405 33554432000 4194304 4587354 140734404739264 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26891/statm: 44809 39405 336 96 0 41371 0
[pid=26892] ppid=26890 vsize=48948 CPUtime=4962.39 cores=1
/proc/26892/stat : 26892 (clasp) R 26890 26890 26823 0 -1 4202496 10074 0 0 0 496237 2 0 0 25 0 1 0 528081521 50122752 8603 33554432000 4194304 4785740 140736816034352 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26892/statm: 12237 8603 341 145 0 9282 0
[pid=26893] ppid=26890 vsize=456492 CPUtime=4961.92 cores=2
/proc/26893/stat : 26893 (TNM) R 26890 26890 26823 0 -1 4202496 519 0 0 0 496190 2 0 0 25 0 1 0 528081521 467447808 416 33554432000 134512640 134534564 4291643936 18446744073709551615 134528918 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26893/statm: 114123 416 95 6 0 112789 0
[pid=26894] ppid=26890 vsize=463200 CPUtime=4962.41 cores=3
/proc/26894/stat : 26894 (march_hi) R 26890 26890 26823 0 -1 4202496 95019 0 0 0 496171 70 0 0 25 0 1 0 528081521 474316800 94144 33554432000 4194304 4331988 140735630774000 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26894/statm: 115800 94144 175 34 0 114242 0
[pid=26895] ppid=26890 vsize=351332 CPUtime=19820.8 cores=4-7
/proc/26895/stat : 26895 (plingeling) S 26890 26890 26823 0 -1 4202496 832356 1249 0 0 1981954 126 0 0 25 0 5 0 528081521 359763968 59911 33554432000 4194304 4356188 140736684537248 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26895/statm: 87833 59911 161 40 0 86377 0
[pid=26895/tid=26902] ppid=26890 vsize=351332 CPUtime=4933.74 cores=4-7
/proc/26895/task/26902/stat : 26902 (plingeling) R 26890 26890 26823 0 -1 4202560 210976 1249 0 0 493343 31 0 0 25 0 5 0 528081523 359763968 59911 33554432000 4194304 4356188 140736684537248 18446744073709551615 4330992 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26895/tid=26903] ppid=26890 vsize=351332 CPUtime=4962.39 cores=4-7
/proc/26895/task/26903/stat : 26903 (plingeling) R 26890 26890 26823 0 -1 4202560 203581 1249 0 0 496207 32 0 0 25 0 5 0 528081523 359763968 59911 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331264 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26895/tid=26904] ppid=26890 vsize=351332 CPUtime=4962.27 cores=4-7
/proc/26895/task/26904/stat : 26904 (plingeling) R 26890 26890 26823 0 -1 4202560 214474 1249 0 0 496195 32 0 0 25 0 5 0 528081523 359763968 59911 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26895/tid=26905] ppid=26890 vsize=351332 CPUtime=4962.36 cores=4-7
/proc/26895/task/26905/stat : 26905 (plingeling) R 26890 26890 26823 0 -1 4202560 202141 1249 0 0 496207 29 0 0 25 0 5 0 528081523 359763968 59911 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331340 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39669.9
Current children cumulated vsize (KiB) 1517532



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 8.00 8.03 8.00 9/180 27063
/proc/meminfo: memFree=29560644/32950928 swapFree=67111428/67111528
[pid=26890] ppid=26888 vsize=18324 CPUtime=0.01 cores=0-7
/proc/26890/stat : 26890 (ppfolio) S 26888 26890 26823 0 -1 4202496 520 0 0 0 0 1 0 0 15 0 1 0 528081521 18763776 390 33554432000 4194304 4287625 140735844752688 18446744073709551615 248089718287 0 0 4096 65536 3215377173946826751 0 0 17 6 0 0 0
/proc/26890/statm: 4581 390 341 23 0 91 0
[pid=26891] ppid=26890 vsize=179236 CPUtime=5000.11 cores=0
/proc/26891/stat : 26891 (cryptominisat) R 26890 26890 26823 0 -1 4202496 253340 0 0 0 499907 104 0 0 25 0 1 0 528081521 183537664 39543 33554432000 4194304 4587354 140734404739264 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26891/statm: 44809 39543 336 96 0 41371 0
[pid=26892] ppid=26890 vsize=48948 CPUtime=5000.1 cores=1
/proc/26892/stat : 26892 (clasp) R 26890 26890 26823 0 -1 4202496 10074 0 0 0 500008 2 0 0 25 0 1 0 528081521 50122752 8603 33554432000 4194304 4785740 140736816034352 18446744073709551615 4287252 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/26892/statm: 12237 8603 341 145 0 9282 0
[pid=26893] ppid=26890 vsize=456492 CPUtime=4999.62 cores=2
/proc/26893/stat : 26893 (TNM) R 26890 26890 26823 0 -1 4202496 519 0 0 0 499960 2 0 0 25 0 1 0 528081521 467447808 416 33554432000 134512640 134534564 4291643936 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/26893/statm: 114123 416 95 6 0 112789 0
[pid=26894] ppid=26890 vsize=463200 CPUtime=5000.11 cores=3
/proc/26894/stat : 26894 (march_hi) R 26890 26890 26823 0 -1 4202496 95526 0 0 0 499941 70 0 0 25 0 1 0 528081521 474316800 94651 33554432000 4194304 4331988 140735630774000 18446744073709551615 4299264 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/26894/statm: 115800 94651 175 34 0 114242 0
[pid=26895] ppid=26890 vsize=353892 CPUtime=19971.4 cores=4-7
/proc/26895/stat : 26895 (plingeling) S 26890 26890 26823 0 -1 4202496 835492 1249 0 0 1997016 127 0 0 25 0 5 0 528081521 362385408 60551 33554432000 4194304 4356188 140736684537248 18446744073709551615 248101500901 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/26895/statm: 88473 60551 161 40 0 87017 0
[pid=26895/tid=26902] ppid=26890 vsize=353892 CPUtime=4971.24 cores=4-7
/proc/26895/task/26902/stat : 26902 (plingeling) R 26890 26890 26823 0 -1 4202560 211488 1249 0 0 497092 32 0 0 25 0 5 0 528081523 362385408 60551 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331296 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=26895/tid=26903] ppid=26890 vsize=353892 CPUtime=5000.1 cores=4-7
/proc/26895/task/26903/stat : 26903 (plingeling) R 26890 26890 26823 0 -1 4202560 204285 1249 0 0 499978 32 0 0 25 0 5 0 528081523 362385408 60551 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=26895/tid=26904] ppid=26890 vsize=353892 CPUtime=4999.97 cores=4-7
/proc/26895/task/26904/stat : 26904 (plingeling) R 26890 26890 26823 0 -1 4202560 216394 1249 0 0 499965 32 0 0 25 0 5 0 528081523 362385408 60551 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=26895/tid=26905] ppid=26890 vsize=353892 CPUtime=5000.07 cores=4-7
/proc/26895/task/26905/stat : 26905 (plingeling) R 26890 26890 26823 0 -1 4202560 202141 1249 0 0 499978 29 0 0 25 0 5 0 528081523 362385408 60551 33554432000 4194304 4356188 140736684537248 18446744073709551615 4331323 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39971.4
Current children cumulated vsize (KiB) 1520092

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26890 and gives
#  childrusage.ru_utime.tv_sec=14998
#  childrusage.ru_utime.tv_usec=760841
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=116830
# CPU time returned by wait4() is 14999.9
# while last known CPU time is 39971.4
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5000.02
CPU time (s): 39971.4
CPU user time (s): 39968.3
CPU system time (s): 3.06
CPU usage (%): 799.425
Max. virtual memory (cumulated for all children) (KiB): 13471380

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 14998.8
system time used= 1.11683
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 264469
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1233
involuntary context switches= 85775

runsolver used 7.92779 second user time and 19.3201 second system time

The end

Launcher Data 

Begin job on node123 at 2011-04-30 14:00:17
IDJOB=3222219
IDBENCH=83053
IDSOLVER=1638
FILE ID=node123/3222219-1304164817
RUNJOBID= node123-1304164817-26837
PBS_JOBID= 13170944
Free space on /tmp= 73468 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k7-r89-v70-c6230-S1960545292-083.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3222219-1304164817/watcher-3222219-1304164817 -o /tmp/evaluation-result-3222219-1304164817/solver-3222219-1304164817 -C 40000 -W 5000 -M 31000  ppfolio HOME/instance-3222219-1304164817.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 54de6cac0499270ba5ca6b23e35899f2
RANDOM SEED=1474865065

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30372516 kB
Buffers:        642568 kB
Cached:        1497936 kB
SwapCached:        100 kB
Active:         236896 kB
Inactive:      1967252 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30372516 kB
SwapTotal:    67111528 kB
SwapFree:     67111428 kB
Dirty:           10244 kB
Writeback:          24 kB
AnonPages:       63128 kB
Mapped:          14292 kB
Slab:           307984 kB
PageTables:       4360 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   186228 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73456 MiB
End job on node123 at 2011-04-30 15:23:39