Trace number 3275271

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 40000.6 5003.52

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n130-s30940966-unsat.cnf
MD5SUMca44a78076b8228fbb99ecc0147f157f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables133
Number of clauses276
Sum of the clauses size828
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3276
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 8 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3275271-1304166217/watcher-3275271-1304166217 -o /tmp/evaluation-result-3275271-1304166217/solver-3275271-1304166217 -C 40000 -W 5100 -M 31000 ppfolio HOME/instance-3275271-1304166217.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.36 7.88 7.96 2/170 14904
/proc/meminfo: memFree=30918224/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) R 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185824 0 0 4096 65536 0 0 0 17 6 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0

[startup+0.022448 s]
/proc/loadavg: 7.36 7.88 7.96 2/170 14904
/proc/meminfo: memFree=30918224/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) S 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 3964460289738407935 0 0 17 7 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.1434 s]
/proc/loadavg: 7.36 7.88 7.96 2/170 14904
/proc/meminfo: memFree=30918224/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) S 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 25 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 3964460289738407935 0 0 17 7 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.343354 s]
/proc/loadavg: 7.36 7.88 7.96 2/170 14904
/proc/meminfo: memFree=30918224/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) R 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 24 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 3 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700289 s]
/proc/loadavg: 7.36 7.88 7.96 2/170 14904
/proc/meminfo: memFree=30918224/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) R 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 24 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 0 0 0 17 3 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50114 s]
/proc/loadavg: 7.36 7.88 7.96 9/180 14920
/proc/meminfo: memFree=30897560/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) S 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 17 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 3964460289738407935 0 0 17 3 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
[pid=14905] ppid=14904 vsize=1857892 CPUtime=1.49 cores=0
/proc/14905/stat : 14905 (cryptominisat) R 14904 14904 14483 0 -1 4202496 3665 0 0 0 149 0 0 0 20 0 1 0 528222156 1902481408 2009 33554432000 4194304 4587354 140737236650720 18446744073709551615 4238628 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/14905/statm: 464473 2009 337 96 0 461035 0
[pid=14906] ppid=14904 vsize=12692 CPUtime=1.49 cores=1
/proc/14906/stat : 14906 (clasp) R 14904 14904 14483 0 -1 4202496 625 0 0 0 149 0 0 0 20 0 1 0 528222156 12996608 516 33554432000 4194304 4785740 140735057728128 18446744073709551615 4553280 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/14906/statm: 3173 516 340 145 0 218 0
[pid=14907] ppid=14904 vsize=455692 CPUtime=1.49 cores=2
/proc/14907/stat : 14907 (TNM) R 14904 14904 14483 0 -1 4202496 266 0 0 0 149 0 0 0 20 0 1 0 528222156 466628608 163 33554432000 134512640 134534564 4288515792 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/14907/statm: 113923 163 95 6 0 112589 0
[pid=14908] ppid=14904 vsize=8324 CPUtime=1.49 cores=3
/proc/14908/stat : 14908 (march_hi) R 14904 14904 14483 0 -1 4202496 678 0 0 0 149 0 0 0 20 0 1 0 528222156 8523776 563 33554432000 4194304 4331988 140737420758320 18446744073709551615 4237280 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/14908/statm: 2081 563 173 34 0 523 0
[pid=14909] ppid=14904 vsize=127672 CPUtime=5.92 cores=4-7
/proc/14909/stat : 14909 (plingeling) S 14904 14904 14483 0 -1 4202496 5012 1257 0 0 592 0 0 0 18 0 5 0 528222156 130736128 4208 33554432000 4194304 4356188 140737474020000 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/14909/statm: 31918 4208 163 40 0 30462 0
[pid=14909/tid=14916] ppid=14904 vsize=127672 CPUtime=1.45 cores=4-7
/proc/14909/task/14916/stat : 14916 (plingeling) R 14904 14904 14483 0 -1 4202560 1123 1257 0 0 145 0 0 0 23 0 5 0 528222157 130736128 4208 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14909/tid=14917] ppid=14904 vsize=127672 CPUtime=1.48 cores=4-7
/proc/14909/task/14917/stat : 14917 (plingeling) R 14904 14904 14483 0 -1 4202560 1139 1257 0 0 148 0 0 0 23 0 5 0 528222157 130736128 4208 33554432000 4194304 4356188 140737474020000 18446744073709551615 4233969 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14909/tid=14918] ppid=14904 vsize=127672 CPUtime=1.48 cores=4-7
/proc/14909/task/14918/stat : 14918 (plingeling) R 14904 14904 14483 0 -1 4202560 1245 1257 0 0 148 0 0 0 23 0 5 0 528222157 130736128 4208 33554432000 4194304 4356188 140737474020000 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14909/tid=14919] ppid=14904 vsize=127672 CPUtime=1.49 cores=4-7
/proc/14909/task/14919/stat : 14919 (plingeling) R 14904 14904 14483 0 -1 4202560 1176 1257 0 0 149 0 0 0 20 0 5 0 528222157 130736128 4208 33554432000 4194304 4356188 140737474020000 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.88
Current children cumulated vsize (KiB) 2480596

[startup+3.10085 s]
/proc/loadavg: 7.36 7.88 7.96 9/180 14920
/proc/meminfo: memFree=30887888/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) S 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 3964460289738407935 0 0 17 3 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
[pid=14905] ppid=14904 vsize=1862452 CPUtime=3.08 cores=0
/proc/14905/stat : 14905 (cryptominisat) R 14904 14904 14483 0 -1 4202496 5302 0 0 0 308 0 0 0 25 0 1 0 528222156 1907150848 2807 33554432000 4194304 4587354 140737236650720 18446744073709551615 4238431 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/14905/statm: 465613 2807 337 96 0 462175 0
[pid=14906] ppid=14904 vsize=12824 CPUtime=3.09 cores=1
/proc/14906/stat : 14906 (clasp) R 14904 14904 14483 0 -1 4202496 668 0 0 0 309 0 0 0 25 0 1 0 528222156 13131776 559 33554432000 4194304 4785740 140735057728128 18446744073709551615 4550848 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/14906/statm: 3206 559 340 145 0 251 0
[pid=14907] ppid=14904 vsize=455692 CPUtime=3.09 cores=2
/proc/14907/stat : 14907 (TNM) R 14904 14904 14483 0 -1 4202496 266 0 0 0 309 0 0 0 25 0 1 0 528222156 466628608 163 33554432000 134512640 134534564 4288515792 18446744073709551615 134529786 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/14907/statm: 113923 163 95 6 0 112589 0
[pid=14908] ppid=14904 vsize=9376 CPUtime=3.09 cores=3
/proc/14908/stat : 14908 (march_hi) R 14904 14904 14483 0 -1 4202496 994 0 0 0 309 0 0 0 25 0 1 0 528222156 9601024 879 33554432000 4194304 4331988 140737420758320 18446744073709551615 4211568 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/14908/statm: 2344 879 173 34 0 786 0
[pid=14909] ppid=14904 vsize=129608 CPUtime=12.31 cores=4-7
/proc/14909/stat : 14909 (plingeling) S 14904 14904 14483 0 -1 4202496 6520 1257 0 0 1230 1 0 0 18 0 5 0 528222156 132718592 4692 33554432000 4194304 4356188 140737474020000 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/14909/statm: 32402 4692 163 40 0 30946 0
[pid=14909/tid=14916] ppid=14904 vsize=129608 CPUtime=3.04 cores=4-7
/proc/14909/task/14916/stat : 14916 (plingeling) R 14904 14904 14483 0 -1 4202560 1508 1257 0 0 304 0 0 0 25 0 5 0 528222157 132718592 4692 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331023 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14909/tid=14917] ppid=14904 vsize=129608 CPUtime=3.08 cores=4-7
/proc/14909/task/14917/stat : 14917 (plingeling) R 14904 14904 14483 0 -1 4202560 1396 1257 0 0 308 0 0 0 25 0 5 0 528222157 132718592 4692 33554432000 4194304 4356188 140737474020000 18446744073709551615 4332145 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14909/tid=14918] ppid=14904 vsize=129608 CPUtime=3.08 cores=4-7
/proc/14909/task/14918/stat : 14918 (plingeling) R 14904 14904 14483 0 -1 4202560 1629 1257 0 0 308 0 0 0 25 0 5 0 528222157 132718592 4692 33554432000 4194304 4356188 140737474020000 18446744073709551615 4281709 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14909/tid=14919] ppid=14904 vsize=129608 CPUtime=3.08 cores=4-7
/proc/14909/task/14919/stat : 14919 (plingeling) R 14904 14904 14483 0 -1 4202560 1658 1257 0 0 308 0 0 0 25 0 5 0 528222157 132718592 4692 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331019 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.66
Current children cumulated vsize (KiB) 2488276

[startup+6.30126 s]
/proc/loadavg: 7.41 7.88 7.96 9/180 14920
/proc/meminfo: memFree=30874612/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) S 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 3964460289738407935 0 0 17 3 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
[pid=14905] ppid=14904 vsize=1860984 CPUtime=6.29 cores=0
/proc/14905/stat : 14905 (cryptominisat) R 14904 14904 14483 0 -1 4202496 7889 0 0 0 628 1 0 0 25 0 1 0 528222156 1905647616 2783 33554432000 4194304 4587354 140737236650720 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/14905/statm: 465246 2783 337 96 0 461808 0
[pid=14906] ppid=14904 vsize=13088 CPUtime=6.29 cores=1
/proc/14906/stat : 14906 (clasp) R 14904 14904 14483 0 -1 4202496 723 0 0 0 629 0 0 0 25 0 1 0 528222156 13402112 614 33554432000 4194304 4785740 140735057728128 18446744073709551615 4287011 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/14906/statm: 3272 614 340 145 0 317 0
[pid=14907] ppid=14904 vsize=455692 CPUtime=6.29 cores=2
/proc/14907/stat : 14907 (TNM) R 14904 14904 14483 0 -1 4202496 266 0 0 0 629 0 0 0 25 0 1 0 528222156 466628608 163 33554432000 134512640 134534564 4288515792 18446744073709551615 134530820 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/14907/statm: 113923 163 95 6 0 112589 0
[pid=14908] ppid=14904 vsize=12408 CPUtime=6.29 cores=3
/proc/14908/stat : 14908 (march_hi) R 14904 14904 14483 0 -1 4202496 1591 0 0 0 629 0 0 0 25 0 1 0 528222156 12705792 1476 33554432000 4194304 4331988 140737420758320 18446744073709551615 4212181 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/14908/statm: 3102 1476 173 34 0 1544 0
[pid=14909] ppid=14904 vsize=140276 CPUtime=25.1 cores=4-7
/proc/14909/stat : 14909 (plingeling) S 14904 14904 14483 0 -1 4202496 12091 1257 0 0 2508 2 0 0 18 0 5 0 528222156 143642624 7359 33554432000 4194304 4356188 140737474020000 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/14909/statm: 35069 7359 163 40 0 33613 0
[pid=14909/tid=14916] ppid=14904 vsize=140276 CPUtime=6.22 cores=4-7
/proc/14909/task/14916/stat : 14916 (plingeling) R 14904 14904 14483 0 -1 4202560 2885 1257 0 0 622 0 0 0 25 0 5 0 528222157 143642624 7359 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331335 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14909/tid=14917] ppid=14904 vsize=140276 CPUtime=6.28 cores=4-7
/proc/14909/task/14917/stat : 14917 (plingeling) R 14904 14904 14483 0 -1 4202560 2902 1257 0 0 628 0 0 0 25 0 5 0 528222157 143642624 7359 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331352 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14909/tid=14918] ppid=14904 vsize=140276 CPUtime=6.28 cores=4-7
/proc/14909/task/14918/stat : 14918 (plingeling) R 14904 14904 14483 0 -1 4202560 3005 1257 0 0 628 0 0 0 25 0 5 0 528222157 143642624 7359 33554432000 4194304 4356188 140737474020000 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14909/tid=14919] ppid=14904 vsize=140276 CPUtime=6.28 cores=4-7
/proc/14909/task/14919/stat : 14919 (plingeling) R 14904 14904 14483 0 -1 4202560 2970 1257 0 0 628 0 0 0 25 0 5 0 528222157 143642624 7359 33554432000 4194304 4356188 140737474020000 18446744073709551615 4210579 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.26
Current children cumulated vsize (KiB) 2500772

[startup+12.7011 s]
/proc/loadavg: 7.46 7.88 7.96 9/180 14920
/proc/meminfo: memFree=30859264/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) S 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 3964460289738407935 0 0 17 3 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
[pid=14905] ppid=14904 vsize=1866780 CPUtime=12.68 cores=0
/proc/14905/stat : 14905 (cryptominisat) R 14904 14904 14483 0 -1 4202496 13142 0 0 0 1267 1 0 0 25 0 1 0 528222156 1911582720 4559 33554432000 4194304 4587354 140737236650720 18446744073709551615 4231728 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/14905/statm: 466695 4559 337 96 0 463257 0
[pid=14906] ppid=14904 vsize=13356 CPUtime=12.69 cores=1
/proc/14906/stat : 14906 (clasp) R 14904 14904 14483 0 -1 4202496 791 0 0 0 1269 0 0 0 25 0 1 0 528222156 13676544 682 33554432000 4194304 4785740 140735057728128 18446744073709551615 4286930 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/14906/statm: 3339 682 340 145 0 384 0
[pid=14907] ppid=14904 vsize=455692 CPUtime=12.69 cores=2
/proc/14907/stat : 14907 (TNM) R 14904 14904 14483 0 -1 4202496 266 0 0 0 1269 0 0 0 25 0 1 0 528222156 466628608 163 33554432000 134512640 134534564 4288515792 18446744073709551615 134529267 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/14907/statm: 113923 163 95 6 0 112589 0
[pid=14908] ppid=14904 vsize=19184 CPUtime=12.69 cores=3
/proc/14908/stat : 14908 (march_hi) R 14904 14904 14483 0 -1 4202496 2765 0 0 0 1268 1 0 0 25 0 1 0 528222156 19644416 2650 33554432000 4194304 4331988 140737420758320 18446744073709551615 4246737 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/14908/statm: 4796 2650 173 34 0 3238 0
[pid=14909] ppid=14904 vsize=143152 CPUtime=50.66 cores=4-7
/proc/14909/stat : 14909 (plingeling) S 14904 14904 14483 0 -1 4202496 19006 1257 0 0 5063 3 0 0 18 0 5 0 528222156 146587648 8078 33554432000 4194304 4356188 140737474020000 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/14909/statm: 35788 8078 163 40 0 34332 0
[pid=14909/tid=14916] ppid=14904 vsize=143152 CPUtime=12.59 cores=4-7
/proc/14909/task/14916/stat : 14916 (plingeling) R 14904 14904 14483 0 -1 4202560 4550 1257 0 0 1259 0 0 0 25 0 5 0 528222157 146587648 8078 33554432000 4194304 4356188 140737474020000 18446744073709551615 4273857 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14909/tid=14917] ppid=14904 vsize=143152 CPUtime=12.67 cores=4-7
/proc/14909/task/14917/stat : 14917 (plingeling) R 14904 14904 14483 0 -1 4202560 4470 1257 0 0 1267 0 0 0 25 0 5 0 528222157 146587648 8078 33554432000 4194304 4356188 140737474020000 18446744073709551615 4332003 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14909/tid=14918] ppid=14904 vsize=143152 CPUtime=12.68 cores=4-7
/proc/14909/task/14918/stat : 14918 (plingeling) R 14904 14904 14483 0 -1 4202560 4894 1257 0 0 1268 0 0 0 25 0 5 0 528222157 146587648 8078 33554432000 4194304 4356188 140737474020000 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14909/tid=14919] ppid=14904 vsize=143152 CPUtime=12.68 cores=4-7
/proc/14909/task/14919/stat : 14919 (plingeling) R 14904 14904 14483 0 -1 4202560 4763 1257 0 0 1268 0 0 0 25 0 5 0 528222157 146587648 8078 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.41
Current children cumulated vsize (KiB) 2516488

[startup+25.5007 s]
/proc/loadavg: 7.58 7.89 7.96 9/180 14920
/proc/meminfo: memFree=30830732/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) S 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 3964460289738407935 0 0 17 3 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
[pid=14905] ppid=14904 vsize=1868808 CPUtime=25.48 cores=0
/proc/14905/stat : 14905 (cryptominisat) R 14904 14904 14483 0 -1 4202496 20038 0 0 0 2546 2 0 0 25 0 1 0 528222156 1913659392 6208 33554432000 4194304 4587354 140737236650720 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=14907] ppid=14904 vsize=455696 CPUtime=4841.63 cores=2
/proc/14907/stat : 14907 (TNM) R 14904 14904 14483 0 -1 4202496 275 0 0 0 484162 1 0 0 25 0 1 0 528222156 466632704 172 33554432000 134512640 134534564 4288515792 18446744073709551615 4869344 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/14907/statm: 113924 172 103 6 0 112590 0
[pid=14908] ppid=14904 vsize=4039564 CPUtime=4842.43 cores=3
/proc/14908/stat : 14908 (march_hi) R 14904 14904 14483 0 -1 4202496 844715 0 0 0 483941 302 0 0 25 0 1 0 528222156 4136513536 844600 33554432000 4194304 4331988 140737420758320 18446744073709551615 4308792 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/14908/statm: 1009891 844600 173 34 0 1008333 0
[pid=14909] ppid=14904 vsize=505972 CPUtime=19343 cores=4-7
/proc/14909/stat : 14909 (plingeling) S 14904 14904 14483 0 -1 4202496 1297642 1257 0 0 1934111 190 0 0 18 0 5 0 528222156 518115328 98619 33554432000 4194304 4356188 140737474020000 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/14909/statm: 126493 98619 163 40 0 125037 0
[pid=14909/tid=14916] ppid=14904 vsize=505972 CPUtime=4816.16 cores=4-7
/proc/14909/task/14916/stat : 14916 (plingeling) R 14904 14904 14483 0 -1 4202560 326313 1257 0 0 481568 48 0 0 25 0 5 0 528222157 518115328 98619 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14909/tid=14917] ppid=14904 vsize=505972 CPUtime=4841.95 cores=4-7
/proc/14909/task/14917/stat : 14917 (plingeling) R 14904 14904 14483 0 -1 4202560 321433 1257 0 0 484148 47 0 0 25 0 5 0 528222157 518115328 98619 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331023 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14909/tid=14918] ppid=14904 vsize=505972 CPUtime=4842.43 cores=4-7
/proc/14909/task/14918/stat : 14918 (plingeling) R 14904 14904 14483 0 -1 4202560 315809 1257 0 0 484191 52 0 0 25 0 5 0 528222157 518115328 98619 33554432000 4194304 4356188 140737474020000 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14909/tid=14919] ppid=14904 vsize=505972 CPUtime=4842.43 cores=4-7
/proc/14909/task/14919/stat : 14919 (plingeling) R 14904 14904 14483 0 -1 4202560 333758 1257 0 0 484202 41 0 0 25 0 5 0 528222157 518115328 98619 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331007 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38711.8
Current children cumulated vsize (KiB) 7052092

[startup+4902.3 s]
/proc/loadavg: 8.06 8.06 8.00 9/180 15062
/proc/meminfo: memFree=26934472/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) S 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 3964460289738407935 0 0 17 3 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
[pid=14905] ppid=14904 vsize=2017724 CPUtime=4902.43 cores=0
/proc/14905/stat : 14905 (cryptominisat) R 14904 14904 14483 0 -1 4202496 389952 0 0 0 490124 119 0 0 25 0 1 0 528222156 2066149376 43039 33554432000 4194304 4587354 140737236650720 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/14905/statm: 504431 43039 337 96 0 500993 0
[pid=14906] ppid=14904 vsize=15372 CPUtime=4902.26 cores=1
/proc/14906/stat : 14906 (clasp) R 14904 14904 14483 0 -1 4202496 1300 0 0 0 490226 0 0 0 25 0 1 0 528222156 15740928 1191 33554432000 4194304 4785740 140735057728128 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/14906/statm: 3843 1191 344 145 0 888 0
[pid=14907] ppid=14904 vsize=455696 CPUtime=4901.64 cores=2
/proc/14907/stat : 14907 (TNM) R 14904 14904 14483 0 -1 4202496 275 0 0 0 490162 2 0 0 25 0 1 0 528222156 466632704 172 33554432000 134512640 134534564 4288515792 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/14907/statm: 113924 172 103 6 0 112590 0
[pid=14908] ppid=14904 vsize=4039564 CPUtime=4902.43 cores=3
/proc/14908/stat : 14908 (march_hi) R 14904 14904 14483 0 -1 4202496 854890 0 0 0 489937 306 0 0 25 0 1 0 528222156 4136513536 854775 33554432000 4194304 4331988 140737420758320 18446744073709551615 4237096 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/14908/statm: 1009891 854775 173 34 0 1008333 0
[pid=14909] ppid=14904 vsize=493300 CPUtime=19582.7 cores=4-7
/proc/14909/stat : 14909 (plingeling) S 14904 14904 14483 0 -1 4202496 1307178 1257 0 0 1958078 191 0 0 18 0 5 0 528222156 505139200 95451 33554432000 4194304 4356188 140737474020000 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/14909/statm: 123325 95451 163 40 0 121869 0
[pid=14909/tid=14916] ppid=14904 vsize=493300 CPUtime=4875.85 cores=4-7
/proc/14909/task/14916/stat : 14916 (plingeling) R 14904 14904 14483 0 -1 4202560 328425 1257 0 0 487536 49 0 0 25 0 5 0 528222157 505139200 95451 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331050 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14909/tid=14917] ppid=14904 vsize=493300 CPUtime=4901.95 cores=4-7
/proc/14909/task/14917/stat : 14917 (plingeling) R 14904 14904 14483 0 -1 4202560 324153 1257 0 0 490148 47 0 0 25 0 5 0 528222157 505139200 95451 33554432000 4194304 4356188 140737474020000 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14909/tid=14918] ppid=14904 vsize=493300 CPUtime=4902.43 cores=4-7
/proc/14909/task/14918/stat : 14918 (plingeling) R 14904 14904 14483 0 -1 4202560 317121 1257 0 0 490191 52 0 0 25 0 5 0 528222157 505139200 95451 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14909/tid=14919] ppid=14904 vsize=493300 CPUtime=4902.44 cores=4-7
/proc/14909/task/14919/stat : 14919 (plingeling) R 14904 14904 14483 0 -1 4202560 337150 1257 0 0 490202 42 0 0 25 0 5 0 528222157 505139200 95451 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39191.4
Current children cumulated vsize (KiB) 7039980

[startup+4962.3 s]
/proc/loadavg: 8.05 8.06 8.00 9/180 15064
/proc/meminfo: memFree=26879124/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) S 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 3964460289738407935 0 0 17 3 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
[pid=14905] ppid=14904 vsize=2017168 CPUtime=4962.44 cores=0
/proc/14905/stat : 14905 (cryptominisat) R 14904 14904 14483 0 -1 4202496 390959 0 0 0 496124 120 0 0 25 0 1 0 528222156 2065580032 43039 33554432000 4194304 4587354 140737236650720 18446744073709551615 4238618 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/14905/statm: 504292 43039 337 96 0 500854 0
[pid=14906] ppid=14904 vsize=15372 CPUtime=4962.26 cores=1
/proc/14906/stat : 14906 (clasp) R 14904 14904 14483 0 -1 4202496 1300 0 0 0 496226 0 0 0 25 0 1 0 528222156 15740928 1191 33554432000 4194304 4785740 140735057728128 18446744073709551615 4546099 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/14906/statm: 3843 1191 344 145 0 888 0
[pid=14907] ppid=14904 vsize=455696 CPUtime=4961.64 cores=2
/proc/14907/stat : 14907 (TNM) R 14904 14904 14483 0 -1 4202496 275 0 0 0 496162 2 0 0 25 0 1 0 528222156 466632704 172 33554432000 134512640 134534564 4288515792 18446744073709551615 134530273 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/14907/statm: 113924 172 103 6 0 112590 0
[pid=14908] ppid=14904 vsize=4039564 CPUtime=4962.43 cores=3
/proc/14908/stat : 14908 (march_hi) R 14904 14904 14483 0 -1 4202496 865194 0 0 0 495933 310 0 0 25 0 1 0 528222156 4136513536 865079 33554432000 4194304 4331988 140737420758320 18446744073709551615 4240527 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/14908/statm: 1009891 865079 173 34 0 1008333 0
[pid=14909] ppid=14904 vsize=508148 CPUtime=19822.4 cores=4-7
/proc/14909/stat : 14909 (plingeling) S 14904 14904 14483 0 -1 4202496 1317066 1257 0 0 1982044 193 0 0 18 0 5 0 528222156 520343552 99163 33554432000 4194304 4356188 140737474020000 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/14909/statm: 127037 99163 163 40 0 125581 0
[pid=14909/tid=14916] ppid=14904 vsize=508148 CPUtime=4935.51 cores=4-7
/proc/14909/task/14916/stat : 14916 (plingeling) R 14904 14904 14483 0 -1 4202560 331753 1257 0 0 493502 49 0 0 25 0 5 0 528222157 520343552 99163 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14909/tid=14917] ppid=14904 vsize=508148 CPUtime=4961.95 cores=4-7
/proc/14909/task/14917/stat : 14917 (plingeling) R 14904 14904 14483 0 -1 4202560 325945 1257 0 0 496147 48 0 0 25 0 5 0 528222157 520343552 99163 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14909/tid=14918] ppid=14904 vsize=508148 CPUtime=4962.43 cores=4-7
/proc/14909/task/14918/stat : 14918 (plingeling) R 14904 14904 14483 0 -1 4202560 319553 1257 0 0 496191 52 0 0 25 0 5 0 528222157 520343552 99163 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331050 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14909/tid=14919] ppid=14904 vsize=508148 CPUtime=4962.44 cores=4-7
/proc/14909/task/14919/stat : 14919 (plingeling) R 14904 14904 14483 0 -1 4202560 339486 1257 0 0 496202 42 0 0 25 0 5 0 528222157 520343552 99163 33554432000 4194304 4356188 140737474020000 18446744073709551615 4330976 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39671.1
Current children cumulated vsize (KiB) 7054272



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5003.5 s]
/proc/loadavg: 8.02 8.05 8.00 9/180 15065
/proc/meminfo: memFree=26867068/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) S 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 3964460289738407935 0 0 17 3 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
[pid=14905] ppid=14904 vsize=2017168 CPUtime=5003.65 cores=0
/proc/14905/stat : 14905 (cryptominisat) R 14904 14904 14483 0 -1 4202496 391937 0 0 0 500245 120 0 0 25 0 1 0 528222156 2065580032 43975 33554432000 4194304 4587354 140737236650720 18446744073709551615 4231904 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/14905/statm: 504292 43975 337 96 0 500854 0
[pid=14906] ppid=14904 vsize=15372 CPUtime=5003.47 cores=1
/proc/14906/stat : 14906 (clasp) R 14904 14904 14483 0 -1 4202496 1300 0 0 0 500347 0 0 0 25 0 1 0 528222156 15740928 1191 33554432000 4194304 4785740 140735057728128 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/14906/statm: 3843 1191 344 145 0 888 0
[pid=14907] ppid=14904 vsize=455696 CPUtime=5002.85 cores=2
/proc/14907/stat : 14907 (TNM) R 14904 14904 14483 0 -1 4202496 275 0 0 0 500283 2 0 0 25 0 1 0 528222156 466632704 172 33554432000 134512640 134534564 4288515792 18446744073709551615 134528638 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/14907/statm: 113924 172 103 6 0 112590 0
[pid=14908] ppid=14904 vsize=4039564 CPUtime=5003.64 cores=3
/proc/14908/stat : 14908 (march_hi) R 14904 14904 14483 0 -1 4202496 872183 0 0 0 500052 312 0 0 25 0 1 0 528222156 4136513536 872068 33554432000 4194304 4331988 140737420758320 18446744073709551615 4228896 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/14908/statm: 1009891 872068 173 34 0 1008333 0
[pid=14909] ppid=14904 vsize=488180 CPUtime=19987 cores=4-7
/proc/14909/stat : 14909 (plingeling) S 14904 14904 14483 0 -1 4202496 1324266 1257 0 0 1998503 194 0 0 18 0 5 0 528222156 499896320 94171 33554432000 4194304 4356188 140737474020000 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/14909/statm: 122045 94171 163 40 0 120589 0
[pid=14909/tid=14916] ppid=14904 vsize=488180 CPUtime=4976.5 cores=4-7
/proc/14909/task/14916/stat : 14916 (plingeling) R 14904 14904 14483 0 -1 4202560 333993 1257 0 0 497600 50 0 0 25 0 5 0 528222157 499896320 94171 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331126 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14909/tid=14917] ppid=14904 vsize=488180 CPUtime=5003.15 cores=4-7
/proc/14909/task/14917/stat : 14917 (plingeling) R 14904 14904 14483 0 -1 4202560 327705 1257 0 0 500267 48 0 0 25 0 5 0 528222157 499896320 94171 33554432000 4194304 4356188 140737474020000 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14909/tid=14918] ppid=14904 vsize=488180 CPUtime=5003.64 cores=4-7
/proc/14909/task/14918/stat : 14918 (plingeling) R 14904 14904 14483 0 -1 4202560 322369 1257 0 0 500312 52 0 0 25 0 5 0 528222157 499896320 94171 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14909/tid=14919] ppid=14904 vsize=488180 CPUtime=5003.64 cores=4-7
/proc/14909/task/14919/stat : 14919 (plingeling) R 14904 14904 14483 0 -1 4202560 339870 1257 0 0 500322 42 0 0 25 0 5 0 528222157 499896320 94171 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 7034304

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5003.5 s]
/proc/loadavg: 8.02 8.05 8.00 9/180 15065
/proc/meminfo: memFree=26867068/32951124 swapFree=67111448/67111528
[pid=14904] ppid=14902 vsize=18324 CPUtime=0 cores=0-7
/proc/14904/stat : 14904 (ppfolio) S 14902 14904 14483 0 -1 4202496 518 0 0 0 0 0 0 0 15 0 1 0 528222156 18763776 389 33554432000 4194304 4287625 140736733850560 18446744073709551615 230809185807 0 0 4096 65536 3964460289738407935 0 0 17 3 0 0 0
/proc/14904/statm: 4581 389 341 23 0 91 0
[pid=14905] ppid=14904 vsize=2017168 CPUtime=5003.65 cores=0
/proc/14905/stat : 14905 (cryptominisat) R 14904 14904 14483 0 -1 4202496 391937 0 0 0 500245 120 0 0 25 0 1 0 528222156 2065580032 43975 33554432000 4194304 4587354 140737236650720 18446744073709551615 4231904 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/14905/statm: 504292 43975 337 96 0 500854 0
[pid=14906] ppid=14904 vsize=15372 CPUtime=5003.47 cores=1
/proc/14906/stat : 14906 (clasp) R 14904 14904 14483 0 -1 4202496 1300 0 0 0 500347 0 0 0 25 0 1 0 528222156 15740928 1191 33554432000 4194304 4785740 140735057728128 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/14906/statm: 3843 1191 344 145 0 888 0
[pid=14907] ppid=14904 vsize=455696 CPUtime=5002.85 cores=2
/proc/14907/stat : 14907 (TNM) R 14904 14904 14483 0 -1 4202496 275 0 0 0 500283 2 0 0 25 0 1 0 528222156 466632704 172 33554432000 134512640 134534564 4288515792 18446744073709551615 134528638 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/14907/statm: 113924 172 103 6 0 112590 0
[pid=14908] ppid=14904 vsize=4039564 CPUtime=5003.64 cores=3
/proc/14908/stat : 14908 (march_hi) R 14904 14904 14483 0 -1 4202496 872183 0 0 0 500052 312 0 0 25 0 1 0 528222156 4136513536 872068 33554432000 4194304 4331988 140737420758320 18446744073709551615 4228896 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/14908/statm: 1009891 872068 173 34 0 1008333 0
[pid=14909] ppid=14904 vsize=488180 CPUtime=19987 cores=4-7
/proc/14909/stat : 14909 (plingeling) S 14904 14904 14483 0 -1 4202496 1324266 1257 0 0 1998503 194 0 0 18 0 5 0 528222156 499896320 94171 33554432000 4194304 4356188 140737474020000 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/14909/statm: 122045 94171 163 40 0 120589 0
[pid=14909/tid=14916] ppid=14904 vsize=488180 CPUtime=4976.5 cores=4-7
/proc/14909/task/14916/stat : 14916 (plingeling) R 14904 14904 14483 0 -1 4202560 333993 1257 0 0 497600 50 0 0 25 0 5 0 528222157 499896320 94171 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331126 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=14909/tid=14917] ppid=14904 vsize=488180 CPUtime=5003.15 cores=4-7
/proc/14909/task/14917/stat : 14917 (plingeling) R 14904 14904 14483 0 -1 4202560 327705 1257 0 0 500267 48 0 0 25 0 5 0 528222157 499896320 94171 33554432000 4194304 4356188 140737474020000 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14909/tid=14918] ppid=14904 vsize=488180 CPUtime=5003.64 cores=4-7
/proc/14909/task/14918/stat : 14918 (plingeling) R 14904 14904 14483 0 -1 4202560 322369 1257 0 0 500312 52 0 0 25 0 5 0 528222157 499896320 94171 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14909/tid=14919] ppid=14904 vsize=488180 CPUtime=5003.64 cores=4-7
/proc/14909/task/14919/stat : 14919 (plingeling) R 14904 14904 14483 0 -1 4202560 339870 1257 0 0 500322 42 0 0 25 0 5 0 528222157 499896320 94171 33554432000 4194304 4356188 140737474020000 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 7034304

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 14904 and gives
#  childrusage.ru_utime.tv_sec=15008
#  childrusage.ru_utime.tv_usec=758321
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=246810
# CPU time returned by wait4() is 15010
# while last known CPU time is 40000.6
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5003.52
CPU time (s): 40000.6
CPU user time (s): 39994.3
CPU system time (s): 6.28
CPU usage (%): 799.449
Max. virtual memory (cumulated for all children) (KiB): 16281772

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 15008.8
system time used= 1.24681
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 394047
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 872
involuntary context switches= 30581

runsolver used 8.43472 second user time and 18.6902 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-30 14:23:37
IDJOB=3275271
IDBENCH=83148
IDSOLVER=1638
FILE ID=node104/3275271-1304166217
RUNJOBID= node104-1304158486-14497
PBS_JOBID= 13170916
Free space on /tmp= 72544 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n130-s30940966-unsat.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3275271-1304166217/watcher-3275271-1304166217 -o /tmp/evaluation-result-3275271-1304166217/solver-3275271-1304166217 -C 40000 -W 5100 -M 31000  ppfolio HOME/instance-3275271-1304166217.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ca44a78076b8228fbb99ecc0147f157f
RANDOM SEED=893107192

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30918628 kB
Buffers:        413932 kB
Cached:        1143780 kB
SwapCached:         80 kB
Active:         173328 kB
Inactive:      1448196 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30918628 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:           10104 kB
Writeback:           0 kB
AnonPages:       64316 kB
Mapped:          14704 kB
Slab:           345064 kB
PageTables:       4248 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187980 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72532 MiB
End job on node104 at 2011-04-30 15:47:03