Trace number 3317729

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4800.12 1205.26

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rbcl_xits_08_UNSAT.cnf
MD5SUM66aa2e18c32a02f55a810347a9702c7f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1067.51
Satisfiable
(Un)Satisfiability was proved
Number of variables1278
Number of clauses68055
Sum of the clauses size202155
Maximum clause length9
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22148
Number of clauses of size 365884
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data 

0.36/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.36/0.67	c INFO: solving HOME/instance-3317729-1304268514.cnf
0.36/0.67	c INFO: computing task features
0.53/0.89	c INFO: computed variable-clause graph statistics
0.63/0.90	c INFO: computed clause balance statistics
1.63/1.98	c INFO: computed variable balance statistics
2.63/2.98	c INFO: computed small-clause counts
2.63/2.99	c INFO: computed Horn-clause counts
2.73/3.01	c INFO: computed variable graph statistics
2.73/3.01	c INFO: collected features for HOME/instance-3317729-1304268514.cnf in 2.32 s
2.73/3.03	c INFO: running lingeling-276@0 for 97 with 4797 remaining (b = 0.26)
2.73/3.05	c INFO: running cryptominisat-2.9.0@0 for 485 with 4797 remaining (b = 0.33)
2.73/3.08	c INFO: running lingeling-276@0 for 582 with 4797 remaining (b = 0.37)
2.82/3.10	c INFO: running lingeling-276@0 for 1261 with 4797 remaining (b = 0.43)
402.26/103.18	c INFO: running SApperloT@0 for 97 with 4697 remaining (b = 0.03)
802.49/203.33	c INFO: running precosat-570@0 for 291 with 4597 remaining (b = 0.14)
1964.62/494.40	c INFO: running cryptominisat-2.9.0@0 for 388 with 4306 remaining (b = 0.18)
1970.22/495.72	c INFO: running cryptominisat-2.9.0@0 for 388 with 4304 remaining (b = 0.15)
2341.95/588.86	c INFO: running lingeling-276@0 for 582 with 4211 remaining (b = 0.20)
3537.99/888.44	c INFO: running cryptominisat-2.9.0@291 for 194 with 3912 remaining (b = 0.12)
3541.97/889.47	c INFO: running lingeling-276@0 for 97 with 3911 remaining (b = 0.05)
3941.17/989.64	c INFO: running cryptominisat-2.9.0@584 for 1067 with 3811 remaining (b = 0.34)
4304.87/1080.96	c INFO: running precosat-570@487 for 291 with 3719 remaining (b = 0.13)
4666.23/1171.67	c INFO: running lingeling-276@390 for 97 with 3629 remaining (b = 0.04)
4800.12/1205.23	c INFO: running cryptominisat-2.9.0@0 for 194 with 3595 remaining (b = 0.06)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317729-1304268514/watcher-3317729-1304268514 -o /tmp/evaluation-result-3317729-1304268514/solver-3317729-1304268514 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317729-1304268514.cnf -seed 867666104 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.08 7.98 5.84 5/215 5490
/proc/meminfo: memFree=28144692/32950928 swapFree=67111428/67111528
[pid=5490] ppid=5488 vsize=15384 CPUtime=0 cores=1,3,5,7
/proc/5490/stat : 5490 (python) R 5488 5490 5278 0 -1 4202496 790 0 0 0 0 0 0 0 25 0 1 0 538451211 15753216 678 33554432000 4194304 5683644 140734838911568 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/5490/statm: 3846 678 322 364 0 333 0

[startup+0.075467 s]
/proc/loadavg: 8.08 7.98 5.84 5/215 5490
/proc/meminfo: memFree=28144692/32950928 swapFree=67111428/67111528
[pid=5490] ppid=5488 vsize=38904 CPUtime=0.04 cores=1,3,5,7
/proc/5490/stat : 5490 (python) S 5488 5490 5278 0 -1 4202496 1665 0 0 0 3 1 0 0 25 0 1 0 538451211 39837696 1491 33554432000 4194304 5683644 140734838911568 18446744073709551615 248084774535 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/5490/statm: 9726 1491 455 364 0 1026 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 38904

[startup+0.100462 s]
/proc/loadavg: 8.08 7.98 5.84 5/215 5490
/proc/meminfo: memFree=28144692/32950928 swapFree=67111428/67111528
[pid=5490] ppid=5488 vsize=85620 CPUtime=0.06 cores=1,3,5,7
/proc/5490/stat : 5490 (python) S 5488 5490 5278 0 -1 4202496 2631 0 0 0 4 2 0 0 25 0 1 0 538451211 87674880 2348 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089696256 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/5490/statm: 21405 2348 713 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85620

[startup+0.300512 s]
/proc/loadavg: 8.08 7.98 5.84 5/215 5490
/proc/meminfo: memFree=28144692/32950928 swapFree=67111428/67111528
[pid=5490] ppid=5488 vsize=135748 CPUtime=0.18 cores=1,3,5,7
/proc/5490/stat : 5490 (python) S 5488 5490 5278 0 -1 4202496 5965 933 1 0 12 6 0 0 25 0 1 0 538451211 139005952 4150 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089694213 0 2147483391 16781312 2 18446744071699199166 0 0 17 1 0 0 0
/proc/5490/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700417 s]
/proc/loadavg: 8.08 7.98 5.84 5/215 5490
/proc/meminfo: memFree=28144692/32950928 swapFree=67111428/67111528
[pid=5490] ppid=5488 vsize=280628 CPUtime=0.43 cores=1,3,5,7
/proc/5490/stat : 5490 (python) R 5488 5490 5278 0 -1 4202496 9797 933 1 0 30 13 0 0 15 0 1 0 538451211 287363072 7475 33554432000 4194304 5683644 140734838911568 18446744073709551615 4527920 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/5490/statm: 70157 7475 1761 364 0 6081 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 280628

[startup+1.50021 s]
/proc/loadavg: 8.08 7.98 5.84 6/216 5495
/proc/meminfo: memFree=28043492/32950928 swapFree=67111428/67111528
[pid=5490] ppid=5488 vsize=290848 CPUtime=1.23 cores=1,3,5,7
/proc/5490/stat : 5490 (python) R 5488 5490 5278 0 -1 4202496 14240 933 1 0 109 14 0 0 16 0 1 0 538451211 297828352 10097 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089357743 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/5490/statm: 72712 10097 1826 364 0 8636 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 290848

[startup+3.10093 s]
/proc/loadavg: 7.83 7.93 5.84 6/216 5495
/proc/meminfo: memFree=28041136/32950928 swapFree=67111428/67111528
[pid=5490] ppid=5488 vsize=313468 CPUtime=2.82 cores=1,3,5,7
/proc/5490/stat : 5490 (python) R 5488 5490 5278 0 -1 4202496 16525 933 1 0 267 15 0 0 24 0 4 0 538451211 320991232 8121 33554432000 4194304 5683644 140734838911568 18446744073709551615 47828243462036 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/5490/statm: 78367 8121 1878 364 0 14279 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 313468

[startup+6.30137 s]
/proc/loadavg: 7.83 7.93 5.84 9/228 5507
/proc/meminfo: memFree=27972220/32950928 swapFree=67111428/67111528
[pid=5490] ppid=5488 vsize=323724 CPUtime=2.83 cores=1,3,5,7
/proc/5490/stat : 5490 (python) S 5488 5490 5278 0 -1 4202496 16925 933 1 0 268 15 0 0 25 0 5 0 538451211 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101524939 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/5490/statm: 80931 8128 1881 364 0 16840 0
[pid=5496] ppid=5490 vsize=283376 CPUtime=0 cores=1,3,5,7
/proc/5496/stat : 5496 (python) S 5490 5490 5278 0 -1 4202560 810 0 0 0 0 0 0 0 18 0 1 0 538451514 290177024 6502 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718287 0 0 16781312 514 8619933121791361285 0 0 17 1 0 0 0
/proc/5496/statm: 70844 6502 360 364 0 6762 0
[pid=5498] ppid=5496 vsize=13068 CPUtime=3.25 cores=1,3,5,7
/proc/5498/stat : 5498 (lingeling) R 5496 5498 5498 0 -1 4202496 3544 0 0 0 325 0 0 0 25 0 1 0 538451515 13381632 2434 33554432000 4194304 4352236 140734331248240 18446744073709551615 4268321 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/5498/statm: 3267 2434 128 39 0 2347 0
[pid=5499] ppid=5490 vsize=293452 CPUtime=0 cores=1,3,5,7
/proc/5499/stat : 5499 (python) S 5490 5490 5278 0 -1 4202560 750 0 0 0 0 0 0 0 15 0 1 0 538451517 300494848 6585 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 18377734330198753544 0 0 17 5 0 0 0
/proc/5499/statm: 73363 6585 349 364 0 9278 0
[pid=5501] ppid=5499 vsize=46880 CPUtime=3.2 cores=1,3,5,7
/proc/5501/stat : 5501 (cryptominisat-2) R 5499 5501 5501 0 -1 4202496 7454 0 0 0 320 0 0 0 25 0 1 0 538451517 48005120 4895 33554432000 4194304 4677096 140733364965680 18446744073709551615 4320052 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/5501/statm: 11720 4895 388 118 0 6679 0
[pid=5502] ppid=5490 vsize=304116 CPUtime=0 cores=1,3,5,7
/proc/5502/stat : 5502 (python) S 5490 5490 5278 0 -1 4202560 754 0 0 0 0 0 0 0 18 0 1 0 538451519 311414784 6589 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 8619929273500664072 0 0 17 5 0 0 0
/proc/5502/statm: 76029 6589 349 364 0 11941 0
[pid=5504] ppid=5502 vsize=12612 CPUtime=3.2 cores=1,3,5,7
/proc/5504/stat : 5504 (lingeling) R 5502 5504 5504 0 -1 4202496 3430 0 0 0 320 0 0 0 25 0 1 0 538451519 12914688 2320 33554432000 4194304 4352236 140736861524208 18446744073709551615 4328016 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/5504/statm: 3153 2320 128 39 0 2233 0
[pid=5505] ppid=5490 vsize=314324 CPUtime=0 cores=1,3,5,7
/proc/5505/stat : 5505 (python) S 5490 5490 5278 0 -1 4202560 751 0 0 0 0 0 0 0 18 0 1 0 538451522 321867776 6593 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 4613611817338372356 0 0 17 1 0 0 0
/proc/5505/statm: 78581 6593 349 364 0 14490 0
[pid=5507] ppid=5505 vsize=12516 CPUtime=3.18 cores=1,3,5,7
/proc/5507/stat : 5507 (lingeling) R 5505 5507 5507 0 -1 4202496 3409 0 0 0 318 0 0 0 25 0 1 0 538451522 12816384 2297 33554432000 4194304 4352236 140734050030480 18446744073709551615 4328087 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/5507/statm: 3129 2297 128 39 0 2209 0
[pid=5490/tid=5497] ppid=5488 vsize=323724 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5497/stat : 5497 (python) S 5488 5490 5278 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 5 0 538451515 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 3 0 0 0
[pid=5490/tid=5500] ppid=5488 vsize=323724 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5500/stat : 5500 (python) S 5488 5490 5278 0 -1 4202560 20 933 0 0 0 0 0 0 22 0 5 0 538451517 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 7 0 0 0
[pid=5490/tid=5503] ppid=5488 vsize=323724 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5503/stat : 5503 (python) S 5488 5490 5278 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 5 0 538451519 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 5 0 0 0
[pid=5490/tid=5506] ppid=5488 vsize=323724 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5506/stat : 5506 (python) S 5488 5490 5278 0 -1 4202560 26 933 0 0 0 0 0 0 25 0 5 0 538451522 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 15.66
Current children cumulated vsize (KiB) 1604068

[startup+12.7012 s]
/proc/loadavg: 7.86 7.94 5.86 9/228 5507
/proc/meminfo: memFree=27941988/32950928 swapFree=67111428/67111528
[pid=5490] ppid=5488 vsize=323724 CPUtime=2.83 cores=1,3,5,7
/proc/5490/stat : 5490 (python) S 5488 5490 5278 0 -1 4202496 16925 933 1 0 268 15 0 0 25 0 5 0 538451211 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101524939 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/5490/statm: 80931 8128 1881 364 0 16840 0
[pid=5496] ppid=5490 vsize=283376 CPUtime=0 cores=1,3,5,7
/proc/5496/stat : 5496 (python) S 5490 5490 5278 0 -1 4202560 987 0 0 0 0 0 0 0 18 0 1 0 538451514 290177024 6524 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718287 0 0 16781312 514 8619933121791361285 0 0 17 1 0 0 0
/proc/5496/statm: 70844 6524 382 364 0 6762 0
[pid=5498] ppid=5496 vsize=13964 CPUtime=9.65 cores=1,3,5,7
/proc/5498/stat : 5498 (lingeling) R 5496 5498 5498 0 -1 4202496 3768 0 0 0 965 0 0 0 25 0 1 0 538451515 14299136 2658 33554432000 4194304 4352236 140734331248240 18446744073709551615 4328095 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/5498/statm: 3491 2658 128 39 0 2571 0
[pid=5499] ppid=5490 vsize=293452 CPUtime=0 cores=1,3,5,7
/proc/5499/stat : 5499 (python) S 5490 5490 5278 0 -1 4202560 919 0 0 0 0 0 0 0 15 0 1 0 538451517 300494848 6608 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 18377734330198753544 0 0 17 5 0 0 0
/proc/5499/statm: 73363 6608 372 364 0 9278 0
[pid=5501] ppid=5499 vsize=68164 CPUtime=9.57 cores=1,3,5,7
/proc/5501/stat : 5501 (cryptominisat-2) R 5499 5501 5501 0 -1 4202496 14435 0 0 0 955 2 0 0 25 0 1 0 538451517 69799936 10201 33554432000 4194304 4677096 140733364965680 18446744073709551615 4319783 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/5501/statm: 17041 10201 391 118 0 12000 0
[pid=5502] ppid=5490 vsize=304116 CPUtime=0 cores=1,3,5,7
/proc/5502/stat : 5502 (python) S 5490 5490 5278 0 -1 4202560 933 0 0 0 0 0 0 0 18 0 1 0 538451519 311414784 6612 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 8619929273500664072 0 0 17 5 0 0 0
/proc/5502/statm: 76029 6612 372 364 0 11941 0
[pid=5504] ppid=5502 vsize=14432 CPUtime=9.58 cores=1,3,5,7
/proc/5504/stat : 5504 (lingeling) R 5502 5504 5504 0 -1 4202496 3885 0 0 0 958 0 0 0 25 0 1 0 538451519 14778368 2775 33554432000 4194304 4352236 140736861524208 18446744073709551615 4328100 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/5504/statm: 3608 2775 128 39 0 2688 0
[pid=5505] ppid=5490 vsize=314324 CPUtime=0 cores=1,3,5,7
/proc/5505/stat : 5505 (python) S 5490 5490 5278 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 538451522 321867776 6615 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 4613611817338372356 0 0 17 1 0 0 0
/proc/5505/statm: 78581 6615 371 364 0 14490 0
[pid=5507] ppid=5505 vsize=14204 CPUtime=9.56 cores=1,3,5,7
/proc/5507/stat : 5507 (lingeling) R 5505 5507 5507 0 -1 4202496 3831 0 0 0 956 0 0 0 25 0 1 0 538451522 14544896 2719 33554432000 4194304 4352236 140734050030480 18446744073709551615 4328122 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/5507/statm: 3551 2719 128 39 0 2631 0
[pid=5490/tid=5497] ppid=5488 vsize=323724 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5497/stat : 5497 (python) S 5488 5490 5278 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 5 0 538451515 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 3 0 0 0
[pid=5490/tid=5500] ppid=5488 vsize=323724 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5500/stat : 5500 (python) S 5488 5490 5278 0 -1 4202560 20 933 0 0 0 0 0 0 22 0 5 0 538451517 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 7 0 0 0
[pid=5490/tid=5503] ppid=5488 vsize=323724 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5503/stat : 5503 (python) S 5488 5490 5278 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 5 0 538451519 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 5 0 0 0
[pid=5490/tid=5506] ppid=5488 vsize=323724 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5506/stat : 5506 (python) S 5488 5490 5278 0 -1 4202560 26 933 0 0 0 0 0 0 25 0 5 0 538451522 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 41.19
Current children cumulated vsize (KiB) 1629756

[startup+25.501 s]
/proc/loadavg: 7.88 7.94 5.88 9/228 5507
/proc/meminfo: memFree=27907124/32950928 swapFree=67111428/67111528
[pid=5490] ppid=5488 vsize=323724 CPUtime=2.83 cores=1,3,5,7
/proc/5490/stat : 5490 (python) S 5488 5490 5278 0 -1 4202496 16925 933 1 0 268 15 0 0 25 0 5 0 538451211 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101524939 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/5490/statm: 80931 8128 1881 364 0 16840 0
[pid=5496] ppid=5490 vsize=283376 CPUtime=0.02 cores=1,3,5,7
/proc/5496/stat : 5496 (python) S 5490 5490 5278 0 -1 4202560 997 0 0 0 1 1 0 0 18 0 1 0 538451514 290177024 6525 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718287 0 0 16781312 514 16015028973348028677 0 0 17 1 0 0 0
/proc/5496/statm: 70844 6525 383 364 0 6762 0
[pid=5498] ppid=5496 vsize=23052 CPUtime=22.45 cores=1,3,5,7
/proc/5498/stat : 5498 (lingeling) R 5496 5498 5498 0 -1 4202496 6040 0 0 0 2245 0 0 0 25 0 1 0 538451515 23605248 4930 33554432000 4194304 4352236 140734331248240 18446744073709551615 4328126 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/5498/statm: 5763 4930 128 39 0 4843 0
[pid=5499] ppid=5490 vsize=293452 CPUtime=0.03 cores=1,3,5,7
/proc/5499/stat : 5499 (python) S 5490 5490 5278 0 -1 4202560 934 0 0 0 2 1 0 0 15 0 1 0 538451517 300494848 6608 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 18377734330198753544 0 0 17 5 0 0 0
/proc/5499/statm: 73363 6608 372 364 0 9278 0
[pid=5501] ppid=5499 vsize=79664 CPUtime=22.29 cores=1,3,5,7
/proc/5501/stat : 5501 (cryptominisat-2) R 5499 5501 5501 0 -1 4202496 23223 0 0 0 2225 4 0 0 25 0 1 0 538451517 81575936 12465 33554432000 4194304 4677096 140733364965680 18446744073709551615 4319256 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/5501/statm: 19916 12465 391 118 0 14875 0
[pid=5502] ppid=5490 vsize=304116 CPUtime=0.03 cores=1,3,5,7
/proc/5502/stat : 5502 (python) S 5490 5490 5278 0 -1 4202560 943 0 0 0 2 1 0 0 18 0 1 0 538451519 311414784 6612 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 16015028973348028680 0 0 17 5 0 0 0
/proc/5502/statm: 76029 6612 372 364 0 11941 0
[pid=5504] ppid=5502 vsize=19928 CPUtime=22.33 cores=1,3,5,7
/proc/5504/stat : 5504 (lingeling) R 5502 5504 5504 0 -1 4202496 5259 0 0 0 2233 0 0 0 25 0 1 0 538451519 20406272 4149 33554432000 4194304 4352236 140736861524208 18446744073709551615 4278520 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/5504/statm: 4982 4149 128 39 0 4062 0
[pid=5505] ppid=5490 vsize=314324 CPUtime=0.03 cores=1,3,5,7
/proc/5505/stat : 5505 (python) S 5490 5490 5278 0 -1 4202560 910 0 0 0 2 1 0 0 18 0 1 0 538451522 321867776 6616 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 16015028973348028676 0 0 17 1 0 0 0
/proc/5505/statm: 78581 6616 372 364 0 14490 0
[pid=5507] ppid=5505 vsize=21360 CPUtime=22.32 cores=1,3,5,7
/proc/5507/stat : 5507 (lingeling) R 5505 5507 5507 0 -1 4202496 5620 0 0 0 2231 1 0 0 25 0 1 0 538451522 21872640 4508 33554432000 4194304 4352236 140734050030480 18446744073709551615 4329024 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/5507/statm: 5340 4508 128 39 0 4420 0
[pid=5490/tid=5497] ppid=5488 vsize=323724 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5497/stat : 5497 (python) S 5488 5490 5278 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 5 0 538451515 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 3 0 0 0
[pid=5490/tid=5500] ppid=5488 vsize=323724 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5500/stat : 5500 (python) S 5488 5490 5278 0 -1 4202560 20 933 0 0 0 0 0 0 22 0 5 0 538451517 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 7 0 0 0
[pid=5490/tid=5503] ppid=5488 vsize=323724 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5503/stat : 5503 (python) S 5488 5490 5278 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 5 0 538451519 331493376 8128 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 5 0 0 0

################
# More data... #
################

/proc/5504/stat : 5504 (lingeling) T 5502 5504 5504 0 -1 4202496 35362 0 0 0 58400 4 0 0 25 0 1 0 538451519 49336320 11212 33554432000 4194304 4352236 140736861524208 18446744073709551615 4328126 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/5504/statm: 12045 11212 128 39 0 11125 0
[pid=5502/tid=5632] ppid=5490 vsize=304116 CPUtime=0 cores=1,3,5,7
/proc/5502/task/5632/stat : 5632 (python) S 5490 5490 5278 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538510095 311414784 6641 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604463509611520 0 0 -1 5 0 0 0
[pid=5505] ppid=5490 vsize=314324 CPUtime=1.66 cores=1,3,5,7
/proc/5505/stat : 5505 (python) S 5490 5490 5278 0 -1 4202560 967 0 0 0 89 77 0 0 18 0 1 0 538451522 321867776 6616 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 16015028973348028676 0 0 17 1 0 0 0
/proc/5505/statm: 78581 6616 372 364 0 14490 0
[pid=5507] ppid=5505 vsize=58736 CPUtime=1175.57 cores=1,3,5,7
/proc/5507/stat : 5507 (lingeling) R 5505 5507 5507 0 -1 4202496 58644 0 0 0 117549 8 0 0 25 0 1 0 538451522 60145664 13852 33554432000 4194304 4352236 140734050030480 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/5507/statm: 14684 13852 128 39 0 13764 0
[pid=5543] ppid=5490 vsize=324324 CPUtime=0.13 cores=1,3,5,7
/proc/5543/stat : 5543 (python) S 5490 5490 5278 0 -1 4202560 1127 0 0 0 8 5 0 0 19 0 2 0 538461529 332107776 6694 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/5543/statm: 81081 6694 400 364 0 16987 0
[pid=5545] ppid=5543 vsize=28912 CPUtime=99.84 cores=1,3,5,7
/proc/5545/stat : 5545 (SApperloT-base) T 5543 5545 5545 0 -1 4202496 6453 0 0 0 9983 1 0 0 25 0 1 0 538461530 29605888 6156 33554432000 134512640 135674940 4293707776 18446744073709551615 134565184 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/5545/statm: 7228 6156 99 284 0 6942 0
[pid=5543/tid=5549] ppid=5490 vsize=324324 CPUtime=0 cores=1,3,5,7
/proc/5543/task/5549/stat : 5549 (python) S 5490 5490 5278 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538471542 332107776 6694 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604471149064256 0 0 -1 3 0 0 0
[pid=5550] ppid=5490 vsize=334700 CPUtime=0.55 cores=1,3,5,7
/proc/5550/stat : 5550 (python) S 5490 5490 5278 0 -1 4202560 1179 0 0 0 27 28 0 0 18 0 2 0 538471544 342732800 6698 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/5550/statm: 83675 6698 400 364 0 19578 0
[pid=5552] ppid=5550 vsize=56668 CPUtime=391.08 cores=1,3,5,7
/proc/5552/stat : 5552 (precosat) R 5550 5552 5552 0 -1 4202496 25599 0 0 0 39102 6 0 0 25 0 1 0 538471545 58028032 13893 33554432000 4194304 4890832 140736430759328 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/5552/statm: 14167 13893 86 171 0 13994 0
[pid=5550/tid=5626] ppid=5490 vsize=334700 CPUtime=0 cores=1,3,5,7
/proc/5550/task/5626/stat : 5626 (python) S 5490 5490 5278 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538500781 342732800 6698 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604454224046912 0 0 -1 7 0 0 0
[pid=5627] ppid=5490 vsize=344980 CPUtime=0.98 cores=1,3,5,7
/proc/5627/stat : 5627 (python) S 5490 5490 5278 0 -1 4202560 1200 0 0 0 50 48 0 0 15 0 2 0 538500783 353259520 6703 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/5627/statm: 86245 6703 401 364 0 22145 0
[pid=5629] ppid=5627 vsize=149684 CPUtime=583.59 cores=1,3,5,7
/proc/5629/stat : 5629 (cryptominisat-2) R 5627 5629 5629 0 -1 4202496 206542 0 0 0 58289 70 0 0 25 0 1 0 538500783 153276416 28865 33554432000 4194304 4677096 140735291240704 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/5629/statm: 37421 28865 391 118 0 32380 0
[pid=5627/tid=5655] ppid=5490 vsize=344980 CPUtime=0 cores=1,3,5,7
/proc/5627/task/5655/stat : 5655 (python) S 5490 5490 5278 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 538540156 353259520 6703 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604468608587712 0 0 -1 1 0 0 0
[pid=5656] ppid=5490 vsize=355184 CPUtime=0.15 cores=1,3,5,7
/proc/5656/stat : 5656 (python) S 5490 5490 5278 0 -1 4202560 1187 0 0 0 7 8 0 0 19 0 2 0 538540158 363708416 6712 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/5656/statm: 88796 6712 406 364 0 24693 0
[pid=5658] ppid=5656 vsize=27444 CPUtime=99.69 cores=1,3,5,7
/proc/5658/stat : 5658 (lingeling) T 5656 5658 5658 0 -1 4202496 11246 0 0 0 9968 1 0 0 25 0 1 0 538540159 28102656 6029 33554432000 4194304 4352236 140737465781792 18446744073709551615 4329360 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/5658/statm: 6861 6029 128 39 0 5941 0
[pid=5656/tid=5665] ppid=5490 vsize=355184 CPUtime=0 cores=1,3,5,7
/proc/5656/task/5665/stat : 5665 (python) S 5490 5490 5278 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 538550173 363708416 6712 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604453986881664 0 0 -1 1 0 0 0
[pid=5490/tid=5497] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5497/stat : 5497 (python) S 5488 5490 5278 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 9 0 538451515 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 3 0 0 0
[pid=5490/tid=5500] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5500/stat : 5500 (python) S 5488 5490 5278 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 9 0 538451517 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 7 0 0 0
[pid=5490/tid=5503] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5503/stat : 5503 (python) S 5488 5490 5278 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 9 0 538451519 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 5 0 0 0
[pid=5490/tid=5506] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5506/stat : 5506 (python) S 5488 5490 5278 0 -1 4202560 26 933 0 0 0 0 0 0 25 0 9 0 538451522 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
[pid=5490/tid=5544] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5544/stat : 5544 (python) S 5488 5490 5278 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 9 0 538461530 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
[pid=5490/tid=5551] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5551/stat : 5551 (python) S 5488 5490 5278 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 538471544 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
[pid=5490/tid=5628] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5628/stat : 5628 (python) S 5488 5490 5278 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 538500783 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
[pid=5490/tid=5657] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5657/stat : 5657 (python) S 5488 5490 5278 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 9 0 538540158 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4708.87
Current children cumulated vsize (KiB) 3626384



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205.2 s]
/proc/loadavg: 8.20 8.11 7.32 9/246 5675
/proc/meminfo: memFree=20987908/32950928 swapFree=67111428/67111528
[pid=5490] ppid=5488 vsize=364928 CPUtime=3.07 cores=1,3,5,7
/proc/5490/stat : 5490 (python) S 5488 5490 5278 0 -1 4202496 20838 933 1 0 291 16 0 0 18 0 9 0 538451211 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101524939 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5490/statm: 91232 8198 1890 364 0 27129 0
[pid=5496] ppid=5490 vsize=293620 CPUtime=1.05 cores=1,3,5,7
/proc/5496/stat : 5496 (python) S 5490 5490 5278 0 -1 4202560 1215 0 0 0 56 49 0 0 18 0 2 0 538451514 300666880 6563 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/5496/statm: 73405 6563 416 364 0 9323 0
[pid=5498] ppid=5496 vsize=52484 CPUtime=716.45 cores=1,3,5,7
/proc/5498/stat : 5498 (lingeling) R 5496 5498 5498 0 -1 4202496 42614 0 0 0 71640 5 0 0 25 0 1 0 538451515 53743616 12288 33554432000 4194304 4352236 140734331248240 18446744073709551615 4328336 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/5498/statm: 13121 12288 128 39 0 12201 0
[pid=5496/tid=5542] ppid=5490 vsize=293620 CPUtime=0 cores=1,3,5,7
/proc/5496/task/5542/stat : 5542 (python) S 5490 5490 5278 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538461527 300666880 6563 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604463509612416 0 0 -1 3 0 0 0
[pid=5499] ppid=5490 vsize=293452 CPUtime=1.71 cores=1,3,5,7
/proc/5499/stat : 5499 (python) S 5490 5490 5278 0 -1 4202560 1171 0 0 0 86 85 0 0 15 0 2 0 538451517 300494848 6637 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5499/statm: 73363 6637 400 364 0 9278 0
[pid=5501] ppid=5499 vsize=274648 CPUtime=1071.47 cores=1,3,5,7
/proc/5501/stat : 5501 (cryptominisat-2) T 5499 5501 5501 0 -1 4202496 317301 0 0 0 107036 111 0 0 25 0 1 0 538451517 281239552 41123 33554432000 4194304 4677096 140733364965680 18446744073709551615 4320006 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/5501/statm: 68662 41123 391 118 0 63621 0
[pid=5499/tid=5625] ppid=5490 vsize=293452 CPUtime=0 cores=1,3,5,7
/proc/5499/task/5625/stat : 5625 (python) S 5490 5490 5278 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 538500649 300494848 6637 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604471125858240 0 0 -1 5 0 0 0
[pid=5502] ppid=5490 vsize=304116 CPUtime=0.78 cores=1,3,5,7
/proc/5502/stat : 5502 (python) S 5490 5490 5278 0 -1 4202560 1155 0 0 0 41 37 0 0 19 0 2 0 538451519 311414784 6641 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/5502/statm: 76029 6641 400 364 0 11941 0
[pid=5504] ppid=5502 vsize=48180 CPUtime=584.04 cores=1,3,5,7
/proc/5504/stat : 5504 (lingeling) T 5502 5504 5504 0 -1 4202496 35362 0 0 0 58400 4 0 0 25 0 1 0 538451519 49336320 11212 33554432000 4194304 4352236 140736861524208 18446744073709551615 4328126 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/5504/statm: 12045 11212 128 39 0 11125 0
[pid=5502/tid=5632] ppid=5490 vsize=304116 CPUtime=0 cores=1,3,5,7
/proc/5502/task/5632/stat : 5632 (python) S 5490 5490 5278 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538510095 311414784 6641 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604463509611520 0 0 -1 5 0 0 0
[pid=5505] ppid=5490 vsize=314324 CPUtime=1.7 cores=1,3,5,7
/proc/5505/stat : 5505 (python) S 5490 5490 5278 0 -1 4202560 967 0 0 0 91 79 0 0 18 0 1 0 538451522 321867776 6616 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 16015028973348028676 0 0 17 1 0 0 0
/proc/5505/statm: 78581 6616 372 364 0 14490 0
[pid=5507] ppid=5505 vsize=58736 CPUtime=1198.48 cores=1,3,5,7
/proc/5507/stat : 5507 (lingeling) R 5505 5507 5507 0 -1 4202496 58644 0 0 0 119840 8 0 0 25 0 1 0 538451522 60145664 13852 33554432000 4194304 4352236 140734050030480 18446744073709551615 4276488 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/5507/statm: 14684 13852 128 39 0 13764 0
[pid=5543] ppid=5490 vsize=324324 CPUtime=0.13 cores=1,3,5,7
/proc/5543/stat : 5543 (python) S 5490 5490 5278 0 -1 4202560 1127 0 0 0 8 5 0 0 19 0 2 0 538461529 332107776 6694 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/5543/statm: 81081 6694 400 364 0 16987 0
[pid=5545] ppid=5543 vsize=28912 CPUtime=99.84 cores=1,3,5,7
/proc/5545/stat : 5545 (SApperloT-base) T 5543 5545 5545 0 -1 4202496 6453 0 0 0 9983 1 0 0 25 0 1 0 538461530 29605888 6156 33554432000 134512640 135674940 4293707776 18446744073709551615 134565184 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/5545/statm: 7228 6156 99 284 0 6942 0
[pid=5543/tid=5549] ppid=5490 vsize=324324 CPUtime=0 cores=1,3,5,7
/proc/5543/task/5549/stat : 5549 (python) S 5490 5490 5278 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538471542 332107776 6694 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604471149064256 0 0 -1 3 0 0 0
[pid=5550] ppid=5490 vsize=334700 CPUtime=0.59 cores=1,3,5,7
/proc/5550/stat : 5550 (python) S 5490 5490 5278 0 -1 4202560 1179 0 0 0 30 29 0 0 18 0 2 0 538471544 342732800 6698 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/5550/statm: 83675 6698 400 364 0 19578 0
[pid=5552] ppid=5550 vsize=56668 CPUtime=413.58 cores=1,3,5,7
/proc/5552/stat : 5552 (precosat) R 5550 5552 5552 0 -1 4202496 25642 0 0 0 41352 6 0 0 25 0 1 0 538471545 58028032 13936 33554432000 4194304 4890832 140736430759328 18446744073709551615 4238577 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/5552/statm: 14167 13936 86 171 0 13994 0
[pid=5550/tid=5626] ppid=5490 vsize=334700 CPUtime=0 cores=1,3,5,7
/proc/5550/task/5626/stat : 5626 (python) S 5490 5490 5278 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538500781 342732800 6698 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604454224046912 0 0 -1 7 0 0 0
[pid=5627] ppid=5490 vsize=344980 CPUtime=1.02 cores=1,3,5,7
/proc/5627/stat : 5627 (python) S 5490 5490 5278 0 -1 4202560 1200 0 0 0 52 50 0 0 15 0 2 0 538500783 353259520 6703 33554432000 4194304 5683644 140734838911568 18446744073709551615 248089718342 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/5627/statm: 86245 6703 401 364 0 22145 0
[pid=5629] ppid=5627 vsize=149752 CPUtime=606.37 cores=1,3,5,7
/proc/5629/stat : 5629 (cryptominisat-2) R 5627 5629 5629 0 -1 4202496 211854 0 0 0 60565 72 0 0 25 0 1 0 538500783 153346048 29175 33554432000 4194304 4677096 140735291240704 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/5629/statm: 37438 29175 391 118 0 32397 0
[pid=5627/tid=5655] ppid=5490 vsize=344980 CPUtime=0 cores=1,3,5,7
/proc/5627/task/5655/stat : 5655 (python) S 5490 5490 5278 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 538540156 353259520 6703 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604468608587712 0 0 -1 1 0 0 0
[pid=5656] ppid=5490 vsize=355184 CPUtime=0.15 cores=1,3,5,7
/proc/5656/stat : 5656 (python) S 5490 5490 5278 0 -1 4202560 1187 0 0 0 7 8 0 0 19 0 2 0 538540158 363708416 6712 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101524939 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/5656/statm: 88796 6712 406 364 0 24693 0
[pid=5658] ppid=5656 vsize=27444 CPUtime=99.69 cores=1,3,5,7
/proc/5658/stat : 5658 (lingeling) T 5656 5658 5658 0 -1 4202496 11246 0 0 0 9968 1 0 0 25 0 1 0 538540159 28102656 6029 33554432000 4194304 4352236 140737465781792 18446744073709551615 4329360 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/5658/statm: 6861 6029 128 39 0 5941 0
[pid=5656/tid=5665] ppid=5490 vsize=355184 CPUtime=0 cores=1,3,5,7
/proc/5656/task/5665/stat : 5665 (python) S 5490 5490 5278 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 538550173 363708416 6712 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 514 18446604453986881664 0 0 -1 1 0 0 0
[pid=5490/tid=5497] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5497/stat : 5497 (python) S 5488 5490 5278 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 9 0 538451515 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 3 0 0 0
[pid=5490/tid=5500] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5500/stat : 5500 (python) S 5488 5490 5278 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 9 0 538451517 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 7 0 0 0
[pid=5490/tid=5503] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5503/stat : 5503 (python) S 5488 5490 5278 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 9 0 538451519 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 5 0 0 0
[pid=5490/tid=5506] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5506/stat : 5506 (python) S 5488 5490 5278 0 -1 4202560 26 933 0 0 0 0 0 0 25 0 9 0 538451522 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
[pid=5490/tid=5544] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5544/stat : 5544 (python) S 5488 5490 5278 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 9 0 538461530 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
[pid=5490/tid=5551] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5551/stat : 5551 (python) S 5488 5490 5278 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 538471544 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
[pid=5490/tid=5628] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5628/stat : 5628 (python) S 5488 5490 5278 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 538500783 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
[pid=5490/tid=5657] ppid=5488 vsize=364928 CPUtime=0 cores=1,3,5,7
/proc/5490/task/5657/stat : 5657 (python) S 5488 5490 5278 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 9 0 538540158 373686272 8198 33554432000 4194304 5683644 140734838911568 18446744073709551615 248101521841 0 0 16781312 2 18446604468608588608 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.12
Current children cumulated vsize (KiB) 3626452

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 5490 and gives
#  childrusage.ru_utime.tv_sec=1920
#  childrusage.ru_utime.tv_usec=545032
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=846567
# CPU time returned by wait4() is 1923.39
# while last known CPU time is 4800.12
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1205.26
CPU time (s): 4800.12
CPU user time (s): 4794.46
CPU system time (s): 5.66
CPU usage (%): 398.265
Max. virtual memory (cumulated for all children) (KiB): 3698956

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1920.55
system time used= 2.84657
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 128550
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8255
involuntary context switches= 5896

runsolver used 3.62545 second user time and 7.54485 second system time

The end

Launcher Data 

Begin job on node123 at 2011-05-01 18:48:34
IDJOB=3317729
IDBENCH=71078
IDSOLVER=1706
FILE ID=node123/3317729-1304268514
RUNJOBID= node123-1304267283-5297
PBS_JOBID= 13173956
Free space on /tmp= 73436 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rbcl_xits_08_UNSAT.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317729-1304268514/watcher-3317729-1304268514 -o /tmp/evaluation-result-3317729-1304268514/solver-3317729-1304268514 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317729-1304268514.cnf -seed 867666104 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 66aa2e18c32a02f55a810347a9702c7f
RANDOM SEED=867666104

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      28145220 kB
Buffers:        350364 kB
Cached:        1687620 kB
SwapCached:        100 kB
Active:        2567484 kB
Inactive:      1871188 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      28145220 kB
SwapTotal:    67111528 kB
SwapFree:     67111428 kB
Dirty:           33000 kB
Writeback:           0 kB
AnonPages:     2400452 kB
Mapped:          22756 kB
Slab:           289204 kB
PageTables:      16776 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  4148820 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73400 MiB
End job on node123 at 2011-05-01 19:08:41