Trace number 3378034

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-industrial (fixed)? (TO) 1298.48 1300.04

General information on the benchmark

Nameindustrial/jarvisalo/
eq.atree.braun.12.unsat.cnf
MD5SUM8d6acb9f6b752ad76c024133f5175c69
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1694
Number of clauses5726
Sum of the clauses size14874
Maximum clause length23
Minimum clause length1
Number of clauses of size 13
Number of clauses of size 22490
Number of clauses of size 33143
Number of clauses of size 439
Number of clauses of size 538
Number of clauses of size over 513

Solver Data 

0.68/2.39	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.68/2.39	c INFO: solving HOME/instance-3378034-1305452895.cnf
0.68/2.39	c INFO: computing task features
0.71/2.41	c INFO: computed variable-clause graph statistics
0.71/2.41	c INFO: computed clause balance statistics
0.81/2.51	c INFO: computed variable balance statistics
0.81/2.58	c INFO: computed small-clause counts
0.81/2.58	c INFO: computed Horn-clause counts
0.81/2.59	c INFO: computed variable graph statistics
0.81/2.59	c INFO: collected features for HOME/instance-3378034-1305452895.cnf in 0.20 s
0.91/2.61	c INFO: running lingeling-276@0 for 582 with 2399 remaining (b = 0.58)
588.20/589.89	c INFO: running lingeling-276@585 for 291 with 1813 remaining (b = 0.17)
881.95/883.55	c INFO: running lingeling-276@0 for 194 with 1520 remaining (b = 0.35)
1078.43/1080.02	c INFO: running cryptominisat-2.9.0@0 for 485 with 1324 remaining (b = 0.41)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378034-1305452895/watcher-3378034-1305452895 -o /tmp/evaluation-result-3378034-1305452895/solver-3378034-1305452895 -C 2400 -W 1300 -M 7680 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378034-1305452895.cnf -seed 2026730375 -budget 2400 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.62 3.93 3.88 5/315 19580
/proc/meminfo: memFree=23609928/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=14252 CPUtime=0 cores=4,6
/proc/19580/stat : 19580 (python) D 19578 19580 18433 0 -1 4194304 192 0 2 0 0 0 0 0 20 0 1 0 656891949 14594048 130 33554432000 4194304 5683644 140735335869536 18446744073709551615 5398816 0 0 4096 0 18446744071562234166 0 0 17 4 0 0 0
/proc/19580/statm: 3563 130 102 364 0 50 0

[startup+0.107406 s]
/proc/loadavg: 3.62 3.93 3.88 5/315 19580
/proc/meminfo: memFree=23609928/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=18884 CPUtime=0.02 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 1230 0 7 0 1 1 0 0 17 0 1 0 656891949 19337216 1093 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436015104 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 2
/proc/19580/statm: 4721 1093 421 364 0 690 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18884

[startup+0.200423 s]
/proc/loadavg: 3.62 3.93 3.88 5/315 19580
/proc/meminfo: memFree=23609928/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=30116 CPUtime=0.06 cores=4,6
/proc/19580/stat : 19580 (python) R 19578 19580 18433 0 -1 4202496 1504 0 11 0 5 1 0 0 17 0 1 0 656891949 30838784 1352 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436012901 0 0 16781312 2 0 0 0 17 4 0 0 3
/proc/19580/statm: 7529 1352 443 364 0 899 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 30116

[startup+0.300386 s]
/proc/loadavg: 3.62 3.93 3.88 5/315 19580
/proc/meminfo: memFree=23609928/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=50016 CPUtime=0.08 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 1946 0 17 0 6 2 0 0 17 0 1 0 656891949 51216384 1726 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436015104 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 4
/proc/19580/statm: 12504 1726 476 364 0 1204 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 50016

[startup+0.700303 s]
/proc/loadavg: 3.62 3.93 3.88 5/315 19580
/proc/meminfo: memFree=23609928/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=113348 CPUtime=0.18 cores=4,6
/proc/19580/stat : 19580 (python) R 19578 19580 18433 0 -1 4202496 3540 0 30 0 11 7 0 0 16 0 1 0 656891949 116068352 3216 33554432000 4194304 5683644 140735335869536 18446744073709551615 212435666193 0 0 16781312 2 0 0 0 17 4 0 0 9
/proc/19580/statm: 28337 3216 886 364 0 2359 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 113348

[startup+1.50118 s]
/proc/loadavg: 3.62 3.93 3.88 4/330 19613
/proc/meminfo: memFree=23499556/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=160668 CPUtime=0.48 cores=4,6
/proc/19580/stat : 19580 (python) D 19578 19580 18433 0 -1 4202496 6564 925 45 8 26 22 0 0 17 0 1 0 656891949 164524032 4700 33554432000 4194304 5683644 140735335869536 18446744073709551615 212431093383 0 0 16781312 2 0 0 0 17 4 0 0 15
/proc/19580/statm: 40167 4700 1259 364 0 3454 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 160668

[startup+3.10079 s]
/proc/loadavg: 3.62 3.93 3.88 1/330 19613
/proc/meminfo: memFree=23451220/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=289384 CPUtime=0.92 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 9725 925 92 8 62 30 0 0 17 0 2 0 656891949 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 72346 7234 1867 364 0 8264 0
Current children cumulated CPU time (s) 0.92
Current children cumulated vsize (KiB) 289384
heavy processes:

[startup+6.30122 s]
/proc/loadavg: 3.97 4.00 3.90 5/333 19616
/proc/meminfo: memFree=23028856/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=289384 CPUtime=0.92 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 9725 925 92 8 62 30 0 0 17 0 2 0 656891949 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 72346 7234 1867 364 0 8264 0
[pid=19614] ppid=19580 vsize=279140 CPUtime=0 cores=4,6
/proc/19614/stat : 19614 (python) S 19580 19580 18433 0 -1 4202560 732 0 0 0 0 0 0 0 15 0 1 0 656892211 285839360 5717 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436037135 0 0 16781312 514 997270519705207043 0 0 17 4 0 0 0
/proc/19614/statm: 69785 5717 354 364 0 5703 0
[pid=19616] ppid=19614 vsize=8072 CPUtime=3.66 cores=4,6
/proc/19616/stat : 19616 (lingeling) R 19614 19616 19616 0 -1 4202496 2202 0 0 0 366 0 0 0 25 0 1 0 656892212 8265728 1220 33554432000 4194304 4352236 140736975471376 18446744073709551615 4278679 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/19616/statm: 2018 1220 129 39 0 1098 0
[pid=19580/tid=19615] ppid=19578 vsize=289384 CPUtime=0 cores=4,6
/proc/19580/task/19615/stat : 19615 (python) S 19578 19580 18433 0 -1 4202560 29 925 0 8 0 0 0 0 18 0 2 0 656892211 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4.58
Current children cumulated vsize (KiB) 576596
heavy processes:

[startup+12.701 s]
/proc/loadavg: 3.98 4.00 3.91 5/333 19616
/proc/meminfo: memFree=23026796/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=289384 CPUtime=0.92 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 9725 925 92 8 62 30 0 0 17 0 2 0 656891949 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 72346 7234 1867 364 0 8264 0
[pid=19614] ppid=19580 vsize=279140 CPUtime=0.02 cores=4,6
/proc/19614/stat : 19614 (python) S 19580 19580 18433 0 -1 4202560 884 0 0 0 1 1 0 0 15 0 1 0 656892211 285839360 5740 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436037135 0 0 16781312 514 15860710317366411523 0 0 17 4 0 0 0
/proc/19614/statm: 69785 5740 377 364 0 5703 0
[pid=19616] ppid=19614 vsize=9108 CPUtime=10.03 cores=4,6
/proc/19616/stat : 19616 (lingeling) R 19614 19616 19616 0 -1 4202496 3868 0 0 0 1003 0 0 0 25 0 1 0 656892212 9326592 1478 33554432000 4194304 4352236 140736975471376 18446744073709551615 4277619 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/19616/statm: 2277 1478 129 39 0 1357 0
[pid=19580/tid=19615] ppid=19578 vsize=289384 CPUtime=0 cores=4,6
/proc/19580/task/19615/stat : 19615 (python) S 19578 19580 18433 0 -1 4202560 29 925 0 8 0 0 0 0 18 0 2 0 656892211 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10.97
Current children cumulated vsize (KiB) 577632

[startup+25.5006 s]
/proc/loadavg: 3.98 4.00 3.91 5/333 19617
/proc/meminfo: memFree=23028288/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=289384 CPUtime=0.92 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 9725 925 92 8 62 30 0 0 17 0 2 0 656891949 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 72346 7234 1867 364 0 8264 0
[pid=19614] ppid=19580 vsize=279140 CPUtime=0.05 cores=4,6
/proc/19614/stat : 19614 (python) S 19580 19580 18433 0 -1 4202560 889 0 0 0 2 3 0 0 15 0 1 0 656892211 285839360 5740 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436037135 0 0 16781312 514 15860710317366411523 0 0 17 4 0 0 0
/proc/19614/statm: 69785 5740 377 364 0 5703 0
[pid=19616] ppid=19614 vsize=12828 CPUtime=22.82 cores=4,6
/proc/19616/stat : 19616 (lingeling) R 19614 19616 19616 0 -1 4202496 7070 0 0 0 2282 0 0 0 25 0 1 0 656892212 13135872 2408 33554432000 4194304 4352236 140736975471376 18446744073709551615 4328009 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/19616/statm: 3207 2408 129 39 0 2287 0
[pid=19580/tid=19615] ppid=19578 vsize=289384 CPUtime=0 cores=4,6
/proc/19580/task/19615/stat : 19615 (python) S 19578 19580 18433 0 -1 4202560 29 925 0 8 0 0 0 0 18 0 2 0 656892211 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 23.79
Current children cumulated vsize (KiB) 581352

[startup+51.1007 s]
/proc/loadavg: 4.11 4.03 3.92 5/336 19655
/proc/meminfo: memFree=23059704/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=289384 CPUtime=0.92 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 9725 925 92 8 62 30 0 0 17 0 2 0 656891949 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 72346 7234 1867 364 0 8264 0
[pid=19614] ppid=19580 vsize=279140 CPUtime=0.1 cores=4,6
/proc/19614/stat : 19614 (python) S 19580 19580 18433 0 -1 4202560 901 0 0 0 4 6 0 0 15 0 1 0 656892211 285839360 5740 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436037135 0 0 16781312 514 15860710317366411523 0 0 17 4 0 0 0
/proc/19614/statm: 69785 5740 377 364 0 5703 0
[pid=19616] ppid=19614 vsize=14624 CPUtime=48.4 cores=4,6
/proc/19616/stat : 19616 (lingeling) R 19614 19616 19616 0 -1 4202496 11103 0 0 0 4839 1 0 0 25 0 1 0 656892212 14974976 2857 33554432000 4194304 4352236 140736975471376 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/19616/statm: 3656 2857 129 39 0 2736 0
[pid=19580/tid=19615] ppid=19578 vsize=289384 CPUtime=0 cores=4,6
/proc/19580/task/19615/stat : 19615 (python) S 19578 19580 18433 0 -1 4202560 29 925 0 8 0 0 0 0 18 0 2 0 656892211 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.42
Current children cumulated vsize (KiB) 583148

[startup+102.301 s]
/proc/loadavg: 4.18 4.06 3.93 5/342 19733
/proc/meminfo: memFree=23298188/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=289384 CPUtime=0.92 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 9725 925 92 8 62 30 0 0 17 0 2 0 656891949 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 72346 7234 1867 364 0 8264 0
[pid=19614] ppid=19580 vsize=279140 CPUtime=0.22 cores=4,6
/proc/19614/stat : 19614 (python) S 19580 19580 18433 0 -1 4202560 923 0 0 0 10 12 0 0 15 0 1 0 656892211 285839360 5740 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436037135 0 0 16781312 514 15860710317366411523 0 0 17 4 0 0 0
/proc/19614/statm: 69785 5740 377 364 0 5703 0
[pid=19616] ppid=19614 vsize=17188 CPUtime=99.53 cores=4,6
/proc/19616/stat : 19616 (lingeling) R 19614 19616 19616 0 -1 4202496 18784 0 0 0 9950 3 0 0 25 0 1 0 656892212 17600512 3498 33554432000 4194304 4352236 140736975471376 18446744073709551615 4328151 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/19616/statm: 4297 3498 129 39 0 3377 0
[pid=19580/tid=19615] ppid=19578 vsize=289384 CPUtime=0 cores=4,6
/proc/19580/task/19615/stat : 19615 (python) S 19578 19580 18433 0 -1 4202560 29 925 0 8 0 0 0 0 18 0 2 0 656892211 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 100.67
Current children cumulated vsize (KiB) 585712

[startup+162.301 s]
/proc/loadavg: 4.23 4.09 3.95 5/342 19734
/proc/meminfo: memFree=23274824/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=289384 CPUtime=0.92 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 9725 925 92 8 62 30 0 0 17 0 2 0 656891949 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 72346 7234 1867 364 0 8264 0
[pid=19614] ppid=19580 vsize=279140 CPUtime=0.35 cores=4,6
/proc/19614/stat : 19614 (python) S 19580 19580 18433 0 -1 4202560 945 0 0 0 17 18 0 0 15 0 1 0 656892211 285839360 5740 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436037135 0 0 16781312 514 15860710317366411523 0 0 17 4 0 0 0
/proc/19614/statm: 69785 5740 377 364 0 5703 0
[pid=19616] ppid=19614 vsize=21028 CPUtime=159.39 cores=4,6
/proc/19616/stat : 19616 (lingeling) R 19614 19616 19616 0 -1 4202496 26720 0 0 0 15936 3 0 0 25 0 1 0 656892212 21532672 4458 33554432000 4194304 4352236 140736975471376 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/19616/statm: 5257 4458 129 39 0 4337 0
[pid=19580/tid=19615] ppid=19578 vsize=289384 CPUtime=0 cores=4,6
/proc/19580/task/19615/stat : 19615 (python) S 19578 19580 18433 0 -1 4202560 29 925 0 8 0 0 0 0 18 0 2 0 656892211 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 160.66
Current children cumulated vsize (KiB) 589552

[startup+222.312 s]
/proc/loadavg: 4.08 4.07 3.95 5/342 19736
/proc/meminfo: memFree=23267900/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=289384 CPUtime=0.92 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 9725 925 92 8 62 30 0 0 17 0 2 0 656891949 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 72346 7234 1867 364 0 8264 0
[pid=19614] ppid=19580 vsize=279140 CPUtime=0.49 cores=4,6
/proc/19614/stat : 19614 (python) S 19580 19580 18433 0 -1 4202560 962 0 0 0 24 25 0 0 15 0 1 0 656892211 285839360 5740 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436037135 0 0 16781312 514 15860710317366411523 0 0 17 4 0 0 0
/proc/19614/statm: 69785 5740 377 364 0 5703 0
[pid=19616] ppid=19614 vsize=24868 CPUtime=219.3 cores=4,6
/proc/19616/stat : 19616 (lingeling) R 19614 19616 19616 0 -1 4202496 33376 0 0 0 21925 5 0 0 25 0 1 0 656892212 25464832 5418 33554432000 4194304 4352236 140736975471376 18446744073709551615 4281167 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/19616/statm: 6217 5418 129 39 0 5297 0
[pid=19580/tid=19615] ppid=19578 vsize=289384 CPUtime=0 cores=4,6
/proc/19580/task/19615/stat : 19615 (python) S 19578 19580 18433 0 -1 4202560 29 925 0 8 0 0 0 0 18 0 2 0 656892211 296329216 7234 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0

################
# More data... #
################

[startup+1182.3 s]
/proc/loadavg: 4.11 4.05 4.00 5/366 19798
/proc/meminfo: memFree=21886652/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=309896 CPUtime=0.94 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 11374 925 92 8 64 30 0 0 19 0 4 0 656891949 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 77474 7251 1872 364 0 13386 0
[pid=19614] ppid=19580 vsize=289384 CPUtime=2.06 cores=4,6
/proc/19614/stat : 19614 (python) S 19580 19580 18433 0 -1 4202560 1218 0 0 0 102 104 0 0 15 0 2 0 656892211 296329216 5785 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19614/statm: 72346 5785 417 364 0 8264 0
[pid=19616] ppid=19614 vsize=34472 CPUtime=878.98 cores=4,6
/proc/19616/stat : 19616 (lingeling) T 19614 19616 19616 0 -1 4202496 89794 0 0 0 87886 12 0 0 25 0 1 0 656892212 35299328 7820 33554432000 4194304 4352236 140736975471376 18446744073709551615 4329000 0 0 16781312 17506 18446744071562691360 0 0 17 4 0 0 0
/proc/19616/statm: 8618 7820 129 39 0 7698 0
[pid=19614/tid=19755] ppid=19580 vsize=289384 CPUtime=0 cores=4,6
/proc/19614/task/19755/stat : 19755 (python) S 19580 19580 18433 0 -1 4202560 43 0 0 0 0 0 0 0 15 0 2 0 656950938 296329216 5785 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 514 18446604453144888384 0 0 -1 4 0 0 0
[pid=19781] ppid=19580 vsize=289396 CPUtime=0.49 cores=4,6
/proc/19781/stat : 19781 (python) S 19580 19580 18433 0 -1 4202560 1125 0 0 0 26 23 0 0 19 0 2 0 656980305 296341504 5768 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19781/statm: 72349 5768 400 364 0 8264 0
[pid=19783] ppid=19781 vsize=22016 CPUtime=196 cores=4,6
/proc/19783/stat : 19783 (lingeling) T 19781 19783 19783 0 -1 4202496 30986 0 0 0 19596 4 0 0 25 0 1 0 656980305 22544384 4706 33554432000 4194304 4352236 140737263855168 18446744073709551615 4328205 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/19783/statm: 5504 4706 129 39 0 4584 0
[pid=19781/tid=19792] ppid=19580 vsize=289396 CPUtime=0 cores=4,6
/proc/19781/task/19792/stat : 19792 (python) S 19580 19580 18433 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656999951 296341504 5768 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 514 18446604445288707904 0 0 -1 4 0 0 0
[pid=19793] ppid=19580 vsize=299652 CPUtime=0.27 cores=4,6
/proc/19793/stat : 19793 (python) S 19580 19580 18433 0 -1 4202560 960 0 0 0 15 12 0 0 15 0 1 0 656999952 306843648 5746 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436037190 0 0 16781312 514 15860710317366411523 0 0 17 4 0 0 0
/proc/19793/statm: 74913 5746 371 364 0 10825 0
[pid=19795] ppid=19793 vsize=66332 CPUtime=102 cores=4,6
/proc/19795/stat : 19795 (cryptominisat-2) R 19793 19795 19795 0 -1 4202496 37020 0 0 0 10191 9 0 0 25 0 1 0 656999952 67923968 9708 33554432000 4194304 4677096 140735690299280 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19795/statm: 16583 9708 392 118 0 11542 0
[pid=19580/tid=19615] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19615/stat : 19615 (python) S 19578 19580 18433 0 -1 4202560 30 925 0 8 0 0 0 0 18 0 4 0 656892211 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
[pid=19580/tid=19782] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19782/stat : 19782 (python) S 19578 19580 18433 0 -1 4202560 29 925 0 8 0 0 0 0 20 0 4 0 656980305 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
[pid=19580/tid=19794] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19794/stat : 19794 (python) S 19578 19580 18433 0 -1 4202560 24 925 0 8 0 0 0 0 20 0 4 0 656999952 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1180.74
Current children cumulated vsize (KiB) 1311148

[startup+1242.3 s]
/proc/loadavg: 4.08 4.05 4.00 5/366 19799
/proc/meminfo: memFree=21761472/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=309896 CPUtime=0.94 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 11374 925 92 8 64 30 0 0 19 0 4 0 656891949 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 77474 7251 1872 364 0 13386 0
[pid=19614] ppid=19580 vsize=289384 CPUtime=2.06 cores=4,6
/proc/19614/stat : 19614 (python) S 19580 19580 18433 0 -1 4202560 1218 0 0 0 102 104 0 0 15 0 2 0 656892211 296329216 5785 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19614/statm: 72346 5785 417 364 0 8264 0
[pid=19616] ppid=19614 vsize=34472 CPUtime=878.98 cores=4,6
/proc/19616/stat : 19616 (lingeling) T 19614 19616 19616 0 -1 4202496 89794 0 0 0 87886 12 0 0 25 0 1 0 656892212 35299328 7820 33554432000 4194304 4352236 140736975471376 18446744073709551615 4329000 0 0 16781312 17506 18446744071562691360 0 0 17 4 0 0 0
/proc/19616/statm: 8618 7820 129 39 0 7698 0
[pid=19614/tid=19755] ppid=19580 vsize=289384 CPUtime=0 cores=4,6
/proc/19614/task/19755/stat : 19755 (python) S 19580 19580 18433 0 -1 4202560 43 0 0 0 0 0 0 0 15 0 2 0 656950938 296329216 5785 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 514 18446604453144888384 0 0 -1 4 0 0 0
[pid=19781] ppid=19580 vsize=289396 CPUtime=0.49 cores=4,6
/proc/19781/stat : 19781 (python) S 19580 19580 18433 0 -1 4202560 1125 0 0 0 26 23 0 0 19 0 2 0 656980305 296341504 5768 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19781/statm: 72349 5768 400 364 0 8264 0
[pid=19783] ppid=19781 vsize=22016 CPUtime=196 cores=4,6
/proc/19783/stat : 19783 (lingeling) T 19781 19783 19783 0 -1 4202496 30986 0 0 0 19596 4 0 0 25 0 1 0 656980305 22544384 4706 33554432000 4194304 4352236 140737263855168 18446744073709551615 4328205 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/19783/statm: 5504 4706 129 39 0 4584 0
[pid=19781/tid=19792] ppid=19580 vsize=289396 CPUtime=0 cores=4,6
/proc/19781/task/19792/stat : 19792 (python) S 19580 19580 18433 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656999951 296341504 5768 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 514 18446604445288707904 0 0 -1 4 0 0 0
[pid=19793] ppid=19580 vsize=299652 CPUtime=0.42 cores=4,6
/proc/19793/stat : 19793 (python) S 19580 19580 18433 0 -1 4202560 981 0 0 0 24 18 0 0 15 0 1 0 656999952 306843648 5746 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436037190 0 0 16781312 514 15860710317366411523 0 0 17 4 0 0 0
/proc/19793/statm: 74913 5746 371 364 0 10825 0
[pid=19795] ppid=19793 vsize=77112 CPUtime=161.86 cores=4,6
/proc/19795/stat : 19795 (cryptominisat-2) R 19793 19795 19795 0 -1 4202496 50041 0 0 0 16174 12 0 0 25 0 1 0 656999952 78962688 13558 33554432000 4194304 4677096 140735690299280 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19795/statm: 19278 13558 392 118 0 14237 0
[pid=19580/tid=19615] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19615/stat : 19615 (python) S 19578 19580 18433 0 -1 4202560 30 925 0 8 0 0 0 0 18 0 4 0 656892211 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
[pid=19580/tid=19782] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19782/stat : 19782 (python) S 19578 19580 18433 0 -1 4202560 29 925 0 8 0 0 0 0 20 0 4 0 656980305 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
[pid=19580/tid=19794] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19794/stat : 19794 (python) S 19578 19580 18433 0 -1 4202560 24 925 0 8 0 0 0 0 20 0 4 0 656999952 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1240.75
Current children cumulated vsize (KiB) 1321928



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.03 4.04 4.00 5/366 19801
/proc/meminfo: memFree=21765120/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=309896 CPUtime=0.94 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 11374 925 92 8 64 30 0 0 19 0 4 0 656891949 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 77474 7251 1872 364 0 13386 0
[pid=19614] ppid=19580 vsize=289384 CPUtime=2.06 cores=4,6
/proc/19614/stat : 19614 (python) S 19580 19580 18433 0 -1 4202560 1218 0 0 0 102 104 0 0 15 0 2 0 656892211 296329216 5785 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19614/statm: 72346 5785 417 364 0 8264 0
[pid=19616] ppid=19614 vsize=34472 CPUtime=878.98 cores=4,6
/proc/19616/stat : 19616 (lingeling) T 19614 19616 19616 0 -1 4202496 89794 0 0 0 87886 12 0 0 25 0 1 0 656892212 35299328 7820 33554432000 4194304 4352236 140736975471376 18446744073709551615 4329000 0 0 16781312 17506 18446744071562691360 0 0 17 4 0 0 0
/proc/19616/statm: 8618 7820 129 39 0 7698 0
[pid=19614/tid=19755] ppid=19580 vsize=289384 CPUtime=0 cores=4,6
/proc/19614/task/19755/stat : 19755 (python) S 19580 19580 18433 0 -1 4202560 43 0 0 0 0 0 0 0 15 0 2 0 656950938 296329216 5785 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 514 18446604453144888384 0 0 -1 4 0 0 0
[pid=19781] ppid=19580 vsize=289396 CPUtime=0.49 cores=4,6
/proc/19781/stat : 19781 (python) S 19580 19580 18433 0 -1 4202560 1125 0 0 0 26 23 0 0 19 0 2 0 656980305 296341504 5768 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19781/statm: 72349 5768 400 364 0 8264 0
[pid=19783] ppid=19781 vsize=22016 CPUtime=196 cores=4,6
/proc/19783/stat : 19783 (lingeling) T 19781 19783 19783 0 -1 4202496 30986 0 0 0 19596 4 0 0 25 0 1 0 656980305 22544384 4706 33554432000 4194304 4352236 140737263855168 18446744073709551615 4328205 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/19783/statm: 5504 4706 129 39 0 4584 0
[pid=19781/tid=19792] ppid=19580 vsize=289396 CPUtime=0 cores=4,6
/proc/19781/task/19792/stat : 19792 (python) S 19580 19580 18433 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656999951 296341504 5768 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 514 18446604445288707904 0 0 -1 4 0 0 0
[pid=19793] ppid=19580 vsize=299652 CPUtime=0.57 cores=4,6
/proc/19793/stat : 19793 (python) S 19580 19580 18433 0 -1 4202560 997 0 0 0 31 26 0 0 15 0 1 0 656999952 306843648 5746 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436037190 0 0 16781312 514 15860710317366411523 0 0 17 4 0 0 0
/proc/19793/statm: 74913 5746 371 364 0 10825 0
[pid=19795] ppid=19793 vsize=77564 CPUtime=219.44 cores=4,6
/proc/19795/stat : 19795 (cryptominisat-2) R 19793 19795 19795 0 -1 4202496 61475 0 0 0 21928 16 0 0 25 0 1 0 656999952 79425536 12085 33554432000 4194304 4677096 140735690299280 18446744073709551615 4319878 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19795/statm: 19391 12085 392 118 0 14350 0
[pid=19580/tid=19615] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19615/stat : 19615 (python) S 19578 19580 18433 0 -1 4202560 30 925 0 8 0 0 0 0 18 0 4 0 656892211 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
[pid=19580/tid=19782] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19782/stat : 19782 (python) S 19578 19580 18433 0 -1 4202560 29 925 0 8 0 0 0 0 20 0 4 0 656980305 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
[pid=19580/tid=19794] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19794/stat : 19794 (python) S 19578 19580 18433 0 -1 4202560 24 925 0 8 0 0 0 0 20 0 4 0 656999952 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1298.48
Current children cumulated vsize (KiB) 1322380

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 4.03 4.04 4.00 5/366 19801
/proc/meminfo: memFree=21765120/32951124 swapFree=57331800/67111528
[pid=19580] ppid=19578 vsize=309896 CPUtime=0.94 cores=4,6
/proc/19580/stat : 19580 (python) S 19578 19580 18433 0 -1 4202496 11374 925 92 8 64 30 0 0 19 0 4 0 656891949 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 25
/proc/19580/statm: 77474 7251 1872 364 0 13386 0
[pid=19614] ppid=19580 vsize=289384 CPUtime=2.06 cores=4,6
/proc/19614/stat : 19614 (python) S 19580 19580 18433 0 -1 4202560 1218 0 0 0 102 104 0 0 15 0 2 0 656892211 296329216 5785 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19614/statm: 72346 5785 417 364 0 8264 0
[pid=19616] ppid=19614 vsize=34472 CPUtime=878.98 cores=4,6
/proc/19616/stat : 19616 (lingeling) T 19614 19616 19616 0 -1 4202496 89794 0 0 0 87886 12 0 0 25 0 1 0 656892212 35299328 7820 33554432000 4194304 4352236 140736975471376 18446744073709551615 4329000 0 0 16781312 17506 18446744071562691360 0 0 17 4 0 0 0
/proc/19616/statm: 8618 7820 129 39 0 7698 0
[pid=19614/tid=19755] ppid=19580 vsize=289384 CPUtime=0 cores=4,6
/proc/19614/task/19755/stat : 19755 (python) S 19580 19580 18433 0 -1 4202560 43 0 0 0 0 0 0 0 15 0 2 0 656950938 296329216 5785 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 514 18446604453144888384 0 0 -1 4 0 0 0
[pid=19781] ppid=19580 vsize=289396 CPUtime=0.49 cores=4,6
/proc/19781/stat : 19781 (python) S 19580 19580 18433 0 -1 4202560 1125 0 0 0 26 23 0 0 19 0 2 0 656980305 296341504 5768 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/19781/statm: 72349 5768 400 364 0 8264 0
[pid=19783] ppid=19781 vsize=22016 CPUtime=196 cores=4,6
/proc/19783/stat : 19783 (lingeling) T 19781 19783 19783 0 -1 4202496 30986 0 0 0 19596 4 0 0 25 0 1 0 656980305 22544384 4706 33554432000 4194304 4352236 140737263855168 18446744073709551615 4328205 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/19783/statm: 5504 4706 129 39 0 4584 0
[pid=19781/tid=19792] ppid=19580 vsize=289396 CPUtime=0 cores=4,6
/proc/19781/task/19792/stat : 19792 (python) S 19580 19580 18433 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 656999951 296341504 5768 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 514 18446604445288707904 0 0 -1 4 0 0 0
[pid=19793] ppid=19580 vsize=299652 CPUtime=0.57 cores=4,6
/proc/19793/stat : 19793 (python) S 19580 19580 18433 0 -1 4202560 997 0 0 0 31 26 0 0 15 0 1 0 656999952 306843648 5746 33554432000 4194304 5683644 140735335869536 18446744073709551615 212436037190 0 0 16781312 514 15860710317366411523 0 0 17 4 0 0 0
/proc/19793/statm: 74913 5746 371 364 0 10825 0
[pid=19795] ppid=19793 vsize=77564 CPUtime=219.44 cores=4,6
/proc/19795/stat : 19795 (cryptominisat-2) R 19793 19795 19795 0 -1 4202496 61475 0 0 0 21928 16 0 0 25 0 1 0 656999952 79425536 12085 33554432000 4194304 4677096 140735690299280 18446744073709551615 4319878 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/19795/statm: 19391 12085 392 118 0 14350 0
[pid=19580/tid=19615] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19615/stat : 19615 (python) S 19578 19580 18433 0 -1 4202560 30 925 0 8 0 0 0 0 18 0 4 0 656892211 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
[pid=19580/tid=19782] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19782/stat : 19782 (python) S 19578 19580 18433 0 -1 4202560 29 925 0 8 0 0 0 0 20 0 4 0 656980305 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
[pid=19580/tid=19794] ppid=19578 vsize=309896 CPUtime=0 cores=4,6
/proc/19580/task/19794/stat : 19794 (python) S 19578 19580 18433 0 -1 4202560 24 925 0 8 0 0 0 0 20 0 4 0 656999952 317333504 7251 33554432000 4194304 5683644 140735335869536 18446744073709551615 212447840689 0 0 16781312 2 18446604451735754944 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1298.48
Current children cumulated vsize (KiB) 1322380

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 19580 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=647901
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=316951
# CPU time returned by wait4() is 0.964852
# while last known CPU time is 1298.48
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.04
CPU time (s): 1298.48
CPU user time (s): 1296.33
CPU system time (s): 2.15
CPU usage (%): 99.8802
Max. virtual memory (cumulated for all children) (KiB): 1322380

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.647901
system time used= 0.316951
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 12300
page faults= 100
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 51879
involuntary context switches= 287

runsolver used 4.47132 second user time and 9.38757 second system time

The end

Launcher Data 

Begin job on node102 at 2011-05-15 11:48:15
IDJOB=3378034
IDBENCH=20468
IDSOLVER=1858
FILE ID=node102/3378034-1305452895
RUNJOBID= node102-1305452895-19555
PBS_JOBID= 13324852
Free space on /tmp= 73660 MiB

SOLVER NAME= borg-sat 11.03.02-seq-industrial (fixed)
BENCH NAME= SAT07/industrial/jarvisalo/eq.atree.braun.12.unsat.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378034-1305452895/watcher-3378034-1305452895 -o /tmp/evaluation-result-3378034-1305452895/solver-3378034-1305452895 -C 2400 -W 1300 -M 7680  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378034-1305452895.cnf -seed 2026730375 -budget 2400

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 8d6acb9f6b752ad76c024133f5175c69
RANDOM SEED=2026730375

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23611820 kB
Buffers:         14916 kB
Cached:         379016 kB
SwapCached:      89820 kB
Active:         166000 kB
Inactive:      8994932 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23611820 kB
SwapTotal:    67111528 kB
SwapFree:     57331800 kB
Dirty:          120928 kB
Writeback:           0 kB
AnonPages:     8687944 kB
Mapped:          11664 kB
Slab:            60692 kB
PageTables:      53856 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 59043148 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73524 MiB
End job on node102 at 2011-05-15 12:09:58