Trace number 3378786

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-industrial (fixed)? (MO) 3308.9 931.888

General information on the benchmark

Namevelev-vliw-uns-4.0-9-i1.cnf
MD5SUM590cca3a58efdeb1c95ef988a53daa1d
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark420.299
Satisfiable
(Un)Satisfiability was proved
Number of variables154309
Number of clauses3230738
Sum of the clauses size9429252
Maximum clause length3625
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 22024994
Number of clauses of size 31081436
Number of clauses of size 48866
Number of clauses of size 58692
Number of clauses of size over 5106749

Solver Data 

0.40/1.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.40/1.47	c INFO: solving HOME/instance-3378786-1305463524.cnf
0.40/1.47	c INFO: computing task features
12.15/13.21	c INFO: computed variable-clause graph statistics
12.55/13.63	c INFO: computed clause balance statistics
64.26/65.37	c INFO: computed variable balance statistics
102.76/103.84	c INFO: computed small-clause counts
103.45/104.50	c INFO: computed Horn-clause counts
134.25/135.30	c INFO: computed variable graph statistics
134.25/135.31	c INFO: collected features for HOME/instance-3378786-1305463524.cnf in 133.42 s
134.25/135.33	c INFO: running lingeling-276@0 for 485 with 1066 remaining (b = 0.73)
134.25/135.35	c INFO: running lingeling-276@0 for 97 with 1066 remaining (b = 0.53)
134.25/135.36	c INFO: running cryptominisat-2.9.0@0 for 485 with 1066 remaining (b = 0.35)
134.25/135.38	c INFO: running precosat-570@0 for 97 with 1066 remaining (b = 0.17)
533.95/235.65	c INFO: running cryptominisat-2.9.0@0 for 965 with 965 remaining (b = 0.23)
533.95/235.69	c INFO: running lingeling-276@0 for 965 with 965 remaining (b = 0.21)
2091.63/626.22	c INFO: running lingeling-276@0 for 97 with 575 remaining (b = 0.23)
2117.11/632.68	c INFO: running precosat-570@100 for 194 with 568 remaining (b = 0.08)
2491.51/726.53	c INFO: running glucosER@0 for 291 with 474 remaining (b = 0.16)
2888.82/826.21	c INFO: running precosat-570@0 for 97 with 375 remaining (b = 0.08)
3287.87/926.53	c INFO: running precosat-570@198 for 274 with 274 remaining (b = 0.04)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378786-1305463524/watcher-3378786-1305463524 -o /tmp/evaluation-result-3378786-1305463524/solver-3378786-1305463524 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378786-1305463524.cnf -seed 1429669604 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.46 3.89 3.84 2/357 1630
/proc/meminfo: memFree=18136956/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=15216 CPUtime=0 cores=1,3,5,7
/proc/1630/stat : 1630 (python) R 1628 1630 1592 0 -1 4202496 664 0 0 0 0 0 0 0 18 0 1 0 638768493 15581184 560 33554432000 4194304 5683644 140737074347872 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/1630/statm: 3804 562 314 364 0 291 0

[startup+0.0944441 s]
/proc/loadavg: 3.46 3.89 3.84 2/357 1630
/proc/meminfo: memFree=18136956/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=84524 CPUtime=0.05 cores=1,3,5,7
/proc/1630/stat : 1630 (python) R 1628 1630 1592 0 -1 4202496 2249 0 0 0 4 1 0 0 17 0 1 0 638768493 86552576 1997 33554432000 4194304 5683644 140737074347872 18446744073709551615 233505327979 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/1630/statm: 21131 1998 617 364 0 1335 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 84524

[startup+0.10044 s]
/proc/loadavg: 3.46 3.89 3.84 2/357 1630
/proc/meminfo: memFree=18136956/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=85364 CPUtime=0.05 cores=1,3,5,7
/proc/1630/stat : 1630 (python) R 1628 1630 1592 0 -1 4202496 2596 0 0 0 4 1 0 0 17 0 1 0 638768493 87412736 2316 33554432000 4194304 5683644 140737074347872 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/1630/statm: 21341 2318 713 364 0 1558 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85364

[startup+0.300415 s]
/proc/loadavg: 3.46 3.89 3.84 2/357 1630
/proc/meminfo: memFree=18136956/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=135752 CPUtime=0.19 cores=1,3,5,7
/proc/1630/stat : 1630 (python) R 1628 1630 1592 0 -1 4202496 5962 932 1 0 13 6 0 0 17 0 1 0 638768493 139010048 4151 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510293509 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/1630/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135752

[startup+0.700338 s]
/proc/loadavg: 3.46 3.89 3.84 2/357 1630
/proc/meminfo: memFree=18136956/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=163656 CPUtime=0.25 cores=1,3,5,7
/proc/1630/stat : 1630 (python) D 1628 1630 1592 0 -1 4202496 6652 932 14 0 15 10 0 0 16 0 1 0 638768493 167583744 4758 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510297344 0 0 16781312 2 18446744071562234166 0 0 17 1 0 0 4
/proc/1630/statm: 40914 4758 1311 364 0 3455 0
Current children cumulated CPU time (s) 0.25
Current children cumulated vsize (KiB) 163656

[startup+1.5002 s]
/proc/loadavg: 3.46 3.89 3.84 1/358 1639
/proc/meminfo: memFree=18095520/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=346744 CPUtime=0.45 cores=1,3,5,7
/proc/1630/stat : 1630 (python) R 1628 1630 1592 0 -1 4202496 21729 932 69 0 26 19 0 0 16 0 1 0 638768493 355065856 19477 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510297344 0 0 16781312 2 0 0 0 17 1 0 0 52
/proc/1630/statm: 86686 19496 1758 364 0 22610 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 346744

[startup+3.1009 s]
/proc/loadavg: 3.46 3.89 3.84 3/358 1639
/proc/meminfo: memFree=17906904/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=451748 CPUtime=2.06 cores=1,3,5,7
/proc/1630/stat : 1630 (python) R 1628 1630 1592 0 -1 4202496 51795 932 69 0 183 23 0 0 17 0 1 0 638768493 462589952 49542 33554432000 4194304 5683644 140737074347872 18446744073709551615 4539757 0 0 16781312 2 0 0 0 17 1 0 0 52
/proc/1630/statm: 112937 49543 1761 364 0 48861 0
Current children cumulated CPU time (s) 2.06
Current children cumulated vsize (KiB) 451748
heavy processes:

[startup+6.30033 s]
/proc/loadavg: 3.51 3.89 3.85 3/358 1639
/proc/meminfo: memFree=17491220/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=656112 CPUtime=5.25 cores=1,3,5,7
/proc/1630/stat : 1630 (python) R 1628 1630 1592 0 -1 4202496 102344 932 69 0 496 29 0 0 25 0 1 0 638768493 671858688 100091 33554432000 4194304 5683644 140737074347872 18446744073709551615 233509958341 0 0 16781312 2 0 0 0 17 1 0 0 52
/proc/1630/statm: 164028 100091 1761 364 0 99952 0
Current children cumulated CPU time (s) 5.25
Current children cumulated vsize (KiB) 656112

[startup+12.7002 s]
/proc/loadavg: 3.39 3.86 3.83 3/358 1639
/proc/meminfo: memFree=17093012/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=918872 CPUtime=11.65 cores=1,3,5,7
/proc/1630/stat : 1630 (python) R 1628 1630 1592 0 -1 4202496 294515 932 69 0 1113 52 0 0 25 0 1 0 638768493 940924928 167124 33554432000 4194304 5683644 140737074347872 18446744073709551615 47993939603376 0 0 16781312 2 0 0 0 17 1 0 0 52
/proc/1630/statm: 229718 167124 1815 364 0 165642 0
Current children cumulated CPU time (s) 11.65
Current children cumulated vsize (KiB) 918872

[startup+25.5009 s]
/proc/loadavg: 3.08 3.77 3.80 3/358 1639
/proc/meminfo: memFree=17220464/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=893632 CPUtime=24.46 cores=1,3,5,7
/proc/1630/stat : 1630 (python) R 1628 1630 1592 0 -1 4202496 307115 932 69 0 2392 54 0 0 25 0 1 0 638768493 915079168 160825 33554432000 4194304 5683644 140737074347872 18446744073709551615 47993972272365 0 0 16781312 2 0 0 0 17 1 0 0 52
/proc/1630/statm: 223408 160825 1826 364 0 159332 0
Current children cumulated CPU time (s) 24.46
Current children cumulated vsize (KiB) 893632

[startup+51.1003 s]
/proc/loadavg: 2.71 3.63 3.76 3/358 1640
/proc/meminfo: memFree=17211164/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=893632 CPUtime=50.06 cores=1,3,5,7
/proc/1630/stat : 1630 (python) R 1628 1630 1592 0 -1 4202496 307115 932 69 0 4951 55 0 0 25 0 1 0 638768493 915079168 160825 33554432000 4194304 5683644 140737074347872 18446744073709551615 4272664 0 0 16781312 2 0 0 0 17 1 0 0 52
/proc/1630/statm: 223408 160825 1826 364 0 159332 0
Current children cumulated CPU time (s) 50.06
Current children cumulated vsize (KiB) 893632

[startup+102.3 s]
/proc/loadavg: 2.31 3.37 3.66 3/358 1641
/proc/meminfo: memFree=17211068/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=893632 CPUtime=101.26 cores=1,3,5,7
/proc/1630/stat : 1630 (python) R 1628 1630 1592 0 -1 4202496 307116 932 69 0 10071 55 0 0 25 0 1 0 638768493 915079168 160826 33554432000 4194304 5683644 140737074347872 18446744073709551615 47993939895242 0 0 16781312 2 0 0 0 17 1 0 0 52
/proc/1630/statm: 223408 160826 1827 364 0 159332 0
Current children cumulated CPU time (s) 101.26
Current children cumulated vsize (KiB) 893632

[startup+162.301 s]
/proc/loadavg: 3.21 3.38 3.64 7/370 1655
/proc/meminfo: memFree=15874824/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=745764 CPUtime=134.34 cores=1,3,5,7
/proc/1630/stat : 1630 (python) S 1628 1630 1592 0 -1 4202496 334981 932 69 0 13371 63 0 0 24 0 5 0 638768493 763662336 97279 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 52
/proc/1630/statm: 186441 97279 1873 364 0 122350 0
[pid=1643] ppid=1630 vsize=639216 CPUtime=0.07 cores=1,3,5,7
/proc/1643/stat : 1643 (python) S 1630 1630 1592 0 -1 4202560 910 0 0 0 3 4 0 0 18 0 1 0 638782026 654557184 95765 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317583 0 0 16781312 514 8263946986550427911 0 0 17 5 0 0 0
/proc/1643/statm: 159804 95765 376 364 0 95722 0
[pid=1647] ppid=1643 vsize=176832 CPUtime=26.59 cores=1,3,5,7
/proc/1647/stat : 1647 (lingeling) R 1643 1647 1647 0 -1 4202496 79592 0 0 0 2645 14 0 0 25 0 1 0 638782029 181075968 43378 33554432000 4194304 4352236 140735342819520 18446744073709551615 4208066 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/1647/statm: 44208 43378 129 39 0 43288 0
[pid=1645] ppid=1630 vsize=649472 CPUtime=0.07 cores=1,3,5,7
/proc/1645/stat : 1645 (python) S 1630 1630 1592 0 -1 4202560 908 0 0 0 3 4 0 0 18 0 1 0 638782028 665059328 95761 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 8263946986550427909 0 0 17 1 0 0 0
/proc/1645/statm: 162368 95761 370 364 0 98283 0
[pid=1650] ppid=1645 vsize=176992 CPUtime=26.9 cores=1,3,5,7
/proc/1650/stat : 1650 (lingeling) R 1645 1650 1650 0 -1 4202496 79638 0 0 0 2676 14 0 0 25 0 1 0 638782031 181239808 43418 33554432000 4194304 4352236 140735830627584 18446744073709551615 4328411 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/1650/statm: 44248 43418 129 39 0 43328 0
[pid=1648] ppid=1630 vsize=659728 CPUtime=0.08 cores=1,3,5,7
/proc/1648/stat : 1648 (python) S 1630 1630 1592 0 -1 4202560 910 0 0 0 3 5 0 0 15 0 1 0 638782030 675561472 95765 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 8263946986550427908 0 0 17 1 0 0 0
/proc/1648/statm: 164932 95765 370 364 0 100844 0
[pid=1653] ppid=1648 vsize=938456 CPUtime=26.74 cores=1,3,5,7
/proc/1653/stat : 1653 (cryptominisat-2) R 1648 1653 1653 0 -1 4202496 203720 0 0 0 2645 29 0 0 25 0 1 0 638782032 960978944 194376 33554432000 4194304 4677096 140735419802544 18446744073709551615 4319256 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/1653/statm: 234614 194376 390 118 0 229573 0
[pid=1651] ppid=1630 vsize=669984 CPUtime=0.07 cores=1,3,5,7
/proc/1651/stat : 1651 (python) S 1630 1630 1592 0 -1 4202560 922 0 0 0 3 4 0 0 18 0 1 0 638782031 686063616 95769 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 8263946986550427908 0 0 17 5 0 0 0
/proc/1651/statm: 167496 95769 370 364 0 103405 0
[pid=1654] ppid=1651 vsize=458972 CPUtime=26.75 cores=1,3,5,7
/proc/1654/stat : 1654 (precosat) R 1651 1654 1654 0 -1 4202496 114978 0 0 0 2656 19 0 0 25 0 1 0 638782032 469987328 111814 33554432000 4194304 4890832 140733495359536 18446744073709551615 4246393 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/1654/statm: 114743 111814 80 171 0 114570 0
[pid=1630/tid=1644] ppid=1628 vsize=745764 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1644/stat : 1644 (python) S 1628 1630 1592 0 -1 4202560 79 932 0 0 0 0 0 0 19 0 5 0 638782027 763662336 97279 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1646] ppid=1628 vsize=745764 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1646/stat : 1646 (python) S 1628 1630 1592 0 -1 4202560 38 932 0 0 0 0 0 0 21 0 5 0 638782029 763662336 97279 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1649] ppid=1628 vsize=745764 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1649/stat : 1649 (python) S 1628 1630 1592 0 -1 4202560 69 932 0 0 0 0 0 0 22 0 5 0 638782031 763662336 97279 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 1 0 0 0
[pid=1630/tid=1652] ppid=1628 vsize=745764 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1652/stat : 1652 (python) S 1628 1630 1592 0 -1 4202560 15 932 0 0 0 0 0 0 24 0 5 0 638782032 763662336 97279 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 241.61
Current children cumulated vsize (KiB) 5115416

[startup+222.302 s]
/proc/loadavg: 4.34 3.67 3.72 6/370 1657
/proc/meminfo: memFree=15412436/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=745764 CPUtime=134.34 cores=1,3,5,7
/proc/1630/stat : 1630 (python) S 1628 1630 1592 0 -1 4202496 334981 932 69 0 13371 63 0 0 24 0 5 0 638768493 763662336 97279 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 52
/proc/1630/statm: 186441 97279 1873 364 0 122350 0
[pid=1643] ppid=1630 vsize=639216 CPUtime=0.22 cores=1,3,5,7
/proc/1643/stat : 1643 (python) S 1630 1630 1592 0 -1 4202560 935 0 0 0 10 12 0 0 18 0 1 0 638782026 654557184 95765 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317583 0 0 16781312 514 8263946986550427911 0 0 17 5 0 0 0
/proc/1643/statm: 159804 95765 376 364 0 95722 0
[pid=1647] ppid=1643 vsize=178268 CPUtime=85.89 cores=1,3,5,7
/proc/1647/stat : 1647 (lingeling) R 1643 1647 1647 0 -1 4202496 128783 0 0 0 8569 20 0 0 25 0 1 0 638782029 182546432 43737 33554432000 4194304 4352236 140735342819520 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/1647/statm: 44567 43737 129 39 0 43647 0
[pid=1645] ppid=1630 vsize=649472 CPUtime=0.23 cores=1,3,5,7
/proc/1645/stat : 1645 (python) S 1630 1630 1592 0 -1 4202560 934 0 0 0 11 12 0 0 18 0 1 0 638782028 665059328 95761 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 8263946986550427909 0 0 17 1 0 0 0
/proc/1645/statm: 162368 95761 370 364 0 98283 0
[pid=1650] ppid=1645 vsize=169380 CPUtime=86.9 cores=1,3,5,7
/proc/1650/stat : 1650 (lingeling) R 1645 1650 1650 0 -1 4202496 142797 0 0 0 8668 22 0 0 25 0 1 0 638782031 173445120 41547 33554432000 4194304 4352236 140735830627584 18446744073709551615 4207631 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/1650/statm: 42345 41547 129 39 0 41425 0
[pid=1648] ppid=1630 vsize=659728 CPUtime=0.26 cores=1,3,5,7
/proc/1648/stat : 1648 (python) S 1630 1630 1592 0 -1 4202560 940 0 0 0 12 14 0 0 15 0 1 0 638782030 675561472 95765 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 8263946986550427908 0 0 17 1 0 0 0
/proc/1648/statm: 164932 95765 370 364 0 100844 0
[pid=1653] ppid=1648 vsize=1575036 CPUtime=86.39 cores=1,3,5,7
/proc/1653/stat : 1653 (cryptominisat-2) R 1648 1653 1653 0 -1 4202496 319319 0 0 0 8596 43 0 0 25 0 1 0 638782032 1612836864 296294 33554432000 4194304 4677096 140735419802544 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/1653/statm: 393759 296294 392 118 0 388718 0
[pid=1651] ppid=1630 vsize=669984 CPUtime=0.22 cores=1,3,5,7
/proc/1651/stat : 1651 (python) S 1630 1630 1592 0 -1 4202560 948 0 0 0 12 10 0 0 18 0 1 0 638782031 686063616 95769 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 8263946986550427908 0 0 17 5 0 0 0
/proc/1651/statm: 167496 95769 370 364 0 103405 0
[pid=1654] ppid=1651 vsize=516092 CPUtime=86.43 cores=1,3,5,7
/proc/1654/stat : 1654 (precosat) R 1651 1654 1654 0 -1 4202496 129652 0 0 0 8622 21 0 0 25 0 1 0 638782032 528478208 126488 33554432000 4194304 4890832 140733495359536 18446744073709551615 4212935 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/1654/statm: 129023 126488 86 171 0 128850 0
[pid=1630/tid=1644] ppid=1628 vsize=745764 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/1650/stat : 1650 (lingeling) R 1645 1650 1650 0 -1 4202496 543550 0 0 0 79022 71 0 0 25 0 1 0 638782031 267894784 64574 33554432000 4194304 4352236 140735830627584 18446744073709551615 4216482 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/1650/statm: 65404 64574 129 39 0 64484 0
[pid=1645/tid=1658] ppid=1630 vsize=649472 CPUtime=0 cores=1,3,5,7
/proc/1645/task/1658/stat : 1658 (python) S 1630 1630 1592 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 638792058 665059328 95793 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 514 18446604467992490432 0 0 -1 1 0 0 0
[pid=1648] ppid=1630 vsize=659728 CPUtime=1.48 cores=1,3,5,7
/proc/1648/stat : 1648 (python) S 1630 1630 1592 0 -1 4202560 1130 0 0 0 71 77 0 0 16 0 2 0 638782030 675561472 95797 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/1648/statm: 164932 95797 399 364 0 100844 0
[pid=1653] ppid=1648 vsize=3485132 CPUtime=490.25 cores=1,3,5,7
/proc/1653/stat : 1653 (cryptominisat-2) T 1648 1653 1653 0 -1 4202496 748043 0 0 0 48911 114 0 0 25 0 1 0 638782032 3568775168 685774 33554432000 4194304 4677096 140735419802544 18446744073709551615 4317744 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/1653/statm: 871283 685774 392 118 0 866242 0
[pid=1648/tid=1729] ppid=1630 vsize=659728 CPUtime=0 cores=1,3,5,7
/proc/1648/task/1729/stat : 1729 (python) S 1630 1630 1592 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 638831115 675561472 95797 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 514 18446604467992492224 0 0 -1 1 0 0 0
[pid=1651] ppid=1630 vsize=669984 CPUtime=0.85 cores=1,3,5,7
/proc/1651/stat : 1651 (python) S 1630 1630 1592 0 -1 4202560 1151 0 0 0 46 39 0 0 18 0 2 0 638782031 686063616 95801 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/1651/statm: 167496 95801 399 364 0 103405 0
[pid=1654] ppid=1651 vsize=516604 CPUtime=297.39 cores=1,3,5,7
/proc/1654/stat : 1654 (precosat) R 1651 1654 1654 0 -1 4202496 129862 0 0 0 29717 22 0 0 25 0 1 0 638782032 529002496 126698 33554432000 4194304 4890832 140733495359536 18446744073709551615 4238338 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/1654/statm: 129151 126698 86 171 0 128978 0
[pid=1651/tid=1661] ppid=1630 vsize=669984 CPUtime=0 cores=1,3,5,7
/proc/1651/task/1661/stat : 1661 (python) S 1630 1630 1592 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 638792061 686063616 95801 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 514 18446604461258331328 0 0 -1 5 0 0 0
[pid=1659] ppid=1630 vsize=745776 CPUtime=2.1 cores=1,3,5,7
/proc/1659/stat : 1659 (python) S 1630 1630 1592 0 -1 4202560 1008 0 0 0 111 99 0 0 15 0 1 0 638792058 763674624 95776 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 8263946986550427911 0 0 17 1 0 0 0
/proc/1659/statm: 186444 95776 370 364 0 122350 0
[pid=1662] ppid=1659 vsize=4036228 CPUtime=692.64 cores=1,3,5,7
/proc/1662/stat : 1662 (cryptominisat-2) R 1659 1662 1662 0 -1 4202496 826844 0 0 0 69140 124 0 0 25 0 1 0 638792062 4133097472 750735 33554432000 4194304 4677096 140733307890400 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/1662/statm: 1009057 750735 392 118 0 1004016 0
[pid=1730] ppid=1630 vsize=756032 CPUtime=0.3 cores=1,3,5,7
/proc/1730/stat : 1730 (python) S 1630 1630 1592 0 -1 4202560 1109 0 0 0 15 15 0 0 19 0 2 0 638831115 774176768 95810 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/1730/statm: 189008 95810 399 364 0 124911 0
[pid=1732] ppid=1730 vsize=174728 CPUtime=99.01 cores=1,3,5,7
/proc/1732/stat : 1732 (lingeling) T 1730 1732 1732 0 -1 4202496 145638 0 0 0 9878 23 0 0 25 0 1 0 638831117 178921472 42852 33554432000 4194304 4352236 140734332146976 18446744073709551615 4241616 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/1732/statm: 43682 42852 129 39 0 42762 0
[pid=1730/tid=1741] ppid=1630 vsize=756032 CPUtime=0 cores=1,3,5,7
/proc/1730/task/1741/stat : 1741 (python) S 1630 1630 1592 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 638841146 774176768 95810 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 514 18446604470181487744 0 0 -1 7 0 0 0
[pid=1742] ppid=1630 vsize=766288 CPUtime=0.57 cores=1,3,5,7
/proc/1742/stat : 1742 (python) S 1630 1630 1592 0 -1 4202560 972 0 0 0 29 28 0 0 18 0 1 0 638841146 784678912 95784 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 8263946986550427910 0 0 17 5 0 0 0
/proc/1742/statm: 191572 95784 370 364 0 127472 0
[pid=1744] ppid=1742 vsize=240580 CPUtime=204.06 cores=1,3,5,7
/proc/1744/stat : 1744 (glucoser_static) R 1742 1744 1744 0 -1 4202496 58246 0 0 0 20391 15 0 0 25 0 1 0 638841148 246353920 57973 33554432000 134512640 134580299 4293179456 18446744073709551615 134553443 0 0 16781312 8388611 0 0 0 17 5 0 0 0
/proc/1744/statm: 60145 57973 243 17 0 59473 0
[pid=1748] ppid=1630 vsize=776544 CPUtime=0.3 cores=1,3,5,7
/proc/1748/stat : 1748 (python) S 1630 1630 1592 0 -1 4202560 1151 0 0 0 13 17 0 0 19 0 2 0 638851114 795181056 95824 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/1748/statm: 194136 95824 405 364 0 130033 0
[pid=1750] ppid=1748 vsize=511448 CPUtime=99.7 cores=1,3,5,7
/proc/1750/stat : 1750 (precosat) T 1748 1750 1750 0 -1 4202496 128521 0 0 0 9949 21 0 0 25 0 1 0 638851116 523722752 125326 33554432000 4194304 4890832 140735973236096 18446744073709551615 4232334 0 0 16781312 17442 18446744071562691360 0 0 17 5 0 0 0
/proc/1750/statm: 127862 125326 86 171 0 127689 0
[pid=1748/tid=1753] ppid=1630 vsize=776544 CPUtime=0 cores=1,3,5,7
/proc/1748/task/1753/stat : 1753 (python) S 1630 1630 1592 0 -1 4202560 42 0 0 0 0 0 0 0 19 0 2 0 638861145 795181056 95824 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 514 18446604459124790400 0 0 -1 5 0 0 0
[pid=1630/tid=1644] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1644/stat : 1644 (python) S 1628 1630 1592 0 -1 4202560 79 932 0 0 0 0 0 0 19 0 9 0 638782027 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1646] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1646/stat : 1646 (python) S 1628 1630 1592 0 -1 4202560 44 932 0 0 0 0 0 0 18 0 9 0 638782029 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1649] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1649/stat : 1649 (python) S 1628 1630 1592 0 -1 4202560 69 932 0 0 0 0 0 0 22 0 9 0 638782031 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 1 0 0 0
[pid=1630/tid=1652] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1652/stat : 1652 (python) S 1628 1630 1592 0 -1 4202560 24 932 0 0 0 0 0 0 18 0 9 0 638782032 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1660] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1660/stat : 1660 (python) S 1628 1630 1592 0 -1 4202560 20 932 0 0 0 0 0 0 20 0 9 0 638792060 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1731] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1731/stat : 1731 (python) S 1628 1630 1592 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 9 0 638831117 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1743] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1743/stat : 1743 (python) S 1628 1630 1592 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 9 0 638841148 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1749] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1749/stat : 1749 (python) S 1628 1630 1592 0 -1 4202560 28 932 0 0 0 0 0 0 20 0 9 0 638851115 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3308.9
Current children cumulated vsize (KiB) 15873188

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+931.801 s]
/proc/loadavg: 8.20 7.67 5.97 9/404 1754
/proc/meminfo: memFree=7935988/32951124 swapFree=67111348/67111528
[pid=1630] ppid=1628 vsize=786788 CPUtime=134.43 cores=1,3,5,7
/proc/1630/stat : 1630 (python) S 1628 1630 1592 0 -1 4202496 338681 932 69 0 13375 68 0 0 18 0 9 0 638768493 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 52
/proc/1630/statm: 196697 97312 1890 364 0 132594 0
[pid=1643] ppid=1630 vsize=649460 CPUtime=1.39 cores=1,3,5,7
/proc/1643/stat : 1643 (python) S 1630 1630 1592 0 -1 4202560 1197 0 0 0 72 67 0 0 19 0 2 0 638782026 665047040 95808 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/1643/statm: 162365 95808 414 364 0 98283 0
[pid=1647] ppid=1643 vsize=186780 CPUtime=491.27 cores=1,3,5,7
/proc/1647/stat : 1647 (lingeling) T 1643 1647 1647 0 -1 4202496 401994 0 0 0 49076 51 0 0 25 0 1 0 638782029 191262720 45897 33554432000 4194304 4352236 140735342819520 18446744073709551615 4328063 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/1647/statm: 46695 45897 129 39 0 45775 0
[pid=1643/tid=1734] ppid=1630 vsize=649460 CPUtime=0 cores=1,3,5,7
/proc/1643/task/1734/stat : 1734 (python) S 1630 1630 1592 0 -1 4202560 119 0 0 0 0 0 0 0 19 0 2 0 638831760 665047040 95808 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 514 18446604467992493120 0 0 -1 7 0 0 0
[pid=1645] ppid=1630 vsize=649472 CPUtime=2.23 cores=1,3,5,7
/proc/1645/stat : 1645 (python) S 1630 1630 1592 0 -1 4202560 1148 0 0 0 112 111 0 0 18 0 2 0 638782028 665059328 95793 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/1645/statm: 162368 95793 399 364 0 98283 0
[pid=1650] ppid=1645 vsize=261616 CPUtime=790.93 cores=1,3,5,7
/proc/1650/stat : 1650 (lingeling) R 1645 1650 1650 0 -1 4202496 543550 0 0 0 79022 71 0 0 25 0 1 0 638782031 267894784 64574 33554432000 4194304 4352236 140735830627584 18446744073709551615 4216482 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/1650/statm: 65404 64574 129 39 0 64484 0
[pid=1645/tid=1658] ppid=1630 vsize=649472 CPUtime=0 cores=1,3,5,7
/proc/1645/task/1658/stat : 1658 (python) S 1630 1630 1592 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 638792058 665059328 95793 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 514 18446604467992490432 0 0 -1 1 0 0 0
[pid=1648] ppid=1630 vsize=659728 CPUtime=1.48 cores=1,3,5,7
/proc/1648/stat : 1648 (python) S 1630 1630 1592 0 -1 4202560 1130 0 0 0 71 77 0 0 16 0 2 0 638782030 675561472 95797 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/1648/statm: 164932 95797 399 364 0 100844 0
[pid=1653] ppid=1648 vsize=3485132 CPUtime=490.25 cores=1,3,5,7
/proc/1653/stat : 1653 (cryptominisat-2) T 1648 1653 1653 0 -1 4202496 748043 0 0 0 48911 114 0 0 25 0 1 0 638782032 3568775168 685774 33554432000 4194304 4677096 140735419802544 18446744073709551615 4317744 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/1653/statm: 871283 685774 392 118 0 866242 0
[pid=1648/tid=1729] ppid=1630 vsize=659728 CPUtime=0 cores=1,3,5,7
/proc/1648/task/1729/stat : 1729 (python) S 1630 1630 1592 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 638831115 675561472 95797 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 514 18446604467992492224 0 0 -1 1 0 0 0
[pid=1651] ppid=1630 vsize=669984 CPUtime=0.85 cores=1,3,5,7
/proc/1651/stat : 1651 (python) S 1630 1630 1592 0 -1 4202560 1151 0 0 0 46 39 0 0 18 0 2 0 638782031 686063616 95801 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/1651/statm: 167496 95801 399 364 0 103405 0
[pid=1654] ppid=1651 vsize=516604 CPUtime=297.39 cores=1,3,5,7
/proc/1654/stat : 1654 (precosat) R 1651 1654 1654 0 -1 4202496 129862 0 0 0 29717 22 0 0 25 0 1 0 638782032 529002496 126698 33554432000 4194304 4890832 140733495359536 18446744073709551615 4238338 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/1654/statm: 129151 126698 86 171 0 128978 0
[pid=1651/tid=1661] ppid=1630 vsize=669984 CPUtime=0 cores=1,3,5,7
/proc/1651/task/1661/stat : 1661 (python) S 1630 1630 1592 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 638792061 686063616 95801 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 514 18446604461258331328 0 0 -1 5 0 0 0
[pid=1659] ppid=1630 vsize=745776 CPUtime=2.1 cores=1,3,5,7
/proc/1659/stat : 1659 (python) S 1630 1630 1592 0 -1 4202560 1008 0 0 0 111 99 0 0 15 0 1 0 638792058 763674624 95776 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 8263946986550427911 0 0 17 1 0 0 0
/proc/1659/statm: 186444 95776 370 364 0 122350 0
[pid=1662] ppid=1659 vsize=4036228 CPUtime=692.64 cores=1,3,5,7
/proc/1662/stat : 1662 (cryptominisat-2) R 1659 1662 1662 0 -1 4202496 826844 0 0 0 69140 124 0 0 25 0 1 0 638792062 4133097472 750735 33554432000 4194304 4677096 140733307890400 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/1662/statm: 1009057 750735 392 118 0 1004016 0
[pid=1730] ppid=1630 vsize=756032 CPUtime=0.3 cores=1,3,5,7
/proc/1730/stat : 1730 (python) S 1630 1630 1592 0 -1 4202560 1109 0 0 0 15 15 0 0 19 0 2 0 638831115 774176768 95810 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/1730/statm: 189008 95810 399 364 0 124911 0
[pid=1732] ppid=1730 vsize=174728 CPUtime=99.01 cores=1,3,5,7
/proc/1732/stat : 1732 (lingeling) T 1730 1732 1732 0 -1 4202496 145638 0 0 0 9878 23 0 0 25 0 1 0 638831117 178921472 42852 33554432000 4194304 4352236 140734332146976 18446744073709551615 4241616 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/1732/statm: 43682 42852 129 39 0 42762 0
[pid=1730/tid=1741] ppid=1630 vsize=756032 CPUtime=0 cores=1,3,5,7
/proc/1730/task/1741/stat : 1741 (python) S 1630 1630 1592 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 638841146 774176768 95810 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 514 18446604470181487744 0 0 -1 7 0 0 0
[pid=1742] ppid=1630 vsize=766288 CPUtime=0.57 cores=1,3,5,7
/proc/1742/stat : 1742 (python) S 1630 1630 1592 0 -1 4202560 972 0 0 0 29 28 0 0 18 0 1 0 638841146 784678912 95784 33554432000 4194304 5683644 140737074347872 18446744073709551615 233510317638 0 0 16781312 514 8263946986550427910 0 0 17 5 0 0 0
/proc/1742/statm: 191572 95784 370 364 0 127472 0
[pid=1744] ppid=1742 vsize=240580 CPUtime=204.06 cores=1,3,5,7
/proc/1744/stat : 1744 (glucoser_static) R 1742 1744 1744 0 -1 4202496 58246 0 0 0 20391 15 0 0 25 0 1 0 638841148 246353920 57973 33554432000 134512640 134580299 4293179456 18446744073709551615 134553443 0 0 16781312 8388611 0 0 0 17 5 0 0 0
/proc/1744/statm: 60145 57973 243 17 0 59473 0
[pid=1748] ppid=1630 vsize=776544 CPUtime=0.3 cores=1,3,5,7
/proc/1748/stat : 1748 (python) S 1630 1630 1592 0 -1 4202560 1151 0 0 0 13 17 0 0 19 0 2 0 638851114 795181056 95824 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/1748/statm: 194136 95824 405 364 0 130033 0
[pid=1750] ppid=1748 vsize=511448 CPUtime=99.7 cores=1,3,5,7
/proc/1750/stat : 1750 (precosat) T 1748 1750 1750 0 -1 4202496 128521 0 0 0 9949 21 0 0 25 0 1 0 638851116 523722752 125326 33554432000 4194304 4890832 140735973236096 18446744073709551615 4232334 0 0 16781312 17442 18446744071562691360 0 0 17 5 0 0 0
/proc/1750/statm: 127862 125326 86 171 0 127689 0
[pid=1748/tid=1753] ppid=1630 vsize=776544 CPUtime=0 cores=1,3,5,7
/proc/1748/task/1753/stat : 1753 (python) S 1630 1630 1592 0 -1 4202560 42 0 0 0 0 0 0 0 19 0 2 0 638861145 795181056 95824 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 514 18446604459124790400 0 0 -1 5 0 0 0
[pid=1630/tid=1644] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1644/stat : 1644 (python) S 1628 1630 1592 0 -1 4202560 79 932 0 0 0 0 0 0 19 0 9 0 638782027 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1646] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1646/stat : 1646 (python) S 1628 1630 1592 0 -1 4202560 44 932 0 0 0 0 0 0 18 0 9 0 638782029 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1649] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1649/stat : 1649 (python) S 1628 1630 1592 0 -1 4202560 69 932 0 0 0 0 0 0 22 0 9 0 638782031 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 1 0 0 0
[pid=1630/tid=1652] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1652/stat : 1652 (python) S 1628 1630 1592 0 -1 4202560 24 932 0 0 0 0 0 0 18 0 9 0 638782032 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1660] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1660/stat : 1660 (python) S 1628 1630 1592 0 -1 4202560 20 932 0 0 0 0 0 0 20 0 9 0 638792060 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1731] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1731/stat : 1731 (python) S 1628 1630 1592 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 9 0 638831117 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1743] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1743/stat : 1743 (python) S 1628 1630 1592 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 9 0 638841148 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
[pid=1630/tid=1749] ppid=1628 vsize=786788 CPUtime=0 cores=1,3,5,7
/proc/1630/task/1749/stat : 1749 (python) S 1628 1630 1592 0 -1 4202560 28 932 0 0 0 0 0 0 20 0 9 0 638851115 805670912 97312 33554432000 4194304 5683644 140737074347872 18446744073709551615 233522121137 0 0 16781312 2 18446604460315996416 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3308.9
Current children cumulated vsize (KiB) 15873188

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1630 and gives
#  childrusage.ru_utime.tv_sec=133
#  childrusage.ru_utime.tv_usec=754666
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=714891
# CPU time returned by wait4() is 134.47
# while last known CPU time is 3308.9
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 931.888
CPU time (s): 3308.9
CPU user time (s): 3299.28
CPU system time (s): 9.62
CPU usage (%): 355.075
Max. virtual memory (cumulated for all children) (KiB): 15873188

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 133.755
system time used= 0.714891
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 339618
page faults= 69
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11338
involuntary context switches= 239

runsolver used 3.76643 second user time and 8.69968 second system time

The end

Launcher Data 

Begin job on node145 at 2011-05-15 14:45:26
IDJOB=3378786
IDBENCH=69571
IDSOLVER=1860
FILE ID=node145/3378786-1305463524
RUNJOBID= node145-1305463524-1611
PBS_JOBID= 13325000
Free space on /tmp= 73552 MiB

SOLVER NAME= borg-sat 11.03.02-par-industrial (fixed)
BENCH NAME= SAT_RACE08/cnf/velev-vliw-uns-4.0-9-i1.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378786-1305463524/watcher-3378786-1305463524 -o /tmp/evaluation-result-3378786-1305463524/solver-3378786-1305463524 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378786-1305463524.cnf -seed 1429669604 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 590cca3a58efdeb1c95ef988a53daa1d
RANDOM SEED=1429669604

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18137360 kB
Buffers:        316296 kB
Cached:        8650364 kB
SwapCached:          0 kB
Active:        7647192 kB
Inactive:      6803980 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18137360 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:          156080 kB
Writeback:           0 kB
AnonPages:     5484056 kB
Mapped:          29612 kB
Slab:           262948 kB
PageTables:      34008 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 79370688 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73540 MiB
End job on node145 at 2011-05-15 15:01:00