Trace number 3317724

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4800.31 1273.79

General information on the benchmark

NameAPPLICATIONS/bitverif/
minandmaxor/minandmaxor128.cnf
MD5SUM5b2e2178738883a628728bb1ec39f4a9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables249327
Number of clauses746444
Sum of the clauses size1741700
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2497628
Number of clauses of size 3248814
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.31/0.48	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.31/0.48	c INFO: solving HOME/instance-3317724-1304267362.cnf
0.31/0.48	c INFO: computing task features
2.69/2.85	c INFO: computed variable-clause graph statistics
2.79/2.94	c INFO: computed clause balance statistics
14.10/14.23	c INFO: computed variable balance statistics
22.49/22.69	c INFO: computed small-clause counts
22.69/22.89	c INFO: computed Horn-clause counts
94.00/94.13	c INFO: computed variable graph statistics
94.00/94.13	c INFO: collected features for HOME/instance-3317724-1304267362.cnf in 93.58 s
94.00/94.15	c INFO: running lingeling-276@0 for 97 with 4706 remaining (b = 0.63)
94.00/94.18	c INFO: running cryptominisat-2.9.0@0 for 485 with 4706 remaining (b = 0.45)
94.09/94.21	c INFO: running lingeling-276@0 for 1067 with 4706 remaining (b = 0.52)
94.09/94.23	c INFO: running cryptominisat-2.9.0@0 for 485 with 4706 remaining (b = 0.37)
493.89/194.31	c INFO: running lingeling-276@0 for 97 with 4606 remaining (b = 0.14)
873.75/289.44	c INFO: running lingeling-276@94 for 97 with 4511 remaining (b = 0.14)
1277.62/390.58	c INFO: running lingeling-276@195 for 97 with 4409 remaining (b = 0.13)
1657.88/485.71	c INFO: running precosat-570@0 for 388 with 4314 remaining (b = 0.59)
2053.62/584.86	c INFO: running lingeling-276@0 for 97 with 4215 remaining (b = 0.42)
2063.61/587.32	c INFO: running lingeling-276@290 for 388 with 4213 remaining (b = 0.17)
2453.78/685.03	c INFO: running SApperloT@0 for 97 with 4115 remaining (b = 0.03)
2853.50/785.19	c INFO: running cryptominisat-2.9.0@0 for 97 with 4015 remaining (b = 0.05)
3232.41/880.21	c INFO: running cryptominisat-2.9.0@0 for 1843 with 3920 remaining (b = 0.50)
3263.08/887.98	c INFO: running cryptominisat-2.9.0@392 for 97 with 3912 remaining (b = 0.11)
3617.33/976.85	c INFO: running lingeling-276@0 for 194 with 3823 remaining (b = 0.10)
3642.39/983.12	c INFO: running precosat-570@489 for 291 with 3817 remaining (b = 0.14)
4361.23/1163.56	c INFO: running cryptominisat-2.9.0@99 for 388 with 3636 remaining (b = 0.16)
4395.47/1172.19	c INFO: running precosat-570@0 for 388 with 3628 remaining (b = 0.16)
4795.12/1272.48	c INFO: running lingeling-276@0 for 194 with 3528 remaining (b = 0.07)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317724-1304267362/watcher-3317724-1304267362 -o /tmp/evaluation-result-3317724-1304267362/solver-3317724-1304267362 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317724-1304267362.cnf -seed 1413425613 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.34 0.61 0.20 2/177 937
/proc/meminfo: memFree=23408340/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=15216 CPUtime=0 cores=0,2,4,6
/proc/937/stat : 937 (python) R 935 937 788 0 -1 4202496 664 0 0 0 0 0 0 0 25 0 1 0 538336690 15581184 559 33554432000 4194304 5683644 140736810924752 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/937/statm: 3804 561 314 364 0 291 0

[startup+0.034038 s]
/proc/loadavg: 2.34 0.61 0.20 2/177 937
/proc/meminfo: memFree=23408340/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=18884 CPUtime=0.02 cores=0,2,4,6
/proc/937/stat : 937 (python) R 935 937 788 0 -1 4202496 1284 0 0 0 2 0 0 0 25 0 1 0 538336690 19337216 1136 33554432000 4194304 5683644 140736810924752 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/937/statm: 4721 1136 421 364 0 690 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 18884

[startup+0.10101 s]
/proc/loadavg: 2.34 0.61 0.20 2/177 937
/proc/meminfo: memFree=23408340/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=102012 CPUtime=0.07 cores=0,2,4,6
/proc/937/stat : 937 (python) S 935 937 788 0 -1 4202496 3027 0 0 0 5 2 0 0 17 0 1 0 538336690 104460288 2717 33554432000 4194304 5683644 140736810924752 18446744073709551615 244442021511 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/937/statm: 26055 2725 847 364 0 1803 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 102012

[startup+0.301921 s]
/proc/loadavg: 2.34 0.61 0.20 2/177 937
/proc/meminfo: memFree=23408340/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=157384 CPUtime=0.22 cores=0,2,4,6
/proc/937/stat : 937 (python) S 935 937 788 0 -1 4202496 6590 935 1 0 16 6 0 0 17 0 1 0 538336690 161161216 4696 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446943232 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/937/statm: 39346 4696 1257 364 0 3454 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 157384

[startup+0.700944 s]
/proc/loadavg: 2.34 0.61 0.20 2/177 937
/proc/meminfo: memFree=23408340/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=305040 CPUtime=0.59 cores=0,2,4,6
/proc/937/stat : 937 (python) R 935 937 788 0 -1 4202496 15907 935 1 0 50 9 0 0 17 0 1 0 538336690 312360960 13587 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446606021 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/937/statm: 76260 13587 1761 364 0 12184 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 305040

[startup+1.50075 s]
/proc/loadavg: 2.31 0.63 0.21 3/178 942
/proc/meminfo: memFree=23340316/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=359416 CPUtime=1.39 cores=0,2,4,6
/proc/937/stat : 937 (python) R 935 937 788 0 -1 4202496 29090 935 1 0 128 11 0 0 19 0 1 0 538336690 368041984 26770 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446606021 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/937/statm: 89854 26771 1761 364 0 25778 0
Current children cumulated CPU time (s) 1.39
Current children cumulated vsize (KiB) 359416

[startup+3.10049 s]
/proc/loadavg: 2.31 0.63 0.21 3/178 942
/proc/meminfo: memFree=23272736/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=429312 CPUtime=2.99 cores=0,2,4,6
/proc/937/stat : 937 (python) R 935 937 788 0 -1 4202496 63935 935 1 0 284 15 0 0 22 0 1 0 538336690 439615488 44712 33554432000 4194304 5683644 140736810924752 18446744073709551615 47196862763217 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/937/statm: 107328 44712 1826 364 0 43252 0
Current children cumulated CPU time (s) 2.99
Current children cumulated vsize (KiB) 429312

[startup+6.30089 s]
/proc/loadavg: 2.31 0.63 0.21 3/178 942
/proc/meminfo: memFree=23235804/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=429312 CPUtime=6.19 cores=0,2,4,6
/proc/937/stat : 937 (python) R 935 937 788 0 -1 4202496 63935 935 1 0 604 15 0 0 25 0 1 0 538336690 439615488 44712 33554432000 4194304 5683644 140736810924752 18446744073709551615 47196862693911 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/937/statm: 107328 44712 1826 364 0 43252 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 429312

[startup+12.7006 s]
/proc/loadavg: 2.26 0.67 0.23 7/190 955
/proc/meminfo: memFree=23043740/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=429312 CPUtime=12.59 cores=0,2,4,6
/proc/937/stat : 937 (python) R 935 937 788 0 -1 4202496 63935 935 1 0 1244 15 0 0 25 0 1 0 538336690 439615488 44712 33554432000 4194304 5683644 140736810924752 18446744073709551615 4324486 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/937/statm: 107328 44712 1826 364 0 43252 0
Current children cumulated CPU time (s) 12.59
Current children cumulated vsize (KiB) 429312

[startup+25.5003 s]
/proc/loadavg: 2.68 0.82 0.28 6/190 956
/proc/meminfo: memFree=22663880/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=429312 CPUtime=25.39 cores=0,2,4,6
/proc/937/stat : 937 (python) R 935 937 788 0 -1 4202496 63942 935 1 0 2524 15 0 0 25 0 1 0 538336690 439615488 44719 33554432000 4194304 5683644 140736810924752 18446744073709551615 47196862613644 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/937/statm: 107328 44719 1833 364 0 43252 0
Current children cumulated CPU time (s) 25.39
Current children cumulated vsize (KiB) 429312

[startup+51.1005 s]
/proc/loadavg: 3.47 1.15 0.40 6/190 957
/proc/meminfo: memFree=22541808/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=429312 CPUtime=51 cores=0,2,4,6
/proc/937/stat : 937 (python) R 935 937 788 0 -1 4202496 63942 935 1 0 5085 15 0 0 25 0 1 0 538336690 439615488 44719 33554432000 4194304 5683644 140736810924752 18446744073709551615 47196862613644 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/937/statm: 107328 44719 1833 364 0 43252 0
Current children cumulated CPU time (s) 51
Current children cumulated vsize (KiB) 429312

[startup+102.307 s]
/proc/loadavg: 4.85 1.89 0.70 9/202 970
/proc/meminfo: memFree=21613024/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=458924 CPUtime=94.13 cores=0,2,4,6
/proc/937/stat : 937 (python) S 935 937 788 0 -1 4202496 66635 935 1 0 9396 17 0 0 22 0 5 0 538336690 469938176 41927 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/937/statm: 114731 41927 1881 364 0 50640 0
[pid=959] ppid=937 vsize=417912 CPUtime=0.01 cores=0,2,4,6
/proc/959/stat : 959 (python) S 937 937 788 0 -1 4202560 974 0 0 0 0 1 0 0 18 0 1 0 538346106 427941888 40412 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965263 0 0 16781312 514 4107196552794046721 0 0 17 4 0 0 0
/proc/959/statm: 104478 40412 382 364 0 40396 0
[pid=961] ppid=959 vsize=91268 CPUtime=8.1 cores=0,2,4,6
/proc/961/stat : 961 (lingeling) R 959 961 961 0 -1 4202496 35087 0 0 0 805 5 0 0 25 0 1 0 538346107 93458432 21985 33554432000 4194304 4352236 140736086789728 18446744073709551615 4228843 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/961/statm: 22817 21985 127 39 0 21897 0
[pid=962] ppid=937 vsize=428168 CPUtime=0 cores=0,2,4,6
/proc/962/stat : 962 (python) S 937 937 788 0 -1 4202560 933 0 0 0 0 0 0 0 15 0 1 0 538346109 438444032 40404 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965318 0 0 16781312 514 4107200401084743938 0 0 17 4 0 0 0
/proc/962/statm: 107042 40404 370 364 0 42957 0
[pid=964] ppid=962 vsize=513872 CPUtime=8.1 cores=0,2,4,6
/proc/964/stat : 964 (cryptominisat-2) R 962 964 964 0 -1 4202496 88801 0 0 0 798 12 0 0 25 0 1 0 538346109 526204928 83981 33554432000 4194304 4677096 140734405767200 18446744073709551615 4319643 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/964/statm: 128468 83981 361 118 0 123427 0
[pid=965] ppid=937 vsize=438424 CPUtime=0.01 cores=0,2,4,6
/proc/965/stat : 965 (python) S 937 937 788 0 -1 4202560 927 0 0 0 0 1 0 0 18 0 1 0 538346111 448946176 40408 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965318 0 0 16781312 514 1078414202957168900 0 0 17 6 0 0 0
/proc/965/statm: 109606 40408 370 364 0 45518 0
[pid=967] ppid=965 vsize=91268 CPUtime=8.07 cores=0,2,4,6
/proc/967/stat : 967 (lingeling) R 965 967 967 0 -1 4202496 35121 0 0 0 803 4 0 0 25 0 1 0 538346112 93458432 21985 33554432000 4194304 4352236 140733197548784 18446744073709551615 4303552 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/967/statm: 22817 21985 127 39 0 21897 0
[pid=968] ppid=937 vsize=448680 CPUtime=0 cores=0,2,4,6
/proc/968/stat : 968 (python) S 937 937 788 0 -1 4202560 938 0 0 0 0 0 0 0 15 0 1 0 538346114 459448320 40412 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965318 0 0 16781312 514 4129479805198369027 0 0 17 4 0 0 0
/proc/968/statm: 112170 40412 370 364 0 48079 0
[pid=970] ppid=968 vsize=510768 CPUtime=7.99 cores=0,2,4,6
/proc/970/stat : 970 (cryptominisat-2) R 968 970 970 0 -1 4202496 88150 0 0 0 789 10 0 0 25 0 1 0 538346115 523026432 83329 33554432000 4194304 4677096 140733898916816 18446744073709551615 4238081 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/970/statm: 127692 83329 361 118 0 122651 0
[pid=937/tid=960] ppid=935 vsize=458924 CPUtime=0 cores=0,2,4,6
/proc/937/task/960/stat : 960 (python) S 935 937 788 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 5 0 538346107 469938176 41927 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 0 0 0 0
[pid=937/tid=963] ppid=935 vsize=458924 CPUtime=0 cores=0,2,4,6
/proc/937/task/963/stat : 963 (python) S 935 937 788 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 5 0 538346109 469938176 41927 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 2 0 0 0
[pid=937/tid=966] ppid=935 vsize=458924 CPUtime=0 cores=0,2,4,6
/proc/937/task/966/stat : 966 (python) S 935 937 788 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 5 0 538346112 469938176 41927 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 6 0 0 0
[pid=937/tid=969] ppid=935 vsize=458924 CPUtime=0 cores=0,2,4,6
/proc/937/task/969/stat : 969 (python) S 935 937 788 0 -1 4202560 30 935 0 0 0 0 0 0 22 0 5 0 538346115 469938176 41927 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 126.41
Current children cumulated vsize (KiB) 3399284

[startup+162.301 s]
/proc/loadavg: 7.09 3.07 1.17 9/207 977
/proc/meminfo: memFree=20382260/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=458924 CPUtime=94.13 cores=0,2,4,6
/proc/937/stat : 937 (python) S 935 937 788 0 -1 4202496 66635 935 1 0 9396 17 0 0 22 0 5 0 538336690 469938176 41927 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/937/statm: 114731 41927 1881 364 0 50640 0
[pid=959] ppid=937 vsize=417912 CPUtime=0.08 cores=0,2,4,6
/proc/959/stat : 959 (python) S 937 937 788 0 -1 4202560 1004 0 0 0 4 4 0 0 18 0 1 0 538346106 427941888 40412 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965263 0 0 16781312 514 15938678885915263233 0 0 17 4 0 0 0
/proc/959/statm: 104478 40412 382 364 0 40396 0
[pid=961] ppid=959 vsize=90540 CPUtime=67.91 cores=0,2,4,6
/proc/961/stat : 961 (lingeling) R 959 961 961 0 -1 4202496 35089 0 0 0 6786 5 0 0 25 0 1 0 538346107 92712960 21805 33554432000 4194304 4352236 140736086789728 18446744073709551615 4289869 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/961/statm: 22635 21805 129 39 0 21715 0
[pid=962] ppid=937 vsize=428168 CPUtime=0.09 cores=0,2,4,6
/proc/962/stat : 962 (python) S 937 937 788 0 -1 4202560 971 0 0 0 5 4 0 0 15 0 1 0 538346109 438444032 40404 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965318 0 0 16781312 514 15938678885915263234 0 0 17 2 0 0 0
/proc/962/statm: 107042 40404 370 364 0 42957 0
[pid=964] ppid=962 vsize=966100 CPUtime=68.02 cores=0,2,4,6
/proc/964/stat : 964 (cryptominisat-2) R 962 964 964 0 -1 4202496 187549 0 0 0 6776 26 0 0 25 0 1 0 538346109 989286400 176129 33554432000 4194304 4677096 140734405767200 18446744073709551615 4236529 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/964/statm: 241525 176129 391 118 0 236484 0
[pid=965] ppid=937 vsize=438424 CPUtime=0.09 cores=0,2,4,6
/proc/965/stat : 965 (python) S 937 937 788 0 -1 4202560 956 0 0 0 5 4 0 0 18 0 1 0 538346111 448946176 40408 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965318 0 0 16781312 514 15938678885915263236 0 0 17 6 0 0 0
/proc/965/statm: 109606 40408 370 364 0 45518 0
[pid=967] ppid=965 vsize=90540 CPUtime=68.07 cores=0,2,4,6
/proc/967/stat : 967 (lingeling) R 965 967 967 0 -1 4202496 39220 0 0 0 6802 5 0 0 25 0 1 0 538346112 92712960 21805 33554432000 4194304 4352236 140733197548784 18446744073709551615 4207584 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/967/statm: 22635 21805 129 39 0 21715 0
[pid=968] ppid=937 vsize=448680 CPUtime=0.1 cores=0,2,4,6
/proc/968/stat : 968 (python) S 937 937 788 0 -1 4202560 969 0 0 0 5 5 0 0 15 0 1 0 538346114 459448320 40412 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965318 0 0 16781312 514 2550765825665499395 0 0 17 4 0 0 0
/proc/968/statm: 112170 40412 370 364 0 48079 0
[pid=970] ppid=968 vsize=942508 CPUtime=67.58 cores=0,2,4,6
/proc/970/stat : 970 (cryptominisat-2) R 968 970 970 0 -1 4202496 182914 0 0 0 6733 25 0 0 25 0 1 0 538346115 965128192 171468 33554432000 4194304 4677096 140733898916816 18446744073709551615 4317747 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/970/statm: 235627 171468 391 118 0 230586 0
[pid=937/tid=960] ppid=935 vsize=458924 CPUtime=0 cores=0,2,4,6
/proc/937/task/960/stat : 960 (python) S 935 937 788 0 -1 4202560 25 935 0 0 0 0 0 0 25 0 5 0 538346107 469938176 41927 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 0 0 0 0
[pid=937/tid=963] ppid=935 vsize=458924 CPUtime=0 cores=0,2,4,6
/proc/937/task/963/stat : 963 (python) S 935 937 788 0 -1 4202560 22 935 0 0 0 0 0 0 25 0 5 0 538346109 469938176 41927 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 2 0 0 0
[pid=937/tid=966] ppid=935 vsize=458924 CPUtime=0 cores=0,2,4,6
/proc/937/task/966/stat : 966 (python) S 935 937 788 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 5 0 538346112 469938176 41927 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 6 0 0 0
[pid=937/tid=969] ppid=935 vsize=458924 CPUtime=0 cores=0,2,4,6
/proc/937/task/969/stat : 969 (python) S 935 937 788 0 -1 4202560 30 935 0 0 0 0 0 0 22 0 5 0 538346115 469938176 41927 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 366.07
Current children cumulated vsize (KiB) 4281796


################
# More data... #
################

[pid=1017] ppid=937 vsize=489704 CPUtime=0.31 cores=0,2,4,6
/proc/1017/stat : 1017 (python) S 937 937 788 0 -1 4202560 1215 0 0 0 17 14 0 0 15 0 2 0 538415210 501456896 40464 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/1017/statm: 122426 40464 405 364 0 58323 0
[pid=1019] ppid=1017 vsize=1610108 CPUtime=195.7 cores=0,2,4,6
/proc/1019/stat : 1019 (cryptominisat-2) T 1017 1019 1019 0 -1 4202496 340452 0 0 0 19516 54 0 0 25 0 1 0 538415211 1648750592 310068 33554432000 4194304 4677096 140735403291232 18446744073709551615 4319558 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/1019/statm: 402527 310068 392 118 0 397486 0
[pid=1017/tid=1028] ppid=937 vsize=489704 CPUtime=0 cores=0,2,4,6
/proc/1017/task/1028/stat : 1028 (python) S 937 937 788 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 538425486 501456896 40464 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 514 18446604453878771840 0 0 -1 6 0 0 0
[pid=1107] ppid=937 vsize=499960 CPUtime=0.26 cores=0,2,4,6
/proc/1107/stat : 1107 (python) S 937 937 788 0 -1 4202560 1166 0 0 0 14 12 0 0 19 0 2 0 538434376 511959040 40462 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/1107/statm: 124990 40462 399 364 0 60884 0
[pid=1109] ppid=1107 vsize=97048 CPUtime=195.02 cores=0,2,4,6
/proc/1109/stat : 1109 (lingeling) T 1107 1109 1109 0 -1 4202496 47089 0 0 0 19497 5 0 0 25 0 1 0 538434376 99377152 23432 33554432000 4194304 4352236 140735661213168 18446744073709551615 4208085 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/1109/statm: 24262 23432 129 39 0 23342 0
[pid=1107/tid=1129] ppid=937 vsize=499960 CPUtime=0 cores=0,2,4,6
/proc/1107/task/1129/stat : 1129 (python) S 937 937 788 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538453907 511959040 40462 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 514 18446604453878487744 0 0 -1 4 0 0 0
[pid=1130] ppid=937 vsize=510216 CPUtime=0.14 cores=0,2,4,6
/proc/1130/stat : 1130 (python) S 937 937 788 0 -1 4202560 964 0 0 0 7 7 0 0 18 0 1 0 538453910 522461184 40436 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965318 0 0 16781312 514 15938678885915263234 0 0 17 4 0 0 0
/proc/1130/statm: 127554 40436 370 364 0 63445 0
[pid=1132] ppid=1130 vsize=336036 CPUtime=101.07 cores=0,2,4,6
/proc/1132/stat : 1132 (precosat) R 1130 1132 1132 0 -1 4202496 99632 0 0 0 10092 15 0 0 25 0 1 0 538453911 344100864 82872 33554432000 4194304 4890832 140737259227008 18446744073709551615 4297695 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/1132/statm: 84009 82872 86 171 0 83836 0
[pid=937/tid=960] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/960/stat : 960 (python) S 935 937 788 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 11 0 538346107 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 0 0 0 0
[pid=937/tid=963] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/963/stat : 963 (python) S 935 937 788 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 11 0 538346109 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 2 0 0 0
[pid=937/tid=966] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/966/stat : 966 (python) S 935 937 788 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 11 0 538346112 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 6 0 0 0
[pid=937/tid=969] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/969/stat : 969 (python) S 935 937 788 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 11 0 538346115 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=989] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/989/stat : 989 (python) S 935 937 788 0 -1 4202560 38 935 0 0 0 0 0 0 18 0 11 0 538385262 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=1000] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/1000/stat : 1000 (python) S 935 937 788 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 11 0 538395178 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=1011] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/1011/stat : 1011 (python) S 935 937 788 0 -1 4202560 32 935 0 0 0 0 0 0 20 0 11 0 538405194 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=1018] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/1018/stat : 1018 (python) S 935 937 788 0 -1 4202560 28 935 0 0 0 0 0 0 18 0 11 0 538415210 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=1108] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/1108/stat : 1108 (python) S 935 937 788 0 -1 4202560 30 935 0 0 0 0 0 0 20 0 11 0 538434376 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=1131] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/1131/stat : 1131 (python) S 935 937 788 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 11 0 538453910 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.31
Current children cumulated vsize (KiB) 11993396

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1273.7 s]
/proc/loadavg: 8.05 7.38 5.64 9/233 1138
/proc/meminfo: memFree=14769472/32951124 swapFree=67111524/67111528
[pid=937] ppid=935 vsize=520460 CPUtime=94.52 cores=0,2,4,6
/proc/937/stat : 937 (python) S 935 937 788 0 -1 4202496 72326 935 1 0 9430 22 0 0 18 0 11 0 538336690 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/937/statm: 130115 41964 1894 364 0 66006 0
[pid=959] ppid=937 vsize=428156 CPUtime=1.05 cores=0,2,4,6
/proc/959/stat : 959 (python) S 937 937 788 0 -1 4202560 1203 0 0 0 57 48 0 0 18 0 2 0 538346106 438431744 40451 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/959/statm: 107039 40451 416 364 0 42957 0
[pid=961] ppid=959 vsize=99192 CPUtime=779.44 cores=0,2,4,6
/proc/961/stat : 961 (lingeling) T 959 961 961 0 -1 4202496 41352 0 0 0 77935 9 0 0 25 0 1 0 538346107 101572608 23968 33554432000 4194304 4352236 140736086789728 18446744073709551615 4278833 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/961/statm: 24798 23968 129 39 0 23878 0
[pid=959/tid=979] ppid=937 vsize=428156 CPUtime=0 cores=0,2,4,6
/proc/959/task/979/stat : 979 (python) S 937 937 788 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 538356119 438431744 40451 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 514 18446604453868974464 0 0 -1 4 0 0 0
[pid=962] ppid=937 vsize=428168 CPUtime=1.27 cores=0,2,4,6
/proc/962/stat : 962 (python) S 937 937 788 0 -1 4202560 1177 0 0 0 71 56 0 0 15 0 2 0 538346109 438444032 40443 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965318 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/962/statm: 107042 40443 408 364 0 42957 0
[pid=964] ppid=962 vsize=2010612 CPUtime=878.64 cores=0,2,4,6
/proc/964/stat : 964 (cryptominisat-2) R 962 964 964 0 -1 4202496 481158 0 0 0 87772 92 0 0 25 0 1 0 538346109 2058866688 379883 33554432000 4194304 4677096 140734405767200 18446744073709551615 244446641931 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/964/statm: 502653 379883 392 118 0 497612 0
[pid=962/tid=998] ppid=937 vsize=428168 CPUtime=0 cores=0,2,4,6
/proc/962/task/998/stat : 998 (python) S 937 937 788 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 538395175 438444032 40443 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 514 18446604453868975360 0 0 -1 4 0 0 0
[pid=965] ppid=937 vsize=438424 CPUtime=1.44 cores=0,2,4,6
/proc/965/stat : 965 (python) S 937 937 788 0 -1 4202560 1154 0 0 0 77 67 0 0 18 0 2 0 538346111 448946176 40438 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965318 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/965/statm: 109606 40438 399 364 0 45518 0
[pid=967] ppid=965 vsize=144160 CPUtime=1070.55 cores=0,2,4,6
/proc/967/stat : 967 (lingeling) R 965 967 967 0 -1 4202496 61518 0 0 0 107046 9 0 0 19 0 1 0 538346112 147619840 35210 33554432000 4194304 4352236 140733197548784 18446744073709551615 4320635 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/967/statm: 36040 35210 129 39 0 35120 0
[pid=965/tid=1127] ppid=937 vsize=438424 CPUtime=0 cores=0,2,4,6
/proc/965/task/1127/stat : 1127 (python) S 937 937 788 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538453045 448946176 40438 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 514 18446604440278879232 0 0 -1 6 0 0 0
[pid=968] ppid=937 vsize=448680 CPUtime=0.86 cores=0,2,4,6
/proc/968/stat : 968 (python) S 937 937 788 0 -1 4202560 1179 0 0 0 46 40 0 0 15 0 2 0 538346114 459448320 40442 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965318 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/968/statm: 112170 40442 399 364 0 48079 0
[pid=970] ppid=968 vsize=1887276 CPUtime=597.97 cores=0,2,4,6
/proc/970/stat : 970 (cryptominisat-2) R 968 970 970 0 -1 4202496 420006 0 0 0 59721 76 0 0 25 0 1 0 538346115 1932570624 349430 33554432000 4194304 4677096 140733898916816 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/970/statm: 471819 349430 392 118 0 466778 0
[pid=968/tid=1002] ppid=937 vsize=448680 CPUtime=0 cores=0,2,4,6
/proc/968/task/1002/stat : 1002 (python) S 937 937 788 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 538395420 459448320 40442 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 514 18446604453874162688 0 0 -1 4 0 0 0
[pid=988] ppid=937 vsize=458936 CPUtime=0.92 cores=0,2,4,6
/proc/988/stat : 988 (python) S 937 937 788 0 -1 4202560 1161 0 0 0 49 43 0 0 18 0 2 0 538385261 469950464 40446 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/988/statm: 114734 40446 399 364 0 50640 0
[pid=990] ppid=988 vsize=458440 CPUtime=681.19 cores=0,2,4,6
/proc/990/stat : 990 (precosat) T 988 990 990 0 -1 4202496 161749 0 0 0 68096 23 0 0 25 0 1 0 538385262 469442560 113495 33554432000 4194304 4890832 140736571289152 18446744073709551615 4238565 0 0 16781312 17442 18446744071562691360 0 0 17 2 0 0 0
/proc/990/statm: 114610 113495 86 171 0 114437 0
[pid=988/tid=1027] ppid=937 vsize=458936 CPUtime=0 cores=0,2,4,6
/proc/988/task/1027/stat : 1027 (python) S 937 937 788 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538424709 469950464 40446 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 514 18446604453882607552 0 0 -1 2 0 0 0
[pid=999] ppid=937 vsize=469192 CPUtime=0.14 cores=0,2,4,6
/proc/999/stat : 999 (python) S 937 937 788 0 -1 4202560 1113 0 0 0 7 7 0 0 19 0 2 0 538395177 480452608 40450 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/999/statm: 117298 40450 399 364 0 53201 0
[pid=1001] ppid=999 vsize=86088 CPUtime=99.84 cores=0,2,4,6
/proc/1001/stat : 1001 (lingeling) T 999 1001 1001 0 -1 4202496 40258 0 0 0 9979 5 0 0 25 0 1 0 538395178 88154112 20692 33554432000 4194304 4352236 140737331309008 18446744073709551615 4327896 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/1001/statm: 21522 20692 129 39 0 20602 0
[pid=999/tid=1009] ppid=937 vsize=469192 CPUtime=0 cores=0,2,4,6
/proc/999/task/1009/stat : 1009 (python) S 937 937 788 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538405191 480452608 40450 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 514 18446604453856444800 0 0 -1 2 0 0 0
[pid=1010] ppid=937 vsize=479448 CPUtime=0.13 cores=0,2,4,6
/proc/1010/stat : 1010 (python) S 937 937 788 0 -1 4202560 1116 0 0 0 8 5 0 0 19 0 2 0 538405193 490954752 40454 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/1010/statm: 119862 40454 399 364 0 55762 0
[pid=1012] ppid=1010 vsize=93092 CPUtime=99.85 cores=0,2,4,6
/proc/1012/stat : 1012 (SApperloT-base) T 1010 1012 1012 0 -1 4202496 23049 0 0 0 9976 9 0 0 25 0 1 0 538405194 95326208 22172 33554432000 134512640 135674940 4290324800 18446744073709551615 134555861 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/1012/statm: 23273 22172 99 284 0 22987 0
[pid=1010/tid=1016] ppid=937 vsize=479448 CPUtime=0 cores=0,2,4,6
/proc/1010/task/1016/stat : 1016 (python) S 937 937 788 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 538415207 490954752 40454 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 514 18446604450718296000 0 0 -1 4 0 0 0
[pid=1017] ppid=937 vsize=489704 CPUtime=0.31 cores=0,2,4,6
/proc/1017/stat : 1017 (python) S 937 937 788 0 -1 4202560 1215 0 0 0 17 14 0 0 15 0 2 0 538415210 501456896 40464 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/1017/statm: 122426 40464 405 364 0 58323 0
[pid=1019] ppid=1017 vsize=1610108 CPUtime=195.7 cores=0,2,4,6
/proc/1019/stat : 1019 (cryptominisat-2) T 1017 1019 1019 0 -1 4202496 340452 0 0 0 19516 54 0 0 25 0 1 0 538415211 1648750592 310068 33554432000 4194304 4677096 140735403291232 18446744073709551615 4319558 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/1019/statm: 402527 310068 392 118 0 397486 0
[pid=1017/tid=1028] ppid=937 vsize=489704 CPUtime=0 cores=0,2,4,6
/proc/1017/task/1028/stat : 1028 (python) S 937 937 788 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 538425486 501456896 40464 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 514 18446604453878771840 0 0 -1 6 0 0 0
[pid=1107] ppid=937 vsize=499960 CPUtime=0.26 cores=0,2,4,6
/proc/1107/stat : 1107 (python) S 937 937 788 0 -1 4202560 1166 0 0 0 14 12 0 0 19 0 2 0 538434376 511959040 40462 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/1107/statm: 124990 40462 399 364 0 60884 0
[pid=1109] ppid=1107 vsize=97048 CPUtime=195.02 cores=0,2,4,6
/proc/1109/stat : 1109 (lingeling) T 1107 1109 1109 0 -1 4202496 47089 0 0 0 19497 5 0 0 25 0 1 0 538434376 99377152 23432 33554432000 4194304 4352236 140735661213168 18446744073709551615 4208085 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/1109/statm: 24262 23432 129 39 0 23342 0
[pid=1107/tid=1129] ppid=937 vsize=499960 CPUtime=0 cores=0,2,4,6
/proc/1107/task/1129/stat : 1129 (python) S 937 937 788 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538453907 511959040 40462 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 514 18446604453878487744 0 0 -1 4 0 0 0
[pid=1130] ppid=937 vsize=510216 CPUtime=0.14 cores=0,2,4,6
/proc/1130/stat : 1130 (python) S 937 937 788 0 -1 4202560 964 0 0 0 7 7 0 0 18 0 1 0 538453910 522461184 40436 33554432000 4194304 5683644 140736810924752 18446744073709551615 244446965318 0 0 16781312 514 15938678885915263234 0 0 17 4 0 0 0
/proc/1130/statm: 127554 40436 370 364 0 63445 0
[pid=1132] ppid=1130 vsize=336036 CPUtime=101.07 cores=0,2,4,6
/proc/1132/stat : 1132 (precosat) R 1130 1132 1132 0 -1 4202496 99632 0 0 0 10092 15 0 0 25 0 1 0 538453911 344100864 82872 33554432000 4194304 4890832 140737259227008 18446744073709551615 4297695 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/1132/statm: 84009 82872 86 171 0 83836 0
[pid=937/tid=960] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/960/stat : 960 (python) S 935 937 788 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 11 0 538346107 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 0 0 0 0
[pid=937/tid=963] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/963/stat : 963 (python) S 935 937 788 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 11 0 538346109 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 2 0 0 0
[pid=937/tid=966] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/966/stat : 966 (python) S 935 937 788 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 11 0 538346112 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 6 0 0 0
[pid=937/tid=969] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/969/stat : 969 (python) S 935 937 788 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 11 0 538346115 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=989] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/989/stat : 989 (python) S 935 937 788 0 -1 4202560 38 935 0 0 0 0 0 0 18 0 11 0 538385262 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=1000] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/1000/stat : 1000 (python) S 935 937 788 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 11 0 538395178 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=1011] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/1011/stat : 1011 (python) S 935 937 788 0 -1 4202560 32 935 0 0 0 0 0 0 20 0 11 0 538405194 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=1018] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/1018/stat : 1018 (python) S 935 937 788 0 -1 4202560 28 935 0 0 0 0 0 0 18 0 11 0 538415210 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=1108] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/1108/stat : 1108 (python) S 935 937 788 0 -1 4202560 30 935 0 0 0 0 0 0 20 0 11 0 538434376 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
[pid=937/tid=1131] ppid=935 vsize=520460 CPUtime=0 cores=0,2,4,6
/proc/937/task/1131/stat : 1131 (python) S 935 937 788 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 11 0 538453910 532951040 41964 33554432000 4194304 5683644 140736810924752 18446744073709551615 244458768817 0 0 16781312 2 18446604453882608448 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.31
Current children cumulated vsize (KiB) 11993396

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 937 and gives
#  childrusage.ru_utime.tv_sec=94
#  childrusage.ru_utime.tv_usec=306663
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=242963
# CPU time returned by wait4() is 94.5496
# while last known CPU time is 4800.31
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1273.79
CPU time (s): 4800.31
CPU user time (s): 4794.13
CPU system time (s): 6.18
CPU usage (%): 376.854
Max. virtual memory (cumulated for all children) (KiB): 11993396

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 94.3067
system time used= 0.242963
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 73267
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1104
involuntary context switches= 203

runsolver used 3.54946 second user time and 8.51571 second system time

The end

Launcher Data 

Begin job on node105 at 2011-05-01 18:29:22
IDJOB=3317724
IDBENCH=70769
IDSOLVER=1706
FILE ID=node105/3317724-1304267362
RUNJOBID= node105-1304267294-806
PBS_JOBID= 13173973
Free space on /tmp= 73364 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT09/APPLICATIONS/bitverif/minandmaxor/minandmaxor128.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317724-1304267362/watcher-3317724-1304267362 -o /tmp/evaluation-result-3317724-1304267362/solver-3317724-1304267362 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317724-1304267362.cnf -seed 1413425613 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5b2e2178738883a628728bb1ec39f4a9
RANDOM SEED=1413425613

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23408620 kB
Buffers:       2187448 kB
Cached:        6516864 kB
SwapCached:          4 kB
Active:        1099868 kB
Inactive:      7883744 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23408620 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           58580 kB
Writeback:           0 kB
AnonPages:      278660 kB
Mapped:          20156 kB
Slab:           494720 kB
PageTables:       5896 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   426236 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73328 MiB
End job on node105 at 2011-05-01 18:50:38