Trace number 3498451

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-industrial (fixed)? (TO) 5000.03 4993.96

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom18.cnf
MD5SUM9ece8f569c93ceee834817ef3350ed8e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables36410
Number of clauses121578
Sum of the clauses size309786
Maximum clause length1188
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 262692
Number of clauses of size 358247
Number of clauses of size 4170
Number of clauses of size 516
Number of clauses of size over 5452

Solver Data 

0.37/0.70	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.37/0.70	c INFO: solving HOME/instance-3498451-1307954338.cnf
0.37/0.70	c INFO: computing task features
0.68/1.06	c INFO: computed variable-clause graph statistics
0.68/1.07	c INFO: computed clause balance statistics
2.67/3.04	c INFO: computed variable balance statistics
4.17/4.52	c INFO: computed small-clause counts
4.17/4.53	c INFO: computed Horn-clause counts
5.87/6.21	c INFO: computed variable graph statistics
5.87/6.21	c INFO: collected features for HOME/instance-3498451-1307954338.cnf in 5.50 s
5.87/6.23	c INFO: running lingeling-276@0 for 97 with 4994 remaining (b = 0.33)
106.03/106.36	c INFO: running cryptominisat-2.9.0@0 for 485 with 4894 remaining (b = 0.33)
594.16/593.86	c INFO: running lingeling-276@100 for 1164 with 4407 remaining (b = 0.47)
1761.80/1760.06	c INFO: running SApperloT@0 for 97 with 3241 remaining (b = 0.17)
1861.98/1860.18	c INFO: running cryptominisat-2.9.0@487 for 97 with 3141 remaining (b = 0.11)
1958.20/1956.23	c INFO: running lingeling-276@0 for 97 with 3045 remaining (b = 0.16)
2058.37/2056.36	c INFO: running lingeling-276@100 for 194 with 2945 remaining (b = 0.18)
2249.81/2247.56	c INFO: running precosat-570@0 for 194 with 2753 remaining (b = 0.17)
2446.36/2443.81	c INFO: running precosat-570@196 for 97 with 2557 remaining (b = 0.07)
2541.58/2538.93	c INFO: running lingeling-276@0 for 194 with 2462 remaining (b = 0.14)
2738.03/2735.18	c INFO: running lingeling-276@196 for 97 with 2266 remaining (b = 0.06)
2833.26/2830.30	c INFO: running cryptominisat-2.9.0@0 for 485 with 2171 remaining (b = 0.21)
3320.65/3316.94	c INFO: running cryptominisat-2.9.0@486 for 97 with 1684 remaining (b = 0.05)
3421.88/3418.03	c INFO: running precosat-570@291 for 97 with 1583 remaining (b = 0.05)
3519.13/3515.16	c INFO: running lingeling-276@291 for 97 with 1486 remaining (b = 0.05)
3616.37/3612.29	c INFO: running lingeling-276@0 for 97 with 1389 remaining (b = 0.05)
3716.71/3712.43	c INFO: running cryptominisat-2.9.0@582 for 1289 with 1289 remaining (b = 0.35)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /var/tmp/evaluation-result-3498451-1307954338/watcher-3498451-1307954338 -o /var/tmp/evaluation-result-3498451-1307954338/solver-3498451-1307954338 -C 5000 -W 5100 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498451-1307954338.cnf -seed 932415470 -budget 5000 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.99 1.95 1.43 3/182 28961
/proc/meminfo: memFree=3090836/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 28636 0 -1 4202496 713 0 0 0 0 0 0 0 25 0 1 0 907034286 15548416 603 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446943232 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/28961/statm: 3796 603 319 364 0 283 0

[startup+0.0850861 s]
/proc/loadavg: 1.99 1.95 1.43 3/182 28961
/proc/meminfo: memFree=3090836/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=50016 CPUtime=0.05 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 28636 0 -1 4202496 1950 0 0 0 4 1 0 0 17 0 1 0 907034286 51216384 1713 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446943232 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/28961/statm: 12504 1713 476 364 0 1204 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 50016

[startup+0.101069 s]
/proc/loadavg: 1.99 1.95 1.43 3/182 28961
/proc/meminfo: memFree=3090836/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=85360 CPUtime=0.07 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 28636 0 -1 4202496 2583 0 0 0 5 2 0 0 17 0 1 0 907034286 87408640 2307 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446943232 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28961/statm: 21340 2307 707 364 0 1557 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 85360

[startup+0.301036 s]
/proc/loadavg: 1.99 1.95 1.43 3/182 28961
/proc/meminfo: memFree=3090836/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=135752 CPUtime=0.17 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 28636 0 -1 4202496 5974 933 1 0 12 5 0 0 17 0 1 0 907034286 139010048 4149 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446941189 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/28961/statm: 33938 4149 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135752

[startup+0.700957 s]
/proc/loadavg: 1.99 1.95 1.43 3/182 28961
/proc/meminfo: memFree=3090836/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=275668 CPUtime=0.37 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 28636 0 -1 4202496 9042 933 1 0 26 11 0 0 15 0 1 0 907034286 282284032 6787 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446945152 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28961/statm: 68916 6786 1729 364 0 5456 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 275668

[startup+1.5008 s]
/proc/loadavg: 1.99 1.95 1.43 3/183 28966
/proc/meminfo: memFree=3047792/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=304028 CPUtime=1.17 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 28636 0 -1 4202496 18638 933 1 0 105 12 0 0 16 0 1 0 907034286 311324672 13391 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446605851 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28961/statm: 76007 13391 1826 364 0 11931 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 304028

[startup+3.10051 s]
/proc/loadavg: 1.99 1.95 1.43 3/183 28966
/proc/meminfo: memFree=3042708/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=304028 CPUtime=2.77 cores=1,3,5,7
/proc/28961/stat : 28961 (python) R 28959 28961 28636 0 -1 4202496 18639 933 1 0 265 12 0 0 18 0 1 0 907034286 311324672 13392 33554432000 4194304 5683644 140735935984848 18446744073709551615 47599843315296 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28961/statm: 76007 13392 1827 364 0 11931 0
Current children cumulated CPU time (s) 2.77
Current children cumulated vsize (KiB) 304028

[startup+6.30088 s]
/proc/loadavg: 1.99 1.95 1.43 3/183 28966
/proc/meminfo: memFree=3043032/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=312304 CPUtime=5.9 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 28636 0 -1 4202496 19008 933 1 0 578 12 0 0 25 0 2 0 907034286 319799296 12938 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28961/statm: 78076 12938 1867 364 0 13994 0
Current children cumulated CPU time (s) 5.9
Current children cumulated vsize (KiB) 312304

[startup+12.7007 s]
/proc/loadavg: 2.07 1.97 1.44 3/186 28969
/proc/meminfo: memFree=3031400/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=312304 CPUtime=5.9 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 28636 0 -1 4202496 19008 933 1 0 578 12 0 0 25 0 2 0 907034286 319799296 12938 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28961/statm: 78076 12938 1867 364 0 13994 0
[pid=28967] ppid=28961 vsize=302060 CPUtime=0 cores=1,3,5,7
/proc/28967/stat : 28967 (python) S 28961 28961 28636 0 -1 4202560 977 0 0 0 0 0 0 0 18 0 1 0 907034909 309309440 11448 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446965263 0 0 16781312 514 9294299337234284804 0 0 17 5 0 0 0
/proc/28967/statm: 75515 11448 381 364 0 11433 0
[pid=28969] ppid=28967 vsize=15356 CPUtime=6.45 cores=1,3,5,7
/proc/28969/stat : 28969 (lingeling) R 28967 28969 28969 0 -1 4202496 4951 0 0 0 644 1 0 0 25 0 1 0 907034910 15724544 3009 33554432000 4194304 4352236 140733538458336 18446744073709551615 4273795 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/28969/statm: 3839 3009 129 39 0 2919 0
[pid=28961/tid=28968] ppid=28959 vsize=312304 CPUtime=0 cores=1,3,5,7
/proc/28961/task/28968/stat : 28968 (python) S 28959 28961 28636 0 -1 4202560 30 933 0 0 0 0 0 0 25 0 2 0 907034910 319799296 12938 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.35
Current children cumulated vsize (KiB) 629720

[startup+25.5004 s]
/proc/loadavg: 2.06 1.97 1.45 3/186 28969
/proc/meminfo: memFree=3030468/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=312304 CPUtime=5.9 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 28636 0 -1 4202496 19008 933 1 0 578 12 0 0 25 0 2 0 907034286 319799296 12938 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28961/statm: 78076 12938 1867 364 0 13994 0
[pid=28967] ppid=28961 vsize=302060 CPUtime=0.02 cores=1,3,5,7
/proc/28967/stat : 28967 (python) S 28961 28961 28636 0 -1 4202560 984 0 0 0 1 1 0 0 18 0 1 0 907034909 309309440 11448 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446965263 0 0 16781312 514 12733329812064534788 0 0 17 5 0 0 0
/proc/28967/statm: 75515 11448 381 364 0 11433 0
[pid=28969] ppid=28967 vsize=16776 CPUtime=19.25 cores=1,3,5,7
/proc/28969/stat : 28969 (lingeling) R 28967 28969 28969 0 -1 4202496 5306 0 0 0 1924 1 0 0 25 0 1 0 907034910 17178624 3364 33554432000 4194304 4352236 140733538458336 18446744073709551615 4328047 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/28969/statm: 4194 3364 129 39 0 3274 0
[pid=28961/tid=28968] ppid=28959 vsize=312304 CPUtime=0 cores=1,3,5,7
/proc/28961/task/28968/stat : 28968 (python) S 28959 28961 28636 0 -1 4202560 30 933 0 0 0 0 0 0 25 0 2 0 907034910 319799296 12938 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.17
Current children cumulated vsize (KiB) 631140

[startup+51.1006 s]
/proc/loadavg: 2.03 1.97 1.46 3/186 28970
/proc/meminfo: memFree=3022224/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=312304 CPUtime=5.9 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 28636 0 -1 4202496 19008 933 1 0 578 12 0 0 25 0 2 0 907034286 319799296 12938 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28961/statm: 78076 12938 1867 364 0 13994 0
[pid=28967] ppid=28961 vsize=302060 CPUtime=0.04 cores=1,3,5,7
/proc/28967/stat : 28967 (python) S 28961 28961 28636 0 -1 4202560 993 0 0 0 2 2 0 0 18 0 1 0 907034909 309309440 11448 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446965263 0 0 16781312 514 12733329812064534788 0 0 17 5 0 0 0
/proc/28967/statm: 75515 11448 381 364 0 11433 0
[pid=28969] ppid=28967 vsize=18316 CPUtime=44.84 cores=1,3,5,7
/proc/28969/stat : 28969 (lingeling) R 28967 28969 28969 0 -1 4202496 5692 0 0 0 4483 1 0 0 25 0 1 0 907034910 18755584 3749 33554432000 4194304 4352236 140733538458336 18446744073709551615 4208062 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/28969/statm: 4579 3749 129 39 0 3659 0
[pid=28961/tid=28968] ppid=28959 vsize=312304 CPUtime=0 cores=1,3,5,7
/proc/28961/task/28968/stat : 28968 (python) S 28959 28961 28636 0 -1 4202560 30 933 0 0 0 0 0 0 25 0 2 0 907034910 319799296 12938 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.78
Current children cumulated vsize (KiB) 632680

[startup+102.306 s]
/proc/loadavg: 2.01 1.97 1.49 3/186 28971
/proc/meminfo: memFree=3006592/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=312304 CPUtime=5.9 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 28636 0 -1 4202496 19008 933 1 0 578 12 0 0 25 0 2 0 907034286 319799296 12938 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28961/statm: 78076 12938 1867 364 0 13994 0
[pid=28967] ppid=28961 vsize=302060 CPUtime=0.1 cores=1,3,5,7
/proc/28967/stat : 28967 (python) S 28961 28961 28636 0 -1 4202560 1014 0 0 0 5 5 0 0 18 0 1 0 907034909 309309440 11448 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446965263 0 0 16781312 514 12733329812064534788 0 0 17 5 0 0 0
/proc/28967/statm: 75515 11448 381 364 0 11433 0
[pid=28969] ppid=28967 vsize=25656 CPUtime=96.04 cores=1,3,5,7
/proc/28969/stat : 28969 (lingeling) R 28967 28969 28969 0 -1 4202496 10599 0 0 0 9603 1 0 0 25 0 1 0 907034910 26271744 5584 33554432000 4194304 4352236 140733538458336 18446744073709551615 4328419 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/28969/statm: 6414 5584 129 39 0 5494 0
[pid=28961/tid=28968] ppid=28959 vsize=312304 CPUtime=0 cores=1,3,5,7
/proc/28961/task/28968/stat : 28968 (python) S 28959 28961 28636 0 -1 4202560 30 933 0 0 0 0 0 0 25 0 2 0 907034910 319799296 12938 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 102.04
Current children cumulated vsize (KiB) 640020

[startup+162.301 s]
/proc/loadavg: 2.05 1.99 1.52 3/193 28980
/proc/meminfo: memFree=2626608/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=322560 CPUtime=5.94 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 28636 0 -1 4202496 19800 933 1 0 581 13 0 0 19 0 3 0 907034286 330301440 12945 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28961/statm: 80640 12945 1870 364 0 16555 0
[pid=28967] ppid=28961 vsize=312304 CPUtime=0.11 cores=1,3,5,7
/proc/28967/stat : 28967 (python) S 28961 28961 28636 0 -1 4202560 1170 0 0 0 6 5 0 0 19 0 2 0 907034909 319799296 11486 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28967/statm: 78076 11486 414 364 0 13994 0
[pid=28969] ppid=28967 vsize=25656 CPUtime=100.08 cores=1,3,5,7
/proc/28969/stat : 28969 (lingeling) T 28967 28969 28969 0 -1 4202496 10599 0 0 0 10007 1 0 0 25 0 1 0 907034910 26271744 5584 33554432000 4194304 4352236 140733538458336 18446744073709551615 4281083 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/28969/statm: 6414 5584 129 39 0 5494 0
[pid=28967/tid=28972] ppid=28961 vsize=312304 CPUtime=0 cores=1,3,5,7
/proc/28967/task/28972/stat : 28972 (python) S 28961 28961 28636 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 907044920 319799296 11486 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604463666625536 0 0 -1 5 0 0 0
[pid=28973] ppid=28961 vsize=312316 CPUtime=0.07 cores=1,3,5,7
/proc/28973/stat : 28973 (python) S 28961 28961 28636 0 -1 4202560 942 0 0 0 3 4 0 0 15 0 1 0 907044923 319811584 11441 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446965318 0 0 16781312 514 12733329812064534792 0 0 17 1 0 0 0
/proc/28973/statm: 78079 11441 370 364 0 13994 0
[pid=28975] ppid=28973 vsize=253304 CPUtime=55.92 cores=1,3,5,7
/proc/28975/stat : 28975 (cryptominisat-2) R 28973 28975 28975 0 -1 4202496 69089 0 0 0 5580 12 0 0 25 0 1 0 907044923 259383296 44691 33554432000 4194304 4677096 140736904993696 18446744073709551615 4358608 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/28975/statm: 63326 44692 393 118 0 58285 0
[pid=28961/tid=28968] ppid=28959 vsize=322560 CPUtime=0 cores=1,3,5,7
/proc/28961/task/28968/stat : 28968 (python) S 28959 28961 28636 0 -1 4202560 30 933 0 0 0 0 0 0 25 0 3 0 907034910 330301440 12945 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
[pid=28961/tid=28974] ppid=28959 vsize=322560 CPUtime=0 cores=1,3,5,7
/proc/28961/task/28974/stat : 28974 (python) S 28959 28961 28636 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 3 0 907044923 330301440 12945 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 162.12
Current children cumulated vsize (KiB) 1226140

[startup+222.301 s]
/proc/loadavg: 2.02 1.99 1.55 3/193 28982
/proc/meminfo: memFree=2590992/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=322560 CPUtime=5.94 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 28636 0 -1 4202496 19800 933 1 0 581 13 0 0 19 0 3 0 907034286 330301440 12945 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28961/statm: 80640 12945 1870 364 0 16555 0
[pid=28967] ppid=28961 vsize=312304 CPUtime=0.11 cores=1,3,5,7
/proc/28967/stat : 28967 (python) S 28961 28961 28636 0 -1 4202560 1170 0 0 0 6 5 0 0 19 0 2 0 907034909 319799296 11486 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28967/statm: 78076 11486 414 364 0 13994 0
[pid=28969] ppid=28967 vsize=25656 CPUtime=100.08 cores=1,3,5,7
/proc/28969/stat : 28969 (lingeling) T 28967 28969 28969 0 -1 4202496 10599 0 0 0 10007 1 0 0 25 0 1 0 907034910 26271744 5584 33554432000 4194304 4352236 140733538458336 18446744073709551615 4281083 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/28969/statm: 6414 5584 129 39 0 5494 0
[pid=28967/tid=28972] ppid=28961 vsize=312304 CPUtime=0 cores=1,3,5,7
/proc/28967/task/28972/stat : 28972 (python) S 28961 28961 28636 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 907044920 319799296 11486 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604463666625536 0 0 -1 5 0 0 0

################
# More data... #
################

/proc/29101/stat : 29101 (SApperloT-base) T 29099 29101 29101 0 -1 4202496 15626 0 0 0 10008 1 0 0 25 0 1 0 907210292 65261568 15264 33554432000 134512640 135674940 4291966688 18446744073709551615 134565359 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/29101/statm: 15933 15264 100 284 0 15647 0
[pid=29099/tid=29108] ppid=28961 vsize=322572 CPUtime=0 cores=1,3,5,7
/proc/29099/task/29108/stat : 29108 (python) S 28961 28961 28636 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 907220303 330313728 11475 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604471161183104 0 0 -1 3 0 0 0
[pid=29116] ppid=28961 vsize=332828 CPUtime=0.48 cores=1,3,5,7
/proc/29116/stat : 29116 (python) S 28961 28961 28636 0 -1 4202560 1151 0 0 0 25 23 0 0 18 0 2 0 907229909 340815872 11479 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29116/statm: 83207 11479 399 364 0 19116 0
[pid=29118] ppid=29116 vsize=34964 CPUtime=388.41 cores=1,3,5,7
/proc/29118/stat : 29118 (lingeling) T 29116 29118 29118 0 -1 4202496 18043 0 0 0 38840 1 0 0 25 0 1 0 907229910 35803136 7910 33554432000 4194304 4352236 140734394421392 18446744073709551615 4328000 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/29118/statm: 8741 7910 129 39 0 7821 0
[pid=29116/tid=29121] ppid=28961 vsize=332828 CPUtime=0 cores=1,3,5,7
/proc/29116/task/29121/stat : 29121 (python) S 28961 28961 28636 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 907239920 340815872 11479 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604471120399104 0 0 -1 5 0 0 0
[pid=29128] ppid=28961 vsize=343084 CPUtime=0.52 cores=1,3,5,7
/proc/29128/stat : 29128 (python) S 28961 28961 28636 0 -1 4202560 1158 0 0 0 26 26 0 0 18 0 2 0 907259042 351318016 11483 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/29128/statm: 85771 11483 399 364 0 21677 0
[pid=29130] ppid=29128 vsize=61276 CPUtime=388.46 cores=1,3,5,7
/proc/29130/stat : 29130 (precosat) T 29128 29130 29130 0 -1 4202496 24693 0 0 0 38843 3 0 0 25 0 1 0 907259043 62746624 14608 33554432000 4194304 4890832 140734131631456 18446744073709551615 4229367 0 0 16781312 17442 18446744071562691360 0 0 17 5 0 0 0
/proc/29130/statm: 15319 14608 86 171 0 15146 0
[pid=29128/tid=29140] ppid=28961 vsize=343084 CPUtime=0 cores=1,3,5,7
/proc/29128/task/29140/stat : 29140 (python) S 28961 28961 28636 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 907278666 351318016 11483 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604454224844608 0 0 -1 1 0 0 0
[pid=29143] ppid=28961 vsize=353340 CPUtime=0.38 cores=1,3,5,7
/proc/29143/stat : 29143 (python) S 28961 28961 28636 0 -1 4202560 1153 0 0 0 20 18 0 0 15 0 2 0 907288180 361820160 11487 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/29143/statm: 88335 11487 399 364 0 24238 0
[pid=29145] ppid=29143 vsize=31484 CPUtime=291.34 cores=1,3,5,7
/proc/29145/stat : 29145 (lingeling) T 29143 29145 29145 0 -1 4202496 13078 0 0 0 29132 2 0 0 25 0 1 0 907288180 32239616 7041 33554432000 4194304 4352236 140734665882112 18446744073709551615 4328544 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/29145/statm: 7871 7041 129 39 0 6951 0
[pid=29143/tid=29151] ppid=28961 vsize=353340 CPUtime=0 cores=1,3,5,7
/proc/29143/task/29151/stat : 29151 (python) S 28961 28961 28636 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 907307803 361820160 11487 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604454224842816 0 0 -1 3 0 0 0
[pid=29159] ppid=28961 vsize=363596 CPUtime=0.83 cores=1,3,5,7
/proc/29159/stat : 29159 (python) S 28961 28961 28636 0 -1 4202560 1181 0 0 0 46 37 0 0 15 0 2 0 907317317 372322304 11491 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29159/statm: 90899 11491 399 364 0 26799 0
[pid=29161] ppid=29159 vsize=355748 CPUtime=587.7 cores=1,3,5,7
/proc/29161/stat : 29161 (cryptominisat-2) T 29159 29161 29161 0 -1 4202496 349540 0 0 0 58713 57 0 0 25 0 1 0 907317317 364285952 80237 33554432000 4194304 4677096 140734916665552 18446744073709551615 4336430 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/29161/statm: 88937 80237 393 118 0 83896 0
[pid=29159/tid=29175] ppid=28961 vsize=363596 CPUtime=0 cores=1,3,5,7
/proc/29159/task/29175/stat : 29175 (python) S 28961 28961 28636 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 907365979 372322304 11491 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604471117586560 0 0 -1 1 0 0 0
[pid=29192] ppid=28961 vsize=373852 CPUtime=0.13 cores=1,3,5,7
/proc/29192/stat : 29192 (python) S 28961 28961 28636 0 -1 4202560 1157 0 0 0 6 7 0 0 19 0 2 0 907395515 382824448 11501 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29192/statm: 93463 11501 405 364 0 29360 0
[pid=29194] ppid=29192 vsize=24848 CPUtime=100.11 cores=1,3,5,7
/proc/29194/stat : 29194 (lingeling) T 29192 29194 29194 0 -1 4202496 9382 0 0 0 10010 1 0 0 25 0 1 0 907395516 25444352 5382 33554432000 4194304 4352236 140736162463984 18446744073709551615 4276607 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/29194/statm: 6212 5382 129 39 0 5292 0
[pid=29192/tid=29198] ppid=28961 vsize=373852 CPUtime=0 cores=1,3,5,7
/proc/29192/task/29198/stat : 29198 (python) S 28961 28961 28636 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 907405528 382824448 11501 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604471117589248 0 0 -1 3 0 0 0
[pid=28961/tid=28968] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/28968/stat : 28968 (python) S 28959 28961 28636 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 9 0 907034910 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
[pid=28961/tid=28974] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/28974/stat : 28974 (python) S 28959 28961 28636 0 -1 4202560 37 933 0 0 0 0 0 0 18 0 9 0 907044923 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
[pid=28961/tid=29100] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29100/stat : 29100 (python) S 28959 28961 28636 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 9 0 907210292 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
[pid=28961/tid=29117] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29117/stat : 29117 (python) S 28959 28961 28636 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 907229909 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 3 0 0 0
[pid=28961/tid=29129] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29129/stat : 29129 (python) S 28959 28961 28636 0 -1 4202560 36 933 0 0 0 0 0 0 18 0 9 0 907259042 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
[pid=28961/tid=29144] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29144/stat : 29144 (python) S 28959 28961 28636 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 9 0 907288180 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 3 0 0 0
[pid=28961/tid=29160] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29160/stat : 29160 (python) S 28959 28961 28636 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 907317317 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
[pid=28961/tid=29193] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29193/stat : 29193 (python) S 28959 28961 28636 0 -1 4202560 35 933 0 0 0 0 0 0 20 0 9 0 907395516 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5000.03
Current children cumulated vsize (KiB) 4437124

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4993.9 s]
/proc/loadavg: 2.01 2.02 1.97 4/239 29246
/proc/meminfo: memFree=5693512/32951124 swapFree=67064380/67111528
[pid=28961] ppid=28959 vsize=384096 CPUtime=6.16 cores=1,3,5,7
/proc/28961/stat : 28961 (python) S 28959 28961 28636 0 -1 4202496 25660 933 1 0 601 15 0 0 18 0 9 0 907034286 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28961/statm: 96024 12989 1890 364 0 31921 0
[pid=28967] ppid=28961 vsize=312304 CPUtime=1.51 cores=1,3,5,7
/proc/28967/stat : 28967 (python) S 28961 28961 28636 0 -1 4202560 1209 0 0 0 82 69 0 0 18 0 2 0 907034909 319799296 11487 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/28967/statm: 78076 11487 415 364 0 13994 0
[pid=28969] ppid=28967 vsize=52332 CPUtime=1266.3 cores=1,3,5,7
/proc/28969/stat : 28969 (lingeling) T 28967 28969 28969 0 -1 4202496 59508 0 0 0 126623 7 0 0 25 0 1 0 907034910 53587968 12253 33554432000 4194304 4352236 140733538458336 18446744073709551615 4327792 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/28969/statm: 13083 12253 129 39 0 12163 0
[pid=28967/tid=28972] ppid=28961 vsize=312304 CPUtime=0 cores=1,3,5,7
/proc/28967/task/28972/stat : 28972 (python) S 28961 28961 28636 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 907044920 319799296 11487 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604463666625536 0 0 -1 5 0 0 0
[pid=28973] ppid=28961 vsize=312316 CPUtime=2.48 cores=1,3,5,7
/proc/28973/stat : 28973 (python) S 28961 28961 28636 0 -1 4202560 1156 0 0 0 131 117 0 0 15 0 2 0 907044923 319811584 11472 33554432000 4194304 5683644 140735935984848 18446744073709551615 244446965318 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/28973/statm: 78079 11472 400 364 0 13994 0
[pid=28975] ppid=28973 vsize=714752 CPUtime=1865.02 cores=1,3,5,7
/proc/28975/stat : 28975 (cryptominisat-2) R 28973 28975 28975 0 -1 4202496 728959 0 0 0 186374 128 0 0 25 0 1 0 907044923 731906048 140610 33554432000 4194304 4677096 140736904993696 18446744073709551615 4551905 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/28975/statm: 178688 140610 393 118 0 173647 0
[pid=28973/tid=28996] ppid=28961 vsize=312316 CPUtime=0 cores=1,3,5,7
/proc/28973/task/28996/stat : 28996 (python) S 28961 28961 28636 0 -1 4202560 43 0 0 0 0 0 0 0 15 0 2 0 907093670 319811584 11472 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604463050445888 0 0 -1 1 0 0 0
[pid=29099] ppid=28961 vsize=322572 CPUtime=0.11 cores=1,3,5,7
/proc/29099/stat : 29099 (python) S 28961 28961 28636 0 -1 4202560 1105 0 0 0 6 5 0 0 19 0 2 0 907210292 330313728 11475 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29099/statm: 80643 11475 399 364 0 16555 0
[pid=29101] ppid=29099 vsize=63732 CPUtime=100.09 cores=1,3,5,7
/proc/29101/stat : 29101 (SApperloT-base) T 29099 29101 29101 0 -1 4202496 15626 0 0 0 10008 1 0 0 25 0 1 0 907210292 65261568 15264 33554432000 134512640 135674940 4291966688 18446744073709551615 134565359 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/29101/statm: 15933 15264 100 284 0 15647 0
[pid=29099/tid=29108] ppid=28961 vsize=322572 CPUtime=0 cores=1,3,5,7
/proc/29099/task/29108/stat : 29108 (python) S 28961 28961 28636 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 907220303 330313728 11475 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604471161183104 0 0 -1 3 0 0 0
[pid=29116] ppid=28961 vsize=332828 CPUtime=0.48 cores=1,3,5,7
/proc/29116/stat : 29116 (python) S 28961 28961 28636 0 -1 4202560 1151 0 0 0 25 23 0 0 18 0 2 0 907229909 340815872 11479 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/29116/statm: 83207 11479 399 364 0 19116 0
[pid=29118] ppid=29116 vsize=34964 CPUtime=388.41 cores=1,3,5,7
/proc/29118/stat : 29118 (lingeling) T 29116 29118 29118 0 -1 4202496 18043 0 0 0 38840 1 0 0 25 0 1 0 907229910 35803136 7910 33554432000 4194304 4352236 140734394421392 18446744073709551615 4328000 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/29118/statm: 8741 7910 129 39 0 7821 0
[pid=29116/tid=29121] ppid=28961 vsize=332828 CPUtime=0 cores=1,3,5,7
/proc/29116/task/29121/stat : 29121 (python) S 28961 28961 28636 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 907239920 340815872 11479 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604471120399104 0 0 -1 5 0 0 0
[pid=29128] ppid=28961 vsize=343084 CPUtime=0.52 cores=1,3,5,7
/proc/29128/stat : 29128 (python) S 28961 28961 28636 0 -1 4202560 1158 0 0 0 26 26 0 0 18 0 2 0 907259042 351318016 11483 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/29128/statm: 85771 11483 399 364 0 21677 0
[pid=29130] ppid=29128 vsize=61276 CPUtime=388.46 cores=1,3,5,7
/proc/29130/stat : 29130 (precosat) T 29128 29130 29130 0 -1 4202496 24693 0 0 0 38843 3 0 0 25 0 1 0 907259043 62746624 14608 33554432000 4194304 4890832 140734131631456 18446744073709551615 4229367 0 0 16781312 17442 18446744071562691360 0 0 17 5 0 0 0
/proc/29130/statm: 15319 14608 86 171 0 15146 0
[pid=29128/tid=29140] ppid=28961 vsize=343084 CPUtime=0 cores=1,3,5,7
/proc/29128/task/29140/stat : 29140 (python) S 28961 28961 28636 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 907278666 351318016 11483 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604454224844608 0 0 -1 1 0 0 0
[pid=29143] ppid=28961 vsize=353340 CPUtime=0.38 cores=1,3,5,7
/proc/29143/stat : 29143 (python) S 28961 28961 28636 0 -1 4202560 1153 0 0 0 20 18 0 0 15 0 2 0 907288180 361820160 11487 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/29143/statm: 88335 11487 399 364 0 24238 0
[pid=29145] ppid=29143 vsize=31484 CPUtime=291.34 cores=1,3,5,7
/proc/29145/stat : 29145 (lingeling) T 29143 29145 29145 0 -1 4202496 13078 0 0 0 29132 2 0 0 25 0 1 0 907288180 32239616 7041 33554432000 4194304 4352236 140734665882112 18446744073709551615 4328544 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/29145/statm: 7871 7041 129 39 0 6951 0
[pid=29143/tid=29151] ppid=28961 vsize=353340 CPUtime=0 cores=1,3,5,7
/proc/29143/task/29151/stat : 29151 (python) S 28961 28961 28636 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 907307803 361820160 11487 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604454224842816 0 0 -1 3 0 0 0
[pid=29159] ppid=28961 vsize=363596 CPUtime=0.83 cores=1,3,5,7
/proc/29159/stat : 29159 (python) S 28961 28961 28636 0 -1 4202560 1181 0 0 0 46 37 0 0 15 0 2 0 907317317 372322304 11491 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29159/statm: 90899 11491 399 364 0 26799 0
[pid=29161] ppid=29159 vsize=355748 CPUtime=587.7 cores=1,3,5,7
/proc/29161/stat : 29161 (cryptominisat-2) T 29159 29161 29161 0 -1 4202496 349540 0 0 0 58713 57 0 0 25 0 1 0 907317317 364285952 80237 33554432000 4194304 4677096 140734916665552 18446744073709551615 4336430 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/29161/statm: 88937 80237 393 118 0 83896 0
[pid=29159/tid=29175] ppid=28961 vsize=363596 CPUtime=0 cores=1,3,5,7
/proc/29159/task/29175/stat : 29175 (python) S 28961 28961 28636 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 907365979 372322304 11491 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604471117586560 0 0 -1 1 0 0 0
[pid=29192] ppid=28961 vsize=373852 CPUtime=0.13 cores=1,3,5,7
/proc/29192/stat : 29192 (python) S 28961 28961 28636 0 -1 4202560 1157 0 0 0 6 7 0 0 19 0 2 0 907395515 382824448 11501 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458771915 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29192/statm: 93463 11501 405 364 0 29360 0
[pid=29194] ppid=29192 vsize=24848 CPUtime=100.11 cores=1,3,5,7
/proc/29194/stat : 29194 (lingeling) T 29192 29194 29194 0 -1 4202496 9382 0 0 0 10010 1 0 0 25 0 1 0 907395516 25444352 5382 33554432000 4194304 4352236 140736162463984 18446744073709551615 4276607 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/29194/statm: 6212 5382 129 39 0 5292 0
[pid=29192/tid=29198] ppid=28961 vsize=373852 CPUtime=0 cores=1,3,5,7
/proc/29192/task/29198/stat : 29198 (python) S 28961 28961 28636 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 907405528 382824448 11501 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 514 18446604471117589248 0 0 -1 3 0 0 0
[pid=28961/tid=28968] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/28968/stat : 28968 (python) S 28959 28961 28636 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 9 0 907034910 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
[pid=28961/tid=28974] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/28974/stat : 28974 (python) S 28959 28961 28636 0 -1 4202560 37 933 0 0 0 0 0 0 18 0 9 0 907044923 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
[pid=28961/tid=29100] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29100/stat : 29100 (python) S 28959 28961 28636 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 9 0 907210292 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
[pid=28961/tid=29117] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29117/stat : 29117 (python) S 28959 28961 28636 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 907229909 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 3 0 0 0
[pid=28961/tid=29129] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29129/stat : 29129 (python) S 28959 28961 28636 0 -1 4202560 36 933 0 0 0 0 0 0 18 0 9 0 907259042 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
[pid=28961/tid=29144] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29144/stat : 29144 (python) S 28959 28961 28636 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 9 0 907288180 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 3 0 0 0
[pid=28961/tid=29160] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29160/stat : 29160 (python) S 28959 28961 28636 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 907317317 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
[pid=28961/tid=29193] ppid=28959 vsize=384096 CPUtime=0 cores=1,3,5,7
/proc/28961/task/29193/stat : 29193 (python) S 28959 28961 28636 0 -1 4202560 35 933 0 0 0 0 0 0 20 0 9 0 907395516 393314304 12989 33554432000 4194304 5683644 140735935984848 18446744073709551615 244458768817 0 0 16781312 2 18446604471078585408 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5000.03
Current children cumulated vsize (KiB) 4437124

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28961 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=20084
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=155976
# CPU time returned by wait4() is 6.17606
# while last known CPU time is 5000.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4993.96
CPU time (s): 5000.03
CPU user time (s): 4994.86
CPU system time (s): 5.17
CPU usage (%): 100.121
Max. virtual memory (cumulated for all children) (KiB): 4463232

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.02008
system time used= 0.155976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 26597
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2901
involuntary context switches= 53

runsolver used 14.6178 second user time and 29.6645 second system time

The end

Launcher Data 

Begin job on node105 at 2011-06-13 10:38:58
IDJOB=3498451
IDBENCH=83127
IDSOLVER=1991
FILE ID=node105/3498451-1307954338
RUNJOBID= node105-1307953128-28655
PBS_JOBID= 13559723
Free space on /var/tmp= 2676 MiB

SOLVER NAME= borg-sat 11.03.02-seq-industrial (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom18.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /var/tmp/evaluation-result-3498451-1307954338/watcher-3498451-1307954338 -o /var/tmp/evaluation-result-3498451-1307954338/solver-3498451-1307954338 -C 5000 -W 5100 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3498451-1307954338.cnf -seed 932415470 -budget 5000

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9ece8f569c93ceee834817ef3350ed8e
RANDOM SEED=932415470

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       3091372 kB
Buffers:        102552 kB
Cached:       26698640 kB
SwapCached:      19904 kB
Active:       13551400 kB
Inactive:     15436540 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       3091372 kB
SwapTotal:    67111528 kB
SwapFree:     67064380 kB
Dirty:           33756 kB
Writeback:           0 kB
AnonPages:     2184572 kB
Mapped:          16448 kB
Slab:           799236 kB
PageTables:      13124 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  4113224 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /var/tmp at the end= 2824 MiB
End job on node105 at 2011-06-13 12:02:14