Trace number 3317901

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4194.55 1300.05

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top21.cnf
MD5SUM9fab5edd49fb904ff76ff7abf98e0d14
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables51138
Number of clauses162526
Sum of the clauses size397144
Maximum clause length2101
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 299113
Number of clauses of size 362300
Number of clauses of size 4230
Number of clauses of size 519
Number of clauses of size over 5863

Solver Data 

0.36/0.64	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.36/0.64	c INFO: solving HOME/instance-3317901-1304269910.cnf
0.36/0.64	c INFO: computing task features
0.94/1.23	c INFO: computed variable-clause graph statistics
0.94/1.25	c INFO: computed clause balance statistics
3.53/3.80	c INFO: computed variable balance statistics
5.33/5.67	c INFO: computed small-clause counts
5.33/5.68	c INFO: computed Horn-clause counts
8.63/8.93	c INFO: computed variable graph statistics
8.63/8.93	c INFO: collected features for HOME/instance-3317901-1304269910.cnf in 8.27 s
8.63/8.96	c INFO: running lingeling-276@0 for 97 with 4791 remaining (b = 0.35)
8.63/8.98	c INFO: running cryptominisat-2.9.0@0 for 485 with 4791 remaining (b = 0.33)
8.73/9.01	c INFO: running lingeling-276@0 for 1261 with 4791 remaining (b = 0.47)
8.73/9.03	c INFO: running cryptominisat-2.9.0@0 for 1649 with 4791 remaining (b = 0.50)
309.42/109.12	c INFO: running lingeling-276@0 for 1164 with 4691 remaining (b = 0.39)
1856.07/551.83	c INFO: running lingeling-276@0 for 97 with 4248 remaining (b = 0.27)
2205.79/651.99	c INFO: running lingeling-276@98 for 97 with 4148 remaining (b = 0.08)
2548.88/750.16	c INFO: running SApperloT@0 for 97 with 4050 remaining (b = 0.12)
3130.45/944.45	c INFO: running precosat-570@0 for 388 with 3856 remaining (b = 0.22)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317901-1304269910/watcher-3317901-1304269910 -o /tmp/evaluation-result-3317901-1304269910/solver-3317901-1304269910 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317901-1304269910.cnf -seed 26425585 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.07 7.01 5.83 8/206 21633
/proc/meminfo: memFree=27567012/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/21633/stat : 21633 (python) S 21631 21633 21052 0 -1 4202496 724 0 0 0 0 0 0 0 25 0 1 0 538588899 15548416 615 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550535680 0 2147483391 16781312 2 18446744071699469502 0 0 17 1 0 0 0
/proc/21633/statm: 3796 615 321 364 0 283 0

[startup+0.0142381 s]
/proc/loadavg: 9.07 7.01 5.83 8/206 21633
/proc/meminfo: memFree=27567012/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/21633/stat : 21633 (python) R 21631 21633 21052 0 -1 4202496 927 0 0 0 0 0 0 0 25 0 1 0 538588899 16154624 807 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562351760 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/21633/statm: 3944 807 356 364 0 431 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15776

[startup+0.100215 s]
/proc/loadavg: 9.07 7.01 5.83 8/206 21633
/proc/meminfo: memFree=27567012/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=87708 CPUtime=0.06 cores=1,3,5,7
/proc/21633/stat : 21633 (python) R 21631 21633 21052 0 -1 4202496 2637 0 0 0 5 1 0 0 25 0 1 0 538588899 89812992 2354 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550537472 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/21633/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87708

[startup+0.30015 s]
/proc/loadavg: 9.07 7.01 5.83 8/206 21633
/proc/meminfo: memFree=27567012/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=135748 CPUtime=0.19 cores=1,3,5,7
/proc/21633/stat : 21633 (python) S 21631 21633 21052 0 -1 4202496 5960 934 1 0 14 5 0 0 17 0 1 0 538588899 139005952 4150 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550533637 0 2147483391 16781312 2 18446744071699469502 0 0 17 7 0 0 0
/proc/21633/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.706121 s]
/proc/loadavg: 9.07 7.01 5.83 8/206 21633
/proc/meminfo: memFree=27567012/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=283740 CPUtime=0.44 cores=1,3,5,7
/proc/21633/stat : 21633 (python) R 21631 21633 21052 0 -1 4202496 10588 934 1 0 34 10 0 0 15 0 1 0 538588899 290549760 8272 33554432000 4194304 5683644 140735369536448 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/21633/statm: 70935 8272 1761 364 0 6859 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 283740

[startup+1.50097 s]
/proc/loadavg: 8.82 6.99 5.83 7/207 21638
/proc/meminfo: memFree=27524720/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=312000 CPUtime=1.24 cores=1,3,5,7
/proc/21633/stat : 21633 (python) R 21631 21633 21052 0 -1 4202496 21456 934 1 0 112 12 0 0 16 0 1 0 538588899 319488000 15385 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550196296 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/21633/statm: 78000 15385 1826 364 0 13924 0
Current children cumulated CPU time (s) 1.24
Current children cumulated vsize (KiB) 312000

[startup+3.10067 s]
/proc/loadavg: 8.82 6.99 5.83 7/207 21638
/proc/meminfo: memFree=27508972/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=312000 CPUtime=2.84 cores=1,3,5,7
/proc/21633/stat : 21633 (python) R 21631 21633 21052 0 -1 4202496 21456 934 1 0 272 12 0 0 18 0 1 0 538588899 319488000 15385 33554432000 4194304 5683644 140735369536448 18446744073709551615 4294353 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/21633/statm: 78000 15385 1826 364 0 13924 0
Current children cumulated CPU time (s) 2.84
Current children cumulated vsize (KiB) 312000

[startup+6.30109 s]
/proc/loadavg: 8.82 6.99 5.83 7/207 21638
/proc/meminfo: memFree=27552868/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=312000 CPUtime=6.04 cores=1,3,5,7
/proc/21633/stat : 21633 (python) R 21631 21633 21052 0 -1 4202496 21463 934 1 0 592 12 0 0 25 0 1 0 538588899 319488000 15392 33554432000 4194304 5683644 140735369536448 18446744073709551615 47527958616192 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/21633/statm: 78000 15392 1833 364 0 13924 0
Current children cumulated CPU time (s) 6.04
Current children cumulated vsize (KiB) 312000

[startup+12.7009 s]
/proc/loadavg: 8.71 7.03 5.86 10/219 21651
/proc/meminfo: memFree=27381840/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=350460 CPUtime=8.77 cores=1,3,5,7
/proc/21633/stat : 21633 (python) S 21631 21633 21052 0 -1 4202496 24183 934 1 0 863 14 0 0 24 0 5 0 538588899 358871040 14812 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21633/statm: 87615 14812 1881 364 0 23524 0
[pid=21640] ppid=21633 vsize=309448 CPUtime=0 cores=1,3,5,7
/proc/21640/stat : 21640 (python) S 21633 21633 21052 0 -1 4202560 810 0 0 0 0 0 0 0 18 0 1 0 538589795 316874752 13273 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557711 0 0 16781312 514 4470074697500819720 0 0 17 7 0 0 0
/proc/21640/statm: 77362 13273 358 364 0 13280 0
[pid=21642] ppid=21640 vsize=23648 CPUtime=3.72 cores=1,3,5,7
/proc/21642/stat : 21642 (lingeling) R 21640 21642 21642 0 -1 4202496 6996 0 0 0 372 0 0 0 25 0 1 0 538589795 24215552 5080 33554432000 4194304 4352236 140735822302960 18446744073709551615 4268343 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/21642/statm: 5912 5080 127 39 0 4992 0
[pid=21643] ppid=21633 vsize=319704 CPUtime=0 cores=1,3,5,7
/proc/21643/stat : 21643 (python) S 21633 21633 21052 0 -1 4202560 749 0 0 0 0 0 0 0 15 0 1 0 538589797 327376896 13266 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 4470070849210122504 0 0 17 1 0 0 0
/proc/21643/statm: 79926 13266 347 364 0 15841 0
[pid=21645] ppid=21643 vsize=122588 CPUtime=2.07 cores=1,3,5,7
/proc/21645/stat : 21645 (cryptominisat-2) R 21643 21645 21645 0 -1 4202496 23296 0 0 0 204 3 0 0 25 0 1 0 538589798 125530112 21983 33554432000 4194304 4677096 140735565166432 18446744073709551615 4238499 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21645/statm: 30647 21983 361 118 0 25606 0
[pid=21646] ppid=21633 vsize=329960 CPUtime=0 cores=1,3,5,7
/proc/21646/stat : 21646 (python) S 21633 21633 21052 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 538589800 337879040 13270 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 9489237251280830724 0 0 17 7 0 0 0
/proc/21646/statm: 82490 13270 347 364 0 18402 0
[pid=21650] ppid=21646 vsize=23628 CPUtime=3.65 cores=1,3,5,7
/proc/21650/stat : 21650 (lingeling) R 21646 21650 21650 0 -1 4202496 6990 0 0 0 364 1 0 0 25 0 1 0 538589803 24195072 5075 33554432000 4194304 4352236 140736770542160 18446744073709551615 4214782 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21650/statm: 5907 5075 127 39 0 4987 0
[pid=21648] ppid=21633 vsize=340216 CPUtime=0 cores=1,3,5,7
/proc/21648/stat : 21648 (python) S 21633 21633 21052 0 -1 4202560 758 0 0 0 0 0 0 0 15 0 1 0 538589802 348381184 13274 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 9489233402990166015 0 0 17 7 0 0 0
/proc/21648/statm: 85054 13274 347 364 0 20963 0
[pid=21651] ppid=21648 vsize=97744 CPUtime=1.61 cores=1,3,5,7
/proc/21651/stat : 21651 (cryptominisat-2) R 21648 21651 21651 0 -1 4202496 17241 0 0 0 158 3 0 0 25 0 1 0 538589803 100089856 15927 33554432000 4194304 4677096 140737290387184 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21651/statm: 24436 15927 361 118 0 19395 0
[pid=21633/tid=21641] ppid=21631 vsize=350460 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21641/stat : 21641 (python) S 21631 21633 21052 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 5 0 538589795 358871040 14812 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 5 0 0 0
[pid=21633/tid=21644] ppid=21631 vsize=350460 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21644/stat : 21644 (python) S 21631 21633 21052 0 -1 4202560 21 934 0 0 0 0 0 0 20 0 5 0 538589798 358871040 14812 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 1 0 0 0
[pid=21633/tid=21647] ppid=21631 vsize=350460 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21647/stat : 21647 (python) S 21631 21633 21052 0 -1 4202560 40 934 0 0 0 0 0 0 22 0 5 0 538589800 358871040 14812 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 1 0 0 0
[pid=21633/tid=21649] ppid=21631 vsize=350460 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21649/stat : 21649 (python) S 21631 21633 21052 0 -1 4202560 18 934 0 0 0 0 0 0 25 0 5 0 538589803 358871040 14812 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 19.82
Current children cumulated vsize (KiB) 1917396

[startup+25.5006 s]
/proc/loadavg: 8.83 7.11 5.89 10/219 21651
/proc/meminfo: memFree=27005144/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=350460 CPUtime=8.77 cores=1,3,5,7
/proc/21633/stat : 21633 (python) S 21631 21633 21052 0 -1 4202496 24183 934 1 0 863 14 0 0 24 0 5 0 538588899 358871040 14812 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21633/statm: 87615 14812 1881 364 0 23524 0
[pid=21640] ppid=21633 vsize=309448 CPUtime=0.02 cores=1,3,5,7
/proc/21640/stat : 21640 (python) S 21633 21633 21052 0 -1 4202560 992 0 0 0 1 1 0 0 18 0 1 0 538589795 316874752 13296 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557711 0 0 16781312 514 17585888041812066568 0 0 17 7 0 0 0
/proc/21640/statm: 77362 13296 381 364 0 13280 0
[pid=21642] ppid=21640 vsize=23528 CPUtime=16.53 cores=1,3,5,7
/proc/21642/stat : 21642 (lingeling) R 21640 21642 21642 0 -1 4202496 8023 0 0 0 1652 1 0 0 25 0 1 0 538589795 24092672 5052 33554432000 4194304 4352236 140735822302960 18446744073709551615 4267573 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/21642/statm: 5882 5052 129 39 0 4962 0
[pid=21643] ppid=21633 vsize=319704 CPUtime=0.01 cores=1,3,5,7
/proc/21643/stat : 21643 (python) S 21633 21633 21052 0 -1 4202560 919 0 0 0 1 0 0 0 15 0 1 0 538589797 327376896 13289 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 583559203667280136 0 0 17 1 0 0 0
/proc/21643/statm: 79926 13289 370 364 0 15841 0
[pid=21645] ppid=21643 vsize=295848 CPUtime=8.48 cores=1,3,5,7
/proc/21645/stat : 21645 (cryptominisat-2) R 21643 21645 21645 0 -1 4202496 61635 0 0 0 839 9 0 0 25 0 1 0 538589798 302948352 60322 33554432000 4194304 4677096 140735565166432 18446744073709551615 4338995 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21645/statm: 73962 60322 392 118 0 68921 0
[pid=21646] ppid=21633 vsize=329960 CPUtime=0.02 cores=1,3,5,7
/proc/21646/stat : 21646 (python) S 21633 21633 21052 0 -1 4202560 936 0 0 0 1 1 0 0 18 0 1 0 538589800 337879040 13293 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 17585888041812066564 0 0 17 7 0 0 0
/proc/21646/statm: 82490 13293 370 364 0 18402 0
[pid=21650] ppid=21646 vsize=23508 CPUtime=16.42 cores=1,3,5,7
/proc/21650/stat : 21650 (lingeling) R 21646 21650 21650 0 -1 4202496 8017 0 0 0 1641 1 0 0 25 0 1 0 538589803 24072192 5047 33554432000 4194304 4352236 140736770542160 18446744073709551615 4268398 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21650/statm: 5877 5047 129 39 0 4957 0
[pid=21648] ppid=21633 vsize=340216 CPUtime=0.02 cores=1,3,5,7
/proc/21648/stat : 21648 (python) S 21633 21633 21052 0 -1 4202560 922 0 0 0 1 1 0 0 15 0 1 0 538589802 348381184 13297 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 1486275842257420551 0 0 17 7 0 0 0
/proc/21648/statm: 85054 13297 370 364 0 20963 0
[pid=21651] ppid=21648 vsize=294580 CPUtime=8.01 cores=1,3,5,7
/proc/21651/stat : 21651 (cryptominisat-2) R 21648 21651 21651 0 -1 4202496 61220 0 0 0 792 9 0 0 25 0 1 0 538589803 301649920 59906 33554432000 4194304 4677096 140737290387184 18446744073709551615 4564191 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21651/statm: 73645 59906 379 118 0 68604 0
[pid=21633/tid=21641] ppid=21631 vsize=350460 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21641/stat : 21641 (python) S 21631 21633 21052 0 -1 4202560 25 934 0 0 0 0 0 0 25 0 5 0 538589795 358871040 14812 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 5 0 0 0
[pid=21633/tid=21644] ppid=21631 vsize=350460 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21644/stat : 21644 (python) S 21631 21633 21052 0 -1 4202560 21 934 0 0 0 0 0 0 20 0 5 0 538589798 358871040 14812 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 1 0 0 0
[pid=21633/tid=21647] ppid=21631 vsize=350460 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21647/stat : 21647 (python) S 21631 21633 21052 0 -1 4202560 40 934 0 0 0 0 0 0 22 0 5 0 538589800 358871040 14812 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 1 0 0 0
[pid=21633/tid=21649] ppid=21631 vsize=350460 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21649/stat : 21649 (python) S 21631 21633 21052 0 -1 4202560 18 934 0 0 0 0 0 0 25 0 5 0 538589803 358871040 14812 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 58.28
Current children cumulated vsize (KiB) 2287252

[startup+51.1009 s]
/proc/loadavg: 8.96 7.28 5.98 10/219 21652
/proc/meminfo: memFree=26956592/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=350460 CPUtime=8.77 cores=1,3,5,7
/proc/21633/stat : 21633 (python) S 21631 21633 21052 0 -1 4202496 24183 934 1 0 863 14 0 0 24 0 5 0 538588899 358871040 14812 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21633/statm: 87615 14812 1881 364 0 23524 0
[pid=21640] ppid=21633 vsize=309448 CPUtime=0.05 cores=1,3,5,7
/proc/21640/stat : 21640 (python) S 21633 21633 21052 0 -1 4202560 1003 0 0 0 3 2 0 0 18 0 1 0 538589795 316874752 13296 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557711 0 0 16781312 514 17585888041812066568 0 0 17 7 0 0 0
/proc/21640/statm: 77362 13296 381 364 0 13280 0
[pid=21642] ppid=21640 vsize=23524 CPUtime=42.12 cores=1,3,5,7
/proc/21642/stat : 21642 (lingeling) R 21640 21642 21642 0 -1 4202496 10071 0 0 0 4211 1 0 0 25 0 1 0 538589795 24088576 5051 33554432000 4194304 4352236 140735822302960 18446744073709551615 4276696 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/21642/statm: 5881 5051 129 39 0 4961 0
[pid=21643] ppid=21633 vsize=319704 CPUtime=0.06 cores=1,3,5,7
/proc/21643/stat : 21643 (python) S 21633 21633 21052 0 -1 4202560 929 0 0 0 4 2 0 0 15 0 1 0 538589797 327376896 13289 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 4470070849210122504 0 0 17 1 0 0 0
/proc/21643/statm: 79926 13289 370 364 0 15841 0
[pid=21645] ppid=21643 vsize=320116 CPUtime=21.28 cores=1,3,5,7
/proc/21645/stat : 21645 (cryptominisat-2) R 21643 21645 21645 0 -1 4202496 71967 0 0 0 2117 11 0 0 25 0 1 0 538589798 327798784 66374 33554432000 4194304 4677096 140735565166432 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21645/statm: 80029 66374 393 118 0 74988 0
[pid=21646] ppid=21633 vsize=329960 CPUtime=0.05 cores=1,3,5,7
/proc/21646/stat : 21646 (python) S 21633 21633 21052 0 -1 4202560 949 0 0 0 3 2 0 0 18 0 1 0 538589800 337879040 13293 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 17585888041812066564 0 0 17 7 0 0 0
/proc/21646/statm: 82490 13293 370 364 0 18402 0
[pid=21650] ppid=21646 vsize=27600 CPUtime=41.98 cores=1,3,5,7
/proc/21650/stat : 21650 (lingeling) R 21646 21650 21650 0 -1 4202496 10065 0 0 0 4197 1 0 0 25 0 1 0 538589803 28262400 6070 33554432000 4194304 4352236 140736770542160 18446744073709551615 4328859 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21650/statm: 6900 6070 129 39 0 5980 0
[pid=21648] ppid=21633 vsize=340216 CPUtime=0.05 cores=1,3,5,7
/proc/21648/stat : 21648 (python) S 21633 21633 21052 0 -1 4202560 935 0 0 0 3 2 0 0 15 0 1 0 538589802 348381184 13297 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 1486275842257420551 0 0 17 7 0 0 0
/proc/21648/statm: 85054 13297 370 364 0 20963 0

################
# More data... #
################

Current children cumulated vsize (KiB) 3975704

[startup+1242.3 s]
/proc/loadavg: 8.88 8.60 7.97 10/232 21848
/proc/meminfo: memFree=26149420/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=381228 CPUtime=8.89 cores=1,3,5,7
/proc/21633/stat : 21633 (python) S 21631 21633 21052 0 -1 4202496 26750 934 1 0 874 15 0 0 19 0 8 0 538588899 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21633/statm: 95307 14831 1888 364 0 31207 0
[pid=21640] ppid=21633 vsize=319692 CPUtime=1.76 cores=1,3,5,7
/proc/21640/stat : 21640 (python) S 21633 21633 21052 0 -1 4202560 1220 0 0 0 84 92 0 0 18 0 2 0 538589795 327364608 13335 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/21640/statm: 79923 13335 415 364 0 15841 0
[pid=21642] ppid=21640 vsize=53660 CPUtime=885.76 cores=1,3,5,7
/proc/21642/stat : 21642 (lingeling) R 21640 21642 21642 0 -1 4202496 57543 0 0 0 88569 7 0 0 25 0 1 0 538589795 54947840 12585 33554432000 4194304 4352236 140735822302960 18446744073709551615 4328085 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/21642/statm: 13415 12585 129 39 0 12495 0
[pid=21640/tid=21654] ppid=21633 vsize=319692 CPUtime=0 cores=1,3,5,7
/proc/21640/task/21654/stat : 21654 (python) S 21633 21633 21052 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538599809 327364608 13335 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 514 18446604471133332800 0 0 -1 7 0 0 0
[pid=21643] ppid=21633 vsize=319704 CPUtime=0.83 cores=1,3,5,7
/proc/21643/stat : 21643 (python) S 21633 21633 21052 0 -1 4202560 1145 0 0 0 44 39 0 0 16 0 2 0 538589797 327376896 13320 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/21643/statm: 79926 13320 400 364 0 15841 0
[pid=21645] ppid=21643 vsize=433364 CPUtime=488.3 cores=1,3,5,7
/proc/21645/stat : 21645 (cryptominisat-2) T 21643 21645 21645 0 -1 4202496 219576 0 0 0 48777 53 0 0 25 0 1 0 538589798 443764736 93061 33554432000 4194304 4677096 140735565166432 18446744073709551615 4319756 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/21645/statm: 108341 93061 393 118 0 103300 0
[pid=21643/tid=21680] ppid=21633 vsize=319704 CPUtime=0 cores=1,3,5,7
/proc/21643/task/21680/stat : 21680 (python) S 21633 21633 21052 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 538644080 327376896 13320 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 514 18446604471133331904 0 0 -1 1 0 0 0
[pid=21646] ppid=21633 vsize=329960 CPUtime=1.78 cores=1,3,5,7
/proc/21646/stat : 21646 (python) S 21633 21633 21052 0 -1 4202560 1003 0 0 0 88 90 0 0 18 0 1 0 538589800 337879040 13293 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 17585888041812066564 0 0 17 7 0 0 0
/proc/21646/statm: 82490 13293 370 364 0 18402 0
[pid=21650] ppid=21646 vsize=58132 CPUtime=1001.15 cores=1,3,5,7
/proc/21650/stat : 21650 (lingeling) R 21646 21650 21650 0 -1 4202496 66980 0 0 0 100107 8 0 0 25 0 1 0 538589803 59527168 13703 33554432000 4194304 4352236 140736770542160 18446744073709551615 4329086 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21650/statm: 14533 13703 129 39 0 13613 0
[pid=21648] ppid=21633 vsize=340216 CPUtime=1.84 cores=1,3,5,7
/proc/21648/stat : 21648 (python) S 21633 21633 21052 0 -1 4202560 1010 0 0 0 88 96 0 0 15 0 1 0 538589802 348381184 13298 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 17585888041812066567 0 0 17 7 0 0 0
/proc/21648/statm: 85054 13298 371 364 0 20963 0
[pid=21651] ppid=21648 vsize=529408 CPUtime=1171.03 cores=1,3,5,7
/proc/21651/stat : 21651 (cryptominisat-2) R 21648 21651 21651 0 -1 4202496 331266 0 0 0 117006 97 0 0 25 0 1 0 538589803 542113792 118138 33554432000 4194304 4677096 140737290387184 18446744073709551615 4319584 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21651/statm: 132352 118138 393 118 0 127311 0
[pid=21681] ppid=21633 vsize=350472 CPUtime=0.29 cores=1,3,5,7
/proc/21681/stat : 21681 (python) S 21633 21633 21052 0 -1 4202560 1170 0 0 0 15 14 0 0 18 0 2 0 538644082 358883328 13331 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/21681/statm: 87618 13331 399 364 0 23524 0
[pid=21683] ppid=21681 vsize=33620 CPUtime=195.77 cores=1,3,5,7
/proc/21683/stat : 21683 (lingeling) T 21681 21683 21683 0 -1 4202496 17717 0 0 0 19575 2 0 0 25 0 1 0 538644082 34426880 7574 33554432000 4194304 4352236 140735502819520 18446744073709551615 4276757 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/21683/statm: 8405 7574 129 39 0 7485 0
[pid=21681/tid=21688] ppid=21633 vsize=350472 CPUtime=0 cores=1,3,5,7
/proc/21681/task/21688/stat : 21688 (python) S 21633 21633 21052 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 538654096 358883328 13331 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 514 18446604463712010368 0 0 -1 7 0 0 0
[pid=21693] ppid=21633 vsize=360728 CPUtime=0.28 cores=1,3,5,7
/proc/21693/stat : 21693 (python) S 21633 21633 21052 0 -1 4202560 1149 0 0 0 15 13 0 0 19 0 2 0 538663915 369385472 13335 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/21693/statm: 90182 13335 399 364 0 26085 0
[pid=21695] ppid=21693 vsize=48600 CPUtime=97.14 cores=1,3,5,7
/proc/21695/stat : 21695 (SApperloT-base) T 21693 21695 21695 0 -1 4202496 11692 0 0 0 9709 5 0 0 25 0 1 0 538663915 49766400 11327 33554432000 134512640 135674940 4289430976 18446744073709551615 134564255 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/21695/statm: 12150 11327 100 284 0 11864 0
[pid=21693/tid=21778] ppid=21633 vsize=360728 CPUtime=0 cores=1,3,5,7
/proc/21693/task/21778/stat : 21778 (python) S 21633 21633 21052 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 538683342 369385472 13335 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 514 18446604468682723776 0 0 -1 7 0 0 0
[pid=21779] ppid=21633 vsize=370984 CPUtime=0.44 cores=1,3,5,7
/proc/21779/stat : 21779 (python) S 21633 21633 21052 0 -1 4202560 1006 0 0 0 21 23 0 0 18 0 1 0 538683344 379887616 13309 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 17585888041812066565 0 0 17 7 0 0 0
/proc/21779/statm: 92746 13309 370 364 0 28646 0
[pid=21781] ppid=21779 vsize=49008 CPUtime=166.62 cores=1,3,5,7
/proc/21781/stat : 21781 (precosat) R 21779 21781 21781 0 -1 4202496 12613 0 0 0 16660 2 0 0 25 0 1 0 538683344 50184192 11542 33554432000 4194304 4890832 140734023205680 18446744073709551615 4238265 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/21781/statm: 12252 11542 86 171 0 12079 0
[pid=21633/tid=21641] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21641/stat : 21641 (python) S 21631 21633 21052 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 8 0 538589795 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 5 0 0 0
[pid=21633/tid=21644] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21644/stat : 21644 (python) S 21631 21633 21052 0 -1 4202560 21 934 0 0 0 0 0 0 20 0 8 0 538589798 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 1 0 0 0
[pid=21633/tid=21647] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21647/stat : 21647 (python) S 21631 21633 21052 0 -1 4202560 40 934 0 0 0 0 0 0 22 0 8 0 538589800 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 1 0 0 0
[pid=21633/tid=21649] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21649/stat : 21649 (python) S 21631 21633 21052 0 -1 4202560 18 934 0 0 0 0 0 0 25 0 8 0 538589803 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 7 0 0 0
[pid=21633/tid=21682] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21682/stat : 21682 (python) S 21631 21633 21052 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 8 0 538644082 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 7 0 0 0
[pid=21633/tid=21694] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21694/stat : 21694 (python) S 21631 21633 21052 0 -1 4202560 32 934 0 0 0 0 0 0 20 0 8 0 538663915 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 7 0 0 0
[pid=21633/tid=21780] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21780/stat : 21780 (python) S 21631 21633 21052 0 -1 4202560 31 934 0 0 0 0 0 0 20 0 8 0 538683344 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4021.88
Current children cumulated vsize (KiB) 3978776



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 9.04 8.69 8.04 10/236 21854
/proc/meminfo: memFree=25954056/32951124 swapFree=67111336/67111528
[pid=21633] ppid=21631 vsize=381228 CPUtime=8.89 cores=1,3,5,7
/proc/21633/stat : 21633 (python) S 21631 21633 21052 0 -1 4202496 26750 934 1 0 874 15 0 0 19 0 8 0 538588899 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/21633/statm: 95307 14831 1888 364 0 31207 0
[pid=21640] ppid=21633 vsize=319692 CPUtime=1.85 cores=1,3,5,7
/proc/21640/stat : 21640 (python) S 21633 21633 21052 0 -1 4202560 1220 0 0 0 89 96 0 0 18 0 2 0 538589795 327364608 13335 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/21640/statm: 79923 13335 415 364 0 15841 0
[pid=21642] ppid=21640 vsize=44444 CPUtime=914.65 cores=1,3,5,7
/proc/21642/stat : 21642 (lingeling) R 21640 21642 21642 0 -1 4202496 57799 0 0 0 91458 7 0 0 25 0 1 0 538589795 45510656 10281 33554432000 4194304 4352236 140735822302960 18446744073709551615 4328390 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/21642/statm: 11111 10281 129 39 0 10191 0
[pid=21640/tid=21654] ppid=21633 vsize=319692 CPUtime=0 cores=1,3,5,7
/proc/21640/task/21654/stat : 21654 (python) S 21633 21633 21052 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538599809 327364608 13335 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 514 18446604471133332800 0 0 -1 7 0 0 0
[pid=21643] ppid=21633 vsize=319704 CPUtime=0.83 cores=1,3,5,7
/proc/21643/stat : 21643 (python) S 21633 21633 21052 0 -1 4202560 1145 0 0 0 44 39 0 0 16 0 2 0 538589797 327376896 13320 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/21643/statm: 79926 13320 400 364 0 15841 0
[pid=21645] ppid=21643 vsize=433364 CPUtime=488.3 cores=1,3,5,7
/proc/21645/stat : 21645 (cryptominisat-2) T 21643 21645 21645 0 -1 4202496 219576 0 0 0 48777 53 0 0 25 0 1 0 538589798 443764736 93061 33554432000 4194304 4677096 140735565166432 18446744073709551615 4319756 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/21645/statm: 108341 93061 393 118 0 103300 0
[pid=21643/tid=21680] ppid=21633 vsize=319704 CPUtime=0 cores=1,3,5,7
/proc/21643/task/21680/stat : 21680 (python) S 21633 21633 21052 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 538644080 327376896 13320 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 514 18446604471133331904 0 0 -1 1 0 0 0
[pid=21646] ppid=21633 vsize=329960 CPUtime=1.87 cores=1,3,5,7
/proc/21646/stat : 21646 (python) S 21633 21633 21052 0 -1 4202560 1003 0 0 0 92 95 0 0 18 0 1 0 538589800 337879040 13293 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 17585888041812066564 0 0 17 7 0 0 0
/proc/21646/statm: 82490 13293 370 364 0 18402 0
[pid=21650] ppid=21646 vsize=61204 CPUtime=1058.86 cores=1,3,5,7
/proc/21650/stat : 21650 (lingeling) R 21646 21650 21650 0 -1 4202496 69796 0 0 0 105877 9 0 0 25 0 1 0 538589803 62672896 14471 33554432000 4194304 4352236 140736770542160 18446744073709551615 4327867 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21650/statm: 15301 14471 129 39 0 14381 0
[pid=21648] ppid=21633 vsize=340216 CPUtime=1.91 cores=1,3,5,7
/proc/21648/stat : 21648 (python) S 21633 21633 21052 0 -1 4202560 1010 0 0 0 92 99 0 0 15 0 1 0 538589802 348381184 13298 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 17585888041812066567 0 0 17 7 0 0 0
/proc/21648/statm: 85054 13298 371 364 0 20963 0
[pid=21651] ppid=21648 vsize=511676 CPUtime=1199.84 cores=1,3,5,7
/proc/21651/stat : 21651 (cryptominisat-2) R 21648 21651 21651 0 -1 4202496 334157 0 0 0 119886 98 0 0 25 0 1 0 538589803 523956224 111823 33554432000 4194304 4677096 140737290387184 18446744073709551615 4320199 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/21651/statm: 127919 111823 393 118 0 122878 0
[pid=21681] ppid=21633 vsize=350472 CPUtime=0.29 cores=1,3,5,7
/proc/21681/stat : 21681 (python) S 21633 21633 21052 0 -1 4202560 1170 0 0 0 15 14 0 0 18 0 2 0 538644082 358883328 13331 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/21681/statm: 87618 13331 399 364 0 23524 0
[pid=21683] ppid=21681 vsize=33620 CPUtime=195.77 cores=1,3,5,7
/proc/21683/stat : 21683 (lingeling) T 21681 21683 21683 0 -1 4202496 17717 0 0 0 19575 2 0 0 25 0 1 0 538644082 34426880 7574 33554432000 4194304 4352236 140735502819520 18446744073709551615 4276757 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/21683/statm: 8405 7574 129 39 0 7485 0
[pid=21681/tid=21688] ppid=21633 vsize=350472 CPUtime=0 cores=1,3,5,7
/proc/21681/task/21688/stat : 21688 (python) S 21633 21633 21052 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 538654096 358883328 13331 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 514 18446604463712010368 0 0 -1 7 0 0 0
[pid=21693] ppid=21633 vsize=360728 CPUtime=0.28 cores=1,3,5,7
/proc/21693/stat : 21693 (python) S 21633 21633 21052 0 -1 4202560 1149 0 0 0 15 13 0 0 19 0 2 0 538663915 369385472 13335 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/21693/statm: 90182 13335 399 364 0 26085 0
[pid=21695] ppid=21693 vsize=48600 CPUtime=97.14 cores=1,3,5,7
/proc/21695/stat : 21695 (SApperloT-base) T 21693 21695 21695 0 -1 4202496 11692 0 0 0 9709 5 0 0 25 0 1 0 538663915 49766400 11327 33554432000 134512640 135674940 4289430976 18446744073709551615 134564255 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/21695/statm: 12150 11327 100 284 0 11864 0
[pid=21693/tid=21778] ppid=21633 vsize=360728 CPUtime=0 cores=1,3,5,7
/proc/21693/task/21778/stat : 21778 (python) S 21633 21633 21052 0 -1 4202560 51 0 0 0 0 0 0 0 19 0 2 0 538683342 369385472 13335 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 514 18446604468682723776 0 0 -1 7 0 0 0
[pid=21779] ppid=21633 vsize=370984 CPUtime=0.53 cores=1,3,5,7
/proc/21779/stat : 21779 (python) S 21633 21633 21052 0 -1 4202560 1006 0 0 0 26 27 0 0 18 0 1 0 538683344 379887616 13309 33554432000 4194304 5683644 140735369536448 18446744073709551615 271550557766 0 0 16781312 514 17585888041812066565 0 0 17 7 0 0 0
/proc/21779/statm: 92746 13309 370 364 0 28646 0
[pid=21781] ppid=21779 vsize=49008 CPUtime=223.54 cores=1,3,5,7
/proc/21781/stat : 21781 (precosat) R 21779 21781 21781 0 -1 4202496 14947 0 0 0 22352 2 0 0 25 0 1 0 538683344 50184192 11542 33554432000 4194304 4890832 140734023205680 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/21781/statm: 12252 11542 86 171 0 12079 0
[pid=21633/tid=21641] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21641/stat : 21641 (python) S 21631 21633 21052 0 -1 4202560 30 934 0 0 0 0 0 0 18 0 8 0 538589795 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 5 0 0 0
[pid=21633/tid=21644] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21644/stat : 21644 (python) S 21631 21633 21052 0 -1 4202560 21 934 0 0 0 0 0 0 20 0 8 0 538589798 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 1 0 0 0
[pid=21633/tid=21647] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21647/stat : 21647 (python) S 21631 21633 21052 0 -1 4202560 40 934 0 0 0 0 0 0 22 0 8 0 538589800 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 1 0 0 0
[pid=21633/tid=21649] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21649/stat : 21649 (python) S 21631 21633 21052 0 -1 4202560 18 934 0 0 0 0 0 0 25 0 8 0 538589803 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 7 0 0 0
[pid=21633/tid=21682] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21682/stat : 21682 (python) S 21631 21633 21052 0 -1 4202560 29 934 0 0 0 0 0 0 18 0 8 0 538644082 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 7 0 0 0
[pid=21633/tid=21694] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21694/stat : 21694 (python) S 21631 21633 21052 0 -1 4202560 32 934 0 0 0 0 0 0 20 0 8 0 538663915 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 7 0 0 0
[pid=21633/tid=21780] ppid=21631 vsize=381228 CPUtime=0 cores=1,3,5,7
/proc/21633/task/21780/stat : 21780 (python) S 21631 21633 21052 0 -1 4202560 31 934 0 0 0 0 0 0 20 0 8 0 538683344 390377472 14831 33554432000 4194304 5683644 140735369536448 18446744073709551615 271562361265 0 0 16781312 2 18446604468682724672 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4194.55
Current children cumulated vsize (KiB) 3954900

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21633 and gives
#  childrusage.ru_utime.tv_sec=8
#  childrusage.ru_utime.tv_usec=743670
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=153976
# CPU time returned by wait4() is 8.89765
# while last known CPU time is 4194.55
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.05
CPU time (s): 4194.55
CPU user time (s): 4188.81
CPU system time (s): 5.74
CPU usage (%): 322.644
Max. virtual memory (cumulated for all children) (KiB): 4070936

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 8.74367
system time used= 0.153976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 27689
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2903
involuntary context switches= 56

runsolver used 2.67259 second user time and 6.10207 second system time

The end

Launcher Data 

Begin job on node133 at 2011-05-01 19:11:50
IDJOB=3317901
IDBENCH=83115
IDSOLVER=1706
FILE ID=node133/3317901-1304269910
RUNJOBID= node133-1304267282-21071
PBS_JOBID= 13173946
Free space on /tmp= 72848 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top21.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317901-1304269910/watcher-3317901-1304269910 -o /tmp/evaluation-result-3317901-1304269910/solver-3317901-1304269910 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317901-1304269910.cnf -seed 26425585 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9fab5edd49fb904ff76ff7abf98e0d14
RANDOM SEED=26425585

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27567044 kB
Buffers:        571308 kB
Cached:        1343268 kB
SwapCached:        124 kB
Active:        3317092 kB
Inactive:      1706496 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27567044 kB
SwapTotal:    67111528 kB
SwapFree:     67111336 kB
Dirty:           34552 kB
Writeback:           0 kB
AnonPages:     3108740 kB
Mapped:          23408 kB
Slab:           285052 kB
PageTables:      16532 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  4534020 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72800 MiB
End job on node133 at 2011-05-01 19:33:32