Trace number 3317713

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4395.44 1300.09

General information on the benchmark

NameSAT03/industrial/schuppan/l2s/
bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf
MD5SUMf16626953757fdd1326f2a14f01adca9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1015.28
Satisfiable
(Un)Satisfiability was proved
Number of variables435701
Number of clauses1379987
Sum of the clauses size3544455
Maximum clause length304
Minimum clause length1
Number of clauses of size 1142
Number of clauses of size 2654099
Number of clauses of size 3705129
Number of clauses of size 412732
Number of clauses of size 54852
Number of clauses of size over 53033

Solver Data 

0.31/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.31/0.47	c INFO: solving HOME/instance-3317713-1304270945.cnf
0.31/0.47	c INFO: computing task features
6.01/6.16	c INFO: computed variable-clause graph statistics
6.21/6.37	c INFO: computed clause balance statistics
29.41/29.56	c INFO: computed variable balance statistics
46.81/46.94	c INFO: computed small-clause counts
47.41/47.56	c INFO: computed Horn-clause counts
264.11/264.24	c INFO: computed variable graph statistics
264.11/264.24	c INFO: collected features for HOME/instance-3317713-1304270945.cnf in 263.61 s
264.11/264.26	c INFO: running lingeling-276@0 for 194 with 4536 remaining (b = 0.83)
264.11/264.29	c INFO: running lingeling-276@0 for 97 with 4536 remaining (b = 0.67)
264.21/264.32	c INFO: running cryptominisat-2.9.0@0 for 582 with 4536 remaining (b = 0.44)
264.21/264.35	c INFO: running lingeling-276@0 for 873 with 4536 remaining (b = 0.42)
664.17/364.50	c INFO: running cryptominisat-2.9.0@0 for 485 with 4435 remaining (b = 0.32)
1047.83/460.61	c INFO: running lingeling-276@0 for 388 with 4339 remaining (b = 0.24)
2611.28/852.23	c INFO: running precosat-570@0 for 97 with 3948 remaining (b = 0.55)
2617.26/853.79	c INFO: running lingeling-276@390 for 97 with 3946 remaining (b = 0.04)
2639.99/859.49	c INFO: running precosat-570@0 for 388 with 3940 remaining (b = 0.23)
2993.16/947.97	c INFO: running lingeling-276@0 for 97 with 3852 remaining (b = 0.05)
3011.08/952.46	c INFO: running precosat-570@586 for 97 with 3848 remaining (b = 0.05)
3390.23/1047.64	c INFO: running cryptominisat-2.9.0@0 for 97 with 3752 remaining (b = 0.05)
3392.21/1048.20	c INFO: running lingeling-276@879 for 194 with 3752 remaining (b = 0.08)
3774.11/1144.00	c INFO: running cryptominisat-2.9.0@195 for 1746 with 3656 remaining (b = 0.49)
3778.90/1145.29	c INFO: running cryptominisat-2.9.0@0 for 1746 with 3655 remaining (b = 0.46)
4186.32/1247.56	c INFO: running cryptominisat-2.9.0@98 for 1649 with 3552 remaining (b = 0.42)
4213.42/1254.38	c INFO: running precosat-570@681 for 97 with 3546 remaining (b = 0.07)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317713-1304270945/watcher-3317713-1304270945 -o /tmp/evaluation-result-3317713-1304270945/solver-3317713-1304270945 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317713-1304270945.cnf -seed 101583788 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.84 6.29 7.24 2/221 14507
/proc/meminfo: memFree=27908732/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=15772 CPUtime=0 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 854 0 0 0 0 0 0 0 17 0 1 0 538695632 16150528 736 33554432000 4194304 5683644 140734110434160 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 3942 735 334 364 0 429 0

[startup+0.04928 s]
/proc/loadavg: 3.84 6.29 7.24 2/221 14507
/proc/meminfo: memFree=27908732/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=29792 CPUtime=0.03 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 1456 0 0 0 3 0 0 0 17 0 1 0 538695632 30507008 1296 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613110416 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 7448 1296 443 364 0 818 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 29792

[startup+0.100256 s]
/proc/loadavg: 3.84 6.29 7.24 2/221 14507
/proc/meminfo: memFree=27908732/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=104224 CPUtime=0.06 cores=0,2,4,6
/proc/14507/stat : 14507 (python) S 14505 14507 13600 0 -1 4202496 3037 0 0 0 5 1 0 0 17 0 1 0 538695632 106725376 2726 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613108736 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/14507/statm: 26056 2726 847 364 0 1804 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 104224

[startup+0.300225 s]
/proc/loadavg: 3.84 6.29 7.24 2/221 14507
/proc/meminfo: memFree=27908732/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=166548 CPUtime=0.23 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 6683 931 1 0 17 6 0 0 17 0 1 0 538695632 170545152 4773 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613108736 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 41637 4773 1322 364 0 3454 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 166548

[startup+0.701173 s]
/proc/loadavg: 3.84 6.29 7.24 2/221 14507
/proc/meminfo: memFree=27908732/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=320100 CPUtime=0.61 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 19537 931 1 0 51 10 0 0 17 0 1 0 538695632 327782400 17217 33554432000 4194304 5683644 140734110434160 18446744073709551615 270612771873 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 80025 17219 1761 364 0 15949 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 320100

[startup+1.50099 s]
/proc/loadavg: 3.84 6.29 7.24 3/222 14512
/proc/meminfo: memFree=27762776/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=373928 CPUtime=1.41 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 32630 931 1 0 129 12 0 0 18 0 1 0 538695632 382902272 30310 33554432000 4194304 5683644 140734110434160 18446744073709551615 270612771525 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 93482 30310 1761 364 0 29406 0
Current children cumulated CPU time (s) 1.41
Current children cumulated vsize (KiB) 373928

[startup+3.10072 s]
/proc/loadavg: 3.84 6.29 7.24 3/222 14512
/proc/meminfo: memFree=27630096/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=481340 CPUtime=3 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 58776 931 1 0 285 15 0 0 22 0 1 0 538695632 492892160 56456 33554432000 4194304 5683644 140734110434160 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 120335 56456 1761 364 0 56259 0
Current children cumulated CPU time (s) 3
Current children cumulated vsize (KiB) 481340

[startup+6.30118 s]
/proc/loadavg: 3.78 6.24 7.22 3/222 14512
/proc/meminfo: memFree=27438708/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=576888 CPUtime=6.21 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 117901 931 1 0 597 24 0 0 25 0 1 0 538695632 590733312 81598 33554432000 4194304 5683644 140734110434160 18446744073709551615 47773597851288 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 144222 81598 1818 364 0 80146 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 576888

[startup+12.701 s]
/proc/loadavg: 3.63 6.17 7.19 3/222 14512
/proc/meminfo: memFree=27438604/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=576888 CPUtime=12.61 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 117909 931 1 0 1237 24 0 0 25 0 1 0 538695632 590733312 81606 33554432000 4194304 5683644 140734110434160 18446744073709551615 47773565500924 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 144222 81606 1826 364 0 80146 0
Current children cumulated CPU time (s) 12.61
Current children cumulated vsize (KiB) 576888

[startup+25.5008 s]
/proc/loadavg: 3.27 5.96 7.10 3/222 14513
/proc/meminfo: memFree=27439192/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=576888 CPUtime=25.41 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 117909 931 1 0 2517 24 0 0 25 0 1 0 538695632 590733312 81606 33554432000 4194304 5683644 140734110434160 18446744073709551615 47773567981509 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 144222 81606 1826 364 0 80146 0
Current children cumulated CPU time (s) 25.41
Current children cumulated vsize (KiB) 576888

[startup+51.1002 s]
/proc/loadavg: 2.84 5.64 6.97 3/222 14513
/proc/meminfo: memFree=27438504/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=576888 CPUtime=51.01 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 117916 931 1 0 5077 24 0 0 25 0 1 0 538695632 590733312 81613 33554432000 4194304 5683644 140734110434160 18446744073709551615 47773565204608 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 144222 81613 1833 364 0 80146 0
Current children cumulated CPU time (s) 51.01
Current children cumulated vsize (KiB) 576888

[startup+102.3 s]
/proc/loadavg: 2.36 5.08 6.70 3/222 14515
/proc/meminfo: memFree=27437992/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=576888 CPUtime=102.21 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 117916 931 1 0 10197 24 0 0 25 0 1 0 538695632 590733312 81613 33554432000 4194304 5683644 140734110434160 18446744073709551615 47773565204608 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 144222 81613 1833 364 0 80146 0
Current children cumulated CPU time (s) 102.21
Current children cumulated vsize (KiB) 576888

[startup+162.301 s]
/proc/loadavg: 4.12 5.09 6.61 6/234 14528
/proc/meminfo: memFree=25924436/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=576888 CPUtime=162.21 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 117916 931 1 0 16197 24 0 0 25 0 1 0 538695632 590733312 81613 33554432000 4194304 5683644 140734110434160 18446744073709551615 47773565204620 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 144222 81613 1833 364 0 80146 0
Current children cumulated CPU time (s) 162.21
Current children cumulated vsize (KiB) 576888

[startup+222.301 s]
/proc/loadavg: 4.72 5.09 6.51 6/235 14531
/proc/meminfo: memFree=25191564/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=576888 CPUtime=222.21 cores=0,2,4,6
/proc/14507/stat : 14507 (python) R 14505 14507 13600 0 -1 4202496 117916 931 1 0 22197 24 0 0 25 0 1 0 538695632 590733312 81613 33554432000 4194304 5683644 140734110434160 18446744073709551615 47773565204608 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14507/statm: 144222 81613 1833 364 0 80146 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 576888

[startup+282.309 s]
/proc/loadavg: 5.86 5.29 6.48 9/247 14544
/proc/meminfo: memFree=23854572/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=595220 CPUtime=264.27 cores=0,2,4,6
/proc/14507/stat : 14507 (python) S 14505 14507 13600 0 -1 4202496 120625 931 1 0 26399 28 0 0 22 0 5 0 538695632 609505280 76001 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624937419 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14507/statm: 148805 76001 1881 364 0 84714 0
[pid=14533] ppid=14507 vsize=554208 CPUtime=0.03 cores=0,2,4,6
/proc/14533/stat : 14533 (python) S 14507 14507 13600 0 -1 4202560 978 0 0 0 1 2 0 0 18 0 1 0 538722058 567508992 74485 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130767 0 0 16781312 514 2546996695510515971 0 0 17 6 0 0 0
/proc/14533/statm: 138552 74485 381 364 0 74470 0
[pid=14535] ppid=14533 vsize=134448 CPUtime=17.99 cores=0,2,4,6
/proc/14535/stat : 14535 (lingeling) R 14533 14535 14535 0 -1 4202496 56823 0 0 0 1790 9 0 0 25 0 1 0 538722059 137674752 30733 33554432000 4194304 4352236 140733589829904 18446744073709551615 4267820 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/14535/statm: 33612 30733 127 39 0 32692 0
[pid=14536] ppid=14507 vsize=564464 CPUtime=0.03 cores=0,2,4,6
/proc/14536/stat : 14536 (python) S 14507 14507 13600 0 -1 4202560 897 0 0 0 1 2 0 0 18 0 1 0 538722061 578011136 74478 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130822 0 0 16781312 514 2546996695510515970 0 0 17 0 0 0 0
/proc/14536/statm: 141116 74478 370 364 0 77031 0
[pid=14538] ppid=14536 vsize=134456 CPUtime=17.92 cores=0,2,4,6
/proc/14538/stat : 14538 (lingeling) R 14536 14538 14538 0 -1 4202496 56825 0 0 0 1784 8 0 0 25 0 1 0 538722064 137682944 30735 33554432000 4194304 4352236 140737093052208 18446744073709551615 4309476 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/14538/statm: 33614 30735 127 39 0 32694 0
[pid=14539] ppid=14507 vsize=574720 CPUtime=0.02 cores=0,2,4,6
/proc/14539/stat : 14539 (python) S 14507 14507 13600 0 -1 4202560 936 0 0 0 1 1 0 0 15 0 1 0 538722064 588513280 74482 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130822 0 0 16781312 514 2546996695510515971 0 0 17 4 0 0 0
/proc/14539/statm: 143680 74482 370 364 0 79592 0
[pid=14541] ppid=14539 vsize=656648 CPUtime=17.79 cores=0,2,4,6
/proc/14541/stat : 14541 (cryptominisat-2) R 14539 14541 14541 0 -1 4202496 134835 0 0 0 1760 19 0 0 25 0 1 0 538722065 672407552 125760 33554432000 4194304 4677096 140736976045328 18446744073709551615 4319643 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/14541/statm: 164162 125760 361 118 0 159121 0
[pid=14542] ppid=14507 vsize=584976 CPUtime=0.03 cores=0,2,4,6
/proc/14542/stat : 14542 (python) S 14507 14507 13600 0 -1 4202560 936 0 0 0 1 2 0 0 18 0 1 0 538722067 599015424 74486 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130822 0 0 16781312 514 2546996695510515971 0 0 17 0 0 0 0
/proc/14542/statm: 146244 74486 370 364 0 82153 0
[pid=14544] ppid=14542 vsize=134472 CPUtime=17.92 cores=0,2,4,6
/proc/14544/stat : 14544 (lingeling) R 14542 14544 14544 0 -1 4202496 56830 0 0 0 1785 7 0 0 25 0 1 0 538722069 137699328 30739 33554432000 4194304 4352236 140733501870784 18446744073709551615 4228457 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/14544/statm: 33618 30739 127 39 0 32698 0
[pid=14507/tid=14534] ppid=14505 vsize=595220 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14534/stat : 14534 (python) S 14505 14507 13600 0 -1 4202560 24 931 0 0 0 0 0 0 25 0 5 0 538722059 609505280 76001 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 6 0 0 0
[pid=14507/tid=14537] ppid=14505 vsize=595220 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14537/stat : 14537 (python) S 14505 14507 13600 0 -1 4202560 28 931 0 0 0 0 0 0 25 0 5 0 538722062 609505280 76001 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14540] ppid=14505 vsize=595220 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14540/stat : 14540 (python) S 14505 14507 13600 0 -1 4202560 23 931 0 0 0 0 0 0 20 0 5 0 538722065 609505280 76001 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14543] ppid=14505 vsize=595220 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14543/stat : 14543 (python) S 14505 14507 13600 0 -1 4202560 29 931 0 0 0 0 0 0 22 0 5 0 538722068 609505280 76001 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 336
Current children cumulated vsize (KiB) 3933612

[startup+342.301 s]
/proc/loadavg: 7.26 5.80 6.58 9/247 14546
/proc/meminfo: memFree=23167560/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=595220 CPUtime=264.27 cores=0,2,4,6
/proc/14507/stat : 14507 (python) S 14505 14507 13600 0 -1 4202496 120625 931 1 0 26399 28 0 0 22 0 5 0 538695632 609505280 76001 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624937419 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14507/statm: 148805 76001 1881 364 0 84714 0
[pid=14533] ppid=14507 vsize=554208 CPUtime=0.12 cores=0,2,4,6
/proc/14533/stat : 14533 (python) S 14507 14507 13600 0 -1 4202560 1005 0 0 0 6 6 0 0 18 0 1 0 538722058 567508992 74485 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130767 0 0 16781312 514 2546996695510515971 0 0 17 6 0 0 0
/proc/14533/statm: 138552 74485 381 364 0 74470 0
[pid=14535] ppid=14533 vsize=94752 CPUtime=77.86 cores=0,2,4,6
/proc/14535/stat : 14535 (lingeling) R 14533 14535 14535 0 -1 4202496 57665 0 0 0 7777 9 0 0 25 0 1 0 538722059 97026048 20811 33554432000 4194304 4352236 140733589829904 18446744073709551615 4328351 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/14535/statm: 23688 20811 129 39 0 22768 0
[pid=14536] ppid=14507 vsize=564464 CPUtime=0.13 cores=0,2,4,6
/proc/14536/stat : 14536 (python) S 14507 14507 13600 0 -1 4202560 923 0 0 0 7 6 0 0 18 0 1 0 538722061 578011136 74478 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130822 0 0 16781312 514 2546996695510515970 0 0 17 0 0 0 0

################
# More data... #
################

[pid=14582] ppid=14507 vsize=605488 CPUtime=0.45 cores=0,2,4,6
/proc/14582/stat : 14582 (python) S 14507 14507 13600 0 -1 4202560 1159 0 0 0 25 20 0 0 18 0 2 0 538780856 620019712 74524 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130822 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14582/statm: 151372 74524 399 364 0 87275 0
[pid=14584] ppid=14582 vsize=374792 CPUtime=239.81 cores=0,2,4,6
/proc/14584/stat : 14584 (precosat) R 14582 14584 14584 0 -1 4202496 98436 0 0 0 23963 18 0 0 25 0 1 0 538780857 383787008 91227 33554432000 4194304 4890832 140736827686048 18446744073709551615 4297728 0 0 16781312 17442 0 0 0 17 0 0 0 0
/proc/14584/statm: 93698 91227 86 171 0 93525 0
[pid=14582/tid=14597] ppid=14507 vsize=605488 CPUtime=0 cores=0,2,4,6
/proc/14582/task/14597/stat : 14597 (python) S 14507 14507 13600 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 538790875 620019712 74524 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604453902075904 0 0 -1 6 0 0 0
[pid=14587] ppid=14507 vsize=615744 CPUtime=0.71 cores=0,2,4,6
/proc/14587/stat : 14587 (python) S 14507 14507 13600 0 -1 4202560 1159 0 0 0 38 33 0 0 19 0 2 0 538781582 630521856 74528 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/14587/statm: 153936 74528 399 364 0 89836 0
[pid=14589] ppid=14587 vsize=371080 CPUtime=394.12 cores=0,2,4,6
/proc/14589/stat : 14589 (precosat) T 14587 14589 14589 0 -1 4202496 97431 0 0 0 39397 15 0 0 25 0 1 0 538781583 379985920 90292 33554432000 4194304 4890832 140734765865840 18446744073709551615 4291941 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/14589/statm: 92770 90292 86 171 0 92597 0
[pid=14587/tid=14620] ppid=14507 vsize=615744 CPUtime=0 cores=0,2,4,6
/proc/14587/task/14620/stat : 14620 (python) S 14507 14507 13600 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538821068 630521856 74528 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604451263031424 0 0 -1 4 0 0 0
[pid=14594] ppid=14507 vsize=626000 CPUtime=0.18 cores=0,2,4,6
/proc/14594/stat : 14594 (python) S 14507 14507 13600 0 -1 4202560 1164 0 0 0 10 8 0 0 19 0 2 0 538790430 641024000 74538 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14594/statm: 156500 74538 405 364 0 92397 0
[pid=14596] ppid=14594 vsize=94728 CPUtime=98.48 cores=0,2,4,6
/proc/14596/stat : 14596 (lingeling) T 14594 14596 14596 0 -1 4202496 57691 0 0 0 9839 9 0 0 25 0 1 0 538790431 97001472 20804 33554432000 4194304 4352236 140737145024624 18446744073709551615 4234513 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/14596/statm: 23682 20804 129 39 0 22762 0
[pid=14594/tid=14607] ppid=14507 vsize=626000 CPUtime=0 cores=0,2,4,6
/proc/14594/task/14607/stat : 14607 (python) S 14507 14507 13600 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538800449 641024000 74538 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604451263030528 0 0 -1 6 0 0 0
[pid=14604] ppid=14507 vsize=636256 CPUtime=0.3 cores=0,2,4,6
/proc/14604/stat : 14604 (python) S 14507 14507 13600 0 -1 4202560 1178 0 0 0 17 13 0 0 15 0 2 0 538800396 651526144 74545 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130822 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/14604/statm: 159064 74545 408 364 0 94958 0
[pid=14606] ppid=14604 vsize=1277756 CPUtime=149.73 cores=0,2,4,6
/proc/14606/stat : 14606 (cryptominisat-2) R 14604 14606 14606 0 -1 4202496 281565 0 0 0 14937 36 0 0 25 0 1 0 538800397 1308422144 259143 33554432000 4194304 4677096 140733221225184 18446744073709551615 4336422 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/14606/statm: 319439 259143 393 118 0 314398 0
[pid=14604/tid=14611] ppid=14507 vsize=636256 CPUtime=0 cores=0,2,4,6
/proc/14604/task/14611/stat : 14611 (python) S 14507 14507 13600 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 538810159 651526144 74545 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604440526451968 0 0 -1 2 0 0 0
[pid=14507/tid=14534] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14534/stat : 14534 (python) S 14505 14507 13600 0 -1 4202560 24 931 0 0 0 0 0 0 25 0 10 0 538722059 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 6 0 0 0
[pid=14507/tid=14537] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14537/stat : 14537 (python) S 14505 14507 13600 0 -1 4202560 45 931 0 0 0 0 0 0 18 0 10 0 538722062 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14540] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14540/stat : 14540 (python) S 14505 14507 13600 0 -1 4202560 26 931 0 0 0 0 0 0 18 0 10 0 538722065 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14543] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14543/stat : 14543 (python) S 14505 14507 13600 0 -1 4202560 29 931 0 0 0 0 0 0 22 0 10 0 538722068 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14550] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14550/stat : 14550 (python) S 14505 14507 13600 0 -1 4202560 28 931 0 0 0 0 0 0 18 0 10 0 538732083 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14583] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14583/stat : 14583 (python) S 14505 14507 13600 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 10 0 538780856 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14588] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14588/stat : 14588 (python) S 14505 14507 13600 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 10 0 538781582 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14595] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14595/stat : 14595 (python) S 14505 14507 13600 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 10 0 538790431 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14605] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14605/stat : 14605 (python) S 14505 14507 13600 0 -1 4202560 30 931 0 0 0 0 0 0 18 0 10 0 538800397 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4395.44
Current children cumulated vsize (KiB) 12813040

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300 s]
/proc/loadavg: 7.07 7.80 7.48 5/258 14640
/proc/meminfo: memFree=20196536/32951124 swapFree=67111516/67111528
[pid=14507] ppid=14505 vsize=646500 CPUtime=264.61 cores=0,2,4,6
/proc/14507/stat : 14507 (python) S 14505 14507 13600 0 -1 4202496 125429 931 1 0 26429 32 0 0 18 0 10 0 538695632 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624937419 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/14507/statm: 161625 76032 1892 364 0 97519 0
[pid=14533] ppid=14507 vsize=564452 CPUtime=0.33 cores=0,2,4,6
/proc/14533/stat : 14533 (python) S 14507 14507 13600 0 -1 4202560 1199 0 0 0 17 16 0 0 19 0 2 0 538722058 577998848 74523 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/14533/statm: 141113 74523 414 364 0 77031 0
[pid=14535] ppid=14533 vsize=96816 CPUtime=195.94 cores=0,2,4,6
/proc/14535/stat : 14535 (lingeling) T 14533 14535 14535 0 -1 4202496 59029 0 0 0 19585 9 0 0 25 0 1 0 538722059 99139584 21327 33554432000 4194304 4352236 140733589829904 18446744073709551615 4327902 0 0 16781312 17506 18446744071562691360 0 0 17 4 0 0 0
/proc/14535/statm: 24204 21327 129 39 0 23284 0
[pid=14533/tid=14554] ppid=14507 vsize=564452 CPUtime=0 cores=0,2,4,6
/proc/14533/task/14554/stat : 14554 (python) S 14507 14507 13600 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538741691 577998848 74523 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604453977649344 0 0 -1 6 0 0 0
[pid=14536] ppid=14507 vsize=564464 CPUtime=1.39 cores=0,2,4,6
/proc/14536/stat : 14536 (python) S 14507 14507 13600 0 -1 4202560 1151 0 0 0 72 67 0 0 18 0 2 0 538722061 578011136 74508 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14536/statm: 141116 74508 399 364 0 77031 0
[pid=14538] ppid=14536 vsize=97760 CPUtime=781.07 cores=0,2,4,6
/proc/14538/stat : 14538 (lingeling) T 14536 14538 14538 0 -1 4202496 64320 0 0 0 78090 17 0 0 25 0 1 0 538722064 100106240 23610 33554432000 4194304 4352236 140737093052208 18446744073709551615 4328026 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/14538/statm: 24440 23610 129 39 0 23520 0
[pid=14536/tid=14548] ppid=14507 vsize=564464 CPUtime=0 cores=0,2,4,6
/proc/14536/task/14548/stat : 14548 (python) S 14507 14507 13600 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 538732080 578011136 74508 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604443954555072 0 0 -1 0 0 0 0
[pid=14539] ppid=14507 vsize=574720 CPUtime=1.35 cores=0,2,4,6
/proc/14539/stat : 14539 (python) S 14507 14507 13600 0 -1 4202560 1176 0 0 0 71 64 0 0 15 0 2 0 538722064 588513280 74512 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130822 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/14539/statm: 143680 74512 399 364 0 79592 0
[pid=14541] ppid=14539 vsize=2233872 CPUtime=741.85 cores=0,2,4,6
/proc/14541/stat : 14541 (cryptominisat-2) R 14539 14541 14541 0 -1 4202496 514159 0 0 0 74100 85 0 0 25 0 1 0 538722065 2287484928 457553 33554432000 4194304 4677096 140736976045328 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/14541/statm: 558468 457553 393 118 0 553427 0
[pid=14539/tid=14585] ppid=14507 vsize=574720 CPUtime=0 cores=0,2,4,6
/proc/14539/task/14585/stat : 14585 (python) S 14507 14507 13600 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 538781009 588513280 74512 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604443954554176 0 0 -1 4 0 0 0
[pid=14542] ppid=14507 vsize=584976 CPUtime=1.53 cores=0,2,4,6
/proc/14542/stat : 14542 (python) S 14507 14507 13600 0 -1 4202560 1160 0 0 0 81 72 0 0 19 0 2 0 538722067 599015424 74516 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14542/statm: 146244 74516 399 364 0 82153 0
[pid=14544] ppid=14542 vsize=93552 CPUtime=879.23 cores=0,2,4,6
/proc/14544/stat : 14544 (lingeling) T 14542 14544 14544 0 -1 4202496 63407 0 0 0 87913 10 0 0 25 0 1 0 538722069 95797248 22558 33554432000 4194304 4352236 140733501870784 18446744073709551615 4328009 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/14544/statm: 23388 22558 129 39 0 22468 0
[pid=14542/tid=14610] ppid=14507 vsize=584976 CPUtime=0 cores=0,2,4,6
/proc/14542/task/14610/stat : 14610 (python) S 14507 14507 13600 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538810030 599015424 74516 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604443100730304 0 0 -1 0 0 0 0
[pid=14549] ppid=14507 vsize=595232 CPUtime=1.19 cores=0,2,4,6
/proc/14549/stat : 14549 (python) S 14507 14507 13600 0 -1 4202560 1178 0 0 0 65 54 0 0 15 0 2 0 538732082 609517568 74520 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130822 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/14549/statm: 148808 74520 399 364 0 84714 0
[pid=14551] ppid=14549 vsize=2158852 CPUtime=643.17 cores=0,2,4,6
/proc/14551/stat : 14551 (cryptominisat-2) R 14549 14551 14551 0 -1 4202496 486625 0 0 0 64235 82 0 0 25 0 1 0 538732084 2210664448 437020 33554432000 4194304 4677096 140736244726624 18446744073709551615 4318965 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/14551/statm: 539713 437020 393 118 0 534672 0
[pid=14549/tid=14586] ppid=14507 vsize=595232 CPUtime=0 cores=0,2,4,6
/proc/14549/task/14586/stat : 14586 (python) S 14507 14507 13600 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 538781579 609517568 74520 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604440278206464 0 0 -1 6 0 0 0
[pid=14582] ppid=14507 vsize=605488 CPUtime=0.45 cores=0,2,4,6
/proc/14582/stat : 14582 (python) S 14507 14507 13600 0 -1 4202560 1159 0 0 0 25 20 0 0 18 0 2 0 538780856 620019712 74524 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130822 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14582/statm: 151372 74524 399 364 0 87275 0
[pid=14584] ppid=14582 vsize=374792 CPUtime=239.81 cores=0,2,4,6
/proc/14584/stat : 14584 (precosat) R 14582 14584 14584 0 -1 4202496 98436 0 0 0 23963 18 0 0 25 0 1 0 538780857 383787008 91227 33554432000 4194304 4890832 140736827686048 18446744073709551615 4297728 0 0 16781312 17442 0 0 0 17 0 0 0 0
/proc/14584/statm: 93698 91227 86 171 0 93525 0
[pid=14582/tid=14597] ppid=14507 vsize=605488 CPUtime=0 cores=0,2,4,6
/proc/14582/task/14597/stat : 14597 (python) S 14507 14507 13600 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 538790875 620019712 74524 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604453902075904 0 0 -1 6 0 0 0
[pid=14587] ppid=14507 vsize=615744 CPUtime=0.71 cores=0,2,4,6
/proc/14587/stat : 14587 (python) S 14507 14507 13600 0 -1 4202560 1159 0 0 0 38 33 0 0 19 0 2 0 538781582 630521856 74528 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/14587/statm: 153936 74528 399 364 0 89836 0
[pid=14589] ppid=14587 vsize=371080 CPUtime=394.12 cores=0,2,4,6
/proc/14589/stat : 14589 (precosat) T 14587 14589 14589 0 -1 4202496 97431 0 0 0 39397 15 0 0 25 0 1 0 538781583 379985920 90292 33554432000 4194304 4890832 140734765865840 18446744073709551615 4291941 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/14589/statm: 92770 90292 86 171 0 92597 0
[pid=14587/tid=14620] ppid=14507 vsize=615744 CPUtime=0 cores=0,2,4,6
/proc/14587/task/14620/stat : 14620 (python) S 14507 14507 13600 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 538821068 630521856 74528 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604451263031424 0 0 -1 4 0 0 0
[pid=14594] ppid=14507 vsize=626000 CPUtime=0.18 cores=0,2,4,6
/proc/14594/stat : 14594 (python) S 14507 14507 13600 0 -1 4202560 1164 0 0 0 10 8 0 0 19 0 2 0 538790430 641024000 74538 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624937419 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/14594/statm: 156500 74538 405 364 0 92397 0
[pid=14596] ppid=14594 vsize=94728 CPUtime=98.48 cores=0,2,4,6
/proc/14596/stat : 14596 (lingeling) T 14594 14596 14596 0 -1 4202496 57691 0 0 0 9839 9 0 0 25 0 1 0 538790431 97001472 20804 33554432000 4194304 4352236 140737145024624 18446744073709551615 4234513 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/14596/statm: 23682 20804 129 39 0 22762 0
[pid=14594/tid=14607] ppid=14507 vsize=626000 CPUtime=0 cores=0,2,4,6
/proc/14594/task/14607/stat : 14607 (python) S 14507 14507 13600 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538800449 641024000 74538 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604451263030528 0 0 -1 6 0 0 0
[pid=14604] ppid=14507 vsize=636256 CPUtime=0.3 cores=0,2,4,6
/proc/14604/stat : 14604 (python) S 14507 14507 13600 0 -1 4202560 1178 0 0 0 17 13 0 0 15 0 2 0 538800396 651526144 74545 33554432000 4194304 5683644 140734110434160 18446744073709551615 270613130822 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/14604/statm: 159064 74545 408 364 0 94958 0
[pid=14606] ppid=14604 vsize=1277756 CPUtime=149.73 cores=0,2,4,6
/proc/14606/stat : 14606 (cryptominisat-2) R 14604 14606 14606 0 -1 4202496 281565 0 0 0 14937 36 0 0 25 0 1 0 538800397 1308422144 259143 33554432000 4194304 4677096 140733221225184 18446744073709551615 4336422 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/14606/statm: 319439 259143 393 118 0 314398 0
[pid=14604/tid=14611] ppid=14507 vsize=636256 CPUtime=0 cores=0,2,4,6
/proc/14604/task/14611/stat : 14611 (python) S 14507 14507 13600 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 538810159 651526144 74545 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 514 18446604440526451968 0 0 -1 2 0 0 0
[pid=14507/tid=14534] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14534/stat : 14534 (python) S 14505 14507 13600 0 -1 4202560 24 931 0 0 0 0 0 0 25 0 10 0 538722059 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 6 0 0 0
[pid=14507/tid=14537] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14537/stat : 14537 (python) S 14505 14507 13600 0 -1 4202560 45 931 0 0 0 0 0 0 18 0 10 0 538722062 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14540] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14540/stat : 14540 (python) S 14505 14507 13600 0 -1 4202560 26 931 0 0 0 0 0 0 18 0 10 0 538722065 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14543] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14543/stat : 14543 (python) S 14505 14507 13600 0 -1 4202560 29 931 0 0 0 0 0 0 22 0 10 0 538722068 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14550] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14550/stat : 14550 (python) S 14505 14507 13600 0 -1 4202560 28 931 0 0 0 0 0 0 18 0 10 0 538732083 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14583] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14583/stat : 14583 (python) S 14505 14507 13600 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 10 0 538780856 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14588] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14588/stat : 14588 (python) S 14505 14507 13600 0 -1 4202560 27 931 0 0 0 0 0 0 20 0 10 0 538781582 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14595] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14595/stat : 14595 (python) S 14505 14507 13600 0 -1 4202560 30 931 0 0 0 0 0 0 20 0 10 0 538790431 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
[pid=14507/tid=14605] ppid=14505 vsize=646500 CPUtime=0 cores=0,2,4,6
/proc/14507/task/14605/stat : 14605 (python) S 14505 14507 13600 0 -1 4202560 30 931 0 0 0 0 0 0 18 0 10 0 538800397 662016000 76032 33554432000 4194304 5683644 140734110434160 18446744073709551615 270624934321 0 0 16781312 2 18446604453983593664 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4395.44
Current children cumulated vsize (KiB) 12813040

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 14507 and gives
#  childrusage.ru_utime.tv_sec=264
#  childrusage.ru_utime.tv_usec=295820
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=360945
# CPU time returned by wait4() is 264.657
# while last known CPU time is 4395.44
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.09
CPU time (s): 4395.44
CPU user time (s): 4388.84
CPU system time (s): 6.6
CPU usage (%): 338.087
Max. virtual memory (cumulated for all children) (KiB): 12948628

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 264.296
system time used= 0.360945
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 126363
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1093
involuntary context switches= 424

runsolver used 3.72643 second user time and 9.2126 second system time

The end

Launcher Data 

Begin job on node108 at 2011-05-01 19:29:07
IDJOB=3317713
IDBENCH=84246
IDSOLVER=1706
FILE ID=node108/3317713-1304270945
RUNJOBID= node108-1304270945-14483
PBS_JOBID= 13173970
Free space on /tmp= 72984 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT03/industrial/schuppan/l2s/bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317713-1304270945/watcher-3317713-1304270945 -o /tmp/evaluation-result-3317713-1304270945/solver-3317713-1304270945 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317713-1304270945.cnf -seed 101583788 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f16626953757fdd1326f2a14f01adca9
RANDOM SEED=101583788

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27909012 kB
Buffers:        646428 kB
Cached:        1707388 kB
SwapCached:         12 kB
Active:        2514032 kB
Inactive:      2111244 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27909012 kB
SwapTotal:    67111528 kB
SwapFree:     67111516 kB
Dirty:          106752 kB
Writeback:           0 kB
AnonPages:     2270892 kB
Mapped:          23884 kB
Slab:           342764 kB
PageTables:      13892 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 18120612 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72992 MiB
End job on node108 at 2011-05-01 19:50:49