Trace number 3317916

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4800.37 1285.26

General information on the benchmark

Nameapplication/jarvisalo/smtqfbv-aigs/
smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf
MD5SUMb967fca11e85ef5b614d3452b1c4b2ad
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables257030
Number of clauses769313
Sum of the clauses size1795061
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2512874
Number of clauses of size 3256437
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.36/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.36/0.67	c INFO: solving HOME/instance-3317916-1304269452.cnf
0.36/0.67	c INFO: computing task features
2.83/3.13	c INFO: computed variable-clause graph statistics
2.94/3.23	c INFO: computed clause balance statistics
16.24/16.53	c INFO: computed variable balance statistics
26.33/26.61	c INFO: computed small-clause counts
26.53/26.84	c INFO: computed Horn-clause counts
109.53/109.82	c INFO: computed variable graph statistics
109.53/109.82	c INFO: collected features for HOME/instance-3317916-1304269452.cnf in 109.06 s
109.53/109.84	c INFO: running lingeling-276@0 for 97 with 4690 remaining (b = 0.64)
109.53/109.87	c INFO: running cryptominisat-2.9.0@0 for 485 with 4690 remaining (b = 0.45)
109.53/109.90	c INFO: running lingeling-276@0 for 1067 with 4690 remaining (b = 0.52)
109.66/109.93	c INFO: running lingeling-276@0 for 873 with 4690 remaining (b = 0.42)
509.05/210.00	c INFO: running cryptominisat-2.9.0@0 for 485 with 4590 remaining (b = 0.35)
2058.09/597.81	c INFO: running precosat-570@0 for 388 with 4202 remaining (b = 0.27)
2475.01/702.26	c INFO: running cryptominisat-2.9.0@487 for 97 with 4098 remaining (b = 0.09)
2860.41/798.73	c INFO: running lingeling-276@0 for 97 with 4001 remaining (b = 0.09)
3248.19/895.87	c INFO: running lingeling-276@96 for 97 with 3904 remaining (b = 0.09)
3625.55/990.33	c INFO: running lingeling-276@0 for 194 with 3810 remaining (b = 0.13)
3628.36/991.03	c INFO: running precosat-570@488 for 194 with 3809 remaining (b = 0.11)
3652.29/997.01	c INFO: running cryptominisat-2.9.0@0 for 97 with 3803 remaining (b = 0.06)
4059.42/1099.28	c INFO: running cryptominisat-2.9.0@0 for 388 with 3701 remaining (b = 0.16)
4394.02/1183.23	c INFO: running cryptominisat-2.9.0@101 for 388 with 3617 remaining (b = 0.17)
4414.35/1188.32	c INFO: running precosat-570@589 for 97 with 3612 remaining (b = 0.05)
4427.48/1191.65	c INFO: running lingeling-276@99 for 97 with 3609 remaining (b = 0.04)
4789.19/1282.47	c INFO: running lingeling-276@0 for 388 with 3518 remaining (b = 0.16)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317916-1304269452/watcher-3317916-1304269452 -o /tmp/evaluation-result-3317916-1304269452/solver-3317916-1304269452 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317916-1304269452.cnf -seed 1401861513 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.68 4.35 5.02 4/189 21554
/proc/meminfo: memFree=28423640/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=15184 CPUtime=0 cores=0,2,4,6
/proc/21554/stat : 21554 (python) S 21552 21554 21052 0 -1 4202496 724 0 0 0 0 0 0 0 20 0 1 0 538543144 15548416 614 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550535680 0 2147483391 16781312 2 18446744071699469502 0 0 17 4 0 0 0
/proc/21554/statm: 3796 614 321 364 0 283 0

[startup+0.063838 s]
/proc/loadavg: 4.68 4.35 5.02 4/189 21554
/proc/meminfo: memFree=28423640/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=29788 CPUtime=0.04 cores=0,2,4,6
/proc/21554/stat : 21554 (python) R 21552 21554 21052 0 -1 4202496 1460 0 0 0 3 1 0 0 20 0 1 0 538543144 30502912 1299 33554432000 4194304 5683644 140734544083696 18446744073709551615 4602399 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/21554/statm: 7447 1299 443 364 0 817 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 29788

[startup+0.100829 s]
/proc/loadavg: 4.68 4.35 5.02 4/189 21554
/proc/meminfo: memFree=28423640/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=85620 CPUtime=0.05 cores=0,2,4,6
/proc/21554/stat : 21554 (python) S 21552 21554 21052 0 -1 4202496 2631 0 0 0 4 1 0 0 20 0 1 0 538543144 87674880 2348 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550535680 0 2147483391 16781312 2 18446744071699469502 0 0 17 4 0 0 0
/proc/21554/statm: 21405 2348 713 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85620

[startup+0.300799 s]
/proc/loadavg: 4.68 4.35 5.02 4/189 21554
/proc/meminfo: memFree=28423640/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=135748 CPUtime=0.19 cores=0,2,4,6
/proc/21554/stat : 21554 (python) R 21552 21554 21052 0 -1 4202496 5964 933 1 0 14 5 0 0 17 0 1 0 538543144 139005952 4150 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550533637 0 2147483391 16781312 2 0 0 0 17 4 0 0 0
/proc/21554/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.700764 s]
/proc/loadavg: 4.68 4.35 5.02 4/189 21554
/proc/meminfo: memFree=28423640/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=293068 CPUtime=0.44 cores=0,2,4,6
/proc/21554/stat : 21554 (python) R 21552 21554 21052 0 -1 4202496 12905 933 1 0 33 11 0 0 16 0 1 0 538543144 300101632 10585 33554432000 4194304 5683644 140734544083696 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/21554/statm: 73267 10585 1761 364 0 9191 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 293068

[startup+1.50062 s]
/proc/loadavg: 4.68 4.35 5.02 4/190 21559
/proc/meminfo: memFree=28366344/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=347088 CPUtime=1.23 cores=0,2,4,6
/proc/21554/stat : 21554 (python) R 21552 21554 21052 0 -1 4202496 26079 933 1 0 111 12 0 0 17 0 1 0 538543144 355418112 23759 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550198469 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/21554/statm: 86772 23759 1761 364 0 22696 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 347088

[startup+3.10026 s]
/proc/loadavg: 4.68 4.35 5.02 4/190 21559
/proc/meminfo: memFree=28292812/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=434384 CPUtime=2.83 cores=0,2,4,6
/proc/21554/stat : 21554 (python) R 21552 21554 21052 0 -1 4202496 65716 933 1 0 265 18 0 0 19 0 1 0 538543144 444809216 45970 33554432000 4194304 5683644 140734544083696 18446744073709551615 47040235827056 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/21554/statm: 108596 45970 1815 364 0 44520 0
Current children cumulated CPU time (s) 2.83
Current children cumulated vsize (KiB) 434384

[startup+6.3007 s]
/proc/loadavg: 4.55 4.33 5.01 4/190 21559
/proc/meminfo: memFree=28264788/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=434384 CPUtime=6.03 cores=0,2,4,6
/proc/21554/stat : 21554 (python) R 21552 21554 21052 0 -1 4202496 65728 933 1 0 585 18 0 0 25 0 1 0 538543144 444809216 45981 33554432000 4194304 5683644 140734544083696 18446744073709551615 4623682 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/21554/statm: 108596 45981 1826 364 0 44520 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 434384

[startup+12.7006 s]
/proc/loadavg: 4.42 4.31 5.00 4/190 21561
/proc/meminfo: memFree=28258736/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=434384 CPUtime=12.43 cores=0,2,4,6
/proc/21554/stat : 21554 (python) R 21552 21554 21052 0 -1 4202496 65728 933 1 0 1225 18 0 0 25 0 1 0 538543144 444809216 45981 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550224261 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/21554/statm: 108596 45981 1826 364 0 44520 0
Current children cumulated CPU time (s) 12.43
Current children cumulated vsize (KiB) 434384

[startup+25.5002 s]
/proc/loadavg: 4.11 4.24 4.96 4/190 21563
/proc/meminfo: memFree=28248636/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=434384 CPUtime=25.23 cores=0,2,4,6
/proc/21554/stat : 21554 (python) R 21552 21554 21052 0 -1 4202496 65729 933 1 0 2505 18 0 0 25 0 1 0 538543144 444809216 45982 33554432000 4194304 5683644 140734544083696 18446744073709551615 47040238710358 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/21554/statm: 108596 45982 1827 364 0 44520 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 434384

[startup+51.1006 s]
/proc/loadavg: 3.73 4.14 4.91 4/190 21563
/proc/meminfo: memFree=28251700/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=434384 CPUtime=50.83 cores=0,2,4,6
/proc/21554/stat : 21554 (python) R 21552 21554 21052 0 -1 4202496 65735 933 1 0 5065 18 0 0 25 0 1 0 538543144 444809216 45988 33554432000 4194304 5683644 140734544083696 18446744073709551615 47040235841664 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/21554/statm: 108596 45988 1833 364 0 44520 0
Current children cumulated CPU time (s) 50.83
Current children cumulated vsize (KiB) 434384

[startup+102.306 s]
/proc/loadavg: 3.36 3.98 4.81 4/190 21565
/proc/meminfo: memFree=28244380/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=434384 CPUtime=102.04 cores=0,2,4,6
/proc/21554/stat : 21554 (python) R 21552 21554 21052 0 -1 4202496 65735 933 1 0 10186 18 0 0 25 0 1 0 538543144 444809216 45988 33554432000 4194304 5683644 140734544083696 18446744073709551615 47040235841664 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/21554/statm: 108596 45988 1833 364 0 44520 0
Current children cumulated CPU time (s) 102.04
Current children cumulated vsize (KiB) 434384

[startup+162.301 s]
/proc/loadavg: 4.86 4.27 4.86 7/202 21578
/proc/meminfo: memFree=27506928/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=463644 CPUtime=109.66 cores=0,2,4,6
/proc/21554/stat : 21554 (python) S 21552 21554 21052 0 -1 4202496 68419 933 1 0 10946 20 0 0 20 0 5 0 538543144 474771456 43108 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21554/statm: 115911 43108 1881 364 0 51820 0
[pid=21566] ppid=21554 vsize=422632 CPUtime=0.07 cores=0,2,4,6
/proc/21566/stat : 21566 (python) S 21554 21554 21052 0 -1 4202560 1003 0 0 0 4 3 0 0 18 0 1 0 538554128 432775168 41593 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557711 0 0 16781312 514 7314602258849562881 0 0 17 4 0 0 0
/proc/21566/statm: 105658 41593 382 364 0 41576 0
[pid=21568] ppid=21566 vsize=97616 CPUtime=52.14 cores=0,2,4,6
/proc/21568/stat : 21568 (lingeling) R 21566 21568 21568 0 -1 4202496 44868 0 0 0 5209 5 0 0 25 0 1 0 538554129 99958784 23573 33554432000 4194304 4352236 140733533139712 18446744073709551615 4327902 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/21568/statm: 24404 23573 129 39 0 23484 0
[pid=21569] ppid=21554 vsize=432888 CPUtime=0.07 cores=0,2,4,6
/proc/21569/stat : 21569 (python) S 21554 21554 21052 0 -1 4202560 951 0 0 0 4 3 0 0 15 0 1 0 538554131 443277312 41585 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 4562814929890935044 0 0 17 0 0 0 0
/proc/21569/statm: 108222 41585 370 364 0 44137 0
[pid=21571] ppid=21569 vsize=473852 CPUtime=52.31 cores=0,2,4,6
/proc/21571/stat : 21571 (cryptominisat-2) R 21569 21571 21571 0 -1 4202496 123432 0 0 0 5214 17 0 0 25 0 1 0 538554134 485224448 104489 33554432000 4194304 4677096 140734936747184 18446744073709551615 4335955 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/21571/statm: 118463 104489 392 118 0 113422 0
[pid=21572] ppid=21554 vsize=443144 CPUtime=0.06 cores=0,2,4,6
/proc/21572/stat : 21572 (python) S 21554 21554 21052 0 -1 4202560 952 0 0 0 4 2 0 0 18 0 1 0 538554134 453779456 41589 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 7314602258849562884 0 0 17 4 0 0 0
/proc/21572/statm: 110786 41589 370 364 0 46698 0
[pid=21574] ppid=21572 vsize=97416 CPUtime=52.3 cores=0,2,4,6
/proc/21574/stat : 21574 (lingeling) R 21572 21574 21574 0 -1 4202496 38880 0 0 0 5225 5 0 0 25 0 1 0 538554135 99753984 23524 33554432000 4194304 4352236 140736219563520 18446744073709551615 4327902 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/21574/statm: 24354 23524 129 39 0 23434 0
[pid=21575] ppid=21554 vsize=453400 CPUtime=0.07 cores=0,2,4,6
/proc/21575/stat : 21575 (python) S 21554 21554 21052 0 -1 4202560 949 0 0 0 4 3 0 0 18 0 1 0 538554137 464281600 41593 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 7314602258849562883 0 0 17 2 0 0 0
/proc/21575/statm: 113350 41593 370 364 0 49259 0
[pid=21577] ppid=21575 vsize=98172 CPUtime=52.2 cores=0,2,4,6
/proc/21577/stat : 21577 (lingeling) R 21575 21577 21577 0 -1 4202496 39068 0 0 0 5215 5 0 0 25 0 1 0 538554138 100528128 23713 33554432000 4194304 4352236 140733633886896 18446744073709551615 4276530 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/21577/statm: 24543 23713 129 39 0 23623 0
[pid=21554/tid=21567] ppid=21552 vsize=463644 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21567/stat : 21567 (python) S 21552 21554 21052 0 -1 4202560 24 933 0 0 0 0 0 0 25 0 5 0 538554129 474771456 43108 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 6 0 0 0
[pid=21554/tid=21570] ppid=21552 vsize=463644 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21570/stat : 21570 (python) S 21552 21554 21052 0 -1 4202560 22 933 0 0 0 0 0 0 20 0 5 0 538554132 474771456 43108 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 0 0 0 0
[pid=21554/tid=21573] ppid=21552 vsize=463644 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21573/stat : 21573 (python) S 21552 21554 21052 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 5 0 538554135 474771456 43108 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 0 0 0 0
[pid=21554/tid=21576] ppid=21552 vsize=463644 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21576/stat : 21576 (python) S 21552 21554 21052 0 -1 4202560 27 933 0 0 0 0 0 0 20 0 5 0 538554138 474771456 43108 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 318.88
Current children cumulated vsize (KiB) 2982764

[startup+222.301 s]
/proc/loadavg: 5.68 4.61 4.94 8/206 21584
/proc/meminfo: memFree=27125796/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=473900 CPUtime=109.69 cores=0,2,4,6
/proc/21554/stat : 21554 (python) S 21552 21554 21052 0 -1 4202496 69222 933 1 0 10948 21 0 0 20 0 6 0 538543144 485273600 43115 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21554/statm: 118475 43115 1884 364 0 54381 0
[pid=21566] ppid=21554 vsize=432876 CPUtime=0.13 cores=0,2,4,6
/proc/21566/stat : 21566 (python) S 21554 21554 21052 0 -1 4202560 1172 0 0 0 7 6 0 0 19 0 2 0 538554128 443265024 41631 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/21566/statm: 108219 41631 415 364 0 44137 0
[pid=21568] ppid=21566 vsize=97600 CPUtime=99.54 cores=0,2,4,6
/proc/21568/stat : 21568 (lingeling) T 21566 21568 21568 0 -1 4202496 44868 0 0 0 9949 5 0 0 25 0 1 0 538554129 99942400 23569 33554432000 4194304 4352236 140733533139712 18446744073709551615 4301712 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/21568/statm: 24400 23569 129 39 0 23480 0
[pid=21566/tid=21581] ppid=21554 vsize=432876 CPUtime=0 cores=0,2,4,6
/proc/21566/task/21581/stat : 21581 (python) S 21554 21554 21052 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538564142 443265024 41631 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604449063715968 0 0 -1 4 0 0 0
[pid=21569] ppid=21554 vsize=432888 CPUtime=0.16 cores=0,2,4,6
/proc/21569/stat : 21569 (python) S 21554 21554 21052 0 -1 4202560 972 0 0 0 9 7 0 0 15 0 1 0 538554131 443277312 41585 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 7314602258849562884 0 0 17 0 0 0 0
/proc/21569/statm: 108222 41585 370 364 0 44137 0
[pid=21571] ppid=21569 vsize=527164 CPUtime=112.23 cores=0,2,4,6
/proc/21571/stat : 21571 (cryptominisat-2) R 21569 21571 21571 0 -1 4202496 132769 0 0 0 11204 19 0 0 25 0 1 0 538554134 539815936 113826 33554432000 4194304 4677096 140734936747184 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/21571/statm: 131791 113826 392 118 0 126750 0
[pid=21572] ppid=21554 vsize=443144 CPUtime=0.15 cores=0,2,4,6
/proc/21572/stat : 21572 (python) S 21554 21554 21052 0 -1 4202560 969 0 0 0 9 6 0 0 18 0 1 0 538554134 453779456 41589 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 7314602258849562884 0 0 17 4 0 0 0
/proc/21572/statm: 110786 41589 370 364 0 46698 0
[pid=21574] ppid=21572 vsize=97404 CPUtime=112.21 cores=0,2,4,6
/proc/21574/stat : 21574 (lingeling) R 21572 21574 21574 0 -1 4202496 38880 0 0 0 11216 5 0 0 25 0 1 0 538554135 99741696 23521 33554432000 4194304 4352236 140736219563520 18446744073709551615 4213253 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/21574/statm: 24351 23521 129 39 0 23431 0
[pid=21575] ppid=21554 vsize=453400 CPUtime=0.15 cores=0,2,4,6
/proc/21575/stat : 21575 (python) S 21554 21554 21052 0 -1 4202560 965 0 0 0 8 7 0 0 18 0 1 0 538554137 464281600 41593 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 7314602258849562883 0 0 17 2 0 0 0
/proc/21575/statm: 113350 41593 370 364 0 49259 0
[pid=21577] ppid=21575 vsize=98152 CPUtime=112.06 cores=0,2,4,6
/proc/21577/stat : 21577 (lingeling) R 21575 21577 21577 0 -1 4202496 39068 0 0 0 11201 5 0 0 25 0 1 0 538554138 100507648 23708 33554432000 4194304 4352236 140733633886896 18446744073709551615 4241442 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/21577/statm: 24538 23708 129 39 0 23618 0

################
# More data... #
################

[pid=21575] ppid=21554 vsize=453400 CPUtime=1.3 cores=0,2,4,6
/proc/21575/stat : 21575 (python) S 21554 21554 21052 0 -1 4202560 1154 0 0 0 71 59 0 0 18 0 2 0 538554137 464281600 41623 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21575/statm: 113350 41623 399 364 0 49259 0
[pid=21577] ppid=21575 vsize=98080 CPUtime=929.6 cores=0,2,4,6
/proc/21577/stat : 21577 (lingeling) R 21575 21577 21577 0 -1 4202496 39068 0 0 0 92955 5 0 0 25 0 1 0 538554138 100433920 23690 33554432000 4194304 4352236 140733633886896 18446744073709551615 4328208 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/21577/statm: 24520 23690 129 39 0 23600 0
[pid=21575/tid=21676] ppid=21554 vsize=453400 CPUtime=0 cores=0,2,4,6
/proc/21575/task/21676/stat : 21676 (python) S 21554 21554 21052 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 538642245 464281600 41623 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604453911630976 0 0 -1 2 0 0 0
[pid=21582] ppid=21554 vsize=463656 CPUtime=0.88 cores=0,2,4,6
/proc/21582/stat : 21582 (python) S 21554 21554 21052 0 -1 4202560 1172 0 0 0 46 42 0 0 15 0 2 0 538564144 474783744 41628 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/21582/statm: 115914 41628 400 364 0 51820 0
[pid=21584] ppid=21582 vsize=544868 CPUtime=585.3 cores=0,2,4,6
/proc/21584/stat : 21584 (cryptominisat-2) T 21582 21584 21584 0 -1 4202496 171475 0 0 0 58491 39 0 0 25 0 1 0 538564145 557944832 121062 33554432000 4194304 4677096 140737314405552 18446744073709551615 4320231 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/21584/statm: 136217 121062 393 118 0 131176 0
[pid=21582/tid=21663] ppid=21554 vsize=463656 CPUtime=0 cores=0,2,4,6
/proc/21582/task/21663/stat : 21663 (python) S 21554 21554 21052 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 538613368 474783744 41628 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604453950474368 0 0 -1 6 0 0 0
[pid=21657] ppid=21554 vsize=473912 CPUtime=0.92 cores=0,2,4,6
/proc/21657/stat : 21657 (python) S 21554 21554 21052 0 -1 4202560 1157 0 0 0 46 46 0 0 18 0 2 0 538602925 485285888 41631 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/21657/statm: 118478 41631 399 364 0 54381 0
[pid=21659] ppid=21657 vsize=257988 CPUtime=640.18 cores=0,2,4,6
/proc/21659/stat : 21659 (precosat) R 21657 21659 21659 0 -1 4202496 67433 0 0 0 64008 10 0 0 25 0 1 0 538602926 264179712 63143 33554432000 4194304 4890832 140736989082112 18446744073709551615 4238265 0 0 16781312 17442 0 0 0 17 6 0 0 0
/proc/21659/statm: 64497 63143 86 171 0 64324 0
[pid=21657/tid=21672] ppid=21554 vsize=473912 CPUtime=0 cores=0,2,4,6
/proc/21657/task/21672/stat : 21672 (python) S 21554 21554 21052 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538642175 485285888 41631 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604453934966592 0 0 -1 6 0 0 0
[pid=21673] ppid=21554 vsize=484168 CPUtime=0.3 cores=0,2,4,6
/proc/21673/stat : 21673 (python) S 21554 21554 21052 0 -1 4202560 1156 0 0 0 15 15 0 0 19 0 2 0 538642177 495788032 41635 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21673/statm: 121042 41635 399 364 0 56942 0
[pid=21675] ppid=21673 vsize=97360 CPUtime=197.73 cores=0,2,4,6
/proc/21675/stat : 21675 (lingeling) T 21673 21675 21675 0 -1 4202496 44809 0 0 0 19768 5 0 0 25 0 1 0 538642178 99696640 23510 33554432000 4194304 4352236 140734082526224 18446744073709551615 4229934 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/21675/statm: 24340 23510 129 39 0 23420 0
[pid=21673/tid=21692] ppid=21554 vsize=484168 CPUtime=0 cores=0,2,4,6
/proc/21673/task/21692/stat : 21692 (python) S 21554 21554 21052 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 538662307 495788032 41635 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604440932636672 0 0 -1 6 0 0 0
[pid=21677] ppid=21554 vsize=494424 CPUtime=0.28 cores=0,2,4,6
/proc/21677/stat : 21677 (python) S 21554 21554 21052 0 -1 4202560 1210 0 0 0 17 11 0 0 15 0 2 0 538642845 506290176 41645 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21677/statm: 123606 41645 405 364 0 59503 0
[pid=21679] ppid=21677 vsize=533860 CPUtime=160.98 cores=0,2,4,6
/proc/21679/stat : 21679 (cryptominisat-2) R 21677 21679 21679 0 -1 4202496 136729 0 0 0 16079 19 0 0 25 0 1 0 538642846 546672640 117730 33554432000 4194304 4677096 140735125664032 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/21679/statm: 133465 117730 393 118 0 128424 0
[pid=21677/tid=21686] ppid=21554 vsize=494424 CPUtime=0 cores=0,2,4,6
/proc/21677/task/21686/stat : 21686 (python) S 21554 21554 21052 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 538653070 506290176 41645 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604453953221632 0 0 -1 2 0 0 0
[pid=21554/tid=21567] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21567/stat : 21567 (python) S 21552 21554 21052 0 -1 4202560 29 933 0 0 0 0 0 0 18 0 9 0 538554129 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 6 0 0 0
[pid=21554/tid=21570] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21570/stat : 21570 (python) S 21552 21554 21052 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 9 0 538554132 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 0 0 0 0
[pid=21554/tid=21573] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21573/stat : 21573 (python) S 21552 21554 21052 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 9 0 538554135 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 0 0 0 0
[pid=21554/tid=21576] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21576/stat : 21576 (python) S 21552 21554 21052 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 538554138 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 2 0 0 0
[pid=21554/tid=21583] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21583/stat : 21583 (python) S 21552 21554 21052 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 9 0 538564144 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 2 0 0 0
[pid=21554/tid=21658] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21658/stat : 21658 (python) S 21552 21554 21052 0 -1 4202560 37 933 0 0 0 0 0 0 18 0 9 0 538602926 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 2 0 0 0
[pid=21554/tid=21674] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21674/stat : 21674 (python) S 21552 21554 21052 0 -1 4202560 32 933 0 0 0 0 0 0 20 0 9 0 538642178 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 2 0 0 0
[pid=21554/tid=21678] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21678/stat : 21678 (python) S 21552 21554 21052 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 538642846 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4629.45
Current children cumulated vsize (KiB) 6457948



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1285.2 s]
/proc/loadavg: 9.30 9.08 7.80 10/244 21697
/proc/meminfo: memFree=25617988/32951124 swapFree=67111336/67111528
[pid=21554] ppid=21552 vsize=504668 CPUtime=109.97 cores=0,2,4,6
/proc/21554/stat : 21554 (python) S 21552 21554 21052 0 -1 4202496 72372 933 1 0 10974 23 0 0 18 0 9 0 538543144 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562364363 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/21554/statm: 126167 43133 1890 364 0 62064 0
[pid=21566] ppid=21554 vsize=432876 CPUtime=0.4 cores=0,2,4,6
/proc/21566/stat : 21566 (python) S 21554 21554 21052 0 -1 4202560 1202 0 0 0 21 19 0 0 18 0 2 0 538554128 443265024 41632 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21566/statm: 108219 41632 416 364 0 44137 0
[pid=21568] ppid=21566 vsize=97560 CPUtime=296.73 cores=0,2,4,6
/proc/21568/stat : 21568 (lingeling) T 21566 21568 21568 0 -1 4202496 44868 0 0 0 29668 5 0 0 25 0 1 0 538554129 99901440 23559 33554432000 4194304 4352236 140733533139712 18446744073709551615 4328055 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/21568/statm: 24390 23559 129 39 0 23470 0
[pid=21566/tid=21581] ppid=21554 vsize=432876 CPUtime=0 cores=0,2,4,6
/proc/21566/task/21581/stat : 21581 (python) S 21554 21554 21052 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 538564142 443265024 41632 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604449063715968 0 0 -1 4 0 0 0
[pid=21569] ppid=21554 vsize=432888 CPUtime=1.06 cores=0,2,4,6
/proc/21569/stat : 21569 (python) S 21554 21554 21052 0 -1 4202560 1165 0 0 0 59 47 0 0 15 0 2 0 538554131 443277312 41616 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/21569/statm: 108222 41616 400 364 0 44137 0
[pid=21571] ppid=21569 vsize=547504 CPUtime=672.86 cores=0,2,4,6
/proc/21571/stat : 21571 (cryptominisat-2) R 21569 21571 21571 0 -1 4202496 139130 0 0 0 67264 22 0 0 25 0 1 0 538554134 560644096 120187 33554432000 4194304 4677096 140734936747184 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/21571/statm: 136876 120187 392 118 0 131835 0
[pid=21569/tid=21656] ppid=21554 vsize=432888 CPUtime=0 cores=0,2,4,6
/proc/21569/task/21656/stat : 21656 (python) S 21554 21554 21052 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 538602923 443277312 41616 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604453911630080 0 0 -1 0 0 0 0
[pid=21572] ppid=21554 vsize=443144 CPUtime=1.49 cores=0,2,4,6
/proc/21572/stat : 21572 (python) S 21554 21554 21052 0 -1 4202560 1151 0 0 0 76 73 0 0 18 0 2 0 538554134 453779456 41619 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/21572/statm: 110786 41619 399 364 0 46698 0
[pid=21574] ppid=21572 vsize=97912 CPUtime=1075.13 cores=0,2,4,6
/proc/21574/stat : 21574 (lingeling) R 21572 21574 21574 0 -1 4202496 39026 0 0 0 107505 8 0 0 23 0 1 0 538554135 100261888 23648 33554432000 4194304 4352236 140736219563520 18446744073709551615 4327902 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/21574/statm: 24478 23648 129 39 0 23558 0
[pid=21572/tid=21691] ppid=21554 vsize=443144 CPUtime=0 cores=0,2,4,6
/proc/21572/task/21691/stat : 21691 (python) S 21554 21554 21052 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 538661465 453779456 41619 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604449063715072 0 0 -1 4 0 0 0
[pid=21575] ppid=21554 vsize=453400 CPUtime=1.37 cores=0,2,4,6
/proc/21575/stat : 21575 (python) S 21554 21554 21052 0 -1 4202560 1154 0 0 0 74 63 0 0 18 0 2 0 538554137 464281600 41623 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21575/statm: 113350 41623 399 364 0 49259 0
[pid=21577] ppid=21575 vsize=98076 CPUtime=972.5 cores=0,2,4,6
/proc/21577/stat : 21577 (lingeling) R 21575 21577 21577 0 -1 4202496 39068 0 0 0 97245 5 0 0 25 0 1 0 538554138 100429824 23689 33554432000 4194304 4352236 140733633886896 18446744073709551615 4281116 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/21577/statm: 24519 23689 129 39 0 23599 0
[pid=21575/tid=21676] ppid=21554 vsize=453400 CPUtime=0 cores=0,2,4,6
/proc/21575/task/21676/stat : 21676 (python) S 21554 21554 21052 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 538642245 464281600 41623 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604453911630976 0 0 -1 2 0 0 0
[pid=21582] ppid=21554 vsize=463656 CPUtime=0.88 cores=0,2,4,6
/proc/21582/stat : 21582 (python) S 21554 21554 21052 0 -1 4202560 1172 0 0 0 46 42 0 0 15 0 2 0 538564144 474783744 41628 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/21582/statm: 115914 41628 400 364 0 51820 0
[pid=21584] ppid=21582 vsize=544868 CPUtime=585.3 cores=0,2,4,6
/proc/21584/stat : 21584 (cryptominisat-2) T 21582 21584 21584 0 -1 4202496 171475 0 0 0 58491 39 0 0 25 0 1 0 538564145 557944832 121062 33554432000 4194304 4677096 140737314405552 18446744073709551615 4320231 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/21584/statm: 136217 121062 393 118 0 131176 0
[pid=21582/tid=21663] ppid=21554 vsize=463656 CPUtime=0 cores=0,2,4,6
/proc/21582/task/21663/stat : 21663 (python) S 21554 21554 21052 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 538613368 474783744 41628 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604453950474368 0 0 -1 6 0 0 0
[pid=21657] ppid=21554 vsize=473912 CPUtime=0.98 cores=0,2,4,6
/proc/21657/stat : 21657 (python) S 21554 21554 21052 0 -1 4202560 1157 0 0 0 50 48 0 0 18 0 2 0 538602925 485285888 41631 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/21657/statm: 118478 41631 399 364 0 54381 0
[pid=21659] ppid=21657 vsize=257988 CPUtime=679.62 cores=0,2,4,6
/proc/21659/stat : 21659 (precosat) T 21657 21659 21659 0 -1 4202496 67433 0 0 0 67952 10 0 0 25 0 1 0 538602926 264179712 63143 33554432000 4194304 4890832 140736989082112 18446744073709551615 4238686 0 0 16781312 17442 18446744071562691360 0 0 17 6 0 0 0
/proc/21659/statm: 64497 63143 86 171 0 64324 0
[pid=21657/tid=21672] ppid=21554 vsize=473912 CPUtime=0 cores=0,2,4,6
/proc/21657/task/21672/stat : 21672 (python) S 21554 21554 21052 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538642175 485285888 41631 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604453934966592 0 0 -1 6 0 0 0
[pid=21673] ppid=21554 vsize=484168 CPUtime=0.3 cores=0,2,4,6
/proc/21673/stat : 21673 (python) S 21554 21554 21052 0 -1 4202560 1156 0 0 0 15 15 0 0 19 0 2 0 538642177 495788032 41635 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562364363 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21673/statm: 121042 41635 399 364 0 56942 0
[pid=21675] ppid=21673 vsize=97360 CPUtime=197.73 cores=0,2,4,6
/proc/21675/stat : 21675 (lingeling) T 21673 21675 21675 0 -1 4202496 44809 0 0 0 19768 5 0 0 25 0 1 0 538642178 99696640 23510 33554432000 4194304 4352236 140734082526224 18446744073709551615 4229934 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/21675/statm: 24340 23510 129 39 0 23420 0
[pid=21673/tid=21692] ppid=21554 vsize=484168 CPUtime=0 cores=0,2,4,6
/proc/21673/task/21692/stat : 21692 (python) S 21554 21554 21052 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 538662307 495788032 41635 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604440932636672 0 0 -1 6 0 0 0
[pid=21677] ppid=21554 vsize=494424 CPUtime=0.34 cores=0,2,4,6
/proc/21677/stat : 21677 (python) S 21554 21554 21052 0 -1 4202560 1215 0 0 0 20 14 0 0 15 0 2 0 538642845 506290176 41645 33554432000 4194304 5683644 140734544083696 18446744073709551615 271550557766 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/21677/statm: 123606 41645 405 364 0 59503 0
[pid=21679] ppid=21677 vsize=506764 CPUtime=203.71 cores=0,2,4,6
/proc/21679/stat : 21679 (cryptominisat-2) R 21677 21679 21679 0 -1 4202496 138427 0 0 0 20351 20 0 0 25 0 1 0 538642846 518926336 112644 33554432000 4194304 4677096 140735125664032 18446744073709551615 4319403 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/21679/statm: 126691 112644 393 118 0 121650 0
[pid=21677/tid=21686] ppid=21554 vsize=494424 CPUtime=0 cores=0,2,4,6
/proc/21677/task/21686/stat : 21686 (python) S 21554 21554 21052 0 -1 4202560 49 0 0 0 0 0 0 0 17 0 2 0 538653070 506290176 41645 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 514 18446604453953221632 0 0 -1 2 0 0 0
[pid=21554/tid=21567] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21567/stat : 21567 (python) S 21552 21554 21052 0 -1 4202560 29 933 0 0 0 0 0 0 18 0 9 0 538554129 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 6 0 0 0
[pid=21554/tid=21570] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21570/stat : 21570 (python) S 21552 21554 21052 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 9 0 538554132 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 0 0 0 0
[pid=21554/tid=21573] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21573/stat : 21573 (python) S 21552 21554 21052 0 -1 4202560 27 933 0 0 0 0 0 0 18 0 9 0 538554135 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 0 0 0 0
[pid=21554/tid=21576] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21576/stat : 21576 (python) S 21552 21554 21052 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 538554138 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 2 0 0 0
[pid=21554/tid=21583] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21583/stat : 21583 (python) S 21552 21554 21052 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 9 0 538564144 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 2 0 0 0
[pid=21554/tid=21658] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21658/stat : 21658 (python) S 21552 21554 21052 0 -1 4202560 37 933 0 0 0 0 0 0 18 0 9 0 538602926 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 2 0 0 0
[pid=21554/tid=21674] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21674/stat : 21674 (python) S 21552 21554 21052 0 -1 4202560 32 933 0 0 0 0 0 0 20 0 9 0 538642178 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 2 0 0 0
[pid=21554/tid=21678] ppid=21552 vsize=504668 CPUtime=0 cores=0,2,4,6
/proc/21554/task/21678/stat : 21678 (python) S 21552 21554 21052 0 -1 4202560 32 933 0 0 0 0 0 0 18 0 9 0 538642846 516780032 43133 33554432000 4194304 5683644 140734544083696 18446744073709551615 271562361265 0 0 16781312 2 18446604453953223424 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.37
Current children cumulated vsize (KiB) 6431168

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21554 and gives
#  childrusage.ru_utime.tv_sec=109
#  childrusage.ru_utime.tv_usec=745316
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=251961
# CPU time returned by wait4() is 109.997
# while last known CPU time is 4800.37
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1285.26
CPU time (s): 4800.37
CPU user time (s): 4795.79
CPU system time (s): 4.58
CPU usage (%): 373.493
Max. virtual memory (cumulated for all children) (KiB): 6463592

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 109.745
system time used= 0.251961
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 73306
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2939
involuntary context switches= 344

runsolver used 3.13452 second user time and 7.76382 second system time

The end

Launcher Data 

Begin job on node133 at 2011-05-01 19:04:12
IDJOB=3317916
IDBENCH=82459
IDSOLVER=1706
FILE ID=node133/3317916-1304269452
RUNJOBID= node133-1304267282-21070
PBS_JOBID= 13173946
Free space on /tmp= 72776 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/jarvisalo/smtqfbv-aigs/smtlib-qfbv-aigs-VS3-benchmark-S2-tseitin.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317916-1304269452/watcher-3317916-1304269452 -o /tmp/evaluation-result-3317916-1304269452/solver-3317916-1304269452 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317916-1304269452.cnf -seed 1401861513 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b967fca11e85ef5b614d3452b1c4b2ad
RANDOM SEED=1401861513

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28423548 kB
Buffers:        570824 kB
Cached:        1414604 kB
SwapCached:        124 kB
Active:        2466836 kB
Inactive:      1707144 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28423548 kB
SwapTotal:    67111528 kB
SwapFree:     67111336 kB
Dirty:           45500 kB
Writeback:           0 kB
AnonPages:     2187940 kB
Mapped:          22548 kB
Slab:           285400 kB
PageTables:       9944 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  2551992 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72816 MiB
End job on node133 at 2011-05-01 19:25:40