Trace number 3322633

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 5636.46 1037.65

General information on the benchmark

NameSAT04/industrial/velev/vliw_unsat_2.0/
9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf
MD5SUM776da55785376fd8eac6989ca812b102
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark935.02
Satisfiable
(Un)Satisfiability was proved
Number of variables371419
Number of clauses7170909
Sum of the clauses size20872419
Maximum clause length205
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 26770451
Number of clauses of size 392326
Number of clauses of size 48862
Number of clauses of size 523554
Number of clauses of size over 5275715

Solver Data 

0.36/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.36/0.67	c INFO: solving HOME/instance-3322633-1304355095.cnf
0.36/0.67	c INFO: computing task features
28.72/29.09	c INFO: computed variable-clause graph statistics
29.63/29.97	c INFO: computed clause balance statistics
138.83/139.17	c INFO: computed variable balance statistics
211.83/212.18	c INFO: computed small-clause counts
214.83/215.12	c INFO: computed Horn-clause counts
378.04/378.33	c INFO: computed variable graph statistics
378.04/378.35	c INFO: collected features for HOME/instance-3322633-1304355095.cnf in 376.37 s
378.04/378.39	c INFO: running lingeling-276@0 for 97 with 39622 remaining (b = 0.78)
378.14/378.43	c INFO: running lingeling-276@0 for 485 with 39622 remaining (b = 0.88)
378.14/378.48	c INFO: running precosat-570@0 for 97 with 39622 remaining (b = 0.59)
378.23/378.52	c INFO: running lingeling-276@0 for 97 with 39622 remaining (b = 0.38)
378.23/378.57	c INFO: running cryptominisat-2.9.0@0 for 485 with 39622 remaining (b = 0.37)
378.33/378.61	c INFO: running cryptominisat-2.9.0@0 for 582 with 39622 remaining (b = 0.30)
378.33/378.66	c INFO: running precosat-570@0 for 97 with 39622 remaining (b = 0.11)
378.43/378.71	c INFO: running cryptominisat-2.9.0@0 for 1261 with 39621 remaining (b = 0.42)
1163.07/476.82	c INFO: running lingeling-276@0 for 1164 with 39523 remaining (b = 0.32)
1169.46/477.68	c INFO: running glucosER@0 for 291 with 39523 remaining (b = 0.26)
1178.20/478.76	c INFO: running precosat-570@0 for 97 with 39521 remaining (b = 0.11)
1179.79/478.96	c INFO: running precosat-570@0 for 97 with 39521 remaining (b = 0.11)
1978.62/579.01	c INFO: running precosat-570@99 for 97 with 39421 remaining (b = 0.11)
1987.41/580.19	c INFO: running lingeling-276@0 for 776 with 39420 remaining (b = 0.34)
2738.53/674.23	c INFO: running lingeling-276@0 for 97 with 39326 remaining (b = 0.51)
3537.98/774.52	c INFO: running glucosER@0 for 291 with 39226 remaining (b = 0.26)
3552.30/776.34	c INFO: running glucosER@99 for 97 with 39224 remaining (b = 0.13)
4288.92/868.69	c INFO: running precosat-570@199 for 97 with 39132 remaining (b = 0.10)
4295.30/869.49	c INFO: running precosat-570@100 for 97 with 39131 remaining (b = 0.13)
4312.05/871.57	c INFO: running precosat-570@0 for 97 with 39129 remaining (b = 0.20)
5065.16/965.94	c INFO: running lingeling-276@0 for 97 with 39034 remaining (b = 0.08)
5070.79/966.75	c INFO: running cryptominisat-2.9.0@0 for 1843 with 39033 remaining (b = 0.46)
5096.99/970.00	c INFO: running precosat-570@194 for 194 with 39030 remaining (b = 0.05)
5112.90/971.91	c INFO: running precosat-570@96 for 97 with 39028 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322633-1304355095/watcher-3322633-1304355095 -o /tmp/evaluation-result-3322633-1304355095/solver-3322633-1304355095 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3322633-1304355095.cnf -seed 1878574111 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.55 7.31 7.75 1/272 12185
/proc/meminfo: memFree=12604064/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=15384 CPUtime=0 cores=0-7
/proc/12185/stat : 12185 (python) S 12183 12185 11828 0 -1 4202496 820 0 0 0 0 0 0 0 21 0 1 0 547112623 15753216 705 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634513408 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/12185/statm: 3846 705 334 364 0 333 0

[startup+0.0880639 s]
/proc/loadavg: 6.55 7.31 7.75 1/272 12185
/proc/meminfo: memFree=12604064/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=50340 CPUtime=0.04 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 2011 0 0 0 4 0 0 0 21 0 1 0 547112623 51548160 1771 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634513408 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 12585 1771 480 364 0 1285 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 50340

[startup+0.101055 s]
/proc/loadavg: 6.55 7.31 7.75 1/272 12185
/proc/meminfo: memFree=12604064/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=85368 CPUtime=0.05 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 2605 0 0 0 4 1 0 0 18 0 1 0 547112623 87416832 2325 33554432000 4194304 5683644 140736815557856 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 21342 2328 713 364 0 1559 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85368

[startup+0.301019 s]
/proc/loadavg: 6.55 7.31 7.75 1/272 12185
/proc/meminfo: memFree=12604064/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=135752 CPUtime=0.17 cores=0-7
/proc/12185/stat : 12185 (python) S 12183 12185 11828 0 -1 4202496 5961 937 1 0 14 3 0 0 18 0 1 0 547112623 139010048 4151 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634511365 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/12185/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135752

[startup+0.700943 s]
/proc/loadavg: 6.55 7.31 7.75 1/272 12185
/proc/meminfo: memFree=12604064/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=434428 CPUtime=0.42 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 19839 937 1 0 30 12 0 0 17 0 1 0 547112623 444854272 17524 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634515200 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 108607 17546 1758 364 0 44531 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 434428

[startup+1.5008 s]
/proc/loadavg: 6.55 7.31 7.75 2/273 12190
/proc/meminfo: memFree=12411896/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=483376 CPUtime=1.23 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 60018 937 1 0 103 20 0 0 18 0 1 0 547112623 494977024 57703 33554432000 4194304 5683644 140736815557856 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 120844 57703 1761 364 0 56768 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 483376

[startup+3.10054 s]
/proc/loadavg: 6.55 7.31 7.75 2/273 12190
/proc/meminfo: memFree=12345804/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=585572 CPUtime=2.83 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 85632 937 1 0 260 23 0 0 21 0 1 0 547112623 599625728 83317 33554432000 4194304 5683644 140736815557856 18446744073709551615 4539117 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 146393 83318 1761 364 0 82317 0
Current children cumulated CPU time (s) 2.83
Current children cumulated vsize (KiB) 585572

[startup+6.30096 s]
/proc/loadavg: 6.10 7.21 7.71 2/273 12190
/proc/meminfo: memFree=12135716/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=801484 CPUtime=6.03 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 136619 937 1 0 574 29 0 0 25 0 1 0 547112623 820719616 134304 33554432000 4194304 5683644 140736815557856 18446744073709551615 4602725 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 200371 134304 1761 364 0 136295 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 801484

[startup+12.7008 s]
/proc/loadavg: 5.69 7.11 7.67 2/273 12190
/proc/meminfo: memFree=11714576/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=1213708 CPUtime=12.43 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 238706 937 1 0 1201 42 0 0 25 0 1 0 547112623 1242836992 236391 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634176197 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 303427 236391 1761 364 0 239351 0
Current children cumulated CPU time (s) 12.43
Current children cumulated vsize (KiB) 1213708

[startup+25.5006 s]
/proc/loadavg: 4.65 6.81 7.56 2/273 12191
/proc/meminfo: memFree=11071856/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=1808040 CPUtime=25.23 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 731553 937 1 0 2426 97 0 0 25 0 1 0 547112623 1851432960 380677 33554432000 4194304 5683644 140736815557856 18446744073709551615 47267280295546 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 452010 380679 1814 364 0 387934 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 1808040

[startup+51.1011 s]
/proc/loadavg: 3.41 6.34 7.39 2/273 12191
/proc/meminfo: memFree=11280060/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=1586844 CPUtime=50.83 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 881058 937 1 0 4969 114 0 0 25 0 1 0 547112623 1624928256 334096 33554432000 4194304 5683644 140736815557856 18446744073709551615 47267280160450 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 396711 334096 1826 364 0 332635 0
Current children cumulated CPU time (s) 50.83
Current children cumulated vsize (KiB) 1586844

[startup+102.309 s]
/proc/loadavg: 2.04 5.51 7.05 2/273 12193
/proc/meminfo: memFree=11279840/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=1586844 CPUtime=102.04 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 881058 937 1 0 10090 114 0 0 25 0 1 0 547112623 1624928256 334096 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634211764 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 396711 334096 1826 364 0 332635 0
Current children cumulated CPU time (s) 102.04
Current children cumulated vsize (KiB) 1586844

[startup+162.301 s]
/proc/loadavg: 1.38 4.69 6.67 2/273 12194
/proc/meminfo: memFree=11279912/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=1586844 CPUtime=162.03 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 881059 937 1 0 16089 114 0 0 25 0 1 0 547112623 1624928256 334097 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634171953 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 396711 334097 1827 364 0 332635 0
Current children cumulated CPU time (s) 162.03
Current children cumulated vsize (KiB) 1586844

[startup+222.301 s]
/proc/loadavg: 1.14 4.02 6.31 2/273 12196
/proc/meminfo: memFree=11280364/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=1586844 CPUtime=222.03 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 1119167 937 1 0 22064 139 0 0 25 0 1 0 547112623 1624928256 334103 33554432000 4194304 5683644 140736815557856 18446744073709551615 47267279882368 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 396711 334103 1833 364 0 332635 0
Current children cumulated CPU time (s) 222.03
Current children cumulated vsize (KiB) 1586844

[startup+282.3 s]
/proc/loadavg: 1.05 3.46 5.98 2/273 12198
/proc/meminfo: memFree=11280584/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=1586844 CPUtime=282.03 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 1119167 937 1 0 28064 139 0 0 25 0 1 0 547112623 1624928256 334103 33554432000 4194304 5683644 140736815557856 18446744073709551615 47267279882380 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 396711 334103 1833 364 0 332635 0
Current children cumulated CPU time (s) 282.03
Current children cumulated vsize (KiB) 1586844

[startup+342.301 s]
/proc/loadavg: 1.02 3.01 5.66 2/273 12199
/proc/meminfo: memFree=11280416/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=1586844 CPUtime=342.03 cores=0-7
/proc/12185/stat : 12185 (python) R 12183 12185 11828 0 -1 4202496 1119167 937 1 0 34064 139 0 0 25 0 1 0 547112623 1624928256 334103 33554432000 4194304 5683644 140736815557856 18446744073709551615 47267279882380 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12185/statm: 396711 334103 1833 364 0 332635 0
Current children cumulated CPU time (s) 342.03
Current children cumulated vsize (KiB) 1586844

[startup+402.301 s]
/proc/loadavg: 2.99 3.10 5.52 9/297 12225
/proc/meminfo: memFree=6994260/32951124 swapFree=67111528/67111528
[pid=12185] ppid=12183 vsize=1115300 CPUtime=378.46 cores=0-7
/proc/12185/stat : 12185 (python) S 12183 12185 11828 0 -1 4202496 1124655 937 1 0 37689 157 0 0 20 0 9 0 547112623 1142067200 179575 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646342091 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/12185/statm: 278825 179575 1889 364 0 214722 0
[pid=12201] ppid=12185 vsize=967728 CPUtime=0.06 cores=0-7
/proc/12201/stat : 12201 (python) S 12185 12185 11828 0 -1 4202560 917 0 0 0 2 4 0 0 18 0 1 0 547150462 990953472 177861 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535439 0 0 16781312 514 4783895927616143619 0 0 17 1 0 0 0
/proc/12201/statm: 241932 177861 376 364 0 177850 0
[pid=12203] ppid=12201 vsize=243688 CPUtime=23.86 cores=0-7
/proc/12203/stat : 12203 (lingeling) R 12201 12203 12203 0 -1 4202496 90175 0 0 0 2364 22 0 0 25 0 1 0 547150464 249536512 60091 33554432000 4194304 4352236 140733635375792 18446744073709551615 4235483 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/12203/statm: 60922 60091 129 39 0 60002 0
[pid=12204] ppid=12185 vsize=977984 CPUtime=0.05 cores=0-7
/proc/12204/stat : 12204 (python) S 12185 12185 11828 0 -1 4202560 924 0 0 0 2 3 0 0 18 0 1 0 547150466 1001455616 177859 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 4783895927616143620 0 0 17 0 0 0 0
/proc/12204/statm: 244496 177859 370 364 0 180411 0
[pid=12206] ppid=12204 vsize=244816 CPUtime=23.82 cores=0-7
/proc/12206/stat : 12206 (lingeling) R 12204 12206 12206 0 -1 4202496 90573 0 0 0 2364 18 0 0 25 0 1 0 547150468 250691584 60374 33554432000 4194304 4352236 140734555967808 18446744073709551615 4328100 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/12206/statm: 61204 60374 129 39 0 60284 0
[pid=12207] ppid=12185 vsize=988240 CPUtime=0.07 cores=0-7
/proc/12207/stat : 12207 (python) S 12185 12185 11828 0 -1 4202560 904 0 0 0 3 4 0 0 18 0 1 0 547150471 1011957760 177863 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 4783895927616143617 0 0 17 1 0 0 0
/proc/12207/statm: 247060 177863 370 364 0 182972 0
[pid=12209] ppid=12207 vsize=816984 CPUtime=23.77 cores=0-7
/proc/12209/stat : 12209 (precosat) R 12207 12209 12209 0 -1 4202496 204594 0 0 0 2338 39 0 0 25 0 1 0 547150473 836591616 196142 33554432000 4194304 4890832 140734591067920 18446744073709551615 4287795 0 0 16781312 17442 0 0 0 17 4 0 0 0
/proc/12209/statm: 204246 196142 80 171 0 204073 0
[pid=12210] ppid=12185 vsize=998496 CPUtime=0.07 cores=0-7
/proc/12210/stat : 12210 (python) S 12185 12185 11828 0 -1 4202560 943 0 0 0 2 5 0 0 18 0 1 0 547150475 1022459904 177867 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 4783895927616143617 0 0 17 7 0 0 0
/proc/12210/statm: 249624 177867 370 364 0 185533 0
[pid=12212] ppid=12210 vsize=243480 CPUtime=23.73 cores=0-7
/proc/12212/stat : 12212 (lingeling) R 12210 12212 12212 0 -1 4202496 90107 0 0 0 2352 21 0 0 25 0 1 0 547150477 249323520 60040 33554432000 4194304 4352236 140736507446608 18446744073709551615 4233908 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/12212/statm: 60870 60040 129 39 0 59950 0
[pid=12213] ppid=12185 vsize=1074288 CPUtime=0.06 cores=0-7
/proc/12213/stat : 12213 (python) S 12185 12185 11828 0 -1 4202560 806 0 0 0 2 4 0 0 15 0 1 0 547150480 1100070912 177989 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 5777106775513727236 0 0 17 1 0 0 0
/proc/12213/statm: 268572 177989 371 364 0 204478 0
[pid=12215] ppid=12213 vsize=962632 CPUtime=23.62 cores=0-7
/proc/12215/stat : 12215 (cryptominisat-2) R 12213 12215 12215 0 -1 4202496 212282 0 0 0 2332 30 0 0 25 0 1 0 547150482 985735168 203169 33554432000 4194304 4677096 140734828879216 18446744073709551615 4335485 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/12215/statm: 240658 203169 375 118 0 235617 0
[pid=12216] ppid=12185 vsize=1084544 CPUtime=0.06 cores=0-7

################
# More data... #
################

[pid=12185/tid=12217] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12217/stat : 12217 (python) S 12183 12185 11828 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 14 0 547150486 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 7 0 0 0
[pid=12185/tid=12220] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12220/stat : 12220 (python) S 12183 12185 11828 0 -1 4202560 52 937 0 0 0 0 0 0 18 0 14 0 547150491 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 6 0 0 0
[pid=12185/tid=12223] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12223/stat : 12223 (python) S 12183 12185 11828 0 -1 4202560 34 937 0 0 0 0 0 0 20 0 14 0 547150496 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 1 0 0 0
[pid=12185/tid=12231] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12231/stat : 12231 (python) S 12183 12185 11828 0 -1 4202560 46 937 0 0 0 0 0 0 18 0 14 0 547160393 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 6 0 0 0
[pid=12185/tid=12250] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12250/stat : 12250 (python) S 12183 12185 11828 0 -1 4202560 40 937 0 0 0 0 0 0 20 0 14 0 547180048 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 6 0 0 0
[pid=12185/tid=12260] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12260/stat : 12260 (python) S 12183 12185 11828 0 -1 4202560 34 937 0 0 0 0 0 0 20 0 14 0 547190077 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 1 0 0 0
[pid=12185/tid=12268] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12268/stat : 12268 (python) S 12183 12185 11828 0 -1 4202560 44 937 0 0 0 0 0 0 18 0 14 0 547199782 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 1 0 0 0
[pid=12185/tid=12274] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12274/stat : 12274 (python) S 12183 12185 11828 0 -1 4202560 34 937 0 0 0 0 0 0 20 0 14 0 547209219 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5636.46
Current children cumulated vsize (KiB) 31793084

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1037.5 s]
/proc/loadavg: 8.03 7.50 6.79 9/322 12279
/proc/meminfo: memFree=96168/32951124 swapFree=67111524/67111528
[pid=12185] ppid=12183 vsize=1166580 CPUtime=379.18 cores=0-7
/proc/12185/stat : 12185 (python) S 12183 12185 11828 0 -1 4202496 1130114 937 1 0 37751 167 0 0 18 0 14 0 547112623 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646342091 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/12185/statm: 291645 179647 1900 364 0 227527 0
[pid=12201] ppid=12185 vsize=977972 CPUtime=1.22 cores=0-7
/proc/12201/stat : 12201 (python) S 12185 12185 11828 0 -1 4202560 1138 0 0 0 59 63 0 0 18 0 2 0 547150462 1001443328 177900 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/12201/statm: 244493 177900 410 364 0 180411 0
[pid=12203] ppid=12201 vsize=266240 CPUtime=555.93 cores=0-7
/proc/12203/stat : 12203 (lingeling) R 12201 12203 12203 0 -1 4202496 284028 0 0 0 55544 49 0 0 25 0 1 0 547150464 272629760 65729 33554432000 4194304 4352236 140733635375792 18446744073709551615 4207655 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/12203/statm: 66560 65729 129 39 0 65640 0
[pid=12201/tid=12229] ppid=12185 vsize=977972 CPUtime=0 cores=0-7
/proc/12201/task/12229/stat : 12229 (python) S 12185 12185 11828 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 547160388 1001443328 177900 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 514 18446604441594644352 0 0 -1 1 0 0 0
[pid=12204] ppid=12185 vsize=977984 CPUtime=1.06 cores=0-7
/proc/12204/stat : 12204 (python) S 12185 12185 11828 0 -1 4202560 1133 0 0 0 58 48 0 0 19 0 2 0 547150466 1001455616 177889 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/12204/statm: 244496 177889 399 364 0 180411 0
[pid=12206] ppid=12204 vsize=237004 CPUtime=490.82 cores=0-7
/proc/12206/stat : 12206 (lingeling) T 12204 12206 12206 0 -1 4202496 269927 0 0 0 49037 45 0 0 25 0 1 0 547150468 242692096 58421 33554432000 4194304 4352236 140734555967808 18446744073709551615 4234513 0 0 16781312 17506 18446744071562691360 0 0 17 4 0 0 0
/proc/12206/statm: 59251 58421 129 39 0 58331 0
[pid=12204/tid=12266] ppid=12185 vsize=977984 CPUtime=0 cores=0-7
/proc/12204/task/12266/stat : 12266 (python) S 12185 12185 11828 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 547199568 1001455616 177889 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 514 18446604452805563456 0 0 -1 0 0 0 0
[pid=12207] ppid=12185 vsize=1053776 CPUtime=0.88 cores=0-7
/proc/12207/stat : 12207 (python) S 12185 12185 11828 0 -1 4202560 1151 0 0 0 42 46 0 0 18 0 2 0 547150471 1079066624 177895 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/12207/statm: 263444 177895 399 364 0 199356 0
[pid=12209] ppid=12207 vsize=825124 CPUtime=390.84 cores=0-7
/proc/12209/stat : 12209 (precosat) T 12207 12209 12209 0 -1 4202496 229365 0 0 0 39041 43 0 0 25 0 1 0 547150473 844926976 202842 33554432000 4194304 4890832 140734591067920 18446744073709551615 4232252 0 0 16781312 17442 18446744071562691360 0 0 17 1 0 0 0
/proc/12209/statm: 206281 202842 86 171 0 206108 0
[pid=12207/tid=12233] ppid=12185 vsize=1053776 CPUtime=0 cores=0-7
/proc/12207/task/12233/stat : 12233 (python) S 12185 12185 11828 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 547160496 1079066624 177895 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 514 18446604449295606848 0 0 -1 4 0 0 0
[pid=12210] ppid=12185 vsize=998496 CPUtime=1.44 cores=0-7
/proc/12210/stat : 12210 (python) S 12185 12185 11828 0 -1 4202560 1168 0 0 0 65 79 0 0 18 0 2 0 547150475 1022459904 177897 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/12210/statm: 249624 177897 399 364 0 185533 0
[pid=12212] ppid=12210 vsize=231664 CPUtime=658.91 cores=0-7
/proc/12212/stat : 12212 (lingeling) R 12210 12212 12212 0 -1 4202496 274761 0 0 0 65847 44 0 0 25 0 1 0 547150477 237223936 57086 33554432000 4194304 4352236 140736507446608 18446744073709551615 4241523 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/12212/statm: 57916 57086 129 39 0 56996 0
[pid=12210/tid=12228] ppid=12185 vsize=998496 CPUtime=0 cores=0-7
/proc/12210/task/12228/stat : 12228 (python) S 12185 12185 11828 0 -1 4202560 49 0 0 0 0 0 0 0 19 0 2 0 547160302 1022459904 177897 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 514 18446604453976596928 0 0 -1 7 0 0 0
[pid=12213] ppid=12185 vsize=1074288 CPUtime=1.3 cores=0-7
/proc/12213/stat : 12213 (python) S 12185 12185 11828 0 -1 4202560 1031 0 0 0 66 64 0 0 15 0 2 0 547150480 1100070912 178018 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/12213/statm: 268572 178018 399 364 0 204478 0
[pid=12215] ppid=12213 vsize=3936960 CPUtime=559.63 cores=0-7
/proc/12215/stat : 12215 (cryptominisat-2) R 12213 12215 12215 0 -1 4202496 854133 0 0 0 55817 146 0 0 25 0 1 0 547150482 4031447040 775421 33554432000 4194304 4677096 140734828879216 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/12215/statm: 984240 775421 391 118 0 979199 0
[pid=12213/tid=12265] ppid=12185 vsize=1074288 CPUtime=0 cores=0-7
/proc/12213/task/12265/stat : 12265 (python) S 12185 12185 11828 0 -1 4202560 98 0 0 0 0 0 0 0 16 0 2 0 547199489 1100070912 178018 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 514 18446604442890426432 0 0 -1 0 0 0 0
[pid=12216] ppid=12185 vsize=1084544 CPUtime=1.37 cores=0-7
/proc/12216/stat : 12216 (python) S 12185 12185 11828 0 -1 4202560 994 0 0 0 64 73 0 0 16 0 2 0 547150485 1110573056 178007 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/12216/statm: 271136 178007 399 364 0 207039 0
[pid=12218] ppid=12216 vsize=3709220 CPUtime=584.42 cores=0-7
/proc/12218/stat : 12218 (cryptominisat-2) T 12216 12218 12218 0 -1 4202496 832786 0 0 0 58303 139 0 0 25 0 1 0 547150486 3798241280 741754 33554432000 4194304 4677096 140735332975728 18446744073709551615 4318809 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/12218/statm: 927305 741754 393 118 0 922264 0
[pid=12216/tid=12276] ppid=12185 vsize=1084544 CPUtime=0 cores=0-7
/proc/12216/task/12276/stat : 12276 (python) S 12185 12185 11828 0 -1 4202560 66 0 0 0 0 0 0 0 16 0 2 0 547209618 1110573056 178007 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 514 18446604442890425536 0 0 -1 4 0 0 0
[pid=12219] ppid=12185 vsize=1094800 CPUtime=0.81 cores=0-7
/proc/12219/stat : 12219 (python) S 12185 12185 11828 0 -1 4202560 1000 0 0 0 40 41 0 0 18 0 2 0 547150489 1121075200 178003 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/12219/statm: 273700 178003 399 364 0 209600 0
[pid=12221] ppid=12219 vsize=1106452 CPUtime=364.49 cores=0-7
/proc/12221/stat : 12221 (precosat) R 12219 12221 12221 0 -1 4202496 279625 0 0 0 36400 49 0 0 25 0 1 0 547150493 1133006848 270957 33554432000 4194304 4890832 140733194018928 18446744073709551615 4238312 0 0 16781312 17442 0 0 0 17 0 0 0 0
/proc/12221/statm: 276613 270957 86 171 0 276440 0
[pid=12219/tid=12234] ppid=12185 vsize=1094800 CPUtime=0 cores=0-7
/proc/12219/task/12234/stat : 12234 (python) S 12185 12185 11828 0 -1 4202560 71 0 0 0 0 0 0 0 18 0 2 0 547160515 1121075200 178003 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 514 18446604443312822272 0 0 -1 0 0 0 0
[pid=12222] ppid=12185 vsize=1105056 CPUtime=1.54 cores=0-7
/proc/12222/stat : 12222 (python) S 12185 12185 11828 0 -1 4202560 883 0 0 0 81 73 0 0 15 0 1 0 547150494 1131577344 178059 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 4783895927616143620 0 0 17 7 0 0 0
/proc/12222/statm: 276264 178059 377 364 0 212161 0
[pid=12224] ppid=12222 vsize=3919424 CPUtime=650.01 cores=0-7
/proc/12224/stat : 12224 (cryptominisat-2) R 12222 12224 12224 0 -1 4202496 914442 0 0 0 64854 147 0 0 25 0 1 0 547150496 4013490176 778311 33554432000 4194304 4677096 140733403787456 18446744073709551615 4320291 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/12224/statm: 979856 778311 393 118 0 974815 0
[pid=12230] ppid=12185 vsize=1115312 CPUtime=0.83 cores=0-7
/proc/12230/stat : 12230 (python) S 12185 12185 11828 0 -1 4202560 1028 0 0 0 44 39 0 0 18 0 2 0 547160391 1142079488 178053 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/12230/statm: 278828 178053 399 364 0 214722 0
[pid=12232] ppid=12230 vsize=519764 CPUtime=391.99 cores=0-7
/proc/12232/stat : 12232 (glucoser_static) T 12230 12232 12232 0 -1 4202496 121912 0 0 0 39173 26 0 0 25 0 1 0 547160393 532238336 121636 33554432000 134512640 134580299 4288357184 18446744073709551615 134552965 0 0 16781312 8388611 18446744071562691360 0 0 17 0 0 0 0
/proc/12232/statm: 129941 121636 243 17 0 129269 0
[pid=12230/tid=12262] ppid=12185 vsize=1115312 CPUtime=0 cores=0-7
/proc/12230/task/12262/stat : 12262 (python) S 12185 12185 11828 0 -1 4202560 81 0 0 0 0 0 0 0 18 0 2 0 547190253 1142079488 178053 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 514 18446604442861363392 0 0 -1 1 0 0 0
[pid=12249] ppid=12185 vsize=1125568 CPUtime=0.22 cores=0-7
/proc/12249/stat : 12249 (python) S 12185 12185 11828 0 -1 4202560 1027 0 0 0 11 11 0 0 19 0 2 0 547180047 1152581632 178074 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/12249/statm: 281392 178074 399 364 0 217283 0
[pid=12251] ppid=12249 vsize=232460 CPUtime=99.95 cores=0-7
/proc/12251/stat : 12251 (lingeling) T 12249 12251 12251 0 -1 4202496 117653 0 0 0 9966 29 0 0 25 0 1 0 547180049 238039040 57286 33554432000 4194304 4352236 140733945986704 18446744073709551615 4239114 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/12251/statm: 58115 57286 129 39 0 57195 0
[pid=12249/tid=12258] ppid=12185 vsize=1125568 CPUtime=0 cores=0-7
/proc/12249/task/12258/stat : 12258 (python) S 12185 12185 11828 0 -1 4202560 77 0 0 0 0 0 0 0 19 0 2 0 547190072 1152581632 178074 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 514 18446604442861366080 0 0 -1 1 0 0 0
[pid=12259] ppid=12185 vsize=1135824 CPUtime=0.57 cores=0-7
/proc/12259/stat : 12259 (python) S 12185 12185 11828 0 -1 4202560 848 0 0 0 29 28 0 0 18 0 1 0 547190076 1163083776 178065 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 4783895927616143616 0 0 17 6 0 0 0
/proc/12259/statm: 283956 178065 371 364 0 219844 0
[pid=12261] ppid=12259 vsize=506340 CPUtime=262.71 cores=0-7
/proc/12261/stat : 12261 (glucoser_static) R 12259 12261 12261 0 -1 4202496 118539 0 0 0 26241 30 0 0 25 0 1 0 547190078 518492160 118262 33554432000 134512640 134580299 4290663856 18446744073709551615 134543205 0 0 16781312 8388611 0 0 0 17 4 0 0 0
/proc/12261/statm: 126585 118262 243 17 0 125913 0
[pid=12267] ppid=12185 vsize=1146080 CPUtime=0.37 cores=0-7
/proc/12267/stat : 12267 (python) S 12185 12185 11828 0 -1 4202560 1044 0 0 0 18 19 0 0 18 0 2 0 547199780 1173585920 178074 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/12267/statm: 286520 178074 399 364 0 222405 0
[pid=12269] ppid=12267 vsize=834340 CPUtime=164.55 cores=0-7
/proc/12269/stat : 12269 (precosat) R 12267 12269 12269 0 -1 4202496 223390 0 0 0 16407 48 0 0 25 0 1 0 547199782 854364160 205274 33554432000 4194304 4890832 140735548093664 18446744073709551615 4246473 0 0 16781312 17442 0 0 0 17 6 0 0 0
/proc/12269/statm: 208585 205274 86 171 0 208412 0
[pid=12267/tid=12277] ppid=12185 vsize=1146080 CPUtime=0 cores=0-7
/proc/12267/task/12277/stat : 12277 (python) S 12185 12185 11828 0 -1 4202560 76 0 0 0 0 0 0 0 19 0 2 0 547209809 1173585920 178074 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 514 18446604453922179072 0 0 -1 1 0 0 0
[pid=12273] ppid=12185 vsize=1156336 CPUtime=0.17 cores=0-7
/proc/12273/stat : 12273 (python) S 12185 12185 11828 0 -1 4202560 862 0 0 0 8 9 0 0 18 0 1 0 547209218 1184088064 178118 33554432000 4194304 5683644 140736815557856 18446744073709551615 216634535494 0 0 16781312 514 4783895927616143620 0 0 17 6 0 0 0
/proc/12273/statm: 289084 178118 371 364 0 224966 0
[pid=12275] ppid=12273 vsize=255476 CPUtime=71.25 cores=0-7
/proc/12275/stat : 12275 (lingeling) R 12273 12275 12275 0 -1 4202496 117901 0 0 0 7098 27 0 0 25 0 1 0 547209220 261607424 63039 33554432000 4194304 4352236 140737187930656 18446744073709551615 4207874 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/12275/statm: 63869 63039 129 39 0 62949 0
[pid=12185/tid=12202] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12202/stat : 12202 (python) S 12183 12185 11828 0 -1 4202560 31 937 0 0 0 0 0 0 18 0 14 0 547150464 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 6 0 0 0
[pid=12185/tid=12205] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12205/stat : 12205 (python) S 12183 12185 11828 0 -1 4202560 21 937 0 0 0 0 0 0 25 0 14 0 547150468 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 0 0 0 0
[pid=12185/tid=12208] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12208/stat : 12208 (python) S 12183 12185 11828 0 -1 4202560 42 937 0 0 0 0 0 0 18 0 14 0 547150473 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 4 0 0 0
[pid=12185/tid=12211] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12211/stat : 12211 (python) S 12183 12185 11828 0 -1 4202560 31 937 0 0 0 0 0 0 18 0 14 0 547150477 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 5 0 0 0
[pid=12185/tid=12214] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12214/stat : 12214 (python) S 12183 12185 11828 0 -1 4202560 70 937 0 0 0 0 0 0 18 0 14 0 547150482 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 0 0 0 0
[pid=12185/tid=12217] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12217/stat : 12217 (python) S 12183 12185 11828 0 -1 4202560 30 937 0 0 0 0 0 0 20 0 14 0 547150486 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 7 0 0 0
[pid=12185/tid=12220] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12220/stat : 12220 (python) S 12183 12185 11828 0 -1 4202560 52 937 0 0 0 0 0 0 18 0 14 0 547150491 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 6 0 0 0
[pid=12185/tid=12223] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12223/stat : 12223 (python) S 12183 12185 11828 0 -1 4202560 34 937 0 0 0 0 0 0 20 0 14 0 547150496 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 1 0 0 0
[pid=12185/tid=12231] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12231/stat : 12231 (python) S 12183 12185 11828 0 -1 4202560 46 937 0 0 0 0 0 0 18 0 14 0 547160393 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 6 0 0 0
[pid=12185/tid=12250] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12250/stat : 12250 (python) S 12183 12185 11828 0 -1 4202560 40 937 0 0 0 0 0 0 20 0 14 0 547180048 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 6 0 0 0
[pid=12185/tid=12260] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12260/stat : 12260 (python) S 12183 12185 11828 0 -1 4202560 34 937 0 0 0 0 0 0 20 0 14 0 547190077 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 1 0 0 0
[pid=12185/tid=12268] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12268/stat : 12268 (python) S 12183 12185 11828 0 -1 4202560 44 937 0 0 0 0 0 0 18 0 14 0 547199782 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 1 0 0 0
[pid=12185/tid=12274] ppid=12183 vsize=1166580 CPUtime=0 cores=0-7
/proc/12185/task/12274/stat : 12274 (python) S 12183 12185 11828 0 -1 4202560 34 937 0 0 0 0 0 0 20 0 14 0 547209219 1194577920 179647 33554432000 4194304 5683644 140736815557856 18446744073709551615 216646338993 0 0 16781312 2 18446604446305057664 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5636.46
Current children cumulated vsize (KiB) 31793084

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 12185 and gives
#  childrusage.ru_utime.tv_sec=377
#  childrusage.ru_utime.tv_usec=516608
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=722738
# CPU time returned by wait4() is 379.239
# while last known CPU time is 5636.46
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1037.65
CPU time (s): 5636.46
CPU user time (s): 5620.64
CPU system time (s): 15.82
CPU usage (%): 543.197
Max. virtual memory (cumulated for all children) (KiB): 31793084

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 377.517
system time used= 1.72274
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1131059
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3107
involuntary context switches= 565

runsolver used 3.90641 second user time and 10.5104 second system time

The end

Launcher Data 

Begin job on node103 at 2011-05-02 18:51:40
IDJOB=3322633
IDBENCH=85005
IDSOLVER=1710
FILE ID=node103/3322633-1304355095
RUNJOBID= node103-1304349970-11842
PBS_JOBID= 13178676
Free space on /tmp= 73320 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT04/industrial/velev/vliw_unsat_2.0/9dlx_vliw_at_b_iq8.used-as.sat04-718.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322633-1304355095/watcher-3322633-1304355095 -o /tmp/evaluation-result-3322633-1304355095/solver-3322633-1304355095 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3322633-1304355095.cnf -seed 1878574111 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 776da55785376fd8eac6989ca812b102
RANDOM SEED=1878574111

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12604220 kB
Buffers:       2162672 kB
Cached:       10770452 kB
SwapCached:          0 kB
Active:       12592396 kB
Inactive:      7131620 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12604220 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          188140 kB
Writeback:           0 kB
AnonPages:     6790428 kB
Mapped:          23768 kB
Slab:           530672 kB
PageTables:      27692 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 44517500 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73288 MiB
End job on node103 at 2011-05-02 19:09:00