Trace number 3321545

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 26531.3 3450.77

General information on the benchmark

Nameapplication/fuhs/
AProVE11/AProVE11-06.cnf
MD5SUM6fd7d026c372988cefc364000243d13f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1455.4
Satisfiable
(Un)Satisfiability was proved
Number of variables302076
Number of clauses1039056
Sum of the clauses size2729970
Maximum clause length978
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2420562
Number of clauses of size 3588399
Number of clauses of size 429561
Number of clauses of size 569
Number of clauses of size over 5464

Solver Data 

0.40/0.70	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.40/0.70	c INFO: solving HOME/instance-3321545-1304345345.cnf
0.40/0.70	c INFO: computing task features
4.12/4.42	c INFO: computed variable-clause graph statistics
4.21/4.54	c INFO: computed clause balance statistics
22.21/22.51	c INFO: computed variable balance statistics
35.92/36.30	c INFO: computed small-clause counts
36.31/36.64	c INFO: computed Horn-clause counts
140.71/141.06	c INFO: computed variable graph statistics
140.71/141.06	c INFO: collected features for HOME/instance-3321545-1304345345.cnf in 140.24 s
140.71/141.09	c INFO: running lingeling-276@0 for 97 with 39859 remaining (b = 0.54)
140.81/141.12	c INFO: running cryptominisat-2.9.0@0 for 485 with 39859 remaining (b = 0.34)
140.81/141.16	c INFO: running cryptominisat-2.9.0@0 for 485 with 39859 remaining (b = 0.28)
140.90/141.20	c INFO: running lingeling-276@0 for 1261 with 39859 remaining (b = 0.42)
140.90/141.23	c INFO: running lingeling-276@0 for 1261 with 39859 remaining (b = 0.36)
140.90/141.27	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39859 remaining (b = 0.46)
141.01/141.31	c INFO: running SApperloT@0 for 97 with 39859 remaining (b = 0.02)
141.01/141.35	c INFO: running precosat-570@0 for 291 with 39859 remaining (b = 0.14)
940.35/241.31	c INFO: running cryptominisat-2.9.0@0 for 97 with 39759 remaining (b = 0.03)
941.74/241.57	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39759 remaining (b = 0.40)
1748.03/342.51	c INFO: running lingeling-276@0 for 970 with 39658 remaining (b = 0.18)
2477.63/433.91	c INFO: running precosat-570@100 for 291 with 39566 remaining (b = 0.11)
4030.13/628.49	c INFO: running precosat-570@0 for 388 with 39372 remaining (b = 0.13)
4067.66/633.14	c INFO: running lingeling-276@0 for 194 with 39367 remaining (b = 0.07)
4820.31/727.44	c INFO: running precosat-570@585 for 97 with 39273 remaining (b = 0.03)
5580.19/822.65	c INFO: running precosat-570@0 for 97 with 39178 remaining (b = 0.02)
5635.22/829.54	c INFO: running precosat-570@680 for 97 with 39171 remaining (b = 0.03)
6372.77/921.93	c INFO: running lingeling-276@293 for 97 with 39078 remaining (b = 0.02)
6411.06/926.76	c INFO: running cryptominisat-2.9.0@100 for 1843 with 39073 remaining (b = 0.32)
7133.40/1017.20	c INFO: running precosat-570@195 for 194 with 38983 remaining (b = 0.05)
7166.13/1021.39	c INFO: running lingeling-276@0 for 97 with 38979 remaining (b = 0.05)
7966.69/1121.65	c INFO: running precosat-570@490 for 194 with 38879 remaining (b = 0.04)
8676.23/1210.58	c INFO: running precosat-570@588 for 97 with 38790 remaining (b = 0.02)
9479.20/1311.17	c INFO: running lingeling-276@291 for 97 with 38689 remaining (b = 0.02)
9484.70/1311.81	c INFO: running precosat-570@1557 for 97 with 38688 remaining (b = 0.02)
9510.22/1315.04	c INFO: running lingeling-276@390 for 873 with 38685 remaining (b = 0.13)
10244.52/1407.02	c INFO: running cryptominisat-2.9.0@0 for 97 with 38593 remaining (b = 0.02)
10246.65/1407.37	c INFO: running precosat-570@1750 for 485 with 38593 remaining (b = 0.07)
10286.81/1412.40	c INFO: running cryptominisat-2.9.0@0 for 1843 with 38588 remaining (b = 0.25)
10456.49/1433.63	c INFO: running cryptominisat-2.9.0@0 for 1843 with 38567 remaining (b = 0.22)
11054.39/1508.68	c INFO: running precosat-570@683 for 97 with 38492 remaining (b = 0.03)
11830.15/1605.92	c INFO: running cryptominisat-2.9.0@1266 for 97 with 38394 remaining (b = 0.02)
12593.88/1701.73	c INFO: running precosat-570@0 for 291 with 38299 remaining (b = 0.07)
13336.72/1794.96	c INFO: running cryptominisat-2.9.0@1361 for 97 with 38205 remaining (b = 0.02)
14121.12/1893.33	c INFO: running precosat-570@779 for 582 with 38107 remaining (b = 0.10)
14121.92/1893.49	c INFO: running cryptominisat-2.9.0@1844 for 97 with 38107 remaining (b = 0.03)
14926.32/1994.36	c INFO: running precosat-570@780 for 582 with 38006 remaining (b = 0.10)
14935.80/1995.51	c INFO: running cryptominisat-2.9.0@0 for 97 with 38005 remaining (b = 0.02)
15727.35/2094.88	c INFO: running lingeling-276@99 for 194 with 37905 remaining (b = 0.03)
16502.25/2192.04	c INFO: running precosat-570@0 for 388 with 37808 remaining (b = 0.06)
16627.43/2207.77	c INFO: running glucose@0 for 194 with 37792 remaining (b = 0.03)
17269.91/2288.39	c INFO: running lingeling-276@2041 for 97 with 37712 remaining (b = 0.02)
18077.44/2389.68	c INFO: running cryptominisat-2.9.0@2136 for 97 with 37611 remaining (b = 0.01)
18193.84/2404.23	c INFO: running glucose@192 for 97 with 37596 remaining (b = 0.02)
18817.23/2482.50	c INFO: running precosat-570@877 for 388 with 37518 remaining (b = 0.06)
18875.37/2489.76	c INFO: running lingeling-276@0 for 97 with 37511 remaining (b = 0.01)
19000.56/2505.49	c INFO: running precosat-570@1851 for 388 with 37495 remaining (b = 0.05)
19583.25/2578.54	c INFO: running lingeling-276@485 for 776 with 37422 remaining (b = 0.07)
19601.57/2580.85	c INFO: running lingeling-276@392 for 776 with 37419 remaining (b = 0.06)
19674.91/2590.04	c INFO: running cryptominisat-2.9.0@0 for 97 with 37410 remaining (b = 0.01)
20469.58/2689.76	c INFO: running glucose@779 for 5045 with 37311 remaining (b = 0.33)
21160.73/2776.42	c INFO: running precosat-570@879 for 388 with 37224 remaining (b = 0.05)
21923.42/2872.28	c INFO: running precosat-570@974 for 194 with 37128 remaining (b = 0.04)
22155.36/2901.35	c INFO: running precosat-570@878 for 388 with 37099 remaining (b = 0.05)
23497.61/3069.73	c INFO: running precosat-570@1649 for 582 with 36931 remaining (b = 0.06)
24234.82/3162.21	c INFO: running glucosER@0 for 5821 with 36838 remaining (b = 0.35)
25034.39/3262.65	c INFO: running cryptominisat-2.9.0@1266 for 97 with 36738 remaining (b = 0.02)
25235.11/3287.83	c INFO: running precosat-570@0 for 388 with 36712 remaining (b = 0.05)
25365.61/3304.21	c INFO: running precosat-570@1070 for 97 with 36696 remaining (b = 0.01)
25770.12/3355.05	c INFO: running lingeling-276@873 for 97 with 36645 remaining (b = 0.01)
25781.21/3356.41	c INFO: running cryptominisat-2.9.0@195 for 1746 with 36644 remaining (b = 0.15)
25828.13/3362.39	c INFO: running cryptominisat-2.9.0@3107 for 194 with 36638 remaining (b = 0.03)
26123.56/3399.48	c INFO: running precosat-570@1846 for 388 with 36601 remaining (b = 0.04)
26528.81/3450.31	c INFO: running glucose@0 for 5821 with 36550 remaining (b = 0.31)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321545-1304345345/watcher-3321545-1304345345 -o /tmp/evaluation-result-3321545-1304345345/solver-3321545-1304345345 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321545-1304345345.cnf -seed 1513692892 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.28 1.98 1.38 4/239 29351
/proc/meminfo: memFree=27519004/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=15384 CPUtime=0 cores=0-7
/proc/29351/stat : 29351 (python) S 29349 29351 28698 0 -1 4202496 811 0 0 0 0 0 0 0 17 0 1 0 278725899 15753216 696 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660660224 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/29351/statm: 3846 696 334 364 0 333 0

[startup+0.077071 s]
/proc/loadavg: 3.28 1.98 1.38 4/239 29351
/proc/meminfo: memFree=27519004/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=45688 CPUtime=0.05 cores=0-7
/proc/29351/stat : 29351 (python) S 29349 29351 28698 0 -1 4202496 1889 0 0 0 4 1 0 0 17 0 1 0 278725899 46784512 1662 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660660224 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/29351/statm: 11422 1662 470 364 0 1171 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 45688

[startup+0.101053 s]
/proc/loadavg: 3.28 1.98 1.38 4/239 29351
/proc/meminfo: memFree=27519004/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=89772 CPUtime=0.07 cores=0-7
/proc/29351/stat : 29351 (python) S 29349 29351 28698 0 -1 4202496 2673 0 0 0 5 2 0 0 17 0 1 0 278725899 91926528 2388 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660660224 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/29351/statm: 22443 2388 750 364 0 1623 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 89772

[startup+0.301015 s]
/proc/loadavg: 3.28 1.98 1.38 4/239 29351
/proc/meminfo: memFree=27519004/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=135752 CPUtime=0.19 cores=0-7
/proc/29351/stat : 29351 (python) R 29349 29351 28698 0 -1 4202496 5963 933 1 0 13 6 0 0 17 0 1 0 278725899 139010048 4150 33554432000 4194304 5683644 140735154186560 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/29351/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135752

[startup+0.700944 s]
/proc/loadavg: 3.28 1.98 1.38 4/239 29351
/proc/meminfo: memFree=27519004/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=278124 CPUtime=0.4 cores=0-7
/proc/29351/stat : 29351 (python) R 29349 29351 28698 0 -1 4202496 9067 933 1 0 28 12 0 0 16 0 1 0 278725899 284798976 6804 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660662016 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/29351/statm: 69531 6803 1744 364 0 5455 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 278124

[startup+1.5008 s]
/proc/loadavg: 3.28 1.98 1.38 3/240 29356
/proc/meminfo: memFree=27458360/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=351680 CPUtime=1.21 cores=0-7
/proc/29351/stat : 29351 (python) R 29349 29351 28698 0 -1 4202496 27210 933 1 0 105 16 0 0 16 0 1 0 278725899 360120320 24890 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660023044 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/29351/statm: 87920 24891 1761 364 0 23844 0
Current children cumulated CPU time (s) 1.21
Current children cumulated vsize (KiB) 351680

[startup+3.10053 s]
/proc/loadavg: 3.28 1.98 1.38 2/240 29356
/proc/meminfo: memFree=27386192/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=441364 CPUtime=2.8 cores=0-7
/proc/29351/stat : 29351 (python) R 29349 29351 28698 0 -1 4202496 49636 933 1 0 261 19 0 0 19 0 1 0 278725899 451956736 47316 33554432000 4194304 5683644 140735154186560 18446744073709551615 4623672 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/29351/statm: 110341 47316 1761 364 0 46265 0
Current children cumulated CPU time (s) 2.8
Current children cumulated vsize (KiB) 441364

[startup+6.30096 s]
/proc/loadavg: 3.10 1.96 1.38 2/240 29356
/proc/meminfo: memFree=27270884/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=505744 CPUtime=6.01 cores=0-7
/proc/29351/stat : 29351 (python) R 29349 29351 28698 0 -1 4202496 92112 933 1 0 576 25 0 0 25 0 1 0 278725899 517881856 63820 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660320961 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/29351/statm: 126436 63820 1826 364 0 62360 0
Current children cumulated CPU time (s) 6.01
Current children cumulated vsize (KiB) 505744

[startup+12.7009 s]
/proc/loadavg: 2.93 1.94 1.37 2/240 29356
/proc/meminfo: memFree=27271524/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=505744 CPUtime=12.41 cores=0-7
/proc/29351/stat : 29351 (python) R 29349 29351 28698 0 -1 4202496 92112 933 1 0 1216 25 0 0 25 0 1 0 278725899 517881856 63820 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660353461 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/29351/statm: 126436 63820 1826 364 0 62360 0
Current children cumulated CPU time (s) 12.41
Current children cumulated vsize (KiB) 505744

[startup+25.5006 s]
/proc/loadavg: 2.50 1.90 1.37 2/240 29357
/proc/meminfo: memFree=27272912/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=505744 CPUtime=25.21 cores=0-7
/proc/29351/stat : 29351 (python) R 29349 29351 28698 0 -1 4202496 92113 933 1 0 2496 25 0 0 25 0 1 0 278725899 517881856 63821 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660320049 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/29351/statm: 126436 63821 1827 364 0 62360 0
Current children cumulated CPU time (s) 25.21
Current children cumulated vsize (KiB) 505744

[startup+51.1011 s]
/proc/loadavg: 1.99 1.82 1.36 2/240 29357
/proc/meminfo: memFree=27272772/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=505744 CPUtime=50.81 cores=0-7
/proc/29351/stat : 29351 (python) R 29349 29351 28698 0 -1 4202496 92119 933 1 0 5056 25 0 0 25 0 1 0 278725899 517881856 63827 33554432000 4194304 5683644 140735154186560 18446744073709551615 47113396775052 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/29351/statm: 126436 63827 1833 364 0 62360 0
Current children cumulated CPU time (s) 50.81
Current children cumulated vsize (KiB) 505744

[startup+102.308 s]
/proc/loadavg: 1.43 1.69 1.34 2/240 29359
/proc/meminfo: memFree=27272276/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=505744 CPUtime=102.02 cores=0-7
/proc/29351/stat : 29351 (python) R 29349 29351 28698 0 -1 4202496 92119 933 1 0 10177 25 0 0 25 0 1 0 278725899 517881856 63827 33554432000 4194304 5683644 140735154186560 18446744073709551615 47113396775052 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/29351/statm: 126436 63827 1833 364 0 62360 0
Current children cumulated CPU time (s) 102.02
Current children cumulated vsize (KiB) 505744

[startup+162.301 s]
/proc/loadavg: 3.14 2.02 1.46 9/264 29384
/proc/meminfo: memFree=24704124/32951124 swapFree=67111524/67111528
[pid=29351] ppid=29349 vsize=635948 CPUtime=141.07 cores=0-7
/proc/29351/stat : 29351 (python) S 29349 29351 28698 0 -1 4202496 97630 933 1 0 14075 32 0 0 23 0 9 0 278725899 651210752 59738 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672488907 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/29351/statm: 158987 59738 1889 364 0 94884 0
[pid=29361] ppid=29351 vsize=488376 CPUtime=0.03 cores=0-7
/proc/29361/stat : 29361 (python) S 29351 29351 28698 0 -1 4202560 929 0 0 0 1 2 0 0 18 0 1 0 278740008 500097024 58022 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682255 0 0 16781312 514 7943769200542056708 0 0 17 1 0 0 0
/proc/29361/statm: 122094 58022 376 364 0 58012 0
[pid=29363] ppid=29361 vsize=138588 CPUtime=21.18 cores=0-7
/proc/29363/stat : 29363 (lingeling) R 29361 29363 29363 0 -1 4202496 49192 0 0 0 2111 7 0 0 25 0 1 0 278740009 141914112 33817 33554432000 4194304 4352236 140734500225296 18446744073709551615 4328090 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/29363/statm: 34647 33817 129 39 0 33727 0
[pid=29364] ppid=29351 vsize=498632 CPUtime=0.04 cores=0-7
/proc/29364/stat : 29364 (python) S 29351 29351 28698 0 -1 4202560 929 0 0 0 2 2 0 0 15 0 1 0 278740012 510599168 58020 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 7943769200542056708 0 0 17 2 0 0 0
/proc/29364/statm: 124658 58020 370 364 0 60573 0
[pid=29366] ppid=29364 vsize=697688 CPUtime=21.1 cores=0-7
/proc/29366/stat : 29366 (cryptominisat-2) R 29364 29366 29366 0 -1 4202496 163652 0 0 0 2091 19 0 0 25 0 1 0 278740012 714432512 146151 33554432000 4194304 4677096 140735210370064 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/29366/statm: 174422 146151 391 118 0 169381 0
[pid=29367] ppid=29351 vsize=508888 CPUtime=0.03 cores=0-7
/proc/29367/stat : 29367 (python) S 29351 29351 28698 0 -1 4202560 918 0 0 0 0 3 0 0 15 0 1 0 278740015 521101312 58024 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 13111385894454001924 0 0 17 1 0 0 0
/proc/29367/statm: 127222 58024 370 364 0 63134 0
[pid=29369] ppid=29367 vsize=697716 CPUtime=21.11 cores=0-7
/proc/29369/stat : 29369 (cryptominisat-2) R 29367 29369 29369 0 -1 4202496 163489 0 0 0 2087 24 0 0 25 0 1 0 278740016 714461184 146175 33554432000 4194304 4677096 140736474181664 18446744073709551615 4320291 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/29369/statm: 174429 146175 391 118 0 169388 0
[pid=29370] ppid=29351 vsize=519144 CPUtime=0.03 cores=0-7
/proc/29370/stat : 29370 (python) S 29351 29351 28698 0 -1 4202560 947 0 0 0 1 2 0 0 18 0 1 0 278740019 531603456 58028 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 7943769200542056708 0 0 17 1 0 0 0
/proc/29370/statm: 129786 58028 370 364 0 65695 0
[pid=29372] ppid=29370 vsize=138000 CPUtime=21.07 cores=0-7
/proc/29372/stat : 29372 (lingeling) R 29370 29372 29372 0 -1 4202496 49100 0 0 0 2101 6 0 0 25 0 1 0 278740020 141312000 33670 33554432000 4194304 4352236 140735724447296 18446744073709551615 4207874 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/29372/statm: 34500 33670 129 39 0 33580 0
[pid=29373] ppid=29351 vsize=594936 CPUtime=0.03 cores=0-7
/proc/29373/stat : 29373 (python) S 29351 29351 28698 0 -1 4202560 794 0 0 0 1 2 0 0 18 0 1 0 278740022 609214464 58150 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 7943769200542056708 0 0 17 7 0 0 0
/proc/29373/statm: 148734 58150 371 364 0 84640 0
[pid=29375] ppid=29373 vsize=138540 CPUtime=20.8 cores=0-7
/proc/29375/stat : 29375 (lingeling) R 29373 29375 29375 0 -1 4202496 49210 0 0 0 2074 6 0 0 25 0 1 0 278740023 141864960 33805 33554432000 4194304 4352236 140735375779344 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 7 0 0 0
/proc/29375/statm: 34635 33805 129 39 0 33715 0
[pid=29376] ppid=29351 vsize=605192 CPUtime=0.03 cores=0-7
/proc/29376/stat : 29376 (python) S 29351 29351 28698 0 -1 4202560 812 0 0 0 2 1 0 0 15 0 1 0 278740026 619716608 58150 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 5602121303839441156 0 0 17 4 0 0 0
/proc/29376/statm: 151298 58150 371 364 0 87201 0
[pid=29378] ppid=29376 vsize=697696 CPUtime=20.96 cores=0-7
/proc/29378/stat : 29378 (cryptominisat-2) R 29376 29378 29378 0 -1 4202496 163644 0 0 0 2077 19 0 0 25 0 1 0 278740027 714440704 146146 33554432000 4194304 4677096 140736219073696 18446744073709551615 4358608 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/29378/statm: 174424 146146 391 118 0 169383 0
[pid=29379] ppid=29351 vsize=615448 CPUtime=0.03 cores=0-7
/proc/29379/stat : 29379 (python) S 29351 29351 28698 0 -1 4202560 812 0 0 0 1 2 0 0 18 0 1 0 278740030 630218752 58143 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 7943769200542056708 0 0 17 1 0 0 0
/proc/29379/statm: 153862 58143 371 364 0 89762 0
[pid=29381] ppid=29379 vsize=58744 CPUtime=20.92 cores=0-7
/proc/29381/stat : 29381 (SApperloT-base) R 29379 29381 29381 0 -1 4202496 13931 0 0 0 2089 3 0 0 25 0 1 0 278740033 60153856 13444 33554432000 134512640 135674940 4289621200 18446744073709551615 134564342 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/29381/statm: 14686 13444 99 284 0 14400 0
[pid=29382] ppid=29351 vsize=625704 CPUtime=0.03 cores=0-7
/proc/29382/stat : 29382 (python) S 29351 29351 28698 0 -1 4202560 861 0 0 0 2 1 0 0 18 0 1 0 278740034 640720896 58222 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 7943769200542056707 0 0 17 1 0 0 0
/proc/29382/statm: 156426 58222 377 364 0 92323 0
[pid=29384] ppid=29382 vsize=360916 CPUtime=20.73 cores=0-7
/proc/29384/stat : 29384 (precosat) R 29382 29384 29384 0 -1 4202496 90356 0 0 0 2060 13 0 0 25 0 1 0 278740036 369577984 85271 33554432000 4194304 4890832 140735592248784 18446744073709551615 4229325 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/29384/statm: 90229 85271 86 171 0 90056 0
[pid=29351/tid=29362] ppid=29349 vsize=635948 CPUtime=0 cores=0-7
/proc/29351/task/29362/stat : 29362 (python) S 29349 29351 28698 0 -1 4202560 26 933 0 0 0 0 0 0 25 0 9 0 278740009 651210752 59738 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 2 0 0 0
[pid=29351/tid=29365] ppid=29349 vsize=635948 CPUtime=0 cores=0-7
/proc/29351/task/29365/stat : 29365 (python) S 29349 29351 28698 0 -1 4202560 21 933 0 0 0 0 0 0 20 0 9 0 278740012 651210752 59738 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29368] ppid=29349 vsize=635948 CPUtime=0 cores=0-7
/proc/29351/task/29368/stat : 29368 (python) S 29349 29351 28698 0 -1 4202560 24 933 0 0 0 0 0 0 19 0 9 0 278740016 651210752 59738 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29371] ppid=29349 vsize=635948 CPUtime=0 cores=0-7
/proc/29351/task/29371/stat : 29371 (python) S 29349 29351 28698 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 9 0 278740019 651210752 59738 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 5 0 0 0
[pid=29351/tid=29374] ppid=29349 vsize=635948 CPUtime=0 cores=0-7
/proc/29351/task/29374/stat : 29374 (python) S 29349 29351 28698 0 -1 4202560 55 933 0 0 0 0 0 0 19 0 9 0 278740023 651210752 59738 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29377] ppid=29349 vsize=635948 CPUtime=0 cores=0-7
/proc/29351/task/29377/stat : 29377 (python) S 29349 29351 28698 0 -1 4202560 32 933 0 0 0 0 0 0 21 0 9 0 278740027 651210752 59738 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 4 0 0 0
[pid=29351/tid=29380] ppid=29349 vsize=635948 CPUtime=0 cores=0-7
/proc/29351/task/29380/stat : 29380 (python) S 29349 29351 28698 0 -1 4202560 33 933 0 0 0 0 0 0 22 0 9 0 278740031 651210752 59738 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29383] ppid=29349 vsize=635948 CPUtime=0 cores=0-7
/proc/29351/task/29383/stat : 29383 (python) S 29349 29351 28698 0 -1 4202560 34 933 0 0 0 0 0 0 23 0 9 0 278740035 651210752 59738 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 309.19
Current children cumulated vsize (KiB) 8020156


################
# More data... #
################

/proc/29411/statm: 89637 84632 86 171 0 89464 0
[pid=29409/tid=29431] ppid=29351 vsize=656472 CPUtime=0 cores=0-7
/proc/29409/task/29431/stat : 29431 (python) S 29351 29351 28698 0 -1 4202560 81 0 0 0 0 0 0 0 18 0 2 0 278828034 672227328 58229 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 514 18446604453927298304 0 0 -1 0 0 0 0
[pid=29413] ppid=29351 vsize=666728 CPUtime=4.08 cores=0-7
/proc/29413/stat : 29413 (python) S 29351 29351 28698 0 -1 4202560 1056 0 0 0 220 188 0 0 18 0 2 0 278789213 682729472 58252 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672488907 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/29413/statm: 166682 58252 399 364 0 102567 0
[pid=29415] ppid=29413 vsize=145244 CPUtime=2040.69 cores=0-7
/proc/29415/stat : 29415 (lingeling) T 29413 29415 29415 0 -1 4202496 58383 0 0 0 204059 10 0 0 25 0 1 0 278789214 148729856 35481 33554432000 4194304 4352236 140736090285312 18446744073709551615 4329060 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/29415/statm: 36311 35481 129 39 0 35391 0
[pid=29413/tid=29424] ppid=29351 vsize=666728 CPUtime=0 cores=0-7
/proc/29413/task/29424/stat : 29424 (python) S 29351 29351 28698 0 -1 4202560 82 0 0 0 0 0 0 0 18 0 2 0 278808848 682729472 58252 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 514 18446604453930239040 0 0 -1 0 0 0 0
[pid=29421] ppid=29351 vsize=676984 CPUtime=2.68 cores=0-7
/proc/29421/stat : 29421 (python) S 29351 29351 28698 0 -1 4202560 1059 0 0 0 146 122 0 0 18 0 2 0 278808164 693231616 58318 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672488907 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/29421/statm: 169246 58318 399 364 0 105128 0
[pid=29423] ppid=29421 vsize=361304 CPUtime=1362.15 cores=0-7
/proc/29423/stat : 29423 (precosat) T 29421 29423 29423 0 -1 4202496 90370 0 0 0 136195 20 0 0 25 0 1 0 278808165 369975296 85284 33554432000 4194304 4890832 140733724274128 18446744073709551615 4212759 0 0 16781312 17442 18446744071562691360 0 0 17 7 0 0 0
/proc/29423/statm: 90326 85284 86 171 0 90153 0
[pid=29421/tid=29428] ppid=29351 vsize=676984 CPUtime=0 cores=0-7
/proc/29421/task/29428/stat : 29428 (python) S 29351 29351 28698 0 -1 4202560 86 0 0 0 0 0 0 0 18 0 2 0 278818087 693231616 58318 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 514 18446604453963334720 0 0 -1 0 0 0 0
[pid=29432] ppid=29351 vsize=687240 CPUtime=0.88 cores=0-7
/proc/29432/stat : 29432 (python) S 29351 29351 28698 0 -1 4202560 14204 0 0 0 44 44 0 0 18 0 2 0 278828039 703733760 58329 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672488907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29432/statm: 171810 58329 399 364 0 107689 0
[pid=29434] ppid=29432 vsize=140132 CPUtime=392.6 cores=0-7
/proc/29434/stat : 29434 (lingeling) T 29432 29434 29434 0 -1 4202496 55755 0 0 0 39253 7 0 0 25 0 1 0 278828041 143495168 34203 33554432000 4194304 4352236 140735116002368 18446744073709551615 4328100 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/29434/statm: 35033 34203 129 39 0 34113 0
[pid=29432/tid=29438] ppid=29351 vsize=687240 CPUtime=0 cores=0-7
/proc/29432/task/29438/stat : 29438 (python) S 29351 29351 28698 0 -1 4202560 87 0 0 0 0 0 0 0 18 0 2 0 278838059 703733760 58329 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 514 18446604453938038976 0 0 -1 1 0 0 0
[pid=29447] ppid=29351 vsize=697496 CPUtime=1.09 cores=0-7
/proc/29447/stat : 29447 (python) S 29351 29351 28698 0 -1 4202560 1237 0 0 0 55 54 0 0 15 0 2 0 278866601 714235904 58302 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672488907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29447/statm: 174374 58302 407 364 0 110250 0
[pid=29449] ppid=29447 vsize=1391856 CPUtime=490.9 cores=0-7
/proc/29449/stat : 29449 (cryptominisat-2) T 29447 29449 29449 0 -1 4202496 325906 0 0 0 49033 57 0 0 25 0 1 0 278866602 1425260544 295337 33554432000 4194304 4677096 140733961128272 18446744073709551615 4319643 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/29449/statm: 347964 295337 393 118 0 342923 0
[pid=29447/tid=29454] ppid=29351 vsize=697496 CPUtime=0 cores=0-7
/proc/29447/task/29454/stat : 29454 (python) S 29351 29351 28698 0 -1 4202560 83 0 0 0 0 0 0 0 15 0 2 0 278876762 714235904 58302 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 514 18446604443438500864 0 0 -1 0 0 0 0
[pid=29460] ppid=29351 vsize=707752 CPUtime=1.35 cores=0-7
/proc/29460/stat : 29460 (python) S 29351 29351 28698 0 -1 4202560 1234 0 0 0 68 67 0 0 18 0 2 0 278896073 724738048 58309 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29460/statm: 176938 58309 406 364 0 112811 0
[pid=29462] ppid=29460 vsize=361120 CPUtime=672.89 cores=0-7
/proc/29462/stat : 29462 (precosat) R 29460 29462 29462 0 -1 4202496 90316 0 0 0 67270 19 0 0 25 0 1 0 278896074 369786880 85221 33554432000 4194304 4890832 140734658851872 18446744073709551615 4295187 0 0 16781312 17442 0 0 0 17 4 0 0 0
/proc/29462/statm: 90280 85221 86 171 0 90107 0
[pid=29460/tid=29472] ppid=29351 vsize=707752 CPUtime=0 cores=0-7
/proc/29460/task/29472/stat : 29472 (python) S 29351 29351 28698 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 278925329 724738048 58309 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 514 18446604453985900736 0 0 -1 4 0 0 0
[pid=29473] ppid=29351 vsize=718008 CPUtime=0.22 cores=0-7
/proc/29473/stat : 29473 (python) S 29351 29351 28698 0 -1 4202560 1114 0 0 0 9 13 0 0 16 0 2 0 278925450 735240192 58311 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672488907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29473/statm: 179502 58311 400 364 0 115372 0
[pid=29475] ppid=29473 vsize=1081556 CPUtime=98.65 cores=0-7
/proc/29475/stat : 29475 (cryptominisat-2) T 29473 29475 29475 0 -1 4202496 253196 0 0 0 9821 44 0 0 25 0 1 0 278925453 1107513344 225702 33554432000 4194304 4677096 140735039211568 18446744073709551615 4319872 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/29475/statm: 270389 225702 393 118 0 265348 0
[pid=29473/tid=29479] ppid=29351 vsize=718008 CPUtime=0 cores=0-7
/proc/29473/task/29479/stat : 29479 (python) S 29351 29351 28698 0 -1 4202560 87 0 0 0 0 0 0 0 16 0 2 0 278935381 735240192 58311 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 514 18446604463625647936 0 0 -1 0 0 0 0
[pid=29484] ppid=29351 vsize=728264 CPUtime=1.89 cores=0-7
/proc/29484/stat : 29484 (python) S 29351 29351 28698 0 -1 4202560 1113 0 0 0 93 96 0 0 18 0 2 0 278945103 745742336 58330 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/29484/statm: 182066 58330 400 364 0 117933 0
[pid=29486] ppid=29484 vsize=362408 CPUtime=925.64 cores=0-7
/proc/29486/stat : 29486 (precosat) R 29484 29486 29486 0 -1 4202496 90695 0 0 0 92547 17 0 0 25 0 1 0 278945104 371105792 85601 33554432000 4194304 4890832 140734952762128 18446744073709551615 4238565 0 0 16781312 17442 0 0 0 17 3 0 0 0
/proc/29486/statm: 90602 85601 86 171 0 90429 0
[pid=29484/tid=29504] ppid=29351 vsize=728264 CPUtime=0 cores=0-7
/proc/29484/task/29504/stat : 29504 (python) S 29351 29351 28698 0 -1 4202560 89 0 0 0 0 0 0 0 18 0 2 0 278983977 745742336 58330 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 514 18446604464512344512 0 0 -1 0 0 0 0
[pid=29487] ppid=29351 vsize=738520 CPUtime=2.12 cores=0-7
/proc/29487/stat : 29487 (python) S 29351 29351 28698 0 -1 4202560 1120 0 0 0 105 107 0 0 18 0 2 0 278946676 756244480 58366 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29487/statm: 184630 58366 400 364 0 120494 0
[pid=29489] ppid=29487 vsize=110756 CPUtime=1053.85 cores=0-7
/proc/29489/stat : 29489 (glucose_static) R 29487 29489 29489 0 -1 4202496 27208 0 0 0 105375 10 0 0 25 0 1 0 278946677 113414144 26815 33554432000 134512640 135217611 4292970528 18446744073709551615 134532912 0 0 16781312 8388611 0 0 0 17 0 0 0 0
/proc/29489/statm: 27689 26815 78 173 0 27514 0
[pid=29487/tid=29495] ppid=29351 vsize=738520 CPUtime=0 cores=0-7
/proc/29487/task/29495/stat : 29495 (python) S 29351 29351 28698 0 -1 4202560 83 0 0 0 0 0 0 0 18 0 2 0 278966315 756244480 58366 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 514 18446604469115665280 0 0 -1 5 0 0 0
[pid=29498] ppid=29351 vsize=748776 CPUtime=0.21 cores=0-7
/proc/29498/stat : 29498 (python) S 29351 29351 28698 0 -1 4202560 1134 0 0 0 10 11 0 0 19 0 2 0 278974875 766746624 58383 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672488907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29498/statm: 187194 58383 401 364 0 123055 0
[pid=29500] ppid=29498 vsize=141052 CPUtime=97.65 cores=0-7
/proc/29500/stat : 29500 (lingeling) T 29498 29500 29500 0 -1 4202496 52263 0 0 0 9758 7 0 0 25 0 1 0 278974876 144437248 34432 33554432000 4194304 4352236 140734116188448 18446744073709551615 4233914 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/29500/statm: 35263 34432 129 39 0 34343 0
[pid=29498/tid=29505] ppid=29351 vsize=748776 CPUtime=0 cores=0-7
/proc/29498/task/29505/stat : 29505 (python) S 29351 29351 28698 0 -1 4202560 90 0 0 0 0 0 0 0 19 0 2 0 278984896 766746624 58383 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 514 18446604464512347200 0 0 -1 7 0 0 0
[pid=29506] ppid=29351 vsize=759032 CPUtime=0.22 cores=0-7
/proc/29506/stat : 29506 (python) S 29351 29351 28698 0 -1 4202560 1149 0 0 0 11 11 0 0 16 0 2 0 278984904 777248768 58423 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672488907 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/29506/statm: 189758 58423 400 364 0 125616 0
[pid=29508] ppid=29506 vsize=1068468 CPUtime=99 cores=0-7
/proc/29508/stat : 29508 (cryptominisat-2) T 29506 29508 29508 0 -1 4202496 249930 0 0 0 9862 38 0 0 25 0 1 0 278984905 1094111232 223581 33554432000 4194304 4677096 140736914040016 18446744073709551615 4319726 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/29508/statm: 267117 223581 393 118 0 262076 0
[pid=29506/tid=29512] ppid=29351 vsize=759032 CPUtime=0 cores=0-7
/proc/29506/task/29512/stat : 29512 (python) S 29351 29351 28698 0 -1 4202560 87 0 0 0 0 0 0 0 16 0 2 0 278994867 777248768 58423 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 514 18446604461959334720 0 0 -1 0 0 0 0
[pid=29537] ppid=29351 vsize=769288 CPUtime=0.58 cores=0-7
/proc/29537/stat : 29537 (python) S 29351 29351 28698 0 -1 4202560 1030 0 0 0 28 30 0 0 18 0 1 0 279042120 787750912 58440 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 7943769200542056710 0 0 17 1 0 0 0
/proc/29537/statm: 192322 58440 378 364 0 128177 0
[pid=29539] ppid=29537 vsize=139992 CPUtime=286.97 cores=0-7
/proc/29539/stat : 29539 (glucoser_static) R 29537 29539 29539 0 -1 4202496 33191 0 11 0 28690 7 0 0 25 0 1 0 279042122 143351808 32873 33554432000 134512640 134580299 4287450544 18446744073709551615 134553258 0 0 16781312 8388611 0 0 0 17 6 0 0 18
/proc/29539/statm: 34998 32873 243 17 0 34326 0
[pid=29544] ppid=29351 vsize=779544 CPUtime=0.32 cores=0-7
/proc/29544/stat : 29544 (python) S 29351 29351 28698 0 -1 4202560 979 0 0 0 15 17 0 0 18 0 1 0 279054682 798253056 58485 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 7943769200542056711 0 0 17 1 0 0 0
/proc/29544/statm: 194886 58485 378 364 0 130738 0
[pid=29546] ppid=29544 vsize=359220 CPUtime=162.07 cores=0-7
/proc/29546/stat : 29546 (precosat) R 29544 29546 29546 0 -1 4202496 89831 0 0 0 16193 14 0 0 25 0 1 0 279054684 367841280 84725 33554432000 4194304 4890832 140734032457552 18446744073709551615 4295045 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/29546/statm: 89805 84725 86 171 0 89632 0
[pid=29551] ppid=29351 vsize=789800 CPUtime=0 cores=0-7
/proc/29551/stat : 29551 (python) S 29351 29351 28698 0 -1 4202560 872 0 0 0 0 0 0 0 19 0 1 0 279070930 808755200 58413 33554432000 4194304 5683644 140735154186560 18446744073709551615 268660682310 0 0 16781312 514 14766776516373118975 0 0 17 1 0 0 0
/proc/29551/statm: 197450 58413 351 364 0 133299 0
[pid=29553] ppid=29551 vsize=71208 CPUtime=0.28 cores=0-7
/proc/29553/stat : 29553 (glucose_static) R 29551 29553 29553 0 -1 4202496 17154 0 0 0 25 3 0 0 21 0 1 0 279070931 72916992 16753 33554432000 134512640 135217611 4288291872 18446744073709551615 134723558 0 0 16781312 8388611 0 0 0 17 1 0 0 0
/proc/29553/statm: 17802 16754 59 173 0 17627 0
[pid=29351/tid=29362] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29362/stat : 29362 (python) S 29349 29351 28698 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 25 0 278740009 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 2 0 0 0
[pid=29351/tid=29365] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29365/stat : 29365 (python) S 29349 29351 28698 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 25 0 278740012 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29368] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29368/stat : 29368 (python) S 29349 29351 28698 0 -1 4202560 41 933 0 0 0 0 0 0 18 0 25 0 278740016 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29371] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29371/stat : 29371 (python) S 29349 29351 28698 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 25 0 278740019 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 5 0 0 0
[pid=29351/tid=29374] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29374/stat : 29374 (python) S 29349 29351 28698 0 -1 4202560 55 933 0 0 0 0 0 0 19 0 25 0 278740023 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29377] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29377/stat : 29377 (python) S 29349 29351 28698 0 -1 4202560 32 933 0 0 0 0 0 0 21 0 25 0 278740027 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 4 0 0 0
[pid=29351/tid=29380] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29380/stat : 29380 (python) S 29349 29351 28698 0 -1 4202560 33 933 0 0 0 0 0 0 22 0 25 0 278740031 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29383] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29383/stat : 29383 (python) S 29349 29351 28698 0 -1 4202560 70 933 0 0 0 0 0 0 18 0 25 0 278740035 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 1 0 0 0
[pid=29351/tid=29390] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29390/stat : 29390 (python) S 29349 29351 28698 0 -1 4202560 49 933 0 0 0 0 0 0 18 0 25 0 278750031 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 1 0 0 0
[pid=29351/tid=29394] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29394/stat : 29394 (python) S 29349 29351 28698 0 -1 4202560 38 933 0 0 0 0 0 0 19 0 25 0 278750056 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 1 0 0 0
[pid=29351/tid=29410] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29410/stat : 29410 (python) S 29349 29351 28698 0 -1 4202560 66 933 0 0 0 0 0 0 18 0 25 0 278788749 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 1 0 0 0
[pid=29351/tid=29414] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29414/stat : 29414 (python) S 29349 29351 28698 0 -1 4202560 58 933 0 0 0 0 0 0 18 0 25 0 278789214 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29422] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29422/stat : 29422 (python) S 29349 29351 28698 0 -1 4202560 56 933 0 0 0 0 0 0 18 0 25 0 278808165 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 1 0 0 0
[pid=29351/tid=29433] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29433/stat : 29433 (python) S 29349 29351 28698 0 -1 4202560 60 933 0 0 0 0 0 0 18 0 25 0 278828040 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29448] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29448/stat : 29448 (python) S 29349 29351 28698 0 -1 4202560 55 933 0 0 0 0 0 0 18 0 25 0 278866602 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29461] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29461/stat : 29461 (python) S 29349 29351 28698 0 -1 4202560 45 933 0 0 0 0 0 0 18 0 25 0 278896073 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29474] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29474/stat : 29474 (python) S 29349 29351 28698 0 -1 4202560 44 933 0 0 0 0 0 0 20 0 25 0 278925451 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29485] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29485/stat : 29485 (python) S 29349 29351 28698 0 -1 4202560 48 933 0 0 0 0 0 0 18 0 25 0 278945104 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29488] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29488/stat : 29488 (python) S 29349 29351 28698 0 -1 4202560 41 933 0 0 0 0 0 0 18 0 25 0 278946677 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 1 0 0 0
[pid=29351/tid=29499] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29499/stat : 29499 (python) S 29349 29351 28698 0 -1 4202560 45 933 0 0 0 0 0 0 20 0 25 0 278974876 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29507] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29507/stat : 29507 (python) S 29349 29351 28698 0 -1 4202560 40 933 0 0 0 0 0 0 20 0 25 0 278984904 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 1 0 0 0
[pid=29351/tid=29538] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29538/stat : 29538 (python) S 29349 29351 28698 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 25 0 279042121 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 1 0 0 0
[pid=29351/tid=29545] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29545/stat : 29545 (python) S 29349 29351 28698 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 25 0 279054683 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
[pid=29351/tid=29552] ppid=29349 vsize=800044 CPUtime=0 cores=0-7
/proc/29351/task/29552/stat : 29552 (python) S 29349 29351 28698 0 -1 4202560 43 933 0 0 0 0 0 0 20 0 25 0 279070931 819245056 59988 33554432000 4194304 5683644 140735154186560 18446744073709551615 268672485809 0 0 16781312 2 18446604453934338112 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 26531.3
Current children cumulated vsize (KiB) 32318200

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29351 and gives
#  childrusage.ru_utime.tv_sec=144
#  childrusage.ru_utime.tv_usec=205077
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=512922
# CPU time returned by wait4() is 144.718
# while last known CPU time is 26531.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 3450.77
CPU time (s): 26531.3
CPU user time (s): 26497.5
CPU system time (s): 33.87
CPU usage (%): 768.853
Max. virtual memory (cumulated for all children) (KiB): 32318200

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 144.205
system time used= 0.512922
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 133294
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3253
involuntary context switches= 267

runsolver used 23.4744 second user time and 60.2938 second system time

The end

Launcher Data 

Begin job on node107 at 2011-05-02 16:09:06
IDJOB=3321545
IDBENCH=82354
IDSOLVER=1710
FILE ID=node107/3321545-1304345345
RUNJOBID= node107-1304335863-28712
PBS_JOBID= 13178021
Free space on /tmp= 72932 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/fuhs/AProVE11/AProVE11-06.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321545-1304345345/watcher-3321545-1304345345 -o /tmp/evaluation-result-3321545-1304345345/solver-3321545-1304345345 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321545-1304345345.cnf -seed 1513692892 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6fd7d026c372988cefc364000243d13f
RANDOM SEED=1513692892

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27519044 kB
Buffers:        447476 kB
Cached:        3238944 kB
SwapCached:          4 kB
Active:        1783336 kB
Inactive:      3274144 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27519044 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           53012 kB
Writeback:           0 kB
AnonPages:     1370756 kB
Mapped:          20224 kB
Slab:           295832 kB
PageTables:      13944 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 33343084 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72900 MiB
End job on node107 at 2011-05-02 17:06:39