Trace number 3322606

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 22802.6 2951.34

General information on the benchmark

NameSAT03/industrial/schuppan/l2s/
dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf
MD5SUM3fef216b3efe77c0f10ea0e0be664a94
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables261352
Number of clauses773077
Sum of the clauses size1985588
Maximum clause length248
Minimum clause length1
Number of clauses of size 11592
Number of clauses of size 2357488
Number of clauses of size 3413748
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5249

Solver Data 

0.36/0.76	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.36/0.76	c INFO: solving HOME/instance-3322606-1304354779.cnf
0.36/0.76	c INFO: computing task features
3.23/3.65	c INFO: computed variable-clause graph statistics
3.34/3.76	c INFO: computed clause balance statistics
16.14/16.56	c INFO: computed variable balance statistics
25.54/25.98	c INFO: computed small-clause counts
25.74/26.19	c INFO: computed Horn-clause counts
105.53/105.93	c INFO: computed variable graph statistics
105.53/105.93	c INFO: collected features for HOME/instance-3322606-1304354779.cnf in 105.08 s
105.53/105.96	c INFO: running lingeling-276@0 for 97 with 39894 remaining (b = 0.66)
105.53/105.99	c INFO: running cryptominisat-2.9.0@0 for 485 with 39894 remaining (b = 0.47)
105.63/106.02	c INFO: running SApperloT@0 for 97 with 39894 remaining (b = 0.05)
105.63/106.06	c INFO: running lingeling-276@0 for 970 with 39894 remaining (b = 0.49)
105.63/106.09	c INFO: running cryptominisat-2.9.0@0 for 679 with 39894 remaining (b = 0.42)
105.73/106.13	c INFO: running cryptominisat-2.9.0@0 for 97 with 39894 remaining (b = 0.07)
105.73/106.17	c INFO: running lingeling-276@0 for 1261 with 39894 remaining (b = 0.42)
105.83/106.20	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39894 remaining (b = 0.54)
904.87/206.16	c INFO: running precosat-570@0 for 679 with 39794 remaining (b = 0.30)
905.61/206.23	c INFO: running lingeling-276@0 for 97 with 39794 remaining (b = 0.08)
909.71/206.77	c INFO: running lingeling-276@0 for 873 with 39794 remaining (b = 0.25)
1665.67/301.42	c INFO: running cryptominisat-2.9.0@0 for 97 with 39699 remaining (b = 0.02)
2499.08/405.87	c INFO: running lingeling-276@99 for 97 with 39594 remaining (b = 0.04)
3274.98/503.07	c INFO: running cryptominisat-2.9.0@0 for 1843 with 39497 remaining (b = 0.43)
4028.57/597.43	c INFO: running precosat-570@0 for 776 with 39403 remaining (b = 0.25)
5593.24/793.43	c INFO: running cryptominisat-2.9.0@101 for 1843 with 39207 remaining (b = 0.38)
6357.93/889.25	c INFO: running precosat-570@0 for 776 with 39111 remaining (b = 0.28)
7885.00/1080.69	c INFO: running precosat-570@0 for 97 with 38920 remaining (b = 0.07)
7944.78/1088.17	c INFO: running lingeling-276@0 for 97 with 38912 remaining (b = 0.03)
8685.58/1180.91	c INFO: running lingeling-276@196 for 194 with 38819 remaining (b = 0.08)
8712.71/1184.38	c INFO: running lingeling-276@95 for 97 with 38816 remaining (b = 0.04)
9488.72/1281.59	c INFO: running lingeling-276@100 for 1164 with 38719 remaining (b = 0.26)
10187.90/1369.15	c INFO: running lingeling-276@192 for 97 with 38631 remaining (b = 0.04)
10228.59/1374.25	c INFO: running precosat-570@877 for 388 with 38626 remaining (b = 0.11)
10247.77/1376.66	c INFO: running precosat-570@0 for 97 with 38624 remaining (b = 0.06)
10963.21/1466.36	c INFO: running lingeling-276@0 for 97 with 38534 remaining (b = 0.03)
11047.70/1476.92	c INFO: running lingeling-276@292 for 97 with 38523 remaining (b = 0.04)
11738.28/1563.57	c INFO: running lingeling-276@385 for 97 with 38437 remaining (b = 0.04)
11822.84/1574.13	c INFO: running lingeling-276@99 for 97 with 38426 remaining (b = 0.03)
12513.34/1660.77	c INFO: running cryptominisat-2.9.0@0 for 97 with 38340 remaining (b = 0.02)
12597.85/1671.34	c INFO: running lingeling-276@389 for 873 with 38329 remaining (b = 0.17)
12711.05/1685.51	c INFO: running precosat-570@974 for 194 with 38315 remaining (b = 0.06)
13310.66/1760.79	c INFO: running lingeling-276@196 for 194 with 38240 remaining (b = 0.05)
13336.96/1764.02	c INFO: running lingeling-276@482 for 873 with 38236 remaining (b = 0.14)
14316.12/1886.89	c INFO: running precosat-570@1074 for 97 with 38113 remaining (b = 0.04)
14852.71/1954.14	c INFO: running lingeling-276@0 for 194 with 38046 remaining (b = 0.05)
15075.18/1982.10	c INFO: running precosat-570@1654 for 582 with 38018 remaining (b = 0.09)
15692.32/2059.41	c INFO: running precosat-570@100 for 97 with 37941 remaining (b = 0.02)
16418.76/2150.52	c INFO: running precosat-570@97 for 97 with 37850 remaining (b = 0.02)
16467.31/2156.66	c INFO: running precosat-570@296 for 97 with 37844 remaining (b = 0.02)
17193.68/2247.77	c INFO: running lingeling-276@585 for 679 with 37753 remaining (b = 0.10)
17226.36/2251.86	c INFO: running cryptominisat-2.9.0@0 for 1843 with 37748 remaining (b = 0.28)
18083.51/2359.33	c INFO: running precosat-570@684 for 97 with 37641 remaining (b = 0.03)
18762.73/2444.52	c INFO: running precosat-570@1267 for 97 with 37556 remaining (b = 0.03)
18858.43/2456.56	c INFO: running cryptominisat-2.9.0@0 for 388 with 37544 remaining (b = 0.08)
19529.72/2540.77	c INFO: running cryptominisat-2.9.0@97 for 388 with 37460 remaining (b = 0.09)
19601.51/2549.71	c INFO: running lingeling-276@0 for 97 with 37451 remaining (b = 0.03)
19732.21/2566.18	c INFO: running lingeling-276@1169 for 97 with 37434 remaining (b = 0.02)
20376.41/2646.92	c INFO: running precosat-570@393 for 388 with 37353 remaining (b = 0.07)
20384.38/2647.98	c INFO: running precosat-570@194 for 194 with 37352 remaining (b = 0.04)
20447.35/2655.86	c INFO: running lingeling-276@94 for 291 with 37344 remaining (b = 0.06)
20507.12/2663.40	c INFO: running cryptominisat-2.9.0@100 for 388 with 37337 remaining (b = 0.07)
21919.07/2840.41	c INFO: running precosat-570@1069 for 97 with 37160 remaining (b = 0.03)
21953.37/2844.80	c INFO: running cryptominisat-2.9.0@96 for 388 with 37156 remaining (b = 0.07)
22623.85/2928.89	c INFO: running cryptominisat-2.9.0@973 for 679 with 37071 remaining (b = 0.13)
22664.46/2933.98	c INFO: running cryptominisat-2.9.0@0 for 97 with 37066 remaining (b = 0.02)
22725.91/2941.67	c INFO: running precosat-570@1846 for 388 with 37059 remaining (b = 0.06)
22796.86/2950.52	c INFO: running precosat-570@0 for 291 with 37050 remaining (b = 0.05)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322606-1304354779/watcher-3322606-1304354779 -o /tmp/evaluation-result-3322606-1304354779/solver-3322606-1304354779 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3322606-1304354779.cnf -seed 1630679311 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.59 7.99 8.05 2/213 32029
/proc/meminfo: memFree=22227556/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=15384 CPUtime=0 cores=0-7
/proc/32029/stat : 32029 (python) S 32027 32029 30702 0 -1 4202496 795 0 0 0 0 0 0 0 17 0 1 0 547078462 15753216 681 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/32029/statm: 3846 681 322 364 0 333 0

[startup+0.0831921 s]
/proc/loadavg: 7.59 7.99 8.05 2/213 32029
/proc/meminfo: memFree=22227556/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=50016 CPUtime=0.05 cores=0-7
/proc/32029/stat : 32029 (python) S 32027 32029 30702 0 -1 4202496 1978 0 0 0 4 1 0 0 17 0 1 0 547078462 51216384 1738 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809163776 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/32029/statm: 12504 1738 480 364 0 1204 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 50016

[startup+0.10019 s]
/proc/loadavg: 7.59 7.99 8.05 2/213 32029
/proc/meminfo: memFree=22227556/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=87708 CPUtime=0.06 cores=0-7
/proc/32029/stat : 32029 (python) R 32027 32029 30702 0 -1 4202496 2636 0 0 0 5 1 0 0 17 0 1 0 547078462 89812992 2352 33554432000 4194304 5683644 140734085040224 18446744073709551615 230804203264 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/32029/statm: 21927 2354 717 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87708

[startup+0.300198 s]
/proc/loadavg: 7.59 7.99 8.05 2/213 32029
/proc/meminfo: memFree=22227556/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=135752 CPUtime=0.18 cores=0-7
/proc/32029/stat : 32029 (python) S 32027 32029 30702 0 -1 4202496 5963 932 1 0 13 5 0 0 17 0 1 0 547078462 139010048 4150 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809161733 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/32029/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.70109 s]
/proc/loadavg: 7.59 7.99 8.05 2/213 32029
/proc/meminfo: memFree=22227556/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=246576 CPUtime=0.36 cores=0-7
/proc/32029/stat : 32029 (python) R 32027 32029 30702 0 -1 4202496 8240 932 1 0 26 10 0 0 16 0 1 0 547078462 252493824 6138 33554432000 4194304 5683644 140734085040224 18446744073709551615 4572346 0 0 16781312 2 0 0 0 17 4 0 0 8
/proc/32029/statm: 61644 6138 1621 364 0 4646 0
Current children cumulated CPU time (s) 0.36
Current children cumulated vsize (KiB) 246576

[startup+1.50093 s]
/proc/loadavg: 7.59 7.99 8.05 2/214 32034
/proc/meminfo: memFree=22176584/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=340896 CPUtime=1.13 cores=0-7
/proc/32029/stat : 32029 (python) R 32027 32029 30702 0 -1 4202496 24585 932 1 0 99 14 0 0 17 0 1 0 547078462 349077504 22173 33554432000 4194304 5683644 140734085040224 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 4 0 0 8
/proc/32029/statm: 85224 22174 1761 364 0 21148 0
Current children cumulated CPU time (s) 1.13
Current children cumulated vsize (KiB) 340896

[startup+3.10064 s]
/proc/loadavg: 7.06 7.87 8.01 2/214 32034
/proc/meminfo: memFree=22107392/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=407396 CPUtime=2.74 cores=0-7
/proc/32029/stat : 32029 (python) R 32027 32029 30702 0 -1 4202496 60547 932 1 0 255 19 0 0 19 0 1 0 547078462 417173504 39183 33554432000 4194304 5683644 140734085040224 18446744073709551615 47854890871597 0 0 16781312 2 0 0 0 17 4 0 0 8
/proc/32029/statm: 101849 39183 1776 364 0 37773 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 407396

[startup+6.30105 s]
/proc/loadavg: 7.06 7.87 8.01 2/214 32034
/proc/meminfo: memFree=22039904/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=445684 CPUtime=5.94 cores=0-7
/proc/32029/stat : 32029 (python) R 32027 32029 30702 0 -1 4202496 70179 932 1 0 574 20 0 0 25 0 1 0 547078462 456380416 48805 33554432000 4194304 5683644 140734085040224 18446744073709551615 4500428 0 0 16781312 2 0 0 0 17 4 0 0 8
/proc/32029/statm: 111421 48805 1826 364 0 47345 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 445684

[startup+12.7009 s]
/proc/loadavg: 6.58 7.76 7.97 2/214 32034
/proc/meminfo: memFree=22041168/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=445684 CPUtime=12.34 cores=0-7
/proc/32029/stat : 32029 (python) R 32027 32029 30702 0 -1 4202496 70179 932 1 0 1214 20 0 0 25 0 1 0 547078462 456380416 48805 33554432000 4194304 5683644 140734085040224 18446744073709551615 47854845475551 0 0 16781312 2 0 0 0 17 4 0 0 8
/proc/32029/statm: 111421 48805 1826 364 0 47345 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 445684

[startup+25.5005 s]
/proc/loadavg: 5.34 7.43 7.86 2/214 32034
/proc/meminfo: memFree=22043324/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=445684 CPUtime=25.14 cores=0-7
/proc/32029/stat : 32029 (python) R 32027 32029 30702 0 -1 4202496 70180 932 1 0 2494 20 0 0 25 0 1 0 547078462 456380416 48806 33554432000 4194304 5683644 140734085040224 18446744073709551615 47854848066802 0 0 16781312 2 0 0 0 17 4 0 0 8
/proc/32029/statm: 111421 48806 1827 364 0 47345 0
Current children cumulated CPU time (s) 25.14
Current children cumulated vsize (KiB) 445684

[startup+51.1008 s]
/proc/loadavg: 3.86 6.91 7.68 2/214 32035
/proc/meminfo: memFree=22042996/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=445684 CPUtime=50.74 cores=0-7
/proc/32029/stat : 32029 (python) R 32027 32029 30702 0 -1 4202496 70186 932 1 0 5054 20 0 0 25 0 1 0 547078462 456380416 48812 33554432000 4194304 5683644 140734085040224 18446744073709551615 47854845294732 0 0 16781312 2 0 0 0 17 2 0 0 8
/proc/32029/statm: 111421 48812 1833 364 0 47345 0
Current children cumulated CPU time (s) 50.74
Current children cumulated vsize (KiB) 445684

[startup+102.307 s]
/proc/loadavg: 2.14 5.91 7.29 2/214 32037
/proc/meminfo: memFree=22043060/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=445684 CPUtime=101.94 cores=0-7
/proc/32029/stat : 32029 (python) R 32027 32029 30702 0 -1 4202496 70186 932 1 0 10174 20 0 0 25 0 1 0 547078462 456380416 48812 33554432000 4194304 5683644 140734085040224 18446744073709551615 47854845294732 0 0 16781312 2 0 0 0 17 0 0 0 8
/proc/32029/statm: 111421 48812 1833 364 0 47345 0
Current children cumulated CPU time (s) 101.94
Current children cumulated vsize (KiB) 445684

[startup+162.301 s]
/proc/loadavg: 5.70 6.28 7.33 9/238 32062
/proc/meminfo: memFree=19080380/32951124 swapFree=59765840/67111528
[pid=32029] ppid=32027 vsize=580560 CPUtime=105.84 cores=0-7
/proc/32029/stat : 32029 (python) S 32027 32029 30702 0 -1 4202496 76081 932 1 0 10559 25 0 0 19 0 9 0 547078462 594493440 45722 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820992459 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 8
/proc/32029/statm: 145140 45722 1889 364 0 81037 0
[pid=32038] ppid=32029 vsize=432988 CPUtime=0.09 cores=0-7
/proc/32038/stat : 32038 (python) S 32029 32029 30702 0 -1 4202560 930 0 0 0 4 5 0 0 18 0 1 0 547089058 443379712 44175 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185807 0 0 16781312 514 1154188142002012418 0 0 17 1 0 0 0
/proc/32038/statm: 108247 44175 376 364 0 44165 0
[pid=32040] ppid=32038 vsize=74352 CPUtime=56.32 cores=0-7
/proc/32040/stat : 32040 (lingeling) R 32038 32040 32040 0 -1 4202496 31304 0 0 0 5628 4 0 0 25 0 1 0 547089059 76136448 17758 33554432000 4194304 4352236 140737221186400 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/32040/statm: 18588 17758 129 39 0 17668 0
[pid=32041] ppid=32029 vsize=443244 CPUtime=0.09 cores=0-7
/proc/32041/stat : 32041 (python) S 32029 32029 30702 0 -1 4202560 936 0 0 0 5 4 0 0 15 0 1 0 547089061 453881856 44173 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 6759520414931583233 0 0 17 4 0 0 0
/proc/32041/statm: 110811 44173 370 364 0 46726 0
[pid=32043] ppid=32041 vsize=878372 CPUtime=56.17 cores=0-7
/proc/32043/stat : 32043 (cryptominisat-2) R 32041 32043 32043 0 -1 4202496 178109 0 0 0 5593 24 0 0 25 0 1 0 547089062 899452928 169242 33554432000 4194304 4677096 140733691740128 18446744073709551615 4358576 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/32043/statm: 219593 169243 393 118 0 214552 0
[pid=32044] ppid=32029 vsize=453500 CPUtime=0.09 cores=0-7
/proc/32044/stat : 32044 (python) S 32029 32029 30702 0 -1 4202560 946 0 0 0 4 5 0 0 18 0 1 0 547089065 464384000 44177 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 1154188142002012417 0 0 17 1 0 0 0
/proc/32044/statm: 113375 44177 370 364 0 49287 0
[pid=32046] ppid=32044 vsize=45360 CPUtime=56.25 cores=0-7
/proc/32046/stat : 32046 (SApperloT-base) R 32044 32046 32046 0 -1 4202496 10881 0 0 0 5623 2 0 0 25 0 1 0 547089065 46448640 10176 33554432000 134512640 135674940 4288884976 18446744073709551615 134564250 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/32046/statm: 11340 10176 99 284 0 11054 0
[pid=32047] ppid=32029 vsize=463756 CPUtime=0.09 cores=0-7
/proc/32047/stat : 32047 (python) S 32029 32029 30702 0 -1 4202560 948 0 0 0 4 5 0 0 18 0 1 0 547089068 474886144 44181 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 1154188142002012420 0 0 17 7 0 0 0
/proc/32047/statm: 115939 44181 370 364 0 51848 0
[pid=32049] ppid=32047 vsize=60540 CPUtime=56.22 cores=0-7
/proc/32049/stat : 32049 (lingeling) R 32047 32049 32049 0 -1 4202496 27788 0 0 0 5617 5 0 0 25 0 1 0 547089069 61992960 14305 33554432000 4194304 4352236 140736377112272 18446744073709551615 4331588 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/32049/statm: 15135 14305 129 39 0 14215 0
[pid=32050] ppid=32029 vsize=539548 CPUtime=0.11 cores=0-7
/proc/32050/stat : 32050 (python) S 32029 32029 30702 0 -1 4202560 964 0 0 0 5 6 0 0 15 0 1 0 547089072 552497152 44187 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 5629231257670877442 0 0 17 1 0 0 0
/proc/32050/statm: 134887 44187 370 364 0 70793 0
[pid=32052] ppid=32050 vsize=877732 CPUtime=56.17 cores=0-7
/proc/32052/stat : 32052 (cryptominisat-2) R 32050 32052 32052 0 -1 4202496 178349 0 0 0 5593 24 0 0 25 0 1 0 547089072 898797568 169712 33554432000 4194304 4677096 140735913697456 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/32052/statm: 219433 169712 393 118 0 214392 0
[pid=32053] ppid=32029 vsize=549804 CPUtime=0.1 cores=0-7
/proc/32053/stat : 32053 (python) S 32029 32029 30702 0 -1 4202560 962 0 0 0 5 5 0 0 15 0 1 0 547089075 562999296 44191 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 1154188142002012420 0 0 17 1 0 0 0
/proc/32053/statm: 137451 44191 370 364 0 73354 0
[pid=32055] ppid=32053 vsize=877740 CPUtime=55.57 cores=0-7
/proc/32055/stat : 32055 (cryptominisat-2) R 32053 32055 32055 0 -1 4202496 177855 0 0 0 5531 26 0 0 25 0 1 0 547089076 898805760 169062 33554432000 4194304 4677096 140736597685184 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/32055/statm: 219435 169062 393 118 0 214394 0
[pid=32056] ppid=32029 vsize=560060 CPUtime=0.09 cores=0-7
/proc/32056/stat : 32056 (python) S 32029 32029 30702 0 -1 4202560 956 0 0 0 4 5 0 0 18 0 1 0 547089079 573501440 44195 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 1154188142002012420 0 0 17 1 0 0 0
/proc/32056/statm: 140015 44195 370 364 0 75915 0
[pid=32058] ppid=32056 vsize=60028 CPUtime=56.09 cores=0-7
/proc/32058/stat : 32058 (lingeling) R 32056 32058 32058 0 -1 4202496 27727 0 0 0 5605 4 0 0 25 0 1 0 547089081 61468672 14177 33554432000 4194304 4352236 140733397683312 18446744073709551615 4234304 0 0 16781312 17506 0 0 0 17 0 0 0 0
/proc/32058/statm: 15007 14177 129 39 0 14087 0
[pid=32059] ppid=32029 vsize=570316 CPUtime=0.1 cores=0-7
/proc/32059/stat : 32059 (python) S 32029 32029 30702 0 -1 4202560 1009 0 0 0 5 5 0 0 15 0 1 0 547089082 584003584 44205 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 1154188142002012417 0 0 17 1 0 0 0
/proc/32059/statm: 142579 44205 376 364 0 78476 0
[pid=32061] ppid=32059 vsize=907268 CPUtime=55.46 cores=0-7
/proc/32061/stat : 32061 (cryptominisat-2) R 32059 32061 32061 0 -1 4202496 184237 0 0 0 5520 26 0 0 25 0 1 0 547089083 929042432 175404 33554432000 4194304 4677096 140736118031696 18446744073709551615 4319152 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/32061/statm: 226817 175404 393 118 0 221776 0
[pid=32029/tid=32039] ppid=32027 vsize=580560 CPUtime=0 cores=0-7
/proc/32029/task/32039/stat : 32039 (python) S 32027 32029 30702 0 -1 4202560 28 932 0 0 0 0 0 0 25 0 9 0 547089059 594493440 45722 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 0 0 0 0
[pid=32029/tid=32042] ppid=32027 vsize=580560 CPUtime=0 cores=0-7
/proc/32029/task/32042/stat : 32042 (python) S 32027 32029 30702 0 -1 4202560 20 932 0 0 0 0 0 0 20 0 9 0 547089062 594493440 45722 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 0 0 0 0
[pid=32029/tid=32045] ppid=32027 vsize=580560 CPUtime=0 cores=0-7
/proc/32029/task/32045/stat : 32045 (python) S 32027 32029 30702 0 -1 4202560 25 932 0 0 0 0 0 0 21 0 9 0 547089065 594493440 45722 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 2 0 0 0
[pid=32029/tid=32048] ppid=32027 vsize=580560 CPUtime=0 cores=0-7
/proc/32029/task/32048/stat : 32048 (python) S 32027 32029 30702 0 -1 4202560 19 932 0 0 0 0 0 0 18 0 9 0 547089069 594493440 45722 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 5 0 0 0
[pid=32029/tid=32051] ppid=32027 vsize=580560 CPUtime=0 cores=0-7
/proc/32029/task/32051/stat : 32051 (python) S 32027 32029 30702 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 9 0 547089072 594493440 45722 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 0 0 0 0
[pid=32029/tid=32054] ppid=32027 vsize=580560 CPUtime=0 cores=0-7
/proc/32029/task/32054/stat : 32054 (python) S 32027 32029 30702 0 -1 4202560 20 932 0 0 0 0 0 0 18 0 9 0 547089076 594493440 45722 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 7 0 0 0
[pid=32029/tid=32057] ppid=32027 vsize=580560 CPUtime=0 cores=0-7
/proc/32029/task/32057/stat : 32057 (python) S 32027 32029 30702 0 -1 4202560 24 932 0 0 0 0 0 0 19 0 9 0 547089079 594493440 45722 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
[pid=32029/tid=32060] ppid=32027 vsize=580560 CPUtime=0 cores=0-7
/proc/32029/task/32060/stat : 32060 (python) S 32027 32029 30702 0 -1 4202560 28 932 0 0 0 0 0 0 20 0 9 0 547089083 594493440 45722 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 554.85
Current children cumulated vsize (KiB) 8375168


################
# More data... #
################

/proc/32053/task/32069/stat : 32069 (python) S 32029 32029 30702 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 547099136 562999296 44221 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604440746469312 0 0 -1 1 0 0 0
[pid=32056] ppid=32029 vsize=560060 CPUtime=4.02 cores=0-7
/proc/32056/stat : 32056 (python) S 32029 32029 30702 0 -1 4202560 1172 0 0 0 203 199 0 0 18 0 2 0 547089079 573501440 44225 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/32056/statm: 140015 44225 399 364 0 75915 0
[pid=32058] ppid=32056 vsize=135776 CPUtime=2330.37 cores=0-7
/proc/32058/stat : 32058 (lingeling) T 32056 32058 32058 0 -1 4202496 46665 0 0 0 233029 8 0 0 25 0 1 0 547089081 139034624 33114 33554432000 4194304 4352236 140733397683312 18446744073709551615 4278692 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/32058/statm: 33944 33114 129 39 0 33024 0
[pid=32056/tid=32135] ppid=32029 vsize=560060 CPUtime=0 cores=0-7
/proc/32056/task/32135/stat : 32135 (python) S 32029 32029 30702 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 547215372 573501440 44225 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604440746468416 0 0 -1 0 0 0 0
[pid=32059] ppid=32029 vsize=570316 CPUtime=3.93 cores=0-7
/proc/32059/stat : 32059 (python) S 32029 32029 30702 0 -1 4202560 1240 0 0 0 194 199 0 0 15 0 2 0 547089082 584003584 44236 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/32059/statm: 142579 44236 406 364 0 78476 0
[pid=32061] ppid=32059 vsize=3456384 CPUtime=2230.16 cores=0-7
/proc/32061/stat : 32061 (cryptominisat-2) R 32059 32061 32061 0 -1 4202496 1388637 0 0 0 222610 406 0 0 25 0 1 0 547089083 3539337216 683119 33554432000 4194304 4677096 140736118031696 18446744073709551615 4485106 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/32061/statm: 864096 683119 393 118 0 859055 0
[pid=32059/tid=32168] ppid=32029 vsize=570316 CPUtime=0 cores=0-7
/proc/32059/task/32168/stat : 32168 (python) S 32029 32029 30702 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 547284397 584003584 44236 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604440746467520 0 0 -1 0 0 0 0
[pid=32065] ppid=32029 vsize=580572 CPUtime=2.04 cores=0-7
/proc/32065/stat : 32065 (python) S 32029 32029 30702 0 -1 4202560 1174 0 0 0 109 95 0 0 18 0 2 0 547099078 594505728 44233 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/32065/statm: 145143 44233 399 364 0 81037 0
[pid=32067] ppid=32065 vsize=225152 CPUtime=1171.68 cores=0-7
/proc/32067/stat : 32067 (precosat) R 32065 32067 32067 0 -1 4202496 123153 0 0 0 117150 18 0 0 25 0 1 0 547099079 230555648 53754 33554432000 4194304 4890832 140737055372240 18446744073709551615 4238565 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/32067/statm: 56288 53754 86 171 0 56115 0
[pid=32065/tid=32110] ppid=32029 vsize=580572 CPUtime=0 cores=0-7
/proc/32065/task/32110/stat : 32110 (python) S 32029 32029 30702 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 2 0 547167383 594505728 44233 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604453891446912 0 0 -1 2 0 0 0
[pid=32070] ppid=32029 vsize=590828 CPUtime=3.58 cores=0-7
/proc/32070/stat : 32070 (python) S 32029 32029 30702 0 -1 4202560 1185 0 0 0 187 171 0 0 18 0 2 0 547099140 605007872 44238 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/32070/statm: 147707 44238 399 364 0 83598 0
[pid=32072] ppid=32070 vsize=135788 CPUtime=2043.28 cores=0-7
/proc/32072/stat : 32072 (lingeling) T 32070 32072 32072 0 -1 4202496 46672 0 0 0 204321 7 0 0 25 0 1 0 547099140 139046912 33117 33554432000 4194304 4352236 140735086470912 18446744073709551615 4207831 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/32072/statm: 33947 33117 129 39 0 33027 0
[pid=32070/tid=32126] ppid=32029 vsize=590828 CPUtime=0 cores=0-7
/proc/32070/task/32126/stat : 32126 (python) S 32029 32029 30702 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 547187273 605007872 44238 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604453888450880 0 0 -1 4 0 0 0
[pid=32076] ppid=32029 vsize=601084 CPUtime=3.43 cores=0-7
/proc/32076/stat : 32076 (python) S 32029 32029 30702 0 -1 4202560 1187 0 0 0 174 169 0 0 15 0 2 0 547108604 615510016 44242 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/32076/statm: 150271 44242 399 364 0 86159 0
[pid=32078] ppid=32076 vsize=3088340 CPUtime=1944.28 cores=0-7
/proc/32078/stat : 32078 (cryptominisat-2) T 32076 32078 32078 0 -1 4202496 1130578 0 0 0 194163 265 0 0 25 0 1 0 547108605 3162460160 614854 33554432000 4194304 4677096 140736720253712 18446744073709551615 4336162 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/32078/statm: 772085 614854 393 118 0 767044 0
[pid=32076/tid=32082] ppid=32029 vsize=601084 CPUtime=0 cores=0-7
/proc/32076/task/32082/stat : 32082 (python) S 32029 32029 30702 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 547119045 615510016 44242 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604448952143936 0 0 -1 0 0 0 0
[pid=32089] ppid=32029 vsize=611340 CPUtime=1.51 cores=0-7
/proc/32089/stat : 32089 (python) S 32029 32029 30702 0 -1 4202560 1084 0 0 0 79 72 0 0 18 0 2 0 547138205 626012160 44360 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/32089/statm: 152835 44360 399 364 0 88720 0
[pid=32091] ppid=32089 vsize=215492 CPUtime=883.8 cores=0-7
/proc/32091/stat : 32091 (precosat) R 32089 32091 32091 0 -1 4202496 106958 0 0 0 88364 16 0 0 25 0 1 0 547138206 220663808 51305 33554432000 4194304 4890832 140737351515664 18446744073709551615 4229338 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/32091/statm: 53873 51305 86 171 0 53700 0
[pid=32089/tid=32137] ppid=32029 vsize=611340 CPUtime=0 cores=0-7
/proc/32089/task/32137/stat : 32137 (python) S 32029 32029 30702 0 -1 4202560 121 0 0 0 0 0 0 0 18 0 2 0 547216123 626012160 44360 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604453860494144 0 0 -1 6 0 0 0
[pid=32111] ppid=32029 vsize=621596 CPUtime=2.01 cores=0-7
/proc/32111/stat : 32111 (python) S 32029 32029 30702 0 -1 4202560 1179 0 0 0 104 97 0 0 18 0 2 0 547167387 636514304 44363 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32111/statm: 155399 44363 399 364 0 91281 0
[pid=32113] ppid=32111 vsize=222152 CPUtime=1166.88 cores=0-7
/proc/32113/stat : 32113 (precosat) T 32111 32113 32113 0 -1 4202496 121875 0 0 0 116671 17 0 0 25 0 1 0 547167388 227483648 52991 33554432000 4194304 4890832 140734828538176 18446744073709551615 4213120 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/32113/statm: 55538 52991 86 171 0 55365 0
[pid=32111/tid=32153] ppid=32029 vsize=621596 CPUtime=0 cores=0-7
/proc/32111/task/32153/stat : 32153 (python) S 32029 32029 30702 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 547247008 636514304 44363 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604448377185408 0 0 -1 7 0 0 0
[pid=32123] ppid=32029 vsize=631852 CPUtime=2 cores=0-7
/proc/32123/stat : 32123 (python) S 32029 32029 30702 0 -1 4202560 13546 0 0 0 108 92 0 0 18 0 2 0 547186531 647016448 44380 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32123/statm: 157963 44380 399 364 0 93842 0
[pid=32125] ppid=32123 vsize=231088 CPUtime=1073.34 cores=0-7
/proc/32125/stat : 32125 (precosat) T 32123 32125 32125 0 -1 4202496 131204 0 0 0 107317 17 0 0 25 0 1 0 547186532 236634112 55228 33554432000 4194304 4890832 140735139903280 18446744073709551615 4238327 0 0 16781312 17442 18446744071562691360 0 0 17 2 0 0 0
/proc/32125/statm: 57772 55228 86 171 0 57599 0
[pid=32123/tid=32129] ppid=32029 vsize=631852 CPUtime=0 cores=0-7
/proc/32123/task/32129/stat : 32129 (python) S 32029 32029 30702 0 -1 4202560 134 0 0 0 0 0 0 0 18 0 2 0 547196548 647016448 44380 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604453887109120 0 0 -1 4 0 0 0
[pid=32138] ppid=32029 vsize=642108 CPUtime=1.01 cores=0-7
/proc/32138/stat : 32138 (python) S 32029 32029 30702 0 -1 4202560 21312 0 0 0 50 51 0 0 18 0 2 0 547216128 657518592 44454 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/32138/statm: 160527 44454 407 364 0 96403 0
[pid=32140] ppid=32138 vsize=191824 CPUtime=489.98 cores=0-7
/proc/32140/stat : 32140 (precosat) T 32138 32140 32140 0 -1 4202496 61962 0 0 0 48990 8 0 0 25 0 1 0 547216129 196427776 45421 33554432000 4194304 4890832 140735813499712 18446744073709551615 4297769 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/32140/statm: 47956 45421 86 171 0 47783 0
[pid=32138/tid=32143] ppid=32029 vsize=642108 CPUtime=0 cores=0-7
/proc/32138/task/32143/stat : 32143 (python) S 32029 32029 30702 0 -1 4202560 84 0 0 0 0 0 0 0 18 0 2 0 547226149 657518592 44454 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604453849805184 0 0 -1 6 0 0 0
[pid=32149] ppid=32029 vsize=652364 CPUtime=1.06 cores=0-7
/proc/32149/stat : 32149 (python) S 32029 32029 30702 0 -1 4202560 13439 0 0 0 55 51 0 0 15 0 2 0 547244540 668020736 44433 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32149/statm: 163091 44433 406 364 0 98964 0
[pid=32151] ppid=32149 vsize=2364044 CPUtime=508.74 cores=0-7
/proc/32151/stat : 32151 (cryptominisat-2) R 32149 32151 32151 0 -1 4202496 548712 0 0 0 50780 94 0 0 25 0 1 0 547244540 2420781056 460918 33554432000 4194304 4677096 140735241007936 18446744073709551615 230808862356 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/32151/statm: 591011 460918 393 118 0 585970 0
[pid=32149/tid=32156] ppid=32029 vsize=652364 CPUtime=0 cores=0-7
/proc/32149/task/32156/stat : 32156 (python) S 32029 32029 30702 0 -1 4202560 94 0 0 0 0 0 0 0 15 0 2 0 547254535 668020736 44433 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604444437304640 0 0 -1 6 0 0 0
[pid=32162] ppid=32029 vsize=662620 CPUtime=0.88 cores=0-7
/proc/32162/stat : 32162 (python) S 32029 32029 30702 0 -1 4202560 1213 0 0 0 43 45 0 0 18 0 2 0 547273877 678522880 44431 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32162/statm: 165655 44431 400 364 0 101525 0
[pid=32164] ppid=32162 vsize=74348 CPUtime=490.23 cores=0-7
/proc/32164/stat : 32164 (lingeling) T 32162 32164 32164 0 -1 4202496 31323 0 0 0 49017 6 0 0 25 0 1 0 547273877 76132352 17757 33554432000 4194304 4352236 140734174078896 18446744073709551615 4234450 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/32164/statm: 18587 17757 129 39 0 17667 0
[pid=32162/tid=32171] ppid=32029 vsize=662620 CPUtime=0 cores=0-7
/proc/32162/task/32171/stat : 32171 (python) S 32029 32029 30702 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 547293508 678522880 44431 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604453888391040 0 0 -1 6 0 0 0
[pid=32183] ppid=32029 vsize=672876 CPUtime=0.19 cores=0-7
/proc/32183/stat : 32183 (python) S 32029 32029 30702 0 -1 4202560 1105 0 0 0 10 9 0 0 19 0 2 0 547333433 689025024 44466 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820992459 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/32183/statm: 168219 44466 400 364 0 104086 0
[pid=32185] ppid=32183 vsize=61052 CPUtime=98.02 cores=0-7
/proc/32185/stat : 32185 (lingeling) T 32183 32185 32185 0 -1 4202496 27990 0 0 0 9797 5 0 0 25 0 1 0 547333434 62517248 14433 33554432000 4194304 4352236 140735863115808 18446744073709551615 4276757 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/32185/statm: 15263 14433 129 39 0 14343 0
[pid=32183/tid=32188] ppid=32029 vsize=672876 CPUtime=0 cores=0-7
/proc/32183/task/32188/stat : 32188 (python) S 32029 32029 30702 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 547343253 689025024 44466 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 514 18446604449090262080 0 0 -1 1 0 0 0
[pid=32197] ppid=32029 vsize=683132 CPUtime=0.03 cores=0-7
/proc/32197/stat : 32197 (python) S 32029 32029 30702 0 -1 4202560 916 0 0 0 1 2 0 0 15 0 1 0 547371861 699527168 44442 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 1154188142002012422 0 0 17 6 0 0 0
/proc/32197/statm: 170783 44442 373 364 0 106647 0
[pid=32199] ppid=32197 vsize=558732 CPUtime=16.88 cores=0-7
/proc/32199/stat : 32199 (cryptominisat-2) R 32197 32199 32199 0 -1 4202496 105273 0 0 0 1673 15 0 0 25 0 1 0 547371862 572141568 100620 33554432000 4194304 4677096 140737475662064 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/32199/statm: 139683 100620 361 118 0 134642 0
[pid=32200] ppid=32029 vsize=693388 CPUtime=0 cores=0-7
/proc/32200/stat : 32200 (python) S 32029 32029 30702 0 -1 4202560 822 0 0 0 0 0 0 0 19 0 1 0 547373514 710029312 44485 33554432000 4194304 5683644 140734085040224 18446744073709551615 230809185862 0 0 16781312 514 10008705642992238591 0 0 17 6 0 0 0
/proc/32200/statm: 173347 44485 345 364 0 109208 0
[pid=32202] ppid=32200 vsize=94696 CPUtime=0.66 cores=0-7
/proc/32202/stat : 32202 (precosat) R 32200 32202 32202 0 -1 4202496 23770 0 0 0 62 4 0 0 22 0 1 0 547373515 96968704 23494 33554432000 4194304 4890832 140736197881104 18446744073709551615 4454610 0 0 16781312 17442 0 0 0 17 6 0 0 0
/proc/32202/statm: 23674 23494 68 171 0 23501 0
[pid=32029/tid=32039] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32039/stat : 32039 (python) S 32027 32029 30702 0 -1 4202560 57 932 0 0 0 0 0 0 18 0 21 0 547089059 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 0 0 0 0
[pid=32029/tid=32042] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32042/stat : 32042 (python) S 32027 32029 30702 0 -1 4202560 25 932 0 0 0 0 0 0 18 0 21 0 547089062 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 0 0 0 0
[pid=32029/tid=32045] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32045/stat : 32045 (python) S 32027 32029 30702 0 -1 4202560 25 932 0 0 0 0 0 0 21 0 21 0 547089065 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 2 0 0 0
[pid=32029/tid=32048] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32048/stat : 32048 (python) S 32027 32029 30702 0 -1 4202560 25 932 0 0 0 0 0 0 15 0 21 0 547089069 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 5 0 0 0
[pid=32029/tid=32051] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32051/stat : 32051 (python) S 32027 32029 30702 0 -1 4202560 32 932 0 0 0 0 0 0 18 0 21 0 547089072 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 0 0 0 0
[pid=32029/tid=32054] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32054/stat : 32054 (python) S 32027 32029 30702 0 -1 4202560 23 932 0 0 0 0 0 0 18 0 21 0 547089076 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 7 0 0 0
[pid=32029/tid=32057] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32057/stat : 32057 (python) S 32027 32029 30702 0 -1 4202560 42 932 0 0 0 0 0 0 18 0 21 0 547089079 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
[pid=32029/tid=32060] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32060/stat : 32060 (python) S 32027 32029 30702 0 -1 4202560 35 932 0 0 0 0 0 0 18 0 21 0 547089083 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
[pid=32029/tid=32066] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32066/stat : 32066 (python) S 32027 32029 30702 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 21 0 547099079 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
[pid=32029/tid=32071] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32071/stat : 32071 (python) S 32027 32029 30702 0 -1 4202560 48 932 0 0 0 0 0 0 18 0 21 0 547099140 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 6 0 0 0
[pid=32029/tid=32077] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32077/stat : 32077 (python) S 32027 32029 30702 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 21 0 547108605 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
[pid=32029/tid=32090] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32090/stat : 32090 (python) S 32027 32029 30702 0 -1 4202560 96 932 0 0 0 0 0 0 18 0 21 0 547138206 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
[pid=32029/tid=32112] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32112/stat : 32112 (python) S 32027 32029 30702 0 -1 4202560 35 932 0 0 0 0 0 0 18 0 21 0 547167388 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
[pid=32029/tid=32124] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32124/stat : 32124 (python) S 32027 32029 30702 0 -1 4202560 100 932 0 0 0 0 0 0 18 0 21 0 547186532 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
[pid=32029/tid=32139] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32139/stat : 32139 (python) S 32027 32029 30702 0 -1 4202560 55 932 0 0 0 0 0 0 18 0 21 0 547216129 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 6 0 0 0
[pid=32029/tid=32150] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32150/stat : 32150 (python) S 32027 32029 30702 0 -1 4202560 47 932 0 0 0 0 0 0 18 0 21 0 547244540 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 6 0 0 0
[pid=32029/tid=32163] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32163/stat : 32163 (python) S 32027 32029 30702 0 -1 4202560 38 932 0 0 0 0 0 0 18 0 21 0 547273877 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
[pid=32029/tid=32184] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32184/stat : 32184 (python) S 32027 32029 30702 0 -1 4202560 44 932 0 0 0 0 0 0 20 0 21 0 547333434 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
[pid=32029/tid=32198] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32198/stat : 32198 (python) S 32027 32029 30702 0 -1 4202560 45 932 0 0 0 0 0 0 20 0 21 0 547371861 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 1 0 0 0
[pid=32029/tid=32201] ppid=32027 vsize=703632 CPUtime=0 cores=0-7
/proc/32029/task/32201/stat : 32201 (python) S 32027 32029 30702 0 -1 4202560 42 932 0 0 0 0 0 0 20 0 21 0 547373515 720519168 46057 33554432000 4194304 5683644 140734085040224 18446744073709551615 230820989361 0 0 16781312 2 18446604444264372096 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 22802.6
Current children cumulated vsize (KiB) 31907896

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32029 and gives
#  childrusage.ru_utime.tv_sec=108
#  childrusage.ru_utime.tv_usec=346528
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=368943
# CPU time returned by wait4() is 108.715
# while last known CPU time is 22802.6
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 2951.34
CPU time (s): 22802.6
CPU user time (s): 22767.8
CPU system time (s): 34.78
CPU usage (%): 772.617
Max. virtual memory (cumulated for all children) (KiB): 31907896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 108.347
system time used= 0.368943
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 97846
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3153
involuntary context switches= 366

runsolver used 18.9251 second user time and 44.4882 second system time

The end

Launcher Data 

Begin job on node104 at 2011-05-02 18:46:20
IDJOB=3322606
IDBENCH=84248
IDSOLVER=1710
FILE ID=node104/3322606-1304354779
RUNJOBID= node104-1304342614-30716
PBS_JOBID= 13178062
Free space on /tmp= 73408 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT03/industrial/schuppan/l2s/dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322606-1304354779/watcher-3322606-1304354779 -o /tmp/evaluation-result-3322606-1304354779/solver-3322606-1304354779 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3322606-1304354779.cnf -seed 1630679311 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3fef216b3efe77c0f10ea0e0be664a94
RANDOM SEED=1630679311

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22227960 kB
Buffers:         11240 kB
Cached:         279928 kB
SwapCached:      43832 kB
Active:        2924224 kB
Inactive:      7627720 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22227960 kB
SwapTotal:    67111528 kB
SwapFree:     59765840 kB
Dirty:           46780 kB
Writeback:           0 kB
AnonPages:    10228292 kB
Mapped:          14044 kB
Slab:            61912 kB
PageTables:      42936 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 19425140 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73376 MiB
End job on node104 at 2011-05-02 19:35:34