Trace number 3381211

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-industrial (fixed)? (MO) 19652.2 2557.56

General information on the benchmark

NameSAT03/industrial/schuppan/l2s/
dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf
MD5SUM3fef216b3efe77c0f10ea0e0be664a94
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables261352
Number of clauses773077
Sum of the clauses size1985588
Maximum clause length248
Minimum clause length1
Number of clauses of size 11592
Number of clauses of size 2357488
Number of clauses of size 3413748
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5249

Solver Data 

0.34/0.69	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.34/0.69	c INFO: solving HOME/instance-3381211-1305509300.cnf
0.34/0.69	c INFO: computing task features
3.20/3.58	c INFO: computed variable-clause graph statistics
3.30/3.69	c INFO: computed clause balance statistics
16.60/16.92	c INFO: computed variable balance statistics
26.30/26.65	c INFO: computed small-clause counts
26.50/26.86	c INFO: computed Horn-clause counts
105.01/105.32	c INFO: computed variable graph statistics
105.01/105.32	c INFO: collected features for HOME/instance-3381211-1305509300.cnf in 104.55 s
105.01/105.34	c INFO: running lingeling-276@0 for 97 with 4895 remaining (b = 0.66)
105.01/105.37	c INFO: running cryptominisat-2.9.0@0 for 485 with 4895 remaining (b = 0.47)
105.11/105.40	c INFO: running lingeling-276@0 for 1261 with 4895 remaining (b = 0.57)
105.11/105.44	c INFO: running lingeling-276@0 for 970 with 4895 remaining (b = 0.45)
105.11/105.47	c INFO: running cryptominisat-2.9.0@0 for 582 with 4895 remaining (b = 0.41)
105.11/105.50	c INFO: running precosat-570@0 for 388 with 4895 remaining (b = 0.30)
105.56/105.53	c INFO: running cryptominisat-2.9.0@0 for 485 with 4895 remaining (b = 0.28)
105.56/105.56	c INFO: running lingeling-276@0 for 970 with 4895 remaining (b = 0.30)
904.71/205.68	c INFO: running lingeling-276@0 for 97 with 4795 remaining (b = 0.06)
1665.30/300.97	c INFO: running lingeling-276@94 for 97 with 4699 remaining (b = 0.06)
2473.74/402.30	c INFO: running precosat-570@0 for 388 with 4598 remaining (b = 0.18)
3258.67/500.66	c INFO: running SApperloT@0 for 97 with 4500 remaining (b = 0.03)
3998.11/593.33	c INFO: running cryptominisat-2.9.0@0 for 388 with 4407 remaining (b = 0.16)
4058.74/601.00	c INFO: running cryptominisat-2.9.0@0 for 485 with 4399 remaining (b = 0.17)
4077.07/603.25	c INFO: running precosat-570@0 for 679 with 4397 remaining (b = 0.20)
4799.00/693.75	c INFO: running lingeling-276@0 for 194 with 4306 remaining (b = 0.06)
5626.22/797.46	c INFO: running precosat-570@393 for 388 with 4203 remaining (b = 0.12)
6367.28/890.36	c INFO: running cryptominisat-2.9.0@0 for 1843 with 4110 remaining (b = 0.43)
7130.65/986.08	c INFO: running cryptominisat-2.9.0@0 for 1843 with 4014 remaining (b = 0.41)
7866.10/1078.27	c INFO: running cryptominisat-2.9.0@99 for 1843 with 3922 remaining (b = 0.39)
7907.62/1083.43	c INFO: running cryptominisat-2.9.0@0 for 1940 with 3917 remaining (b = 0.37)
8027.19/1098.42	c INFO: running lingeling-276@393 for 873 with 3902 remaining (b = 0.17)
8729.89/1186.60	c INFO: running precosat-570@589 for 194 with 3814 remaining (b = 0.10)
9509.13/1284.20	c INFO: running precosat-570@584 for 194 with 3716 remaining (b = 0.10)
10169.57/1367.04	c INFO: running precosat-570@0 for 2134 with 3633 remaining (b = 0.38)
10258.10/1378.18	c INFO: running precosat-570@1267 for 97 with 3622 remaining (b = 0.05)
11036.43/1475.78	c INFO: running cryptominisat-2.9.0@0 for 97 with 3524 remaining (b = 0.04)
11065.97/1479.50	c INFO: running precosat-570@0 for 388 with 3521 remaining (b = 0.13)
11823.57/1574.53	c INFO: running cryptominisat-2.9.0@100 for 388 with 3426 remaining (b = 0.10)
14207.35/1873.78	c INFO: running precosat-570@98 for 291 with 3126 remaining (b = 0.08)
14969.76/1969.41	c INFO: running lingeling-276@195 for 97 with 3031 remaining (b = 0.03)
15038.30/1978.10	c INFO: running precosat-570@0 for 388 with 3022 remaining (b = 0.14)
15743.10/2066.74	c INFO: running precosat-570@0 for 97 with 2933 remaining (b = 0.05)
16523.82/2164.76	c INFO: running lingeling-276@1072 for 194 with 2835 remaining (b = 0.05)
16542.20/2167.09	c INFO: running precosat-570@489 for 291 with 2833 remaining (b = 0.07)
18066.10/2358.38	c INFO: running lingeling-276@1171 for 97 with 2642 remaining (b = 0.02)
18185.56/2373.34	c INFO: running SApperloT@485 for 97 with 2627 remaining (b = 0.02)
18825.20/2453.69	c INFO: running lingeling-276@0 for 97 with 2547 remaining (b = 0.03)
18892.08/2462.09	c INFO: running precosat-570@682 for 97 with 2538 remaining (b = 0.03)
18952.64/2469.67	c INFO: running precosat-570@1846 for 388 with 2531 remaining (b = 0.07)
19624.96/2554.04	c INFO: running precosat-570@289 for 194 with 2446 remaining (b = 0.04)
19643.35/2556.41	c INFO: running cryptominisat-2.9.0@0 for 97 with 2444 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3381211-1305509300/watcher-3381211-1305509300 -o /tmp/evaluation-result-3381211-1305509300/solver-3381211-1305509300 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3381211-1305509300.cnf -seed 1189484711 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.10 8.12 8.03 2/385 2837
/proc/meminfo: memFree=16341672/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=15184 CPUtime=0 cores=0-7
/proc/2837/stat : 2837 (python) R 2835 2837 2618 0 -1 4202496 722 0 0 0 0 0 0 0 21 0 1 0 643345601 15548416 614 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095449088 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2837/statm: 3796 614 321 364 0 283 0

[startup+0.062446 s]
/proc/loadavg: 8.10 8.12 8.03 2/385 2837
/proc/meminfo: memFree=16341672/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=29792 CPUtime=0.04 cores=0-7
/proc/2837/stat : 2837 (python) R 2835 2837 2618 0 -1 4202496 1458 0 0 0 3 1 0 0 21 0 1 0 643345601 30507008 1299 33554432000 4194304 5683644 140736489544688 18446744073709551615 4447936 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2837/statm: 7448 1299 443 364 0 818 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 29792

[startup+0.100436 s]
/proc/loadavg: 8.10 8.12 8.03 2/385 2837
/proc/meminfo: memFree=16341672/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=85624 CPUtime=0.05 cores=0-7
/proc/2837/stat : 2837 (python) S 2835 2837 2618 0 -1 4202496 2629 0 0 0 4 1 0 0 18 0 1 0 643345601 87678976 2348 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095449088 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/2837/statm: 21406 2348 713 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85624

[startup+0.300422 s]
/proc/loadavg: 8.10 8.12 8.03 2/385 2837
/proc/meminfo: memFree=16341672/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=135752 CPUtime=0.18 cores=0-7
/proc/2837/stat : 2837 (python) R 2835 2837 2618 0 -1 4202496 5958 934 1 0 13 5 0 0 18 0 1 0 643345601 139010048 4150 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095447045 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2837/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135752

[startup+0.700337 s]
/proc/loadavg: 8.10 8.12 8.03 2/385 2837
/proc/meminfo: memFree=16341672/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=293356 CPUtime=0.4 cores=0-7
/proc/2837/stat : 2837 (python) R 2835 2837 2618 0 -1 4202496 9743 934 1 0 29 11 0 0 17 0 1 0 643345601 300396544 7427 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095450880 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2837/statm: 73339 7447 1758 364 0 9263 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 293356

[startup+1.50016 s]
/proc/loadavg: 7.53 8.00 8.00 2/386 2850
/proc/meminfo: memFree=16286416/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=345556 CPUtime=1.21 cores=0-7
/proc/2837/stat : 2837 (python) R 2835 2837 2618 0 -1 4202496 25701 934 1 0 107 14 0 0 18 0 1 0 643345601 353849344 23291 33554432000 4194304 5683644 140736489544688 18446744073709551615 4295780 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2837/statm: 86422 23292 1761 364 0 22346 0
Current children cumulated CPU time (s) 1.21
Current children cumulated vsize (KiB) 345556

[startup+3.10086 s]
/proc/loadavg: 7.53 8.00 8.00 2/386 2850
/proc/meminfo: memFree=16213876/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=407396 CPUtime=2.8 cores=0-7
/proc/2837/stat : 2837 (python) R 2835 2837 2618 0 -1 4202496 60545 934 1 0 262 18 0 0 20 0 1 0 643345601 417173504 39183 33554432000 4194304 5683644 140736489544688 18446744073709551615 47882322447137 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2837/statm: 101849 39183 1776 364 0 37773 0
Current children cumulated CPU time (s) 2.8
Current children cumulated vsize (KiB) 407396

[startup+6.30027 s]
/proc/loadavg: 7.53 8.00 8.00 2/386 2850
/proc/meminfo: memFree=16152252/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=445684 CPUtime=6 cores=0-7
/proc/2837/stat : 2837 (python) R 2835 2837 2618 0 -1 4202496 70177 934 1 0 581 19 0 0 25 0 1 0 643345601 456380416 48805 33554432000 4194304 5683644 140736489544688 18446744073709551615 4509160 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2837/statm: 111421 48805 1826 364 0 47345 0
Current children cumulated CPU time (s) 6
Current children cumulated vsize (KiB) 445684

[startup+12.7011 s]
/proc/loadavg: 6.53 7.77 7.92 2/386 2850
/proc/meminfo: memFree=16152068/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=445684 CPUtime=12.4 cores=0-7
/proc/2837/stat : 2837 (python) R 2835 2837 2618 0 -1 4202496 70177 934 1 0 1221 19 0 0 25 0 1 0 643345601 456380416 48805 33554432000 4194304 5683644 140736489544688 18446744073709551615 47882279586928 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2837/statm: 111421 48805 1826 364 0 47345 0
Current children cumulated CPU time (s) 12.4
Current children cumulated vsize (KiB) 445684

[startup+25.5007 s]
/proc/loadavg: 5.68 7.55 7.85 2/386 2851
/proc/meminfo: memFree=16153580/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=445684 CPUtime=25.2 cores=0-7
/proc/2837/stat : 2837 (python) R 2835 2837 2618 0 -1 4202496 70178 934 1 0 2501 19 0 0 25 0 1 0 643345601 456380416 48806 33554432000 4194304 5683644 140736489544688 18446744073709551615 47882277205461 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2837/statm: 111421 48806 1827 364 0 47345 0
Current children cumulated CPU time (s) 25.2
Current children cumulated vsize (KiB) 445684

[startup+51.101 s]
/proc/loadavg: 4.08 7.02 7.66 2/386 2851
/proc/meminfo: memFree=16153420/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=445684 CPUtime=50.81 cores=0-7
/proc/2837/stat : 2837 (python) R 2835 2837 2618 0 -1 4202496 70184 934 1 0 5062 19 0 0 25 0 1 0 643345601 456380416 48812 33554432000 4194304 5683644 140736489544688 18446744073709551615 47882276870272 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2837/statm: 111421 48812 1833 364 0 47345 0
Current children cumulated CPU time (s) 50.81
Current children cumulated vsize (KiB) 445684

[startup+102.314 s]
/proc/loadavg: 2.23 6.01 7.28 2/386 2853
/proc/meminfo: memFree=16152956/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=445684 CPUtime=102.02 cores=0-7
/proc/2837/stat : 2837 (python) R 2835 2837 2618 0 -1 4202496 70184 934 1 0 10183 19 0 0 25 0 1 0 643345601 456380416 48812 33554432000 4194304 5683644 140736489544688 18446744073709551615 47882276870284 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2837/statm: 111421 48812 1833 364 0 47345 0
Current children cumulated CPU time (s) 102.02
Current children cumulated vsize (KiB) 445684

[startup+162.302 s]
/proc/loadavg: 5.93 6.37 7.32 9/410 2879
/proc/meminfo: memFree=13633880/32951124 swapFree=65980224/67111528
[pid=2837] ppid=2835 vsize=580560 CPUtime=105.28 cores=0-7
/proc/2837/stat : 2837 (python) S 2835 2837 2618 0 -1 4202496 75609 934 1 0 10502 26 0 0 25 0 9 0 643345601 594493440 45893 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107277771 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/2837/statm: 145140 45893 1889 364 0 81037 0
[pid=2854] ppid=2837 vsize=432988 CPUtime=0.16 cores=0-7
/proc/2854/stat : 2854 (python) S 2837 2837 2618 0 -1 4202560 1006 0 0 0 7 9 0 0 18 0 1 0 643356136 443379712 44180 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471119 0 0 16781312 514 8291443573337850113 0 0 17 1 0 0 0
/proc/2854/statm: 108247 44180 381 364 0 44165 0
[pid=2856] ppid=2854 vsize=60540 CPUtime=56.93 cores=0-7
/proc/2856/stat : 2856 (lingeling) R 2854 2856 2856 0 -1 4202496 27852 0 0 0 5688 5 0 0 25 0 1 0 643356137 61992960 14305 33554432000 4194304 4352236 140733281712256 18446744073709551615 4328100 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/2856/statm: 15135 14305 129 39 0 14215 0
[pid=2857] ppid=2837 vsize=443244 CPUtime=0.17 cores=0-7
/proc/2857/stat : 2857 (python) S 2837 2837 2618 0 -1 4202560 934 0 0 0 8 9 0 0 15 0 1 0 643356139 453881856 44173 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 3323546578131583234 0 0 17 6 0 0 0
/proc/2857/statm: 110811 44173 370 364 0 46726 0
[pid=2859] ppid=2857 vsize=889096 CPUtime=56.72 cores=0-7
/proc/2859/stat : 2859 (cryptominisat-2) R 2857 2859 2859 0 -1 4202496 180098 0 0 0 5650 22 0 0 25 0 1 0 643356140 910434304 171301 33554432000 4194304 4677096 140733863214320 18446744073709551615 4319571 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/2859/statm: 222274 171301 393 118 0 217233 0
[pid=2860] ppid=2837 vsize=453500 CPUtime=0.17 cores=0-7
/proc/2860/stat : 2860 (python) S 2837 2837 2618 0 -1 4202560 945 0 0 0 7 10 0 0 18 0 1 0 643356142 464384000 44177 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 8291443573337850115 0 0 17 1 0 0 0
/proc/2860/statm: 113375 44177 370 364 0 49287 0
[pid=2863] ppid=2860 vsize=74348 CPUtime=56.87 cores=0-7
/proc/2863/stat : 2863 (lingeling) R 2860 2863 2863 0 -1 4202496 31304 0 0 0 5681 6 0 0 25 0 1 0 643356143 76132352 17757 33554432000 4194304 4352236 140733221599328 18446744073709551615 4327902 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/2863/statm: 18587 17757 129 39 0 17667 0
[pid=2864] ppid=2837 vsize=463756 CPUtime=0.16 cores=0-7
/proc/2864/stat : 2864 (python) S 2837 2837 2618 0 -1 4202560 954 0 0 0 8 8 0 0 18 0 1 0 643356145 474886144 44181 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 8291443573337850116 0 0 17 1 0 0 0
/proc/2864/statm: 115939 44181 370 364 0 51848 0
[pid=2866] ppid=2864 vsize=60544 CPUtime=56.84 cores=0-7
/proc/2866/stat : 2866 (lingeling) R 2864 2866 2866 0 -1 4202496 27848 0 0 0 5679 5 0 0 25 0 1 0 643356146 61997056 14305 33554432000 4194304 4352236 140736090620800 18446744073709551615 4328009 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/2866/statm: 15136 14305 129 39 0 14216 0
[pid=2867] ppid=2837 vsize=539548 CPUtime=0.18 cores=0-7
/proc/2867/stat : 2867 (python) S 2837 2837 2618 0 -1 4202560 802 0 0 0 11 7 0 0 15 0 1 0 643356149 552497152 44303 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 8291443573337850114 0 0 17 2 0 0 0
/proc/2867/statm: 134887 44303 371 364 0 70793 0
[pid=2869] ppid=2867 vsize=935804 CPUtime=56.31 cores=0-7
/proc/2869/stat : 2869 (cryptominisat-2) R 2867 2869 2869 0 -1 4202496 189434 0 0 0 5602 29 0 0 25 0 1 0 643356150 958263296 180789 33554432000 4194304 4677096 140733395924144 18446744073709551615 4319643 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2869/statm: 233951 180789 393 118 0 228910 0
[pid=2870] ppid=2837 vsize=549804 CPUtime=0.16 cores=0-7
/proc/2870/stat : 2870 (python) S 2837 2837 2618 0 -1 4202560 808 0 0 0 9 7 0 0 18 0 1 0 643356152 562999296 44278 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 8291443573337850116 0 0 17 0 0 0 0
/proc/2870/statm: 137451 44278 371 364 0 73354 0
[pid=2872] ppid=2870 vsize=199368 CPUtime=56.61 cores=0-7
/proc/2872/stat : 2872 (precosat) R 2870 2872 2872 0 -1 4202496 51655 0 0 0 5653 8 0 0 25 0 1 0 643356153 204152832 47287 33554432000 4194304 4890832 140734262906704 18446744073709551615 4246730 0 0 16781312 17442 0 0 0 17 0 0 0 0
/proc/2872/statm: 49842 47287 86 171 0 49669 0
[pid=2873] ppid=2837 vsize=560060 CPUtime=0.17 cores=0-7
/proc/2873/stat : 2873 (python) S 2837 2837 2618 0 -1 4202560 817 0 0 0 9 8 0 0 15 0 1 0 643356155 573501440 44292 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 17792613824314966273 0 0 17 7 0 0 0
/proc/2873/statm: 140015 44292 371 364 0 75915 0
[pid=2875] ppid=2873 vsize=871752 CPUtime=55.68 cores=0-7
/proc/2875/stat : 2875 (cryptominisat-2) R 2873 2875 2875 0 -1 4202496 176859 0 0 0 5544 24 0 0 25 0 1 0 643356158 892674048 168215 33554432000 4194304 4677096 140736684498144 18446744073709551615 4318905 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/2875/statm: 217938 168215 393 118 0 212897 0
[pid=2876] ppid=2837 vsize=570316 CPUtime=0.16 cores=0-7
/proc/2876/stat : 2876 (python) S 2837 2837 2618 0 -1 4202560 869 0 0 0 8 8 0 0 18 0 1 0 643356158 584003584 44377 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 8291443573337850113 0 0 17 2 0 0 0
/proc/2876/statm: 142579 44377 377 364 0 78476 0
[pid=2878] ppid=2876 vsize=60544 CPUtime=56.36 cores=0-7
/proc/2878/stat : 2878 (lingeling) R 2876 2878 2878 0 -1 4202496 27850 0 0 0 5632 4 0 0 25 0 1 0 643356159 61997056 14306 33554432000 4194304 4352236 140737291697696 18446744073709551615 4234513 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/2878/statm: 15136 14306 129 39 0 14216 0
[pid=2837/tid=2855] ppid=2835 vsize=580560 CPUtime=0 cores=0-7
/proc/2837/task/2855/stat : 2855 (python) S 2835 2837 2618 0 -1 4202560 24 934 0 0 0 0 0 0 25 0 9 0 643356137 594493440 45893 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 0 0 0 0
[pid=2837/tid=2858] ppid=2835 vsize=580560 CPUtime=0 cores=0-7
/proc/2837/task/2858/stat : 2858 (python) S 2835 2837 2618 0 -1 4202560 20 934 0 0 0 0 0 0 20 0 9 0 643356140 594493440 45893 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 4 0 0 0
[pid=2837/tid=2862] ppid=2835 vsize=580560 CPUtime=0 cores=0-7
/proc/2837/task/2862/stat : 2862 (python) S 2835 2837 2618 0 -1 4202560 23 934 0 0 0 0 0 0 19 0 9 0 643356143 594493440 45893 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 2 0 0 0
[pid=2837/tid=2865] ppid=2835 vsize=580560 CPUtime=0 cores=0-7
/proc/2837/task/2865/stat : 2865 (python) S 2835 2837 2618 0 -1 4202560 23 934 0 0 0 0 0 0 18 0 9 0 643356146 594493440 45893 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 5 0 0 0
[pid=2837/tid=2868] ppid=2835 vsize=580560 CPUtime=0 cores=0-7
/proc/2837/task/2868/stat : 2868 (python) S 2835 2837 2618 0 -1 4202560 55 934 0 0 0 0 0 0 21 0 9 0 643356149 594493440 45893 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 2 0 0 0
[pid=2837/tid=2871] ppid=2835 vsize=580560 CPUtime=0 cores=0-7
/proc/2837/task/2871/stat : 2871 (python) S 2835 2837 2618 0 -1 4202560 31 934 0 0 0 0 0 0 23 0 9 0 643356153 594493440 45893 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 0 0 0 0
[pid=2837/tid=2874] ppid=2835 vsize=580560 CPUtime=0 cores=0-7
/proc/2837/task/2874/stat : 2874 (python) S 2835 2837 2618 0 -1 4202560 33 934 0 0 0 0 0 0 24 0 9 0 643356156 594493440 45893 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 7 0 0 0
[pid=2837/tid=2877] ppid=2835 vsize=580560 CPUtime=0 cores=0-7
/proc/2837/task/2877/stat : 2877 (python) S 2835 2837 2618 0 -1 4202560 35 934 0 0 0 0 0 0 25 0 9 0 643356159 594493440 45893 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 558.93
Current children cumulated vsize (KiB) 7745772


################
# More data... #
################

/proc/2872/statm: 60622 58082 86 171 0 60449 0
[pid=2870/tid=2894] ppid=2837 vsize=549804 CPUtime=0 cores=0-7
/proc/2870/task/2894/stat : 2894 (python) S 2837 2837 2618 0 -1 4202560 69 0 0 0 0 0 0 0 18 0 2 0 643395665 562999296 44307 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604441827238848 0 0 -1 1 0 0 0
[pid=2873] ppid=2837 vsize=560060 CPUtime=6.86 cores=0-7
/proc/2873/stat : 2873 (python) S 2837 2837 2618 0 -1 4202560 1005 0 0 0 341 345 0 0 15 0 2 0 643356155 573501440 44322 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/2873/statm: 140015 44322 400 364 0 75915 0
[pid=2875] ppid=2873 vsize=3227440 CPUtime=2141.95 cores=0-7
/proc/2875/stat : 2875 (cryptominisat-2) R 2873 2875 2875 0 -1 4202496 1159334 0 0 0 213858 337 0 0 25 0 1 0 643356158 3304898560 631009 33554432000 4194304 4677096 140736684498144 18446744073709551615 4336210 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2875/statm: 806860 631009 393 118 0 801819 0
[pid=2873/tid=2906] ppid=2837 vsize=560060 CPUtime=0 cores=0-7
/proc/2873/task/2906/stat : 2906 (python) S 2837 2837 2618 0 -1 4202560 68 0 0 0 0 0 0 0 16 0 2 0 643405924 573501440 44322 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604441673886592 0 0 -1 0 0 0 0
[pid=2876] ppid=2837 vsize=570316 CPUtime=2.94 cores=0-7
/proc/2876/stat : 2876 (python) S 2837 2837 2618 0 -1 4202560 1054 0 0 0 158 136 0 0 18 0 2 0 643356158 584003584 44406 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107277771 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/2876/statm: 142579 44406 405 364 0 78476 0
[pid=2878] ppid=2876 vsize=108896 CPUtime=971.56 cores=0-7
/proc/2878/stat : 2878 (lingeling) T 2876 2878 2878 0 -1 4202496 39940 0 0 0 97150 6 0 0 25 0 1 0 643356159 111509504 26394 33554432000 4194304 4352236 140737291697696 18446744073709551615 4278683 0 0 16781312 17506 18446744071562691360 0 0 17 1 0 0 0
/proc/2878/statm: 27224 26394 129 39 0 26304 0
[pid=2876/tid=2929] ppid=2837 vsize=570316 CPUtime=0 cores=0-7
/proc/2876/task/2929/stat : 2929 (python) S 2837 2837 2618 0 -1 4202560 74 0 0 0 0 0 0 0 19 0 2 0 643453942 584003584 44406 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604441673885696 0 0 -1 4 0 0 0
[pid=2888] ppid=2837 vsize=580572 CPUtime=3.25 cores=0-7
/proc/2888/stat : 2888 (python) S 2837 2837 2618 0 -1 4202560 1026 0 0 0 172 153 0 0 18 0 2 0 643385832 594505728 44364 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107277771 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/2888/statm: 145143 44364 399 364 0 81037 0
[pid=2890] ppid=2888 vsize=222412 CPUtime=1072.71 cores=0-7
/proc/2890/stat : 2890 (precosat) T 2888 2890 2890 0 -1 4202496 127452 0 0 0 107253 18 0 0 25 0 1 0 643385832 227749888 53011 33554432000 4194304 4890832 140733277205120 18446744073709551615 4238673 0 0 16781312 17442 18446744071562691360 0 0 17 4 0 0 0
/proc/2890/statm: 55603 53011 86 171 0 55430 0
[pid=2888/tid=2918] ppid=2837 vsize=580572 CPUtime=0 cores=0-7
/proc/2888/task/2918/stat : 2918 (python) S 2837 2837 2618 0 -1 4202560 75 0 0 0 0 0 0 0 18 0 2 0 643425345 594505728 44364 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604445356122432 0 0 -1 4 0 0 0
[pid=2895] ppid=2837 vsize=590828 CPUtime=0.63 cores=0-7
/proc/2895/stat : 2895 (python) S 2837 2837 2618 0 -1 4202560 1023 0 0 0 33 30 0 0 18 0 2 0 643395668 605007872 44363 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107277771 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/2895/statm: 147707 44363 399 364 0 83598 0
[pid=2897] ppid=2895 vsize=84972 CPUtime=195.32 cores=0-7
/proc/2897/stat : 2897 (SApperloT-base) T 2895 2897 2897 0 -1 4202496 20955 0 0 0 19526 6 0 0 25 0 1 0 643395669 87011328 20002 33554432000 134512640 135674940 4291468288 18446744073709551615 134551170 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/2897/statm: 21243 20002 100 284 0 20957 0
[pid=2895/tid=2902] ppid=2837 vsize=590828 CPUtime=0 cores=0-7
/proc/2895/task/2902/stat : 2902 (python) S 2837 2837 2618 0 -1 4202560 69 0 0 0 0 0 0 0 18 0 2 0 643405699 605007872 44363 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604442595870016 0 0 -1 1 0 0 0
[pid=2903] ppid=2837 vsize=601084 CPUtime=1.59 cores=0-7
/proc/2903/stat : 2903 (python) S 2837 2837 2618 0 -1 4202560 1043 0 0 0 80 79 0 0 16 0 2 0 643405701 615510016 44400 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107277771 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/2903/statm: 150271 44400 399 364 0 86159 0
[pid=2905] ppid=2903 vsize=2424392 CPUtime=489.07 cores=0-7
/proc/2905/stat : 2905 (cryptominisat-2) T 2903 2905 2905 0 -1 4202496 527222 0 0 0 48819 88 0 0 25 0 1 0 643405702 2482577408 456790 33554432000 4194304 4677096 140736146954224 18446744073709551615 4320122 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/2905/statm: 606098 456790 393 118 0 601057 0
[pid=2903/tid=2934] ppid=2837 vsize=601084 CPUtime=0 cores=0-7
/proc/2903/task/2934/stat : 2934 (python) S 2837 2837 2618 0 -1 4202560 72 0 0 0 0 0 0 0 16 0 2 0 643455441 615510016 44400 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604453963141504 0 0 -1 7 0 0 0
[pid=2910] ppid=2837 vsize=611340 CPUtime=3.35 cores=0-7
/proc/2910/stat : 2910 (python) S 2837 2837 2618 0 -1 4202560 1044 0 0 0 174 161 0 0 18 0 2 0 643414977 626012160 44411 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107277771 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/2910/statm: 152835 44411 399 364 0 88720 0
[pid=2912] ppid=2910 vsize=104756 CPUtime=1072.27 cores=0-7
/proc/2912/stat : 2912 (lingeling) T 2910 2912 2912 0 -1 4202496 38945 0 0 0 107221 6 0 0 25 0 1 0 643414978 107270144 25359 33554432000 4194304 4352236 140736099503072 18446744073709551615 4281083 0 0 16781312 17506 18446744071562691360 0 0 17 3 0 0 0
/proc/2912/statm: 26189 25359 129 39 0 25269 0
[pid=2910/tid=2922] ppid=2837 vsize=611340 CPUtime=0 cores=0-7
/proc/2910/task/2922/stat : 2922 (python) S 2837 2837 2618 0 -1 4202560 76 0 0 0 0 0 0 0 18 0 2 0 643434635 626012160 44411 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604445106791744 0 0 -1 3 0 0 0
[pid=2930] ppid=2837 vsize=621596 CPUtime=4.75 cores=0-7
/proc/2930/stat : 2930 (python) S 2837 2837 2618 0 -1 4202560 893 0 0 0 239 236 0 0 15 0 1 0 643453945 636514304 44394 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 8291443573337850115 0 0 17 5 0 0 0
/proc/2930/statm: 155399 44394 380 364 0 91281 0
[pid=2933] ppid=2930 vsize=2657096 CPUtime=1428.22 cores=0-7
/proc/2933/stat : 2933 (cryptominisat-2) R 2930 2933 2933 0 -1 4202496 828301 0 0 0 142616 206 0 0 25 0 1 0 643453946 2720866304 525402 33554432000 4194304 4677096 140737456923616 18446744073709551615 4319729 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/2933/statm: 664274 525402 419 118 0 659233 0
[pid=2943] ppid=2837 vsize=631852 CPUtime=4.23 cores=0-7
/proc/2943/stat : 2943 (python) S 2837 2837 2618 0 -1 4202560 69349 0 0 0 221 202 0 0 18 0 1 0 643482306 647016448 44391 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 8291443573337850114 0 0 17 4 0 0 0
/proc/2943/statm: 157963 44391 371 364 0 93842 0
[pid=2946] ppid=2943 vsize=222124 CPUtime=1186.46 cores=0-7
/proc/2946/stat : 2946 (precosat) R 2943 2946 2946 0 -1 4202496 109153 0 0 0 118628 18 0 0 25 0 1 0 643482307 227454976 52983 33554432000 4194304 4890832 140735896966464 18446744073709551615 4238565 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/2946/statm: 55531 52983 86 171 0 55358 0
[pid=2950] ppid=2837 vsize=642108 CPUtime=1.7 cores=0-7
/proc/2950/stat : 2950 (python) S 2837 2837 2618 0 -1 4202560 1227 0 0 0 87 83 0 0 15 0 2 0 643493180 657518592 44435 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107277771 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/2950/statm: 160527 44435 406 364 0 96403 0
[pid=2953] ppid=2950 vsize=2446948 CPUtime=490.46 cores=0-7
/proc/2953/stat : 2953 (cryptominisat-2) T 2950 2953 2953 0 -1 4202496 561095 0 0 0 48957 89 0 0 25 0 1 0 643493181 2505674752 476355 33554432000 4194304 4677096 140736155340976 18446744073709551615 4336232 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/2953/statm: 611737 476355 393 118 0 606696 0
[pid=2950/tid=2960] ppid=2837 vsize=642108 CPUtime=0 cores=0-7
/proc/2950/task/2960/stat : 2960 (python) S 2837 2837 2618 0 -1 4202560 73 0 0 0 0 0 0 0 15 0 2 0 643503052 657518592 44435 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604445106792640 0 0 -1 1 0 0 0
[pid=2954] ppid=2837 vsize=652364 CPUtime=3.46 cores=0-7
/proc/2954/stat : 2954 (python) S 2837 2837 2618 0 -1 4202560 1296 0 0 0 175 171 0 0 18 0 2 0 643493551 668020736 44473 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107277771 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/2954/statm: 163091 44473 406 364 0 98964 0
[pid=2956] ppid=2954 vsize=235404 CPUtime=1069.71 cores=0-7
/proc/2956/stat : 2956 (precosat) T 2954 2956 2956 0 -1 4202496 125671 0 0 0 106952 19 0 0 25 0 1 0 643493552 241053696 56290 33554432000 4194304 4890832 140734835661184 18446744073709551615 4297728 0 0 16781312 17442 18446744071562691360 0 0 17 6 0 0 0
/proc/2956/statm: 58851 56290 86 171 0 58678 0
[pid=2954/tid=2969] ppid=2837 vsize=652364 CPUtime=0 cores=0-7
/proc/2954/task/2969/stat : 2969 (python) S 2837 2837 2618 0 -1 4202560 80 0 0 0 0 0 0 0 18 0 2 0 643532977 668020736 44473 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604453953104576 0 0 -1 4 0 0 0
[pid=2982] ppid=2837 vsize=662620 CPUtime=1.25 cores=0-7
/proc/2982/stat : 2982 (python) S 2837 2837 2618 0 -1 4202560 1124 0 0 0 65 60 0 0 19 0 2 0 643543412 678522880 44464 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107277771 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/2982/statm: 165655 44464 406 364 0 101525 0
[pid=2984] ppid=2982 vsize=199948 CPUtime=393.69 cores=0-7
/proc/2984/stat : 2984 (precosat) T 2982 2984 2984 0 -1 4202496 51801 0 0 0 39359 10 0 0 25 0 1 0 643543414 204746752 47441 33554432000 4194304 4890832 140735761406368 18446744073709551615 4287958 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/2984/statm: 49987 47441 86 171 0 49814 0
[pid=2982/tid=3506] ppid=2837 vsize=662620 CPUtime=0 cores=0-7
/proc/2982/task/3506/stat : 3506 (python) S 2837 2837 2618 0 -1 4202560 80 0 0 0 0 0 0 0 19 0 2 0 643582933 678522880 44464 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604441673884800 0 0 -1 3 0 0 0
[pid=3494] ppid=2837 vsize=672876 CPUtime=0.34 cores=0-7
/proc/3494/stat : 3494 (python) S 2837 2837 2618 0 -1 4202560 1113 0 0 0 15 19 0 0 18 0 2 0 643552276 689025024 44506 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/3494/statm: 168219 44506 400 364 0 104086 0
[pid=3496] ppid=3494 vsize=200096 CPUtime=103.01 cores=0-7
/proc/3496/stat : 3496 (precosat) R 3494 3496 3496 0 -1 4202496 51828 0 0 0 10294 7 0 0 25 0 1 0 643552277 204898304 47470 33554432000 4194304 4890832 140734015789536 18446744073709551615 4229292 0 0 16781312 17442 0 0 0 17 4 0 0 0
/proc/3496/statm: 50024 47470 86 171 0 49851 0
[pid=3494/tid=3500] ppid=2837 vsize=672876 CPUtime=0 cores=0-7
/proc/3494/task/3500/stat : 3500 (python) S 2837 2837 2618 0 -1 4202560 79 0 0 0 0 0 0 0 19 0 2 0 643562309 689025024 44506 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604451037228032 0 0 -1 4 0 0 0
[pid=3515] ppid=2837 vsize=683132 CPUtime=0.33 cores=0-7
/proc/3515/stat : 3515 (python) S 2837 2837 2618 0 -1 4202560 1116 0 0 0 17 16 0 0 19 0 2 0 643590971 699527168 44503 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107277771 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/3515/statm: 170783 44503 400 364 0 106647 0
[pid=3517] ppid=3515 vsize=60540 CPUtime=99.67 cores=0-7
/proc/3517/stat : 3517 (lingeling) T 3515 3517 3517 0 -1 4202496 27696 0 0 0 9962 5 0 0 25 0 1 0 643590972 61992960 14138 33554432000 4194304 4352236 140733407560912 18446744073709551615 4328390 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/3517/statm: 15135 14138 129 39 0 14215 0
[pid=3515/tid=3521] ppid=2837 vsize=683132 CPUtime=0 cores=0-7
/proc/3515/task/3521/stat : 3521 (python) S 2837 2837 2618 0 -1 4202560 84 0 0 0 0 0 0 0 19 0 2 0 643601004 699527168 44503 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 514 18446604444105021376 0 0 -1 1 0 0 0
[pid=3522] ppid=2837 vsize=693388 CPUtime=0 cores=0-7
/proc/3522/stat : 3522 (python) S 2837 2837 2618 0 -1 4202560 844 0 0 0 0 0 0 0 15 0 1 0 643601243 710029312 44478 33554432000 4194304 5683644 140736489544688 18446744073709551615 228095471174 0 0 16781312 514 8051182694777716992 0 0 17 2 0 0 0
/proc/3522/statm: 173347 44478 349 364 0 109208 0
[pid=3524] ppid=3522 vsize=166276 CPUtime=0.98 cores=0-7
/proc/3524/stat : 3524 (cryptominisat-2) R 3522 3524 3524 0 -1 4202496 31590 0 0 0 93 5 0 0 23 0 1 0 643601244 170266624 26938 33554432000 4194304 4677096 140736695852032 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/3524/statm: 41569 26938 353 118 0 36528 0
[pid=2837/tid=2855] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2855/stat : 2855 (python) S 2835 2837 2618 0 -1 4202560 40 934 0 0 0 0 0 0 18 0 21 0 643356137 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 0 0 0 0
[pid=2837/tid=2858] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2858/stat : 2858 (python) S 2835 2837 2618 0 -1 4202560 31 934 0 0 0 0 0 0 18 0 21 0 643356140 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 4 0 0 0
[pid=2837/tid=2862] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2862/stat : 2862 (python) S 2835 2837 2618 0 -1 4202560 23 934 0 0 0 0 0 0 19 0 21 0 643356143 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 2 0 0 0
[pid=2837/tid=2865] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2865/stat : 2865 (python) S 2835 2837 2618 0 -1 4202560 23 934 0 0 0 0 0 0 18 0 21 0 643356146 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 5 0 0 0
[pid=2837/tid=2868] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2868/stat : 2868 (python) S 2835 2837 2618 0 -1 4202560 61 934 0 0 0 0 0 0 18 0 21 0 643356149 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 2 0 0 0
[pid=2837/tid=2871] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2871/stat : 2871 (python) S 2835 2837 2618 0 -1 4202560 52 934 0 0 0 0 0 0 18 0 21 0 643356153 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 0 0 0 0
[pid=2837/tid=2874] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2874/stat : 2874 (python) S 2835 2837 2618 0 -1 4202560 41 934 0 0 0 0 0 0 18 0 21 0 643356156 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 7 0 0 0
[pid=2837/tid=2877] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2877/stat : 2877 (python) S 2835 2837 2618 0 -1 4202560 35 934 0 0 0 0 0 0 25 0 21 0 643356159 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 2 0 0 0
[pid=2837/tid=2889] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2889/stat : 2889 (python) S 2835 2837 2618 0 -1 4202560 61 934 0 0 0 0 0 0 18 0 21 0 643385832 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 3 0 0 0
[pid=2837/tid=2896] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2896/stat : 2896 (python) S 2835 2837 2618 0 -1 4202560 39 934 0 0 0 0 0 0 18 0 21 0 643395669 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 1 0 0 0
[pid=2837/tid=2904] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2904/stat : 2904 (python) S 2835 2837 2618 0 -1 4202560 34 934 0 0 0 0 0 0 20 0 21 0 643405702 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 2 0 0 0
[pid=2837/tid=2911] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2911/stat : 2911 (python) S 2835 2837 2618 0 -1 4202560 40 934 0 0 0 0 0 0 18 0 21 0 643414978 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 1 0 0 0
[pid=2837/tid=2931] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2931/stat : 2931 (python) S 2835 2837 2618 0 -1 4202560 41 934 0 0 0 0 0 0 20 0 21 0 643453946 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 2 0 0 0
[pid=2837/tid=2944] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2944/stat : 2944 (python) S 2835 2837 2618 0 -1 4202560 43 934 0 0 0 0 0 0 18 0 21 0 643482307 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 3 0 0 0
[pid=2837/tid=2952] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2952/stat : 2952 (python) S 2835 2837 2618 0 -1 4202560 45 934 0 0 0 0 0 0 18 0 21 0 643493181 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 1 0 0 0
[pid=2837/tid=2955] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2955/stat : 2955 (python) S 2835 2837 2618 0 -1 4202560 47 934 0 0 0 0 0 0 18 0 21 0 643493552 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 2 0 0 0
[pid=2837/tid=2983] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/2983/stat : 2983 (python) S 2835 2837 2618 0 -1 4202560 38 934 0 0 0 0 0 0 20 0 21 0 643543412 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 2 0 0 0
[pid=2837/tid=3495] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/3495/stat : 3495 (python) S 2835 2837 2618 0 -1 4202560 39 934 0 0 0 0 0 0 18 0 21 0 643552277 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 3 0 0 0
[pid=2837/tid=3516] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/3516/stat : 3516 (python) S 2835 2837 2618 0 -1 4202560 34 934 0 0 0 0 0 0 20 0 21 0 643590972 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 2 0 0 0
[pid=2837/tid=3523] ppid=2835 vsize=703632 CPUtime=0 cores=0-7
/proc/2837/task/3523/stat : 3523 (python) S 2835 2837 2618 0 -1 4202560 40 934 0 0 0 0 0 0 20 0 21 0 643601244 720519168 46042 33554432000 4194304 5683644 140736489544688 18446744073709551615 228107274673 0 0 16781312 2 18446604445481903168 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 19652.2
Current children cumulated vsize (KiB) 32185348

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2837 and gives
#  childrusage.ru_utime.tv_sec=105
#  childrusage.ru_utime.tv_usec=907899
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=378942
# CPU time returned by wait4() is 106.287
# while last known CPU time is 19652.2
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 2557.56
CPU time (s): 19652.2
CPU user time (s): 19606.5
CPU system time (s): 45.65
CPU usage (%): 768.397
Max. virtual memory (cumulated for all children) (KiB): 32185348

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 105.908
system time used= 0.378942
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 88029
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3172
involuntary context switches= 192

runsolver used 19.1791 second user time and 48.2187 second system time

The end

Launcher Data 

Begin job on node142 at 2011-05-16 03:28:21
IDJOB=3381211
IDBENCH=84248
IDSOLVER=1864
FILE ID=node142/3381211-1305509300
RUNJOBID= node142-1305504289-2632
PBS_JOBID= 13325481
Free space on /tmp= 73524 MiB

SOLVER NAME= borg-sat 11.03.02-par-industrial (fixed)
BENCH NAME= SAT03/industrial/schuppan/l2s/dme-03-1-k247-unsat.shuffled-as.sat03-407.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3381211-1305509300/watcher-3381211-1305509300 -o /tmp/evaluation-result-3381211-1305509300/solver-3381211-1305509300 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3381211-1305509300.cnf -seed 1189484711 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3fef216b3efe77c0f10ea0e0be664a94
RANDOM SEED=1189484711

node142.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5131.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16342076 kB
Buffers:        348012 kB
Cached:        4940532 kB
SwapCached:      11512 kB
Active:       13114640 kB
Inactive:      3139932 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16342076 kB
SwapTotal:    67111528 kB
SwapFree:     65980224 kB
Dirty:           46968 kB
Writeback:           0 kB
AnonPages:    10963184 kB
Mapped:          22624 kB
Slab:           239464 kB
PageTables:      46656 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 84204312 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73616 MiB
End job on node142 at 2011-05-16 04:11:01