Trace number 3322604

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 20458.8 2797.38

General information on the benchmark

NameSAT03/industrial/schuppan/l2s/
bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf
MD5SUMf16626953757fdd1326f2a14f01adca9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark911.704
Satisfiable
(Un)Satisfiability was proved
Number of variables435701
Number of clauses1379987
Sum of the clauses size3544455
Maximum clause length304
Minimum clause length1
Number of clauses of size 1142
Number of clauses of size 2654099
Number of clauses of size 3705129
Number of clauses of size 412732
Number of clauses of size 54852
Number of clauses of size over 53033

Solver Data 

0.35/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.35/0.68	c INFO: solving HOME/instance-3322604-1304354673.cnf
0.35/0.68	c INFO: computing task features
6.03/6.35	c INFO: computed variable-clause graph statistics
6.24/6.56	c INFO: computed clause balance statistics
29.83/30.10	c INFO: computed variable balance statistics
47.73/48.05	c INFO: computed small-clause counts
48.33/48.67	c INFO: computed Horn-clause counts
265.04/265.38	c INFO: computed variable graph statistics
265.04/265.38	c INFO: collected features for HOME/instance-3322604-1304354673.cnf in 264.57 s
265.13/265.41	c INFO: running lingeling-276@0 for 194 with 39735 remaining (b = 0.83)
265.13/265.44	c INFO: running lingeling-276@0 for 97 with 39735 remaining (b = 0.67)
265.13/265.48	c INFO: running cryptominisat-2.9.0@0 for 485 with 39735 remaining (b = 0.40)
265.23/265.52	c INFO: running cryptominisat-2.9.0@0 for 679 with 39735 remaining (b = 0.40)
265.23/265.56	c INFO: running SApperloT@0 for 97 with 39735 remaining (b = 0.04)
265.33/265.60	c INFO: running cryptominisat-2.9.0@0 for 97 with 39735 remaining (b = 0.06)
265.33/265.64	c INFO: running lingeling-276@0 for 1261 with 39735 remaining (b = 0.42)
265.33/265.68	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39735 remaining (b = 0.49)
1052.64/364.14	c INFO: running lingeling-276@0 for 873 with 39636 remaining (b = 0.26)
1064.53/365.66	c INFO: running precosat-570@0 for 291 with 39635 remaining (b = 0.14)
1065.29/365.78	c INFO: running cryptominisat-2.9.0@0 for 1843 with 39634 remaining (b = 0.44)
1831.65/461.78	c INFO: running precosat-570@0 for 776 with 39538 remaining (b = 0.25)
3399.44/658.16	c INFO: running lingeling-276@0 for 776 with 39342 remaining (b = 0.18)
4179.32/755.87	c INFO: running precosat-570@0 for 97 with 39244 remaining (b = 0.10)
4979.20/856.09	c INFO: running precosat-570@100 for 291 with 39144 remaining (b = 0.10)
5720.79/948.95	c INFO: running precosat-570@99 for 291 with 39051 remaining (b = 0.10)
7330.92/1150.66	c INFO: running precosat-570@0 for 97 with 38850 remaining (b = 0.08)
8072.44/1243.60	c INFO: running cryptominisat-2.9.0@0 for 97 with 38757 remaining (b = 0.03)
8079.60/1244.45	c INFO: running precosat-570@393 for 291 with 38756 remaining (b = 0.08)
8092.37/1246.09	c INFO: running precosat-570@292 for 97 with 38754 remaining (b = 0.03)
8130.63/1250.89	c INFO: running precosat-570@878 for 291 with 38749 remaining (b = 0.09)
8900.83/1347.31	c INFO: running cryptominisat-2.9.0@0 for 1843 with 38653 remaining (b = 0.35)
8902.48/1347.55	c INFO: running cryptominisat-2.9.0@294 for 97 with 38653 remaining (b = 0.04)
9594.97/1434.40	c INFO: running lingeling-276@0 for 97 with 38566 remaining (b = 0.07)
9691.43/1446.42	c INFO: running precosat-570@779 for 679 with 38554 remaining (b = 0.15)
10370.70/1531.65	c INFO: running cryptominisat-2.9.0@0 for 388 with 38469 remaining (b = 0.09)
10387.44/1533.73	c INFO: running cryptominisat-2.9.0@1070 for 582 with 38466 remaining (b = 0.13)
10413.72/1537.04	c INFO: running precosat-570@1170 for 194 with 38463 remaining (b = 0.06)
10472.74/1544.44	c INFO: running precosat-570@979 for 194 with 38456 remaining (b = 0.07)
11987.49/1734.43	c INFO: running lingeling-276@488 for 776 with 38266 remaining (b = 0.16)
12046.49/1741.82	c INFO: running precosat-570@1174 for 194 with 38258 remaining (b = 0.06)
13484.78/1922.23	c INFO: running lingeling-276@0 for 291 with 38078 remaining (b = 0.08)
13554.93/1931.04	c INFO: running cryptominisat-2.9.0@0 for 97 with 38069 remaining (b = 0.03)
13660.15/1944.23	c INFO: running precosat-570@1563 for 97 with 38056 remaining (b = 0.02)
14374.57/2033.83	c INFO: running cryptominisat-2.9.0@197 for 291 with 37966 remaining (b = 0.08)
14466.97/2045.46	c INFO: running precosat-570@0 for 388 with 37955 remaining (b = 0.08)
15026.63/2115.61	c INFO: running cryptominisat-2.9.0@1360 for 97 with 37885 remaining (b = 0.03)
15114.29/2126.61	c INFO: running precosat-570@2042 for 97 with 37874 remaining (b = 0.03)
15785.63/2210.82	c INFO: running lingeling-276@100 for 1164 with 37789 remaining (b = 0.17)
15809.54/2213.89	c INFO: running lingeling-276@0 for 291 with 37786 remaining (b = 0.07)
15844.59/2218.22	c INFO: running cryptominisat-2.9.0@2040 for 194 with 37782 remaining (b = 0.03)
15865.35/2220.85	c INFO: running precosat-570@3886 for 97 with 37779 remaining (b = 0.04)
16672.21/2322.09	c INFO: running lingeling-276@96 for 1164 with 37678 remaining (b = 0.18)
16710.44/2326.80	c INFO: running glucose@0 for 5821 with 37673 remaining (b = 0.48)
17398.47/2413.12	c INFO: running precosat-570@0 for 97 with 37587 remaining (b = 0.07)
17630.48/2442.35	c INFO: running cryptominisat-2.9.0@295 for 194 with 37558 remaining (b = 0.04)
18165.15/2509.46	c INFO: running precosat-570@577 for 291 with 37491 remaining (b = 0.06)
18168.32/2509.85	c INFO: running lingeling-276@680 for 582 with 37490 remaining (b = 0.10)
18189.10/2512.41	c INFO: running cryptominisat-2.9.0@196 for 291 with 37488 remaining (b = 0.06)
19148.62/2632.84	c INFO: running cryptominisat-2.9.0@590 for 1067 with 37367 remaining (b = 0.17)
20457.21/2797.06	c INFO: running cryptominisat-2.9.0@0 for 97 with 37203 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322604-1304354673/watcher-3322604-1304354673 -o /tmp/evaluation-result-3322604-1304354673/solver-3322604-1304354673 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3322604-1304354673.cnf -seed 85778260 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.01 8.17 8.23 2/218 25643
/proc/meminfo: memFree=14181116/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=15380 CPUtime=0 cores=0-7
/proc/25643/stat : 25643 (python) R 25641 25643 25120 0 -1 4202496 795 0 0 0 0 0 0 0 21 0 1 0 625698124 15749120 681 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367544832 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25643/statm: 3845 681 322 364 0 332 0

[startup+0.068556 s]
/proc/loadavg: 8.01 8.17 8.23 2/218 25643
/proc/meminfo: memFree=14181116/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=34424 CPUtime=0.04 cores=0-7
/proc/25643/stat : 25643 (python) S 25641 25643 25120 0 -1 4202496 1553 0 0 0 3 1 0 0 21 0 1 0 625698124 35250176 1388 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367544832 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/25643/statm: 8606 1388 448 364 0 944 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 34424

[startup+0.100553 s]
/proc/loadavg: 8.01 8.17 8.23 2/218 25643
/proc/meminfo: memFree=14181116/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=87704 CPUtime=0.06 cores=0-7
/proc/25643/stat : 25643 (python) S 25641 25643 25120 0 -1 4202496 2638 0 0 0 4 2 0 0 21 0 1 0 625698124 89808896 2354 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367544832 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/25643/statm: 21926 2354 717 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 87704

[startup+0.300539 s]
/proc/loadavg: 8.01 8.17 8.23 2/218 25643
/proc/meminfo: memFree=14181116/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=135748 CPUtime=0.18 cores=0-7
/proc/25643/stat : 25643 (python) S 25641 25643 25120 0 -1 4202496 5964 935 1 0 13 5 0 0 17 0 1 0 625698124 139005952 4150 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367542789 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/25643/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.700448 s]
/proc/loadavg: 8.01 8.17 8.23 2/218 25643
/proc/meminfo: memFree=14181116/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=306064 CPUtime=0.43 cores=0-7
/proc/25643/stat : 25643 (python) R 25641 25643 25120 0 -1 4202496 16156 935 1 0 30 13 0 0 16 0 1 0 625698124 313409536 13838 33554432000 4194304 5683644 140734374294160 18446744073709551615 4421846 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25643/statm: 76516 13863 1761 364 0 12440 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 306064

[startup+1.5003 s]
/proc/loadavg: 7.37 8.03 8.18 2/219 25648
/proc/meminfo: memFree=14112784/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=359280 CPUtime=1.23 cores=0-7
/proc/25643/stat : 25643 (python) R 25641 25643 25120 0 -1 4202496 29039 935 1 0 109 14 0 0 17 0 1 0 625698124 367902720 26721 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367243217 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25643/statm: 89820 26722 1761 364 0 25744 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 359280

[startup+3.101 s]
/proc/loadavg: 7.37 8.03 8.18 2/219 25648
/proc/meminfo: memFree=14041360/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=463832 CPUtime=2.82 cores=0-7
/proc/25643/stat : 25643 (python) R 25641 25643 25120 0 -1 4202496 54822 935 1 0 265 17 0 0 19 0 1 0 625698124 474963968 52504 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367207621 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25643/statm: 115958 52505 1761 364 0 51882 0
Current children cumulated CPU time (s) 2.82
Current children cumulated vsize (KiB) 463832

[startup+6.30041 s]
/proc/loadavg: 7.37 8.03 8.18 2/219 25648
/proc/meminfo: memFree=13862588/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=576888 CPUtime=6.03 cores=0-7
/proc/25643/stat : 25643 (python) R 25641 25643 25120 0 -1 4202496 117896 935 1 0 578 25 0 0 25 0 1 0 625698124 590733312 81596 33554432000 4194304 5683644 140734374294160 18446744073709551615 47624116008545 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25643/statm: 144222 81596 1815 364 0 80146 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 576888

[startup+12.7002 s]
/proc/loadavg: 6.39 7.80 8.10 2/219 25649
/proc/meminfo: memFree=13863392/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=576888 CPUtime=12.43 cores=0-7
/proc/25643/stat : 25643 (python) R 25641 25643 25120 0 -1 4202496 117908 935 1 0 1218 25 0 0 25 0 1 0 625698124 590733312 81607 33554432000 4194304 5683644 140734374294160 18446744073709551615 4531971 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25643/statm: 144222 81607 1826 364 0 80146 0
Current children cumulated CPU time (s) 12.43
Current children cumulated vsize (KiB) 576888

[startup+25.5009 s]
/proc/loadavg: 5.56 7.58 8.03 2/219 25649
/proc/meminfo: memFree=13865056/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=576888 CPUtime=25.23 cores=0-7
/proc/25643/stat : 25643 (python) R 25641 25643 25120 0 -1 4202496 117908 935 1 0 2498 25 0 0 25 0 1 0 625698124 590733312 81607 33554432000 4194304 5683644 140734374294160 18446744073709551615 4619670 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25643/statm: 144222 81607 1826 364 0 80146 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 576888

[startup+51.1011 s]
/proc/loadavg: 4.00 7.05 7.84 2/219 25649
/proc/meminfo: memFree=13864552/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=576888 CPUtime=50.83 cores=0-7
/proc/25643/stat : 25643 (python) R 25641 25643 25120 0 -1 4202496 117915 935 1 0 5058 25 0 0 25 0 1 0 625698124 590733312 81614 33554432000 4194304 5683644 140734374294160 18446744073709551615 47624115595404 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25643/statm: 144222 81614 1833 364 0 80146 0
Current children cumulated CPU time (s) 50.83
Current children cumulated vsize (KiB) 576888

[startup+102.308 s]
/proc/loadavg: 2.20 6.03 7.44 2/219 25651
/proc/meminfo: memFree=13864436/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=576888 CPUtime=102.04 cores=0-7
/proc/25643/stat : 25643 (python) R 25641 25643 25120 0 -1 4202496 117915 935 1 0 10179 25 0 0 25 0 1 0 625698124 590733312 81614 33554432000 4194304 5683644 140734374294160 18446744073709551615 47624115595404 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25643/statm: 144222 81614 1833 364 0 80146 0
Current children cumulated CPU time (s) 102.04
Current children cumulated vsize (KiB) 576888

[startup+162.301 s]
/proc/loadavg: 1.44 5.11 7.04 2/219 25653
/proc/meminfo: memFree=13864520/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=576888 CPUtime=162.04 cores=0-7
/proc/25643/stat : 25643 (python) R 25641 25643 25120 0 -1 4202496 117915 935 1 0 16179 25 0 0 25 0 1 0 625698124 590733312 81614 33554432000 4194304 5683644 140734374294160 18446744073709551615 47624115595392 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25643/statm: 144222 81614 1833 364 0 80146 0
Current children cumulated CPU time (s) 162.04
Current children cumulated vsize (KiB) 576888

[startup+222.301 s]
/proc/loadavg: 1.16 4.36 6.66 2/219 25654
/proc/meminfo: memFree=13864604/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=576888 CPUtime=222.04 cores=0-7
/proc/25643/stat : 25643 (python) R 25641 25643 25120 0 -1 4202496 117915 935 1 0 22179 25 0 0 25 0 1 0 625698124 590733312 81614 33554432000 4194304 5683644 140734374294160 18446744073709551615 47624115595392 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25643/statm: 144222 81614 1833 364 0 80146 0
Current children cumulated CPU time (s) 222.04
Current children cumulated vsize (KiB) 576888

[startup+282.301 s]
/proc/loadavg: 3.05 4.20 6.45 10/243 25679
/proc/meminfo: memFree=11669616/32950928 swapFree=64191720/67111528
[pid=25643] ppid=25641 vsize=636244 CPUtime=265.42 cores=0-7
/proc/25643/stat : 25643 (python) S 25641 25643 25120 0 -1 4202496 123775 935 1 0 26510 32 0 0 22 0 9 0 625698124 651513856 76026 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25643/statm: 159061 76026 1889 364 0 94958 0
[pid=25656] ppid=25643 vsize=554208 CPUtime=0.03 cores=0-7
/proc/25656/stat : 25656 (python) S 25643 25643 25120 0 -1 4202560 910 0 0 0 2 1 0 0 18 0 1 0 625724666 567508992 74481 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566863 0 0 16781312 514 6301855292644622595 0 0 17 7 0 0 0
/proc/25656/statm: 138552 74481 376 364 0 74470 0
[pid=25658] ppid=25656 vsize=134464 CPUtime=16.86 cores=0-7
/proc/25658/stat : 25658 (lingeling) R 25656 25658 25658 0 -1 4202496 56698 0 0 0 1678 8 0 0 25 0 1 0 625724667 137691136 30737 33554432000 4194304 4352236 140737343791456 18446744073709551615 4213253 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/25658/statm: 33616 30737 127 39 0 32696 0
[pid=25659] ppid=25643 vsize=564464 CPUtime=0.03 cores=0-7
/proc/25659/stat : 25659 (python) S 25643 25643 25120 0 -1 4202560 911 0 0 0 1 2 0 0 18 0 1 0 625724669 578011136 74479 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 6301855292644622595 0 0 17 4 0 0 0
/proc/25659/statm: 141116 74479 370 364 0 77031 0
[pid=25661] ppid=25659 vsize=134460 CPUtime=16.83 cores=0-7
/proc/25661/stat : 25661 (lingeling) R 25659 25661 25661 0 -1 4202496 56829 0 0 0 1674 9 0 0 25 0 1 0 625724670 137687040 30736 33554432000 4194304 4352236 140736300930336 18446744073709551615 4300233 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/25661/statm: 33615 30736 127 39 0 32695 0
[pid=25662] ppid=25643 vsize=574720 CPUtime=0.03 cores=0-7
/proc/25662/stat : 25662 (python) S 25643 25643 25120 0 -1 4202560 935 0 0 0 1 2 0 0 15 0 1 0 625724673 588513280 74483 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 6301855292644622596 0 0 17 6 0 0 0
/proc/25662/statm: 143680 74483 370 364 0 79592 0
[pid=25664] ppid=25662 vsize=587076 CPUtime=16.76 cores=0-7
/proc/25664/stat : 25664 (cryptominisat-2) R 25662 25664 25664 0 -1 4202496 121397 0 0 0 1659 17 0 0 25 0 1 0 625724674 601165824 112320 33554432000 4194304 4677096 140733561425568 18446744073709551615 4319787 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/25664/statm: 146769 112320 361 118 0 141728 0
[pid=25665] ppid=25643 vsize=584976 CPUtime=0.03 cores=0-7
/proc/25665/stat : 25665 (python) S 25643 25643 25120 0 -1 4202560 943 0 0 0 1 2 0 0 15 0 1 0 625724677 599015424 74487 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 6301855292644622596 0 0 17 6 0 0 0
/proc/25665/statm: 146244 74487 370 364 0 82153 0
[pid=25667] ppid=25665 vsize=614600 CPUtime=16.53 cores=0-7
/proc/25667/stat : 25667 (cryptominisat-2) R 25665 25667 25667 0 -1 4202496 126904 0 0 0 1634 19 0 0 25 0 1 0 625724678 629350400 117829 33554432000 4194304 4677096 140736976174416 18446744073709551615 4238462 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/25667/statm: 153650 117829 361 118 0 148609 0
[pid=25668] ppid=25643 vsize=595232 CPUtime=0.03 cores=0-7
/proc/25668/stat : 25668 (python) S 25643 25643 25120 0 -1 4202560 942 0 0 0 1 2 0 0 18 0 1 0 625724681 609517568 74491 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 6301855292644622596 0 0 17 0 0 0 0
/proc/25668/statm: 148808 74491 370 364 0 84714 0
[pid=25670] ppid=25668 vsize=75696 CPUtime=16.7 cores=0-7
/proc/25670/stat : 25670 (SApperloT-base) R 25668 25670 25670 0 -1 4202496 18070 0 0 0 1665 5 0 0 25 0 1 0 625724682 77512704 17190 33554432000 134512640 135674940 4288033456 18446744073709551615 134564271 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/25670/statm: 18924 17190 99 284 0 18638 0
[pid=25671] ppid=25643 vsize=605488 CPUtime=0.02 cores=0-7
/proc/25671/stat : 25671 (python) S 25643 25643 25120 0 -1 4202560 948 0 0 0 1 1 0 0 15 0 1 0 625724685 620019712 74495 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 6301855292644622594 0 0 17 6 0 0 0
/proc/25671/statm: 151372 74495 370 364 0 87275 0
[pid=25673] ppid=25671 vsize=583172 CPUtime=16.64 cores=0-7
/proc/25673/stat : 25673 (cryptominisat-2) R 25671 25673 25673 0 -1 4202496 120618 0 0 0 1647 17 0 0 25 0 1 0 625724686 597168128 111541 33554432000 4194304 4677096 140735620022656 18446744073709551615 4319726 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/25673/statm: 145793 111541 361 118 0 140752 0
[pid=25674] ppid=25643 vsize=615744 CPUtime=0.03 cores=0-7
/proc/25674/stat : 25674 (python) S 25643 25643 25120 0 -1 4202560 937 0 0 0 1 2 0 0 18 0 1 0 625724689 630521856 74499 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 6301855292644622595 0 0 17 2 0 0 0
/proc/25674/statm: 153936 74499 370 364 0 89836 0
[pid=25676] ppid=25674 vsize=134464 CPUtime=16.58 cores=0-7
/proc/25676/stat : 25676 (lingeling) R 25674 25676 25676 0 -1 4202496 56830 0 0 0 1648 10 0 0 25 0 1 0 625724690 137691136 30738 33554432000 4194304 4352236 140733743656272 18446744073709551615 4229934 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/25676/statm: 33616 30738 127 39 0 32696 0
[pid=25677] ppid=25643 vsize=626000 CPUtime=0.03 cores=0-7
/proc/25677/stat : 25677 (python) S 25643 25643 25120 0 -1 4202560 1000 0 0 0 1 2 0 0 15 0 1 0 625724693 641024000 74509 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 6301855292644622593 0 0 17 6 0 0 0
/proc/25677/statm: 156500 74509 376 364 0 92397 0
[pid=25679] ppid=25677 vsize=578696 CPUtime=16.46 cores=0-7
/proc/25679/stat : 25679 (cryptominisat-2) R 25677 25679 25679 0 -1 4202496 119712 0 0 0 1630 16 0 0 25 0 1 0 625724694 592584704 110628 33554432000 4194304 4677096 140735455539824 18446744073709551615 251367239376 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/25679/statm: 144674 110628 361 118 0 139633 0
[pid=25643/tid=25657] ppid=25641 vsize=636244 CPUtime=0 cores=0-7

################
# More data... #
################

/proc/25671/task/25683/stat : 25683 (python) S 25643 25643 25120 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 625734536 620019712 74525 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604451895624064 0 0 -1 6 0 0 0
[pid=25674] ppid=25643 vsize=615744 CPUtime=2.71 cores=0-7
/proc/25674/stat : 25674 (python) S 25643 25643 25120 0 -1 4202560 1171 0 0 0 135 136 0 0 18 0 2 0 625724689 630521856 74529 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/25674/statm: 153936 74529 399 364 0 89836 0
[pid=25676] ppid=25674 vsize=98312 CPUtime=1557.7 cores=0-7
/proc/25676/stat : 25676 (lingeling) T 25674 25676 25676 0 -1 4202496 65864 0 0 0 155747 23 0 0 25 0 1 0 625724690 100671488 23749 33554432000 4194304 4352236 140733743656272 18446744073709551615 4329086 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/25676/statm: 24578 23749 129 39 0 23658 0
[pid=25674/tid=25756] ppid=25643 vsize=615744 CPUtime=0 cores=0-7
/proc/25674/task/25756/stat : 25756 (python) S 25643 25643 25120 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 625851284 630521856 74529 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604452638345984 0 0 -1 1 0 0 0
[pid=25677] ppid=25643 vsize=626000 CPUtime=3.08 cores=0-7
/proc/25677/stat : 25677 (python) S 25643 25643 25120 0 -1 4202560 1236 0 0 0 160 148 0 0 16 0 2 0 625724693 641024000 74539 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/25677/statm: 156500 74539 405 364 0 92397 0
[pid=25679] ppid=25677 vsize=2482412 CPUtime=1652.55 cores=0-7
/proc/25679/stat : 25679 (cryptominisat-2) T 25677 25679 25679 0 -1 4202496 564618 0 0 0 165130 125 0 0 25 0 1 0 625724694 2541989888 495952 33554432000 4194304 4677096 140735455539824 18446744073709551615 4337555 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/25679/statm: 620603 495952 393 118 0 615562 0
[pid=25677/tid=25768] ppid=25643 vsize=626000 CPUtime=0 cores=0-7
/proc/25677/task/25768/stat : 25768 (python) S 25643 25643 25120 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 625891223 641024000 74539 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604451895625856 0 0 -1 2 0 0 0
[pid=25684] ppid=25643 vsize=636256 CPUtime=2.55 cores=0-7
/proc/25684/stat : 25684 (python) S 25643 25643 25120 0 -1 4202560 1177 0 0 0 132 123 0 0 18 0 2 0 625734539 651526144 74537 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/25684/statm: 159064 74537 399 364 0 94958 0
[pid=25686] ppid=25684 vsize=101732 CPUtime=1463.7 cores=0-7
/proc/25686/stat : 25686 (lingeling) R 25684 25686 25686 0 -1 4202496 65353 0 0 0 146359 11 0 0 25 0 1 0 625734540 104173568 24603 33554432000 4194304 4352236 140733196475568 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/25686/statm: 25433 24603 129 39 0 24513 0
[pid=25684/tid=25738] ppid=25643 vsize=636256 CPUtime=0 cores=0-7
/proc/25684/task/25738/stat : 25738 (python) S 25643 25643 25120 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 625822480 651526144 74537 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604451895626752 0 0 -1 6 0 0 0
[pid=25688] ppid=25643 vsize=712048 CPUtime=2.61 cores=0-7
/proc/25688/stat : 25688 (python) S 25643 25643 25120 0 -1 4202560 1059 0 0 0 132 129 0 0 18 0 2 0 625734690 729137152 74658 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/25688/statm: 178012 74658 399 364 0 113903 0
[pid=25690] ppid=25688 vsize=372076 CPUtime=1459.85 cores=0-7
/proc/25690/stat : 25690 (precosat) T 25688 25690 25690 0 -1 4202496 97601 0 0 0 145964 21 0 0 25 0 1 0 625734692 381005824 90445 33554432000 4194304 4890832 140734072433584 18446744073709551615 4229325 0 0 16781312 17442 18446744071562691360 0 0 17 0 0 0 0
/proc/25690/statm: 93019 90445 86 171 0 92846 0
[pid=25688/tid=25703] ppid=25643 vsize=712048 CPUtime=0 cores=0-7
/proc/25688/task/25703/stat : 25703 (python) S 25643 25643 25120 0 -1 4202560 115 0 0 0 0 0 0 0 18 0 2 0 625763937 729137152 74658 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604452423025984 0 0 -1 3 0 0 0
[pid=25696] ppid=25643 vsize=722304 CPUtime=1.5 cores=0-7
/proc/25696/stat : 25696 (python) S 25643 25643 25120 0 -1 4202560 1031 0 0 0 74 76 0 0 18 0 2 0 625744303 739639296 74650 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/25696/statm: 180576 74650 399 364 0 116464 0
[pid=25698] ppid=25696 vsize=371732 CPUtime=877.27 cores=0-7
/proc/25698/stat : 25698 (precosat) T 25696 25698 25698 0 -1 4202496 97618 0 0 0 87712 15 0 0 25 0 1 0 625744304 380653568 90468 33554432000 4194304 4890832 140734574318128 18446744073709551615 4238565 0 0 16781312 17442 18446744071562691360 0 0 17 4 0 0 0
/proc/25698/statm: 92933 90468 86 171 0 92760 0
[pid=25696/tid=25742] ppid=25643 vsize=722304 CPUtime=0 cores=0-7
/proc/25696/task/25742/stat : 25742 (python) S 25643 25643 25120 0 -1 4202560 79 0 0 0 0 0 0 0 18 0 2 0 625822729 739639296 74650 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604452638343296 0 0 -1 3 0 0 0
[pid=25708] ppid=25643 vsize=732560 CPUtime=1.57 cores=0-7
/proc/25708/stat : 25708 (python) S 25643 25643 25120 0 -1 4202560 1051 0 0 0 78 79 0 0 18 0 2 0 625773711 750141440 74621 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/25708/statm: 183140 74621 399 364 0 119025 0
[pid=25710] ppid=25708 vsize=372976 CPUtime=878.57 cores=0-7
/proc/25710/stat : 25710 (precosat) T 25708 25710 25710 0 -1 4202496 97840 0 0 0 87840 17 0 0 25 0 1 0 625773713 381927424 90664 33554432000 4194304 4890832 140733533776720 18446744073709551615 4238518 0 0 16781312 17442 18446744071562691360 0 0 17 6 0 0 0
/proc/25710/statm: 93244 90664 86 171 0 93071 0
[pid=25708/tid=25714] ppid=25643 vsize=732560 CPUtime=0 cores=0-7
/proc/25708/task/25714/stat : 25714 (python) S 25643 25643 25120 0 -1 4202560 83 0 0 0 0 0 0 0 18 0 2 0 625783729 750141440 74621 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604453858714880 0 0 -1 1 0 0 0
[pid=25733] ppid=25643 vsize=742816 CPUtime=1.64 cores=0-7
/proc/25733/stat : 25733 (python) S 25643 25643 25120 0 -1 4202560 1207 0 0 0 84 80 0 0 18 0 2 0 625813191 760643584 74677 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/25733/statm: 185704 74677 399 364 0 121586 0
[pid=25735] ppid=25733 vsize=372476 CPUtime=877.96 cores=0-7
/proc/25735/stat : 25735 (precosat) T 25733 25735 25735 0 -1 4202496 97709 0 0 0 87780 16 0 0 25 0 1 0 625813192 381415424 90545 33554432000 4194304 4890832 140736139669424 18446744073709551615 4238338 0 0 16781312 17442 18446744071562691360 0 0 17 2 0 0 0
/proc/25735/statm: 93119 90545 86 171 0 92946 0
[pid=25733/tid=25743] ppid=25643 vsize=742816 CPUtime=0 cores=0-7
/proc/25733/task/25743/stat : 25743 (python) S 25643 25643 25120 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 625823209 760643584 74677 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604453895264128 0 0 -1 4 0 0 0
[pid=25739] ppid=25643 vsize=753072 CPUtime=2.07 cores=0-7
/proc/25739/stat : 25739 (python) S 25643 25643 25120 0 -1 4202560 1207 0 0 0 108 99 0 0 15 0 2 0 625822485 771145728 74681 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/25739/statm: 188268 74681 399 364 0 124147 0
[pid=25741] ppid=25739 vsize=2243764 CPUtime=1070.61 cores=0-7
/proc/25741/stat : 25741 (cryptominisat-2) T 25739 25741 25741 0 -1 4202496 522996 0 0 0 106948 113 0 0 25 0 1 0 625822486 2297614336 462329 33554432000 4194304 4677096 140735093095264 18446744073709551615 4468093 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/25741/statm: 560941 462329 393 118 0 555900 0
[pid=25739/tid=25747] ppid=25643 vsize=753072 CPUtime=0 cores=0-7
/proc/25739/task/25747/stat : 25747 (python) S 25643 25643 25120 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 625832875 771145728 74681 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604453984795392 0 0 -1 7 0 0 0
[pid=25750] ppid=25643 vsize=763328 CPUtime=1.08 cores=0-7
/proc/25750/stat : 25750 (python) S 25643 25643 25120 0 -1 4202560 1274 0 0 0 55 53 0 0 18 0 2 0 625841565 781647872 74693 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/25750/statm: 190832 74693 407 364 0 126708 0
[pid=25752] ppid=25750 vsize=93832 CPUtime=562.33 cores=0-7
/proc/25752/stat : 25752 (lingeling) R 25750 25752 25752 0 -1 4202496 62262 0 0 0 56221 12 0 0 25 0 1 0 625841567 96083968 22627 33554432000 4194304 4352236 140735799390592 18446744073709551615 4328126 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/25752/statm: 23458 22627 129 39 0 22538 0
[pid=25750/tid=25757] ppid=25643 vsize=763328 CPUtime=0 cores=0-7
/proc/25750/task/25757/stat : 25757 (python) S 25643 25643 25120 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 625851492 781647872 74693 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604454482580480 0 0 -1 7 0 0 0
[pid=25769] ppid=25643 vsize=773584 CPUtime=1.46 cores=0-7
/proc/25769/stat : 25769 (python) S 25643 25643 25120 0 -1 4202560 1295 0 0 0 76 70 0 0 15 0 2 0 625891229 792150016 74758 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/25769/statm: 193396 74758 406 364 0 129269 0
[pid=25771] ppid=25769 vsize=2269356 CPUtime=747.39 cores=0-7
/proc/25771/stat : 25771 (cryptominisat-2) R 25769 25771 25771 0 -1 4202496 472465 0 0 0 74648 91 0 0 25 0 1 0 625891230 2323820544 439274 33554432000 4194304 4677096 140736148139632 18446744073709551615 4238499 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/25771/statm: 567339 439274 393 118 0 562298 0
[pid=25769/tid=25775] ppid=25643 vsize=773584 CPUtime=0 cores=0-7
/proc/25769/task/25775/stat : 25775 (python) S 25643 25643 25120 0 -1 4202560 127 0 0 0 0 0 0 0 15 0 2 0 625901501 792150016 74758 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604471152861440 0 0 -1 1 0 0 0
[pid=25777] ppid=25643 vsize=783840 CPUtime=1.29 cores=0-7
/proc/25777/stat : 25777 (python) S 25643 25643 25120 0 -1 4202560 1221 0 0 0 63 66 0 0 18 0 2 0 625902671 802652160 74730 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/25777/statm: 195960 74730 400 364 0 131830 0
[pid=25779] ppid=25777 vsize=372428 CPUtime=681.79 cores=0-7
/proc/25779/stat : 25779 (precosat) T 25777 25779 25779 0 -1 4202496 97819 0 0 0 68161 18 0 0 25 0 1 0 625902672 381366272 90631 33554432000 4194304 4890832 140733760285904 18446744073709551615 4238565 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/25779/statm: 93107 90631 86 171 0 92934 0
[pid=25777/tid=25796] ppid=25643 vsize=783840 CPUtime=0 cores=0-7
/proc/25777/task/25796/stat : 25796 (python) S 25643 25643 25120 0 -1 4202560 50 0 0 0 0 0 0 0 18 0 2 0 625942352 802652160 74730 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604466168783808 0 0 -1 7 0 0 0
[pid=25787] ppid=25643 vsize=794096 CPUtime=0.87 cores=0-7
/proc/25787/stat : 25787 (python) S 25643 25643 25120 0 -1 4202560 1068 0 0 0 43 44 0 0 18 0 1 0 625930805 813154304 74704 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 6301855292644622600 0 0 17 7 0 0 0
/proc/25787/statm: 198524 74704 371 364 0 134391 0
[pid=25789] ppid=25787 vsize=145328 CPUtime=466.74 cores=0-7
/proc/25789/stat : 25789 (glucose_static) R 25787 25789 25789 0 -1 4202496 35197 0 0 0 46662 12 0 0 25 0 1 0 625930807 148815872 34686 33554432000 134512640 135217611 4292668624 18446744073709551615 134533193 0 0 16781312 8388611 0 0 0 17 5 0 0 0
/proc/25789/statm: 36332 34686 78 173 0 36157 0
[pid=25793] ppid=25643 vsize=804352 CPUtime=0.19 cores=0-7
/proc/25793/stat : 25793 (python) S 25643 25643 25120 0 -1 4202560 1216 0 0 0 9 10 0 0 19 0 2 0 625939437 823656448 74739 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/25793/statm: 201088 74739 401 364 0 136952 0
[pid=25795] ppid=25793 vsize=374720 CPUtime=98.83 cores=0-7
/proc/25795/stat : 25795 (precosat) T 25793 25795 25795 0 -1 4202496 98415 0 0 0 9866 17 0 0 25 0 1 0 625939438 383713280 91179 33554432000 4194304 4890832 140734922820656 18446744073709551615 4295928 0 0 16781312 17442 18446744071562691360 0 0 17 2 0 0 13
/proc/25795/statm: 93680 91179 86 171 0 93507 0
[pid=25793/tid=25799] ppid=25643 vsize=804352 CPUtime=0 cores=0-7
/proc/25793/task/25799/stat : 25799 (python) S 25643 25643 25120 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 625949358 823656448 74739 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 514 18446604471147128768 0 0 -1 2 0 0 0
[pid=25808] ppid=25643 vsize=814608 CPUtime=0.01 cores=0-7
/proc/25808/stat : 25808 (python) S 25643 25643 25120 0 -1 4202560 847 0 0 0 0 1 0 0 19 0 1 0 625977831 834158592 74731 33554432000 4194304 5683644 140734374294160 18446744073709551615 251367566918 0 0 16781312 514 11591196719844393224 0 0 17 5 0 0 0
/proc/25808/statm: 203652 74731 349 364 0 139513 0
[pid=25810] ppid=25808 vsize=31276 CPUtime=0.01 cores=0-7
/proc/25810/stat : 25810 (cryptominisat-2) D 25808 25810 25810 0 -1 4204544 3470 0 0 0 0 1 0 0 20 0 1 0 625977832 32026624 2688 33554432000 4194304 4677096 140734252130576 18446744073709551615 251367243984 0 0 16781312 2 18446744071562234512 0 0 17 7 0 0 8
/proc/25810/statm: 7819 2688 332 118 0 2778 0
[pid=25643/tid=25657] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25657/stat : 25657 (python) S 25641 25643 25120 0 -1 4202560 32 935 0 0 0 0 0 0 18 0 21 0 625724666 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 0 0 0 0
[pid=25643/tid=25660] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25660/stat : 25660 (python) S 25641 25643 25120 0 -1 4202560 34 935 0 0 0 0 0 0 18 0 21 0 625724670 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 4 0 0 0
[pid=25643/tid=25663] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25663/stat : 25663 (python) S 25641 25643 25120 0 -1 4202560 30 935 0 0 0 0 0 0 18 0 21 0 625724673 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 2 0 0 0
[pid=25643/tid=25666] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25666/stat : 25666 (python) S 25641 25643 25120 0 -1 4202560 28 935 0 0 0 0 0 0 18 0 21 0 625724678 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 2 0 0 0
[pid=25643/tid=25669] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25669/stat : 25669 (python) S 25641 25643 25120 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 21 0 625724682 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 2 0 0 0
[pid=25643/tid=25672] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25672/stat : 25672 (python) S 25641 25643 25120 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 21 0 625724686 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 0 0 0 0
[pid=25643/tid=25675] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25675/stat : 25675 (python) S 25641 25643 25120 0 -1 4202560 27 935 0 0 0 0 0 0 18 0 21 0 625724690 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 6 0 0 0
[pid=25643/tid=25678] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25678/stat : 25678 (python) S 25641 25643 25120 0 -1 4202560 27 935 0 0 0 0 0 0 22 0 21 0 625724694 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 6 0 0 0
[pid=25643/tid=25685] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25685/stat : 25685 (python) S 25641 25643 25120 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 21 0 625734540 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 1 0 0 0
[pid=25643/tid=25689] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25689/stat : 25689 (python) S 25641 25643 25120 0 -1 4202560 80 935 0 0 0 0 0 0 18 0 21 0 625734691 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 6 0 0 0
[pid=25643/tid=25697] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25697/stat : 25697 (python) S 25641 25643 25120 0 -1 4202560 41 935 0 0 0 0 0 0 18 0 21 0 625744304 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 6 0 0 0
[pid=25643/tid=25709] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25709/stat : 25709 (python) S 25641 25643 25120 0 -1 4202560 47 935 0 0 0 0 0 0 18 0 21 0 625773712 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 1 0 0 0
[pid=25643/tid=25734] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25734/stat : 25734 (python) S 25641 25643 25120 0 -1 4202560 45 935 0 0 0 0 0 0 18 0 21 0 625813192 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 6 0 0 0
[pid=25643/tid=25740] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25740/stat : 25740 (python) S 25641 25643 25120 0 -1 4202560 38 935 0 0 0 0 0 0 18 0 21 0 625822486 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 7 0 0 0
[pid=25643/tid=25751] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25751/stat : 25751 (python) S 25641 25643 25120 0 -1 4202560 40 935 0 0 0 0 0 0 18 0 21 0 625841567 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 0 0 0 0
[pid=25643/tid=25770] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25770/stat : 25770 (python) S 25641 25643 25120 0 -1 4202560 89 935 0 0 0 0 0 0 18 0 21 0 625891230 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 7 0 0 0
[pid=25643/tid=25778] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25778/stat : 25778 (python) S 25641 25643 25120 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 21 0 625902672 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 7 0 0 0
[pid=25643/tid=25788] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25788/stat : 25788 (python) S 25641 25643 25120 0 -1 4202560 30 935 0 0 0 0 0 0 20 0 21 0 625930806 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 7 0 0 0
[pid=25643/tid=25794] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25794/stat : 25794 (python) S 25641 25643 25120 0 -1 4202560 30 935 0 0 0 0 0 0 20 0 21 0 625939438 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 0 0 0 0
[pid=25643/tid=25809] ppid=25641 vsize=824852 CPUtime=0 cores=0-7
/proc/25643/task/25809/stat : 25809 (python) S 25641 25643 25120 0 -1 4202560 50 935 0 0 0 0 0 0 20 0 21 0 625977832 844648448 76296 33554432000 4194304 5683644 140734374294160 18446744073709551615 251379370417 0 0 16781312 2 18446604453898409920 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 20458.8
Current children cumulated vsize (KiB) 31997260

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 25643 and gives
#  childrusage.ru_utime.tv_sec=267
#  childrusage.ru_utime.tv_usec=545326
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=514921
# CPU time returned by wait4() is 268.06
# while last known CPU time is 20458.8
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 2797.38
CPU time (s): 20458.8
CPU user time (s): 20430.5
CPU system time (s): 28.33
CPU usage (%): 731.356
Max. virtual memory (cumulated for all children) (KiB): 31997260

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 267.545
system time used= 0.514921
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 149723
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3270
involuntary context switches= 491

runsolver used 16.0306 second user time and 42.9335 second system time

The end

Launcher Data 

Begin job on node113 at 2011-05-02 18:44:34
IDJOB=3322604
IDBENCH=84246
IDSOLVER=1710
FILE ID=node113/3322604-1304354673
RUNJOBID= node113-1304347119-25134
PBS_JOBID= 13178654
Free space on /tmp= 73540 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT03/industrial/schuppan/l2s/bc57-sensors-1-k303-unsat.shuffled-as.sat03-406.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322604-1304354673/watcher-3322604-1304354673 -o /tmp/evaluation-result-3322604-1304354673/solver-3322604-1304354673 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3322604-1304354673.cnf -seed 85778260 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f16626953757fdd1326f2a14f01adca9
RANDOM SEED=85778260

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14181644 kB
Buffers:          8160 kB
Cached:         216564 kB
SwapCached:      58880 kB
Active:        6622632 kB
Inactive:     11936304 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14181644 kB
SwapTotal:    67111528 kB
SwapFree:     64191720 kB
Dirty:           59356 kB
Writeback:           0 kB
AnonPages:    18285520 kB
Mapped:           9972 kB
Slab:            92336 kB
PageTables:      52504 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 24597052 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73508 MiB
End job on node113 at 2011-05-02 19:31:14