Trace number 3321577

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (MO) 13688.8 1997.69

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf
MD5SUM6ed645315c9ffb8177453b955fbe1737
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1309.74
Satisfiable
(Un)Satisfiability was proved
Number of variables109684
Number of clauses1767096
Sum of the clauses size4034296
Maximum clause length78
Minimum clause length1
Number of clauses of size 1696
Number of clauses of size 21705200
Number of clauses of size 34800
Number of clauses of size 422200
Number of clauses of size 59600
Number of clauses of size over 524600

Solver Data 

0.37/0.66	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.37/0.66	c INFO: solving HOME/instance-3321577-1304347170.cnf
0.37/0.66	c INFO: computing task features
5.75/6.04	c INFO: computed variable-clause graph statistics
5.95/6.27	c INFO: computed clause balance statistics
30.65/30.95	c INFO: computed variable balance statistics
50.45/50.73	c INFO: computed small-clause counts
50.75/51.00	c INFO: computed Horn-clause counts
67.15/67.49	c INFO: computed variable graph statistics
67.15/67.49	c INFO: collected features for HOME/instance-3321577-1304347170.cnf in 66.64 s
67.25/67.52	c INFO: running lingeling-276@0 for 97 with 39933 remaining (b = 0.31)
67.25/67.56	c INFO: running cryptominisat-2.9.0@0 for 485 with 39933 remaining (b = 0.21)
67.25/67.60	c INFO: running SApperloT@0 for 97 with 39933 remaining (b = 0.03)
67.35/67.63	c INFO: running lingeling-276@0 for 1261 with 39933 remaining (b = 0.32)
67.35/67.67	c INFO: running cryptominisat-2.9.0@0 for 485 with 39933 remaining (b = 0.13)
67.44/67.71	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39932 remaining (b = 0.33)
67.44/67.74	c INFO: running lingeling-276@0 for 1261 with 39932 remaining (b = 0.24)
67.44/67.78	c INFO: running precosat-570@0 for 291 with 39932 remaining (b = 0.07)
803.85/166.79	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39833 remaining (b = 0.25)
810.81/167.71	c INFO: running lingeling-276@0 for 1164 with 39832 remaining (b = 0.17)
2534.48/414.41	c INFO: running SApperloT@0 for 97 with 39586 remaining (b = 0.03)
3510.13/554.00	c INFO: running precosat-570@98 for 291 with 39446 remaining (b = 0.13)
3616.85/568.29	c INFO: running precosat-570@0 for 388 with 39432 remaining (b = 0.15)
3746.11/586.76	c INFO: running lingeling-276@0 for 97 with 39413 remaining (b = 0.08)
4951.08/753.08	c INFO: running cryptominisat-2.9.0@0 for 1843 with 39247 remaining (b = 0.21)
5668.57/855.50	c INFO: running precosat-570@583 for 97 with 39145 remaining (b = 0.02)
6610.54/985.99	c INFO: running SApperloT@0 for 97 with 39014 remaining (b = 0.01)
6661.45/992.76	c INFO: running precosat-570@975 for 291 with 39007 remaining (b = 0.05)
7326.73/1086.21	c INFO: running lingeling-276@102 for 1164 with 38914 remaining (b = 0.12)
9388.94/1381.49	c INFO: running lingeling-276@0 for 97 with 38619 remaining (b = 0.08)
9507.73/1398.50	c INFO: running precosat-570@1075 for 194 with 38602 remaining (b = 0.04)
9553.24/1404.76	c INFO: running cryptominisat-2.9.0@0 for 97 with 38595 remaining (b = 0.01)
10699.43/1568.92	c INFO: running precosat-570@102 for 5336 with 38431 remaining (b = 0.34)
10733.62/1573.88	c INFO: running precosat-570@0 for 97 with 38426 remaining (b = 0.01)
10851.47/1590.79	c INFO: running cryptominisat-2.9.0@1266 for 97 with 38409 remaining (b = 0.02)
10894.05/1596.87	c INFO: running lingeling-276@1163 for 194 with 38403 remaining (b = 0.02)
11516.91/1686.17	c INFO: running glucosER@0 for 291 with 38314 remaining (b = 0.05)
11525.98/1687.48	c INFO: running precosat-570@100 for 97 with 38313 remaining (b = 0.02)
12529.70/1831.40	c INFO: running lingeling-276@0 for 97 with 38169 remaining (b = 0.03)
12685.94/1853.80	c INFO: running cryptominisat-2.9.0@1461 for 194 with 38146 remaining (b = 0.03)
13389.76/1954.70	c INFO: running precosat-570@2338 for 873 with 38046 remaining (b = 0.07)
13595.49/1984.13	c INFO: running glucosER@0 for 5821 with 38016 remaining (b = 0.29)
13683.19/1996.74	c INFO: running glucose@0 for 5821 with 38003 remaining (b = 0.29)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321577-1304347170/watcher-3321577-1304347170 -o /tmp/evaluation-result-3321577-1304347170/solver-3321577-1304347170 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321577-1304347170.cnf -seed 86909275 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.87 8.80 7.77 2/208 6093
/proc/meminfo: memFree=27236716/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=15384 CPUtime=0 cores=0-7
/proc/6093/stat : 6093 (python) R 6091 6093 6067 0 -1 4202496 812 0 0 0 0 0 0 0 21 0 1 0 2326525 15753216 698 33554432000 4194304 5683644 140733323921824 18446744073709551615 5116756 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6093/statm: 3846 698 334 364 0 333 0

[startup+0.089801 s]
/proc/loadavg: 7.87 8.80 7.77 2/208 6093
/proc/meminfo: memFree=27236716/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=84524 CPUtime=0.05 cores=0-7
/proc/6093/stat : 6093 (python) R 6091 6093 6067 0 -1 4202496 2229 0 0 0 4 1 0 0 21 0 1 0 2326525 86552576 1977 33554432000 4194304 5683644 140733323921824 18446744073709551615 218875597092 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6093/statm: 21131 1995 614 364 0 1335 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 84524

[startup+0.10081 s]
/proc/loadavg: 7.87 8.80 7.77 2/208 6093
/proc/meminfo: memFree=27236716/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=91828 CPUtime=0.05 cores=0-7
/proc/6093/stat : 6093 (python) R 6091 6093 6067 0 -1 4202496 2678 0 0 0 4 1 0 0 21 0 1 0 2326525 94031872 2394 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880563200 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6093/statm: 22957 2394 755 364 0 1622 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 91828

[startup+0.300764 s]
/proc/loadavg: 7.87 8.80 7.77 2/208 6093
/proc/meminfo: memFree=27236716/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=135748 CPUtime=0.19 cores=0-7
/proc/6093/stat : 6093 (python) S 6091 6093 6067 0 -1 4202496 5961 935 1 0 15 4 0 0 17 0 1 0 2326525 139005952 4150 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880561157 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/6093/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135748

[startup+0.700694 s]
/proc/loadavg: 7.87 8.80 7.77 2/208 6093
/proc/meminfo: memFree=27236716/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=309780 CPUtime=0.45 cores=0-7
/proc/6093/stat : 6093 (python) R 6091 6093 6067 0 -1 4202496 17081 935 1 0 34 11 0 0 16 0 1 0 2326525 317214720 14761 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880249779 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6093/statm: 77445 14761 1761 364 0 13369 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 309780

[startup+1.50056 s]
/proc/loadavg: 7.40 8.68 7.74 3/209 6098
/proc/meminfo: memFree=27164044/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=363024 CPUtime=1.25 cores=0-7
/proc/6093/stat : 6093 (python) R 6091 6093 6067 0 -1 4202496 29971 935 1 0 113 12 0 0 17 0 1 0 2326525 371736576 27651 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880225989 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6093/statm: 90756 27651 1761 364 0 26680 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 363024

[startup+3.10027 s]
/proc/loadavg: 7.40 8.68 7.74 3/209 6098
/proc/meminfo: memFree=27093104/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=469428 CPUtime=2.85 cores=0-7
/proc/6093/stat : 6093 (python) R 6091 6093 6067 0 -1 4202496 56012 935 1 0 270 15 0 0 19 0 1 0 2326525 480694272 53692 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880225989 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/6093/statm: 117357 53692 1761 364 0 53281 0
Current children cumulated CPU time (s) 2.85
Current children cumulated vsize (KiB) 469428

[startup+6.30071 s]
/proc/loadavg: 7.40 8.68 7.74 3/209 6098
/proc/meminfo: memFree=26999624/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=599188 CPUtime=6.05 cores=0-7
/proc/6093/stat : 6093 (python) R 6091 6093 6067 0 -1 4202496 145782 935 1 0 577 28 0 0 25 0 1 0 2326525 613568512 87182 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880232320 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/6093/statm: 149797 87182 1826 364 0 85721 0
Current children cumulated CPU time (s) 6.05
Current children cumulated vsize (KiB) 599188

[startup+12.7006 s]
/proc/loadavg: 6.57 8.46 7.68 3/209 6098
/proc/meminfo: memFree=26896596/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=599188 CPUtime=12.45 cores=0-7
/proc/6093/stat : 6093 (python) R 6091 6093 6067 0 -1 4202496 145782 935 1 0 1217 28 0 0 25 0 1 0 2326525 613568512 87182 33554432000 4194304 5683644 140733323921824 18446744073709551615 4602703 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/6093/statm: 149797 87182 1826 364 0 85721 0
Current children cumulated CPU time (s) 12.45
Current children cumulated vsize (KiB) 599188

[startup+25.5003 s]
/proc/loadavg: 5.86 8.25 7.62 3/209 6098
/proc/meminfo: memFree=26898176/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=599188 CPUtime=25.25 cores=0-7
/proc/6093/stat : 6093 (python) R 6091 6093 6067 0 -1 4202496 145782 935 1 0 2497 28 0 0 25 0 1 0 2326525 613568512 87182 33554432000 4194304 5683644 140733323921824 18446744073709551615 4603052 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/6093/statm: 149797 87182 1826 364 0 85721 0
Current children cumulated CPU time (s) 25.25
Current children cumulated vsize (KiB) 599188

[startup+51.1008 s]
/proc/loadavg: 4.54 7.75 7.46 3/209 6099
/proc/meminfo: memFree=26897580/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=612992 CPUtime=50.85 cores=0-7
/proc/6093/stat : 6093 (python) R 6091 6093 6067 0 -1 4202496 149240 935 1 0 5057 28 0 0 25 0 1 0 2326525 627703808 90640 33554432000 4194304 5683644 140733323921824 18446744073709551615 47248593934476 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/6093/statm: 153248 90640 1833 364 0 89172 0
Current children cumulated CPU time (s) 50.85
Current children cumulated vsize (KiB) 612992

[startup+102.309 s]
/proc/loadavg: 6.11 7.55 7.41 10/233 6124
/proc/meminfo: memFree=25065140/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=733984 CPUtime=67.54 cores=0-7
/proc/6093/stat : 6093 (python) S 6091 6093 6067 0 -1 4202496 154545 935 1 0 6719 35 0 0 21 0 9 0 2326525 751599616 84255 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892391883 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6093/statm: 183496 84255 1889 364 0 119393 0
[pid=6100] ppid=6093 vsize=586412 CPUtime=0.05 cores=0-7
/proc/6100/stat : 6100 (python) S 6093 6093 6067 0 -1 4202560 926 0 0 0 3 2 0 0 18 0 1 0 2333277 600485888 82532 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585231 0 0 16781312 514 16762081153724154116 0 0 17 2 0 0 0
/proc/6100/statm: 146603 82532 376 364 0 82521 0
[pid=6102] ppid=6100 vsize=64416 CPUtime=34.71 cores=0-7
/proc/6102/stat : 6102 (lingeling) R 6100 6102 6102 0 -1 4202496 24954 0 0 0 3467 4 0 0 25 0 1 0 2333278 65961984 15274 33554432000 4194304 4352236 140737245670544 18446744073709551615 4328079 0 0 16781312 17506 0 0 0 17 2 0 0 0
/proc/6102/statm: 16104 15274 129 39 0 15184 0
[pid=6103] ppid=6093 vsize=596668 CPUtime=0.05 cores=0-7
/proc/6103/stat : 6103 (python) S 6093 6093 6067 0 -1 4202560 922 0 0 0 2 3 0 0 15 0 1 0 2333281 610988032 82530 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 16762081153724154115 0 0 17 3 0 0 0
/proc/6103/statm: 149167 82530 370 364 0 85082 0
[pid=6105] ppid=6103 vsize=615692 CPUtime=34.72 cores=0-7
/proc/6105/stat : 6105 (cryptominisat-2) R 6103 6105 6105 0 -1 4202496 121333 0 0 0 3452 20 0 0 25 0 1 0 2333282 630468608 110270 33554432000 4194304 4677096 140734173197664 18446744073709551615 218880261899 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/6105/statm: 153923 110270 387 118 0 148882 0
[pid=6106] ppid=6093 vsize=606924 CPUtime=0.06 cores=0-7
/proc/6106/stat : 6106 (python) S 6093 6093 6067 0 -1 4202560 914 0 0 0 3 3 0 0 18 0 1 0 2333285 621490176 82534 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 16762081153724154115 0 0 17 3 0 0 0
/proc/6106/statm: 151731 82534 370 364 0 87643 0
[pid=6108] ppid=6106 vsize=112496 CPUtime=34.35 cores=0-7
/proc/6108/stat : 6108 (SApperloT-base) R 6106 6108 6108 0 -1 4202496 26903 0 0 0 3428 7 0 0 25 0 1 0 2333286 115195904 26156 33554432000 134512640 135674940 4289450864 18446744073709551615 134551872 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6108/statm: 28124 26156 99 284 0 27838 0
[pid=6109] ppid=6093 vsize=682716 CPUtime=0.05 cores=0-7
/proc/6109/stat : 6109 (python) S 6093 6093 6067 0 -1 4202560 787 0 0 0 2 3 0 0 18 0 1 0 2333289 699101184 82656 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 16762081153724154115 0 0 17 3 0 0 0
/proc/6109/statm: 170679 82656 371 364 0 106588 0
[pid=6111] ppid=6109 vsize=62320 CPUtime=34.65 cores=0-7
/proc/6111/stat : 6111 (lingeling) R 6109 6111 6111 0 -1 4202496 24411 0 0 0 3460 5 0 0 25 0 1 0 2333290 63815680 14750 33554432000 4194304 4352236 140736858850896 18446744073709551615 4222658 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/6111/statm: 15580 14750 129 39 0 14660 0
[pid=6112] ppid=6093 vsize=692972 CPUtime=0.05 cores=0-7
/proc/6112/stat : 6112 (python) S 6093 6093 6067 0 -1 4202560 799 0 0 0 2 3 0 0 15 0 1 0 2333292 709603328 82644 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 5625682034136416515 0 0 17 3 0 0 0
/proc/6112/statm: 173243 82644 371 364 0 109149 0
[pid=6114] ppid=6112 vsize=553440 CPUtime=28.82 cores=0-7
/proc/6114/stat : 6114 (cryptominisat-2) R 6112 6114 6114 0 -1 4202496 116727 0 0 0 2864 18 0 0 25 0 1 0 2333293 566722560 105581 33554432000 4194304 4677096 140735291916128 18446744073709551615 4335832 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/6114/statm: 138360 105581 387 118 0 133319 0
[pid=6115] ppid=6093 vsize=703228 CPUtime=0.05 cores=0-7
/proc/6115/stat : 6115 (python) S 6093 6093 6067 0 -1 4202560 817 0 0 0 3 2 0 0 15 0 1 0 2333296 720105472 82644 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 16762081153724154115 0 0 17 3 0 0 0
/proc/6115/statm: 175807 82644 371 364 0 111710 0
[pid=6117] ppid=6115 vsize=615640 CPUtime=34.51 cores=0-7
/proc/6117/stat : 6117 (cryptominisat-2) R 6115 6117 6117 0 -1 4202496 120754 0 0 0 3431 20 0 0 25 0 1 0 2333298 630415360 109559 33554432000 4194304 4677096 140733205076112 18446744073709551615 4320137 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/6117/statm: 153910 109559 387 118 0 148869 0
[pid=6118] ppid=6093 vsize=713484 CPUtime=0.05 cores=0-7
/proc/6118/stat : 6118 (python) S 6093 6093 6067 0 -1 4202560 820 0 0 0 2 3 0 0 18 0 1 0 2333300 730607616 82717 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 16762081153724154115 0 0 17 3 0 0 0
/proc/6118/statm: 178371 82717 371 364 0 114271 0
[pid=6120] ppid=6118 vsize=62356 CPUtime=34.53 cores=0-7
/proc/6120/stat : 6120 (lingeling) R 6118 6120 6120 0 -1 4202496 24431 0 0 0 3449 4 0 0 25 0 1 0 2333301 63852544 14759 33554432000 4194304 4352236 140735744448048 18446744073709551615 4328100 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/6120/statm: 15589 14759 129 39 0 14669 0
[pid=6121] ppid=6093 vsize=723740 CPUtime=0.05 cores=0-7
/proc/6121/stat : 6121 (python) S 6093 6093 6067 0 -1 4202560 864 0 0 0 2 3 0 0 18 0 1 0 2333304 741109760 82739 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 16762081153724154116 0 0 17 1 0 0 0
/proc/6121/statm: 180935 82739 377 364 0 116832 0
[pid=6123] ppid=6121 vsize=233196 CPUtime=17.12 cores=0-7
/proc/6123/stat : 6123 (precosat) R 6121 6123 6123 0 -1 4202496 59397 0 0 0 1701 11 0 0 25 0 1 0 2333305 238792704 57412 33554432000 4194304 4890832 140734260054448 18446744073709551615 4213357 0 0 16781312 17442 0 0 0 17 1 0 0 0
/proc/6123/statm: 58299 57412 86 171 0 58126 0
[pid=6093/tid=6101] ppid=6091 vsize=733984 CPUtime=0 cores=0-7
/proc/6093/task/6101/stat : 6101 (python) S 6091 6093 6067 0 -1 4202560 28 935 0 0 0 0 0 0 25 0 9 0 2333278 751599616 84255 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 6 0 0 0
[pid=6093/tid=6104] ppid=6091 vsize=733984 CPUtime=0 cores=0-7
/proc/6093/task/6104/stat : 6104 (python) S 6091 6093 6067 0 -1 4202560 23 935 0 0 0 0 0 0 19 0 9 0 2333282 751599616 84255 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 4 0 0 0
[pid=6093/tid=6107] ppid=6091 vsize=733984 CPUtime=0 cores=0-7
/proc/6093/task/6107/stat : 6107 (python) S 6091 6093 6067 0 -1 4202560 25 935 0 0 0 0 0 0 18 0 9 0 2333286 751599616 84255 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 5 0 0 0
[pid=6093/tid=6110] ppid=6091 vsize=733984 CPUtime=0 cores=0-7
/proc/6093/task/6110/stat : 6110 (python) S 6091 6093 6067 0 -1 4202560 78 935 0 0 0 0 0 0 21 0 9 0 2333289 751599616 84255 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 4 0 0 0
[pid=6093/tid=6113] ppid=6091 vsize=733984 CPUtime=0 cores=0-7
/proc/6093/task/6113/stat : 6113 (python) S 6091 6093 6067 0 -1 4202560 36 935 0 0 0 0 0 0 22 0 9 0 2333293 751599616 84255 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 7 0 0 0
[pid=6093/tid=6116] ppid=6091 vsize=733984 CPUtime=0 cores=0-7
/proc/6093/task/6116/stat : 6116 (python) S 6091 6093 6067 0 -1 4202560 34 935 0 0 0 0 0 0 19 0 9 0 2333297 751599616 84255 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 3 0 0 0
[pid=6093/tid=6119] ppid=6091 vsize=733984 CPUtime=0 cores=0-7
/proc/6093/task/6119/stat : 6119 (python) S 6091 6093 6067 0 -1 4202560 34 935 0 0 0 0 0 0 17 0 9 0 2333300 751599616 84255 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 1 0 0 0
[pid=6093/tid=6122] ppid=6091 vsize=733984 CPUtime=0 cores=0-7
/proc/6093/task/6122/stat : 6122 (python) S 6091 6093 6067 0 -1 4202560 34 935 0 0 0 0 0 0 21 0 9 0 2333304 751599616 84255 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 321.36
Current children cumulated vsize (KiB) 8359684

[startup+162.301 s]
/proc/loadavg: 8.08 7.84 7.51 10/233 6126
/proc/meminfo: memFree=24157308/32950928 swapFree=67111528/67111528
[pid=6093] ppid=6091 vsize=733984 CPUtime=67.54 cores=0-7
/proc/6093/stat : 6093 (python) S 6091 6093 6067 0 -1 4202496 154545 935 1 0 6719 35 0 0 21 0 9 0 2326525 751599616 84255 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892391883 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6093/statm: 183496 84255 1889 364 0 119393 0
[pid=6100] ppid=6093 vsize=586412 CPUtime=0.14 cores=0-7
/proc/6100/stat : 6100 (python) S 6093 6093 6067 0 -1 4202560 951 0 0 0 8 6 0 0 18 0 1 0 2333277 600485888 82532 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585231 0 0 16781312 514 16762081153724154116 0 0 17 2 0 0 0
/proc/6100/statm: 146603 82532 376 364 0 82521 0

################
# More data... #
################

[pid=6115] ppid=6093 vsize=703228 CPUtime=3.24 cores=0-7
/proc/6115/stat : 6115 (python) S 6093 6093 6067 0 -1 4202560 824 0 0 0 162 162 0 0 16 0 1 0 2333296 720105472 82644 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 16762081153724154115 0 0 17 1 0 0 0
/proc/6115/statm: 175807 82644 371 364 0 111710 0
[pid=6117] ppid=6115 vsize=2625012 CPUtime=1582.13 cores=0-7
/proc/6117/stat : 6117 (cryptominisat-2) R 6115 6117 6117 0 -1 4202496 910965 0 0 0 157976 237 0 0 25 0 1 0 2333298 2688012288 543951 33554432000 4194304 4677096 140733205076112 18446744073709551615 4339319 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/6117/statm: 656253 543951 391 118 0 651212 0
[pid=6118] ppid=6093 vsize=713484 CPUtime=2.14 cores=0-7
/proc/6118/stat : 6118 (python) S 6093 6093 6067 0 -1 4202560 1000 0 0 0 110 104 0 0 19 0 2 0 2333300 730607616 82746 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/6118/statm: 178371 82746 399 364 0 114271 0
[pid=6120] ppid=6118 vsize=217780 CPUtime=1264.23 cores=0-7
/proc/6120/stat : 6120 (lingeling) T 6118 6120 6120 0 -1 4202496 267117 0 0 0 126391 32 0 0 25 0 1 0 2333301 223006720 52080 33554432000 4194304 4352236 140735744448048 18446744073709551615 4208032 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/6120/statm: 54445 52080 129 39 0 53525 0
[pid=6118/tid=6196] ppid=6093 vsize=713484 CPUtime=0 cores=0-7
/proc/6118/task/6196/stat : 6196 (python) S 6093 6093 6067 0 -1 4202560 69 0 0 0 0 0 0 0 19 0 2 0 2466996 730607616 82746 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604453972449344 0 0 -1 7 0 0 0
[pid=6121] ppid=6093 vsize=723740 CPUtime=2.32 cores=0-7
/proc/6121/stat : 6121 (python) S 6093 6093 6067 0 -1 4202560 1058 0 0 0 124 108 0 0 18 0 2 0 2333304 741109760 82768 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6121/statm: 180935 82768 405 364 0 116832 0
[pid=6123] ppid=6121 vsize=472704 CPUtime=1208.8 cores=0-7
/proc/6123/stat : 6123 (precosat) R 6121 6123 6123 0 -1 4202496 188458 0 0 0 120837 43 0 0 25 0 1 0 2333305 484048896 117298 33554432000 4194304 4890832 140734260054448 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/6123/statm: 118176 117298 86 171 0 118003 0
[pid=6121/tid=6138] ppid=6093 vsize=723740 CPUtime=0 cores=0-7
/proc/6121/task/6138/stat : 6138 (python) S 6093 6093 6067 0 -1 4202560 77 0 0 0 0 0 0 0 18 0 2 0 2367962 741109760 82768 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604453862998464 0 0 -1 1 0 0 0
[pid=6128] ppid=6093 vsize=733996 CPUtime=3.04 cores=0-7
/proc/6128/stat : 6128 (python) S 6093 6093 6067 0 -1 4202560 1038 0 0 0 157 147 0 0 16 0 2 0 2343204 751611904 82718 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/6128/statm: 183499 82718 399 364 0 119393 0
[pid=6130] ppid=6128 vsize=3271600 CPUtime=1654.93 cores=0-7
/proc/6130/stat : 6130 (cryptominisat-2) T 6128 6130 6130 0 -1 4202496 1064421 0 0 0 165279 214 0 0 25 0 1 0 2343205 3350118400 675279 33554432000 4194304 4677096 140737411779184 18446744073709551615 4319643 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/6130/statm: 817900 675279 391 118 0 812859 0
[pid=6128/tid=6229] ppid=6093 vsize=733996 CPUtime=0 cores=0-7
/proc/6128/task/6229/stat : 6229 (python) S 6093 6093 6067 0 -1 4202560 76 0 0 0 0 0 0 0 16 0 2 0 2524932 751611904 82718 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604453864480832 0 0 -1 4 0 0 0
[pid=6139] ppid=6093 vsize=744252 CPUtime=0.27 cores=0-7
/proc/6139/stat : 6139 (python) S 6093 6093 6067 0 -1 4202560 1029 0 0 0 15 12 0 0 19 0 2 0 2367966 762114048 82752 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6139/statm: 186063 82752 399 364 0 121954 0
[pid=6141] ppid=6139 vsize=256960 CPUtime=102.26 cores=0-7
/proc/6141/stat : 6141 (SApperloT-base) T 6139 6141 6141 0 -1 4202496 67608 0 0 0 10206 20 0 0 25 0 1 0 2367967 263127040 59177 33554432000 134512640 135674940 4291491232 18446744073709551615 134551104 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/6141/statm: 64240 59177 99 284 0 63954 0
[pid=6139/tid=6152] ppid=6093 vsize=744252 CPUtime=0 cores=0-7
/proc/6139/task/6152/stat : 6152 (python) S 6093 6093 6067 0 -1 4202560 78 0 0 0 0 0 0 0 19 0 2 0 2385197 762114048 82752 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604453923494912 0 0 -1 0 0 0 0
[pid=6148] ppid=6093 vsize=754508 CPUtime=1.42 cores=0-7
/proc/6148/stat : 6148 (python) S 6093 6093 6067 0 -1 4202560 1044 0 0 0 79 63 0 0 18 0 2 0 2383354 772616192 82798 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/6148/statm: 188627 82798 399 364 0 124515 0
[pid=6150] ppid=6148 vsize=422704 CPUtime=689.59 cores=0-7
/proc/6150/stat : 6150 (precosat) R 6148 6150 6150 0 -1 4202496 144785 0 0 0 68930 29 0 0 25 0 1 0 2383355 432848896 104812 33554432000 4194304 4890832 140737424903024 18446744073709551615 4229292 0 0 16781312 17442 0 0 0 17 4 0 0 0
/proc/6150/statm: 105676 104812 86 171 0 105503 0
[pid=6148/tid=6168] ppid=6093 vsize=754508 CPUtime=0 cores=0-7
/proc/6148/task/6168/stat : 6168 (python) S 6093 6093 6067 0 -1 4202560 78 0 0 0 0 0 0 0 19 0 2 0 2425120 772616192 82798 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604452277119040 0 0 -1 0 0 0 0
[pid=6153] ppid=6093 vsize=764764 CPUtime=1.79 cores=0-7
/proc/6153/stat : 6153 (python) S 6093 6093 6067 0 -1 4202560 1056 0 0 0 94 85 0 0 18 0 2 0 2385202 783118336 82768 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/6153/statm: 191191 82768 399 364 0 127076 0
[pid=6155] ppid=6153 vsize=211620 CPUtime=984.75 cores=0-7
/proc/6155/stat : 6155 (lingeling) R 6153 6155 6155 0 -1 4202496 185182 0 0 0 98449 26 0 0 25 0 1 0 2385203 216698880 52075 33554432000 4194304 4352236 140734235235648 18446744073709551615 4238639 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/6155/statm: 52905 52075 129 39 0 51985 0
[pid=6153/tid=6161] ppid=6093 vsize=764764 CPUtime=0 cores=0-7
/proc/6153/task/6161/stat : 6161 (python) S 6093 6093 6067 0 -1 4202560 76 0 0 0 0 0 0 0 19 0 2 0 2401829 783118336 82768 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604453985340096 0 0 -1 0 0 0 0
[pid=6169] ppid=6093 vsize=775020 CPUtime=0.17 cores=0-7
/proc/6169/stat : 6169 (python) S 6093 6093 6067 0 -1 4202560 1050 0 0 0 9 8 0 0 19 0 2 0 2425124 793620480 82795 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/6169/statm: 193755 82795 399 364 0 129637 0
[pid=6171] ppid=6169 vsize=226336 CPUtime=99.8 cores=0-7
/proc/6171/stat : 6171 (SApperloT-base) T 6169 6171 6171 0 -1 4202496 55704 0 0 0 9967 13 0 0 25 0 1 0 2425125 231768064 54364 33554432000 134512640 135674940 4288149824 18446744073709551615 134551907 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/6171/statm: 56584 54364 99 284 0 56298 0
[pid=6169/tid=6174] ppid=6093 vsize=775020 CPUtime=0 cores=0-7
/proc/6169/task/6174/stat : 6174 (python) S 6093 6093 6067 0 -1 4202560 75 0 0 0 0 0 0 0 19 0 2 0 2435142 793620480 82795 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604453903773760 0 0 -1 2 0 0 0
[pid=6192] ppid=6093 vsize=785276 CPUtime=0.82 cores=0-7
/proc/6192/stat : 6192 (python) S 6093 6093 6067 0 -1 4202560 13660 0 0 0 43 39 0 0 18 0 2 0 2464674 804122624 82802 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/6192/statm: 196319 82802 399 364 0 132198 0
[pid=6194] ppid=6192 vsize=196984 CPUtime=295.73 cores=0-7
/proc/6194/stat : 6194 (lingeling) T 6192 6194 6194 0 -1 4202496 97249 0 0 0 29560 13 0 0 25 0 1 0 2464675 201711616 46369 33554432000 4194304 4352236 140735616257536 18446744073709551615 4276583 0 0 16781312 17506 18446744071562691360 0 0 17 2 0 0 0
/proc/6194/statm: 49246 46369 129 39 0 48326 0
[pid=6192/tid=6206] ppid=6093 vsize=785276 CPUtime=0 cores=0-7
/proc/6192/task/6206/stat : 6206 (python) S 6093 6093 6067 0 -1 4202560 82 0 0 0 0 0 0 0 18 0 2 0 2483908 804122624 82802 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604453985339200 0 0 -1 1 0 0 0
[pid=6197] ppid=6093 vsize=795532 CPUtime=0.9 cores=0-7
/proc/6197/stat : 6197 (python) S 6093 6093 6067 0 -1 4202560 22235 0 0 0 48 42 0 0 16 0 2 0 2467002 814624768 82818 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6197/statm: 198883 82818 407 364 0 134759 0
[pid=6199] ppid=6197 vsize=1596040 CPUtime=295.09 cores=0-7
/proc/6199/stat : 6199 (cryptominisat-2) R 6197 6199 6199 0 -1 4202496 392229 0 0 0 29440 69 0 0 25 0 1 0 2467002 1634344960 317550 33554432000 4194304 4677096 140733349497056 18446744073709551615 4335822 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/6199/statm: 399010 317550 391 118 0 393969 0
[pid=6197/tid=6210] ppid=6093 vsize=795532 CPUtime=0 cores=0-7
/proc/6197/task/6210/stat : 6210 (python) S 6093 6093 6067 0 -1 4202560 76 0 0 0 0 0 0 0 15 0 2 0 2485598 814624768 82818 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604453898369728 0 0 -1 2 0 0 0
[pid=6207] ppid=6093 vsize=805788 CPUtime=0.51 cores=0-7
/proc/6207/stat : 6207 (python) S 6093 6093 6067 0 -1 4202560 5740 0 0 0 26 25 0 0 18 0 2 0 2483914 825126912 82826 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/6207/statm: 201447 82826 407 364 0 137320 0
[pid=6209] ppid=6207 vsize=433040 CPUtime=195.43 cores=0-7
/proc/6209/stat : 6209 (precosat) T 6207 6209 6209 0 -1 4202496 117389 0 0 0 19519 24 0 0 25 0 1 0 2483914 443432960 107350 33554432000 4194304 4890832 140736909759248 18446744073709551615 4229367 0 0 16781312 17442 18446744071562691360 0 0 17 5 0 0 0
/proc/6209/statm: 108260 107350 86 171 0 108087 0
[pid=6207/tid=6213] ppid=6093 vsize=805788 CPUtime=0 cores=0-7
/proc/6207/task/6213/stat : 6213 (python) S 6093 6093 6067 0 -1 4202560 81 0 0 0 0 0 0 0 18 0 2 0 2495137 825126912 82826 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604453866825792 0 0 -1 6 0 0 0
[pid=6214] ppid=6093 vsize=816044 CPUtime=0.52 cores=0-7
/proc/6214/stat : 6214 (python) S 6093 6093 6067 0 -1 4202560 1096 0 0 0 26 26 0 0 19 0 2 0 2495143 835629056 82830 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/6214/statm: 204011 82830 401 364 0 139881 0
[pid=6216] ppid=6214 vsize=182980 CPUtime=291.98 cores=0-7
/proc/6216/stat : 6216 (glucoser_static) T 6214 6216 6216 0 -1 4202496 43603 0 0 0 29188 10 0 0 25 0 1 0 2495144 187371520 43313 33554432000 134512640 134580299 4287445584 18446744073709551615 134548255 0 0 16781312 8388611 18446744071562691360 0 0 17 0 0 0 0
/proc/6216/statm: 45745 43313 243 17 0 45073 0
[pid=6214/tid=6236] ppid=6093 vsize=816044 CPUtime=0 cores=0-7
/proc/6214/task/6236/stat : 6236 (python) S 6093 6093 6067 0 -1 4202560 80 0 0 0 0 0 0 0 19 0 2 0 2526192 835629056 82830 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604453895198016 0 0 -1 1 0 0 0
[pid=6221] ppid=6093 vsize=826300 CPUtime=0.21 cores=0-7
/proc/6221/stat : 6221 (python) S 6093 6093 6067 0 -1 4202560 1104 0 0 0 11 10 0 0 19 0 2 0 2509665 846131200 82841 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892391883 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6221/statm: 206575 82841 401 364 0 142442 0
[pid=6223] ppid=6221 vsize=190760 CPUtime=99.31 cores=0-7
/proc/6223/stat : 6223 (lingeling) T 6221 6223 6223 0 -1 4202496 64906 0 0 0 9922 9 0 0 25 0 1 0 2509666 195338240 46860 33554432000 4194304 4352236 140734038784560 18446744073709551615 4276717 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/6223/statm: 47690 46860 129 39 0 46770 0
[pid=6221/tid=6228] ppid=6093 vsize=826300 CPUtime=0 cores=0-7
/proc/6221/task/6228/stat : 6228 (python) S 6093 6093 6067 0 -1 4202560 79 0 0 0 0 0 0 0 19 0 2 0 2521989 846131200 82841 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 514 18446604453898367040 0 0 -1 4 0 0 0
[pid=6230] ppid=6093 vsize=836556 CPUtime=0.02 cores=0-7
/proc/6230/stat : 6230 (python) S 6093 6093 6067 0 -1 4202560 916 0 0 0 1 1 0 0 18 0 1 0 2524938 856633344 82851 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 16762081153724154114 0 0 17 2 0 0 0
/proc/6230/statm: 209139 82851 373 364 0 145003 0
[pid=6232] ppid=6230 vsize=105396 CPUtime=13.31 cores=0-7
/proc/6232/stat : 6232 (glucoser_static) R 6230 6232 6232 0 -1 4202496 24285 0 0 0 1327 4 0 0 25 0 1 0 2524939 107925504 23993 33554432000 134512640 134580299 4290397472 18446744073709551615 134543208 0 0 16781312 8388611 0 0 0 17 2 0 0 0
/proc/6232/statm: 26349 23993 242 17 0 25677 0
[pid=6237] ppid=6093 vsize=846812 CPUtime=0 cores=0-7
/proc/6237/stat : 6237 (python) S 6093 6093 6067 0 -1 4202560 820 0 0 0 0 0 0 0 19 0 1 0 2526199 867135488 82802 33554432000 4194304 5683644 140733323921824 18446744073709551615 218880585286 0 0 16781312 514 18382534523087749119 0 0 17 1 0 0 0
/proc/6237/statm: 211703 82802 345 364 0 147564 0
[pid=6239] ppid=6237 vsize=72448 CPUtime=0.39 cores=0-7
/proc/6239/stat : 6239 (glucose_static) R 6237 6239 6239 0 -1 4202496 17523 0 0 0 35 4 0 0 21 0 1 0 2526200 74186752 17251 33554432000 134512640 135217611 4286877024 18446744073709551615 134723558 0 0 16781312 8388611 0 0 0 17 1 0 0 0
/proc/6239/statm: 18145 17252 59 173 0 17970 0
[pid=6093/tid=6101] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6101/stat : 6101 (python) S 6091 6093 6067 0 -1 4202560 33 935 0 0 0 0 0 0 18 0 21 0 2333278 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 6 0 0 0
[pid=6093/tid=6104] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6104/stat : 6104 (python) S 6091 6093 6067 0 -1 4202560 29 935 0 0 0 0 0 0 18 0 21 0 2333282 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 4 0 0 0
[pid=6093/tid=6107] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6107/stat : 6107 (python) S 6091 6093 6067 0 -1 4202560 25 935 0 0 0 0 0 0 18 0 21 0 2333286 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 5 0 0 0
[pid=6093/tid=6110] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6110/stat : 6110 (python) S 6091 6093 6067 0 -1 4202560 78 935 0 0 0 0 0 0 21 0 21 0 2333289 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 4 0 0 0
[pid=6093/tid=6113] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6113/stat : 6113 (python) S 6091 6093 6067 0 -1 4202560 36 935 0 0 0 0 0 0 22 0 21 0 2333293 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 7 0 0 0
[pid=6093/tid=6116] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6116/stat : 6116 (python) S 6091 6093 6067 0 -1 4202560 34 935 0 0 0 0 0 0 19 0 21 0 2333297 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 3 0 0 0
[pid=6093/tid=6119] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6119/stat : 6119 (python) S 6091 6093 6067 0 -1 4202560 34 935 0 0 0 0 0 0 17 0 21 0 2333300 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 1 0 0 0
[pid=6093/tid=6122] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6122/stat : 6122 (python) S 6091 6093 6067 0 -1 4202560 73 935 0 0 0 0 0 0 18 0 21 0 2333304 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6129] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6129/stat : 6129 (python) S 6091 6093 6067 0 -1 4202560 39 935 0 0 0 0 0 0 19 0 21 0 2343205 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6140] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6140/stat : 6140 (python) S 6091 6093 6067 0 -1 4202560 37 935 0 0 0 0 0 0 19 0 21 0 2367967 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6149] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6149/stat : 6149 (python) S 6091 6093 6067 0 -1 4202560 43 935 0 0 0 0 0 0 18 0 21 0 2383355 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6154] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6154/stat : 6154 (python) S 6091 6093 6067 0 -1 4202560 37 935 0 0 0 0 0 0 18 0 21 0 2385203 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6170] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6170/stat : 6170 (python) S 6091 6093 6067 0 -1 4202560 37 935 0 0 0 0 0 0 20 0 21 0 2425125 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6193] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6193/stat : 6193 (python) S 6091 6093 6067 0 -1 4202560 47 935 0 0 0 0 0 0 18 0 21 0 2464675 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6198] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6198/stat : 6198 (python) S 6091 6093 6067 0 -1 4202560 52 935 0 0 0 0 0 0 18 0 21 0 2467002 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6208] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6208/stat : 6208 (python) S 6091 6093 6067 0 -1 4202560 42 935 0 0 0 0 0 0 18 0 21 0 2483914 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6215] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6215/stat : 6215 (python) S 6091 6093 6067 0 -1 4202560 40 935 0 0 0 0 0 0 19 0 21 0 2495143 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6222] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6222/stat : 6222 (python) S 6091 6093 6067 0 -1 4202560 37 935 0 0 0 0 0 0 20 0 21 0 2509666 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6231] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6231/stat : 6231 (python) S 6091 6093 6067 0 -1 4202560 37 935 0 0 0 0 0 0 20 0 21 0 2524939 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
[pid=6093/tid=6238] ppid=6091 vsize=857056 CPUtime=0 cores=0-7
/proc/6093/task/6238/stat : 6238 (python) S 6091 6093 6067 0 -1 4202560 38 935 0 0 0 0 0 0 19 0 21 0 2526200 877625344 84374 33554432000 4194304 5683644 140733323921824 18446744073709551615 218892388785 0 0 16781312 2 18446604453852433280 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 13688.8
Current children cumulated vsize (KiB) 32053468

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6093 and gives
#  childrusage.ru_utime.tv_sec=68
#  childrusage.ru_utime.tv_usec=464591
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=510922
# CPU time returned by wait4() is 68.9755
# while last known CPU time is 13688.8
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1997.69
CPU time (s): 13688.8
CPU user time (s): 13664.6
CPU system time (s): 24.25
CPU usage (%): 685.234
Max. virtual memory (cumulated for all children) (KiB): 32053468

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 68.4646
system time used= 0.510922
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 170513
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3025
involuntary context switches= 881

runsolver used 10.5034 second user time and 26.06 second system time

The end

Launcher Data 

Begin job on node112 at 2011-05-02 16:39:31
IDJOB=3321577
IDBENCH=82379
IDSOLVER=1710
FILE ID=node112/3321577-1304347170
RUNJOBID= node112-1304347170-6081
PBS_JOBID= 13178656
Free space on /tmp= 72460 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/rintanen/SATPlanning/sokoban-sequential-p145-microban-sequential.050-NOTKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321577-1304347170/watcher-3321577-1304347170 -o /tmp/evaluation-result-3321577-1304347170/solver-3321577-1304347170 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3321577-1304347170.cnf -seed 86909275 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6ed645315c9ffb8177453b955fbe1737
RANDOM SEED=86909275

node112.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5180.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.847
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      27237004 kB
Buffers:         62936 kB
Cached:        1215728 kB
SwapCached:          0 kB
Active:        4575596 kB
Inactive:      1007564 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      27237004 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           61808 kB
Writeback:           0 kB
AnonPages:     4304916 kB
Mapped:          14832 kB
Slab:            52816 kB
PageTables:      13496 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  4544732 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72428 MiB
End job on node112 at 2011-05-02 17:12:51