Trace number 3378970

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-industrial (fixed)? 4601.27 1199.68

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf
MD5SUMa8ad0173824ed9404a8c153da07c5f9c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark938.798
Satisfiable
(Un)Satisfiability was proved
Number of variables183325
Number of clauses546914
Sum of the clauses size1276130
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2364608
Number of clauses of size 3182304
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.30/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.30/0.47	c INFO: solving HOME/instance-3378970-1305465907.cnf
0.30/0.47	c INFO: computing task features
2.00/2.19	c INFO: computed variable-clause graph statistics
2.10/2.25	c INFO: computed clause balance statistics
10.59/10.76	c INFO: computed variable balance statistics
16.99/17.19	c INFO: computed small-clause counts
17.19/17.31	c INFO: computed Horn-clause counts
59.09/59.30	c INFO: computed variable graph statistics
59.09/59.30	c INFO: collected features for HOME/instance-3378970-1305465907.cnf in 58.78 s
59.20/59.31	c INFO: running lingeling-276@0 for 485 with 1141 remaining (b = 0.73)
59.20/59.32	c INFO: running lingeling-276@0 for 194 with 1141 remaining (b = 0.57)
59.20/59.33	c INFO: running cryptominisat-2.9.0@0 for 1141 with 1141 remaining (b = 0.65)
59.20/59.34	c INFO: running precosat-570@0 for 388 with 1141 remaining (b = 0.49)
842.50/255.86	c INFO: running lingeling-276@0 for 97 with 944 remaining (b = 0.29)
1258.74/360.20	c INFO: running cryptominisat-2.9.0@0 for 840 with 840 remaining (b = 0.30)
1634.31/454.42	c INFO: running lingeling-276@0 for 194 with 746 remaining (b = 0.12)
2017.86/550.63	c INFO: running lingeling-276@102 for 194 with 649 remaining (b = 0.12)
2405.83/647.95	c INFO: running precosat-570@0 for 97 with 552 remaining (b = 0.21)
2801.58/747.21	c INFO: running cryptominisat-2.9.0@0 for 453 with 453 remaining (b = 0.14)
2805.55/748.24	c INFO: running precosat-570@195 for 452 with 452 remaining (b = 0.13)
4601.12/1199.64	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378970-1305465907/watcher-3378970-1305465907 -o /tmp/evaluation-result-3378970-1305465907/solver-3378970-1305465907 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378970-1305465907.cnf -seed 50333654 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.25 3.24 4.04 5/382 16730
/proc/meminfo: memFree=24421916/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=16236 CPUtime=0 cores=0,2,4,6
/proc/16730/stat : 16730 (python) R 16728 16730 15878 0 -1 4202496 1037 0 0 0 0 0 0 0 25 0 1 0 639006327 16625664 909 33554432000 4194304 5683644 140734478027600 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/16730/statm: 4059 909 380 364 0 546 0

[startup+0.0956891 s]
/proc/loadavg: 3.25 3.24 4.04 5/382 16730
/proc/meminfo: memFree=24421916/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=101876 CPUtime=0.05 cores=0,2,4,6
/proc/16730/stat : 16730 (python) R 16728 16730 15878 0 -1 4202496 2960 0 0 0 4 1 0 0 25 0 1 0 639006327 104321024 2654 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726403072 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/16730/statm: 25469 2654 841 364 0 1769 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 101876

[startup+0.100743 s]
/proc/loadavg: 3.25 3.24 4.04 5/382 16730
/proc/meminfo: memFree=24421916/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=104224 CPUtime=0.05 cores=0,2,4,6
/proc/16730/stat : 16730 (python) S 16728 16730 15878 0 -1 4202496 3065 0 0 0 4 1 0 0 25 0 1 0 639006327 106725376 2747 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726403072 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/16730/statm: 26056 2747 847 364 0 1804 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 104224

[startup+0.300646 s]
/proc/loadavg: 3.25 3.24 4.04 5/382 16730
/proc/meminfo: memFree=24421916/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=170752 CPUtime=0.22 cores=0,2,4,6
/proc/16730/stat : 16730 (python) R 16728 16730 15878 0 -1 4202496 6742 932 1 0 16 6 0 0 17 0 1 0 639006327 174850048 4807 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726403072 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/16730/statm: 42688 4807 1336 364 0 3453 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 170752

[startup+0.700603 s]
/proc/loadavg: 3.25 3.24 4.04 5/382 16730
/proc/meminfo: memFree=24421916/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=302760 CPUtime=0.59 cores=0,2,4,6
/proc/16730/stat : 16730 (python) R 16728 16730 15878 0 -1 4202496 15386 932 1 0 50 9 0 0 17 0 1 0 639006327 310026240 12951 33554432000 4194304 5683644 140734478027600 18446744073709551615 4445115 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/16730/statm: 75690 12952 1761 364 0 11614 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 302760

[startup+1.50045 s]
/proc/loadavg: 3.25 3.24 4.04 7/384 16736
/proc/meminfo: memFree=24339556/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=356504 CPUtime=1.38 cores=0,2,4,6
/proc/16730/stat : 16730 (python) R 16728 16730 15878 0 -1 4202496 28430 932 1 0 127 11 0 0 19 0 1 0 639006327 365060096 25995 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726066209 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/16730/statm: 89126 25995 1761 364 0 25050 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 356504

[startup+3.10015 s]
/proc/loadavg: 3.25 3.24 4.04 6/383 16736
/proc/meminfo: memFree=24284880/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=389544 CPUtime=2.99 cores=0,2,4,6
/proc/16730/stat : 16730 (python) R 16728 16730 15878 0 -1 4202496 49563 932 1 0 285 14 0 0 22 0 1 0 639006327 398893056 34771 33554432000 4194304 5683644 140734478027600 18446744073709551615 47625520070264 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/16730/statm: 97386 34771 1826 364 0 33310 0
Current children cumulated CPU time (s) 2.99
Current children cumulated vsize (KiB) 389544

[startup+6.30055 s]
/proc/loadavg: 3.39 3.27 4.05 6/383 16736
/proc/meminfo: memFree=24258240/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=389544 CPUtime=6.19 cores=0,2,4,6
/proc/16730/stat : 16730 (python) R 16728 16730 15878 0 -1 4202496 49563 932 1 0 605 14 0 0 25 0 1 0 639006327 398893056 34771 33554432000 4194304 5683644 140734478027600 18446744073709551615 47625520439914 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/16730/statm: 97386 34771 1826 364 0 33310 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 389544

[startup+12.7003 s]
/proc/loadavg: 3.52 3.30 4.05 6/383 16736
/proc/meminfo: memFree=24243116/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=389544 CPUtime=12.59 cores=0,2,4,6
/proc/16730/stat : 16730 (python) R 16728 16730 15878 0 -1 4202496 49564 932 1 0 1245 14 0 0 25 0 1 0 639006327 398893056 34772 33554432000 4194304 5683644 140734478027600 18446744073709551615 4500322 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/16730/statm: 97386 34772 1827 364 0 33310 0
Current children cumulated CPU time (s) 12.59
Current children cumulated vsize (KiB) 389544

[startup+25.501 s]
/proc/loadavg: 3.39 3.28 4.03 3/371 16768
/proc/meminfo: memFree=24597240/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=389544 CPUtime=25.39 cores=0,2,4,6
/proc/16730/stat : 16730 (python) R 16728 16730 15878 0 -1 4202496 49570 932 1 0 2525 14 0 0 25 0 1 0 639006327 398893056 34778 33554432000 4194304 5683644 140734478027600 18446744073709551615 47625520130188 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/16730/statm: 97386 34778 1833 364 0 33310 0
Current children cumulated CPU time (s) 25.39
Current children cumulated vsize (KiB) 389544

[startup+51.1012 s]
/proc/loadavg: 3.38 3.28 4.01 3/371 16813
/proc/meminfo: memFree=24615432/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=389544 CPUtime=50.99 cores=0,2,4,6
/proc/16730/stat : 16730 (python) R 16728 16730 15878 0 -1 4202496 49570 932 1 0 5085 14 0 0 25 0 1 0 639006327 398893056 34778 33554432000 4194304 5683644 140734478027600 18446744073709551615 47625520130188 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/16730/statm: 97386 34778 1833 364 0 33310 0
Current children cumulated CPU time (s) 50.99
Current children cumulated vsize (KiB) 389544

[startup+102.314 s]
/proc/loadavg: 5.07 3.68 4.10 9/395 16838
/proc/meminfo: memFree=23255044/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=422204 CPUtime=59.23 cores=0,2,4,6
/proc/16730/stat : 16730 (python) S 16728 16730 15878 0 -1 4202496 52212 932 1 0 5908 15 0 0 19 0 5 0 639006327 432336896 32740 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/16730/statm: 105551 32740 1873 364 0 41460 0
[pid=16814] ppid=16730 vsize=381192 CPUtime=0.11 cores=0,2,4,6
/proc/16814/stat : 16814 (python) S 16730 16730 15878 0 -1 4202560 918 0 0 0 6 5 0 0 18 0 1 0 639012258 390340608 31227 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425103 0 0 16781312 514 12334286256019046659 0 0 17 4 0 0 0
/proc/16814/statm: 95298 31227 376 364 0 31216 0
[pid=16816] ppid=16814 vsize=65988 CPUtime=42.45 cores=0,2,4,6
/proc/16816/stat : 16816 (lingeling) R 16814 16816 16816 0 -1 4202496 33635 0 0 0 4241 4 0 0 25 0 1 0 639012259 67571712 15666 33554432000 4194304 4352236 140734719479712 18446744073709551615 4236203 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/16816/statm: 16497 15666 129 39 0 15577 0
[pid=16817] ppid=16730 vsize=391448 CPUtime=0.11 cores=0,2,4,6
/proc/16817/stat : 16817 (python) S 16730 16730 15878 0 -1 4202560 909 0 0 0 6 5 0 0 18 0 1 0 639012259 400842752 31225 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 12334286256019046660 0 0 17 2 0 0 0
/proc/16817/statm: 97862 31225 370 364 0 33777 0
[pid=16819] ppid=16817 vsize=66528 CPUtime=42.85 cores=0,2,4,6
/proc/16819/stat : 16819 (lingeling) R 16817 16819 16819 0 -1 4202496 33383 0 0 0 4282 3 0 0 25 0 1 0 639012260 68124672 15802 33554432000 4194304 4352236 140735006952336 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/16819/statm: 16632 15802 129 39 0 15712 0
[pid=16820] ppid=16730 vsize=401704 CPUtime=0.12 cores=0,2,4,6
/proc/16820/stat : 16820 (python) S 16730 16730 15878 0 -1 4202560 945 0 0 0 7 5 0 0 15 0 1 0 639012261 411344896 31229 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 1833017829192859908 0 0 17 2 0 0 0
/proc/16820/statm: 100426 31229 370 364 0 36338 0
[pid=16822] ppid=16820 vsize=539736 CPUtime=42.84 cores=0,2,4,6
/proc/16822/stat : 16822 (cryptominisat-2) R 16820 16822 16822 0 -1 4202496 138522 0 0 0 4264 20 0 0 25 0 1 0 639012261 552689664 123800 33554432000 4194304 4677096 140736637206288 18446744073709551615 4319756 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/16822/statm: 134934 123800 393 118 0 129893 0
[pid=16823] ppid=16730 vsize=411960 CPUtime=0.11 cores=0,2,4,6
/proc/16823/stat : 16823 (python) S 16730 16730 15878 0 -1 4202560 934 0 0 0 6 5 0 0 18 0 1 0 639012262 421847040 31233 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 12334286256019046658 0 0 17 0 0 0 0
/proc/16823/statm: 102990 31233 370 364 0 38899 0
[pid=16825] ppid=16823 vsize=183144 CPUtime=42.69 cores=0,2,4,6
/proc/16825/stat : 16825 (precosat) R 16823 16825 16825 0 -1 4202496 46319 0 0 0 4263 6 0 0 25 0 1 0 639012262 187539456 43188 33554432000 4194304 4890832 140734702864912 18446744073709551615 4295569 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/16825/statm: 45786 43188 86 171 0 45613 0
[pid=16730/tid=16815] ppid=16728 vsize=422204 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16815/stat : 16815 (python) S 16728 16730 15878 0 -1 4202560 27 932 0 0 0 0 0 0 25 0 5 0 639012259 432336896 32740 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 6 0 0 0
[pid=16730/tid=16818] ppid=16728 vsize=422204 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16818/stat : 16818 (python) S 16728 16730 15878 0 -1 4202560 19 932 0 0 0 0 0 0 20 0 5 0 639012260 432336896 32740 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 2 0 0 0
[pid=16730/tid=16821] ppid=16728 vsize=422204 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16821/stat : 16821 (python) S 16728 16730 15878 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 5 0 639012261 432336896 32740 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 2 0 0 0
[pid=16730/tid=16824] ppid=16728 vsize=422204 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16824/stat : 16824 (python) S 16728 16730 15878 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 5 0 639012262 432336896 32740 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 230.51
Current children cumulated vsize (KiB) 2863904

[startup+162.301 s]
/proc/loadavg: 6.92 4.47 4.34 9/395 16840
/proc/meminfo: memFree=23214544/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=422204 CPUtime=59.23 cores=0,2,4,6
/proc/16730/stat : 16730 (python) S 16728 16730 15878 0 -1 4202496 52212 932 1 0 5908 15 0 0 19 0 5 0 639006327 432336896 32740 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/16730/statm: 105551 32740 1873 364 0 41460 0
[pid=16814] ppid=16730 vsize=381192 CPUtime=0.28 cores=0,2,4,6
/proc/16814/stat : 16814 (python) S 16730 16730 15878 0 -1 4202560 940 0 0 0 14 14 0 0 18 0 1 0 639012258 390340608 31227 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425103 0 0 16781312 514 12334286256019046659 0 0 17 4 0 0 0
/proc/16814/statm: 95298 31227 376 364 0 31216 0
[pid=16816] ppid=16814 vsize=65984 CPUtime=101.68 cores=0,2,4,6
/proc/16816/stat : 16816 (lingeling) R 16814 16816 16816 0 -1 4202496 33635 0 0 0 10164 4 0 0 25 0 1 0 639012259 67567616 15665 33554432000 4194304 4352236 140734719479712 18446744073709551615 4328105 0 0 16781312 17506 0 0 0 17 6 0 0 0
/proc/16816/statm: 16496 15665 129 39 0 15576 0
[pid=16817] ppid=16730 vsize=391448 CPUtime=0.28 cores=0,2,4,6
/proc/16817/stat : 16817 (python) S 16730 16730 15878 0 -1 4202560 933 0 0 0 15 13 0 0 18 0 1 0 639012259 400842752 31225 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 12334286256019046660 0 0 17 2 0 0 0
/proc/16817/statm: 97862 31225 370 364 0 33777 0
[pid=16819] ppid=16817 vsize=66524 CPUtime=102.66 cores=0,2,4,6
/proc/16819/stat : 16819 (lingeling) R 16817 16819 16819 0 -1 4202496 33383 0 0 0 10263 3 0 0 25 0 1 0 639012260 68120576 15801 33554432000 4194304 4352236 140735006952336 18446744073709551615 4328321 0 0 16781312 17506 0 0 0 17 4 0 0 0
/proc/16819/statm: 16631 15801 129 39 0 15711 0
[pid=16820] ppid=16730 vsize=401704 CPUtime=0.31 cores=0,2,4,6
/proc/16820/stat : 16820 (python) S 16730 16730 15878 0 -1 4202560 970 0 0 0 17 14 0 0 15 0 1 0 639012261 411344896 31229 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 1833017829192859908 0 0 17 0 0 0 0
/proc/16820/statm: 100426 31229 370 364 0 36338 0
[pid=16822] ppid=16820 vsize=572164 CPUtime=102.62 cores=0,2,4,6
/proc/16822/stat : 16822 (cryptominisat-2) R 16820 16822 16822 0 -1 4202496 145075 0 0 0 10239 23 0 0 25 0 1 0 639012261 585895936 130353 33554432000 4194304 4677096 140736637206288 18446744073709551615 4320291 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/16822/statm: 143041 130353 393 118 0 138000 0
[pid=16823] ppid=16730 vsize=411960 CPUtime=0.29 cores=0,2,4,6
/proc/16823/stat : 16823 (python) S 16730 16730 15878 0 -1 4202560 956 0 0 0 16 13 0 0 18 0 1 0 639012262 421847040 31233 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 12334286256019046658 0 0 17 0 0 0 0
/proc/16823/statm: 102990 31233 370 364 0 38899 0
[pid=16825] ppid=16823 vsize=183144 CPUtime=102.33 cores=0,2,4,6
/proc/16825/stat : 16825 (precosat) R 16823 16825 16825 0 -1 4202496 46322 0 0 0 10227 6 0 0 25 0 1 0 639012262 187539456 43191 33554432000 4194304 4890832 140734702864912 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 2 0 0 0
/proc/16825/statm: 45786 43191 86 171 0 45613 0
[pid=16730/tid=16815] ppid=16728 vsize=422204 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16815/stat : 16815 (python) S 16728 16730 15878 0 -1 4202560 27 932 0 0 0 0 0 0 25 0 5 0 639012259 432336896 32740 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 6 0 0 0
[pid=16730/tid=16818] ppid=16728 vsize=422204 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16818/stat : 16818 (python) S 16728 16730 15878 0 -1 4202560 19 932 0 0 0 0 0 0 20 0 5 0 639012260 432336896 32740 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 2 0 0 0
[pid=16730/tid=16821] ppid=16728 vsize=422204 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16821/stat : 16821 (python) S 16728 16730 15878 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 5 0 639012261 432336896 32740 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 2 0 0 0
[pid=16730/tid=16824] ppid=16728 vsize=422204 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16824/stat : 16824 (python) S 16728 16730 15878 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 5 0 639012262 432336896 32740 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 469.68
Current children cumulated vsize (KiB) 2896324


################
# More data... #
################

/proc/16825/stat : 16825 (precosat) R 16823 16825 16825 0 -1 4202496 46335 0 0 0 84439 7 0 0 25 0 1 0 639012262 187539456 43204 33554432000 4194304 4890832 140734702864912 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 4 0 0 0
/proc/16825/statm: 45786 43204 86 171 0 45613 0
[pid=16823/tid=16858] ppid=16730 vsize=411960 CPUtime=0 cores=0,2,4,6
/proc/16823/task/16858/stat : 16858 (python) S 16730 16730 15878 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 639051768 421847040 31263 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 514 18446604447596574720 0 0 -1 0 0 0 0
[pid=16845] ppid=16730 vsize=422216 CPUtime=0.89 cores=0,2,4,6
/proc/16845/stat : 16845 (python) S 16730 16730 15878 0 -1 4202560 1154 0 0 0 46 43 0 0 18 0 2 0 639031914 432349184 31267 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/16845/statm: 105554 31267 399 364 0 41460 0
[pid=16847] ppid=16845 vsize=74612 CPUtime=295.54 cores=0,2,4,6
/proc/16847/stat : 16847 (lingeling) T 16845 16847 16847 0 -1 4202496 43983 0 0 0 29547 7 0 0 25 0 1 0 639031916 76402688 17823 33554432000 4194304 4352236 140734652131504 18446744073709551615 4328194 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/16847/statm: 18653 17823 129 39 0 17733 0
[pid=16845/tid=16851] ppid=16730 vsize=422216 CPUtime=0 cores=0,2,4,6
/proc/16845/task/16851/stat : 16851 (python) S 16730 16730 15878 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 639042346 432349184 31267 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 514 18446604440278902912 0 0 -1 6 0 0 0
[pid=16852] ppid=16730 vsize=432472 CPUtime=2.55 cores=0,2,4,6
/proc/16852/stat : 16852 (python) S 16730 16730 15878 0 -1 4202560 1020 0 0 0 135 120 0 0 15 0 1 0 639042347 442851328 31242 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 12334286256019046657 0 0 17 6 0 0 0
/proc/16852/statm: 108118 31242 371 364 0 44021 0
[pid=16854] ppid=16852 vsize=620008 CPUtime=823.77 cores=0,2,4,6
/proc/16854/stat : 16854 (cryptominisat-2) R 16852 16854 16854 0 -1 4202496 255950 0 0 0 82319 58 0 0 25 0 1 0 639042348 634888192 142916 33554432000 4194304 4677096 140736731194368 18446744073709551615 4320065 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/16854/statm: 155002 142916 393 118 0 149961 0
[pid=16910] ppid=16730 vsize=442728 CPUtime=0.29 cores=0,2,4,6
/proc/16910/stat : 16910 (python) S 16730 16730 15878 0 -1 4202560 1099 0 0 0 15 14 0 0 19 0 2 0 639071122 453353472 31275 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/16910/statm: 110682 31275 399 364 0 46582 0
[pid=16912] ppid=16910 vsize=184260 CPUtime=99.97 cores=0,2,4,6
/proc/16912/stat : 16912 (precosat) T 16910 16912 16912 0 -1 4202496 46660 0 0 0 9991 6 0 0 25 0 1 0 639071123 188682240 43527 33554432000 4194304 4890832 140734461498304 18446744073709551615 4238599 0 0 16781312 17442 18446744071562691360 0 0 17 4 0 0 0
/proc/16912/statm: 46065 43527 86 171 0 45892 0
[pid=16910/tid=16919] ppid=16730 vsize=442728 CPUtime=0 cores=0,2,4,6
/proc/16910/task/16919/stat : 16919 (python) S 16730 16730 15878 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 639081151 453353472 31275 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 514 18446604453283434688 0 0 -1 4 0 0 0
[pid=16916] ppid=16730 vsize=452984 CPUtime=1.42 cores=0,2,4,6
/proc/16916/stat : 16916 (python) S 16730 16730 15878 0 -1 4202560 1065 0 0 0 76 66 0 0 15 0 1 0 639081048 463855616 31255 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 10334366968366203139 0 0 17 0 0 0 0
/proc/16916/statm: 113246 31255 376 364 0 49143 0
[pid=16918] ppid=16916 vsize=622808 CPUtime=448.83 cores=0,2,4,6
/proc/16918/stat : 16918 (cryptominisat-2) R 16916 16918 16918 0 -1 4202496 165485 0 0 0 44848 35 0 0 25 0 1 0 639081049 637755392 142364 33554432000 4194304 4677096 140733408410560 18446744073709551615 4319869 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/16918/statm: 155702 142364 393 118 0 150661 0
[pid=16730/tid=16815] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16815/stat : 16815 (python) S 16728 16730 15878 0 -1 4202560 27 932 0 0 0 0 0 0 25 0 9 0 639012259 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 6 0 0 0
[pid=16730/tid=16818] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16818/stat : 16818 (python) S 16728 16730 15878 0 -1 4202560 24 932 0 0 0 0 0 0 18 0 9 0 639012260 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 2 0 0 0
[pid=16730/tid=16821] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16821/stat : 16821 (python) S 16728 16730 15878 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 9 0 639012261 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 2 0 0 0
[pid=16730/tid=16824] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16824/stat : 16824 (python) S 16728 16730 15878 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 9 0 639012262 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16846] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16846/stat : 16846 (python) S 16728 16730 15878 0 -1 4202560 30 932 0 0 0 0 0 0 18 0 9 0 639031914 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16853] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16853/stat : 16853 (python) S 16728 16730 15878 0 -1 4202560 24 932 0 0 0 0 0 0 20 0 9 0 639042348 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16911] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16911/stat : 16911 (python) S 16728 16730 15878 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 9 0 639071122 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16917] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16917/stat : 16917 (python) S 16728 16730 15878 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 9 0 639081048 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4599.03
Current children cumulated vsize (KiB) 6290120

[startup+1199.5 s]
/proc/loadavg: 8.22 8.04 6.86 10/422 16940
/proc/meminfo: memFree=20227176/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=463228 CPUtime=59.3 cores=0,2,4,6
/proc/16730/stat : 16730 (python) S 16728 16730 15878 0 -1 4202496 55852 932 1 0 5912 18 0 0 18 0 9 0 639006327 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738231755 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/16730/statm: 115807 32765 1882 364 0 51704 0
[pid=16814] ppid=16730 vsize=391436 CPUtime=1.38 cores=0,2,4,6
/proc/16814/stat : 16814 (python) S 16730 16730 15878 0 -1 4202560 1197 0 0 0 70 68 0 0 19 0 2 0 639012258 400830464 31270 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/16814/statm: 97859 31270 414 364 0 33777 0
[pid=16816] ppid=16814 vsize=74164 CPUtime=487.37 cores=0,2,4,6
/proc/16816/stat : 16816 (lingeling) T 16814 16816 16816 0 -1 4202496 50019 0 0 0 48730 7 0 0 25 0 1 0 639012259 75943936 17710 33554432000 4194304 4352236 140734719479712 18446744073709551615 4328055 0 0 16781312 17506 18446744071562691360 0 0 17 0 0 0 0
/proc/16816/statm: 18541 17710 129 39 0 17621 0
[pid=16814/tid=16905] ppid=16730 vsize=391436 CPUtime=0 cores=0,2,4,6
/proc/16814/task/16905/stat : 16905 (python) S 16730 16730 15878 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 639061389 400830464 31270 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 514 18446604453939091456 0 0 -1 4 0 0 0
[pid=16817] ppid=16730 vsize=391448 CPUtime=1.11 cores=0,2,4,6
/proc/16817/stat : 16817 (python) S 16730 16730 15878 0 -1 4202560 1149 0 0 0 57 54 0 0 18 0 2 0 639012259 400842752 31255 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/16817/statm: 97862 31255 399 364 0 33777 0
[pid=16819] ppid=16817 vsize=74704 CPUtime=389.2 cores=0,2,4,6
/proc/16819/stat : 16819 (lingeling) T 16817 16819 16819 0 -1 4202496 43623 0 0 0 38915 5 0 0 25 0 1 0 639012260 76496896 17846 33554432000 4194304 4352236 140735006952336 18446744073709551615 4233979 0 0 16781312 17506 18446744071562691360 0 0 17 4 0 0 0
/proc/16819/statm: 18676 17846 129 39 0 17756 0
[pid=16817/tid=16844] ppid=16730 vsize=391448 CPUtime=0 cores=0,2,4,6
/proc/16817/task/16844/stat : 16844 (python) S 16730 16730 15878 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 639031913 400842752 31255 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 514 18446604440860968064 0 0 -1 2 0 0 0
[pid=16820] ppid=16730 vsize=401704 CPUtime=3.45 cores=0,2,4,6
/proc/16820/stat : 16820 (python) S 16730 16730 15878 0 -1 4202560 1012 0 0 0 183 162 0 0 15 0 1 0 639012261 411344896 31230 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 12334286256019046660 0 0 17 2 0 0 0
/proc/16820/statm: 100426 31230 371 364 0 36338 0
[pid=16822] ppid=16820 vsize=646244 CPUtime=1137.46 cores=0,2,4,6
/proc/16822/stat : 16822 (cryptominisat-2) R 16820 16822 16822 0 -1 4202496 298250 0 0 0 113671 75 0 0 25 0 1 0 639012261 661753856 150368 33554432000 4194304 4677096 140736637206288 18446744073709551615 4319256 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/16822/statm: 161561 150368 393 118 0 156520 0
[pid=16823] ppid=16730 vsize=411964 CPUtime=2.46 cores=0,2,4,6
/proc/16823/stat : 16823 (python) R 16730 16730 15878 0 -1 4202560 1150 0 0 0 134 112 0 0 18 0 2 0 639012262 421851136 31263 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726404923 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/16823/statm: 102990 31263 399 364 0 38899 0
[pid=16825] ppid=16823 vsize=183144 CPUtime=844.86 cores=0,2,4,6
/proc/16825/stat : 16825 (precosat) R 16823 16825 16825 0 -1 4202496 46335 0 0 0 84479 7 0 0 25 0 1 0 639012262 187539456 43204 33554432000 4194304 4890832 140734702864912 18446744073709551615 4293638 0 0 16781312 17442 0 0 0 17 4 0 0 0
/proc/16825/statm: 45786 43204 86 171 0 45613 0
[pid=16823/tid=16858] ppid=16730 vsize=411960 CPUtime=0 cores=0,2,4,6
/proc/16823/task/16858/stat : 16858 (python) S 16730 16730 15878 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 639051768 421847040 31263 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 514 18446604447596574720 0 0 -1 0 0 0 0
[pid=16845] ppid=16730 vsize=422216 CPUtime=0.89 cores=0,2,4,6
/proc/16845/stat : 16845 (python) S 16730 16730 15878 0 -1 4202560 1154 0 0 0 46 43 0 0 18 0 2 0 639031914 432349184 31267 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/16845/statm: 105554 31267 399 364 0 41460 0
[pid=16847] ppid=16845 vsize=74612 CPUtime=295.54 cores=0,2,4,6
/proc/16847/stat : 16847 (lingeling) T 16845 16847 16847 0 -1 4202496 43983 0 0 0 29547 7 0 0 25 0 1 0 639031916 76402688 17823 33554432000 4194304 4352236 140734652131504 18446744073709551615 4328194 0 0 16781312 17506 18446744071562691360 0 0 17 6 0 0 0
/proc/16847/statm: 18653 17823 129 39 0 17733 0
[pid=16845/tid=16851] ppid=16730 vsize=422216 CPUtime=0 cores=0,2,4,6
/proc/16845/task/16851/stat : 16851 (python) S 16730 16730 15878 0 -1 4202560 46 0 0 0 0 0 0 0 18 0 2 0 639042346 432349184 31267 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 514 18446604440278902912 0 0 -1 6 0 0 0
[pid=16852] ppid=16730 vsize=432472 CPUtime=2.55 cores=0,2,4,6
/proc/16852/stat : 16852 (python) S 16730 16730 15878 0 -1 4202560 1020 0 0 0 135 120 0 0 15 0 1 0 639042347 442851328 31242 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 12334286256019046657 0 0 17 6 0 0 0
/proc/16852/statm: 108118 31242 371 364 0 44021 0
[pid=16854] ppid=16852 vsize=620008 CPUtime=824.16 cores=0,2,4,6
/proc/16854/stat : 16854 (cryptominisat-2) R 16852 16854 16854 0 -1 4202496 255971 0 0 0 82358 58 0 0 25 0 1 0 639042348 634888192 142937 33554432000 4194304 4677096 140736731194368 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/16854/statm: 155002 142937 393 118 0 149961 0
[pid=16910] ppid=16730 vsize=442728 CPUtime=0.29 cores=0,2,4,6
/proc/16910/stat : 16910 (python) S 16730 16730 15878 0 -1 4202560 1099 0 0 0 15 14 0 0 19 0 2 0 639071122 453353472 31275 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738231755 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/16910/statm: 110682 31275 399 364 0 46582 0
[pid=16912] ppid=16910 vsize=184260 CPUtime=99.97 cores=0,2,4,6
/proc/16912/stat : 16912 (precosat) T 16910 16912 16912 0 -1 4202496 46660 0 0 0 9991 6 0 0 25 0 1 0 639071123 188682240 43527 33554432000 4194304 4890832 140734461498304 18446744073709551615 4238599 0 0 16781312 17442 18446744071562691360 0 0 17 4 0 0 0
/proc/16912/statm: 46065 43527 86 171 0 45892 0
[pid=16910/tid=16919] ppid=16730 vsize=442728 CPUtime=0 cores=0,2,4,6
/proc/16910/task/16919/stat : 16919 (python) S 16730 16730 15878 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 639081151 453353472 31275 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 514 18446604453283434688 0 0 -1 4 0 0 0
[pid=16916] ppid=16730 vsize=452984 CPUtime=1.42 cores=0,2,4,6
/proc/16916/stat : 16916 (python) S 16730 16730 15878 0 -1 4202560 1065 0 0 0 76 66 0 0 15 0 1 0 639081048 463855616 31255 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 10334366968366203139 0 0 17 0 0 0 0
/proc/16916/statm: 113246 31255 376 364 0 49143 0
[pid=16918] ppid=16916 vsize=622808 CPUtime=449.22 cores=0,2,4,6
/proc/16918/stat : 16918 (cryptominisat-2) R 16916 16918 16918 0 -1 4202496 165512 0 0 0 44887 35 0 0 25 0 1 0 639081049 637755392 142391 33554432000 4194304 4677096 140733408410560 18446744073709551615 4320231 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/16918/statm: 155702 142391 393 118 0 150661 0
[pid=16730/tid=16815] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16815/stat : 16815 (python) S 16728 16730 15878 0 -1 4202560 27 932 0 0 0 0 0 0 25 0 9 0 639012259 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 6 0 0 0
[pid=16730/tid=16818] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16818/stat : 16818 (python) S 16728 16730 15878 0 -1 4202560 24 932 0 0 0 0 0 0 18 0 9 0 639012260 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 2 0 0 0
[pid=16730/tid=16821] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16821/stat : 16821 (python) S 16728 16730 15878 0 -1 4202560 22 932 0 0 0 0 0 0 20 0 9 0 639012261 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 2 0 0 0
[pid=16730/tid=16824] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16824/stat : 16824 (python) S 16728 16730 15878 0 -1 4202560 31 932 0 0 0 0 0 0 18 0 9 0 639012262 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16846] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16846/stat : 16846 (python) S 16728 16730 15878 0 -1 4202560 30 932 0 0 0 0 0 0 18 0 9 0 639031914 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16853] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16853/stat : 16853 (python) S 16728 16730 15878 0 -1 4202560 24 932 0 0 0 0 0 0 20 0 9 0 639042348 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16911] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16911/stat : 16911 (python) S 16728 16730 15878 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 9 0 639071122 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16917] ppid=16728 vsize=463228 CPUtime=0 cores=0,2,4,6
/proc/16730/task/16917/stat : 16917 (python) S 16728 16730 15878 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 9 0 639081048 474345472 32765 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4600.63
Current children cumulated vsize (KiB) 6290124

[startup+1199.6 s]
/proc/loadavg: 8.22 8.04 6.86 10/422 16940
/proc/meminfo: memFree=20227176/32951124 swapFree=63083164/67111528
[pid=16730] ppid=16728 vsize=463228 CPUtime=3009.37 cores=0,2,4,6
/proc/16730/stat : 16730 (python) S 16728 16730 15878 0 -1 4202496 55946 494458 1 0 5913 18 294489 517 17 0 9 0 639006327 474345472 32773 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738235199 0 0 16781312 2 18446744073709551615 0 0 17 6 0 0 0
/proc/16730/statm: 115807 32773 1890 364 0 51704 0
[pid=16820] ppid=16730 vsize=401704 CPUtime=3.45 cores=0,2,4,6
/proc/16820/stat : 16820 (python) S 16730 16730 15878 0 -1 4202560 1031 0 0 0 183 162 0 0 15 0 1 0 639012261 411344896 31235 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738235199 0 0 16781824 2 18446744071562232103 0 0 17 2 0 0 0
/proc/16820/statm: 100426 31235 376 364 0 36338 0
[pid=16822] ppid=16820 vsize=0 CPUtime=1137.57 cores=0,2,4,6
/proc/16822/stat : 16822 (cryptominisat-2) R 16820 16822 16822 0 -1 4203524 298251 0 0 0 113680 77 0 0 25 0 1 0 639012261 0 0 33554432000 0 0 0 0 0 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/16822/statm: 0 0 0 0 0 0 0
[pid=16916] ppid=16730 vsize=452984 CPUtime=1.42 cores=0,2,4,6
/proc/16916/stat : 16916 (python) S 16730 16730 15878 0 -1 4202560 1065 0 0 0 76 66 0 0 15 0 1 0 639081048 463855616 31255 33554432000 4194304 5683644 140734478027600 18446744073709551615 264726425158 0 0 16781312 514 10334366968366203139 0 0 17 0 0 0 0
/proc/16916/statm: 113246 31255 376 364 0 49143 0
[pid=16918] ppid=16916 vsize=622808 CPUtime=449.31 cores=0,2,4,6
/proc/16918/stat : 16918 (cryptominisat-2) R 16916 16918 16918 0 -1 4202496 165518 0 0 0 44896 35 0 0 25 0 1 0 639081049 637755392 142397 33554432000 4194304 4677096 140733408410560 18446744073709551615 4320006 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/16918/statm: 155702 142397 393 118 0 150661 0
[pid=16730/tid=16815] ppid=16728 vsize=463228 CPUtime=2950.06 cores=0,2,4,6
/proc/16730/task/16815/stat : 16815 (python) S 16728 16730 15878 0 -1 4202560 27 494458 0 0 0 0 294489 517 25 0 9 0 639012259 474345472 32773 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 6 0 0 0
[pid=16730/tid=16818] ppid=16728 vsize=463228 CPUtime=2950.06 cores=0,2,4,6
/proc/16730/task/16818/stat : 16818 (python) S 16728 16730 15878 0 -1 4202560 24 494458 0 0 0 0 294489 517 18 0 9 0 639012260 474345472 32773 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 2 0 0 0
[pid=16730/tid=16821] ppid=16728 vsize=463228 CPUtime=2950.06 cores=0,2,4,6
/proc/16730/task/16821/stat : 16821 (python) S 16728 16730 15878 0 -1 4202560 22 494458 0 0 0 0 294489 517 20 0 9 0 639012261 474345472 32773 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 2 0 0 0
[pid=16730/tid=16824] ppid=16728 vsize=463228 CPUtime=2950.06 cores=0,2,4,6
/proc/16730/task/16824/stat : 16824 (python) S 16728 16730 15878 0 -1 4202560 31 494458 0 0 0 0 294489 517 18 0 9 0 639012262 474345472 32773 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16846] ppid=16728 vsize=463228 CPUtime=2950.06 cores=0,2,4,6
/proc/16730/task/16846/stat : 16846 (python) S 16728 16730 15878 0 -1 4202560 30 494458 0 0 0 0 294489 517 18 0 9 0 639031914 474345472 32773 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16853] ppid=16728 vsize=463228 CPUtime=2950.06 cores=0,2,4,6
/proc/16730/task/16853/stat : 16853 (python) S 16728 16730 15878 0 -1 4202560 24 494458 0 0 0 0 294489 517 20 0 9 0 639042348 474345472 32773 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16911] ppid=16728 vsize=463228 CPUtime=2950.06 cores=0,2,4,6
/proc/16730/task/16911/stat : 16911 (python) S 16728 16730 15878 0 -1 4202560 26 494458 0 0 0 0 294489 517 20 0 9 0 639071122 474345472 32773 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
[pid=16730/tid=16917] ppid=16728 vsize=463228 CPUtime=2950.06 cores=0,2,4,6
/proc/16730/task/16917/stat : 16917 (python) S 16728 16730 15878 0 -1 4202560 29 494458 0 0 0 0 294489 517 20 0 9 0 639081048 474345472 32773 33554432000 4194304 5683644 140734478027600 18446744073709551615 264738228657 0 0 16781312 2 18446604447336174016 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4601.12
Current children cumulated vsize (KiB) 1940724

Child status: 0
Real time (s): 1199.68
CPU time (s): 4601.27
CPU user time (s): 4592.44
CPU system time (s): 8.83366
CPU usage (%): 383.54
Max. virtual memory (cumulated for all children) (KiB): 6396284

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4592.43
system time used= 8.83366
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1031266
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7776
involuntary context switches= 30224

runsolver used 5.58315 second user time and 14.0099 second system time

The end

Launcher Data 

Begin job on node141 at 2011-05-15 15:25:07
IDJOB=3378970
IDBENCH=82481
IDSOLVER=1860
FILE ID=node141/3378970-1305465907
RUNJOBID= node141-1305463314-15896
PBS_JOBID= 13324992
Free space on /tmp= 73312 MiB

SOLVER NAME= borg-sat 11.03.02-par-industrial (fixed)
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378970-1305465907/watcher-3378970-1305465907 -o /tmp/evaluation-result-3378970-1305465907/solver-3378970-1305465907 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378970-1305465907.cnf -seed 50333654 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a8ad0173824ed9404a8c153da07c5f9c
RANDOM SEED=50333654

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24422072 kB
Buffers:        271632 kB
Cached:        5445284 kB
SwapCached:      15736 kB
Active:        2868144 kB
Inactive:      5403672 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24422072 kB
SwapTotal:    67111528 kB
SwapFree:     63083164 kB
Dirty:           44324 kB
Writeback:           0 kB
AnonPages:     2546268 kB
Mapped:          19404 kB
Slab:           147164 kB
PageTables:      42364 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 87285316 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73284 MiB
End job on node141 at 2011-05-15 15:45:07