Trace number 3378980

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-industrial (fixed)? 4790.76 1201.11

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
64/aes_64_3_keyfind_1.cnf
MD5SUM4738c3d0ccd52030cff8addcec6bcde9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1404
Number of clauses7572
Sum of the clauses size29588
Maximum clause length5
Minimum clause length1
Number of clauses of size 1140
Number of clauses of size 2240
Number of clauses of size 32992
Number of clauses of size 41008
Number of clauses of size 53192
Number of clauses of size over 50

Solver Data 

0.36/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.36/0.68	c INFO: solving HOME/instance-3378980-1305466524.cnf
0.36/0.68	c INFO: computing task features
0.43/0.71	c INFO: computed variable-clause graph statistics
0.43/0.71	c INFO: computed clause balance statistics
0.53/0.87	c INFO: computed variable balance statistics
0.63/0.97	c INFO: computed small-clause counts
0.63/0.97	c INFO: computed Horn-clause counts
0.63/0.98	c INFO: computed variable graph statistics
0.63/0.98	c INFO: collected features for HOME/instance-3378980-1305466524.cnf in 0.30 s
0.63/0.99	c INFO: running lingeling-276@0 for 582 with 1199 remaining (b = 0.58)
0.63/1.00	c INFO: running cryptominisat-2.9.0@0 for 582 with 1199 remaining (b = 0.51)
0.73/1.01	c INFO: running lingeling-276@0 for 1199 with 1199 remaining (b = 0.57)
0.73/1.02	c INFO: running lingeling-276@0 for 97 with 1199 remaining (b = 0.21)
400.64/101.22	c INFO: running cryptominisat-2.9.0@0 for 1099 with 1099 remaining (b = 0.38)
2343.41/588.00	c INFO: running lingeling-276@99 for 97 with 612 remaining (b = 0.08)
2351.82/590.07	c INFO: running precosat-570@0 for 610 with 610 remaining (b = 0.32)
2731.37/685.18	c INFO: running precosat-570@0 for 97 with 515 remaining (b = 0.10)
3131.25/785.38	c INFO: running lingeling-276@0 for 415 with 415 remaining (b = 0.16)
4790.29/1201.08	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378980-1305466524/watcher-3378980-1305466524 -o /tmp/evaluation-result-3378980-1305466524/solver-3378980-1305466524 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378980-1305466524.cnf -seed 1051148951 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.17 7.71 5.53 5/261 21622
/proc/meminfo: memFree=21217400/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/21622/stat : 21622 (python) S 21620 21622 21297 0 -1 4202496 733 0 0 0 0 0 0 0 25 0 1 0 658253171 15548416 622 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921775104 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/21622/statm: 3796 622 322 364 0 283 0

[startup+0.065668 s]
/proc/loadavg: 8.17 7.71 5.53 5/261 21622
/proc/meminfo: memFree=21217400/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=30116 CPUtime=0.04 cores=1,3,5,7
/proc/21622/stat : 21622 (python) S 21620 21622 21297 0 -1 4202496 1470 0 0 0 3 1 0 0 25 0 1 0 658253171 30838784 1309 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921775104 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/21622/statm: 7529 1309 443 364 0 899 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 30116

[startup+0.100686 s]
/proc/loadavg: 8.17 7.71 5.53 5/261 21622
/proc/meminfo: memFree=21217400/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=85624 CPUtime=0.06 cores=1,3,5,7
/proc/21622/stat : 21622 (python) R 21620 21622 21297 0 -1 4202496 2629 0 0 0 4 2 0 0 17 0 1 0 658253171 87678976 2348 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921775104 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/21622/statm: 21406 2348 713 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85624

[startup+0.300664 s]
/proc/loadavg: 8.17 7.71 5.53 5/261 21622
/proc/meminfo: memFree=21217400/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=135752 CPUtime=0.19 cores=1,3,5,7
/proc/21622/stat : 21622 (python) R 21620 21622 21297 0 -1 4202496 5965 933 1 0 13 6 0 0 17 0 1 0 658253171 139010048 4150 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921582363 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/21622/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135752

[startup+0.700562 s]
/proc/loadavg: 8.17 7.71 5.53 5/261 21622
/proc/meminfo: memFree=21217400/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=279248 CPUtime=0.43 cores=1,3,5,7
/proc/21622/stat : 21622 (python) R 21620 21622 21297 0 -1 4202496 9454 933 1 0 30 13 0 0 15 0 1 0 658253171 285949952 7135 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921463488 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/21622/statm: 69812 7135 1761 364 0 5736 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 279248

[startup+1.50038 s]
/proc/loadavg: 8.17 7.71 5.53 7/265 21631
/proc/meminfo: memFree=21189084/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=320652 CPUtime=0.74 cores=1,3,5,7
/proc/21622/stat : 21622 (python) S 21620 21622 21297 0 -1 4202496 12381 933 1 0 61 13 0 0 24 0 5 0 658253171 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/21622/statm: 80163 7383 1873 364 0 16072 0
[pid=21629] ppid=21622 vsize=279640 CPUtime=0 cores=1,3,5,7
/proc/21629/stat : 21629 (python) S 21622 21622 21297 0 -1 4202560 714 0 0 0 0 0 0 0 18 0 1 0 658253271 286351360 5841 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797135 0 0 16781312 514 4532504967725973503 0 0 17 5 0 0 0
/proc/21629/statm: 69910 5841 347 364 0 5828 0
[pid=21631] ppid=21629 vsize=5004 CPUtime=0.49 cores=1,3,5,7
/proc/21631/stat : 21631 (lingeling) R 21629 21631 21631 0 -1 4202496 753 0 0 0 49 0 0 0 20 0 1 0 658253271 5124096 434 33554432000 4194304 4352236 140736041492848 18446744073709551615 4328095 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21631/statm: 1251 434 128 39 0 331 0
[pid=21622/tid=21630] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21630/stat : 21630 (python) S 21620 21622 21297 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 5 0 658253271 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21633] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21633/stat : 21633 (python) S 21620 21622 21297 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 5 0 658253272 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 605296

[startup+3.10109 s]
/proc/loadavg: 8.16 7.72 5.55 10/274 21640
/proc/meminfo: memFree=21165072/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=320652 CPUtime=0.74 cores=1,3,5,7
/proc/21622/stat : 21622 (python) S 21620 21622 21297 0 -1 4202496 12381 933 1 0 61 13 0 0 24 0 5 0 658253171 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/21622/statm: 80163 7383 1873 364 0 16072 0
[pid=21629] ppid=21622 vsize=279640 CPUtime=0 cores=1,3,5,7
/proc/21629/stat : 21629 (python) S 21622 21622 21297 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 658253271 286351360 5848 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797135 0 0 16781312 514 4532504967725941000 0 0 17 5 0 0 0
/proc/21629/statm: 69910 5848 354 364 0 5828 0
[pid=21631] ppid=21629 vsize=6868 CPUtime=2.09 cores=1,3,5,7
/proc/21631/stat : 21631 (lingeling) R 21629 21631 21631 0 -1 4202496 1203 0 0 0 209 0 0 0 25 0 1 0 658253271 7032832 884 33554432000 4194304 4352236 140736041492848 18446744073709551615 4329081 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21631/statm: 1717 884 128 39 0 797 0
[pid=21632] ppid=21622 vsize=289896 CPUtime=0 cores=1,3,5,7
/proc/21632/stat : 21632 (python) S 21622 21622 21297 0 -1 4202560 746 0 0 0 0 0 0 0 15 0 1 0 658253272 296853504 5846 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 5606936043782635783 0 0 17 5 0 0 0
/proc/21632/statm: 72474 5846 348 364 0 8389 0
[pid=21634] ppid=21632 vsize=33280 CPUtime=2.07 cores=1,3,5,7
/proc/21634/stat : 21634 (cryptominisat-2) R 21632 21634 21634 0 -1 4202496 3453 0 0 0 207 0 0 0 25 0 1 0 658253272 34078720 1811 33554432000 4194304 4677096 140735613796000 18446744073709551615 4318932 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/21634/statm: 8320 1811 392 118 0 3279 0
[pid=21635] ppid=21622 vsize=300152 CPUtime=0 cores=1,3,5,7
/proc/21635/stat : 21635 (python) S 21622 21622 21297 0 -1 4202560 735 0 0 0 0 0 0 0 18 0 1 0 658253273 307355648 5850 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 4484542346377003269 0 0 17 3 0 0 0
/proc/21635/statm: 75038 5850 348 364 0 10950 0
[pid=21637] ppid=21635 vsize=6388 CPUtime=2.07 cores=1,3,5,7
/proc/21637/stat : 21637 (lingeling) R 21635 21637 21637 0 -1 4202496 1116 0 0 0 207 0 0 0 25 0 1 0 658253273 6541312 795 33554432000 4194304 4352236 140736411564864 18446744073709551615 4281245 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/21637/statm: 1597 795 128 39 0 677 0
[pid=21638] ppid=21622 vsize=310408 CPUtime=0 cores=1,3,5,7
/proc/21638/stat : 21638 (python) S 21622 21622 21297 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 658253274 317857792 5854 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 4509463327176360200 0 0 17 3 0 0 0
/proc/21638/statm: 77602 5854 348 364 0 13511 0
[pid=21640] ppid=21638 vsize=6680 CPUtime=2.07 cores=1,3,5,7
/proc/21640/stat : 21640 (lingeling) R 21638 21640 21640 0 -1 4202496 1222 0 0 0 207 0 0 0 25 0 1 0 658253274 6840320 838 33554432000 4194304 4352236 140733364673712 18446744073709551615 4328013 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/21640/statm: 1670 838 128 39 0 750 0
[pid=21622/tid=21630] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21630/stat : 21630 (python) S 21620 21622 21297 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 5 0 658253271 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21633] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21633/stat : 21633 (python) S 21620 21622 21297 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 5 0 658253272 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21636] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21636/stat : 21636 (python) S 21620 21622 21297 0 -1 4202560 25 933 0 0 0 0 0 0 22 0 5 0 658253273 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21639] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21639/stat : 21639 (python) S 21620 21622 21297 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 5 0 658253274 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 9.04
Current children cumulated vsize (KiB) 1553964

[startup+6.3005 s]
/proc/loadavg: 8.16 7.72 5.55 9/274 21640
/proc/meminfo: memFree=21152176/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=320652 CPUtime=0.74 cores=1,3,5,7
/proc/21622/stat : 21622 (python) S 21620 21622 21297 0 -1 4202496 12381 933 1 0 61 13 0 0 24 0 5 0 658253171 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/21622/statm: 80163 7383 1873 364 0 16072 0
[pid=21629] ppid=21622 vsize=279640 CPUtime=0 cores=1,3,5,7
/proc/21629/stat : 21629 (python) S 21622 21622 21297 0 -1 4202560 897 0 0 0 0 0 0 0 18 0 1 0 658253271 286351360 5870 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797135 0 0 16781312 514 4532504967725941000 0 0 17 5 0 0 0
/proc/21629/statm: 69910 5870 376 364 0 5828 0
[pid=21631] ppid=21629 vsize=6872 CPUtime=5.29 cores=1,3,5,7
/proc/21631/stat : 21631 (lingeling) R 21629 21631 21631 0 -1 4202496 1332 0 0 0 529 0 0 0 25 0 1 0 658253271 7036928 885 33554432000 4194304 4352236 140736041492848 18446744073709551615 4279040 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21631/statm: 1718 885 128 39 0 798 0
[pid=21632] ppid=21622 vsize=289896 CPUtime=0 cores=1,3,5,7
/proc/21632/stat : 21632 (python) S 21622 21622 21297 0 -1 4202560 935 0 0 0 0 0 0 0 15 0 1 0 658253272 296853504 5869 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 5606936052372570375 0 0 17 5 0 0 0
/proc/21632/statm: 72474 5869 371 364 0 8389 0
[pid=21634] ppid=21632 vsize=44548 CPUtime=5.25 cores=1,3,5,7
/proc/21634/stat : 21634 (cryptominisat-2) R 21632 21634 21634 0 -1 4202496 6948 0 0 0 524 1 0 0 25 0 1 0 658253272 45617152 2926 33554432000 4194304 4677096 140735613796000 18446744073709551615 4320784 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/21634/statm: 11137 2926 392 118 0 6096 0
[pid=21635] ppid=21622 vsize=300152 CPUtime=0 cores=1,3,5,7
/proc/21635/stat : 21635 (python) S 21622 21622 21297 0 -1 4202560 888 0 0 0 0 0 0 0 18 0 1 0 658253273 307355648 5873 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 4484542346377003269 0 0 17 3 0 0 0
/proc/21635/statm: 75038 5873 371 364 0 10950 0
[pid=21637] ppid=21635 vsize=6640 CPUtime=5.25 cores=1,3,5,7
/proc/21637/stat : 21637 (lingeling) R 21635 21637 21637 0 -1 4202496 1245 0 0 0 525 0 0 0 25 0 1 0 658253273 6799360 828 33554432000 4194304 4352236 140736411564864 18446744073709551615 4207615 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/21637/statm: 1660 828 128 39 0 740 0
[pid=21638] ppid=21622 vsize=310408 CPUtime=0 cores=1,3,5,7
/proc/21638/stat : 21638 (python) S 21622 21622 21297 0 -1 4202560 902 0 0 0 0 0 0 0 18 0 1 0 658253274 317857792 5877 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 4509463327176360200 0 0 17 3 0 0 0
/proc/21638/statm: 77602 5877 371 364 0 13511 0
[pid=21640] ppid=21638 vsize=6812 CPUtime=5.25 cores=1,3,5,7
/proc/21640/stat : 21640 (lingeling) R 21638 21640 21640 0 -1 4202496 1319 0 0 0 525 0 0 0 25 0 1 0 658253274 6975488 871 33554432000 4194304 4352236 140733364673712 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/21640/statm: 1703 871 128 39 0 783 0
[pid=21622/tid=21630] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21630/stat : 21630 (python) S 21620 21622 21297 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 5 0 658253271 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21633] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21633/stat : 21633 (python) S 21620 21622 21297 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 5 0 658253272 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21636] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21636/stat : 21636 (python) S 21620 21622 21297 0 -1 4202560 25 933 0 0 0 0 0 0 22 0 5 0 658253273 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21639] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21639/stat : 21639 (python) S 21620 21622 21297 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 5 0 658253274 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 21.78
Current children cumulated vsize (KiB) 1565620

[startup+12.7013 s]
/proc/loadavg: 8.15 7.72 5.56 9/274 21640
/proc/meminfo: memFree=21149996/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=320652 CPUtime=0.74 cores=1,3,5,7
/proc/21622/stat : 21622 (python) S 21620 21622 21297 0 -1 4202496 12381 933 1 0 61 13 0 0 24 0 5 0 658253171 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/21622/statm: 80163 7383 1873 364 0 16072 0
[pid=21629] ppid=21622 vsize=279640 CPUtime=0.01 cores=1,3,5,7
/proc/21629/stat : 21629 (python) S 21622 21622 21297 0 -1 4202560 902 0 0 0 1 0 0 0 18 0 1 0 658253271 286351360 5871 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797135 0 0 16781312 514 7573840712400077064 0 0 17 5 0 0 0
/proc/21629/statm: 69910 5871 377 364 0 5828 0
[pid=21631] ppid=21629 vsize=7896 CPUtime=11.69 cores=1,3,5,7
/proc/21631/stat : 21631 (lingeling) R 21629 21631 21631 0 -1 4202496 1841 0 0 0 1169 0 0 0 25 0 1 0 658253271 8085504 1170 33554432000 4194304 4352236 140736041492848 18446744073709551615 4280969 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21631/statm: 1974 1170 128 39 0 1054 0
[pid=21632] ppid=21622 vsize=289896 CPUtime=0.02 cores=1,3,5,7
/proc/21632/stat : 21632 (python) S 21622 21622 21297 0 -1 4202560 941 0 0 0 1 1 0 0 15 0 1 0 658253272 296853504 5869 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 17442221458775310599 0 0 17 5 0 0 0
/proc/21632/statm: 72474 5869 371 364 0 8389 0
[pid=21634] ppid=21632 vsize=55488 CPUtime=11.59 cores=1,3,5,7
/proc/21634/stat : 21634 (cryptominisat-2) R 21632 21634 21634 0 -1 4202496 14706 0 0 0 1157 2 0 0 25 0 1 0 658253272 56819712 7173 33554432000 4194304 4677096 140735613796000 18446744073709551615 4465306 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/21634/statm: 13872 7173 392 118 0 8831 0
[pid=21635] ppid=21622 vsize=300152 CPUtime=0.02 cores=1,3,5,7
/proc/21635/stat : 21635 (python) S 21622 21622 21297 0 -1 4202560 892 0 0 0 1 1 0 0 18 0 1 0 658253273 307355648 5873 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 7573840712400077061 0 0 17 3 0 0 0
/proc/21635/statm: 75038 5873 371 364 0 10950 0
[pid=21637] ppid=21635 vsize=8068 CPUtime=11.63 cores=1,3,5,7
/proc/21637/stat : 21637 (lingeling) R 21635 21637 21637 0 -1 4202496 1955 0 0 0 1163 0 0 0 25 0 1 0 658253273 8261632 1218 33554432000 4194304 4352236 140736411564864 18446744073709551615 4328151 0 0 16781312 17506 0 0 0 17 5 0 0 0
/proc/21637/statm: 2017 1218 129 39 0 1097 0
[pid=21638] ppid=21622 vsize=310408 CPUtime=0.01 cores=1,3,5,7
/proc/21638/stat : 21638 (python) S 21622 21622 21297 0 -1 4202560 905 0 0 0 0 1 0 0 18 0 1 0 658253274 317857792 5877 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 7573840712400077064 0 0 17 3 0 0 0
/proc/21638/statm: 77602 5877 371 364 0 13511 0
[pid=21640] ppid=21638 vsize=7964 CPUtime=11.63 cores=1,3,5,7
/proc/21640/stat : 21640 (lingeling) R 21638 21640 21640 0 -1 4202496 1991 0 0 0 1163 0 0 0 25 0 1 0 658253274 8155136 1159 33554432000 4194304 4352236 140733364673712 18446744073709551615 4328194 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/21640/statm: 1991 1159 128 39 0 1071 0
[pid=21622/tid=21630] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21630/stat : 21630 (python) S 21620 21622 21297 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 5 0 658253271 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21633] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21633/stat : 21633 (python) S 21620 21622 21297 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 5 0 658253272 328347648 7383 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21636] ppid=21620 vsize=320652 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/21622/task/21630/stat : 21630 (python) S 21620 21622 21297 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 8 0 658253271 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21633] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21633/stat : 21633 (python) S 21620 21622 21297 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 8 0 658253272 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21636] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21636/stat : 21636 (python) S 21620 21622 21297 0 -1 4202560 25 933 0 0 0 0 0 0 22 0 8 0 658253273 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21639] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21639/stat : 21639 (python) S 21620 21622 21297 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 8 0 658253274 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21645] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21645/stat : 21645 (python) S 21620 21622 21297 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 8 0 658263294 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21668] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21668/stat : 21668 (python) S 21620 21622 21297 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 8 0 658312179 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21674] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21674/stat : 21674 (python) S 21620 21622 21297 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 8 0 658321690 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4779.5
Current children cumulated vsize (KiB) 3223528

[startup+1199.9 s]
/proc/loadavg: 4.25 5.71 6.27 5/265 21797
/proc/meminfo: memFree=22266012/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=351748 CPUtime=0.79 cores=1,3,5,7
/proc/21622/stat : 21622 (python) S 21620 21622 21297 0 -1 4202496 15364 933 1 0 64 15 0 0 18 0 8 0 658253171 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/21622/statm: 87937 7460 1888 364 0 23837 0
[pid=21629] ppid=21622 vsize=289884 CPUtime=1.83 cores=1,3,5,7
/proc/21629/stat : 21629 (python) S 21622 21622 21297 0 -1 4202560 1199 0 0 0 90 93 0 0 18 0 2 0 658253271 296841216 5915 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/21629/statm: 72471 5915 416 364 0 8389 0
[pid=21631] ppid=21629 vsize=19576 CPUtime=1001.53 cores=1,3,5,7
/proc/21631/stat : 21631 (lingeling) R 21629 21631 21631 0 -1 4202496 37084 0 0 0 100148 5 0 0 25 0 1 0 658253271 20045824 4093 33554432000 4194304 4352236 140736041492848 18446744073709551615 4328009 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21631/statm: 4894 4093 128 39 0 3974 0
[pid=21629/tid=21665] ppid=21622 vsize=289884 CPUtime=0 cores=1,3,5,7
/proc/21629/task/21665/stat : 21665 (python) S 21622 21622 21297 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 658311971 296841216 5915 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 514 18446604471147868480 0 0 -1 5 0 0 0
[pid=21632] ppid=21622 vsize=289896 CPUtime=1.14 cores=1,3,5,7
/proc/21632/stat : 21632 (python) S 21622 21622 21297 0 -1 4202560 1152 0 0 0 60 54 0 0 16 0 2 0 658253272 296853504 5899 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/21632/statm: 72474 5899 400 364 0 8389 0
[pid=21634] ppid=21632 vsize=236556 CPUtime=584.18 cores=1,3,5,7
/proc/21634/stat : 21634 (cryptominisat-2) T 21632 21634 21634 0 -1 4202496 208076 0 0 0 58366 52 0 0 25 0 1 0 658253272 242233344 38133 33554432000 4194304 4677096 140735613796000 18446744073709551615 4319571 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/21634/statm: 59139 38133 392 118 0 54098 0
[pid=21632/tid=21666] ppid=21622 vsize=289896 CPUtime=0 cores=1,3,5,7
/proc/21632/task/21666/stat : 21666 (python) S 21622 21622 21297 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 658312178 296853504 5899 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 514 18446604464218834176 0 0 -1 5 0 0 0
[pid=21635] ppid=21622 vsize=300152 CPUtime=2.22 cores=1,3,5,7
/proc/21635/stat : 21635 (python) S 21622 21622 21297 0 -1 4202560 959 0 0 0 117 105 0 0 18 0 1 0 658253273 307355648 5873 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 7573840712400077061 0 0 17 3 0 0 0
/proc/21635/statm: 75038 5873 371 364 0 10950 0
[pid=21637] ppid=21635 vsize=25244 CPUtime=1194.36 cores=1,3,5,7
/proc/21637/stat : 21637 (lingeling) R 21635 21637 21637 0 -1 4202496 42793 0 0 0 119429 7 0 0 25 0 1 0 658253273 25849856 5512 33554432000 4194304 4352236 140736411564864 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/21637/statm: 6311 5512 129 39 0 5391 0
[pid=21638] ppid=21622 vsize=310408 CPUtime=0.37 cores=1,3,5,7
/proc/21638/stat : 21638 (python) S 21622 21622 21297 0 -1 4202560 1132 0 0 0 19 18 0 0 18 0 2 0 658253274 317857792 5907 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/21638/statm: 77602 5907 400 364 0 13511 0
[pid=21640] ppid=21638 vsize=14588 CPUtime=196.97 cores=1,3,5,7
/proc/21640/stat : 21640 (lingeling) T 21638 21640 21640 0 -1 4202496 12176 0 0 0 19696 1 0 0 25 0 1 0 658253274 14938112 2848 33554432000 4194304 4352236 140733364673712 18446744073709551615 4329043 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/21640/statm: 3647 2848 129 39 0 2727 0
[pid=21638/tid=21643] ppid=21622 vsize=310408 CPUtime=0 cores=1,3,5,7
/proc/21638/task/21643/stat : 21643 (python) S 21622 21622 21297 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 658263293 317857792 5907 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 514 18446604471142503680 0 0 -1 3 0 0 0
[pid=21644] ppid=21622 vsize=320664 CPUtime=2.09 cores=1,3,5,7
/proc/21644/stat : 21644 (python) S 21622 21622 21297 0 -1 4202560 999 0 0 0 111 98 0 0 15 0 1 0 658263294 328359936 5881 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 7573840712400077063 0 0 17 3 0 0 0
/proc/21644/statm: 80166 5881 371 364 0 16072 0
[pid=21646] ppid=21644 vsize=319128 CPUtime=1091.32 cores=1,3,5,7
/proc/21646/stat : 21646 (cryptominisat-2) R 21644 21646 21646 0 -1 4202496 316107 0 0 0 109018 114 0 0 25 0 1 0 658263294 326787072 56450 33554432000 4194304 4677096 140733223883920 18446744073709551615 4320203 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/21646/statm: 79782 56450 392 118 0 74741 0
[pid=21667] ppid=21622 vsize=331248 CPUtime=1.12 cores=1,3,5,7
/proc/21667/stat : 21667 (python) S 21622 21622 21297 0 -1 4202560 977 0 0 0 60 52 0 0 18 0 1 0 658312179 339197952 5935 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 7573840712400077061 0 0 17 3 0 0 0
/proc/21667/statm: 82812 5935 371 364 0 18715 0
[pid=21669] ppid=21667 vsize=49760 CPUtime=608.36 cores=1,3,5,7
/proc/21669/stat : 21669 (precosat) R 21667 21669 21669 0 -1 4202496 12743 0 0 0 60829 7 0 0 25 0 1 0 658312179 50954240 12241 33554432000 4194304 4890832 140736373262016 18446744073709551615 4238599 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/21669/statm: 12440 12241 86 171 0 12267 0
[pid=21673] ppid=21622 vsize=341504 CPUtime=0.19 cores=1,3,5,7
/proc/21673/stat : 21673 (python) S 21622 21622 21297 0 -1 4202560 1088 0 0 0 10 9 0 0 19 0 2 0 658321690 349700096 5969 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/21673/statm: 85376 5969 400 364 0 21276 0
[pid=21675] ppid=21673 vsize=23428 CPUtime=99.43 cores=1,3,5,7
/proc/21675/stat : 21675 (precosat) T 21673 21675 21675 0 -1 4202496 5970 0 0 0 9941 2 0 0 25 0 1 0 658321690 23990272 5703 33554432000 4194304 4890832 140735958416960 18446744073709551615 4238594 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/21675/statm: 5857 5703 86 171 0 5684 0
[pid=21673/tid=21713] ppid=21622 vsize=341504 CPUtime=0 cores=1,3,5,7
/proc/21673/task/21713/stat : 21713 (python) S 21622 21622 21297 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 658331709 349700096 5969 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 514 18446604459957154048 0 0 -1 3 0 0 0
[pid=21622/tid=21630] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21630/stat : 21630 (python) S 21620 21622 21297 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 8 0 658253271 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21633] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21633/stat : 21633 (python) S 21620 21622 21297 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 8 0 658253272 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21636] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21636/stat : 21636 (python) S 21620 21622 21297 0 -1 4202560 25 933 0 0 0 0 0 0 22 0 8 0 658253273 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21639] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21639/stat : 21639 (python) S 21620 21622 21297 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 8 0 658253274 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21645] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21645/stat : 21645 (python) S 21620 21622 21297 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 8 0 658263294 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21668] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21668/stat : 21668 (python) S 21620 21622 21297 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 8 0 658312179 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21674] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21674/stat : 21674 (python) S 21620 21622 21297 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 8 0 658321690 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4785.9
Current children cumulated vsize (KiB) 3223784

[startup+1200.7 s]
/proc/loadavg: 4.25 5.71 6.27 5/265 21797
/proc/meminfo: memFree=22265516/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=351748 CPUtime=0.79 cores=1,3,5,7
/proc/21622/stat : 21622 (python) S 21620 21622 21297 0 -1 4202496 15364 933 1 0 64 15 0 0 18 0 8 0 658253171 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 2 18446744073709551615 0 0 17 3 0 0 0
/proc/21622/statm: 87937 7460 1888 364 0 23837 0
[pid=21629] ppid=21622 vsize=289884 CPUtime=1.83 cores=1,3,5,7
/proc/21629/stat : 21629 (python) S 21622 21622 21297 0 -1 4202560 1199 0 0 0 90 93 0 0 18 0 2 0 658253271 296841216 5915 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/21629/statm: 72471 5915 416 364 0 8389 0
[pid=21631] ppid=21629 vsize=19576 CPUtime=1002.33 cores=1,3,5,7
/proc/21631/stat : 21631 (lingeling) R 21629 21631 21631 0 -1 4202496 37084 0 0 0 100228 5 0 0 25 0 1 0 658253271 20045824 4093 33554432000 4194304 4352236 140736041492848 18446744073709551615 4328090 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/21631/statm: 4894 4093 128 39 0 3974 0
[pid=21629/tid=21665] ppid=21622 vsize=289884 CPUtime=0 cores=1,3,5,7
/proc/21629/task/21665/stat : 21665 (python) S 21622 21622 21297 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 658311971 296841216 5915 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 514 18446604471147868480 0 0 -1 5 0 0 0
[pid=21632] ppid=21622 vsize=289896 CPUtime=1.14 cores=1,3,5,7
/proc/21632/stat : 21632 (python) S 21622 21622 21297 0 -1 4202560 1152 0 0 0 60 54 0 0 16 0 2 0 658253272 296853504 5899 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/21632/statm: 72474 5899 400 364 0 8389 0
[pid=21634] ppid=21632 vsize=236556 CPUtime=584.18 cores=1,3,5,7
/proc/21634/stat : 21634 (cryptominisat-2) T 21632 21634 21634 0 -1 4202496 208076 0 0 0 58366 52 0 0 25 0 1 0 658253272 242233344 38133 33554432000 4194304 4677096 140735613796000 18446744073709551615 4319571 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/21634/statm: 59139 38133 392 118 0 54098 0
[pid=21632/tid=21666] ppid=21622 vsize=289896 CPUtime=0 cores=1,3,5,7
/proc/21632/task/21666/stat : 21666 (python) S 21622 21622 21297 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 658312178 296853504 5899 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 514 18446604464218834176 0 0 -1 5 0 0 0
[pid=21635] ppid=21622 vsize=300152 CPUtime=2.22 cores=1,3,5,7
/proc/21635/stat : 21635 (python) S 21622 21622 21297 0 -1 4202560 959 0 0 0 117 105 0 0 18 0 1 0 658253273 307355648 5873 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 7573840712400077061 0 0 17 3 0 0 0
/proc/21635/statm: 75038 5873 371 364 0 10950 0
[pid=21637] ppid=21635 vsize=25244 CPUtime=1195.16 cores=1,3,5,7
/proc/21637/stat : 21637 (lingeling) R 21635 21637 21637 0 -1 4202496 42793 0 0 0 119509 7 0 0 25 0 1 0 658253273 25849856 5512 33554432000 4194304 4352236 140736411564864 18446744073709551615 4328026 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/21637/statm: 6311 5512 129 39 0 5391 0
[pid=21638] ppid=21622 vsize=310408 CPUtime=0.37 cores=1,3,5,7
/proc/21638/stat : 21638 (python) S 21622 21622 21297 0 -1 4202560 1132 0 0 0 19 18 0 0 18 0 2 0 658253274 317857792 5907 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/21638/statm: 77602 5907 400 364 0 13511 0
[pid=21640] ppid=21638 vsize=14588 CPUtime=196.97 cores=1,3,5,7
/proc/21640/stat : 21640 (lingeling) T 21638 21640 21640 0 -1 4202496 12176 0 0 0 19696 1 0 0 25 0 1 0 658253274 14938112 2848 33554432000 4194304 4352236 140733364673712 18446744073709551615 4329043 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/21640/statm: 3647 2848 129 39 0 2727 0
[pid=21638/tid=21643] ppid=21622 vsize=310408 CPUtime=0 cores=1,3,5,7
/proc/21638/task/21643/stat : 21643 (python) S 21622 21622 21297 0 -1 4202560 48 0 0 0 0 0 0 0 18 0 2 0 658263293 317857792 5907 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 514 18446604471142503680 0 0 -1 3 0 0 0
[pid=21644] ppid=21622 vsize=320664 CPUtime=2.09 cores=1,3,5,7
/proc/21644/stat : 21644 (python) S 21622 21622 21297 0 -1 4202560 999 0 0 0 111 98 0 0 15 0 1 0 658263294 328359936 5881 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 7573840712400077063 0 0 17 3 0 0 0
/proc/21644/statm: 80166 5881 371 364 0 16072 0
[pid=21646] ppid=21644 vsize=319128 CPUtime=1092.11 cores=1,3,5,7
/proc/21646/stat : 21646 (cryptominisat-2) R 21644 21646 21646 0 -1 4202496 316230 0 0 0 109097 114 0 0 25 0 1 0 658263294 326787072 56573 33554432000 4194304 4677096 140733223883920 18446744073709551615 4318902 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/21646/statm: 79782 56573 392 118 0 74741 0
[pid=21667] ppid=21622 vsize=331248 CPUtime=1.12 cores=1,3,5,7
/proc/21667/stat : 21667 (python) S 21622 21622 21297 0 -1 4202560 977 0 0 0 60 52 0 0 18 0 1 0 658312179 339197952 5935 33554432000 4194304 5683644 140736821828752 18446744073709551615 222921797190 0 0 16781312 514 7573840712400077061 0 0 17 3 0 0 0
/proc/21667/statm: 82812 5935 371 364 0 18715 0
[pid=21669] ppid=21667 vsize=49760 CPUtime=609.16 cores=1,3,5,7
/proc/21669/stat : 21669 (precosat) R 21667 21669 21669 0 -1 4202496 12743 0 0 0 60909 7 0 0 25 0 1 0 658312179 50954240 12241 33554432000 4194304 4890832 140736373262016 18446744073709551615 4238673 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/21669/statm: 12440 12241 86 171 0 12267 0
[pid=21673] ppid=21622 vsize=341504 CPUtime=0.19 cores=1,3,5,7
/proc/21673/stat : 21673 (python) S 21622 21622 21297 0 -1 4202560 1088 0 0 0 10 9 0 0 19 0 2 0 658321690 349700096 5969 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933603787 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/21673/statm: 85376 5969 400 364 0 21276 0
[pid=21675] ppid=21673 vsize=23428 CPUtime=99.43 cores=1,3,5,7
/proc/21675/stat : 21675 (precosat) T 21673 21675 21675 0 -1 4202496 5970 0 0 0 9941 2 0 0 25 0 1 0 658321690 23990272 5703 33554432000 4194304 4890832 140735958416960 18446744073709551615 4238594 0 0 16781312 17442 18446744071562691360 0 0 17 3 0 0 0
/proc/21675/statm: 5857 5703 86 171 0 5684 0
[pid=21673/tid=21713] ppid=21622 vsize=341504 CPUtime=0 cores=1,3,5,7
/proc/21673/task/21713/stat : 21713 (python) S 21622 21622 21297 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 658331709 349700096 5969 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 514 18446604459957154048 0 0 -1 3 0 0 0
[pid=21622/tid=21630] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21630/stat : 21630 (python) S 21620 21622 21297 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 8 0 658253271 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21633] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21633/stat : 21633 (python) S 21620 21622 21297 0 -1 4202560 24 933 0 0 0 0 0 0 20 0 8 0 658253272 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 5 0 0 0
[pid=21622/tid=21636] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21636/stat : 21636 (python) S 21620 21622 21297 0 -1 4202560 25 933 0 0 0 0 0 0 22 0 8 0 658253273 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21639] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21639/stat : 21639 (python) S 21620 21622 21297 0 -1 4202560 31 933 0 0 0 0 0 0 18 0 8 0 658253274 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21645] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21645/stat : 21645 (python) S 21620 21622 21297 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 8 0 658263294 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21668] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21668/stat : 21668 (python) S 21620 21622 21297 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 8 0 658312179 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
[pid=21622/tid=21674] ppid=21620 vsize=351748 CPUtime=0 cores=1,3,5,7
/proc/21622/task/21674/stat : 21674 (python) S 21620 21622 21297 0 -1 4202560 29 933 0 0 0 0 0 0 20 0 8 0 658321690 360189952 7460 33554432000 4194304 5683644 140736821828752 18446744073709551615 222933600689 0 0 16781312 2 18446604464218835968 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4789.09
Current children cumulated vsize (KiB) 3223784

[startup+1201.1 s]
/proc/loadavg: 4.25 5.71 6.27 2/241 21798
/proc/meminfo: memFree=22790972/32951124 swapFree=61559568/67111528
[pid=21622] ppid=21620 vsize=0 CPUtime=4790.74 cores=1,3,5,7
/proc/21622/stat : 21622 (python) Z 21620 21622 21297 0 -1 4202524 19618 643803 1 0 66 15 478364 629 17 0 1 0 658253171 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/21622/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 4790.74
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 1201.11
CPU time (s): 4790.76
CPU user time (s): 4784.31
CPU system time (s): 6.45202
CPU usage (%): 398.861
Max. virtual memory (cumulated for all children) (KiB): 3226600

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4784.31
system time used= 6.45202
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 663421
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8669
involuntary context switches= 25908

runsolver used 3.24151 second user time and 7.15391 second system time

The end

Launcher Data 

Begin job on node109 at 2011-05-15 15:35:24
IDJOB=3378980
IDBENCH=83421
IDSOLVER=1860
FILE ID=node109/3378980-1305466524
RUNJOBID= node109-1305465319-21316
PBS_JOBID= 13325058
Free space on /tmp= 73232 MiB

SOLVER NAME= borg-sat 11.03.02-par-industrial (fixed)
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/64/aes_64_3_keyfind_1.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378980-1305466524/watcher-3378980-1305466524 -o /tmp/evaluation-result-3378980-1305466524/solver-3378980-1305466524 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3378980-1305466524.cnf -seed 1051148951 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4738c3d0ccd52030cff8addcec6bcde9
RANDOM SEED=1051148951

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21217680 kB
Buffers:        275132 kB
Cached:        2608648 kB
SwapCached:      28404 kB
Active:        3004456 kB
Inactive:      8492700 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21217680 kB
SwapTotal:    67111528 kB
SwapFree:     61559568 kB
Dirty:           31900 kB
Writeback:           0 kB
AnonPages:     8591404 kB
Mapped:          24820 kB
Slab:           133460 kB
PageTables:      40484 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 21407972 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73236 MiB
End job on node109 at 2011-05-15 15:55:25