Trace number 3317766

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 4800.06 1252.37

General information on the benchmark

Nameibm-2002-30r-k85.cnf
MD5SUMc08fe2d9c476652207ada677b7ca59f9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark42.9815
Satisfiable
(Un)Satisfiability was proved
Number of variables181484
Number of clauses890298
Sum of the clauses size2338581
Maximum clause length19
Minimum clause length1
Number of clauses of size 1771
Number of clauses of size 2667172
Number of clauses of size 3144951
Number of clauses of size 424791
Number of clauses of size 511035
Number of clauses of size over 541578

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.35/0.67	c INFO: solving HOME/instance-3317766-1304267339.cnf
0.35/0.67	c INFO: computing task features
3.31/3.63	c INFO: computed variable-clause graph statistics
3.41/3.75	c INFO: computed clause balance statistics
17.41/17.76	c INFO: computed variable balance statistics
27.22/27.58	c INFO: computed small-clause counts
27.41/27.76	c INFO: computed Horn-clause counts
65.52/65.81	c INFO: computed variable graph statistics
65.52/65.81	c INFO: collected features for HOME/instance-3317766-1304267339.cnf in 65.03 s
65.52/65.83	c INFO: running SApperloT@0 for 97 with 4734 remaining (b = 0.11)
65.52/65.86	c INFO: running lingeling-276@0 for 97 with 4734 remaining (b = 0.15)
65.52/65.89	c INFO: running cryptominisat-2.9.0@0 for 485 with 4734 remaining (b = 0.18)
65.67/65.92	c INFO: running lingeling-276@0 for 1261 with 4734 remaining (b = 0.31)
465.05/165.99	c INFO: running cryptominisat-2.9.0@0 for 679 with 4634 remaining (b = 0.17)
465.47/166.02	c INFO: running lingeling-276@0 for 970 with 4634 remaining (b = 0.21)
2012.77/553.42	c INFO: running cryptominisat-2.9.0@0 for 97 with 4247 remaining (b = 0.06)
2419.69/655.35	c INFO: running precosat-570@0 for 388 with 4145 remaining (b = 0.11)
3204.25/851.86	c INFO: running lingeling-276@0 for 97 with 3948 remaining (b = 0.04)
3603.51/952.03	c INFO: running cryptominisat-2.9.0@0 for 1843 with 3848 remaining (b = 0.36)
3993.18/1049.85	c INFO: running cryptominisat-2.9.0@101 for 1843 with 3750 remaining (b = 0.33)
4345.01/1138.19	c INFO: running precosat-570@679 for 97 with 3662 remaining (b = 0.03)
4732.37/1235.35	c INFO: running precosat-570@0 for 97 with 3565 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3317766-1304267339/watcher-3317766-1304267339 -o /tmp/evaluation-result-3317766-1304267339/solver-3317766-1304267339 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317766-1304267339.cnf -seed 867666104 -budget 4800 -cores 4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.67 0.49 0.17 2/175 10003
/proc/meminfo: memFree=30254744/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/10003/stat : 10003 (python) R 10001 10003 9915 0 -1 4202496 734 0 0 0 0 0 0 0 20 0 1 0 538333616 15548416 622 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664804197 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10003/statm: 3796 622 322 364 0 283 0

[startup+0.0151529 s]
/proc/loadavg: 1.67 0.49 0.17 2/175 10003
/proc/meminfo: memFree=30254744/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=15908 CPUtime=0 cores=1,3,5,7
/proc/10003/stat : 10003 (python) S 10001 10003 9915 0 -1 4202496 959 0 0 0 0 0 0 0 20 0 1 0 538333616 16289792 834 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664806400 0 2147483391 16781312 2 18446744071699109054 0 0 17 7 0 0 0
/proc/10003/statm: 3977 834 357 364 0 464 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15908

[startup+0.101155 s]
/proc/loadavg: 1.67 0.49 0.17 2/175 10003
/proc/meminfo: memFree=30254744/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=91828 CPUtime=0.06 cores=1,3,5,7
/proc/10003/stat : 10003 (python) S 10001 10003 9915 0 -1 4202496 2679 0 0 0 4 2 0 0 17 0 1 0 538333616 94031872 2394 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664806400 0 2147483391 16781312 2 18446744071699109054 0 0 17 7 0 0 0
/proc/10003/statm: 22957 2394 755 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 91828

[startup+0.300102 s]
/proc/loadavg: 1.67 0.49 0.17 2/175 10003
/proc/meminfo: memFree=30254744/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=135748 CPUtime=0.18 cores=1,3,5,7
/proc/10003/stat : 10003 (python) S 10001 10003 9915 0 -1 4202496 5965 935 1 0 13 5 0 0 17 0 1 0 538333616 139005952 4150 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664804357 0 2147483391 16781312 2 18446744071699109054 0 0 17 7 0 0 0
/proc/10003/statm: 33937 4150 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 135748

[startup+0.701032 s]
/proc/loadavg: 1.67 0.49 0.17 2/175 10003
/proc/meminfo: memFree=30254744/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=297052 CPUtime=0.41 cores=1,3,5,7
/proc/10003/stat : 10003 (python) R 10001 10003 9915 0 -1 4202496 13908 935 1 0 30 11 0 0 16 0 1 0 538333616 304181248 11588 33554432000 4194304 5683644 140736378815568 18446744073709551615 4421962 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/10003/statm: 74263 11588 1761 364 0 10187 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 297052

[startup+1.50093 s]
/proc/loadavg: 1.67 0.49 0.17 3/176 10008
/proc/meminfo: memFree=30194596/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=350424 CPUtime=1.21 cores=1,3,5,7
/proc/10003/stat : 10003 (python) R 10001 10003 9915 0 -1 4202496 27046 935 1 0 107 14 0 0 17 0 1 0 538333616 358834176 24726 33554432000 4194304 5683644 140736378815568 18446744073709551615 4960212 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10003/statm: 87606 24727 1761 364 0 23530 0
Current children cumulated CPU time (s) 1.21
Current children cumulated vsize (KiB) 350424

[startup+3.10065 s]
/proc/loadavg: 1.67 0.49 0.17 3/176 10008
/proc/meminfo: memFree=30119824/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=446780 CPUtime=2.81 cores=1,3,5,7
/proc/10003/stat : 10003 (python) R 10001 10003 9915 0 -1 4202496 50537 935 1 0 264 17 0 0 19 0 1 0 538333616 457502720 48217 33554432000 4194304 5683644 140736378815568 18446744073709551615 4458822 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10003/statm: 111695 48218 1761 364 0 47619 0
Current children cumulated CPU time (s) 2.81
Current children cumulated vsize (KiB) 446780

[startup+6.3011 s]
/proc/loadavg: 1.78 0.54 0.18 3/176 10008
/proc/meminfo: memFree=30028808/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=471936 CPUtime=6.01 cores=1,3,5,7
/proc/10003/stat : 10003 (python) R 10001 10003 9915 0 -1 4202496 79828 935 1 0 580 21 0 0 25 0 1 0 538333616 483262464 55369 33554432000 4194304 5683644 140736378815568 18446744073709551615 47157607892696 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10003/statm: 117984 55369 1826 364 0 53908 0
Current children cumulated CPU time (s) 6.01
Current children cumulated vsize (KiB) 471936

[startup+12.701 s]
/proc/loadavg: 1.87 0.58 0.20 3/176 10008
/proc/meminfo: memFree=30028992/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=471936 CPUtime=12.41 cores=1,3,5,7
/proc/10003/stat : 10003 (python) R 10001 10003 9915 0 -1 4202496 79828 935 1 0 1220 21 0 0 25 0 1 0 538333616 483262464 55369 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664475520 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10003/statm: 117984 55369 1826 364 0 53908 0
Current children cumulated CPU time (s) 12.41
Current children cumulated vsize (KiB) 471936

[startup+25.5008 s]
/proc/loadavg: 1.97 0.66 0.23 3/176 10009
/proc/meminfo: memFree=30030608/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=471936 CPUtime=25.21 cores=1,3,5,7
/proc/10003/stat : 10003 (python) R 10001 10003 9915 0 -1 4202496 79829 935 1 0 2500 21 0 0 25 0 1 0 538333616 483262464 55370 33554432000 4194304 5683644 140736378815568 18446744073709551615 274668217013 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10003/statm: 117984 55370 1827 364 0 53908 0
Current children cumulated CPU time (s) 25.21
Current children cumulated vsize (KiB) 471936

[startup+51.1003 s]
/proc/loadavg: 1.98 0.77 0.28 3/176 10009
/proc/meminfo: memFree=30031376/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=471936 CPUtime=50.81 cores=1,3,5,7
/proc/10003/stat : 10003 (python) R 10001 10003 9915 0 -1 4202496 79835 935 1 0 5060 21 0 0 25 0 1 0 538333616 483262464 55376 33554432000 4194304 5683644 140736378815568 18446744073709551615 47157607848076 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10003/statm: 117984 55376 1833 364 0 53908 0
Current children cumulated CPU time (s) 50.81
Current children cumulated vsize (KiB) 471936

[startup+102.307 s]
/proc/loadavg: 4.50 1.57 0.57 9/200 10035
/proc/meminfo: memFree=28694728/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=498072 CPUtime=65.64 cores=1,3,5,7
/proc/10003/stat : 10003 (python) S 10001 10003 9915 0 -1 4202496 82539 935 1 0 6540 24 0 0 19 0 5 0 538333616 510025728 51715 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/10003/statm: 124518 51715 1881 364 0 60427 0
[pid=10011] ppid=10003 vsize=457060 CPUtime=0.05 cores=1,3,5,7
/proc/10011/stat : 10011 (python) S 10003 10003 9915 0 -1 4202560 997 0 0 0 2 3 0 0 18 0 1 0 538340200 468029440 50200 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828431 0 0 16781312 514 13361441222594363655 0 0 17 5 0 0 0
/proc/10011/statm: 114265 50200 382 364 0 50183 0
[pid=10013] ppid=10011 vsize=73932 CPUtime=36.24 cores=1,3,5,7
/proc/10013/stat : 10013 (SApperloT-base) R 10011 10013 10013 0 -1 4202496 17819 0 0 0 3618 6 0 0 25 0 1 0 538340201 75706368 17328 33554432000 134512640 135674940 4291220288 18446744073709551615 134552139 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10013/statm: 18483 17328 100 284 0 18197 0
[pid=10014] ppid=10003 vsize=467316 CPUtime=0.04 cores=1,3,5,7
/proc/10014/stat : 10014 (python) S 10003 10003 9915 0 -1 4202560 917 0 0 0 2 2 0 0 18 0 1 0 538340203 478531584 50192 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 13361441222594363653 0 0 17 1 0 0 0
/proc/10014/statm: 116829 50192 370 364 0 52744 0
[pid=10016] ppid=10014 vsize=76824 CPUtime=36.42 cores=1,3,5,7
/proc/10016/stat : 10016 (lingeling) R 10014 10016 10016 0 -1 4202496 29169 0 0 0 3638 4 0 0 25 0 1 0 538340204 78667776 18376 33554432000 4194304 4352236 140735920756736 18446744073709551615 4233979 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/10016/statm: 19206 18376 129 39 0 18286 0
[pid=10017] ppid=10003 vsize=477572 CPUtime=0.06 cores=1,3,5,7
/proc/10017/stat : 10017 (python) S 10003 10003 9915 0 -1 4202560 927 0 0 0 3 3 0 0 15 0 1 0 538340206 489033728 50196 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 13361441222594363655 0 0 17 1 0 0 0
/proc/10017/statm: 119393 50196 370 364 0 55305 0
[pid=10019] ppid=10017 vsize=507820 CPUtime=36.3 cores=1,3,5,7
/proc/10019/stat : 10019 (cryptominisat-2) R 10017 10019 10019 0 -1 4202496 128495 0 0 0 3610 20 0 0 25 0 1 0 538340206 520007680 114810 33554432000 4194304 4677096 140734688065616 18446744073709551615 4501224 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10019/statm: 126955 114810 394 118 0 121914 0
[pid=10020] ppid=10003 vsize=487828 CPUtime=0.04 cores=1,3,5,7
/proc/10020/stat : 10020 (python) S 10003 10003 9915 0 -1 4202560 946 0 0 0 2 2 0 0 18 0 1 0 538340208 499535872 50200 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 13361441222594363653 0 0 17 5 0 0 0
/proc/10020/statm: 121957 50200 370 364 0 57866 0
[pid=10022] ppid=10020 vsize=78900 CPUtime=36.26 cores=1,3,5,7
/proc/10022/stat : 10022 (lingeling) R 10020 10022 10022 0 -1 4202496 28665 0 0 0 3621 5 0 0 25 0 1 0 538340209 80793600 17872 33554432000 4194304 4352236 140733849662704 18446744073709551615 4233979 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/10022/statm: 19725 17872 129 39 0 18805 0
[pid=10003/tid=10012] ppid=10001 vsize=498072 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10012/stat : 10012 (python) S 10001 10003 9915 0 -1 4202560 24 935 0 0 0 0 0 0 19 0 5 0 538340201 510025728 51715 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 3 0 0 0
[pid=10003/tid=10015] ppid=10001 vsize=498072 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10015/stat : 10015 (python) S 10001 10003 9915 0 -1 4202560 20 935 0 0 0 0 0 0 21 0 5 0 538340203 510025728 51715 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 1 0 0 0
[pid=10003/tid=10018] ppid=10001 vsize=498072 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10018/stat : 10018 (python) S 10001 10003 9915 0 -1 4202560 22 935 0 0 0 0 0 0 23 0 5 0 538340206 510025728 51715 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 1 0 0 0
[pid=10003/tid=10021] ppid=10001 vsize=498072 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10021/stat : 10021 (python) S 10001 10003 9915 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 5 0 538340209 510025728 51715 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 211.05
Current children cumulated vsize (KiB) 3125324

[startup+162.301 s]
/proc/loadavg: 6.71 2.74 1.03 9/200 10036
/proc/meminfo: memFree=28514872/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=498072 CPUtime=65.64 cores=1,3,5,7
/proc/10003/stat : 10003 (python) S 10001 10003 9915 0 -1 4202496 82539 935 1 0 6540 24 0 0 19 0 5 0 538333616 510025728 51715 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 5 0 0 0
/proc/10003/statm: 124518 51715 1881 364 0 60427 0
[pid=10011] ppid=10003 vsize=457060 CPUtime=0.12 cores=1,3,5,7
/proc/10011/stat : 10011 (python) S 10003 10003 9915 0 -1 4202560 1020 0 0 0 6 6 0 0 18 0 1 0 538340200 468029440 50200 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828431 0 0 16781312 514 13361441222594363655 0 0 17 5 0 0 0
/proc/10011/statm: 114265 50200 382 364 0 50183 0
[pid=10013] ppid=10011 vsize=135356 CPUtime=95.91 cores=1,3,5,7
/proc/10013/stat : 10013 (SApperloT-base) R 10011 10013 10013 0 -1 4202496 33205 0 0 0 9576 15 0 0 25 0 1 0 538340201 138604544 32585 33554432000 134512640 135674940 4291220288 18446744073709551615 134564017 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10013/statm: 33839 32585 100 284 0 33553 0
[pid=10014] ppid=10003 vsize=467316 CPUtime=0.12 cores=1,3,5,7
/proc/10014/stat : 10014 (python) S 10003 10003 9915 0 -1 4202560 940 0 0 0 6 6 0 0 18 0 1 0 538340203 478531584 50192 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 13361441222594363653 0 0 17 1 0 0 0
/proc/10014/statm: 116829 50192 370 364 0 52744 0
[pid=10016] ppid=10014 vsize=76712 CPUtime=96.41 cores=1,3,5,7
/proc/10016/stat : 10016 (lingeling) R 10014 10016 10016 0 -1 4202496 30091 0 0 0 9637 4 0 0 25 0 1 0 538340204 78553088 18348 33554432000 4194304 4352236 140735920756736 18446744073709551615 4241534 0 0 16781312 17506 0 0 0 17 3 0 0 0
/proc/10016/statm: 19178 18348 129 39 0 18258 0
[pid=10017] ppid=10003 vsize=477572 CPUtime=0.15 cores=1,3,5,7
/proc/10017/stat : 10017 (python) S 10003 10003 9915 0 -1 4202560 949 0 0 0 8 7 0 0 15 0 1 0 538340206 489033728 50196 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 9052332012332876039 0 0 17 1 0 0 0
/proc/10017/statm: 119393 50196 370 364 0 55305 0
[pid=10019] ppid=10017 vsize=551732 CPUtime=96.13 cores=1,3,5,7
/proc/10019/stat : 10019 (cryptominisat-2) R 10017 10019 10019 0 -1 4202496 138496 0 0 0 9590 23 0 0 25 0 1 0 538340206 564973568 124775 33554432000 4194304 4677096 140734688065616 18446744073709551615 4346664 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10019/statm: 137933 124775 394 118 0 132892 0
[pid=10020] ppid=10003 vsize=487828 CPUtime=0.12 cores=1,3,5,7
/proc/10020/stat : 10020 (python) S 10003 10003 9915 0 -1 4202560 966 0 0 0 6 6 0 0 18 0 1 0 538340208 499535872 50200 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 13361441222594363653 0 0 17 5 0 0 0
/proc/10020/statm: 121957 50200 370 364 0 57866 0
[pid=10022] ppid=10020 vsize=78772 CPUtime=96.07 cores=1,3,5,7
/proc/10022/stat : 10022 (lingeling) R 10020 10022 10022 0 -1 4202496 29586 0 0 0 9602 5 0 0 25 0 1 0 538340209 80662528 17840 33554432000 4194304 4352236 140733849662704 18446744073709551615 4329086 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/10022/statm: 19693 17840 129 39 0 18773 0
[pid=10003/tid=10012] ppid=10001 vsize=498072 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10012/stat : 10012 (python) S 10001 10003 9915 0 -1 4202560 24 935 0 0 0 0 0 0 19 0 5 0 538340201 510025728 51715 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 3 0 0 0
[pid=10003/tid=10015] ppid=10001 vsize=498072 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10015/stat : 10015 (python) S 10001 10003 9915 0 -1 4202560 20 935 0 0 0 0 0 0 21 0 5 0 538340203 510025728 51715 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 1 0 0 0
[pid=10003/tid=10018] ppid=10001 vsize=498072 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10018/stat : 10018 (python) S 10001 10003 9915 0 -1 4202560 22 935 0 0 0 0 0 0 23 0 5 0 538340206 510025728 51715 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 1 0 0 0
[pid=10003/tid=10021] ppid=10001 vsize=498072 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10021/stat : 10021 (python) S 10001 10003 9915 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 5 0 538340209 510025728 51715 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 450.67
Current children cumulated vsize (KiB) 3230420


################
# More data... #
################

/proc/10038/statm: 124521 50235 400 364 0 60427 0
[pid=10041] ppid=10038 vsize=607572 CPUtime=680.41 cores=1,3,5,7
/proc/10041/stat : 10041 (cryptominisat-2) T 10038 10041 10041 0 -1 4202496 240580 0 0 0 67986 55 0 0 25 0 1 0 538350217 622153728 139834 33554432000 4194304 4677096 140736774679792 18446744073709551615 274664505019 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/10041/statm: 151893 139834 395 118 0 146852 0
[pid=10038/tid=10082] ppid=10003 vsize=498084 CPUtime=0 cores=1,3,5,7
/proc/10038/task/10082/stat : 10082 (python) S 10003 10003 9915 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 538418800 510038016 50235 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 514 18446604471147831552 0 0 -1 7 0 0 0
[pid=10059] ppid=10003 vsize=508340 CPUtime=0.49 cores=1,3,5,7
/proc/10059/stat : 10059 (python) S 10003 10003 9915 0 -1 4202560 1188 0 0 0 24 25 0 0 15 0 2 0 538388958 520540160 50238 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10059/statm: 127085 50238 399 364 0 62988 0
[pid=10061] ppid=10059 vsize=579512 CPUtime=303.25 cores=1,3,5,7
/proc/10061/stat : 10061 (cryptominisat-2) R 10059 10061 10061 0 -1 4202496 179709 0 0 0 30292 33 0 0 25 0 1 0 538388959 593420288 133399 33554432000 4194304 4677096 140735859403872 18446744073709551615 4320231 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10061/statm: 144878 133399 395 118 0 139837 0
[pid=10059/tid=10068] ppid=10003 vsize=508340 CPUtime=0 cores=1,3,5,7
/proc/10059/task/10068/stat : 10068 (python) S 10003 10003 9915 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 538399149 520540160 50238 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 514 18446604471006128896 0 0 -1 5 0 0 0
[pid=10069] ppid=10003 vsize=518596 CPUtime=0.68 cores=1,3,5,7
/proc/10069/stat : 10069 (python) S 10003 10003 9915 0 -1 4202560 1164 0 0 0 36 32 0 0 18 0 2 0 538399152 531042304 50242 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10069/statm: 129649 50242 399 364 0 65549 0
[pid=10071] ppid=10069 vsize=210508 CPUtime=486.52 cores=1,3,5,7
/proc/10071/stat : 10071 (precosat) T 10069 10071 10071 0 -1 4202496 53720 0 0 0 48644 8 0 0 25 0 1 0 538399153 215560192 50617 33554432000 4194304 4890832 140734892385136 18446744073709551615 4238265 0 0 16781312 17442 18446744071562691360 0 0 17 7 0 0 0
/proc/10071/statm: 52627 50617 86 171 0 52454 0
[pid=10069/tid=10092] ppid=10003 vsize=518596 CPUtime=0 cores=1,3,5,7
/proc/10069/task/10092/stat : 10092 (python) S 10003 10003 9915 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538438600 531042304 50242 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 514 18446604471002704896 0 0 -1 7 0 0 0
[pid=10083] ppid=10003 vsize=528852 CPUtime=0.13 cores=1,3,5,7
/proc/10083/stat : 10083 (python) S 10003 10003 9915 0 -1 4202560 1163 0 0 0 6 7 0 0 19 0 2 0 538418803 541544448 50252 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10083/statm: 132213 50252 405 364 0 68110 0
[pid=10085] ppid=10083 vsize=76828 CPUtime=99.71 cores=1,3,5,7
/proc/10085/stat : 10085 (lingeling) T 10083 10085 10085 0 -1 4202496 30131 0 0 0 9967 4 0 0 25 0 1 0 538418804 78671872 18378 33554432000 4194304 4352236 140734185745968 18446744073709551615 4327857 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/10085/statm: 19207 18378 129 39 0 18287 0
[pid=10083/tid=10088] ppid=10003 vsize=528852 CPUtime=0 cores=1,3,5,7
/proc/10083/task/10088/stat : 10088 (python) S 10003 10003 9915 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538428817 541544448 50252 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 514 18446604463551198464 0 0 -1 5 0 0 0
[pid=10104] ppid=10003 vsize=539108 CPUtime=0.02 cores=1,3,5,7
/proc/10104/stat : 10104 (python) S 10003 10003 9915 0 -1 4202560 942 0 0 0 1 1 0 0 18 0 1 0 538457151 552046592 50220 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 13361441222594363656 0 0 17 7 0 0 0
/proc/10104/statm: 134777 50220 370 364 0 70671 0
[pid=10106] ppid=10104 vsize=209412 CPUtime=16.64 cores=1,3,5,7
/proc/10106/stat : 10106 (precosat) R 10104 10106 10106 0 -1 4202496 53429 0 0 0 1657 7 0 0 25 0 1 0 538457152 214437888 50320 33554432000 4194304 4890832 140736699512048 18446744073709551615 4238562 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/10106/statm: 52353 50320 86 171 0 52180 0
[pid=10003/tid=10012] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10012/stat : 10012 (python) S 10001 10003 9915 0 -1 4202560 24 935 0 0 0 0 0 0 19 0 10 0 538340201 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 3 0 0 0
[pid=10003/tid=10015] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10015/stat : 10015 (python) S 10001 10003 9915 0 -1 4202560 25 935 0 0 0 0 0 0 18 0 10 0 538340203 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 1 0 0 0
[pid=10003/tid=10018] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10018/stat : 10018 (python) S 10001 10003 9915 0 -1 4202560 28 935 0 0 0 0 0 0 18 0 10 0 538340206 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 1 0 0 0
[pid=10003/tid=10021] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10021/stat : 10021 (python) S 10001 10003 9915 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 10 0 538340209 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 5 0 0 0
[pid=10003/tid=10040] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10040/stat : 10040 (python) S 10001 10003 9915 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 10 0 538350217 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 7 0 0 0
[pid=10003/tid=10060] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10060/stat : 10060 (python) S 10001 10003 9915 0 -1 4202560 36 935 0 0 0 0 0 0 18 0 10 0 538388959 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 5 0 0 0
[pid=10003/tid=10070] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10070/stat : 10070 (python) S 10001 10003 9915 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 10 0 538399152 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 5 0 0 0
[pid=10003/tid=10084] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10084/stat : 10084 (python) S 10001 10003 9915 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 10 0 538418803 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 5 0 0 0
[pid=10003/tid=10105] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10105/stat : 10105 (python) S 10001 10003 9915 0 -1 4202560 29 935 0 0 0 0 0 0 20 0 10 0 538457152 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.06
Current children cumulated vsize (KiB) 7657856

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1252.3 s]
/proc/loadavg: 7.83 7.93 5.90 6/214 10138
/proc/meminfo: memFree=26707008/32951132 swapFree=67111356/67111528
[pid=10003] ppid=10001 vsize=549352 CPUtime=65.88 cores=1,3,5,7
/proc/10003/stat : 10003 (python) S 10001 10003 9915 0 -1 4202496 86714 935 1 0 6560 28 0 0 19 0 10 0 538333616 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676635083 0 0 16781312 2 18446744073709551615 0 0 17 7 0 0 0
/proc/10003/statm: 137338 51746 1892 364 0 73232 0
[pid=10011] ppid=10003 vsize=467304 CPUtime=0.13 cores=1,3,5,7
/proc/10011/stat : 10011 (python) S 10003 10003 9915 0 -1 4202560 1177 0 0 0 7 6 0 0 19 0 2 0 538340200 478519296 50238 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10011/statm: 116826 50238 415 364 0 52744 0
[pid=10013] ppid=10011 vsize=138920 CPUtime=99.56 cores=1,3,5,7
/proc/10013/stat : 10013 (SApperloT-base) T 10011 10013 10013 0 -1 4202496 34097 0 0 0 9941 15 0 0 25 0 1 0 538340201 142254080 33477 33554432000 134512640 135674940 4291220288 18446744073709551615 134551227 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/10013/statm: 34730 33477 100 284 0 34444 0
[pid=10011/tid=10037] ppid=10003 vsize=467304 CPUtime=0 cores=1,3,5,7
/proc/10011/task/10037/stat : 10037 (python) S 10003 10003 9915 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 538350214 478519296 50238 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 514 18446604471129755712 0 0 -1 7 0 0 0
[pid=10014] ppid=10003 vsize=467316 CPUtime=1.44 cores=1,3,5,7
/proc/10014/stat : 10014 (python) S 10003 10003 9915 0 -1 4202560 1156 0 0 0 71 73 0 0 18 0 2 0 538340203 478531584 50222 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/10014/statm: 116829 50222 399 364 0 52744 0
[pid=10016] ppid=10014 vsize=98092 CPUtime=1070.12 cores=1,3,5,7
/proc/10016/stat : 10016 (lingeling) T 10014 10016 10016 0 -1 4202496 40581 0 0 0 107006 6 0 0 25 0 1 0 538340204 100446208 23693 33554432000 4194304 4352236 140735920756736 18446744073709551615 4207597 0 0 16781312 17506 18446744071562691360 0 0 17 7 0 0 0
/proc/10016/statm: 24523 23693 129 39 0 23603 0
[pid=10014/tid=10039] ppid=10003 vsize=467316 CPUtime=0 cores=1,3,5,7
/proc/10014/task/10039/stat : 10039 (python) S 10003 10003 9915 0 -1 4202560 49 0 0 0 0 0 0 0 18 0 2 0 538350216 478531584 50222 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 514 18446604466642281536 0 0 -1 1 0 0 0
[pid=10017] ppid=10003 vsize=477572 CPUtime=1.19 cores=1,3,5,7
/proc/10017/stat : 10017 (python) S 10003 10003 9915 0 -1 4202560 1190 0 0 0 61 58 0 0 15 0 2 0 538340206 489033728 50227 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/10017/statm: 119393 50227 400 364 0 55305 0
[pid=10019] ppid=10017 vsize=606128 CPUtime=787.5 cores=1,3,5,7
/proc/10019/stat : 10019 (cryptominisat-2) R 10017 10019 10019 0 -1 4202496 262937 0 0 0 78686 64 0 0 25 0 1 0 538340206 620675072 139640 33554432000 4194304 4677096 140734688065616 18446744073709551615 4320150 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/10019/statm: 151532 139640 394 118 0 146491 0
[pid=10017/tid=10058] ppid=10003 vsize=477572 CPUtime=0 cores=1,3,5,7
/proc/10017/task/10058/stat : 10058 (python) S 10003 10003 9915 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 538388956 489033728 50227 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 514 18446604470987088320 0 0 -1 1 0 0 0
[pid=10020] ppid=10003 vsize=487828 CPUtime=1.61 cores=1,3,5,7
/proc/10020/stat : 10020 (python) S 10003 10003 9915 0 -1 4202560 1002 0 0 0 80 81 0 0 18 0 1 0 538340208 499535872 50200 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 13361441222594363653 0 0 17 5 0 0 0
/proc/10020/statm: 121957 50200 370 364 0 57866 0
[pid=10022] ppid=10020 vsize=88532 CPUtime=1183.75 cores=1,3,5,7
/proc/10022/stat : 10022 (lingeling) R 10020 10022 10022 0 -1 4202496 38186 0 0 0 118369 6 0 0 25 0 1 0 538340209 90656768 21303 33554432000 4194304 4352236 140733849662704 18446744073709551615 4328109 0 0 16781312 17506 0 0 0 17 1 0 0 0
/proc/10022/statm: 22133 21303 129 39 0 21213 0
[pid=10038] ppid=10003 vsize=498084 CPUtime=1.03 cores=1,3,5,7
/proc/10038/stat : 10038 (python) S 10003 10003 9915 0 -1 4202560 1196 0 0 0 54 49 0 0 16 0 2 0 538350216 510038016 50235 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/10038/statm: 124521 50235 400 364 0 60427 0
[pid=10041] ppid=10038 vsize=607572 CPUtime=680.41 cores=1,3,5,7
/proc/10041/stat : 10041 (cryptominisat-2) T 10038 10041 10041 0 -1 4202496 240580 0 0 0 67986 55 0 0 25 0 1 0 538350217 622153728 139834 33554432000 4194304 4677096 140736774679792 18446744073709551615 274664505019 0 0 16781312 2 18446744071562691360 0 0 17 7 0 0 0
/proc/10041/statm: 151893 139834 395 118 0 146852 0
[pid=10038/tid=10082] ppid=10003 vsize=498084 CPUtime=0 cores=1,3,5,7
/proc/10038/task/10082/stat : 10082 (python) S 10003 10003 9915 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 538418800 510038016 50235 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 514 18446604471147831552 0 0 -1 7 0 0 0
[pid=10059] ppid=10003 vsize=508340 CPUtime=0.49 cores=1,3,5,7
/proc/10059/stat : 10059 (python) S 10003 10003 9915 0 -1 4202560 1188 0 0 0 24 25 0 0 15 0 2 0 538388958 520540160 50238 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10059/statm: 127085 50238 399 364 0 62988 0
[pid=10061] ppid=10059 vsize=579512 CPUtime=303.25 cores=1,3,5,7
/proc/10061/stat : 10061 (cryptominisat-2) R 10059 10061 10061 0 -1 4202496 179709 0 0 0 30292 33 0 0 25 0 1 0 538388959 593420288 133399 33554432000 4194304 4677096 140735859403872 18446744073709551615 4320231 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/10061/statm: 144878 133399 395 118 0 139837 0
[pid=10059/tid=10068] ppid=10003 vsize=508340 CPUtime=0 cores=1,3,5,7
/proc/10059/task/10068/stat : 10068 (python) S 10003 10003 9915 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 538399149 520540160 50238 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 514 18446604471006128896 0 0 -1 5 0 0 0
[pid=10069] ppid=10003 vsize=518596 CPUtime=0.68 cores=1,3,5,7
/proc/10069/stat : 10069 (python) S 10003 10003 9915 0 -1 4202560 1164 0 0 0 36 32 0 0 18 0 2 0 538399152 531042304 50242 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10069/statm: 129649 50242 399 364 0 65549 0
[pid=10071] ppid=10069 vsize=210508 CPUtime=486.52 cores=1,3,5,7
/proc/10071/stat : 10071 (precosat) T 10069 10071 10071 0 -1 4202496 53720 0 0 0 48644 8 0 0 25 0 1 0 538399153 215560192 50617 33554432000 4194304 4890832 140734892385136 18446744073709551615 4238265 0 0 16781312 17442 18446744071562691360 0 0 17 7 0 0 0
/proc/10071/statm: 52627 50617 86 171 0 52454 0
[pid=10069/tid=10092] ppid=10003 vsize=518596 CPUtime=0 cores=1,3,5,7
/proc/10069/task/10092/stat : 10092 (python) S 10003 10003 9915 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 538438600 531042304 50242 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 514 18446604471002704896 0 0 -1 7 0 0 0
[pid=10083] ppid=10003 vsize=528852 CPUtime=0.13 cores=1,3,5,7
/proc/10083/stat : 10083 (python) S 10003 10003 9915 0 -1 4202560 1163 0 0 0 6 7 0 0 19 0 2 0 538418803 541544448 50252 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676635083 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/10083/statm: 132213 50252 405 364 0 68110 0
[pid=10085] ppid=10083 vsize=76828 CPUtime=99.71 cores=1,3,5,7
/proc/10085/stat : 10085 (lingeling) T 10083 10085 10085 0 -1 4202496 30131 0 0 0 9967 4 0 0 25 0 1 0 538418804 78671872 18378 33554432000 4194304 4352236 140734185745968 18446744073709551615 4327857 0 0 16781312 17506 18446744071562691360 0 0 17 5 0 0 0
/proc/10085/statm: 19207 18378 129 39 0 18287 0
[pid=10083/tid=10088] ppid=10003 vsize=528852 CPUtime=0 cores=1,3,5,7
/proc/10083/task/10088/stat : 10088 (python) S 10003 10003 9915 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 538428817 541544448 50252 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 514 18446604463551198464 0 0 -1 5 0 0 0
[pid=10104] ppid=10003 vsize=539108 CPUtime=0.02 cores=1,3,5,7
/proc/10104/stat : 10104 (python) S 10003 10003 9915 0 -1 4202560 942 0 0 0 1 1 0 0 18 0 1 0 538457151 552046592 50220 33554432000 4194304 5683644 140736378815568 18446744073709551615 274664828486 0 0 16781312 514 13361441222594363656 0 0 17 7 0 0 0
/proc/10104/statm: 134777 50220 370 364 0 70671 0
[pid=10106] ppid=10104 vsize=209412 CPUtime=16.64 cores=1,3,5,7
/proc/10106/stat : 10106 (precosat) R 10104 10106 10106 0 -1 4202496 53429 0 0 0 1657 7 0 0 25 0 1 0 538457152 214437888 50320 33554432000 4194304 4890832 140736699512048 18446744073709551615 4238562 0 0 16781312 17442 0 0 0 17 7 0 0 0
/proc/10106/statm: 52353 50320 86 171 0 52180 0
[pid=10003/tid=10012] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10012/stat : 10012 (python) S 10001 10003 9915 0 -1 4202560 24 935 0 0 0 0 0 0 19 0 10 0 538340201 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 3 0 0 0
[pid=10003/tid=10015] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10015/stat : 10015 (python) S 10001 10003 9915 0 -1 4202560 25 935 0 0 0 0 0 0 18 0 10 0 538340203 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 1 0 0 0
[pid=10003/tid=10018] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10018/stat : 10018 (python) S 10001 10003 9915 0 -1 4202560 28 935 0 0 0 0 0 0 18 0 10 0 538340206 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 1 0 0 0
[pid=10003/tid=10021] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10021/stat : 10021 (python) S 10001 10003 9915 0 -1 4202560 24 935 0 0 0 0 0 0 20 0 10 0 538340209 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 5 0 0 0
[pid=10003/tid=10040] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10040/stat : 10040 (python) S 10001 10003 9915 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 10 0 538350217 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 7 0 0 0
[pid=10003/tid=10060] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10060/stat : 10060 (python) S 10001 10003 9915 0 -1 4202560 36 935 0 0 0 0 0 0 18 0 10 0 538388959 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 5 0 0 0
[pid=10003/tid=10070] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10070/stat : 10070 (python) S 10001 10003 9915 0 -1 4202560 31 935 0 0 0 0 0 0 18 0 10 0 538399152 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 5 0 0 0
[pid=10003/tid=10084] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10084/stat : 10084 (python) S 10001 10003 9915 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 10 0 538418803 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 5 0 0 0
[pid=10003/tid=10105] ppid=10001 vsize=549352 CPUtime=0 cores=1,3,5,7
/proc/10003/task/10105/stat : 10105 (python) S 10001 10003 9915 0 -1 4202560 29 935 0 0 0 0 0 0 20 0 10 0 538457152 562536448 51746 33554432000 4194304 5683644 140736378815568 18446744073709551615 274676631985 0 0 16781312 2 18446604467078714368 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.06
Current children cumulated vsize (KiB) 7657856

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 10003 and gives
#  childrusage.ru_utime.tv_sec=65
#  childrusage.ru_utime.tv_usec=610025
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=290955
# CPU time returned by wait4() is 65.901
# while last known CPU time is 4800.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1252.37
CPU time (s): 4800.06
CPU user time (s): 4794.48
CPU system time (s): 5.58
CPU usage (%): 383.278
Max. virtual memory (cumulated for all children) (KiB): 7657872

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 65.61
system time used= 0.290955
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 87656
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2820
involuntary context switches= 193

runsolver used 3.2885 second user time and 8.13776 second system time

The end

Launcher Data 

Begin job on node131 at 2011-05-01 18:29:00
IDJOB=3317766
IDBENCH=69635
IDSOLVER=1706
FILE ID=node131/3317766-1304267339
RUNJOBID= node131-1304267281-9934
PBS_JOBID= 13173948
Free space on /tmp= 72176 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT_RACE08/cnf/ibm-2002-30r-k85.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3317766-1304267339/watcher-3317766-1304267339 -o /tmp/evaluation-result-3317766-1304267339/solver-3317766-1304267339 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3317766-1304267339.cnf -seed 867666104 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c08fe2d9c476652207ada677b7ca59f9
RANDOM SEED=867666104

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      30255032 kB
Buffers:        278080 kB
Cached:        1813580 kB
SwapCached:        168 kB
Active:         658108 kB
Inactive:      1720156 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      30255032 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:           72068 kB
Writeback:          28 kB
AnonPages:      286100 kB
Mapped:          20576 kB
Slab:           254512 kB
PageTables:       5640 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   433804 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72152 MiB
End job on node131 at 2011-05-01 18:49:54