Trace number 3377355

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-seq-random (fixed)? (MO) 704.47 704.083

General information on the benchmark

Namerandom/large/
unif-k7-r85-v200-c17000-S72668411-025-UNKNOWN.cnf
MD5SUMa7d53123c03c2abad4ab13635af690bf
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark132.864
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of clauses17000
Sum of the clauses size119000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 517000

Solver Data 

0.48/1.00	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.48/1.00	c INFO: solving HOME/instance-3377355-1305452663.cnf
0.48/1.00	c INFO: computing task features
0.59/1.13	c INFO: computed variable-clause graph statistics
0.59/1.13	c INFO: computed clause balance statistics
1.28/1.81	c INFO: computed variable balance statistics
2.17/2.73	c INFO: computed small-clause counts
2.17/2.73	c INFO: computed Horn-clause counts
2.17/2.73	c INFO: computed variable graph statistics
2.17/2.73	c INFO: collected features for HOME/instance-3377355-1305452663.cnf in 1.09 s
2.17/2.73	c INFO: running gnovelty+2@0 for 97 with 2398 remaining (b = 0.36)
101.95/102.47	c INFO: running gnovelty+2@0 for 97 with 2298 remaining (b = 0.12)
202.61/202.83	c INFO: running adaptg2wsat2009++@0 for 97 with 2198 remaining (b = 0.08)
302.20/302.15	c INFO: running adaptg2wsat2009++@0 for 97 with 2099 remaining (b = 0.07)
402.62/402.51	c INFO: running adaptg2wsat2009++@0 for 97 with 1999 remaining (b = 0.05)
502.95/502.87	c INFO: running gnovelty+2@0 for 97 with 1899 remaining (b = 0.04)
603.62/603.24	c INFO: running FH@0 for 97 with 1798 remaining (b = 0.03)
704.05/703.62	c INFO: running adaptg2wsat2009++@0 for 97 with 1698 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3377355-1305452663/watcher-3377355-1305452663 -o /tmp/evaluation-result-3377355-1305452663/solver-3377355-1305452663 -C 2400 -W 1300 -M 7680 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3377355-1305452663.cnf -seed 1861503481 -budget 2400 

running on 2 cores: 0,2

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.89 4.02 3.96 5/425 26241
/proc/meminfo: memFree=23971380/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=14384 CPUtime=0 cores=0,2
/proc/26241/stat : 26241 (python) R 26239 26241 24847 0 -1 4194304 228 0 0 0 0 0 0 0 25 0 1 0 735496987 14729216 162 33554432000 4194304 5683644 140736105093728 18446744073709551615 5103163 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/26241/statm: 3596 175 141 364 0 83 0

[startup+0.106313 s]
/proc/loadavg: 3.89 4.02 3.96 5/425 26241
/proc/meminfo: memFree=23971380/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=50016 CPUtime=0.05 cores=0,2
/proc/26241/stat : 26241 (python) S 26239 26241 24847 0 -1 4202496 1976 0 0 0 3 2 0 0 17 0 1 0 735496987 51216384 1738 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367544832 0 2147483391 16781312 2 18446744071699199166 0 0 17 0 0 0 0
/proc/26241/statm: 12504 1738 480 364 0 1204 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 50016

[startup+0.200288 s]
/proc/loadavg: 3.89 4.02 3.96 5/425 26241
/proc/meminfo: memFree=23971380/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=115432 CPUtime=0.11 cores=0,2
/proc/26241/stat : 26241 (python) S 26239 26241 24847 0 -1 4202496 3593 0 0 0 7 4 0 0 17 0 1 0 735496987 118202368 3236 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367544832 0 2147483391 16781312 2 18446744071699199166 0 0 17 0 0 0 0
/proc/26241/statm: 28858 3236 889 364 0 2359 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 115432

[startup+0.300272 s]
/proc/loadavg: 3.89 4.02 3.96 5/425 26241
/proc/meminfo: memFree=23971380/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=135588 CPUtime=0.19 cores=0,2
/proc/26241/stat : 26241 (python) R 26239 26241 24847 0 -1 4202496 5897 932 1 0 14 5 0 0 19 0 1 0 735496987 138842112 4133 33554432000 4194304 5683644 140736105093728 18446744073709551615 4570874 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/26241/statm: 33896 4132 1031 364 0 3082 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135588

[startup+0.700196 s]
/proc/loadavg: 3.89 4.02 3.96 5/425 26241
/proc/meminfo: memFree=23971380/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=135752 CPUtime=0.27 cores=0,2
/proc/26241/stat : 26241 (python) R 26239 26241 24847 0 -1 4202496 5971 932 1 0 18 9 0 0 15 0 1 0 735496987 139010048 4150 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367542789 0 2147483391 16781312 2 0 0 0 17 0 0 0 0
/proc/26241/statm: 33938 4150 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.27
Current children cumulated vsize (KiB) 135752

[startup+1.50112 s]
/proc/loadavg: 3.89 4.02 3.96 5/431 26256
/proc/meminfo: memFree=23919252/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=282560 CPUtime=0.98 cores=0,2
/proc/26241/stat : 26241 (python) R 26239 26241 24847 0 -1 4202496 11214 932 1 0 82 16 0 0 16 0 1 0 735496987 289341440 8052 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370836 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/26241/statm: 70640 8052 1826 364 0 6564 0
Current children cumulated CPU time (s) 0.98
Current children cumulated vsize (KiB) 282560

[startup+3.10081 s]
/proc/loadavg: 3.89 4.02 3.96 5/437 26262
/proc/meminfo: memFree=23913948/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=289440 CPUtime=1.59 cores=0,2
/proc/26241/stat : 26241 (python) S 26239 26241 24847 0 -1 4202496 11576 932 1 0 143 16 0 0 19 0 2 0 735496987 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26241/statm: 72360 7224 1869 364 0 8278 0
[pid=26260] ppid=26241 vsize=279196 CPUtime=0 cores=0,2
/proc/26260/stat : 26260 (python) S 26241 26241 24847 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 735497198 285896704 5705 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367566863 0 0 16781312 514 3920191890019844095 0 0 17 0 0 0 0
/proc/26260/statm: 69799 5705 354 364 0 5717 0
[pid=26262] ppid=26260 vsize=1018616 CPUtime=0.98 cores=0,2
/proc/26262/stat : 26262 (gnovelty+2) R 26260 26262 26262 0 -1 4202496 766 0 0 0 98 0 0 0 21 0 1 0 735497199 1043062784 500 33554432000 134512640 135663704 4288398144 18446744073709551615 134545576 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26262/statm: 254654 500 113 282 0 254370 0
[pid=26241/tid=26261] ppid=26239 vsize=289440 CPUtime=0 cores=0,2
/proc/26241/task/26261/stat : 26261 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 19 0 2 0 735497199 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.57
Current children cumulated vsize (KiB) 1587252

[startup+6.30116 s]
/proc/loadavg: 3.98 4.04 3.96 5/437 26262
/proc/meminfo: memFree=23916200/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=289440 CPUtime=1.59 cores=0,2
/proc/26241/stat : 26241 (python) S 26239 26241 24847 0 -1 4202496 11576 932 1 0 143 16 0 0 19 0 2 0 735496987 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26241/statm: 72360 7224 1869 364 0 8278 0
[pid=26260] ppid=26241 vsize=279196 CPUtime=0.02 cores=0,2
/proc/26260/stat : 26260 (python) S 26241 26241 24847 0 -1 4202560 963 0 0 0 1 1 0 0 18 0 1 0 735497198 285896704 5733 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367566863 0 0 16781312 514 3920191890019811587 0 0 17 0 0 0 0
/proc/26260/statm: 69799 5733 382 364 0 5717 0
[pid=26262] ppid=26260 vsize=1018616 CPUtime=4.16 cores=0,2
/proc/26262/stat : 26262 (gnovelty+2) R 26260 26262 26262 0 -1 4202496 766 0 0 0 416 0 0 0 25 0 1 0 735497199 1043062784 500 33554432000 134512640 135663704 4288398144 18446744073709551615 134524503 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26262/statm: 254654 500 113 282 0 254370 0
[pid=26241/tid=26261] ppid=26239 vsize=289440 CPUtime=0 cores=0,2
/proc/26241/task/26261/stat : 26261 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 19 0 2 0 735497199 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.77
Current children cumulated vsize (KiB) 1587252

[startup+12.701 s]
/proc/loadavg: 3.98 4.04 3.96 5/437 26262
/proc/meminfo: memFree=23914248/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=289440 CPUtime=1.59 cores=0,2
/proc/26241/stat : 26241 (python) S 26239 26241 24847 0 -1 4202496 11576 932 1 0 143 16 0 0 19 0 2 0 735496987 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26241/statm: 72360 7224 1869 364 0 8278 0
[pid=26260] ppid=26241 vsize=279196 CPUtime=0.03 cores=0,2
/proc/26260/stat : 26260 (python) S 26241 26241 24847 0 -1 4202560 964 0 0 0 1 2 0 0 18 0 1 0 735497198 285896704 5733 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367566863 0 0 16781312 514 3604375037710139651 0 0 17 0 0 0 0
/proc/26260/statm: 69799 5733 382 364 0 5717 0
[pid=26262] ppid=26260 vsize=1018616 CPUtime=10.54 cores=0,2
/proc/26262/stat : 26262 (gnovelty+2) R 26260 26262 26262 0 -1 4202496 766 0 0 0 1054 0 0 0 25 0 1 0 735497199 1043062784 500 33554432000 134512640 135663704 4288398144 18446744073709551615 134524894 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/26262/statm: 254654 500 113 282 0 254370 0
[pid=26241/tid=26261] ppid=26239 vsize=289440 CPUtime=0 cores=0,2
/proc/26241/task/26261/stat : 26261 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 19 0 2 0 735497199 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.16
Current children cumulated vsize (KiB) 1587252

[startup+25.5007 s]
/proc/loadavg: 4.06 4.05 3.97 5/437 26300
/proc/meminfo: memFree=23908816/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=289440 CPUtime=1.59 cores=0,2
/proc/26241/stat : 26241 (python) S 26239 26241 24847 0 -1 4202496 11576 932 1 0 143 16 0 0 19 0 2 0 735496987 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26241/statm: 72360 7224 1869 364 0 8278 0
[pid=26260] ppid=26241 vsize=279196 CPUtime=0.07 cores=0,2
/proc/26260/stat : 26260 (python) S 26241 26241 24847 0 -1 4202560 970 0 0 0 4 3 0 0 18 0 1 0 735497198 285896704 5733 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367566863 0 0 16781312 514 3604375037710139651 0 0 17 0 0 0 0
/proc/26260/statm: 69799 5733 382 364 0 5717 0
[pid=26262] ppid=26260 vsize=1018616 CPUtime=23.32 cores=0,2
/proc/26262/stat : 26262 (gnovelty+2) R 26260 26262 26262 0 -1 4202496 766 0 0 0 2332 0 0 0 25 0 1 0 735497199 1043062784 500 33554432000 134512640 135663704 4288398144 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26262/statm: 254654 500 113 282 0 254370 0
[pid=26241/tid=26261] ppid=26239 vsize=289440 CPUtime=0 cores=0,2
/proc/26241/task/26261/stat : 26261 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 19 0 2 0 735497199 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.98
Current children cumulated vsize (KiB) 1587252

[startup+51.1009 s]
/proc/loadavg: 4.04 4.04 3.97 5/437 26300
/proc/meminfo: memFree=23908648/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=289440 CPUtime=1.59 cores=0,2
/proc/26241/stat : 26241 (python) S 26239 26241 24847 0 -1 4202496 11576 932 1 0 143 16 0 0 19 0 2 0 735496987 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26241/statm: 72360 7224 1869 364 0 8278 0
[pid=26260] ppid=26241 vsize=279196 CPUtime=0.15 cores=0,2
/proc/26260/stat : 26260 (python) S 26241 26241 24847 0 -1 4202560 982 0 0 0 8 7 0 0 18 0 1 0 735497198 285896704 5733 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367566863 0 0 16781312 514 3604375037710139651 0 0 17 0 0 0 0
/proc/26260/statm: 69799 5733 382 364 0 5717 0
[pid=26262] ppid=26260 vsize=1018616 CPUtime=48.86 cores=0,2
/proc/26262/stat : 26262 (gnovelty+2) R 26260 26262 26262 0 -1 4202496 766 0 0 0 4886 0 0 0 25 0 1 0 735497199 1043062784 500 33554432000 134512640 135663704 4288398144 18446744073709551615 134524718 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26262/statm: 254654 500 113 282 0 254370 0
[pid=26241/tid=26261] ppid=26239 vsize=289440 CPUtime=0 cores=0,2
/proc/26241/task/26261/stat : 26261 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 19 0 2 0 735497199 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.6
Current children cumulated vsize (KiB) 1587252

[startup+102.301 s]
/proc/loadavg: 4.02 4.03 3.97 6/440 26306
/proc/meminfo: memFree=23879652/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=289440 CPUtime=1.59 cores=0,2
/proc/26241/stat : 26241 (python) S 26239 26241 24847 0 -1 4202496 11576 932 1 0 143 16 0 0 19 0 2 0 735496987 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26241/statm: 72360 7224 1869 364 0 8278 0
[pid=26260] ppid=26241 vsize=279196 CPUtime=0.31 cores=0,2
/proc/26260/stat : 26260 (python) S 26241 26241 24847 0 -1 4202560 1005 0 0 0 16 15 0 0 18 0 1 0 735497198 285896704 5733 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367566863 0 0 16781312 514 3604375037710139651 0 0 17 0 0 0 0
/proc/26260/statm: 69799 5733 382 364 0 5717 0
[pid=26262] ppid=26260 vsize=1018616 CPUtime=99.95 cores=0,2
/proc/26262/stat : 26262 (gnovelty+2) R 26260 26262 26262 0 -1 4202496 766 0 0 0 9995 0 0 0 25 0 1 0 735497199 1043062784 500 33554432000 134512640 135663704 4288398144 18446744073709551615 134524551 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26262/statm: 254654 500 113 282 0 254370 0
[pid=26241/tid=26261] ppid=26239 vsize=289440 CPUtime=0 cores=0,2
/proc/26241/task/26261/stat : 26261 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 19 0 2 0 735497199 296386560 7224 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.85
Current children cumulated vsize (KiB) 1587252

[startup+162.301 s]
/proc/loadavg: 3.95 4.01 3.96 5/431 26368
/proc/meminfo: memFree=23846720/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=299868 CPUtime=1.6 cores=0,2
/proc/26241/stat : 26241 (python) S 26239 26241 24847 0 -1 4202496 12458 932 1 0 144 16 0 0 20 0 3 0 735496987 307064832 7298 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26241/statm: 74967 7298 1880 364 0 10882 0
[pid=26260] ppid=26241 vsize=289440 CPUtime=0.33 cores=0,2
/proc/26260/stat : 26260 (python) S 26241 26241 24847 0 -1 4202560 1148 0 0 0 17 16 0 0 19 0 2 0 735497198 296386560 5771 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26260/statm: 72360 5771 415 364 0 8278 0
[pid=26262] ppid=26260 vsize=1018616 CPUtime=100.09 cores=0,2
/proc/26262/stat : 26262 (gnovelty+2) T 26260 26262 26262 0 -1 4202496 766 0 0 0 10009 0 0 0 25 0 1 0 735497199 1043062784 500 33554432000 134512640 135663704 4288398144 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/26262/statm: 254654 500 113 282 0 254370 0
[pid=26260/tid=26307] ppid=26241 vsize=289440 CPUtime=0 cores=0,2
/proc/26260/task/26307/stat : 26307 (python) S 26241 26241 24847 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 735507234 296386560 5771 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604453825434048 0 0 -1 2 0 0 0
[pid=26309] ppid=26241 vsize=289624 CPUtime=0.17 cores=0,2
/proc/26309/stat : 26309 (python) S 26241 26241 24847 0 -1 4202560 906 0 0 0 9 8 0 0 18 0 1 0 735507235 296574976 5785 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367566918 0 0 16781312 514 3604375037710139649 0 0 17 2 0 0 0
/proc/26309/statm: 72406 5785 371 364 0 8321 0
[pid=26311] ppid=26309 vsize=1018616 CPUtime=59.81 cores=0,2
/proc/26311/stat : 26311 (gnovelty+2) R 26309 26311 26311 0 -1 4202496 763 0 0 0 5981 0 0 0 25 0 1 0 735507236 1043062784 500 33554432000 134512640 135663704 4288368288 18446744073709551615 134525715 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26311/statm: 254654 500 113 282 0 254370 0
[pid=26241/tid=26261] ppid=26239 vsize=299868 CPUtime=0 cores=0,2
/proc/26241/task/26261/stat : 26261 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 19 0 3 0 735497199 307064832 7298 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26310] ppid=26239 vsize=299868 CPUtime=0 cores=0,2
/proc/26241/task/26310/stat : 26310 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 3 0 735507236 307064832 7298 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 162

################
# More data... #
################

[pid=26378] ppid=26241 vsize=300484 CPUtime=0.3 cores=0,2
/proc/26378/stat : 26378 (python) S 26241 26241 24847 0 -1 4202560 1081 0 0 0 15 15 0 0 19 0 2 0 735517271 307695616 5954 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26378/statm: 75121 5954 399 364 0 11033 0
[pid=26380] ppid=26378 vsize=418636 CPUtime=99.29 cores=0,2
/proc/26380/stat : 26380 (adaptg2wsat2009) T 26378 26380 26380 0 -1 4202496 1223 0 0 0 9929 0 0 0 25 0 1 0 735517271 428683264 956 33554432000 134512640 135107411 4292638672 18446744073709551615 134531239 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26380/statm: 104659 956 59 146 0 103535 0
[pid=26378/tid=26395] ppid=26241 vsize=300484 CPUtime=0 cores=0,2
/proc/26378/task/26395/stat : 26395 (python) S 26241 26241 24847 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 735527202 307695616 5954 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604442043688128 0 0 -1 2 0 0 0
[pid=26397] ppid=26241 vsize=310740 CPUtime=0.34 cores=0,2
/proc/26397/stat : 26397 (python) S 26241 26241 24847 0 -1 4202560 1081 0 0 0 18 16 0 0 19 0 2 0 735527203 318197760 5958 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26397/statm: 77685 5958 400 364 0 13594 0
[pid=26399] ppid=26397 vsize=418636 CPUtime=100 cores=0,2
/proc/26399/stat : 26399 (adaptg2wsat2009) T 26397 26399 26399 0 -1 4202496 1225 0 0 0 9999 1 0 0 25 0 1 0 735527203 428683264 956 33554432000 134512640 135107411 4287816592 18446744073709551615 134531246 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/26399/statm: 104659 956 59 146 0 103535 0
[pid=26397/tid=26415] ppid=26241 vsize=310740 CPUtime=0 cores=0,2
/proc/26397/task/26415/stat : 26415 (python) S 26241 26241 24847 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 735537238 318197760 5958 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604441289393472 0 0 -1 2 0 0 0
[pid=26416] ppid=26241 vsize=320996 CPUtime=0.34 cores=0,2
/proc/26416/stat : 26416 (python) S 26241 26241 24847 0 -1 4202560 1088 0 0 0 16 18 0 0 19 0 2 0 735537239 328699904 5962 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26416/statm: 80249 5962 400 364 0 16155 0
[pid=26418] ppid=26416 vsize=418636 CPUtime=100.02 cores=0,2
/proc/26418/stat : 26418 (adaptg2wsat2009) T 26416 26418 26418 0 -1 4202496 1220 0 0 0 10002 0 0 0 25 0 1 0 735537239 428683264 955 33554432000 134512640 135107411 4287632560 18446744073709551615 134531561 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26418/statm: 104659 955 59 146 0 103535 0
[pid=26416/tid=26426] ppid=26241 vsize=320996 CPUtime=0 cores=0,2
/proc/26416/task/26426/stat : 26426 (python) S 26241 26241 24847 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 735547273 328699904 5962 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604441973985728 0 0 -1 2 0 0 0
[pid=26427] ppid=26241 vsize=331252 CPUtime=0.32 cores=0,2
/proc/26427/stat : 26427 (python) S 26241 26241 24847 0 -1 4202560 1094 0 0 0 17 15 0 0 19 0 2 0 735547275 339202048 5966 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26427/statm: 82813 5966 400 364 0 18716 0
[pid=26429] ppid=26427 vsize=1018616 CPUtime=100.34 cores=0,2
/proc/26429/stat : 26429 (gnovelty+2) T 26427 26429 26429 0 -1 4202496 768 0 0 0 10034 0 0 0 25 0 1 0 735547275 1043062784 501 33554432000 134512640 135663704 4289250208 18446744073709551615 134524509 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26429/statm: 254654 501 113 282 0 254370 0
[pid=26427/tid=26444] ppid=26241 vsize=331252 CPUtime=0 cores=0,2
/proc/26427/task/26444/stat : 26444 (python) S 26241 26241 24847 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 735557311 339202048 5966 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604445785829504 0 0 -1 2 0 0 0
[pid=26445] ppid=26241 vsize=341508 CPUtime=0.37 cores=0,2
/proc/26445/stat : 26445 (python) S 26241 26241 24847 0 -1 4202560 1087 0 0 0 20 17 0 0 19 0 2 0 735557312 349704192 5970 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26445/statm: 85377 5970 400 364 0 21277 0
[pid=26447] ppid=26445 vsize=248648 CPUtime=100.01 cores=0,2
/proc/26447/stat : 26447 (FH) T 26445 26447 26447 0 -1 4202496 1118 0 0 0 10001 0 0 0 25 0 1 0 735557313 254615552 856 33554432000 134512640 134936988 4287295520 18446744073709551615 134545068 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/26447/statm: 62162 856 41 104 0 61666 0
[pid=26445/tid=26456] ppid=26241 vsize=341508 CPUtime=0 cores=0,2
/proc/26445/task/26456/stat : 26456 (python) S 26241 26241 24847 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 735567348 349704192 5970 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604447693735744 0 0 -1 2 0 0 0
[pid=26457] ppid=26241 vsize=351764 CPUtime=0 cores=0,2
/proc/26457/stat : 26457 (python) S 26241 26241 24847 0 -1 4202560 775 0 0 0 0 0 0 0 19 0 1 0 735567350 360206336 5923 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367566918 0 0 16781312 514 8724265230395244543 0 0 17 0 0 0 0
/proc/26457/statm: 87941 5923 350 364 0 23838 0
[pid=26460] ppid=26457 vsize=418500 CPUtime=0.39 cores=0,2
/proc/26460/stat : 26460 (adaptg2wsat2009) R 26457 26460 26460 0 -1 4202496 1078 0 0 0 39 0 0 0 21 0 1 0 735567351 428544000 808 33554432000 134512640 135107411 4287233520 18446744073709551615 134523457 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26460/statm: 104625 808 49 146 0 103501 0
[pid=26241/tid=26261] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26261/stat : 26261 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 19 0 9 0 735497199 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26310] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26310/stat : 26310 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 9 0 735507236 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26379] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26379/stat : 26379 (python) S 26239 26241 24847 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 9 0 735517271 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26398] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26398/stat : 26398 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 9 0 735527203 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26417] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26417/stat : 26417 (python) S 26239 26241 24847 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 735537239 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26428] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26428/stat : 26428 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 9 0 735547275 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26446] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26446/stat : 26446 (python) S 26239 26241 24847 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 735557313 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26458] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26458/stat : 26458 (python) S 26239 26241 24847 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 9 0 735567350 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 704.47
Current children cumulated vsize (KiB) 7876720

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+704.002 s]
/proc/loadavg: 4.03 4.05 4.00 7/494 26460
/proc/meminfo: memFree=23522832/32950928 swapFree=38710892/67111528
[pid=26241] ppid=26239 vsize=362008 CPUtime=1.7 cores=0,2
/proc/26241/stat : 26241 (python) S 26239 26241 24847 0 -1 4202496 17570 932 1 0 152 18 0 0 20 0 9 0 735496987 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26241/statm: 90502 7469 1892 364 0 26399 0
[pid=26260] ppid=26241 vsize=289440 CPUtime=0.33 cores=0,2
/proc/26260/stat : 26260 (python) S 26241 26241 24847 0 -1 4202560 1148 0 0 0 17 16 0 0 19 0 2 0 735497198 296386560 5771 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26260/statm: 72360 5771 415 364 0 8278 0
[pid=26262] ppid=26260 vsize=1018616 CPUtime=100.09 cores=0,2
/proc/26262/stat : 26262 (gnovelty+2) T 26260 26262 26262 0 -1 4202496 766 0 0 0 10009 0 0 0 25 0 1 0 735497199 1043062784 500 33554432000 134512640 135663704 4288398144 18446744073709551615 134524918 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/26262/statm: 254654 500 113 282 0 254370 0
[pid=26260/tid=26307] ppid=26241 vsize=289440 CPUtime=0 cores=0,2
/proc/26260/task/26307/stat : 26307 (python) S 26241 26241 24847 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 735507234 296386560 5771 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604453825434048 0 0 -1 2 0 0 0
[pid=26309] ppid=26241 vsize=289624 CPUtime=0.3 cores=0,2
/proc/26309/stat : 26309 (python) S 26241 26241 24847 0 -1 4202560 1072 0 0 0 16 14 0 0 19 0 2 0 735507235 296574976 5815 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26309/statm: 72406 5815 400 364 0 8321 0
[pid=26311] ppid=26309 vsize=1018616 CPUtime=100.33 cores=0,2
/proc/26311/stat : 26311 (gnovelty+2) T 26309 26311 26311 0 -1 4202496 763 0 0 0 10033 0 0 0 25 0 1 0 735507236 1043062784 500 33554432000 134512640 135663704 4288368288 18446744073709551615 134524509 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26311/statm: 254654 500 113 282 0 254370 0
[pid=26309/tid=26376] ppid=26241 vsize=289624 CPUtime=0 cores=0,2
/proc/26309/task/26376/stat : 26376 (python) S 26241 26241 24847 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 735517270 296574976 5815 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604442228351168 0 0 -1 2 0 0 0
[pid=26378] ppid=26241 vsize=300484 CPUtime=0.3 cores=0,2
/proc/26378/stat : 26378 (python) S 26241 26241 24847 0 -1 4202560 1081 0 0 0 15 15 0 0 19 0 2 0 735517271 307695616 5954 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26378/statm: 75121 5954 399 364 0 11033 0
[pid=26380] ppid=26378 vsize=418636 CPUtime=99.29 cores=0,2
/proc/26380/stat : 26380 (adaptg2wsat2009) T 26378 26380 26380 0 -1 4202496 1223 0 0 0 9929 0 0 0 25 0 1 0 735517271 428683264 956 33554432000 134512640 135107411 4292638672 18446744073709551615 134531239 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26380/statm: 104659 956 59 146 0 103535 0
[pid=26378/tid=26395] ppid=26241 vsize=300484 CPUtime=0 cores=0,2
/proc/26378/task/26395/stat : 26395 (python) S 26241 26241 24847 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 735527202 307695616 5954 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604442043688128 0 0 -1 2 0 0 0
[pid=26397] ppid=26241 vsize=310740 CPUtime=0.34 cores=0,2
/proc/26397/stat : 26397 (python) S 26241 26241 24847 0 -1 4202560 1081 0 0 0 18 16 0 0 19 0 2 0 735527203 318197760 5958 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26397/statm: 77685 5958 400 364 0 13594 0
[pid=26399] ppid=26397 vsize=418636 CPUtime=100 cores=0,2
/proc/26399/stat : 26399 (adaptg2wsat2009) T 26397 26399 26399 0 -1 4202496 1225 0 0 0 9999 1 0 0 25 0 1 0 735527203 428683264 956 33554432000 134512640 135107411 4287816592 18446744073709551615 134531246 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/26399/statm: 104659 956 59 146 0 103535 0
[pid=26397/tid=26415] ppid=26241 vsize=310740 CPUtime=0 cores=0,2
/proc/26397/task/26415/stat : 26415 (python) S 26241 26241 24847 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 735537238 318197760 5958 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604441289393472 0 0 -1 2 0 0 0
[pid=26416] ppid=26241 vsize=320996 CPUtime=0.34 cores=0,2
/proc/26416/stat : 26416 (python) S 26241 26241 24847 0 -1 4202560 1088 0 0 0 16 18 0 0 19 0 2 0 735537239 328699904 5962 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26416/statm: 80249 5962 400 364 0 16155 0
[pid=26418] ppid=26416 vsize=418636 CPUtime=100.02 cores=0,2
/proc/26418/stat : 26418 (adaptg2wsat2009) T 26416 26418 26418 0 -1 4202496 1220 0 0 0 10002 0 0 0 25 0 1 0 735537239 428683264 955 33554432000 134512640 135107411 4287632560 18446744073709551615 134531561 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26418/statm: 104659 955 59 146 0 103535 0
[pid=26416/tid=26426] ppid=26241 vsize=320996 CPUtime=0 cores=0,2
/proc/26416/task/26426/stat : 26426 (python) S 26241 26241 24847 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 735547273 328699904 5962 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604441973985728 0 0 -1 2 0 0 0
[pid=26427] ppid=26241 vsize=331252 CPUtime=0.32 cores=0,2
/proc/26427/stat : 26427 (python) S 26241 26241 24847 0 -1 4202560 1094 0 0 0 17 15 0 0 19 0 2 0 735547275 339202048 5966 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/26427/statm: 82813 5966 400 364 0 18716 0
[pid=26429] ppid=26427 vsize=1018616 CPUtime=100.34 cores=0,2
/proc/26429/stat : 26429 (gnovelty+2) T 26427 26429 26429 0 -1 4202496 768 0 0 0 10034 0 0 0 25 0 1 0 735547275 1043062784 501 33554432000 134512640 135663704 4289250208 18446744073709551615 134524509 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/26429/statm: 254654 501 113 282 0 254370 0
[pid=26427/tid=26444] ppid=26241 vsize=331252 CPUtime=0 cores=0,2
/proc/26427/task/26444/stat : 26444 (python) S 26241 26241 24847 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 735557311 339202048 5966 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604445785829504 0 0 -1 2 0 0 0
[pid=26445] ppid=26241 vsize=341508 CPUtime=0.37 cores=0,2
/proc/26445/stat : 26445 (python) S 26241 26241 24847 0 -1 4202560 1087 0 0 0 20 17 0 0 19 0 2 0 735557312 349704192 5970 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379373515 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/26445/statm: 85377 5970 400 364 0 21277 0
[pid=26447] ppid=26445 vsize=248648 CPUtime=100.01 cores=0,2
/proc/26447/stat : 26447 (FH) T 26445 26447 26447 0 -1 4202496 1118 0 0 0 10001 0 0 0 25 0 1 0 735557313 254615552 856 33554432000 134512640 134936988 4287295520 18446744073709551615 134545068 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/26447/statm: 62162 856 41 104 0 61666 0
[pid=26445/tid=26456] ppid=26241 vsize=341508 CPUtime=0 cores=0,2
/proc/26445/task/26456/stat : 26456 (python) S 26241 26241 24847 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 735567348 349704192 5970 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 514 18446604447693735744 0 0 -1 2 0 0 0
[pid=26457] ppid=26241 vsize=351764 CPUtime=0 cores=0,2
/proc/26457/stat : 26457 (python) S 26241 26241 24847 0 -1 4202560 775 0 0 0 0 0 0 0 19 0 1 0 735567350 360206336 5923 33554432000 4194304 5683644 140736105093728 18446744073709551615 251367566918 0 0 16781312 514 8724265230395244543 0 0 17 0 0 0 0
/proc/26457/statm: 87941 5923 350 364 0 23838 0
[pid=26460] ppid=26457 vsize=418500 CPUtime=0.39 cores=0,2
/proc/26460/stat : 26460 (adaptg2wsat2009) R 26457 26460 26460 0 -1 4202496 1078 0 0 0 39 0 0 0 21 0 1 0 735567351 428544000 808 33554432000 134512640 135107411 4287233520 18446744073709551615 134523457 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/26460/statm: 104625 808 49 146 0 103501 0
[pid=26241/tid=26261] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26261/stat : 26261 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 19 0 9 0 735497199 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26310] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26310/stat : 26310 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 9 0 735507236 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26379] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26379/stat : 26379 (python) S 26239 26241 24847 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 9 0 735517271 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26398] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26398/stat : 26398 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 9 0 735527203 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26417] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26417/stat : 26417 (python) S 26239 26241 24847 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 735537239 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26428] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26428/stat : 26428 (python) S 26239 26241 24847 0 -1 4202560 27 932 0 0 0 0 0 0 20 0 9 0 735547275 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26446] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26446/stat : 26446 (python) S 26239 26241 24847 0 -1 4202560 30 932 0 0 0 0 0 0 20 0 9 0 735557313 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 0 0 0 0
[pid=26241/tid=26458] ppid=26239 vsize=362008 CPUtime=0 cores=0,2
/proc/26241/task/26458/stat : 26458 (python) S 26239 26241 24847 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 9 0 735567350 370696192 7469 33554432000 4194304 5683644 140736105093728 18446744073709551615 251379370417 0 0 16781312 2 18446604443480954688 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 704.47
Current children cumulated vsize (KiB) 7876720

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 26241 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=537766
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=183972
# CPU time returned by wait4() is 1.72174
# while last known CPU time is 704.47
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 704.083
CPU time (s): 704.47
CPU user time (s): 703.17
CPU system time (s): 1.3
CPU usage (%): 100.055
Max. virtual memory (cumulated for all children) (KiB): 7876720

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.53777
system time used= 0.183972
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18969
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10132
involuntary context switches= 41

runsolver used 3.54146 second user time and 7.57285 second system time

The end

Launcher Data 

Begin job on node113 at 2011-05-15 11:44:23
IDJOB=3377355
IDBENCH=82664
IDSOLVER=1857
FILE ID=node113/3377355-1305452663
RUNJOBID= node113-1305451360-25847
PBS_JOBID= 13324872
Free space on /tmp= 73396 MiB

SOLVER NAME= borg-sat 11.03.02-seq-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v200-c17000-S72668411-025-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3377355-1305452663/watcher-3377355-1305452663 -o /tmp/evaluation-result-3377355-1305452663/solver-3377355-1305452663 -C 2400 -W 1300 -M 7680  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3377355-1305452663.cnf -seed 1861503481 -budget 2400

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= a7d53123c03c2abad4ab13635af690bf
RANDOM SEED=1861503481

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      23971560 kB
Buffers:        272144 kB
Cached:        3073676 kB
SwapCached:      93712 kB
Active:        1941484 kB
Inactive:      6747064 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      23971560 kB
SwapTotal:    67111528 kB
SwapFree:     38710892 kB
Dirty:           64388 kB
Writeback:           0 kB
AnonPages:     5260840 kB
Mapped:          22120 kB
Slab:           120812 kB
PageTables:     104320 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 99782148 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73260 MiB
End job on node113 at 2011-05-15 11:56:09