Trace number 3251087

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
tts 5-4? (TO) 1300.41 1300.37

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m47-q742.5-n45-p15-s28972035.cnf
MD5SUMbfa662ff57088c54e0febd091ce11e5c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2.39763
Satisfiable
(Un)Satisfiability was proved
Number of variables1985
Number of clauses409171
Sum of the clauses size820237
Maximum clause length47
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2409126
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data 

0.19/0.27	c Command: HOME/tts-5-4 HOME/instance-3251087-1303587034.cnf 
0.19/0.27	c Using SATTIMEOUT of 2400
0.19/0.27	c Using SATRAM of 7680
0.19/0.27	c Size of subset node = 32
0.19/0.27	c Variables = 1985
0.19/0.27	c Clauses = 409171
0.19/0.27	c Literals = 820237
0.19/0.27	c Reduced size:
0.19/0.27	c Variables = 1985
0.19/0.27	c Clauses = 409171
0.19/0.27	c Literals = 820237
0.19/0.27	c a2
0.38/0.49	c a1
1.19/1.23	c Independent sub-problems = 1
1.19/1.23	c Sub-problem with 1985 variables and 409171 clauses
1.19/1.23	c using permutation method 4
1.19/1.23	c count = 1
1.19/1.23	c Ordering finished 1.180 seconds
1.19/1.23	c mapped 1.230 seconds
1.19/1.23	c permuted 1.230 seconds
1.19/1.23	c about to sort
1.19/1.27	c sorted
2.59/2.67	c clauses now 409171
2.59/2.67	c init finished 1.360 seconds
2.59/2.67	c tree built 2.660 seconds
2.59/2.67	c 
2.59/2.67	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
2.59/2.67	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
2.59/2.67	c ................................ | ..........                    |                                  2.7         0.0             
2.59/2.67	c ................................ | ..........                  1 |                                  2.7         0.4             
2.59/2.67	c ................................ | ..........                  2 |                                  2.7         0.8             
2.59/2.67	c ................................ | ..........                  3 |                                  2.7         1.1             
2.59/2.67	c ................................ | ..........                  4 |                                  2.7         1.5             
2.59/2.67	c ................................ | ..........                  5 |                                  2.7         1.9             
2.59/2.67	c ................................ | ..........               1000 |              22                  2.7       374.5         1357
47.99/48.01	c ................................ | ..........           12052000 | 7351         309768             48.0    251083.3     15010336
95.98/96.01	c ................................ | ..........           23793000 | 12815        614987             96.0    247843.8     24228010
143.89/144.00	c ................................ | ..........           35559000 | 17722        917463            144.0    246937.5     32828262
191.99/192.01	c ................................ | ..........           47006000 | 25784        1210232           192.0    244822.9     44585252
240.00/240.00	c ................................ | *.........           58129000 | 33505        1496317           240.0    242204.2     54632446
287.99/288.00	c ................................ | *.........           68997000 | 38681        1779521           288.0    239572.9     65412927
335.99/336.00	c ................................ | *.........           79423000 | 44877        2051421           336.0    236378.0     73977274
383.99/384.00	c ................................ | *.........           89746000 | 49384        2319955           384.0    233713.5     81961012
432.00/432.00	c ................................ | *.........           99615000 | 55702        2580619           432.0    230590.3     91515644
480.00/480.00	c ................................ | **........          109475000 | 62853        2838235           480.0    228072.9    100330968
527.91/527.99	c ................................ | **........          119328000 | 69453        3091552           528.0    226000.0    106649045
575.90/575.99	c ................................ | **........          128763000 | 76983        3336005           576.0    223546.9    114005723
623.90/623.99	c ................................ | **........          138461000 | 84807        3588973           624.0    221892.6    123790995
671.91/671.99	c ................................ | **........          147549000 | 89643        3829296           672.0    219567.0    129811393
719.91/719.98	c ................................ | ***.......          156608000 | 93138        4074090           720.0    217511.1    139371706
767.91/767.98	c ................................ | ***.......          165394000 | 96065        4312913           768.0    215356.8    147723563
815.92/815.98	c ................................ | ***.......          173741000 | 99359        4541566           816.0    212917.9    153342335
863.91/863.98	c ................................ | ***.......          184268000 | 107620       4813800           864.0    213273.1    156369524
911.93/911.97	c ................................ | ***.......          194170000 | 114785       5072791           912.0    212905.7    162919000
959.92/959.98	c ................................ | ****......          205002000 | 122894       5351310           960.0    213543.8    167800061
1008.12/1008.13	c ................................ | ****......          216690000 | 131344       5651715          1008.1    214938.3    179338976
1055.93/1055.97	c ................................ | ****......          228235000 | 141895       5940873          1056.0    216131.6    184959761
1103.92/1103.97	c ................................ | ****......          238978000 | 151705       6218927          1104.0    216465.6    189253775
1151.93/1151.96	c ................................ | ****......          250137000 | 160769       6510835          1152.0    217132.8    197443540
1199.92/1199.97	c ................................ | *****.....          260725000 | 168995       6789628          1200.0    217270.8    206538100
1247.93/1247.96	c ................................ | *****.....          271455000 | 179792       7071638          1248.0    217512.0    217053601
1295.93/1295.96	c ................................ | *****.....          282063000 | 188027       7346211          1296.0    217641.2    227981765

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3251087-1303587034/watcher-3251087-1303587034 -o /tmp/evaluation-result-3251087-1303587034/solver-3251087-1303587034 -C 2400 -W 1300 -M 7680 HOME/tts-5-4 HOME/instance-3251087-1303587034.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.44 3.87 3.84 4/184 3613
/proc/meminfo: memFree=12853164/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=7388 CPUtime=0 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 435 0 0 0 0 0 0 0 21 0 1 0 470305812 7565312 379 33554432000 4194304 4337412 140733242009152 18446744073709551615 212435677893 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1847 380 131 35 0 288 0

[startup+0.0230451 s]
/proc/loadavg: 3.44 3.87 3.84 4/184 3613
/proc/meminfo: memFree=12853164/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=10964 CPUtime=0.01 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1319 0 0 0 1 0 0 0 21 0 1 0 470305812 11227136 1263 33554432000 4194304 4337412 140733242009152 18446744073709551615 212435677893 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 2741 1264 132 35 0 1182 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 10964

[startup+0.101059 s]
/proc/loadavg: 3.44 3.87 3.84 4/184 3613
/proc/meminfo: memFree=12853164/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=27180 CPUtime=0.09 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 5310 0 0 0 9 0 0 0 21 0 1 0 470305812 27832320 5254 33554432000 4194304 4337412 140733242009152 18446744073709551615 212435677893 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 6795 5256 132 35 0 5236 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27180

[startup+0.301027 s]
/proc/loadavg: 3.44 3.87 3.84 4/184 3613
/proc/meminfo: memFree=12853164/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=73168 CPUtime=0.29 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 16431 0 0 0 27 2 0 0 22 0 1 0 470305812 74924032 16375 33554432000 4194304 4337412 140733242009152 18446744073709551615 212435713803 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 18292 16375 133 35 0 16733 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 73168

[startup+0.700953 s]
/proc/loadavg: 3.44 3.87 3.84 4/184 3613
/proc/meminfo: memFree=12853164/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=78992 CPUtime=0.69 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 23605 0 0 0 66 3 0 0 24 0 1 0 470305812 80887808 18249 33554432000 4194304 4337412 140733242009152 18446744073709551615 212435677893 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 19748 18250 138 35 0 18189 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 78992

[startup+1.50078 s]
/proc/loadavg: 3.44 3.87 3.84 5/190 3620
/proc/meminfo: memFree=12494232/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=101924 CPUtime=1.49 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 29704 0 0 0 145 4 0 0 25 0 1 0 470305812 104370176 23548 33554432000 4194304 4337412 140733242009152 18446744073709551615 4277673 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 25481 23548 150 35 0 23922 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 101924

[startup+3.10049 s]
/proc/loadavg: 3.44 3.87 3.84 5/190 3620
/proc/meminfo: memFree=12381268/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=189196 CPUtime=3.09 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 52529 0 0 0 302 7 0 0 25 0 1 0 470305812 193736704 45573 33554432000 4194304 4337412 140733242009152 18446744073709551615 4256034 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 47299 45573 156 35 0 45740 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 189196

[startup+6.30089 s]
/proc/loadavg: 3.48 3.87 3.84 5/190 3620
/proc/meminfo: memFree=12039024/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=227012 CPUtime=6.29 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 62229 0 0 0 619 10 0 0 25 0 1 0 470305812 232460288 55273 33554432000 4194304 4337412 140733242009152 18446744073709551615 4238668 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 56753 55273 156 35 0 55194 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 227012

[startup+12.7007 s]
/proc/loadavg: 3.52 3.87 3.84 5/190 3620
/proc/meminfo: memFree=11559964/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=305740 CPUtime=12.69 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 81204 0 0 0 1255 14 0 0 25 0 1 0 470305812 313077760 74248 33554432000 4194304 4337412 140733242009152 18446744073709551615 4268059 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 76435 74249 156 35 0 74876 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 305740

[startup+25.5003 s]
/proc/loadavg: 3.63 3.88 3.84 5/190 3620
/proc/meminfo: memFree=10938076/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=449656 CPUtime=25.48 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 117420 0 0 0 2528 20 0 0 25 0 1 0 470305812 460447744 110464 33554432000 4194304 4337412 140733242009152 18446744073709551615 212435412369 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 112414 110464 156 35 0 110855 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 449656

[startup+51.1004 s]
/proc/loadavg: 3.75 3.89 3.84 5/190 3621
/proc/meminfo: memFree=9925812/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=700024 CPUtime=51.09 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 179595 0 0 0 5076 33 0 0 25 0 1 0 470305812 716824576 172639 33554432000 4194304 4337412 140733242009152 18446744073709551615 4233669 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 175006 172639 156 35 0 173447 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 700024

[startup+102.307 s]
/proc/loadavg: 3.89 3.90 3.85 5/190 3622
/proc/meminfo: memFree=7981572/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=988404 CPUtime=102.29 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 250435 0 0 0 10179 50 0 0 25 0 1 0 470305812 1012125696 243479 33554432000 4194304 4337412 140733242009152 18446744073709551615 4254192 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 247101 243479 156 35 0 245542 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 988404

[startup+162.3 s]
/proc/loadavg: 3.96 3.92 3.85 5/190 3624
/proc/meminfo: memFree=6393932/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=1385280 CPUtime=162.29 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 350184 0 0 0 16156 73 0 0 25 0 1 0 470305812 1418526720 343228 33554432000 4194304 4337412 140733242009152 18446744073709551615 212435713481 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 346320 343228 156 35 0 344761 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 1385280

[startup+222.301 s]
/proc/loadavg: 3.98 3.93 3.86 5/190 3626
/proc/meminfo: memFree=4999908/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=1822784 CPUtime=222.29 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 459304 0 0 0 22125 104 0 0 25 0 1 0 470305812 1866530816 452348 33554432000 4194304 4337412 140733242009152 18446744073709551615 212435412051 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 455696 452348 156 35 0 454137 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 1822784

[startup+282.301 s]
/proc/loadavg: 4.04 3.95 3.87 5/190 3627
/proc/meminfo: memFree=3385736/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=2241536 CPUtime=282.29 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 563981 0 0 0 28096 133 0 0 25 0 1 0 470305812 2295332864 557025 33554432000 4194304 4337412 140733242009152 18446744073709551615 4205760 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 560384 557025 156 35 0 558825 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 2241536

[startup+342.3 s]
/proc/loadavg: 4.01 3.96 3.88 5/190 3629
/proc/meminfo: memFree=1971608/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=2558892 CPUtime=342.29 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 640940 0 0 0 34075 154 0 0 25 0 1 0 470305812 2620305408 633984 33554432000 4194304 4337412 140733242009152 18446744073709551615 4257667 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 639723 633984 156 35 0 638164 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 2558892

[startup+402.301 s]
/proc/loadavg: 4.07 3.98 3.89 5/190 3630
/proc/meminfo: memFree=472768/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=2915144 CPUtime=402.3 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 729880 0 0 0 40050 180 0 0 25 0 1 0 470305812 2985107456 722924 33554432000 4194304 4337412 140733242009152 18446744073709551615 4287915 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 728786 722924 156 35 0 727227 0
Current children cumulated CPU time (s) 402.3
Current children cumulated vsize (KiB) 2915144

[startup+462.301 s]
/proc/loadavg: 4.02 3.98 3.89 5/190 3632
/proc/meminfo: memFree=93324/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=3196396 CPUtime=462.3 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 800249 0 0 0 46032 198 0 0 25 0 1 0 470305812 3273109504 793293 33554432000 4194304 4337412 140733242009152 18446744073709551615 4268080 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 799099 793293 156 35 0 797540 0
Current children cumulated CPU time (s) 462.3
Current children cumulated vsize (KiB) 3196396

[startup+522.3 s]
/proc/loadavg: 4.01 3.98 3.90 5/190 3634
/proc/meminfo: memFree=93692/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=3562032 CPUtime=522.3 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 893749 0 0 0 52006 224 0 0 25 0 1 0 470305812 3647520768 886793 33554432000 4194304 4337412 140733242009152 18446744073709551615 212435412095 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 890508 886793 156 35 0 888949 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 3562032

[startup+582.301 s]
/proc/loadavg: 4.00 3.98 3.91 5/190 3635
/proc/meminfo: memFree=95748/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=3796408 CPUtime=582.3 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 952596 0 0 0 57989 241 0 0 25 0 1 0 470305812 3887521792 945640 33554432000 4194304 4337412 140733242009152 18446744073709551615 4244389 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 949102 945640 156 35 0 947543 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 3796408

[startup+642.301 s]
/proc/loadavg: 4.00 3.98 3.91 5/190 3637
/proc/meminfo: memFree=92364/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=4187036 CPUtime=642.31 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1050166 0 0 0 63964 267 0 0 25 0 1 0 470305812 4287524864 1043210 33554432000 4194304 4337412 140733242009152 18446744073709551615 212435412002 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1046759 1043210 156 35 0 1045200 0
Current children cumulated CPU time (s) 642.31
Current children cumulated vsize (KiB) 4187036

[startup+702.301 s]
/proc/loadavg: 4.00 3.98 3.91 5/190 3638
/proc/meminfo: memFree=92228/32951124 swapFree=67111528/67111528
[pid=3613] ppid=3611 vsize=4468288 CPUtime=702.31 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1120591 0 0 0 69941 290 0 0 25 0 1 0 470305812 4575526912 1113635 33554432000 4194304 4337412 140733242009152 18446744073709551615 4255323 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1117072 1113635 156 35 0 1115513 0
Current children cumulated CPU time (s) 702.31
Current children cumulated vsize (KiB) 4468288

[startup+762.307 s]
/proc/loadavg: 4.03 4.00 3.91 5/190 3640
/proc/meminfo: memFree=97164/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=4790164 CPUtime=762.32 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1201116 0 0 0 75919 313 0 0 25 0 1 0 470305812 4905127936 1194160 33554432000 4194304 4337412 140733242009152 18446744073709551615 4256630 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1197541 1194160 156 35 0 1195982 0
Current children cumulated CPU time (s) 762.32
Current children cumulated vsize (KiB) 4790164

[startup+822.3 s]
/proc/loadavg: 4.01 4.00 3.91 5/190 3642
/proc/meminfo: memFree=92376/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=5062376 CPUtime=822.31 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1261508 0 0 0 81901 330 0 0 25 0 1 0 470305812 5183873024 1254552 33554432000 4194304 4337412 140733242009152 18446744073709551615 4255373 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1265594 1254552 156 35 0 1264035 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 5062376

[startup+882.301 s]
/proc/loadavg: 4.04 4.01 3.92 5/190 3643
/proc/meminfo: memFree=94872/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=5240500 CPUtime=882.31 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1306444 0 0 0 87885 346 0 0 25 0 1 0 470305812 5366272000 1299488 33554432000 4194304 4337412 140733242009152 18446744073709551615 4253559 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1310125 1299488 156 35 0 1308566 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 5240500

[startup+942.301 s]
/proc/loadavg: 3.67 3.92 3.89 4/184 3663
/proc/meminfo: memFree=7705824/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=5484252 CPUtime=942.32 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1366666 0 0 0 93870 362 0 0 25 0 1 0 470305812 5615874048 1359710 33554432000 4194304 4337412 140733242009152 18446744073709551615 4255392 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1371063 1359710 156 35 0 1369504 0
Current children cumulated CPU time (s) 942.32
Current children cumulated vsize (KiB) 5484252

[startup+1002.3 s]
/proc/loadavg: 3.24 3.75 3.84 4/184 3664
/proc/meminfo: memFree=6995976/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=5840504 CPUtime=1002.32 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1456241 0 0 0 99852 380 0 0 25 0 1 0 470305812 5980676096 1449285 33554432000 4194304 4337412 140733242009152 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1460126 1449285 156 35 0 1458567 0
Current children cumulated CPU time (s) 1002.32
Current children cumulated vsize (KiB) 5840504

[startup+1062.3 s]
/proc/loadavg: 3.09 3.61 3.78 4/184 3666
/proc/meminfo: memFree=6033428/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=6049880 CPUtime=1062.33 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1508521 0 0 0 105839 394 0 0 25 0 1 0 470305812 6195077120 1501565 33554432000 4194304 4337412 140733242009152 18446744073709551615 4253533 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1512470 1501565 156 35 0 1510911 0
Current children cumulated CPU time (s) 1062.33
Current children cumulated vsize (KiB) 6049880

[startup+1122.3 s]
/proc/loadavg: 3.03 3.50 3.73 4/184 3668
/proc/meminfo: memFree=5300896/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=6221756 CPUtime=1122.32 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1551103 0 0 0 111829 403 0 0 25 0 1 0 470305812 6371078144 1544147 33554432000 4194304 4337412 140733242009152 18446744073709551615 4239703 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1555439 1544147 156 35 0 1553880 0
Current children cumulated CPU time (s) 1122.32
Current children cumulated vsize (KiB) 6221756

[startup+1182.3 s]
/proc/loadavg: 3.01 3.41 3.68 4/184 3669
/proc/meminfo: memFree=4611796/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=6656132 CPUtime=1182.33 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1660199 0 0 0 117807 426 0 0 25 0 1 0 470305812 6815879168 1653243 33554432000 4194304 4337412 140733242009152 18446744073709551615 4239700 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1664033 1653243 156 35 0 1662474 0
Current children cumulated CPU time (s) 1182.33
Current children cumulated vsize (KiB) 6656132

[startup+1242.3 s]
/proc/loadavg: 3.00 3.33 3.63 4/184 3671
/proc/meminfo: memFree=4071696/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=6981136 CPUtime=1242.33 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1741596 0 0 0 123790 443 0 0 25 0 1 0 470305812 7148683264 1734640 33554432000 4194304 4337412 140733242009152 18446744073709551615 212435412033 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1745284 1734640 156 35 0 1743725 0
Current children cumulated CPU time (s) 1242.33
Current children cumulated vsize (KiB) 6981136



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 3.00 3.27 3.59 4/185 3673
/proc/meminfo: memFree=7953216/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=7393636 CPUtime=1300.04 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4202496 1850132 0 0 0 129543 461 0 0 25 0 1 0 470305812 7571083264 1843176 33554432000 4194304 4337412 140733242009152 18446744073709551615 4284696 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/3613/statm: 1848409 1843176 156 35 0 1846850 0
Current children cumulated CPU time (s) 1300.04
Current children cumulated vsize (KiB) 7393636

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.21 s]
/proc/loadavg: 3.00 3.27 3.59 3/185 3675
/proc/meminfo: memFree=12871384/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=0 CPUtime=1300.24 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4203524 1850132 0 0 0 129543 481 0 0 25 0 1 0 470305812 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 4 0 0 0
/proc/3613/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1300.24
Current children cumulated vsize (KiB) 0

[startup+1300.3 s]
/proc/loadavg: 3.00 3.27 3.59 3/185 3675
/proc/meminfo: memFree=12871384/32951124 swapFree=67111524/67111528
[pid=3613] ppid=3611 vsize=0 CPUtime=1300.33 cores=4,6
/proc/3613/stat : 3613 (tts-5-4) R 3611 3613 2940 0 -1 4203524 1850132 0 0 0 129543 490 0 0 25 0 1 0 470305812 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 4 0 0 0
/proc/3613/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1300.33
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.37
CPU time (s): 1300.41
CPU user time (s): 1295.43
CPU system time (s): 4.97924
CPU usage (%): 100.003
Max. virtual memory (cumulated for all children) (KiB): 7393636

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1295.43
system time used= 4.97924
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1850132
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 1496

runsolver used 2.32864 second user time and 4.77527 second system time

The end

Launcher Data 

Begin job on node102 at 2011-04-23 21:30:35
IDJOB=3251087
IDBENCH=88209
IDSOLVER=1653
FILE ID=node102/3251087-1303587034
RUNJOBID= node102-1303587034-3575
PBS_JOBID= 13150358
Free space on /tmp= 70692 MiB

SOLVER NAME= tts 5-4
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m47-q742.5-n45-p15-s28972035.cnf
COMMAND LINE= DIR/tts-5-4 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3251087-1303587034/watcher-3251087-1303587034 -o /tmp/evaluation-result-3251087-1303587034/solver-3251087-1303587034 -C 2400 -W 1300 -M 7680  HOME/tts-5-4 HOME/instance-3251087-1303587034.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= bfa662ff57088c54e0febd091ce11e5c
RANDOM SEED=1541791485

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12853816 kB
Buffers:       1839276 kB
Cached:       17584212 kB
SwapCached:          0 kB
Active:        9881464 kB
Inactive:      9657880 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12853816 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           25812 kB
Writeback:           0 kB
AnonPages:      115800 kB
Mapped:          14876 kB
Slab:           494568 kB
PageTables:       5184 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   282116 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 70696 MiB
End job on node102 at 2011-04-23 21:52:17