Trace number 3264069

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
tts 5-4? (TO) 1300.15 1300.13

General information on the benchmark

NameSAT04/handmade/kexu/frb-0.6/
frb75-13-2.used-as.sat04-878.cnf
MD5SUM00e6f1cbbaaa8f43dc6451d49bfa1cef
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.241962
Satisfiable
(Un)Satisfiability was proved
Number of variables975
Number of clauses34275
Sum of the clauses size69375
Maximum clause length13
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 234200
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data 

0.01/0.02	c Command: HOME/tts-5-4 HOME/instance-3264069-1303577754.cnf 
0.01/0.02	c Using SATTIMEOUT of 2400
0.01/0.02	c Using SATRAM of 7680
0.01/0.02	c Size of subset node = 32
0.01/0.02	c Variables = 975
0.01/0.02	c Clauses = 34275
0.01/0.02	c Literals = 69375
0.01/0.02	c Reduced size:
0.01/0.02	c Variables = 975
0.01/0.02	c Clauses = 34275
0.01/0.02	c Literals = 69375
0.01/0.02	c a2
0.01/0.04	c a1
0.01/0.08	c Independent sub-problems = 1
0.01/0.08	c Sub-problem with 975 variables and 34275 clauses
0.01/0.08	c using permutation method 4
0.01/0.08	c count = 1
0.01/0.08	c Ordering finished 0.070 seconds
0.01/0.08	c mapped 0.070 seconds
0.01/0.08	c permuted 0.070 seconds
0.01/0.08	c about to sort
0.01/0.08	c sorted
0.09/0.13	c clauses now 34275
0.09/0.13	c init finished 0.080 seconds
0.09/0.13	c tree built 0.130 seconds
0.09/0.13	c 
0.09/0.13	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.09/0.13	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.09/0.13	c ................................ | ..........                    |                                  0.1         0.0             
0.09/0.13	c ................................ | ..........                  1 |                                  0.1         7.7             
0.09/0.13	c ................................ | ..........                  2 |                                  0.1        15.4             
0.09/0.13	c ................................ | ..........                  3 |                                  0.1        23.1             
0.09/0.13	c ................................ | ..........                  4 |                                  0.1        30.8             
0.09/0.13	c ................................ | ..........                  5 |                                  0.1        38.5             
0.09/0.14	c ................................ | ..........               1000 | 26           96                  0.1      7692.3         3093
47.99/48.01	c ................................ | ..........            4897000 | 174376       345670             48.0    102020.8     13508146
95.99/96.00	c ................................ | ..........            7731000 | 286737       541176             96.0     80531.2     20389668
143.99/144.01	c ................................ | ..........           10291000 | 384605       706246            144.0     71465.3     27048156
191.99/192.02	c ................................ | ..........           12232000 | 466716       820580            192.0     63705.0     29124946
239.99/240.01	c ................................ | *.........           15605000 | 592612       1048204           240.0     65018.1     37366824
288.00/288.01	c ................................ | *.........           18376000 | 706431       1230653           288.0     63805.6     44027047
336.00/336.01	c ................................ | *.........           20484000 | 784660       1370943           336.0     60962.5     48931085
383.99/384.00	c ................................ | *.........           22378000 | 861592       1493787           384.0     58276.0     52675565
431.99/432.01	c ................................ | *.........           24280000 | 937130       1624423           432.0     56203.7     57289783
479.99/480.00	c ................................ | **........           25901000 | 1003243      1731235           480.0     53960.4     61007242
528.00/528.01	c ................................ | **........           27166000 | 1053335      1813914           528.0     51450.8     63495014
575.99/576.02	c ................................ | **........           28337000 | 1100152      1887050           576.0     49195.3     63495014
624.00/624.00	c ................................ | **........           29792000 | 1161668      1983179           624.0     47742.8     63495014
672.01/672.01	c ................................ | **........           31145000 | 1213253      2073007           672.0     46345.3     63495014
719.90/719.99	c ................................ | ***.......           32277000 | 1253576      2146788           720.0     44829.2     65267007
768.00/768.02	c ................................ | ***.......           33319000 | 1293311      2214551           768.0     43383.0     67028636
816.00/816.01	c ................................ | ***.......           34267000 | 1330173      2273422           816.0     41993.4     67473287
864.01/864.00	c ................................ | ***.......           35559000 | 1383115      2359563           864.0     41155.8     68717048
912.01/912.00	c ................................ | ***.......           37038000 | 1447374      2443475           912.0     40611.4     70494296
959.91/959.99	c ................................ | ****......           39337000 | 1538195      2595988           960.0     40976.0     74897562
1007.91/1007.99	c ................................ | ****......           41115000 | 1610762      2709596          1008.0     40788.7     78508360
1055.91/1056.00	c ................................ | ****......           42757000 | 1677979      2818776          1056.0     40489.2     83570500
1104.01/1104.01	c ................................ | ****......           44315000 | 1743230      2919357          1104.0     40139.7     88065164
1152.01/1152.01	c ................................ | ****......           46102000 | 1832813      3033609          1152.0     40018.4     91765201
1199.91/1199.99	c ................................ | *****.....           47854000 | 1911053      3151441          1200.0     39878.3     96323397
1247.91/1247.99	c ................................ | *****.....           49451000 | 1984967      3256103          1248.0     39623.9    100135704
1296.01/1296.02	c ................................ | *****.....           51089000 | 2051920      3366293          1296.0     39419.6    103830168

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3264069-1303577754/watcher-3264069-1303577754 -o /tmp/evaluation-result-3264069-1303577754/solver-3264069-1303577754 -C 2400 -W 1300 -M 7680 HOME/tts-5-4 HOME/instance-3264069-1303577754.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.45 3.88 3.87 3/182 12414
/proc/meminfo: memFree=14242620/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=6940 CPUtime=0 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 309 0 0 0 0 0 0 0 24 0 1 0 548006172 7106560 254 33554432000 4194304 4337412 140734259780208 18446744073709551615 215988253381 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 1735 255 131 35 0 176 0

[startup+0.016514 s]
/proc/loadavg: 3.45 3.88 3.87 3/182 12414
/proc/meminfo: memFree=14242620/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=9132 CPUtime=0.01 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 866 0 0 0 1 0 0 0 24 0 1 0 548006172 9351168 811 33554432000 4194304 4337412 140734259780208 18446744073709551615 215988253381 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 2283 812 132 35 0 724 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 9132

[startup+0.100503 s]
/proc/loadavg: 3.45 3.88 3.87 3/182 12414
/proc/meminfo: memFree=14242620/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=17776 CPUtime=0.09 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 3244 0 0 0 9 0 0 0 24 0 1 0 548006172 18202624 2987 33554432000 4194304 4337412 140734259780208 18446744073709551615 215988253381 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 4444 2990 150 35 0 2885 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 17776

[startup+0.300464 s]
/proc/loadavg: 3.45 3.88 3.87 3/182 12414
/proc/meminfo: memFree=14242620/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=32000 CPUtime=0.29 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 6222 0 0 0 29 0 0 0 25 0 1 0 548006172 32768000 5965 33554432000 4194304 4337412 140734259780208 18446744073709551615 4255373 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 8000 5965 156 35 0 6441 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 32000

[startup+0.700397 s]
/proc/loadavg: 3.45 3.88 3.87 3/182 12414
/proc/meminfo: memFree=14242620/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=38408 CPUtime=0.68 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 8083 0 0 0 68 0 0 0 25 0 1 0 548006172 39329792 7826 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253456 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 9602 7826 156 35 0 8043 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 38408

[startup+1.50026 s]
/proc/loadavg: 3.45 3.88 3.87 5/190 12479
/proc/meminfo: memFree=14079984/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=51052 CPUtime=1.49 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 11053 0 0 0 148 1 0 0 25 0 1 0 548006172 52277248 10796 33554432000 4194304 4337412 140734259780208 18446744073709551615 4238634 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 12763 10796 156 35 0 11204 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 51052

[startup+3.10098 s]
/proc/loadavg: 3.45 3.88 3.87 5/190 12479
/proc/meminfo: memFree=14007568/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=73092 CPUtime=3.08 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 16459 0 0 0 306 2 0 0 25 0 1 0 548006172 74846208 16202 33554432000 4194304 4337412 140734259780208 18446744073709551615 215987987832 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 18273 16202 156 35 0 16714 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 73092

[startup+6.30042 s]
/proc/loadavg: 3.49 3.88 3.87 5/190 12479
/proc/meminfo: memFree=13849856/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=111024 CPUtime=6.28 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 26215 0 0 0 624 4 0 0 25 0 1 0 548006172 113688576 25958 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253539 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 27756 25959 156 35 0 26197 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 111024

[startup+12.7003 s]
/proc/loadavg: 3.53 3.89 3.87 5/190 12479
/proc/meminfo: memFree=13570196/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=180368 CPUtime=12.69 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 43643 0 0 0 1261 8 0 0 25 0 1 0 548006172 184696832 43386 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253636 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 45092 43386 156 35 0 43533 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 180368

[startup+25.5011 s]
/proc/loadavg: 3.64 3.89 3.87 5/190 12479
/proc/meminfo: memFree=13139116/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=282588 CPUtime=25.48 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 68666 0 0 0 2536 12 0 0 25 0 1 0 548006172 289370112 68409 33554432000 4194304 4337412 140734259780208 18446744073709551615 4284709 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 70647 68409 156 35 0 69088 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 282588

[startup+51.1006 s]
/proc/loadavg: 3.82 3.91 3.88 5/190 12480
/proc/meminfo: memFree=12410264/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=474980 CPUtime=51.09 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 117395 0 0 0 5085 24 0 0 25 0 1 0 548006172 486379520 117138 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253559 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 118745 117138 156 35 0 117186 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 474980

[startup+102.307 s]
/proc/loadavg: 3.92 3.92 3.89 5/190 12481
/proc/meminfo: memFree=11476768/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=706428 CPUtime=102.3 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 174730 0 0 0 10194 36 0 0 25 0 1 0 548006172 723382272 174473 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 176607 174473 156 35 0 175048 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 706428

[startup+162.301 s]
/proc/loadavg: 3.97 3.94 3.89 5/190 12483
/proc/meminfo: memFree=10607372/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=927104 CPUtime=162.29 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 230138 0 0 0 16180 49 0 0 25 0 1 0 548006172 949354496 229881 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253555 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 231776 229881 156 35 0 230217 0
Current children cumulated CPU time (s) 162.29
Current children cumulated vsize (KiB) 927104

[startup+222.301 s]
/proc/loadavg: 3.99 3.94 3.90 5/190 12485
/proc/meminfo: memFree=9582252/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=1131992 CPUtime=222.29 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 279023 0 0 0 22168 61 0 0 25 0 1 0 548006172 1159159808 278766 33554432000 4194304 4337412 140734259780208 18446744073709551615 4233676 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 282998 278766 156 35 0 281439 0
Current children cumulated CPU time (s) 222.29
Current children cumulated vsize (KiB) 1131992

[startup+282.301 s]
/proc/loadavg: 4.03 3.97 3.91 5/190 12486
/proc/meminfo: memFree=8585264/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=1409104 CPUtime=282.29 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 348339 0 0 0 28149 80 0 0 25 0 1 0 548006172 1442922496 348082 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253555 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 352276 348082 156 35 0 350717 0
Current children cumulated CPU time (s) 282.29
Current children cumulated vsize (KiB) 1409104

[startup+342.301 s]
/proc/loadavg: 4.01 3.97 3.91 5/190 12497
/proc/meminfo: memFree=7998100/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=1595108 CPUtime=342.29 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 394669 0 0 0 34136 93 0 0 25 0 1 0 548006172 1633390592 394412 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 398777 394412 156 35 0 397218 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 1595108

[startup+402.301 s]
/proc/loadavg: 4.00 3.97 3.91 5/190 12498
/proc/meminfo: memFree=7350288/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=1778116 CPUtime=402.29 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 440736 0 0 0 40124 105 0 0 25 0 1 0 548006172 1820790784 440479 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253687 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 444529 440479 156 35 0 442970 0
Current children cumulated CPU time (s) 402.29
Current children cumulated vsize (KiB) 1778116

[startup+462.301 s]
/proc/loadavg: 4.00 3.97 3.91 5/190 12500
/proc/meminfo: memFree=6850916/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=1919800 CPUtime=462.29 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 476347 0 0 0 46113 116 0 0 25 0 1 0 548006172 1965875200 476090 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 479950 476090 156 35 0 478391 0
Current children cumulated CPU time (s) 462.29
Current children cumulated vsize (KiB) 1919800

[startup+522.301 s]
/proc/loadavg: 4.09 4.00 3.92 5/190 12502
/proc/meminfo: memFree=6357840/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=2069452 CPUtime=522.3 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 512982 0 0 0 52103 127 0 0 25 0 1 0 548006172 2119118848 512725 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253652 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 517363 512725 156 35 0 515804 0
Current children cumulated CPU time (s) 522.3
Current children cumulated vsize (KiB) 2069452

[startup+582.301 s]
/proc/loadavg: 4.03 4.00 3.92 5/190 12503
/proc/meminfo: memFree=6007996/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=2070112 CPUtime=582.3 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 513148 0 0 0 58100 130 0 0 25 0 1 0 548006172 2119794688 512891 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253555 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 517528 512891 156 35 0 515969 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 2070112

[startup+642.301 s]
/proc/loadavg: 4.01 4.00 3.92 5/190 12505
/proc/meminfo: memFree=5601240/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=2070904 CPUtime=642.3 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 513349 0 0 0 64099 131 0 0 25 0 1 0 548006172 2120605696 513092 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253555 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 517726 513092 156 35 0 516167 0
Current children cumulated CPU time (s) 642.3
Current children cumulated vsize (KiB) 2070904

[startup+702.301 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 12506
/proc/meminfo: memFree=5326400/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=2093460 CPUtime=702.3 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 518834 0 0 0 70096 134 0 0 25 0 1 0 548006172 2143703040 518577 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253507 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 523365 518577 156 35 0 521806 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 2093460

[startup+762.307 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 12508
/proc/meminfo: memFree=4975536/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=2175448 CPUtime=762.31 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 538776 0 0 0 76089 142 0 0 25 0 1 0 548006172 2227658752 538519 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 543862 538519 156 35 0 542303 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 2175448

[startup+822.301 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 12510
/proc/meminfo: memFree=4657956/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=2197872 CPUtime=822.3 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 544927 0 0 0 82085 145 0 0 25 0 1 0 548006172 2250620928 544670 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253652 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 549468 544670 156 35 0 547909 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 2197872

[startup+882.301 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 12511
/proc/meminfo: memFree=4312844/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=2283252 CPUtime=882.3 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 565857 0 0 0 88079 151 0 0 25 0 1 0 548006172 2338050048 565600 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 570813 565600 156 35 0 569254 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 2283252

[startup+942.301 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 12513
/proc/meminfo: memFree=3777424/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=2425464 CPUtime=942.31 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 601745 0 0 0 94070 161 0 0 25 0 1 0 548006172 2483675136 601488 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 606366 601488 156 35 0 604807 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 2425464

[startup+1002.3 s]
/proc/loadavg: 4.00 4.00 3.92 5/190 12514
/proc/meminfo: memFree=3270528/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=2530140 CPUtime=1002.31 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 627745 0 0 0 100063 168 0 0 25 0 1 0 548006172 2590863360 627488 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 632535 627488 156 35 0 630976 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 2530140

[startup+1062.3 s]
/proc/loadavg: 4.04 4.01 3.93 5/190 12516
/proc/meminfo: memFree=2764288/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=2731652 CPUtime=1062.31 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 677948 0 0 0 106050 181 0 0 25 0 1 0 548006172 2797211648 677691 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253512 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 682913 677691 156 35 0 681354 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 2731652

[startup+1122.3 s]
/proc/loadavg: 4.05 4.02 3.93 5/190 12518
/proc/meminfo: memFree=2467512/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=2901752 CPUtime=1122.31 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 721100 0 0 0 112036 195 0 0 25 0 1 0 548006172 2971394048 720843 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253652 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 725438 720843 156 35 0 723879 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 2901752

[startup+1182.3 s]
/proc/loadavg: 4.02 4.02 3.93 5/190 12519
/proc/meminfo: memFree=2210136/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=3062732 CPUtime=1182.31 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 760842 0 0 0 118022 209 0 0 25 0 1 0 548006172 3136237568 760585 33554432000 4194304 4337412 140734259780208 18446744073709551615 4256622 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 765683 760585 156 35 0 764124 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 3062732

[startup+1242.3 s]
/proc/loadavg: 4.00 4.01 3.93 5/190 12521
/proc/meminfo: memFree=2006088/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=3214064 CPUtime=1242.31 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 798741 0 0 0 124009 222 0 0 25 0 1 0 548006172 3291201536 798484 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253555 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 803516 798484 156 35 0 801957 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 3214064



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.00 4.01 3.93 5/190 12522
/proc/meminfo: memFree=1649088/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=3356012 CPUtime=1300.02 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4202496 834539 0 0 0 129767 235 0 0 25 0 1 0 548006172 3436556288 834282 33554432000 4194304 4337412 140734259780208 18446744073709551615 4253555 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/12414/statm: 839003 834282 156 35 0 837444 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 3356012

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.11 s]
/proc/loadavg: 4.00 4.01 3.93 5/191 12523
/proc/meminfo: memFree=4357016/32950940 swapFree=67111528/67111528
[pid=12414] ppid=12412 vsize=0 CPUtime=1300.12 cores=5,7
/proc/12414/stat : 12414 (tts-5-4) R 12412 12414 12364 0 -1 4203524 834539 0 0 0 129767 245 0 0 25 0 1 0 548006172 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/12414/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1300.12
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.13
CPU time (s): 1300.15
CPU user time (s): 1297.68
CPU system time (s): 2.47262
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 3356012

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1297.68
system time used= 2.47262
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 834539
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 810

runsolver used 1.9807 second user time and 5.12522 second system time

The end

Launcher Data 

Begin job on node117 at 2011-04-23 18:55:54
IDJOB=3264069
IDBENCH=84551
IDSOLVER=1653
FILE ID=node117/3264069-1303577754
RUNJOBID= node117-1303577754-12385
PBS_JOBID= 13150333
Free space on /tmp= 71464 MiB

SOLVER NAME= tts 5-4
BENCH NAME= SAT04/handmade/kexu/frb-0.6/frb75-13-2.used-as.sat04-878.cnf
COMMAND LINE= DIR/tts-5-4 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3264069-1303577754/watcher-3264069-1303577754 -o /tmp/evaluation-result-3264069-1303577754/solver-3264069-1303577754 -C 2400 -W 1300 -M 7680  HOME/tts-5-4 HOME/instance-3264069-1303577754.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 00e6f1cbbaaa8f43dc6451d49bfa1cef
RANDOM SEED=978680276

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      14242776 kB
Buffers:       2312980 kB
Cached:       15771312 kB
SwapCached:          0 kB
Active:       10466324 kB
Inactive:      7684208 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      14242776 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:             616 kB
Writeback:           0 kB
AnonPages:       65468 kB
Mapped:          14332 kB
Slab:           492348 kB
PageTables:       4992 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS:   227288 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71460 MiB
End job on node117 at 2011-04-23 19:17:36