Trace number 1562760

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (TO) 1200.17 609.36

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l44_lambda.cnf
MD5SUMa7bc41b32260e4459b2bee7c18cacba1
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark189.575
Satisfiable
(Un)Satisfiability was proved
Number of variables31540
Number of clauses157264
Sum of the clauses size453246
Maximum clause length9
Minimum clause length1
Number of clauses of size 14112
Number of clauses of size 239373
Number of clauses of size 392004
Number of clauses of size 415027
Number of clauses of size 56616
Number of clauses of size over 5132

Solver Data 

0.39/0.43	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1562760-1240997690.cnf 
0.39/0.43	c Using SATTIMEOUT of 1200
0.39/0.43	c Using SATRAM of 1800
0.39/0.43	c Size of subset node = 16
0.39/0.43	c Variables = 31540
0.39/0.43	c Clauses = 157264
0.39/0.43	c Literals = 453246
0.39/0.43	c Reduced size:
0.39/0.43	c Variables = 31540
0.39/0.43	c Clauses = 141643
0.39/0.43	c Literals = 414027
0.39/0.43	c a2
0.79/0.89	c a1
13.68/13.72	c Independent sub-problems = 1
13.68/13.72	c Sub-problem with 26520 variables and 141643 clauses
13.68/13.72	c using permutation method 4
13.68/13.72	c count = 1
13.68/13.72	c Ordering finished 13.630 seconds
13.68/13.72	c mapped 13.710 seconds
13.68/13.72	c permuted 13.710 seconds
13.68/13.72	c about to sort
13.68/13.77	c sorted
15.79/15.84	c clauses now 141643
15.79/15.84	c init finished 13.900 seconds
15.79/15.84	c tree built 15.840 seconds
15.79/15.84	c 
15.79/15.84	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
15.79/15.84	c ---------------------------------|----------------------------------|------------------------------------------------------
15.79/15.84	c ................................ | ..........                       |                       15.8           0.0             
15.79/15.84	c ................................ | ..........                     1 |                       15.8           0.1             
15.79/15.84	c ****************................ | ..........                     2 |                       15.8           0.1            1
15.79/15.84	c ****************................ | ..........                     3 |                       15.8           0.2            1
15.79/15.84	c ****************................ | ..........                     4 |                       15.8           0.3            1
15.79/15.84	c ****************................ | ..........                     5 |                       15.8           0.3            1
15.79/15.84	c ****************................ | ..........                     6 |                       15.8           0.4            1
15.79/15.86	c ****************................ | ..........                  1000 | 3                     15.9          63.1          116
23.92/19.94	c ****************................ | ..........                289000 | 10421                 24.0       12036.7       838514
48.07/32.03	c ****************................ | ..........                659000 | 30857                 48.1       13689.2      3588125
72.22/44.10	c ****************................ | ..........                786000 | 38652                 72.2       10880.4      5817481
96.17/56.12	c ****************................ | ..........                881000 | 44512                 96.2        9156.1      7381464
120.12/68.17	c ****************................ | *.........                964000 | 49639                120.3        8014.6      8870755
144.27/80.21	c ****************................ | *.........               1037000 | 54144                144.3        7185.9     10564458
168.02/92.12	c ****************................ | *.........               1106000 | 58372                168.1        6579.8     12437353
191.96/104.15	c ****************................ | *.........               1170000 | 62347                192.1        6090.6     13943205
216.31/116.30	c ****************................ | *.........               1234000 | 66313                216.3        5703.7     15472865
239.86/128.19	c ****************................ | **........               1295000 | 70101                240.1        5394.0     17280501
264.20/140.30	c ****************................ | **........               1352000 | 73640                264.3        5116.2     18969246
288.15/152.33	c ****************................ | **........               1406000 | 76993                288.3        4877.5     20407428
312.10/164.39	c ****************................ | **........               1455000 | 80102                312.3        4658.4     21769764
335.85/176.28	c ****************................ | **........               1501000 | 83018                336.1        4466.3     23110248
360.20/188.46	c ****************................ | ***.......               1545000 | 85820                360.4        4287.0     24366363
384.15/200.47	c ****************................ | ***.......               1585000 | 88359                384.4        4123.7     25502674
408.10/212.43	c ****************................ | ***.......               1624000 | 90778                408.2        3978.2     26657833
431.86/224.36	c ****************................ | ***.......               1661000 | 93132                432.0        3844.6     27791658
455.80/236.40	c ****************................ | ***.......               1699000 | 95543                456.1        3725.3     29306265
479.74/248.39	c ****************................ | ****......               1736000 | 97896                480.0        3616.6     30366110
504.30/260.66	c ****************................ | ****......               1772000 | 100188               504.5        3512.5     31372536
527.85/272.49	c ****************................ | ****......               1806000 | 102356               528.1        3419.8     32435457
551.79/284.49	c ****************................ | ****......               1839000 | 104463               552.1        3331.2     33508373
575.73/296.48	c ****************................ | ****......               1871000 | 106500               576.0        3248.3     34300908
600.29/308.72	c ****************................ | *****.....               1903000 | 108542               600.4        3169.4     34984600
624.23/320.79	c ****************................ | *****.....               1934000 | 110513               624.5        3096.9     35769860
648.58/332.93	c ****************................ | *****.....               1964000 | 112431               648.7        3027.4     36573798
672.32/344.86	c ****************................ | *****.....               1994000 | 114332               672.5        2964.8     37524153
696.48/356.95	c ****************................ | *****.....               2024000 | 116255               696.7        2905.2     38341322
720.22/368.82	c ****************................ | ******....               2053000 | 118100               720.4        2849.8     39156399
744.57/381.02	c ****************................ | ******....               2082000 | 119954               744.7        2795.7     39887086
767.93/392.78	c ****************................ | ******....               2110000 | 121733               768.2        2746.6     40657708
791.88/404.74	c ****************................ | ******....               2137000 | 123457               792.1        2698.0     41438832
816.03/416.87	c ****************................ | ******....               2165000 | 125234               816.3        2652.3     42182492
840.57/429.14	c ****************................ | *******...               2194000 | 127083               840.8        2609.5     42811945
863.92/440.83	c ****************................ | *******...               2221000 | 128801               864.1        2570.3     43413613
888.07/452.95	c ****************................ | *******...               2248000 | 130520               888.3        2530.6     44109509
912.62/465.21	c ****************................ | *******...               2275000 | 132245               912.8        2492.4     44683227
936.56/477.23	c ****************................ | *******...               2298000 | 133718               936.8        2453.1     45257650
959.91/488.93	c ****************................ | ********..               2319000 | 135049               960.1        2415.3     45853969
984.46/501.29	c ****************................ | ********..               2342000 | 136511               984.8        2378.1     46527439
1007.81/512.94	c ****************................ | ********..               2400000 | 139792              1008.0        2380.8     47138504
1031.76/524.96	c ****************................ | ********..               2548000 | 149299              1032.0        2468.9     49190198
1055.90/537.03	c ****************................ | ********..               2662000 | 156634              1056.1        2520.5     50819700
1079.85/549.02	c ****************................ | *********.               2762000 | 163063              1080.1        2557.3     52169903
1104.00/561.14	c ****************................ | *********.               2849000 | 168653              1104.3        2580.0     53624095
1127.96/573.18	c ****************................ | *********.               2924000 | 173472              1128.3        2591.6     54800643
1152.10/585.23	c ****************................ | *********.               2988000 | 177594              1152.3        2593.0     55818938
1176.05/597.23	c ****************................ | *********.               3055000 | 181900              1176.3        2597.1     56882708

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1562760-1240997690/watcher-1562760-1240997690 -o /tmp/evaluation-result-1562760-1240997690/solver-1562760-1240997690 -C 1200 -W 1800 -M 1800 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1562760-1240997690.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.99 0.75 0.35 3/65 11696
/proc/meminfo: memFree=1258376/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=1064 CPUtime=0
/proc/11696/stat : 11696 (ttsth-5-0) R 11694 11696 11605 0 -1 4194304 149 0 0 0 0 0 0 0 20 0 1 0 127798980 1089536 133 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/11696/statm: 266 134 77 176 0 88 0

[startup+0.0934189 s]
/proc/loadavg: 0.99 0.75 0.35 3/65 11696
/proc/meminfo: memFree=1258376/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=4372 CPUtime=0.08
/proc/11696/stat : 11696 (ttsth-5-0) R 11694 11696 11605 0 -1 4194304 974 0 0 0 8 0 0 0 20 0 1 0 127798980 4476928 958 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/11696/statm: 1093 958 78 176 0 915 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 4372

[startup+0.101418 s]
/proc/loadavg: 0.99 0.75 0.35 3/65 11696
/proc/meminfo: memFree=1258376/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=4756 CPUtime=0.09
/proc/11696/stat : 11696 (ttsth-5-0) R 11694 11696 11605 0 -1 4194304 1046 0 0 0 9 0 0 0 20 0 1 0 127798980 4870144 1030 1992294400 134512640 135237372 4294956192 18446744073709551615 134762750 0 0 4096 0 0 0 0 17 1 0 0
/proc/11696/statm: 1189 1030 78 176 0 1011 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4756

[startup+0.30144 s]
/proc/loadavg: 0.99 0.75 0.35 3/65 11696
/proc/meminfo: memFree=1258376/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=11800 CPUtime=0.29
/proc/11696/stat : 11696 (ttsth-5-0) R 11694 11696 11605 0 -1 4194304 2744 0 0 0 29 0 0 0 22 0 1 0 127798980 12083200 2728 1992294400 134512640 135237372 4294956192 18446744073709551615 134534253 0 0 4096 0 0 0 0 17 1 0 0
/proc/11696/statm: 2950 2728 78 176 0 2772 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 11800

[startup+0.70148 s]
/proc/loadavg: 0.99 0.75 0.35 3/65 11696
/proc/meminfo: memFree=1258376/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=22900 CPUtime=0.69
/proc/11696/stat : 11696 (ttsth-5-0) R 11694 11696 11605 0 -1 4194304 5431 0 0 0 68 1 0 0 25 0 1 0 127798980 23449600 5387 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 17 1 0 0
/proc/11696/statm: 5725 5387 79 176 0 5547 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 22900

[startup+1.50156 s]
/proc/loadavg: 0.99 0.75 0.35 2/66 11697
/proc/meminfo: memFree=1237248/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=26904 CPUtime=1.49
/proc/11696/stat : 11696 (ttsth-5-0) R 11694 11696 11605 0 -1 4194304 7040 0 0 0 147 2 0 0 25 0 1 0 127798980 27549696 6529 1992294400 134512640 135237372 4294956192 18446744073709551615 134555272 0 0 4096 0 0 0 0 17 1 0 0
/proc/11696/statm: 6726 6530 80 176 0 6548 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 26904

[startup+3.10173 s]
/proc/loadavg: 0.99 0.75 0.35 2/66 11697
/proc/meminfo: memFree=1232256/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=27128 CPUtime=3.09
/proc/11696/stat : 11696 (ttsth-5-0) R 11694 11696 11605 0 -1 4194304 7060 0 0 0 307 2 0 0 25 0 1 0 127798980 27779072 6549 1992294400 134512640 135237372 4294956192 18446744073709551615 134600763 0 0 4096 0 0 0 0 17 1 0 0
/proc/11696/statm: 6782 6549 80 176 0 6604 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 27128

[startup+6.30106 s]
/proc/loadavg: 0.99 0.76 0.36 2/66 11697
/proc/meminfo: memFree=1231872/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=27260 CPUtime=6.29
/proc/11696/stat : 11696 (ttsth-5-0) R 11694 11696 11605 0 -1 4194304 7117 0 0 0 627 2 0 0 25 0 1 0 127798980 27914240 6606 1992294400 134512640 135237372 4294956192 18446744073709551615 134600746 0 0 4096 0 0 0 0 17 1 0 0
/proc/11696/statm: 6815 6606 80 176 0 6637 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 27260

[startup+12.7017 s]
/proc/loadavg: 0.99 0.76 0.36 2/66 11697
/proc/meminfo: memFree=1231744/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=27260 CPUtime=12.69
/proc/11696/stat : 11696 (ttsth-5-0) R 11694 11696 11605 0 -1 4194304 7139 0 0 0 1267 2 0 0 25 0 1 0 127798980 27914240 6628 1992294400 134512640 135237372 4294956192 18446744073709551615 134600718 0 0 4096 0 0 0 0 17 1 0 0
/proc/11696/statm: 6815 6628 80 176 0 6637 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 27260

[startup+25.5011 s]
/proc/loadavg: 1.15 0.80 0.38 3/68 11699
/proc/meminfo: memFree=1136368/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=144744 CPUtime=35.09
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 31571 0 0 0 3495 14 0 0 25 0 3 0 127798980 148217856 30782 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 36186 30782 98 176 0 36008 0
[pid=11696/tid=11698] ppid=11694 vsize=144744 CPUtime=9.64
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 2766 0 0 0 962 2 0 0 25 0 3 0 127800565 148217856 30782 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=144744 CPUtime=9.61
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 5773 0 0 0 958 3 0 0 25 0 3 0 127800565 148217856 30782 1992294400 134512640 135237372 4294956192 18446744073709551615 134562309 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 35.09
Current children cumulated vsize (KiB) 144744

[startup+51.1017 s]
/proc/loadavg: 1.44 0.90 0.42 3/68 11699
/proc/meminfo: memFree=1061296/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=222288 CPUtime=86.19
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 50169 0 0 0 8592 27 0 0 25 0 3 0 127798980 227622912 49380 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 55572 49380 98 176 0 55394 0
[pid=11696/tid=11698] ppid=11694 vsize=222288 CPUtime=35.23
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 11129 0 0 0 3516 7 0 0 25 0 3 0 127800565 227622912 49380 1992294400 134512640 135237372 4294956192 18446744073709551615 134562346 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=222288 CPUtime=35.1
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 16008 0 0 0 3500 10 0 0 25 0 3 0 127800565 227622912 49380 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 86.19
Current children cumulated vsize (KiB) 222288

[startup+102.305 s]
/proc/loadavg: 1.75 1.07 0.50 3/68 11699
/proc/meminfo: memFree=950768/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=336076 CPUtime=188.38
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 77580 0 0 0 18790 48 0 0 25 0 3 0 127798980 344141824 76791 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 84019 76791 98 176 0 83841 0
[pid=11696/tid=11698] ppid=11694 vsize=336076 CPUtime=86.43
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 21081 0 0 0 8629 14 0 0 25 0 3 0 127800565 344141824 76791 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=336076 CPUtime=86.09
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 33467 0 0 0 8585 24 0 0 25 0 3 0 127800565 344141824 76791 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 188.38
Current children cumulated vsize (KiB) 336076

[startup+162.301 s]
/proc/loadavg: 1.91 1.23 0.59 3/68 11699
/proc/meminfo: memFree=829808/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=461052 CPUtime=308.12
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 108007 0 0 0 30744 68 0 0 25 0 3 0 127798980 472117248 107218 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 115263 107218 98 176 0 115085 0
[pid=11696/tid=11698] ppid=11694 vsize=461052 CPUtime=146.4
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 30908 0 0 0 14621 19 0 0 25 0 3 0 127800565 472117248 107218 1992294400 134512640 135237372 4294956192 18446744073709551615 134680467 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=461052 CPUtime=145.86
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 54067 0 0 0 14547 39 0 0 25 0 3 0 127800565 472117248 107218 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 308.12
Current children cumulated vsize (KiB) 461052

[startup+222.302 s]
/proc/loadavg: 1.96 1.37 0.68 3/68 11699
/proc/meminfo: memFree=733872/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=559900 CPUtime=427.86
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 131713 0 0 0 42704 82 0 0 25 0 3 0 127798980 573337600 130924 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 139975 130924 98 176 0 139797 0
[pid=11696/tid=11698] ppid=11694 vsize=559900 CPUtime=206.38
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 40107 0 0 0 20615 23 0 0 25 0 3 0 127800565 573337600 130924 1992294400 134512640 135237372 4294956192 18446744073709551615 134562416 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=559900 CPUtime=205.62
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 68574 0 0 0 20513 49 0 0 25 0 3 0 127800565 573337600 130924 1992294400 134512640 135237372 4294956192 18446744073709551615 134587177 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 427.86
Current children cumulated vsize (KiB) 559900

[startup+282.302 s]
/proc/loadavg: 1.98 1.48 0.76 3/68 11701
/proc/meminfo: memFree=644592/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=652176 CPUtime=547.6
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 154181 0 0 0 54661 99 0 0 25 0 3 0 127798980 667828224 153392 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 163044 153392 98 176 0 162866 0
[pid=11696/tid=11698] ppid=11694 vsize=652176 CPUtime=266.37
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 46694 0 0 0 26610 27 0 0 25 0 3 0 127800565 667828224 153392 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=652176 CPUtime=265.38
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 84455 0 0 0 26476 62 0 0 25 0 3 0 127800565 667828224 153392 1992294400 134512640 135237372 4294956192 18446744073709551615 134680320 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 547.6
Current children cumulated vsize (KiB) 652176

[startup+342.302 s]
/proc/loadavg: 1.99 1.57 0.83 3/68 11701
/proc/meminfo: memFree=580912/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=716128 CPUtime=667.34
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 169874 0 0 0 66625 109 0 0 25 0 3 0 127798980 733315072 169085 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 179032 169085 98 176 0 178854 0
[pid=11696/tid=11698] ppid=11694 vsize=716128 CPUtime=326.35
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 51921 0 0 0 32605 30 0 0 25 0 3 0 127800565 733315072 169085 1992294400 134512640 135237372 4294956192 18446744073709551615 134562430 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=716128 CPUtime=325.14
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 94921 0 0 0 32445 69 0 0 25 0 3 0 127800565 733315072 169085 1992294400 134512640 135237372 4294956192 18446744073709551615 134593221 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 667.34
Current children cumulated vsize (KiB) 716128

[startup+402.301 s]
/proc/loadavg: 1.99 1.65 0.90 3/68 11701
/proc/meminfo: memFree=519728/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=782312 CPUtime=787.08
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 185282 0 0 0 78591 117 0 0 25 0 3 0 127798980 801087488 184493 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 195578 184493 98 176 0 195400 0
[pid=11696/tid=11698] ppid=11694 vsize=782312 CPUtime=386.33
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 56170 0 0 0 38601 32 0 0 25 0 3 0 127800565 801087488 184493 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=782312 CPUtime=384.9
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 106080 0 0 0 38414 76 0 0 25 0 3 0 127800565 801087488 184493 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 787.08
Current children cumulated vsize (KiB) 782312

[startup+462.302 s]
/proc/loadavg: 1.99 1.71 0.97 3/68 11701
/proc/meminfo: memFree=467504/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=836244 CPUtime=906.82
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 198163 0 0 0 90557 125 0 0 25 0 3 0 127798980 856313856 197374 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 209061 197374 98 176 0 208883 0
[pid=11696/tid=11698] ppid=11694 vsize=836244 CPUtime=446.31
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 61728 0 0 0 44596 35 0 0 25 0 3 0 127800565 856313856 197374 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=836244 CPUtime=444.65
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 113403 0 0 0 44385 80 0 0 25 0 3 0 127800565 856313856 197374 1992294400 134512640 135237372 4294956192 18446744073709551615 134591177 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 906.82
Current children cumulated vsize (KiB) 836244

[startup+522.302 s]
/proc/loadavg: 1.99 1.76 1.03 3/68 11701
/proc/meminfo: memFree=402608/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=905708 CPUtime=1026.57
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 214847 0 0 0 102519 138 0 0 25 0 3 0 127798980 927444992 214058 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 226427 214058 98 176 0 226249 0
[pid=11696/tid=11698] ppid=11694 vsize=905708 CPUtime=506.3
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 70667 0 0 0 50588 42 0 0 25 0 3 0 127800565 927444992 214058 1992294400 134512640 135237372 4294956192 18446744073709551615 134519954 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=905708 CPUtime=504.42
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 121148 0 0 0 50356 86 0 0 25 0 3 0 127800565 927444992 214058 1992294400 134512640 135237372 4294956192 18446744073709551615 134562399 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1026.57
Current children cumulated vsize (KiB) 905708

[startup+582.302 s]
/proc/loadavg: 1.99 1.80 1.09 3/68 11701
/proc/meminfo: memFree=294576/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=1015240 CPUtime=1146.31
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 241413 0 0 0 114475 156 0 0 25 0 3 0 127798980 1039605760 240624 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 253810 240624 98 176 0 253632 0
[pid=11696/tid=11698] ppid=11694 vsize=1015240 CPUtime=566.29
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 89825 0 0 0 56577 52 0 0 25 0 3 0 127800565 1039605760 240624 1992294400 134512640 135237372 4294956192 18446744073709551615 134749339 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=1015240 CPUtime=564.17
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 128556 0 0 0 56323 94 0 0 25 0 3 0 127800565 1039605760 240624 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1146.31
Current children cumulated vsize (KiB) 1015240



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+609.202 s]
/proc/loadavg: 1.99 1.82 1.11 3/68 11701
/proc/meminfo: memFree=258672/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=1050916 CPUtime=1200.01
/proc/11696/stat : 11696 (ttsth-5-0) S 11694 11696 11605 0 -1 4194304 250155 0 0 0 119838 163 0 0 25 0 3 0 127798980 1076137984 249366 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 262729 249366 98 176 0 262551 0
[pid=11696/tid=11698] ppid=11694 vsize=1050916 CPUtime=593.18
/proc/11696/task/11698/stat : 11698 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 94902 0 0 0 59263 55 0 0 25 0 3 0 127800565 1076137984 249366 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=11696/tid=11699] ppid=11694 vsize=1050916 CPUtime=590.97
/proc/11696/task/11699/stat : 11699 (ttsth-5-0) R 11694 11696 11605 0 -1 4194368 132221 0 0 0 58999 98 0 0 25 0 3 0 127800565 1076137984 249366 1992294400 134512640 135237372 4294956192 18446744073709551615 134749353 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1200.01
Current children cumulated vsize (KiB) 1050916

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+609.313 s]
/proc/loadavg: 1.91 1.80 1.11 2/68 11702
/proc/meminfo: memFree=959592/2055920 swapFree=4181368/4192956
[pid=11696] ppid=11694 vsize=0 CPUtime=1200.12
/proc/11696/stat : 11696 (ttsth-5-0) Z 11694 11696 11605 0 -1 4195340 250161 0 0 0 119839 173 0 0 16 0 2 0 127798980 0 0 1992294400 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/11696/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.12
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 609.36
CPU time (s): 1200.17
CPU user time (s): 1198.39
CPU system time (s): 1.77373
CPU usage (%): 196.956
Max. virtual memory (cumulated for all children) (KiB): 1050916

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1198.39
system time used= 1.77373
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 250161
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 69
involuntary context switches= 9110

runsolver used 0.541917 second user time and 1.69074 second system time

The end

Launcher Data 

Begin job on node79 at 2009-04-29 11:34:50
IDJOB=1562760
IDBENCH=70940
IDSOLVER=549
FILE ID=node79/1562760-1240997690
PBS_JOBID= 9204793
Free space on /tmp= 65992 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l44_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1562760-1240997690/watcher-1562760-1240997690 -o /tmp/evaluation-result-1562760-1240997690/solver-1562760-1240997690 -C 1200 -W 1800 -M 1800  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1562760-1240997690.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= a7bc41b32260e4459b2bee7c18cacba1
RANDOM SEED=995942869

node79.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.220
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.220
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1258792 kB
Buffers:         59180 kB
Cached:         644512 kB
SwapCached:       5480 kB
Active:          99560 kB
Inactive:       612508 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1258792 kB
SwapTotal:     4192956 kB
SwapFree:      4181368 kB
Dirty:            3700 kB
Writeback:           0 kB
Mapped:          14080 kB
Slab:            71052 kB
Committed_AS:   559048 kB
PageTables:       1384 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 65992 MiB
End job on node79 at 2009-04-29 11:45:01