Trace number 1563228

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (TO) 1200.13 610.182

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l45_lambda.cnf
MD5SUM94aa7bdbcbe99c5b3082c395dc2384e9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark282.168
Satisfiable
(Un)Satisfiability was proved
Number of variables32313
Number of clauses161529
Sum of the clauses size465707
Maximum clause length9
Minimum clause length1
Number of clauses of size 14190
Number of clauses of size 240231
Number of clauses of size 394818
Number of clauses of size 415389
Number of clauses of size 56766
Number of clauses of size over 5135

Solver Data 

0.39/0.48	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1563228-1241001378.cnf 
0.39/0.48	c Using SATTIMEOUT of 1200
0.39/0.48	c Using SATRAM of 1800
0.39/0.48	c Size of subset node = 16
0.39/0.48	c Variables = 32313
0.39/0.48	c Clauses = 161529
0.39/0.48	c Literals = 465707
0.39/0.48	c Reduced size:
0.39/0.48	c Variables = 32313
0.39/0.48	c Clauses = 145662
0.39/0.48	c Literals = 425876
0.39/0.48	c a2
0.89/0.98	c a1
14.89/15.00	c Independent sub-problems = 1
14.89/15.00	c Sub-problem with 27215 variables and 145662 clauses
14.89/15.00	c using permutation method 4
14.89/15.00	c count = 1
14.89/15.00	c Ordering finished 14.900 seconds
14.89/15.00	c mapped 14.990 seconds
14.89/15.00	c permuted 14.990 seconds
14.89/15.00	c about to sort
14.99/15.06	c sorted
17.28/17.39	c clauses now 145662
17.28/17.39	c init finished 15.190 seconds
17.28/17.39	c tree built 17.380 seconds
17.28/17.39	c 
17.28/17.39	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
17.28/17.39	c ---------------------------------|----------------------------------|------------------------------------------------------
17.28/17.39	c ................................ | ..........                       |                       17.4           0.0             
17.28/17.39	c ................................ | ..........                     1 |                       17.4           0.1             
17.28/17.39	c ****************................ | ..........                     2 |                       17.4           0.1            1
17.28/17.39	c ****************................ | ..........                     3 |                       17.4           0.2            1
17.28/17.39	c ****************................ | ..........                     4 |                       17.4           0.2            1
17.28/17.39	c ****************................ | ..........                     5 |                       17.4           0.3            1
17.28/17.39	c ****************................ | ..........                     6 |                       17.4           0.3            1
17.40/17.40	c ****************................ | ..........                  1000 | 3                     17.4          57.4          138
23.97/20.71	c ****************................ | ..........                139000 | 2915                  24.0        5789.3       979420
47.93/32.76	c ****************................ | ..........                531000 | 11647                 48.0       11051.0      4125298
71.87/44.78	c ****************................ | ..........                873000 | 19351                 72.1       12114.9      6557137
95.82/56.78	c ****************................ | ..........               1187000 | 26405                 96.0       12363.3      8420096
119.97/68.82	c ****************................ | *.........               1497000 | 33376                120.0       12470.8     10323407
143.92/80.83	c ****************................ | *.........               1792000 | 40017                144.0       12443.6     12175410
167.86/92.87	c ****************................ | *.........               2091000 | 46716                168.0       12444.2     13973697
192.01/104.92	c ****************................ | *.........               2372000 | 53036                192.1       12349.0     15791063
215.96/116.93	c ****************................ | *.........               2636000 | 59008                216.1       12200.3     17601376
239.91/128.94	c ****************................ | **........               2889000 | 64748                240.0       12035.5     19671131
263.85/140.98	c ****************................ | **........               3148000 | 70623                264.1       11920.6     22306818
287.81/152.99	c ****************................ | **........               3406000 | 76434                288.0       11825.2     24865627
311.96/165.00	c ****************................ | **........               3643000 | 81995                312.0       11675.5     26855945
335.90/177.04	c ****************................ | **........               3897000 | 87855                336.1       11596.5     28672553
359.85/189.06	c ****************................ | ***.......               4154000 | 93822                360.0       11537.9     30739759
384.00/201.11	c ****************................ | ***.......               4394000 | 99394                384.1       11440.3     32790940
407.95/213.14	c ****************................ | ***.......               4625000 | 104689               408.1       11333.3     34311972
431.90/225.12	c ****************................ | ***.......               4855000 | 110049               432.0       11238.2     36058619
455.85/237.15	c ****************................ | ***.......               5090000 | 115587               456.0       11161.5     37564600
479.80/249.17	c ****************................ | ****......               5303000 | 121011               480.0       11047.7     39092552
503.94/261.21	c ****************................ | ****......               5512000 | 126760               504.1       10935.4     40759633
527.88/273.21	c ****************................ | ****......               5749000 | 132470               528.0       10888.3     42355606
551.83/285.28	c ****************................ | ****......               5977000 | 138261               552.1       10826.1     43983001
575.98/297.31	c ****************................ | ****......               6181000 | 143200               576.1       10729.0     45604742
599.93/309.32	c ****************................ | *****.....               6386000 | 148231               600.1       10642.3     46958657
623.88/321.31	c ****************................ | *****.....               6578000 | 153569               624.0       10541.7     48294261
647.83/333.36	c ****************................ | *****.....               6772000 | 158407               648.0       10450.0     49501296
671.78/345.40	c ****************................ | *****.....               6973000 | 165181               672.1       10375.3     51364948
695.73/357.39	c ****************................ | *****.....               7161000 | 171964               696.0       10288.5     53076981
719.87/369.47	c ****************................ | ******....               7353000 | 178364               720.1       10210.7     54456456
743.82/381.44	c ****************................ | ******....               7516000 | 185237               744.0       10101.7     55795327
767.97/393.50	c ****************................ | ******....               7728000 | 191792               768.1       10061.2     58028605
791.92/405.53	c ****************................ | ******....               7934000 | 197284               792.1       10016.3     60086114
815.87/417.53	c ****************................ | ******....               8157000 | 203774               816.1        9995.6     62250873
839.82/429.58	c ****************................ | *******...               8391000 | 210250               840.1        9988.0     64249178
863.96/441.60	c ****************................ | *******...               8594000 | 216403               864.1        9945.7     66346803
887.71/453.59	c ****************................ | *******...               8785000 | 222361               888.0        9892.7     68490304
911.86/465.63	c ****************................ | *******...               8964000 | 228655               912.1        9828.3     70605280
936.01/477.71	c ****************................ | *******...               9138000 | 234748               936.2        9760.8     72562213
959.76/489.68	c ****************................ | ********..               9296000 | 239798               960.1        9682.6     74065002
983.90/501.71	c ****************................ | ********..               9453000 | 244577               984.1        9605.9     75425001
1007.86/513.74	c ****************................ | ********..               9610000 | 249759              1008.1        9533.0     77091381
1031.81/525.72	c ****************................ | ********..               9764000 | 254102              1032.0        9461.1     78876518
1055.75/537.79	c ****************................ | ********..               9932000 | 259082              1056.1        9404.4     80780496
1079.70/549.78	c ****************................ | *********.              10099000 | 264733              1080.0        9350.7     82905420
1103.85/561.83	c ****************................ | *********.              10266000 | 270254              1104.1        9298.2     84684491
1127.80/573.89	c ****************................ | *********.              10417000 | 276390              1128.2        9233.6     86879387
1151.73/585.85	c ****************................ | *********.              10574000 | 282194              1152.0        9178.7     88617500
1175.86/597.93	c ****************................ | *********.              10772000 | 287794              1176.1        9159.0     90228053
1199.80/609.94	c CPU limit (1200) reached
1199.80/609.94	c Time = 1200.08 seconds
1199.80/609.94	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1563228-1241001378/watcher-1563228-1241001378 -o /tmp/evaluation-result-1563228-1241001378/solver-1563228-1241001378 -C 1200 -W 1800 -M 1800 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1563228-1241001378.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.99 1.00 0.91 3/64 6274
/proc/meminfo: memFree=1493616/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=1064 CPUtime=0
/proc/6274/stat : 6274 (ttsth-5-0) R 6272 6274 5947 0 -1 4194304 146 0 0 0 0 0 0 0 18 0 1 0 128171071 1089536 130 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/6274/statm: 266 130 77 176 0 88 0

[startup+0.0202189 s]
/proc/loadavg: 0.99 1.00 0.91 3/64 6274
/proc/meminfo: memFree=1493616/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=1600 CPUtime=0.01
/proc/6274/stat : 6274 (ttsth-5-0) R 6272 6274 5947 0 -1 4194304 283 0 0 0 1 0 0 0 18 0 1 0 128171071 1638400 267 1992294400 134512640 135237372 4294956192 18446744073709551615 134639534 0 0 4096 0 0 0 0 17 1 0 0
/proc/6274/statm: 400 268 78 176 0 222 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 1600

[startup+0.101228 s]
/proc/loadavg: 0.99 1.00 0.91 3/64 6274
/proc/meminfo: memFree=1493616/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=4372 CPUtime=0.09
/proc/6274/stat : 6274 (ttsth-5-0) R 6272 6274 5947 0 -1 4194304 973 0 0 0 9 0 0 0 18 0 1 0 128171071 4476928 957 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/6274/statm: 1093 958 78 176 0 915 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4372

[startup+0.301249 s]
/proc/loadavg: 0.99 1.00 0.91 3/64 6274
/proc/meminfo: memFree=1493616/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=12068 CPUtime=0.29
/proc/6274/stat : 6274 (ttsth-5-0) R 6272 6274 5947 0 -1 4194304 2693 0 0 0 28 1 0 0 19 0 1 0 128171071 12357632 2677 1992294400 134512640 135237372 4294956192 18446744073709551615 134533768 0 0 4096 0 0 0 0 17 1 0 0
/proc/6274/statm: 3017 2677 78 176 0 2839 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 12068

[startup+0.701297 s]
/proc/loadavg: 0.99 1.00 0.91 3/64 6274
/proc/meminfo: memFree=1493616/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=23540 CPUtime=0.69
/proc/6274/stat : 6274 (ttsth-5-0) R 6272 6274 5947 0 -1 4194304 5602 0 0 0 67 2 0 0 22 0 1 0 128171071 24104960 5557 1992294400 134512640 135237372 4294956192 18446744073709551615 134680503 0 0 4096 0 0 0 0 17 1 0 0
/proc/6274/statm: 5885 5557 79 176 0 5707 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 23540

[startup+1.50239 s]
/proc/loadavg: 0.99 1.00 0.91 2/65 6275
/proc/meminfo: memFree=1471080/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=26760 CPUtime=1.49
/proc/6274/stat : 6274 (ttsth-5-0) R 6272 6274 5947 0 -1 4194304 6992 0 0 0 147 2 0 0 25 0 1 0 128171071 27402240 6489 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/6274/statm: 6690 6489 80 176 0 6512 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 26760

[startup+3.10157 s]
/proc/loadavg: 0.99 1.00 0.91 2/65 6275
/proc/meminfo: memFree=1466600/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=27692 CPUtime=3.09
/proc/6274/stat : 6274 (ttsth-5-0) R 6272 6274 5947 0 -1 4194304 7234 0 0 0 306 3 0 0 25 0 1 0 128171071 28356608 6731 1992294400 134512640 135237372 4294956192 18446744073709551615 134600975 0 0 4096 0 0 0 0 17 1 0 0
/proc/6274/statm: 6923 6731 80 176 0 6745 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 27692

[startup+6.30194 s]
/proc/loadavg: 0.99 1.00 0.91 2/65 6275
/proc/meminfo: memFree=1466472/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=27884 CPUtime=6.29
/proc/6274/stat : 6274 (ttsth-5-0) R 6272 6274 5947 0 -1 4194304 7284 0 0 0 626 3 0 0 25 0 1 0 128171071 28553216 6781 1992294400 134512640 135237372 4294956192 18446744073709551615 134600707 0 0 4096 0 0 0 0 17 1 0 0
/proc/6274/statm: 6971 6781 80 176 0 6793 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 27884

[startup+12.7017 s]
/proc/loadavg: 0.99 1.00 0.91 2/65 6275
/proc/meminfo: memFree=1466288/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=28016 CPUtime=12.69
/proc/6274/stat : 6274 (ttsth-5-0) R 6272 6274 5947 0 -1 4194304 7316 0 0 0 1266 3 0 0 25 0 1 0 128171071 28688384 6813 1992294400 134512640 135237372 4294956192 18446744073709551615 134600725 0 0 4096 0 0 0 0 17 1 0 0
/proc/6274/statm: 7004 6813 80 176 0 6826 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 28016

[startup+25.5022 s]
/proc/loadavg: 1.07 1.02 0.91 3/67 6277
/proc/meminfo: memFree=1364000/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=151804 CPUtime=33.56
/proc/6274/stat : 6274 (ttsth-5-0) S 6272 6274 5947 0 -1 4194304 33778 0 0 0 3341 15 0 0 25 0 3 0 128171071 155447296 32717 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/6274/statm: 37951 32717 98 176 0 37773 0
[pid=6274/tid=6276] ppid=6272 vsize=151804 CPUtime=8.1
/proc/6274/task/6276/stat : 6276 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 3306 0 0 0 808 2 0 0 25 0 3 0 128172810 155447296 32717 1992294400 134512640 135237372 4294956192 18446744073709551615 134590241 0 0 4096 0 0 0 0 -1 1 0 0
[pid=6274/tid=6277] ppid=6272 vsize=151804 CPUtime=8.06
/proc/6274/task/6277/stat : 6277 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 6203 0 0 0 805 1 0 0 25 0 3 0 128172810 155447296 32717 1992294400 134512640 135237372 4294956192 18446744073709551615 134562430 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 33.56
Current children cumulated vsize (KiB) 151804

[startup+51.1021 s]
/proc/loadavg: 1.39 1.09 0.94 3/67 6277
/proc/meminfo: memFree=1280032/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=238664 CPUtime=84.65
/proc/6274/stat : 6274 (ttsth-5-0) S 6272 6274 5947 0 -1 4194304 54820 0 0 0 8436 29 0 0 25 0 3 0 128171071 244391936 53759 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/6274/statm: 59666 53759 98 176 0 59488 0
[pid=6274/tid=6276] ppid=6272 vsize=238664 CPUtime=33.69
/proc/6274/task/6276/stat : 6276 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 10755 0 0 0 3361 8 0 0 25 0 3 0 128172810 244391936 53759 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=6274/tid=6277] ppid=6272 vsize=238664 CPUtime=33.56
/proc/6274/task/6277/stat : 6277 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 19796 0 0 0 3347 9 0 0 25 0 3 0 128172810 244391936 53759 1992294400 134512640 135237372 4294956192 18446744073709551615 134749353 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 84.65
Current children cumulated vsize (KiB) 238664

[startup+102.307 s]
/proc/loadavg: 1.75 1.24 1.00 3/67 6277
/proc/meminfo: memFree=1157600/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=362836 CPUtime=186.83
/proc/6274/stat : 6274 (ttsth-5-0) S 6272 6274 5947 0 -1 4194304 84990 0 0 0 18636 47 0 0 25 0 3 0 128171071 371544064 83929 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/6274/statm: 90709 83929 98 176 0 90531 0
[pid=6274/tid=6276] ppid=6272 vsize=362836 CPUtime=84.88
/proc/6274/task/6276/stat : 6276 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 22283 0 0 0 8472 16 0 0 25 0 3 0 128172810 371544064 83929 1992294400 134512640 135237372 4294956192 18446744073709551615 134546034 0 0 4096 0 0 0 0 -1 1 0 0
[pid=6274/tid=6277] ppid=6272 vsize=362836 CPUtime=84.56
/proc/6274/task/6277/stat : 6277 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 38438 0 0 0 8436 20 0 0 25 0 3 0 128172810 371544064 83929 1992294400 134512640 135237372 4294956192 18446744073709551615 134591433 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 186.83
Current children cumulated vsize (KiB) 362836

[startup+162.303 s]
/proc/loadavg: 1.90 1.37 1.05 3/67 6279
/proc/meminfo: memFree=986400/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=540716 CPUtime=306.57
/proc/6274/stat : 6274 (ttsth-5-0) S 6272 6274 5947 0 -1 4194304 128109 0 0 0 30582 75 0 0 25 0 3 0 128171071 553693184 127048 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/6274/statm: 135179 127048 98 176 0 135001 0
[pid=6274/tid=6276] ppid=6272 vsize=540716 CPUtime=144.85
/proc/6274/task/6276/stat : 6276 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 33646 0 0 0 14458 27 0 0 25 0 3 0 128172810 553693184 127048 1992294400 134512640 135237372 4294956192 18446744073709551615 134751534 0 0 4096 0 0 0 0 -1 1 0 0
[pid=6274/tid=6277] ppid=6272 vsize=540716 CPUtime=144.31
/proc/6274/task/6277/stat : 6277 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 70194 0 0 0 14395 36 0 0 25 0 3 0 128172810 553693184 127048 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 306.57
Current children cumulated vsize (KiB) 540716

[startup+222.303 s]
/proc/loadavg: 1.96 1.49 1.12 3/67 6279
/proc/meminfo: memFree=837728/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=691408 CPUtime=426.31
/proc/6274/stat : 6274 (ttsth-5-0) S 6272 6274 5947 0 -1 4194304 164798 0 0 0 42534 97 0 0 25 0 3 0 128171071 708001792 163737 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/6274/statm: 172852 163737 98 176 0 172674 0
[pid=6274/tid=6276] ppid=6272 vsize=691408 CPUtime=204.84
/proc/6274/task/6276/stat : 6276 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 44300 0 0 0 20447 37 0 0 25 0 3 0 128172810 708001792 163737 1992294400 134512640 135237372 4294956192 18446744073709551615 134549924 0 0 4096 0 0 0 0 -1 1 0 0
[pid=6274/tid=6277] ppid=6272 vsize=691408 CPUtime=204.08
/proc/6274/task/6277/stat : 6277 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 96229 0 0 0 20359 49 0 0 25 0 3 0 128172810 708001792 163737 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 426.31
Current children cumulated vsize (KiB) 691408

[startup+282.303 s]
/proc/loadavg: 1.98 1.57 1.16 3/67 6279
/proc/meminfo: memFree=716384/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=819080 CPUtime=546.05
/proc/6274/stat : 6274 (ttsth-5-0) S 6272 6274 5947 0 -1 4194304 195398 0 0 0 54484 121 0 0 25 0 3 0 128171071 838737920 194337 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/6274/statm: 204770 194337 98 176 0 204592 0
[pid=6274/tid=6276] ppid=6272 vsize=819080 CPUtime=264.83
/proc/6274/task/6276/stat : 6276 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 55591 0 0 0 26434 49 0 0 25 0 3 0 128172810 838737920 194337 1992294400 134512640 135237372 4294956192 18446744073709551615 134546034 0 0 4096 0 0 0 0 -1 1 0 0
[pid=6274/tid=6277] ppid=6272 vsize=819080 CPUtime=263.83
/proc/6274/task/6277/stat : 6277 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 115538 0 0 0 26322 61 0 0 25 0 3 0 128172810 838737920 194337 1992294400 134512640 135237372 4294956192 18446744073709551615 134680467 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 546.05
Current children cumulated vsize (KiB) 819080

[startup+342.303 s]
/proc/loadavg: 1.99 1.65 1.21 3/67 6279
/proc/meminfo: memFree=599904/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=937272 CPUtime=665.79
/proc/6274/stat : 6274 (ttsth-5-0) S 6272 6274 5947 0 -1 4194304 224152 0 0 0 66435 144 0 0 25 0 3 0 128171071 959766528 223091 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/6274/statm: 234318 223091 98 176 0 234140 0
[pid=6274/tid=6276] ppid=6272 vsize=937272 CPUtime=324.8
/proc/6274/task/6276/stat : 6276 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 66403 0 0 0 32421 59 0 0 25 0 3 0 128172810 959766528 223091 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=6274/tid=6277] ppid=6272 vsize=937272 CPUtime=323.59
/proc/6274/task/6277/stat : 6277 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 133480 0 0 0 32286 73 0 0 25 0 3 0 128172810 959766528 223091 1992294400 134512640 135237372 4294956192 18446744073709551615 134588018 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 665.79
Current children cumulated vsize (KiB) 937272

[startup+402.303 s]
/proc/loadavg: 1.99 1.71 1.26 3/67 6279
/proc/meminfo: memFree=467168/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=1075932 CPUtime=785.54
/proc/6274/stat : 6274 (ttsth-5-0) S 6272 6274 5947 0 -1 4194304 257481 0 0 0 78388 166 0 0 25 0 3 0 128171071 1101754368 256420 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/6274/statm: 268983 256420 98 176 0 268805 0
[pid=6274/tid=6276] ppid=6272 vsize=1075932 CPUtime=384.78
/proc/6274/task/6276/stat : 6276 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 80564 0 0 0 38409 69 0 0 25 0 3 0 128172810 1101754368 256420 1992294400 134512640 135237372 4294956192 18446744073709551615 134590501 0 0 4096 0 0 0 0 -1 1 0 0
[pid=6274/tid=6277] ppid=6272 vsize=1075932 CPUtime=383.35
/proc/6274/task/6277/stat : 6277 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 152648 0 0 0 38250 85 0 0 25 0 3 0 128172810 1101754368 256420 1992294400 134512640 135237372 4294956192 18446744073709551615 134519952 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 785.54
Current children cumulated vsize (KiB) 1075932

[startup+462.302 s]
/proc/loadavg: 1.99 1.76 1.30 3/67 6279
/proc/meminfo: memFree=301152/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=1245640 CPUtime=905.28
/proc/6274/stat : 6274 (ttsth-5-0) S 6272 6274 5947 0 -1 4194304 298759 0 0 0 90334 194 0 0 25 0 3 0 128171071 1275535360 297698 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/6274/statm: 311410 297699 98 176 0 311232 0
[pid=6274/tid=6276] ppid=6272 vsize=1245640 CPUtime=444.77
/proc/6274/task/6276/stat : 6276 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 94250 0 0 0 44398 79 0 0 25 0 3 0 128172810 1275535360 297699 1992294400 134512640 135237372 4294956192 18446744073709551615 134591237 0 0 4096 0 0 0 0 -1 1 0 0
[pid=6274/tid=6277] ppid=6272 vsize=1245640 CPUtime=443.11
/proc/6274/task/6277/stat : 6277 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 180241 0 0 0 44208 103 0 0 25 0 3 0 128172810 1275535360 297699 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 905.28
Current children cumulated vsize (KiB) 1245640

[startup+522.302 s]
/proc/loadavg: 1.99 1.80 1.34 3/67 6279
/proc/meminfo: memFree=170848/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=1384188 CPUtime=1025.02
/proc/6274/stat : 6274 (ttsth-5-0) S 6272 6274 5947 0 -1 4194304 331621 0 0 0 102284 218 0 0 25 0 3 0 128171071 1417408512 330560 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/6274/statm: 346047 330560 98 176 0 345869 0
[pid=6274/tid=6276] ppid=6272 vsize=1384188 CPUtime=504.75
/proc/6274/task/6276/stat : 6276 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 106290 0 0 0 50384 91 0 0 25 0 3 0 128172810 1417408512 330560 1992294400 134512640 135237372 4294956192 18446744073709551615 134562357 0 0 4096 0 0 0 0 -1 1 0 0
[pid=6274/tid=6277] ppid=6272 vsize=1384188 CPUtime=502.87
/proc/6274/task/6277/stat : 6277 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 201062 0 0 0 50172 115 0 0 25 0 3 0 128172810 1417408512 330560 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1025.02
Current children cumulated vsize (KiB) 1384188

[startup+582.302 s]
/proc/loadavg: 1.99 1.83 1.38 3/67 6279
/proc/meminfo: memFree=18144/2055920 swapFree=4180324/4192956
[pid=6274] ppid=6272 vsize=1543888 CPUtime=1144.76
/proc/6274/stat : 6274 (ttsth-5-0) S 6272 6274 5947 0 -1 4194304 369354 0 0 0 114234 242 0 0 25 0 3 0 128171071 1580941312 368293 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/6274/statm: 385972 368293 98 176 0 385794 0
[pid=6274/tid=6276] ppid=6272 vsize=1543888 CPUtime=564.73
/proc/6274/task/6276/stat : 6276 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 119866 0 0 0 56373 100 0 0 25 0 3 0 128172810 1580941312 368293 1992294400 134512640 135237372 4294956192 18446744073709551615 134680499 0 0 4096 0 0 0 0 -1 1 0 0
[pid=6274/tid=6277] ppid=6272 vsize=1543888 CPUtime=562.62
/proc/6274/task/6277/stat : 6277 (ttsth-5-0) R 6272 6274 5947 0 -1 4194368 225219 0 0 0 56132 130 0 0 25 0 3 0 128172810 1580941312 368293 1992294400 134512640 135237372 4294956192 18446744073709551615 134680467 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1144.76
Current children cumulated vsize (KiB) 1543888



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+610.102 s]
/proc/loadavg: 1.99 1.85 1.40 2/65 6279
/proc/meminfo: memFree=1035040/2055920 swapFree=4180352/4192956
[pid=6274] ppid=6272 vsize=0 CPUtime=1200.05
/proc/6274/stat : 6274 (ttsth-5-0) R 6272 6274 5947 0 -1 4195332 384559 0 0 0 119736 269 0 0 18 0 1 0 128171071 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/6274/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.05
Current children cumulated vsize (KiB) 0

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+610.102 s]
/proc/loadavg: 1.99 1.85 1.40 2/65 6279
/proc/meminfo: memFree=1035040/2055920 swapFree=4180352/4192956
[pid=6274] ppid=6272 vsize=0 CPUtime=1200.05
/proc/6274/stat : 6274 (ttsth-5-0) R 6272 6274 5947 0 -1 4195332 384559 0 0 0 119736 269 0 0 18 0 1 0 128171071 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/6274/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.05
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 610.182
CPU time (s): 1200.13
CPU user time (s): 1197.37
CPU system time (s): 2.76658
CPU usage (%): 196.685
Max. virtual memory (cumulated for all children) (KiB): 1608528

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1197.37
system time used= 2.76658
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 384559
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 97
involuntary context switches= 9202

runsolver used 0.582911 second user time and 1.64175 second system time

The end

Launcher Data 

Begin job on node20 at 2009-04-29 12:36:18
IDJOB=1563228
IDBENCH=70949
IDSOLVER=549
FILE ID=node20/1563228-1241001378
PBS_JOBID= 9204847
Free space on /tmp= 66396 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l45_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1563228-1241001378/watcher-1563228-1241001378 -o /tmp/evaluation-result-1563228-1241001378/solver-1563228-1241001378 -C 1200 -W 1800 -M 1800  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1563228-1241001378.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= 94aa7bdbcbe99c5b3082c395dc2384e9
RANDOM SEED=491639113

node20.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5931.00
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.214
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1494096 kB
Buffers:         45952 kB
Cached:         465472 kB
SwapCached:       6940 kB
Active:         125204 kB
Inactive:       394916 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1494096 kB
SwapTotal:     4192956 kB
SwapFree:      4180324 kB
Dirty:            3780 kB
Writeback:           0 kB
Mapped:          13520 kB
Slab:            27780 kB
Committed_AS:   576664 kB
PageTables:       1396 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66396 MiB
End job on node20 at 2009-04-29 12:46:31