Santry Technology Solutions, Content Management, DotNetNuke, SharePoint Consulting
Register | Login
Wednesday, January 07, 2009

Sections
  
About Us
  
Partners
Downloads
  
 WWWCoder.com Resource Directory

Grabbing Content From an External Website
9/18/2004 7:14:36 PM

USes the Request and Response object to return content from a Web site.


Public Function GetPageText(ByVal URL As String) As String
Dim response As HttpWebResponse = GetResponse(URL)
Dim s As Stream = response.GetResponseStream
Dim enc As String = response.ContentEncoding.Trim
If enc = "" Then enc = "us-ascii"
Dim encode As Encoding = System.Text.Encoding.GetEncoding(enc)
Dim sr As StreamReader = New StreamReader(s, encode)
Return sr.ReadToEnd
End Function


Public Function GetResponse(ByVal url As String) As HttpWebResponse
Dim request As HttpWebRequest = CreateRequest(url)
Return request.GetResponse
End Function


Public Function CreateRequest(ByVal url As String) As HttpWebRequest
Dim req As WebRequest = WebRequest.Create(url)
Dim Null As Object
Dim wreq As HttpWebRequest = req
If Not (wreq Is Null) Then
wreq.UserAgent = userAgent
wreq.Referer = referer
wreq.Timeout = defaultTimeout
End If
Return wreq
End Function
End Class


Page Options:
format for printing  Format for Printer
email article  Email Page
add to your favorites   Add to Favorites
How would you rate the quality of this content?
Poor - - Excellent
Comments?
Overall Rating:
Comments Left:
Left on 10/20/2004 5:44:33 PM by Anonymous
Comments: Option Strict must be off for this to work
Left on 9/21/2004 10:47:39 PM by Anonymous
Comments: Fine
  

 Latest Articles
  

 Latest News
  

 

Spotlight
Syndication

 


 


Digg This
 


DotNetNuke Platinum Benefactor

  
 

 Terms Of Use | Privacy Statement
 Copyright 2008 - Santry Technology Solutions, Box 172, Girard, PA 16417, (814) 774-0970