I've been using libcurl.mono in C# to scrape data, the code could probably be easily adapted to the WebRequest object though.
/54/6c/110512/1.html
/15/d4/99525/1.html
These forums are CLOSED. Please visit the new forums HERE
Gift Sourcecode: How to access SL web pages through C# |
|
Eddy Stryker
libsecondlife Developer
![]() Join date: 6 Jun 2004
Posts: 353
|
06-18-2006 20:46
I've been using libcurl.mono in C# to scrape data, the code could probably be easily adapted to the WebRequest object though.
/54/6c/110512/1.html /15/d4/99525/1.html |
Jeff Linden
Linden Lab Lifeform
Join date: 28 May 2003
Posts: 79
|
06-20-2006 17:53
Are you keeping all the cookies the same?
![]() _____________________
Enhancing your Second Lifetime... one life at a time.
|
Foolish Frost
Grand Technomancer
![]() Join date: 7 Mar 2005
Posts: 1,433
|
06-20-2006 18:57
As far as I can tell, that program just dumps all the cookies we were given from the login address and plays them back when we ask for further pages.
Odd thing, I don't think all of the cookies are being given on that first login screen. Perhaps it's advancing to a second address after that and we're not loading all of the cookies properly? I've tried about a half dozen methods to read that data and get all of the cookies needed, but we normally only see the forum ones. Darn odd. |
Josie Hamilton
Second Style Publisher
![]() Join date: 7 Mar 2004
Posts: 164
|
06-20-2006 19:16
Foolish,
As Cristiano mentioned he was trying to help me with this exact problem for a tray app. I'm interested to fins out what you dig up. PM me or IM in game and let's see if there is any synchronicity between our projects. _____________________
|
Foolish Frost
Grand Technomancer
![]() Join date: 7 Mar 2005
Posts: 1,433
|
06-21-2006 08:50
Well, right now, it's in other people's courts. I just spent over 30 hours trying nearly a dozen methods to get the data. cURL's C# code seems to be having trouble even ACCESSING SLs website, and the first system seems to not get the cookies that are needed to access the account sections of the site.
In otherwords, I'm unable to find where the bug is and need help. I'm willing to work with people, but I can say this: Due to the nature of the way SLs website was put together, I am having trouble authenticating identity to the server. This is because the forums and the account sections of the site are using totally differant methods to confirm themselves. I'm not sure of what the exact reason for the problem is, but it's based in that. It's effectivly two sites with one login, and it's playing silly buggers with getting in. ![]() |