Forum Home
Press F1
 
Thread ID: 9390 2001-05-23 16:16:00 To Juha Saarinen and David Brown Guest (0) Press F1
Post ID Timestamp Content User
13087 2001-05-23 16:16:00 Can anything be done about the response time of this site. It is dreadfully slow when trying to do anything at all, and especially when trying to post a response. It often appears as it nothing is happening, hence the number of multiple postings.

Thank you
Guest (0)
13088 2001-05-24 00:22:00 Hi there I would like to voice the same opinion the site always loads very slowly even at offpeak times like 3 am in the morning. Its almost like a site that is secured for credit card transactions. Please do something about it. Guest (0)
13089 2001-05-24 00:49:00 Hi k1w1

As this isn't Juha or Davids' area and since I'm the webmaster for IDGNet I'll answer this question.

The current brown outs effecting our site at the moment (and that includes PressF1) are not due to any bandwidth or application design problems. It's search engines (actually, the spiders associated with them) - they're hammering us. At the time that you posted this message we were being crawled by Lycos, Google & Alta Vista simultaneously. This slows the server performance for you're average user to a crawl, sometimes for hours. Now, like any site, we want to be indexed by these search engines and attract more users but not to the detriment of average users' interactive experience. So, for the moment, I've disallowed all search engines until we can find how to correctly configure the domino web server we use to deal with the problem.

Two potential problems still exist with this.
1. Some rogue spiders ignore the robots.txt file where they're supposed to receive instructions as to what they can access on a site (this does not include the ones I mentioned above). About that (for the moment at least) I can do nothing.
2. Even though I've now instructed a disallow to the entire site a spider looks at the robots.txt only once when it first arrives. For the remainder of its visit it ignores the instructions and gets on with crawling your site. These visits can sometimes take up to a week as it comes back again and again.

So, after the action I've taken today it could take up to another week before we can consistently provide you with a better service. I do apologise for this, discovery by these spiders so suddenly and to this level was something we didn't see coming. Things should get better soon.

James
Guest (0)
13090 2001-05-24 04:15:00 Get Jetstream

I have no problems at all with this site

or Upgrade your modem
Guest (0)
13091 2001-05-24 14:48:00 Ro ger,

I would like to take this opportunity to reply to your comments.

1. Jetstream is not a cost effective option for my requirements.

2. It would appear from James' reply that you are one of the few.

3. There is nothing wrong with my modem. It may only be 56K, but I still achieve good data transfer speeds with it, (and before you bring up the point of internet providers, I use xtra). When the problem with this site occurs, a check of the connection information shows that no data transfer is taking place. Hardly the modem's fault, is it?
Guest (0)
13092 2001-05-24 15:08:00 James,

Thank you for your prompt reply. It certainly explains the problem I have been experiencing.

I just have one more question. Why does this problem affect the F1 page more than the rest of the site? The response times in other areas are fairly reasonable (once you get in to the site).

K1w1

P.S. Keep up the good work. I really enjoy browsing the site, especially F1.
Guest (0)
1