| Forum Home | ||||
| Press F1 | ||||
| Thread ID: 82140 | 2007-08-16 23:16:00 | Yahoo ! slurp spiders visit PressF1 | Misty (368) | Press F1 |
| Post ID | Timestamp | Content | User | ||
| 581827 | 2007-08-16 23:16:00 | I had just logged onto PressF1 this morning at about 5.15am or 6.15am and by mistake hit the option to view who was online. I had already noticed that only sweetbbyjen (newest member) and I were the only two members showing so would have only expected to see the two of us and lots of "guests". Surprise, surprise - there were heaps of lines showing not only guests but also just as many "Yahoo! Slurp Spiders" and most of them were showing as "viewing profile(s)". I don't know much about such things but presume that they were running from a program designed to farm any details they could find. Is that a correct assumption ?? :eek: Misty :horrified |
Misty (368) | ||
| 581828 | 2007-08-16 23:32:00 | Looks like its got something to do with their search engines obviously. And the only way to fix it is to edit the robots.txt file in vbulletin. But then if u killed them completely, it'll most probably wipe PressF1 off Yahoo :D |
Speedy Gonzales (78) | ||
| 581829 | 2007-08-17 00:16:00 | Hi Misty :) As Speedy said the Yahoo! slurp spiders is to do with the Yahoo search engine (Just like the google bot is to do with the Google search engine etc…), what the Yahoo! slurp spiders do is they go around the internet looking for new websites & updating there database of sites, and as PressF1 is a every changing e.g. with new content (new posts) you will find that the Yahoo! slurp spiders hang around here a LOT! Also don’t worry the Yahoo! slurp spiders don’t see much when they view your profile. (If you log out of PressF1 & have a look at your profile: pressf1.co.nz what you see there as a guest is what the Yahoo! slurp spiders see) Hope this helps :) |
stu161204 (123) | ||
| 581830 | 2007-08-17 02:00:00 | Thanks Speedy and Stu I was not really too concerned personally as my profile is not that exciting or revealing. Just thought that members ought to be made aware - just in case....... Interesting to know however. cheers Misty :) |
Misty (368) | ||
| 581831 | 2007-08-17 02:11:00 | It's no problem- I gave Winmac's address when I signed up :) | Shortcircuit (1666) | ||
| 581832 | 2007-08-17 05:31:00 | Search engine bots just love this site. You find stuff indexed so quickly. Like this thread (www.google.com) already showing at position #1 in google. :p |
Jen (38) | ||
| 581833 | 2007-08-17 05:36:00 | Search engine bots just love this site. You find stuff indexed so quickly. Like this thread (www.google.com) already showing at position #1 in google. :p Spooky- it's kind of like groundhog day... only better :) |
Shortcircuit (1666) | ||
| 581834 | 2007-08-17 07:47:00 | It's no problem- I gave Winmac's address when I signed up :) :lol::lol: |
beeswax34 (63) | ||
| 581835 | 2007-08-17 08:39:00 | Spooky- it's kind of like groundhog day... only better :) But can we still slag off those people who are "famous just for being famous." These bots are making all of us famous. Without trying... |
Laura (43) | ||
| 1 | |||||