Jump to content


Photo

Almost 500 people here, what's happening?


  • Please log in to reply
33 replies to this topic

#1 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 21 June 2007 - 11:08 AM

As I write this there are 489 active users - did we get mentioned somewhere, or what?? Usually it's been around 300 lately.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#2 jedi

jedi

    aequam memento rebus in arduis servare mentem

  • Retired Staff
  • PipPipPipPipPip
  • 15,830 posts

Posted 21 June 2007 - 12:49 PM

Not that I know of, anyone else know? Let's hope some of them stick around to become Helpers.
jedi

My help is free, but if you wish to help keep these forums running please consider a donation, see This Topic for details.

#3 Fred_Flintstone

Fred_Flintstone

    Forum Deity

  • Trusted Advisor
  • PipPipPipPipPip
  • 615 posts

Posted 23 June 2007 - 03:05 PM

Wonder if this article had anything to do with it..
Spywareinfo got a mention in a couple of places..


My help is free, but if you wish to help keep these forums running please consider a donation, see this topic for details.

#4 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 23 June 2007 - 04:49 PM

That must have been it. :)

Didn't last long, we're back to normal numbers now.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#5 snemelk

snemelk

    inżynier

  • Expert
  • PipPipPipPipPip
  • 3,099 posts

Posted 25 June 2007 - 07:33 AM

Not that I know of, anyone else know? Let's hope some of them stick around to become Helpers.


are Helpers so much needed??.. :gasp:
uhh... so I must finish my training eventually...
c18903e63196580f.gif

snemelk.hekko.pl - - my site with a few computer security tips...
Silesia - that's where I live!

"If I had some duct tape, I could fix that." - MacGyver

My help is free, but if you wish to help keep these forums running please consider a donation, see this topic for details.

#6 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 25 June 2007 - 09:35 AM

Yes, we need you..

We wish so many people didn't have to post in Not getting help with your log? We'd like to see everyone get a response within a day or two but as it is, many people wait three days or longer for a reply. Too much malware, too few trained helpers.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#7 SteveJ

SteveJ

    Member

  • Full Member
  • Pip
  • 1 posts

Posted 25 June 2007 - 04:43 PM

Hi cnm...

I need to talk to you... was given referred to you by Suzi

could you PM me?

cheers

//Steve

#8 Blair

Blair

    GeeksToGo

  • Ambassador
  • Pip
  • 82 posts

Posted 10 July 2007 - 11:13 AM

Many if not all forums have experienced a recent surge in guests the past month or so. Yahoo's search engine bot is to blame. Their bots now use a different IP on every page view, which appears to the forum software as a new session, and a new guest.

More info here: http://suggestions.y...=...r&fid=31431

#9 therock247uk

therock247uk

    247fixes.com

  • Ambassador
  • PipPipPipPipPip
  • 870 posts

Posted 10 July 2007 - 01:02 PM

Happened at my site too... Can't say im happy about it either...

#10 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 10 July 2007 - 05:04 PM

Our attendance went right back to normal, so if it was Googlebot they must have changed their ways again.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#11 screen317

screen317

    SWI Sentinel

  • Global Moderator
  • PipPipPipPipPip
  • 8,815 posts

Posted 16 July 2007 - 03:20 PM

Wow... Speaking of a surge in members:

[attachment=1734:SWI_500_.bmp]

Please consider donating to help support the continued prompt and excellent services of this site.


#12 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 16 July 2007 - 04:07 PM

Yes, it went up to the 500s right away when the 2.3.1 went on line. I guess the Googlebot sniffed out a new forum and swarmed around. It will be so disappointed to find we're just the same old same old. :weee:
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#13 ipl_001

ipl_001

    Security Admin at Zebulon.fr

  • Ambassador
  • PipPipPipPipPip
  • 646 posts

Posted 18 July 2007 - 02:30 AM

Hi cnm, hi everyone,

I just had a look at the bottom of the index page...

It's 10:28a in Paris ie 4:28a Eastern US:

466 user(s) active in the past 15 minutes
Active Users 461 guests, 5 members, 0 anonymous members

Far over the 300 you gave!

Edited by ipl_001, 18 July 2007 - 02:30 AM.

Gérard MS_MVP-1.gif asap2.gif Don't give up... that is what they want us to do... Budfred
Has SWI saved your system? Please, consider making a donation!

#14 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 18 July 2007 - 07:44 AM

Yes, it went up to the 500s right away when the 2.3.1 went on line. I guess the Googlebot sniffed out a new forum and swarmed around. It will be so disappointed to find we're just the same old same old. :weee:

The bots came circling around when they saw the new revision..
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#15 jedi

jedi

    aequam memento rebus in arduis servare mentem

  • Retired Staff
  • PipPipPipPipPip
  • 15,830 posts

Posted 19 July 2007 - 09:43 AM

Check this out:
[attachment=1749:board_st...19.07.07.png]

16.00 hours GMT. Couldn't see any bots running either.
jedi

My help is free, but if you wish to help keep these forums running please consider a donation, see This Topic for details.

#16 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 19 July 2007 - 10:05 AM

Bots like Googlebot can be here as multiple logins and you will only see one. You won't see any if the board doesn't recognize their name.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#17 jedi

jedi

    aequam memento rebus in arduis servare mentem

  • Retired Staff
  • PipPipPipPipPip
  • 15,830 posts

Posted 20 July 2007 - 06:49 AM

OK, but I prefer to think we've just amazingly popular! :p
jedi

My help is free, but if you wish to help keep these forums running please consider a donation, see This Topic for details.

#18 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 20 July 2007 - 10:02 AM

It's a possibility. :D
Maybe the new logo is magnetic.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#19 screen317

screen317

    SWI Sentinel

  • Global Moderator
  • PipPipPipPipPip
  • 8,815 posts

Posted 23 July 2007 - 12:56 AM

Uhh cnm!!!

I believe the GoogleBot is on a cloning spree!! :rofl: :rofl:


Posted Image


My word...

It's like the plague spreading all over again!! :rofl: :rofl:

Please consider donating to help support the continued prompt and excellent services of this site.


#20 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 23 July 2007 - 08:34 AM

A huge number are the Yahoo bot. All Net Tools says "lj611725.crawl.yahoo.net (74.6.70.37)".
It looks as though their crawler is using hundreds of 74.6.*.*

On the forum home page, click 'Last Click' to see who the Guests are.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#21 Simonsells91

Simonsells91

    Member

  • Full Member
  • Pip
  • 41 posts

Posted 23 July 2007 - 05:23 PM

The forum has been very sluggish for me lately.

#22 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 23 July 2007 - 05:25 PM

I sent a letter to Yahoo; we'll see whether it has any effect. (No reply to my email yet).

To: 'netblockadmin@yahoo-inc.com'
Subject: Your crawler is swamping us
Sent: Mon 7/23/2007 9:22 AM

Gentlepeople,

There are hundreds of "Guests" with IP 76.6.*.* at http://www.spywareinfoforum.com. This is severely overloading our server with the excessive number of reads. Our normal number of visitors is 200-300; lately it has been 700-1000.

I would greatly appreciate it if you could rein that crawler in...
Thanks,
Coly Moore
Admin 'cnm' at www.spywareinfoforum.com


Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#23 racooper

racooper

    Master of my own Domain

  • Retired Staff
  • PipPipPipPipPip
  • 1,420 posts

Posted 23 July 2007 - 08:06 PM

sounds like a need to modify robots.txt to block Yahoo if it keeps up....

Put this at the top of the existing /robots.txt....
User-agent: Slurp
Disallow: /


#24 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 23 July 2007 - 08:16 PM

I saw that at the Invision forum - but it won't work. Slurp isn't recognized - look in 'Last click', you won't see it. Using all different IP addresses has made it an unknown Guest.

What I've done is temporarily ban the address range it uses (74.6.*.*). That seems to have worked - dropped the visitors from 800 to 500 so. Maybe the board will work more smoothly now.

I'll let it back in after a while.

We're also seeing a lot of 65.55.209.*, which is the Microsoft bot (Live Bot, showing as Guest). I may ban its addresses also. But the board seems quite fast now.

My plan: let the Yahoo bot operate for an hour or so each day at a time when we have few visitors.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#25 davidb231

davidb231

    SWI Junkie

  • Helper Trainee+
  • PipPipPipPip
  • 266 posts

Posted 24 July 2007 - 06:37 AM

This must have been why I was unable to get to the forum for most of the afternoon and early evening (E.S.T.)yesterday. I kept getting the message that something was wrong with the database. :unsure:
If you'd like to contribute to help with the costs of running Spywareinfo

#26 racooper

racooper

    Master of my own Domain

  • Retired Staff
  • PipPipPipPipPip
  • 1,420 posts

Posted 24 July 2007 - 01:03 PM

I saw that at the Invision forum - but it won't work. Slurp isn't recognized - look in 'Last click', you won't see it. Using all different IP addresses has made it an unknown Guest.

"Slurp" is the User Agent for the Yahoo bot....it works, but apparently it may take a day or two to take effect after each spider re-reads robots.txt. IPB may not recognize it, but the web server logs should....

#27 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 24 July 2007 - 05:08 PM

"Slurp" is the User Agent for the Yahoo bot....it works, but apparently it may take a day or two to take effect after each spider re-reads robots.txt. IPB may not recognize it, but the web server logs should....

I don't have access to either robots.txt or the server logs. I prefer to use a control that I have under my finger and can adjust as necessary.

I may experiment with blocking only part of Slurp's address range - for instance, 74.6.*.127 <-- not sure if ACP accepts wild card in the middle.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#28 Simonsells91

Simonsells91

    Member

  • Full Member
  • Pip
  • 41 posts

Posted 24 July 2007 - 05:52 PM

This must have been why I was unable to get to the forum for most of the afternoon and early evening (E.S.T.)yesterday. I kept getting the message that something was wrong with the database. :unsure:

I get that every couple of days, it drives me crazy!

#29 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 24 July 2007 - 06:05 PM

Usually it goes away in a few minutes, after the SQL query queue unwinds. We probably won't see it so often now.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#30 Blair

Blair

    GeeksToGo

  • Ambassador
  • Pip
  • 82 posts

Posted 24 July 2007 - 10:40 PM

To enable IPB to recognition of Yahoo's Slurp bot, in the IPB ACP, go to Tools & Settings -> Search Engine Spiders, and under Spider Bot User-Agent, add the following:
slurp=Yahoo.com

This won't do much, except make the guests online figure more accurate when Yahoo spiders aren't blocked.

Edited by Blair, 24 July 2007 - 10:42 PM.


#31 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 24 July 2007 - 10:51 PM

OK. Slurp was there as slurp@inktomi=Hot Bot. Now slurp=Yahoo bot.

But I don't think those work any more for the multi-IP multi-session ones.
I had livebot=Live Bot but it didn't identify the Guests with IP 65.55.*.*
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#32 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 24 July 2007 - 11:36 PM

Interesting.
lj611852.crawl.yahoo.net 72.30.0.0 - 72.30.255.255 is now identified as Yahoo bot and there are only 5 running.
lj611725.crawl.yahoo.net 74.6.0.0 - 74.6.255.255 is the one I spotted and banned.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#33 cnm

cnm

    Mother Lion of SWI

  • Retired Staff
  • PipPipPipPipPip
  • 25,317 posts

Posted 26 July 2007 - 06:32 PM

I now have most of the bots that visit us showing up with their correct names in Board Statistics (bottom of home page) and causing no trouble.

There is a little known bot (new?) showing up: twiceler=Cuill Bot. Very well behaved. See http://www.cuill.com. A startup company "pioneering a new approach to Search", founded by ex-Google people: http://www.cuill.com/founders.html.
Microsoft MVP Windows Security 2005-2006
How camest thou in this pickle? -- William Shakespeare:(1564-1616)
The various helper groups here
UNITE

#34 screen317

screen317

    SWI Sentinel

  • Global Moderator
  • PipPipPipPipPip
  • 8,815 posts

Posted 27 July 2007 - 01:31 AM

I'm still curious as to why there are still so many guests under the "Last click" page who are just looking at the board index...


There really isn't that much to see :rolleyes:

Please consider donating to help support the continued prompt and excellent services of this site.





Member of UNITE
Support SpywareInfo Forum - click the button