Search Engine Spiders Distorting Stats

Our support will answer all your general questions here.

Moderator: Rock

Post Reply
arock
Posts: 3
Joined: Wed Jun 10, 2009 9:37 pm

Search Engine Spiders Distorting Stats

Post by arock »

Hey
I have brought this up a couple times in the past but wanted to make a thread because I'm not sure if this was ever resolved. Basically, I have TE on some smaller sites which receive relatively speaking a large amount of search engine traffic. So the bookmarkers slot for traffic will have huge numbers sometimes, but when I look at the ips they will be listed as Google or other spiders usually. So sometimes I'll have anywhere between 20-50% bookmarker traffic which will generate clicks, go to trades, but is not actual real surfers. So all my traffic stats get terribly distorted and nothing is even remotely correct, this I have confirmed with by simply trading with my own sites and seeing the Out hits aren't anywhere close to the in hits on the 2nd site.

Any idea what I can do to fix this? I wouldn't want to block the spiders as I would worry about my SE traffic, but I don't want trade expert tracking them either.

Also to toss out an example, I just stuck TE on a site with ~500 traffic a day, mostly search engine traffic. I plan on growing it up some, but also like just having more stats that TE offers. Right now I am getting ~280 bookmarker hits an hour, which will be roughly 6k in bookmarker/spider traffic a day. So for every 10 hits I send to trades, 9 won't actually be surfers, making this pretty useless.
texpert
Site Admin
Posts: 719
Joined: Sat Mar 14, 2009 5:54 pm

Re: Search Engine Spiders Distorting Stats

Post by texpert »

Hmm, well i can see what your problem is. We will try to simplify this whole thing in the future releases. In the mean there is quite a simple solution (or workaround depends how u look at it). You said you are willing to block these IPs. You can do that, but make sure you select "Send blocked traffic to galleries only" in the "Tools / Blocking config". By default system trade "Blocked" (overview menu) is excluded from the total summary, which is what you would probably need. I hope it helps.
arock
Posts: 3
Joined: Wed Jun 10, 2009 9:37 pm

Re: Search Engine Spiders Distorting Stats

Post by arock »

Ok so if I block them it wont actually block them from my site, it'll just block them from being traded?
texpert
Site Admin
Posts: 719
Joined: Sat Mar 14, 2009 5:54 pm

Re: Search Engine Spiders Distorting Stats

Post by texpert »

Yes, make sure you have "Send blocked traffic to galleries only" in the "Tools / Blocking config" selected. And blocked traffic will be sent to galleries only.
Post Reply