Page 1 of 1

Spider question

Posted: Sun Jul 05, 2009 10:44 pm
by mgpdevil
One of my trades gives this spider error every minute:
<b>Header violation:</b> Status code 403 (Forbidden) was found on http://trade.com/
What does this mean? That they block the spider or what?
Is it possible to only use this spider option once a day only instead or something like that?

Re: Spider question

Posted: Fri Jul 10, 2009 1:15 am
by WillWank
mgpdevil wrote:One of my trades gives this spider error every minute:
<b>Header violation:</b> Status code 403 (Forbidden) was found on http://trade.com/
What does this mean? That they block the spider or what?
Is it possible to only use this spider option once a day only instead or something like that?

Go to trade settings and set "Spider Interval" to 24h and "violation interval" to 24h. The "Violation Interval" is kicking in if a violation is found. I.e. if set to 30 mins it will retry every 30 mins until no violation is found, regardless of what "Spider Interval" is set to.

A 403 is what it says, a forbidden page is requested from you (the spider) There might be some rewrite rules in effect on your tradepartners end. Difficult to say without seeing the headers.

Re: Spider question

Posted: Fri Jul 10, 2009 9:56 am
by texpert
If you would try to "wget" the return url, it would also give u 403. Nothing u can really do on your side. If you use v 2.0 yon can edit that trade and set spider to "disabled" for that individual trade only.

Re: Spider question

Posted: Mon Jul 13, 2009 3:10 pm
by mgpdevil
Ok thanks a lot for the replies :)