Google scraper ban

I posted something similar to this on the WMW forum and then decided it belogs here on my blog. This was a thread about collateral damage from the 7-29 Google scraper ban.

Andilinks has a lot of original content, both on pages full of text written entirely by me and as commentary about various listed links. I was however also using exerpts and meta descriptions from the linked sites to describe them and must have passed some threshold for that. I was seeding with these descriptions and re-editing later. I certainly will admit that the AdSense revenue was very good and that did provide an incentive to produce more pages, especially high-traffic pages.

There are far too many pages on my site like this for me to change them legitimately in a timely fashion and using text-scrambling software would degrade the descriptions and make my site more like the scrapers themselves. But I may write a script to swap out certain synonyms wholesale.

I am disallowing googlebot from those pages for now (they still do well with Y and M but I fear these may have their own scraper crack-down soon as well). I am keeping my fingers crossed.

In this recent recovery process I accidentally used too many 301 redirects for the server load and probably confused slurp and msnbot too...

But I have almost four years work invested in the database and am working day and night to recover this. If you stop hearing from me you'll know I 'died trying.'

andiFASHION

I am just heartbroken that Google dropped Andilinks from its index on July 28. I am finally recovering but I doubt I'll ever get back to where I was with it...

I have started a new site with just the Women's Wear pages. I have gotten two pages into Google but I'm blocking the googlebot from the directory until I figure out why Andilinks was banned.

I was probably swept up in the scraper spam ban, but I don't know how to keet the robot from mistaking me for a scraper. Well, I'll have more to say on this later. I'm finally getting my spirits back with having a new website.