google spiders
- Started
- Last post
- 15 Responses
- seed
Do they crawl the web constantly or in certain time intervals?
- k770
i say constantly
- seed0
I submitted a new site and it listed the swf file in the second result. I update the robots.txt file to make it go away but it hasn't happened yet.
- vb_0
i just squashed one to death. i hate them.
- Lesk0
eh, google loves my name.
- Meeklo0
if you hate the google ones...
I cant image your feeling for the metacrawler ones..
:)
- k770
google stuff gets cached. don't be surprised if that shit doesn't go away so fast.
google is like VD, eh?
- seed0
It gave the actual SWF file the number 2 result.
- k770
yep. becuase google crawl html first i bet.
- heavyt0
straight from google:
they index all pages at intervals of approx. 30-40 days. They are working all of the time, but i think that it takes about that long to finish each cycle. So, dpepending on how lucky you are, it could take 1 day or as much as 40.TR1
- seed0
I got search results the day after I added my URL to Google so it may be a while. Pretty lame having a download link to your swf file on a search engine.
- kld0
maybe you could change the name of your swf
- ghandolf0
I heard of people paying companies a monthly fee to have their site get 'preference' in google searches. Is there anything to this? How do you increase your chances of being one of the top 5 hits google returns in a search for your product?
- paraselene0
that's a dark fucking science, mate.
- vwsung18t0
my supervisor, who does SEO says google indexes websites submitted to google around every three months.
- UndoUndo0
their is a new google technique called 'sand boxing' that can stop yr site listing ofr up to six months just incase yr site selling cameras for teens turns into a site selling pics of teens!