geg2
December 15th, 2007, 04:43 PM
A Google patent on crawling frequency became public a couple days ago.
How often a webpage gets crawled is apparently influenced by
a) how often the page has changed historically
b) PageRank of the page
There are a couple other things mentioned in the patent.
Bill Slawski has a pretty detailed interpretation of the patent
http://www.seobythesea.com/?p=929
Here is the URL to the patent:
http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.htm&r=1&p=1&f=G&l=50&d=PTXT&S1=7,308,643.PN.&OS=pn/7,308,643&RS=PN/7,308,643
How often a webpage gets crawled is apparently influenced by
a) how often the page has changed historically
b) PageRank of the page
There are a couple other things mentioned in the patent.
Bill Slawski has a pretty detailed interpretation of the patent
http://www.seobythesea.com/?p=929
Here is the URL to the patent:
http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO2&Sect2=HITOFF&u=%2Fnetahtml%2FPTO%2Fsearch-adv.htm&r=1&p=1&f=G&l=50&d=PTXT&S1=7,308,643.PN.&OS=pn/7,308,643&RS=PN/7,308,643