php display different content to visitors and crawlers

I heard that this method will violate some operating principles of search engines, and may be punished by various search engines, or even delete the website. So I have just removed this treatment until I am sure that it is not cheating. Friends who are enterprising You can continue to use it, but at your own risk.

The homepage and archive pages of this blog display articles in the form of a list, and the content of the article is only loaded when the visitor clicks to expand the article. Because the content of the article contains a large amount of text and pictures, which require a lot of loading time and traffic. Displaying web pages to visitors as quickly as possible can retain a large number of visitors. For mobile users, loading time and traffic are more important.

Generally speaking, The homepage of the website is the page most visited by search engines, and meaningful content should be displayed to them as much as possible. However, if the articles are displayed in the form of a list, visitors and search engines can only obtain the article title information. Article content or summary ( Especially the first sentence of the article) is extremely important for SEO, so we have to try to send this content to the crawler.

Well, we can use the User Agent to determine whether the visitor is a crawler, and if so , then the articles are displayed in general form, otherwise the article list is displayed in list form. You can use the following PHP method to determine whether it is a crawler:

function is_crawler() { 
$userAgent = strtolower($_SERVER['HTTP_USER_AGENT']); 
$spiders = array( 
‘Googlebot', // Google 爬虫 
‘Baiduspider', // 百度爬虫 
‘Yahoo! Slurp', // 雅虎爬虫 
‘YodaoBot', // 有道爬虫 
‘msnbot' // Bing爬虫 
// 更多爬虫关键字 
); 
foreach ($spiders as $spider) { 
$spider = strtolower($spider); 
if (strpos($userAgent, $spider) !== false) { 
return true; 
} 
} 
return false; 
}

This is the method I use, each crawler accesses comments from high to low Sort. Then display different content to crawlers and natural people through the following method

More php displays different content to visitors and crawlers. For related articles, please pay attention to the PHP Chinese website!