How to identify Baidu spider? How to attract Baidu spider?

How to identify Baidu spider? How to attract Baidu spider?

When many SEO practitioners first come into contact with this industry, they often ask: What is Baidu Spider? We can understand that Baidu Spider is the IP used to crawl website links. I often hear that Baidu Spider comes too frequently and the server is going to be overwhelmed. If you cannot identify Baidu Spider, how do you know that it is Baidu Spider that caused the server to explode? There are also cases where Baidu spiders don’t come anymore. There are also many sites that want to get the IP segment of Baidu spiders and add the IP to the whitelist, but they cannot identify Baidu IP.

So how to identify Baidu spider? How to attract Baidu spider? Come on, just do two things to correctly identify Baidu Spider

How to identify Baidu spider? How to attract Baidu spider?

1. Check the UA. If the UA is not correct, you can directly determine that it is not a Baidu search spider. The UAs currently announced to the public are:
Mobile UA: Mozilla/5.0 (Linux;u;Android 4.2.2;zh-cn;) AppleWebKit/534.46 (KHTML,likeGecko) Version/5.1 Mobile Safari/10600.6.3 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

PC UA: Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)

New rendering UA:
Mobile UA: Mozilla/5.0 (iPhone; CPU iPhone OS 9_1 likeMac OS X) AppleWebKit/601.1.46 (KHTML, like Gecko) Version/9.0 Mobile/13B143 Safari/601.1 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html)

PC UA: Mozilla/5.0 (compatible; Baiduspider-render/2.0; +http://www.baidu.com/search/spider.html)

2. Reverse IP
Webmasters can determine whether a spider comes from the Baidu search engine by reverse looking up the IP through DNS. The verification methods vary according to the platform. For example, the verification methods for Linux, Windows, and OS are as follows:

Correctly identify Baidu Spider (1). On Linux, you can use the host ip command to reverse the ip address to determine whether it is captured by Baiduspider. Baiduspider's hostname is in the format of *.baidu.com or *.baidu.jp. Anything other than *.baidu.com or *.baidu.jp is an impersonation.

(2) On Windows or IBM OS/2 platforms, you can use the nslookup ip command to reverse the IP address to determine whether it is captured by Baiduspider. Open the command processor and enter nslookup xxx.xxx.xxx.xxx (IP address) to resolve the IP to determine whether it is captured by Baiduspider. The hostname of Baiduspider is named in the format of *.baidu.com or *.baidu.jp. If it is not *.baidu.com or *.baidu.jp, it is an impersonation.

(3) On Mac OS, you can use the dig command to reverse the IP address to determine whether it is captured by Baiduspider. Open the command processor and enter dig xxx.xxx.xxx.xxx (IP address) to parse the IP to determine whether it is captured by Baiduspider. The hostname of Baiduspider is named in the format of *.baidu.com or *.baidu.jp. If it is not *.baidu.com or *.baidu.jp, it is an impersonation.

How to identify Baidu spider? How to attract Baidu spider?

1. High-authority backlinks

High-weight websites are authoritative and will definitely be treated specially by Baidu spiders. The frequency of crawling will be relatively high. Moreover, the higher the weight of the website, the deeper it will be crawled, and the more pages can be crawled. In this way, spiders will also crawl to our own website through friendly links, so when you change friendly links, try to change to high-authority sites.

2. Keep the website updated

The spider stores the page data every time it crawls. If the second crawl finds that the page is exactly the same as the first included, it means that the page has not been updated and there is no need for the spider to crawl it frequently. The more frequently the page content is updated, the more frequently spiders will visit the page. Update your articles regularly so that spiders can crawl them effectively according to your rules. This will not only allow your updated articles to be crawled faster, but also prevent spiders from making frequent wasted trips. Also, after updating, remember to submit the link actively.

3. Originality of the article

High-quality original content is very attractive to Baidu spiders. The purpose of spiders is to find new things, so the articles updated on the website should not be collected or reprinted every day. We need to give spiders truly valuable original content. If spiders get what they like, they will naturally have a good impression of your website and come here frequently to find food.

4. Home page recommendation

The home page is the page most visited by spiders and also the page with the highest weight on the website. You can set up an update section on the home page. This will not only update the home page and increase the frequency of spider visits, but also promote the crawling and inclusion of updated pages. The same operation can be performed on the column page.

<<:  How to improve SEO ranking? How to rank in the top three on the SEO homepage?

>>:  What does pan-directory mean? How to do IIS secondary directory reverse proxy?

Recommend

Event promotion: A collection of 54 event cases for the 2019 Spring Festival!

During the Spring Festival, major Internet platfo...

How to do new media marketing for niche brands?

While you are writing your PPT, cod are jumping o...

How to play with free channels - bringing in 300,000 users in three months

When a new APP product enters the market, how to ...

Introduction to non-standard advertisements in OPPO App Store

FAQ-Non-standard Advertising Q1: Can I cancel the...

Advertising: 8 creative writing tips to increase your click-through rate!

We all know that the role of creativity is to att...

When will the 2020 epidemic end and when will the 2020 epidemic be lifted?

I want to go out, but when is it safe? Will the e...

Google promotion: teach you how to do Google search advertising

Google Ads is the most important form of advertis...

Yuan Hai: "Case Study: MUJI: Concept-driven Business"

Yuan Hai's "Case Study: MUJI: Concept-dr...