A robots.txt file is important for SEO
One of the goals in Search Engine Optimization (SEO) is to educate Search Engines (SEs) about your website. There are many common methods to provide SEs with information about your site, such as page titles, meta tags (e.g., description, keywords), and the use of Headers (e.g., h1, h2, etc.) and bold text. However, one method that seems to be underused by many Chinese websites, is the use of a robots.txt file. Read the rest of this entry »