Robots.txt and Invisible Characters – How One Hidden Character Could Cause SEO Problems
If you’ve read some of my blog posts in the past, then you know I perform a lot of SEO technical audits. As one of the checks during SEO audits, I always analyze a client’s robots.txt file to ensure it’s not blocking important directories or files. If you’re not familiar with robots.txt, it’s a text … Read more