How to Build a robots.txt File

First of all, it’s not a necessity for every website to have a robots.txt file. This file exists to tell the search engines you want them to limit their access to specific pages or directories of a website, so without one, the entire site would be indexed. It can address either all or just specific bots.

Depending upon the site, of course, allowing the search engine to index any and all pages could present a problem. For instance, if an ecommerce site with on-site search function doesn’t limit access at all, then every single search would result in a new URL being created – which could appear in Google’s search results (as well as any other search engine’s SERPs). This can easily result in a site with only 400-ish pages having tens of thousands of pages [Read more…]

Do you Need a Site Audit?

Site audits can yield a lot of very valuable information to allow you to optimize your website effectively. But is the cost always justified? No, not always.

Does your website even need a site audit? Maybe a Snapshot is sufficient to tell you what needs attention.

If your mechanic proposes an engine overhaul before even checking under the hood, or your doctor suggests surgery before running any tests, you’d rightfully question their judgment, wouldn’t you? The same is true for a site audit. Any reputable SEO is going to have already taken at least a quick look at your site before making a recommendation for a site audit. If they’re quoting you a price before you’ve even shared your domain name, you should run, don’t walk. [Read more…]

Does Early Detection Really Help?

We all know people whose lives were saved because a medical checkup revealed an ailment in its early stages… early enough that treatment could help them avoid some devastating illness. Many of us have loved ones who are still with us because they believed in dealing with their health proactively.

Such a proactive approach isn’t just limited to our bodies, though. We also check our roofs for potential leaks before the rainy season arrives, check the condition of our tires before a long trip and inspect our parachutes before making a jump or our regulator before the first dive of the summer. There’s a long list of routine checks we all perform, knowing that they may enable us to avoid undesirable consequences. It’s in our nature to avoid the undesirable.

We take preventive measures hundreds of times each day. We look before crossing the [Read more…]