


Further assistance through email and a support ticket system is also available. However, Screaming Frog’s User Guide (opens in new tab) ought to address most, if not all, problems you encounter with the software. Technical support is only available for paid-up users of the SEO Spider program. At a glance, this can reveal if you are missing H1 tags or have duplicate headings, both of which could harm your website’s SEO performance. For example, under the tab titled “H1”, you’ll be able to see a list of main headings used on each of your website’s pages. The SEO Spider home screen is set up to easily let you see the key results that have been brought up by your website crawl. As long as your site is set up correctly, SEO Spider should find all of your public pages.

The tool will then look for every link it can find on your homepage and open up them up for analysis. Once you’ve plugged in your website here, simply hit “Start”.
#Screaming frog seo spider tool crawler software software
However, despite the volume of information presented, everything is well-laid out and even beginners should feel comfortable with this software after a couple of hours.Īs soon as the installation is finished, you should be ready to perform your first crawl search.īelow the top menu bar, you’ll see a URL address area. Overall, the SEO Spider interface may feel a little daunting to users who have never worked with an SEO analysis tool before. No matter which edition you’re working with, installation is a relatively quick and pain-free experience. SEO Spider works on any computer running Windows, Mac, or Ubuntu. With SEO Spider you can simply right-click on a URL and hit “Crawl Path Report” to see exactly how it was discovered. If a particular URL should be hidden from public searches, this can obviously be a major headache. One common problem with other SEO website crawling services is that there’s no way to tell how a program found a specific URL. (Image credit: Screaming Frog) View Crawl Path Reports While tree graphs are split into “layers of depth”, crawl diagrams use color-coded nodes to give you a holistic overview of your site’s page index system. With either, you can display up to 10,000 URLs at once. Using SEO Spider, you can create crawl diagrams and tree graphs, both of which are really useful for understanding your site’s architecture. SEO Spider can solve this problem with an advanced algorithmic search that locates any pages on your site with the same headings, titles or descriptions.

But, of course, if you run a large site it’s nearly impossible to manually check for cloned pages. Google and other major search engines don’t look kindly on duplicate content, so having copies of the same pages on your site can quickly lead to lowered page rankings. If you need to schedule regular search crawls for specific URLs, evaluate unpublished websites that can only be accessed through a login, or extract databases for use in another program, this could well be the right tool for you. During our review, SEO Spider stood out for the efficiency of its searches and broad feature set.
