Highlight links internal
external
nofollow

Posted on by


Browseo is a wonderful tool for browsing pages through the eyes of a search engine. When it comes to analyzing site structure and other factors that pertain to an entire website, Screaming Frog is the tool of choice for many to use alongside Browseo. Both tools together are a perfect match.

Besides Browseo, Screaming Frog is one of the most powerful tools a technical SEO has in his toolbox. That said, the recent additions to the software have made it a "must have" for every SEO. Out of necessity I built a similar spider back in the 90's so I know how hard it is to build a spider to evaluate site architecture and structure. The new features take "the Frog" from being a mainstay in the SEO toolbox to a tool that webmasters should be looking at to monitor site health and stay ahead of what can become very large numbers, very fast, in Google Webmaster Tools.

The Sitemap Generator

Yeah! I know you are thinking "big deal there are a bunch of free tools that do that very well!". So webmasters generate it and adjust as content is added. Yes that insures indexing but does it enable you to identify new content or changed content? Likely not. Whereas Screaming Frog includes the last modified date from the header and from that you can learn:

  1. what is new on the site
  2. what has been changed
  3. when these events occured

Last modified is a very important value in the header as Google for sure uses it to partly determine what is fresh and when indexing refreshes should occur. Since Google has been known to favor freshness a few SEO's and spameisters have made their last modified dynamic. Sorry folks, Google is not a fencepost so I would be very, very careful with that stuff. So we have this XML sitemap with last modified how do we use this to our advantage?

Simple! Open Excel import the xml file and then sort (descending) on the last modified field. Voila! At the top of the list are the new and changed files! I suggest a weekly indexing and saving your last indexing for comparison. Again, When your client screws up and potentially tanks their rankings by say .... I don't know... setting the "discourage Search Engines..." setting in WordPress...  Don't laugh I've seen it happen more than once! With weekly indexing you may even be able to catch it before the Search Engines do.

Lists

This feature is amazing for testing how spiders react! Testing robots.txt and .htaccess is now as simple as adding the list of URLs you want to test into Screaming Frog! The first thing I do for site migrations or redevelopments is index the site just before the migration/changes take place. That way I have lists to work from for my robots.txt and .htaccess files. Once those are written and the development/migration is complete I use the list feature in Screaming Frog to test the links, robots.txt and redirections.

Speed

This is very cool because you can get an idea in real seconds which makes sense whereas Google tool uses some cockameme grading thing. However the Google tool is very useful in figuring out exactly what page elements are responsible for the slow load speed. I like to make decisions on "real numbers" not some formulas. How about you?

So, what do you do when you see a need for speed? Use Screaming Frog to identify the problematic pages then you run the pages that need improvements through the Google tool to see the best way to improve the load speed. This saves you time and enables you to make more informed decisions about what pages to implement changes on because they are based on real numbers that you can understand and know exactly how it affects the user experience.

Conclusion

There is lots of other new features in Screaming Frog I strongly suggest you learn what data it collects and as you go through that the ways that it can benefit you will become endless. That and the the never ending additions to this program like Video and Media sitemaps means this will be a tool you'll rely on for many years so learning what it does and how will make you that much better as an SEO or webmaster!

Terry Van Horne

About

Partner, SEO Training Dojo.   Terry Van Horne has been developing and marketing websites since the early 90's in various marketing and development positions including working as internet marketing manager for one of Canada's largest real estate developers; SEO for an award winning real estate search engine and marketing manager for ecommerce stores in the apparel and musical instruments. In 2007 he developed a YouTube Marketing Strategy and to date those 300+ videos have received over 26,000,000+ downloads . He is currently a partner with David Harry in Reliable SEO, a Search and Social Media Marketing Agency, and the award winning SEO Training Dojo, a learning community as well as three other marketing and industry news sites. Terry is Director Of SEO Dojo Radio and co-hosts 2 hour long podcasts "Search Geeks Speak," an hour with luminaries and up and comers in Search Engine Marketing as well as "The Regulators," an hour of Industry News. Terry founded SeoPros.org, the first consumer advocacy organization for purchasers of search engine optimization and is currently a Director of the NFP organization OSEOP that grew out of it. Follow him on Twitter.

104 Responses to “Tool Review: 3 Tips for Using Screaming Frog’s New Features”

  1. Ryan Dozier says:

    I’ve just discovered this tool and already can see the benefits it has.

  2. Doris says:

    I think it is not a disadvantage if you pay $ 99 a year for this extensive software. Other professional SEO tools cost 50, 100 or more $ every month and the Screamingfrog offers for this price incredibly many ways.

  3. Agen Sbobet says:

    You may post on the professional credentials for the blog owner. You could express it’s outstanding. Your blog experience can springboard your click through.

  4. Taruhan Bola says:

    This is my first time i visit here. I found so many entertaining stuff in your blog, especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the leisure here! Keep up the good work. I have been meaning to write something like this on my website and you have given me an idea.

  5. Thanks so much with this fantastic new web site. I’m very fired up to show it to anyone. It makes me so satisfied your vast understanding and wisdom have a new channel for trying into the world. Jadwal Liga Spanyol Klasemen Liga Spanyol

  6. Agaricpro says:

    nice articel, i’m so lucky to find this articel

    Gejala-gejala Penyakit Asam Urat

    Terasa ngilu, nyeri, kesemutan pada persendian
    Persendian akan terasa ngilu biasanya di pagi hari atau malam hari
    Persendian akan kemerahan dan bengkak
    Terasa nyeri di persendian kaki, siku, tumit, dan tangan
    Penderita asam urat akan sulit bergerak jika asam urat sudah parah

  7. wulili says:

    dfdmichael kors, Ray Ban Sunglasses,Ray Ban Outlet,Ray Ban Sale,Cheap Ray Bans,Cheap Ray Ban Sunglasses,ray ban sunglasses outlet,ray ban,rayban,ray bans,ray-ban,raybans,ray ban wayfarer,ray-ban sunglasses,raybans.com,rayban sunglasses,cheap ray ban, jordan shoes, oakley sunglasses, cheap oakley sunglasses, air jordan, tory burch outlet,tory burch,tory burch handbags,tory burch shoes,tory burch sale,toryburch,tory burch sandals,toryburch.com,tory burch flip flops, michael kors outlet, michael kors, toms outlet,toms shoes,toms shoes outlet,tom shoes,toms wedges,cheap toms,toms.com, Ray Ban Sunglasses,Ray Ban Outlet,Ray Ban Sale,Cheap Ray Bans,Cheap Ray Ban Sunglasses,ray ban sunglasses outlet,ray ban,rayban,ray bans,ray-ban,raybans,ray ban wayfarer,ray-ban sunglasses,raybans.com,rayban sunglasses,cheap ray ban, gucci outlet,gucci handbags,gucci belts,gucci shoes,gucci,gucci belt,gucci sunglasses,gucci bags,cheap gucci, burberry outlet,burberry,burberry outlet online,burberry factory outlet,burberry sale,burberry handbags, true religion outlet, polo ralph lauren, burberry, michael kors, oakley sunglasses,cheap oakley,cheap oakley sunglasses,oakley sunglasses cheap,oakley outlet,oakley sunglasses outlet,oakley vault,oakleys,oakley.com,sunglasses outlet,cheap sunglasses,oakley prescription glasses,fake oakleys,oakley glasses,oakley store,fake oakley,oakley sale,cheap oakleys,discount oakley sunglasses, oakley sunglasses, burberry,burberry outlet,burberry outlet online,burberry factory outlet,burberry sale,burberry handbags, christian louboutin, gucci outlet, cheap jordans, polo ralph lauren,ralph lauren outlet,ralph lauren outlet online,polo ralph lauren outlet,polo ralph lauren outlet online,ralph lauren,polo ralph,polo shirts,ralphlauren.com,polo outlet,ralph lauren polo, michael kors outlet online, jordan retro,jordan shoes,air jordan,air jordans,retro jordans,air jordan retro,jordans,jordan 11,jordan xx9,jordan 6,new jordans,cheap jordans,jordan retro 11,jordan 5,air jordan 11,jordans for sale,jordan 4,jordan 1,jordan future,jordan 3,jordan 12,michael jordan shoes,air jordan shoes, tory burch outlet, burberry outlet, jordan retro, gucci handbags,gucci outlet,gucci belts,gucci shoes,gucci,gucci belt,gucci sunglasses,gucci bags,cheap gucci, christian louboutin,louboutin,red bottom shoes,louboutin shoes,red bottoms,louboutin outlet,christian louboutin shoes,christian louboutin outlet,red bottom shoes for women,louboutins, oakley sunglasses, ray ban sunglasses, tory burch, ralph lauren outlet,ralph lauren outlet online,polo ralph lauren outlet,polo ralph lauren outlet online,polo ralph lauren,ralph lauren,polo ralph,polo shirts,ralphlauren.com,polo outlet,ralph lauren polo, Ray Ban Sunglasses,Ray Ban Outlet,Ray Ban Sale,Cheap Ray Bans,Cheap Ray Ban Sunglasses,ray ban sunglasses outlet,ray ban,rayban,ray bans,ray-ban,raybans,ray ban wayfarer,ray-ban sunglasses,raybans.com,rayban sunglasses,cheap ray ban, toms shoes, ralph lauren outlet, michael kors outlet,michael kors,kors outlet,michael kors handbags,michael kors outlet online,michael kors outlet online sale,michael kors handbags clearance,michael kors purses,michaelkors.com,michael kors bags,michael kors shoes,michaelkors,cheap michael kors, air jordan,jordan shoes,cheap jordans,air jordans,jordan retro,air jordan shoes,jordans,jordan 11,jordan xx9,jordan 6,new jordans,retro jordans,jordan retro 11,jordan 5,air jordan 11,jordans for sale,jordan 4,jordan 1,jordan future,jordan 3,jordan 12,michael jordan shoes,air jordan retro, cheap jordans,cheap jordan shoes,cheap jordan,cheap jordans for sale,jordans for cheap,jordan shoes,jordans,air jordan,jordan retro,jordan 11,jordan xx9,jordan 6,new jordans,air jordans,retro jordans,jordan retro 11,jordan 5,air jordan 11,jordans for sale,jordan 4,jordan 1,jordan future,jordan 3,jordan 12,michael jordan shoes,air jordan shoes,air jordan retro, oakley sunglasses,cheap oakley,cheap oakley sunglasses,oakley sunglasses cheap,oakley outlet,oakley sunglasses outlet,oakley vault,oakleys,oakley.com,sunglasses outlet,cheap sunglasses,oakley prescription glasses,fake oakleys,oakley glasses,oakley store,fake oakley,oakley sale,cheap oakleys,discount oakley sunglasses, gucci handbags, michael kors handbags, toms outlet, jordan shoes,air jordan,cheap jordans,air jordans,jordan retro,air jordan shoes,jordans,jordan 11,jordan xx9,jordan 6,new jordans,retro jordans,jordan retro 11,jordan 5,air jordan 11,jordans for sale,jordan 4,jordan 1,jordan future,jordan 3,jordan 12,michael jordan shoes,air jordan retro, tory burch,tory burch outlet,tory burch handbags,tory burch shoes,tory burch sale,toryburch,tory burch sandals,toryburch.com,tory burch flip flops, toms shoes,toms outlet,toms shoes outlet,tom shoes,toms wedges,cheap toms,toms.com, ray ban sunglasses, ray ban sunglasses, oakley sunglasses,cheap oakley,cheap oakley sunglasses,oakley sunglasses cheap,oakley outlet,oakley sunglasses outlet,oakley vault,oakleys,oakley.com,sunglasses outlet,cheap sunglasses,oakley prescription glasses,fake oakleys,oakley glasses,oakley store,fake oakley,oakley sale,cheap oakleys,discount oakley sunglasses, michael kors outlet online,michael kors,kors outlet,michael kors outlet,michael kors handbags,michael kors outlet online sale,michael kors handbags clearance,michael kors purses,michaelkors.com,michael kors bags,michael kors shoes,michaelkors,cheap michael kors

    • wallens says:

      I know your expertise on this. I must say we should have an online discussion on this. Writing only comments will close the discussion straight away! And will restrict the benefits from this information. senuti mac

      • wallens says:

        Your content is nothing short of brilliant in many ways. I think this is engaging and eye-opening material. Thank you so much for caring about your content and your readers. hajj packages

  8. . I am going to bookmark your site and preserve checking for new information.

  9. I know where Im going and I know the truth, and I don’t have to be what you want me to be. I’m free to be what I want.Thankyou i really love it, softtonice | canon support | drivers and software

  10. i love the article. i want these at my fingertips and i bookmarking it for future referance thanks!!
    want to stream any mp3 Stream any mp3 at Snow-mp3

  11. This is one awesome article.Really thank you! Keep writing

  12. Really informative blog post.Thanks Again. Cool.

  13. I really enjoy the post.Much thanks again. Want more.

  14. wallens says:

    These are some great tools that i definitely use for SEO work. This is a great list to use in the future.. Commission Juggernaut Reloaded

  15. esoftpedia says:

    A lot of things that can increase my knowledge here, I continue to monitor your blog for updates. Thankyou i really love it

  16. softpedia says:

    I really liked this part of the article, with a nice and interesting topics have helped a lot of people who do not challenge things people should know… you need more publicize this so many people who know about it are rare for people to know this, Success for you. Download Firefox 2016 Download Firefox 2016 Download Firefox 2016 Download Smadav 2016 smadav 2016

  17. Good post about Screaming Frog’s New Features

  18. This is a wonderful article. These type of articles keeps the users interest in the website.

  19. I appreciate everything you have added to my knowledge base.Admiring the time and effort you put into your blog and detailed information you offer.Thanks. obat mata silinder

  20. Filehorse says:

    I really liked this part of the article, with a nice and interesting topics have helped a lot of people who do not challenge things people should know… you need more publicize this so many people who know about it are rare for people to know this, Success for you.

  21. Keep posting, Thanks-a-mundo for the blog article.Really thank you! Fantastic.Looking forward to reading more. Great post.Really thank you! Awesome.

  22. Helan says:

    Nice post, good to hear about this 3 tips.’

    KWD

  23. These type of articles keeps the users interest in the website. Thank you.

  24. Helan says:

    Hi, Happy veterans day

  25. Im obliged for the blog article.Thanks Again. Cool.

  26. I appreciate you sharing this article post.Really thank you! Really Great.

  27. Thank you for your post.Thanks Again. Keep writing.

  28. Appreciate you sharing, great blog.Really looking forward to read more. Want more.

  29. Thanks for the blog post.Really looking forward to read more. Really Great.

  30. Im obliged for the blog article. Keep writing.

  31. Thank you for your blog post.Really looking forward to read more. Really Great.
    Shahrukh dilwale torrent

    srk dilwale torrent download

  32. Adrian says:

    Interesting topic for a blog. I have been searching the Internet for fun and came upon your website. Fabulous post. Thanks a ton for sharing your knowledge! It is great to see that some people still put in an effort into managing their websites. I’ll be sure to check back again real soon. darkness reborn cheats

  33. hate story 3 says:

    I really like and appreciate your article.Really looking forward to read more. Great.
    Hate Story 3 Torrent Download
    Hate Story 3 Torrent

  34. screaming frogs is really nice…thanks for sharing
    GK Sarkari Naukri
    msrtc recruitment

  35. mata buram says:

    With the Kleine Rittergasse 11, Franken Architects created an exciting and multi-facetted building. Although the interior definitely is convincing, the true star of the project, from my point of view, is the outer appearance. It seems almost unobtrusive at first glance, but the closer you get, the more interesting the house becomes until all questions about the façade dissolve into… well, just shaky lines. cara mengobati mata buram secara alami

  36. I think you should explore the articles on your website, You should also cover different different categories for articles as you writes awesome. Thanks for sharing this great article with us.
    Happy New Year 2016