Friends, Technology, Web2.0 - What I am reading

    [Home] [Recent] [Site Map]

   

Crawl Test Tool Released to the Public

Posted by Oatmeal

As promised the Crawl Test Tool has been released to the public.  I wrote a blog entry about this about a month ago which highlighted some of the features of the tool, but in a nutshell this is what it does:
This tool is used to test how accessible your site is to search engines and can help you quickly diagnose potential crawling issues and give you an overview of your site"s search friendliness. The tool will spider the URL you enter as well as all the internal links on that page (max 50 per report). For each spidered URL, it will examine the following: whether it"s indexed in the major search engines, last time google spidered the page, http status code, primary keywords on the page, meta description, and the number of internal links on each page. 
Since then two things have changed:  The Crawl Test no longer uses the Yahoo! Term Extraction API to retrieve relevant keywords, instead it uses data from our in-house Term Targeting Tool.  Secondly, unless you are a Premium Member you can only run one report per day and each report will only spider 5 pages.  Premium members can run as many reports as they like and it"ll spider 50 pages.  I"d also like to point out that a good way to test the spider-ability of important pages on your site is to run a crawl test on your site map.

I"ve got a sample report available that I ran on our Web 2.0 Awards.  As always, suggestions and ideas are welcome.

>>Source Link
>>Blog: SEOmoz Daily SEO Blog
>>Publish Date: 4/18/2007 8:01:12 AM
>>Keywords: tool test

Related Posts
>>test #
   
>>Crawl Test - SEO Tool #
    Posted by OatmealThe launch of SEOmoz v3 about a month ago was also the debut of a new tool: the Crawl Test. The Crawl Test Tool is used to quickly diagnose potential crawling issues and give you an
>>Google to Test CPC-based Site Targeting #
    Google announced plans to begin a test of CPC-based ads using the site targeting feature. Site targeting allows advertisers to choose individual sites in the content network where they want their ads
>>TV Guide Joins the Video Search Race #
    When I was growing up, almost every home had a TV Guide sitting on the top of the family TV. Now TV Guide is looking to be on every computer desktop with its own video search engine. It looks like TV
>>The 55 Piece Mobile Search Tool Kit #
    Written by Charles S. Knight, SEO and edited by Richard MacManus Last week I saw the following ad in Radio Shack for the Kronus 55 Piece Home Repair Tool Set: Molded case (1) Bits (20) Bit holder
>>Wordtracker launches free keyword suggestion tool #
    Wordtracker has launched a free keyword suggestion tool. The tool gives webmasters up to 100 keywords in each session.
>>I"m Proud of Rebecca (and a Shameless Plug) #
    Posted by randfishI"ve got to say that I"m immensely proud of Rebecca. When she first applied here at SEOmoz, we failed to even call her back for a second interview. But, she convinced us to take her
>>Wordtracker Offers Free Keyword Suggestion Tool #
    Wordtracker, the popular subscription based keyword research tool used by many professional search marketers, has announced a new free keyword suggestion tool that offers search estimates on up to 100
>>85 Piece Mobile Search Tool Kit #
    Back in February, I came across a Kronus 55 piece Home Repair Tool Kit in a Radio Shack ad - all for just $29.99. This inspired me to assemble the first ever 55 Piece Mobile Search Tool Kit here on Re
>>Yahoo Keyword Tool Not Dead Yet #
    Earlier reports that Yahoo"s keyword research tool is being discontinued are not true, according to a Yahoo spokesperson. Apparently, issues with the public Keyword Selector Tool being inaccessible ar

Other Posts:
>>The Unpredictable Science of Predicting Hits
>>Overheard in (SES) New York
>>Top Digg Users?
>>My First SES - Recap Number Two
>>My "Don"t Fire Me Rand" Recap of SES New York
>>The Value of Attending Conferences
>>I Tie Up Mike McDonald & Interview Vanessa Fox... Again.
>>Help Rand Craft Interview Questions for Google WMC Team
>>Why You Should Blog
>>Whiteboard Friday Vidcast - "Mozzers Take Manhattan"
>>Parasite Hosting Now Dominating Spam Results
>>Learn from a Rankings Dominator - NYMag.com


Month Archives:

Top Tags:
Company & Product Profiles Technology Internet Google Search feature column letter analysis WebApp咨询 Search Headlines comment Startups 业界信息 news 业界动态 application Google/SEO 互联网络 国际政治 BigCos Search Types: Local 創投 產業策進 未來趨勢 創業案例 Yahoo Web2.0 widget


@2007 All rights Reserved