This is a surprise that I found by chance. For you see that you also type the main URL of your blog in the address bar of your browser and add /robots.txt. What you're seeing is the text file that originally used for web crawlers do not visit certain pages of your site. Its primary mission is to tell the spiders which pages can recover (Allow) and what to avoid (Disallow).
If you have not customized your robots.txt from the option to search engines Preferences control panel, what should I leave today day will be something like this:
If you have not customized your robots.txt from the option to search engines Preferences control panel, what should I leave today day will be something like this:
Here you can see which indicates that not be indexed addresses that include the parameter / search and how conversely, yes that must retrieve all hanging in the main (domain/) (Except for the above, of course).
The new Sitemap
But the interesting thing we see there and it was not before, is the address at the end with the extension .xml and tells crawlers which direction our sitemap, a kind of map with which to help you to find every corner of our website. It really is a list of all pages of the site (unique addresses) which also includes some important data such as date of update.
With these data the search engines will know, as an index, such as the organization of content to crawl more efficiently. Therefore, submit your sitemap to various search engines is an important part of optimizing your website because not only you will facilitate you to easily find all the pages published, but also be downloaded faster when these change.
Well, although I have not seen advertised, I think we all now have one. Mine is updated as webmaster tools on 16 December last, so you should not have much time to the invention.
Add the New Sitemap to Webmaster Tools
Webmaster Tools there is a section dedicated to the sitemaps that allows us to ensure that Google receives all the information that contains such files properly. But be careful with what is meant, that "receive" is not the same as "indexing" and while it is convenient to do so, does not guarantee anything. To add this new we now just have to enter there, select page for you are going to send the sitemap (if you have several) and within the flyout find the option that name in the section trace.
IMAGE ONE
IMAGE TWO
With Send sitemap already have everything done and we can only hope to pass spiders; sometimes hours, sometimes one day to another.
To combine The Atom format and XML
Maybe in Webmaster Tools you may have mounted before an Atom system that also serves as sitemap, built with successive chains how are you (*)
(*) Each line serves only to 500 entries.
/atom.xml?redirect=false&start-index=1&max-results= 500/atom.xml?redirect=false&start-index=501&max-results=500/atom.xml?redirect=false&start-index=1001&max-results=500That's all we had in Blogger so far and so I suppose many will have it already. In any case it does not hurt to add both formats. The main difference between those with XML and RSS / ATOM is the first detailed all URL's inside a site while the latter typically include only those with date latest update. Therefore some serve to provide complete information travels over from time to time and other help to the most recent changes are updated before.
Indexing Sitemaps
One last thing. If you have many entries is possible that your sitemap has been divided into several pages and then not see it directly the relationship of all your URLs. In that case what you see will be a Sitemap index or ratio of sitemaps partial, within each of which yes you can see all the published articles:3
etc.
http://www.blastism.com/sitemap.xml?page=1http://www.blastism.com/sitemap.xml?page=2http://www.blastism.com/sitemap.xml?page=3 Sign up here with your email
ConversionConversion EmoticonEmoticon