Sitemap errors

Discussion in & # 39; Internet Marketing & # 39; started by australiataxi, December 17, 2018 at 08:13,

  1. australia taxi

    australia taxi



    New member

    November 3, 2018
    Likes received:

    How can I find and fix sitemap errors?

    # 1

    australia taxi,
    December 17, 2018 at 08:13

Share this page

This is how you hide my Sitemap from competitors, not from search engines

The clever solution is to create two sitemaps. The first is for your competitors, the second for your favorite search engines. In military parlance, this first sitemap is a pretense.

The & # 39; feint & # 39; contains your basic website structure, homepage, contact, about us, main categories. It looks like the real deal and works well in dark search engines that you do not care about. It will not benefit your competitors either. Let it be indexed to find it, and give it a unique name like sitemap.xml.

Create your real sitemap with code now. Give it a name like "product-information-sitemap.xml" so it's a reasonable name, but not easier to guess than your password.

Add something to your Sitemap folder in your Apache configuration so that this second Sitemap can be called by search engines, but not indexed:

        Header X-Robots tag "noindex"

Now create the code to maintain this update and look at a third sitemap for images. Dowwngrade it as needed to get the & # 39; feint & # 39; to create. Also pay attention to the timestamps, Google is aware of these and this is important if your sitemap is large.

Now create a & # 39; cron & # 39; job to periodically submit your Sitemap to Google. Add something in your crontab entry to submit your real sitemap every week:

0 0 * * 0 wget

Note that the URL is URL encoded.

You can also gzip your sitemap if size is a problem, even though your web server should provide the gzip, if you have enabled it.

Your robots.txt need not be fancy, as long as it does not allow access to your sitemaps, this should be fine. There is really no need to send different robots.txt files based on user agent strings or other such complicated elements. Just drag your valuable content into an additional unpromoted file and send it to Google on a cron job (instead of waiting for the bot). Easy.

Indexing – How often should we update a Sitemap in a day?

How often should we update a Sitemap in one day?

put on hold as predominantly opinion-based by dan yesterday

Many good questions give some opinion based on expert experience, but the answers to this question are based on opinions rather than facts, references or specific expertise. If this question can be adapted to the rules in the Help, edit the question.

Webcrawler – Should we include coupon pages in the sitemap because they have a higher expiration rate?

Is it a good practice to keep coupons / coupon pages in a sitemap? because they have a faster expiration rate.


We update our sitemap every 24 hours. Therefore, it is recommended to save the coupon pages in the sitemap. Because if they expire but are not updated in the sitemap, will this be a problem?

Adding these will affect the crawl budget due to the page running in 404.

What criteria should be used for priority and frequency of change in a Sitemap?

By what criteria can we set the priority and frequency of change in the sitemap.

For example, if the website is a voucher / service website.

  • The home page must have priority 1. Updated daily
  • Category pages must have priority 1. Updated daily
  • Coupon pages must have priority. Updated weekly

Are the above settings correct?

SEO – Should I provide a custom sitemap for Baidu that contains only Chinese-language URLs?

Some of your previous answers have not been well received and you run the risk of being blocked from answering.

Please note the following notes exactly:

  • Please be sure answer the question, Enter details and share your research!

But avoid

  • Ask for help, clarification or answering other answers.
  • Make statements based on opinions; secure them with references or personal experiences.

For more information, see our tips for writing great answers.

Indexing – Should paginated sites be included in the sitemap?

My site contains ads for boats, boat engines, boat rentals, etc. (

There are ads on several pages. I have finished the pagination (not on the link above):

On some pages (sorting etc.) I have also added a canonical relationship.

Now I want to add pages to the sitemap generator, and I'm not sure if I should add all the URLs, for example:


Or should I just add