1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

What Is The X-robots Tag?

Discussion in 'Search Engine Optimization' started by oreintation, Jun 2, 2016.

  1. oreintation

    oreintation
    Expand Collapse
    Registered Member

    Joined:
    Jun 2, 2016
    Messages:
    13
    Likes Received:
    0
    hi friends,

    What is the X-Robots tag?
     
  2. james jennifer

    james jennifer
    Expand Collapse
    Registered Member

    Joined:
    Feb 14, 2013
    Messages:
    27
    Likes Received:
    0
    I am hearing first time about x-robots, i also want to know about it in details.
     
  3. Jessica Johansson

    Jessica Johansson
    Expand Collapse
    Junior Member

    Joined:
    Feb 13, 2013
    Messages:
    146
    Likes Received:
    3
    Yes, This is the new things for me, but interesting, please share some thing about in details.
     
  4. Sonali Jain

    Sonali Jain
    Expand Collapse
    Registered Member

    Joined:
    Apr 21, 2016
    Messages:
    40
    Likes Received:
    0
    This is a new thing for me also. Please share some cool details about this.
     
  5. WebGenius

    WebGenius
    Expand Collapse
    Registered Member

    Joined:
    Jan 23, 2016
    Messages:
    40
    Likes Received:
    0
    The X-Robots-Tag can be used as an element of the HTTP header response for a given URL. Any directive that can be used in an robots meta tag can also be specified as an X-Robots-Tag. Here's an example of an HTTP response with an X-Robots-Tag instructing crawlers not to index a page.
     
  6. Jessica Johansson

    Jessica Johansson
    Expand Collapse
    Junior Member

    Joined:
    Feb 13, 2013
    Messages:
    146
    Likes Received:
    3

    Ok, Please share some sample code, Thanks.......
     
  7. Qlehq

    Qlehq
    Expand Collapse
    Registered Member

    Joined:
    Sep 24, 2016
    Messages:
    11
    Likes Received:
    0
    Sample code: robots meta tag

    HTML:
    <!DOCTYPE html>
    <html><head>
    <meta name="robots" content="noindex" />
    (…)
    </head>
    <body>(…)</body>
    </html>
     
  8. Zinavo

    Zinavo
    Expand Collapse
    Junior Member

    Joined:
    Aug 17, 2016
    Messages:
    518
    Likes Received:
    3
    First, let me be clear that if you are using above robots.txt and robots meta tag for blocking your content, then there is no need to use this one. TheX-Robots-Tagcan be used as an element of the header response for a given URL of the web page
     
  9. Calvin

    Calvin
    Expand Collapse
    Junior Member

    Joined:
    Oct 27, 2014
    Messages:
    55
    Likes Received:
    5
    The X-Robots-Tag can be used as an element of the HTTP header response for a given URL of the web page. Benefits of Using it:
    • You can use it where the usage of robots meta tags is not possible, for example: non-html files like Image, Video, and Flash can be blocked.
    • You can add the X-Robots-Tag to a site’s HTTP responses using .htaccess and httpd.conf files.
    • It is Global, which means an X-Robots-Tag with HTTP responses allows you to specify crawling directives that are applied globally across a site.
    • You can use regular expressions for high quality flexibility for complex url or content.
    • Like Robots Meta Tag, you can use other attributes for your page like nosnippet, noodp, notranslate etc.
     
  10. Tripath

    Tripath
    Expand Collapse
    Junior Member

    Joined:
    Dec 18, 2015
    Messages:
    134
    Likes Received:
    3
    The X-Robots-Tag can be used as an element of the HTTP header response for a given URL.
     
  11. Jessica Johansson

    Jessica Johansson
    Expand Collapse
    Junior Member

    Joined:
    Feb 13, 2013
    Messages:
    146
    Likes Received:
    3

Share This Page