Evaluación y Análisis

#
# robots.txt
#
# This file is to prevent the crawling and indexing of certain parts
# of your site by web crawlers and spiders run by sites like Yahoo!
# and Google. By telling these "robots" where not to go on your site,
# you save bandwidth and server resources.
#
# This file will be ignored unless it is at the root of your host:
# Used:    http://example.com/robots.txt
# Ignored: http://example.com/site/robots.txt
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html
User-agent: *
Crawl-delay: 10
# CSS, JS, Images
Allow: /misc/*.css$
Allow: /misc/*.css?
Allow: /misc/*.js$
Allow: /misc/*.js?
Allow: /misc/*.gif
Allow: /misc/*.jpg
Allow: /misc/*.jpeg
Allow: /misc/*.png
Allow: /modules/*.css$
Allow: /modules/*.css?
Allow: /modules/*.js$
Allow: /modules/*.js?
Allow: /modules/*.gif
Allow: /modules/*.jpg
Allow: /modules/*.jpeg
Allow: /modules/*.png
Allow: /profiles/*.css$
Allow: /profiles/*.css?
Allow: /profiles/*.js$

La clasificación global de Semrush para consumidor.gov es 535,936 . consumidor.gov tiene un valor estimado de US$19,749,193 según los ingresos publicitarios estimados. consumidor.gov es accedido por aproximadamente 2,278,753 usuarios únicos cada día. Su servidor web está ubicado en United States y tiene una dirección IP de 104.98.79.72. SiteAdvisor dice que es seguro acceder a consumidor.gov.

HTTP/1.1 301 Moved Permanently
Server: AkamaiGHost
Content-Length: 0
Location: https://www.consumidor.gov/
Date: Thu, 21 Oct 2021 20:01:05 GMT
Connection: keep-alive

HTTP/2 200 
x-content-type-options: nosniff
x-content-type-options: nosniff
x-xss-protection: 1; mode=block
x-frame-options: SAMEORIGIN
content-language: es
x-ua-compatible: IE=edge,chrome=1
etag: "1634845999-1"
last-modified: Thu, 21 Oct 2021 19:53:19 GMT
access-control-allow-origin: *
content-type: text/html; charset=utf-8
x-cache-hits: 0
cache-control: public, max-age=300
expires: Thu, 21 Oct 2021 20:06:05 GMT
date: Thu, 21 Oct 2021 20:01:05 GMT