User-agent: * Disallow: /css/* Disallow: /icon/* Disallow: /img/* Disallow: /js/* Disallow: /m/* Disallow: /blogs/* Disallow: /blog/* Disallow: /financial/* Disallow: /entitlement/* Disallow: /servlets/* Disallow: /entity/* Disallow: /ptservlet* User-agent: msnbot Crawl-delay: 5 User-agent: SemrushBot Disallow: / Sitemap: https://www.i3investor.com/site.xml