To prevent unwanted material during the look for indexes, site owners can instruct spiders not to crawl selected files or directories in the normal robots.txt file in the foundation directory of your domain. On top of that, a website page may be explicitly excluded from the search engine's databases by https://news.rafeeg.ae