The EURIPBot Crawler |
The EURIPBot Crawler is the homemade searchengine-bot for the searchengine of EURIP. The bot is examine the internet for informations and add these to the index of the Searchengine EURIP. If you dont like your website being existing in our index, then you have several possibilities to deny the access of our bot to your website. | | |
Deny access of the EURIPBot
Block with Meta-Tag
To deny the access of the EURIPBot-Crawler, please inser a META-Tag named "EURIPBOT" and the value "NOINDEX" into the header of your document.
Deny access with "robots.txt"-file
Your can add a file named "robots.txt" into the root-folder of your website. Just insert the following content into the file:
User-agent: Euripbot
Disallow: /privat/
Disallow: /
Info:
More information about the "robots.txt"-file is presented at the website http://www.robotstxt.org. If you page already exist in our system, it will be removed with the next update
| | | | |
