# /robots.txt User-agent: webcrawler Disallow: User-agent: * Disallow: /admin Disallow: /alcatel Disallow: /awstats Disallow: /camera Disallow: /chat Disallow: /data Disallow: /forum Disallow: /forumtwee Disallow: /fotos2000 Disallow: /fotos2001 Disallow: /fotos2002 Disallow: /fotos2003 Disallow: /gasten Disallow: /gastenboek Disallow: /general Disallow: /intranet Disallow: /katten Disallow: /mrtg Disallow: /muziek Disallow: /mysqlmanager Disallow: /noorwegenfav Disallow: /software Disallow: /sysinfo Disallow: /treinbaan Disallow: /shop-info