User-Agent: *#Disallow all crawlers access to certain pages Disallow: /gayrimenkul Disallow: /db Disallow: /App_Data Disallow: /aspnet_client Disallow: /picture_library Disallow: /reagent2 Disallow: /test Allow :/