#Robots.txt file for Village User-agent: gsa-crawler #Do not allow all brand sites Disallow:/es_LA/tag/ Disallow:/es_LA/category/ Disallow:/es_LA/activities/ Disallow:/es_AR/tag/ Disallow:/es_AR/category/ Disallow:/es_AR/activities/ Disallow:/pt_BR/tag/ Disallow:/pt_BR/category/ Disallow:/pt_BR/activities/ #Do not allow js, swf and xml file indexing.Will work only for google bot. #Reg ex not supported for other bots.Recognised only by google bot. Allow:/sitemap-es_LA.xml Allow:/sitemap-es_AR.xml Allow:/sitemap-pt_BR.xml Disallow:/*.swf Disallow:/*.xml Disallow:/*.js