User-agent: * Disallow: /pdf.aspx? Disallow: /egv_data/ Disallow: /data/ Disallow: /*.pdf$ Disallow: /gazetteViewDetail.aspx? #Allow: WebSurge