User-agent: bingbot Crawl-delay: 30 User-agent: YandexBot Crawl-delay: 30 User-agent: SemrushBot Crawl-delay: 30 User-agent: SiteAuditBot Crawl-delay: 30 User-agent: * Disallow: /app/ Disallow: /cgi-bin/ Disallow: /downloader/ Disallow: /errors/ Disallow: /includes/ Disallow: /lib/ Disallow: /magento/ Disallow: /pkginfo/ Disallow: /report/ Disallow: /scripts/ Disallow: /shell/ Disallow: /stats/ Disallow: /var/ Disallow: /catalogsearch/ Disallow: /checkout/ Disallow: /control/ Disallow: /contacts/ Disallow: /customer/ Disallow: /administrator/ Disallow: /dpadmin Disallow: admin_session_check.php Disallow: ajax_error_alerts.php Disallow: ajax_assisted_sales_service.php Disallow: ajax_cart_service.php Disallow: ajax_returns_service.php Disallow: ajax_scraping_admin.php Disallow: get_cart_number.php Disallow: get_cart_modal.php Disallow: get_related_products.php Disallow: jsProblem.php Disallow: soap2.php Disallow: resources.php Sitemap: https://dieselpro.com/sitemap.xml Sitemap: https://dieselpro.com/sitemap_en_CA.xml Sitemap: https://dieselpro.com/sitemap_en_AU.xml Sitemap: https://dieselpro.com/sitemap_es.xml Sitemap: https://dieselpro.com/sitemap_it.xml Sitemap: https://dieselpro.com/sitemap_fr.xml Sitemap: https://dieselpro.com/sitemap_pt.xml Sitemap: https://dieselpro.com/sitemap_ms.xml user-agent: AhrefsBot user-agent: MJ12bot User-agent: Rogerbot User-agent: Exabot User-agent: MJ12bot User-agent: Dotbot User-agent: Gigabot User-agent: AhrefsBot User-agent: BlackWidow User-agent: Bot\ [EMAIL="craftbot@yahoo.com"]mailto:craftbot@yahoo.com[/EMAIL] User-agent: ChinaClaw User-agent: Custo User-agent: DISCo User-agent: Download\ Demon User-agent: eCatch User-agent: EirGrabber User-agent: EmailSiphon User-agent: EmailWolf User-agent: Express\ WebPictures User-agent: ExtractorPro User-agent: EyeNetIE User-agent: FlashGet User-agent: GetRight User-agent: GetWeb! User-agent: Go!Zilla User-agent: Go-Ahead-Got-It User-agent: GrabNet User-agent: Grafula User-agent: HMView User-agent: HTTrack User-agent: Image\ Stripper User-agent: Image\ Sucker User-agent: Indy\ Library User-agent: InterGET User-agent: Internet\ Ninja User-agent: JetCar User-agent: JOC\ Web\ Spider User-agent: larbin User-agent: LeechFTP User-agent: Mass\ Downloader User-agent: MIDown\ tool User-agent: Mister\ PiX User-agent: Navroad User-agent: NearSite User-agent: NetAnts User-agent: NetSpider User-agent: Net\ Vampire User-agent: NetZIP User-agent: Octopus User-agent: Offline\ Explorer User-agent: Offline\ Navigator User-agent: PageGrabber User-agent: Papa\ Foto User-agent: pavuk User-agent: pcBrowser User-agent: RealDownload User-agent: ReGet User-agent: SiteSnagger User-agent: SmartDownload User-agent: SuperBot User-agent: SuperHTTP User-agent: Surfbot User-agent: tAkeOut User-agent: Teleport\ Pro User-agent: VoidEYE User-agent: Web\ Image\ Collector User-agent: Web\ Sucker User-agent: WebAuto User-agent: WebCopier User-agent: WebFetch User-agent: WebGo\ IS User-agent: WebLeacher User-agent: WebReaper User-agent: WebSauger User-agent: Website\ eXtractor User-agent: Website\ Quester User-agent: WebStripper User-agent: WebWhacker User-agent: WebZIP User-agent: Widow User-agent: WWWOFFLE User-agent: Xaldon\ WebSpider User-agent: Zeus User-agent: PetalBot Disallow: / User-agent: * Crawl-delay: 30