GeedoShopProductFinder

GeedoShopProductFinder is the automated crawler used by Geedo, a global product-search engine specialized in online retail. It indexes products directly from online stores and distributes results across approximately 200 regional Geedo sites, based on the shop's location.

Geedo currently indexes over 8 billion products from more than 5 million stores worldwide. The crawler focuses on publicly accessible product pages and follows robots.txt rules, rate limits, and restrictions defined by site owners.

User Agent Strings

Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko; GeedoShopProductFinder) Chrome/142.0.0.0 Safari/537.36

Verification

To confirm that a request originates from an authentic GeedoShopProductFinder crawler, validate the IP using reverse and forward DNS checks:

Perform a reverse DNS lookup on the requesting IP. Ensure the returned hostname ends with .geedo.com.
```
# host 83.99.206.111
domain name pointer product-search-83-99-206-111.geedo.com.
```

Perform a forward lookup on the returned hostname. Confirm that it resolves to the same IP address.

# host product-search-83-99-206-111.geedo.com
product-search-83-99-206-111.geedo.com has address 83.99.206.111

IP Ranges

GeedoShopProductFinder operates only from documented IP ranges:

83.99.206.0/24

These lists are also available as IPv4 text and JSON.

Rate Limiting

Site owners may control crawl frequency using Crawl-delay in robots.txt.

Specify minimum time (in seconds) between requests:
```
User-agent: GeedoShopProductFinder
Crawl-delay: 10
```

Blocking the Crawler

To restrict the crawler from accessing specific paths, include a robots.txt rule:

User-agent: GeedoShopProductFinder
Disallow: /forum