GelexBot
GelexBot is the crawler behind this service, operated by Dober Security ApS. It fetches published legislation, case law and official guidance from public sources, slowly and openly, under one name you can block.
Who is fetching
Every request we make sends the same agent: GelexBot/0.1 (+https://gelex.eu/bot). We never change it, rotate it or hide behind a browser's name, and we use no proxies. The documents become our corpus of primary law, which lawyers and their AI tools search with a citation to the source.
What it fetches
Only sources we have recorded in our source register, each with its publisher, its licence and the date we read the terms. The coverage page lists every source in use, by jurisdiction.
- Official gazettes, statute databases and court decisions published for the public
- The publisher's own bulk files, APIs or index pages, as documented
- Nothing behind a login, a paywall or a challenge page
How it behaves
One fetcher serves every source, so every publisher gets the same rules.
- robots.txt is read for our own agent name before every request, not only the first
- A longer Crawl-delay of yours wins over ours
- Most publishers get one request at a time, none more than four, with a pause between requests set for each publisher, mostly one to five seconds
- Conditional requests: an unchanged page costs you a 304, not a download
- We retry only 429 and 5xx, with growing waits; a 403, a challenge or Content-Signal ai-input=no stops us
How to object
Disallow GelexBot in robots.txt and we stop at the next request. To ask us to remove what we already hold, follow the takedown procedure.
- Rate or access questions: legal@gelex.eu
- A person answers, and we name the source we fetched from
- A text of ours that differs from your publication: send its address to legal@gelex.eu and we correct it from your published version