What is Mojeek?
MojeekBot is how Mojeek builds its search index. It fetches pages under the MojeekBot identity, processes index controls, and makes eligible documents available to the Mojeek search engine. A crawl is part of indexing, not a visit from a person who has just clicked a result.
Mojeek says the crawler should make no more than one request per second to a site, whether the request succeeds or fails. It does not support the nonstandard Crawl-delay directive. If observed traffic is faster than that published ceiling, first confirm that all requests are genuine and that logs from multiple hosts have not been combined.
Allowing MojeekBot can make a page eligible for Mojeek's conventional search results. Neither the directory record nor Mojeek's bot page says the crawler collects model-training data. A fetch should not be advertised as increasing visibility in unrelated AI answers.
The crawler reads robots.txt and follows the first record whose user agent contains MojeekBot, falling back to the first wildcard record when no specific section exists. Mojeek also documents support for noindex, nocache, and nofollow meta tags. A noindex page still has to be fetched before the engine can see that instruction.
