# Everything may be crawled. The API (/api/) is not blocked here on purpose: a blocked address that other # pages link to still gets indexed, without its content. Instead every API response carries # "X-Robots-Tag: noindex" (.htaccess), which search engines can only see if they are allowed to fetch it. # Content signals (contentsignals.org): how the content may be used once it is accessed. search: show it # in search results with links; ai-input: use it to answer a question in real time, with the source; ai-train: # use it to train or fine-tune a model. The prompt repository is the site's work, so training is not allowed. User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / Sitemap: https://thinkhard.si/sitemap.xml