Technical answer engine optimisation (AEO) for UK websites
Make sure AI assistants can reach and read your website
Tilio, a UK answer engine optimisation (AEO) agency, provides technical AEO for UK websites, finding and fixing what stops AI assistants reaching and reading your pages, from crawler access and rendering to structured data, redirects and duplicate pages. It’s for marketing leads and developers who suspect the site itself is keeping them out of AI answers, and Tilio makes the agreed fixes itself or briefs your developers, as part of Gain, its monthly AEO programme.
Last updated
- 80%
- Answers that named a brand cited its own website
- Tilio’s research
- In Tilio’s research into 44,587 UK AI answers for four brands, collected between 5 October and 3 November 2026, answers that named a brand cited its own website 80% of the time, and an answer engine can’t quote a page it can’t read.
What technical work is included in AEO?
Technical AEO covers the parts of your website that decide whether AI assistants can reach, read and understand it. In Gain, Tilio’s monthly AEO programme, it starts with a full technical audit of your agreed website scope, then the fixes, made by Tilio within an agreed allowance or briefed to your developers.
Much of technical AEO overlaps with technical SEO, because answer engines often draw on pages search engines can crawl and rank. Technical AEO adds the AI side, such as the separate crawlers each AI company runs.
- Crawler access
Whether AI crawlers can get past robots.txt rules and bot protection.
- Rendering
Whether your content is in the page a crawler receives.
- Structured data
The labels that tell AI what a page is about.
- Site structure
How your pages link together, so crawlers find the ones that matter.
- Redirects and duplicates
Old addresses that still reach the right page, and one version of each page, not several.
Technical work is one of four kinds of work in Gain, with tracking, content and outreach to other sites. A page AI assistants can read still has to answer your customers’ questions well, which is the job of content for AI search. The rest of what Tilio offers is listed under Tilio’s AEO services.
Can AI assistants access and read our site?
AI assistants can only access and read your site if your settings let their crawlers in and your content is in the page they receive. Four things can shut them out without anyone noticing: rules in robots.txt, bot protection, content that needs JavaScript or a click to appear, and cookie banners.
Training crawlers such as GPTBot and ClaudeBot are separate from the search crawlers. Blocking them tells OpenAI and Anthropic not to train on your pages, without stopping ChatGPT or Claude finding them for search.
| What gets in the way | What it does | The usual fix |
|---|---|---|
| Rules in robots.txt | A blanket or misaimed rule can block AI search crawlers by mistake. | Allow the search crawlers for ChatGPT, Claude and Perplexity, and Googlebot for Google’s AI features. |
| Bot protection | Bot and firewall rules can turn AI crawlers away even where robots.txt lets them in. | Let the AI search crawlers through. |
| Content that needs JavaScript or a click | Many AI crawlers don’t run JavaScript or click, so content that loads later can be missing. | Put it in the page your server sends. |
| Cookie banners | One that holds content back until a visitor accepts leaves crawlers only the banner. | Serve the content with the page. |
Gain includes a technical review of crawler access and rendering across your agreed website scope, plus an initial AI search audit during onboarding. For a one-off check instead, Tilio’s AI visibility audit includes a technical readiness check. The AI visibility audit costs £1,000, as a one-off fee.
Do you implement fixes or only recommend them?
Both. Tilio makes and checks the agreed technical fixes itself, within the delivery allowance in your Gain scope, and writes briefs for your developers where a change is theirs to make.
Your Gain scope sets the delivery allowance, the amount of technical work your fee covers, and who handles each fix before work starts.
In a typical Gain programme, the technical audit is part of month one, the first fixes come in month two, and from month three Tilio compares the same customer questions with your baseline.
How do you work with our web developers?
Tilio agrees with you and your developers who makes each change before anything starts, then either makes the agreed fixes itself or writes the briefs your developers work from.
Tilio’s own team does the technical work, with no subcontractors, and Tilio’s founders or a senior analyst handle your account directly.
Agree who does what
Access, responsibilities and the approval route for technical changes are agreed before anything changes on your site.
Make or brief each fix
Tilio makes the fix within your delivery allowance, or briefs your developers on the change and why it matters.
Check what changed
Tilio checks the fixes it makes once they’re live, records each change and reviews later answers against it.
If an SEO agency already looks after your technical SEO, Tilio works alongside your SEO agency, agrees who owns each part and only quotes for the work it takes on.
Which website platforms do you work with?
Tilio works on the website and CMS you already have, making agreed changes itself where your platform and access allow, and briefing your developers where a change needs them.
Technical AEO isn’t tied to one platform: robots.txt, structured data and redirects work the same way on any website, though how you change them varies by CMS.
Publishing content in your CMS can also be part of your Gain scope, as an optional addition.
How do we keep AI visibility through a migration or relaunch?
Record where you stand before a migration, redirect every old address to its matching new page, and check the new site the way an AI crawler sees it, before and after launch.
In Gain, Tilio tracks your customer questions daily, so a baseline is already in place before a migration. Judge the new site once the answer engines have re-read its pages, which shows when the new addresses start appearing as citations in the answers Tilio tracks.
Tell us about a planned migration when we agree your scope. If it needs more technical work than your allowance covers, the new scope and fee are agreed with you first.
Relaunches tend to shut AI crawlers out in familiar ways:
A robots.txt rule or noindex tag carried over from the staging site
Old addresses redirected to the home page instead of their matching new pages
New templates that drop the structured data the old pages carried
Content that now only appears once JavaScript runs
Questions about technical AEO
Short answers about Tilio’s technical work for AI search. If your question isn’t here, ask us on a call.
Who can check whether AI search tools can access our website?
Tilio, a UK answer engine optimisation (AEO) agency, checks whether AI search tools can reach and read your website as part of its technical review. The review looks at which AI crawlers your robots.txt lets in, bot protection, content that needs JavaScript or a click to appear, and structured data. The review is part of Gain, Tilio’s monthly AEO programme, and Tilio’s one-off AI visibility audit includes a technical readiness check too.
AI visibility auditDoes Tilio combine AEO with technical SEO?
Yes, where the two overlap. Tilio’s technical review covers the technical SEO work that also decides whether AI assistants can reach and read your pages, such as crawler access, rendering, structured data, site structure, internal linking, redirects and duplicate pages. The review also covers what’s specific to AI search, such as the separate crawlers each AI company runs. If an SEO agency already looks after your wider technical SEO, Tilio works alongside it, agrees who owns each part and only quotes for the work it takes on.
Working alongside your SEO agencyDo you implement structured data or only recommend it?
Both, depending on your scope. Tilio can add structured data itself and check it once it’s live, within the delivery allowance in your Gain programme, or brief your developers on the markup each page needs. Structured data should only describe what a page visibly says, so it’s written from the page’s own content.
Can you review our robots.txt and bot protection settings for AI access?
Yes. Tilio’s technical review checks which AI crawlers your robots.txt lets in, including the search crawlers for ChatGPT, Claude and Perplexity (OAI-SearchBot, Claude-SearchBot and PerplexityBot) and Googlebot, and whether bot protection turns them away even where robots.txt allows them. Training crawlers such as GPTBot and ClaudeBot are separate from the search crawlers, so you can keep them out without blocking AI search. Any change is agreed with whoever manages your site before it’s made.
Can technical AEO work happen without changing our CMS?
Usually, yes. Most technical AEO fixes, such as robots.txt rules, structured data and redirects, are settings or templates within the CMS you already have, though content that only loads with JavaScript can need more developer work. Tilio makes the agreed fixes within your Gain programme’s delivery allowance or briefs your developers, and agrees access and responsibilities with you before changing anything.
How do you prioritise fixes on a limited development budget?
Tilio prioritises the barriers that matter, so anything stopping AI assistants reaching or reading the pages behind your customers’ buying decisions comes before smaller improvements. Tilio can also make agreed fixes itself within your Gain programme’s delivery allowance, so your developers only take on the changes that need them. Your scope sets that allowance, and who handles each fix, before any work starts.
What could stop an AI assistant reading our pricing page?
Usually something that keeps the prices out of the page an AI crawler receives: prices loaded by JavaScript after the page opens, shown only after a click or a form, or held back by a cookie banner until a visitor accepts. A robots.txt rule or bot protection can turn AI crawlers away from the page altogether, and a noindex tag keeps it out of Google’s AI Overviews and AI Mode. Tilio’s technical review checks for each of these on the pages in your agreed scope.
Talk to us about technical AEO
A free 30-minute call with our AI search team, with no preparation needed. Bring what you suspect is getting in the way, and we’ll bring a clear view of where to start.