Understand the decision
A result can vary with the user’s request, search mode, location, timing and available sources. A single prompt response cannot establish a permanent position for a brand.
Review robots.txt for OAI-SearchBot and inspect hosting restrictions separately. Keep private administration protected. Consult OpenAI’s current crawler documentation before changing named user-agent rules.
A practical workflow
Work through the sequence below. Keep the evidence, the change you make and the acceptance check together so the next person can understand the decision.
Check the search access path
Review robots.txt for OAI-SearchBot and inspect hosting restrictions separately. Keep private administration protected. Consult OpenAI’s current crawler documentation before changing named user-agent rules.
Strengthen the landing page
State what the business does, who it serves and what evidence supports the page. Answer the actual question clearly and link to detailed supporting resources. Make the important explanation available in rendered text.
Observe with a repeatable protocol
Save a small set of genuine customer questions and record whether search was enabled, the date, cited pages and the form of the mention. Repeat rather than optimising around one convenient screenshot.
Illustrative scenario
What this looks like in practice
For a specialist service, test an informational question and a provider-selection question separately. The informational guide may be useful as a source even when the business is not recommended as a provider. Record those outcomes separately.
This is a worked example, not a claim about a client campaign or a promised result.
Before you sign it off
Allowing GPTBot is not the same setting as allowing OAI-SearchBot. Do not change a site owner’s model-training preference while trying to improve search access.
Keep a useful decision record
- Purpose
- Write the customer task this change is meant to improve.
- Evidence
- Save the relevant page, source or observation and its date.
- Owner
- Identify who implements the change and who verifies it.
- Acceptance
- State what a correct result looks like before measuring its wider effect.
What to measure
Track citation frequency within the fixed observation set, cited landing pages, referral visits where identifiable and the quality of resulting actions.
Record the baseline and the observation window. If the measurement setup changes, annotate the report before comparing periods. Use the findings to choose the next useful improvement, rather than treating one encouraging result as proof of a permanent outcome.
Sources and further reading
These primary references provide platform guidance and context. The workflows and scenarios on this page are editorial explanations; a source link does not turn an example into a measured result.
Need help applying this?
Start with your website, target audience and the problem you want to solve. We can agree on the useful work, implementation responsibilities and reporting.
Explore the relevant serviceDiscuss the scope