Something stopped working. We just didn’t know since when.
A routine storage operation in an internal workflow failed. A piece of information could not be stored persistently in OpenAI ChatGPT Memory. It looked like a single failed write. So we started investigating.
But then it got more interesting: The storage capability available to our workflow had changed.
We just couldn’t tell when.
We knew when the failure became visible to us.
But not when the underlying capability had actually changed.
Looking back, that left a gap.
Maybe both happened at the same time.
Maybe they didn’t.
We couldn’t reliably reconstruct it.
Rolling back to Legacy Saved Memories didn’t make things any clearer. Existing memories were still readable. New persistent writes were now rejected with “Memory Context full.”
But that didn’t explain the original failure either. Technical cause unknown. No link to the migration or rollback could be established.
That’s when it became a governance problem.
What started as:
“Memory isn’t working.”
became:
A capability relevant to an operational workflow can change without that change being recognizable as such to the workflow that depends on it.
That is the gap between Capability Change and Change Detectability.
An organization can define very precisely which changes should trigger revalidation. But that logic only works if the organization can actually detect that a relevant change has occurred.
Two states can diverge:
the actual state of an external capability
and
the state the workflow continues to assume.
Capability Continuity is not the same as Property Continuity.
And Change Time is not necessarily Detection Time.
The uncomfortably simple question:
What exactly had we been relying on?
That an external capability was available.
And that a change to that capability relevant to our workflow would be detectable to us.
Since then, the order of our questions has changed.
First:
How would we detect a change relevant to our workflow in the first place?
And only then:
Does it require revalidation?
And how would your organization detect such a change?