Govern, measure and evolve|INEMA.CLUB-PRO

Lesson 6 · 20 min

Promote and roll back

Hora v2.2 won the test and was promoted. A week later, logistics changed the delivery day for one route and the agent's table went stale. The conversations handled by Juliana stayed low, but missed delivery-time promises went over the limit. Promoting and rolling back are planned steps: in this lesson you write both before you need them.

Start the lesson
In a glass room, the manager points at a screen where a red line climbs next to a green one, while the company owner listens closely.

In this lesson you will

  1. 1What comes with a promotion: phases, watch, and a trigger to go back
  2. 2Calculate the trigger so you don't roll back by chance
  3. 3Roll back fast, warning first and keeping the version
  4. 4The version history and the cycle's own authority limit

Goal: treat promotion and rollback as planned steps: promote with a written way back, and roll back by the trigger, with no hunt for someone to blame.

01From promotion to the next candidate

Promoting is not the end of the cycle. Click each step.

Click each block in the diagram to see what it does.

AI Management Area, rule 3: promoting and rolling back are steps, not accidents. Horizonte numbers: fictional, for study, in relative weeks.

02Four rules for promoting and going back

G2 put the process under version control and G3 promoted autonomy actions. Here the version is that of the agent package (prompt, context, model, tools) that came out of a LOOP-R cycle.

1. The promotion carries the rollback plan

Carlos approved v2.2 in week 7 with the rollback plan already written: a watch window of two weeks; a trigger of missed delivery-date promises above 3.4% in a week, or one critical error; who decides, Patrícia; how to go back, Rafael points Hora to v2.1 within 2 hours.

Deciding the rollback after the problem hits is deciding in a panic, and it almost always turns into an argument about blame.

RulePromoting needs approval from someone who did not propose it. Rolling back by the written trigger is the duty of whoever operates it, and it does not wait for a meeting.

03Templates to copy

The promotion log, the rollback log, and the version history. The tab next to this one shows Horizonte's.

Promotion log
PROMOTION · agent <name> · from v<current> to v<candidate> · LOOP-R cycle no. <...>
Proposed by: <name> · Approved by (not the proposer): <name> on <date>
Decision card attached: [ ] yes

PHASES: <a slice first, then everyone, or everyone at once, and why>
WATCH WINDOW: <n weeks> · guardrails checked <how often>, by <name>

ROLLBACK TRIGGER (written now)
  <guardrail> above <limit> in <period>
  limit calculation: <pilot rate> + 2 × sqrt(p × (1 - p) ÷ <N for the period>) = <...>
  or: 1 critical error
WHO DECIDES THE ROLLBACK: <name> · without waiting for approval
HOW TO GO BACK: <steps, who does each one, in how long>
WHO IS TOLD BEFOREHAND: <names> · PREVIOUS VERSION KEPT AT: <where>
Rollback log
ROLLBACK · agent <name> · from v<promoted> to v<previous> · <date and time>
Trigger that fired: <indicator> = <value> (<n> of <N>) · written limit: <...>
Target of the change in the same week: <value> (for the log, not for deciding)
Decided by: <name> · notified beforehand: <names> · executed by: <name> in <time>
Rolled-back version kept at: <where>

LIKELY CAUSE: <what changed in the world or in the agent>
PROPOSED FIX: <...> · new candidate: v<...> · back to the 30 cases and the pilot: <dates>
LESSON FOR THE HISTORY: <one sentence>
Agent version history
HISTORY · agent <name> · owner: <name> · cycle authority limit: [ ] L0 proposes [ ] L1 a person approves each change [ ] L2 promotes on its own

| Version | What changed | Why (evidence) | Approved by | Status | Date |
|---|---|---|---|---|---|
| <v> | <...> | <...> | <name> | in use / kept / rolled back / proposed | <...> |

Rule: no row is ever deleted. A rolled-back version stays with the reason.
L2 only after 5 promotions at L1 with no rollback.
Prompt · review the rollback plan
You are a change reviewer. Below is the promotion record for a new
version of an AI agent. Do not decide whether the promotion is good. Point out:

1. Whether the rollback trigger has a number, a period and the math behind the limit.
2. Whether the limit is so tight that normal variation sets it off, or so
   wide that it never fires.
3. Whether who decides the rollback, the steps and the time are written down.
4. Who would be affected by the rollback and is not on the notified list.

Record:
"""<paste>"""
Simulation: illustrative example

Hora v2.1 → v2.2 → v2.1 · Horizonte, fictional study company · relative weeks

  • Week 7, promotion: proposed by Patrícia, approved by Carlos with the decision card from cycle 0001. All conversations on v2.2. Watch window of 2 weeks.
  • Trigger: missed delivery-date promises above 3.4% in a week (1.5% from the pilot + 1.9 points), or 1 critical error. Decides: Patrícia. Rollback: Rafael points it back to v2.1 within 2 h. Notified beforehand: Juliana.
  • Week 8, rollback: 7 of 158 promises missed (4.4%). Taken over by Juliana: 30 of 158 (19.0%). Rolled back in 2 h, v2.2 kept, Carlos informed.
  • Likely cause: the Sorocaba route changed days and the table had no expiry date or change alert.
  • Next candidate: v2.3, route table with Valdir as owner, weekly expiry and a change alert.

04Simulation: Carlos doesn't want to roll back

A simulated conversation for practice. The trigger fired and the owner liked the new version. Answer with what is written in the promotion record.

Carlos · owner of Horizonte (simulation)Horizonte Distribuidora, fictional study company

Choose your answer. The comment appears right after, and the conversation continues based on your choice.

    05Practice

    Horizonte's logs are for practice; the promotion and the rehearsed rollback of your agent are for real.

    1 · Hora's promotion, rollback, and history

    30 min

    Using the numbers from this lesson, fill in the promotion log for v2.2 (week 7) and the rollback log for week 8. Redo the trigger calculation. Build Hora's history with versions 2.0 to 2.3 and mark the cycle's authority limit.

    Done when: the promotion has an approver different from whoever proposed it, a watch window, a trigger with a number and the calculation (1.5% + 1.9 = 3.4%), who decides the rollback, the steps with times, and the people notified; the rollback has the number that fired it (7 of 158), the probable cause, and the next candidate; and the history has 4 lines, none erased.

    2 · Your agent's rehearsed rollback

    45 min

    For the change in your lesson 5 cycle (or for your agent's next change), write the promotion log with the calculated trigger. Then rehearse the rollback in a test environment or outside business hours: point to the previous version, time it, and check that nothing was lost.

    Done when: the promotion log is saved with the trigger as a number and the calculation; the rollback was rehearsed once with the time measured; your agent's version history exists; and whoever decides the rollback confirmed in writing that they know this.

    3 · The conversation with Carlos

    10 min

    Run the simulation above until you reach the top score. If you get one wrong, read the comment and start over.

    Done when: the simulation ended on "Roll back without drama, improve with method" with 8 of 8 points.

    06Quick test

    4 questions. The explanation appears after your attempt.

    Question 1 of 4

    After the promotion, v2.2's goal was still great, but a guardrail went past the written limit. Which one counts?

    07Summary

    Promotion with a way backWatch window, trigger as a number, who decides, and how to roll back, written beforehand.
    Trigger with a numberThe pilot rate plus two standard errors for the week: it neither rolls back by chance nor never rolls back.
    Roll back with no one to blameKnown version, warning first, nothing erased; then the cause and a safeguard.
    History and authority limitEvery version is logged; the cycle moves from L1 to L2 only with evidence.

    To go further

    Previous lessonNext lesson