WEEK 6 · LESSON 7 · TOPIC 12 OF 13 · Trade-Offs and Limitations

Trade-Offs and Limitations

Lesson progress

0% Complete

SECTION 1 OF 1

In this topic · 1 sections
  1. Overview

Overview

The agent optimizes what the assessment rewards. If the test measures only speed, the loop may damage qualities that are not represented, such as appearance or usability. Constraints and secondary checks are therefore part of the experiment, not optional decoration.

The loop is only as productive as its cycle speed and the usefulness of its assessment. If the change method and evaluation each take a long time, the system can run far fewer experiments.

Applications such as outreach, support, advertising, or conversion changes also need enough observations for the measured result to be useful.

Autonomy also increases the importance of reversibility and logging. Without a reliable way to restore the last good state, a long experiment can leave the system worse than it began. Without a research log, the agent may cycle through the same failed ideas.