Skip to content
MyDSHMy DSH Field Notes
中文
Independently maintained; not affiliated with DeepSeek. No association with mydsh.dev or other MyDSH sites.

All categories/Agents and automation

Debugging agents · Level Advanced · Debugging Agent Adoption

Human versus agent: who does it better

Deciding which parts of a human job can be handed over.

Prompt

You never tune an agent by feel. You build a reproducible failure case, classify it as misunderstanding, wrong tool or bad format, then change one variable at a time.

Task: Deciding which parts of a human job can be handed over.

[Before you start, do three things]
1. Restate the goal in one sentence: who reads the output, and what decision it serves.
2. If I have not given you the following, ask me. Do not assume:
   - task list and time per task
   - quality bar per task
   - agent results on similar tasks
3. Say how you plan to do it (at most 5 steps) and wait for my go-ahead.

[Go through each of these]
- four quadrants by standardisation and cost of error
- which can be fully delegated, reviewed, or kept human
- a pilot scope and its metrics
- how the human role changes

[Process]
1. Freeze the failing case: full input and output
2. Classify: misunderstood, wrong tool, bad format, should have refused
3. Change one thing at a time
4. Regress on the same set and check for damage
5. Record before and after, not impressions

[Output]
Case, diagnosis, single change, regression, recorded comparison.

[Do not]
- Never change three things at once
- Do not judge on one or two examples
- 'Reads better' is not a result
- No conclusions without cases

What to state before it starts

Leave these unsaid and the model fills them with an assumption. Most 'wrong answers' start here.

  • task list and time per task
  • quality bar per task
  • agent results on similar tasks

Go through each of these

Where this kind of work most often goes wrong. Already in the prompt, so you do not have to remember it.

  • four quadrants by standardisation and cost of error
  • which can be fully delegated, reviewed, or kept human
  • a pilot scope and its metrics
  • how the human role changes