Documentation

Tenant OwnerReviewerOperator

Product knowledge base, playbooks, and embedded guidance for every persona.

Agent Performance Insights

CoffeeBreak continuously evaluates how well each agent performs in your workspace.
This helps the system choose the right agent for each task and improves quality over time.

This page explains what you can see as a user and how CoffeeBreak uses performance insights to enhance results.


🌟 Why CoffeeBreak Tracks Agent Performance

Every agent has strengths.
Some excel at writing new code, others at refactoring, others at analysis or documentation.

By analyzing how agents perform in your workspace, CoffeeBreak can:

  • Choose the best agent for each task
  • Reduce review cycles
  • Increase first-pass success rates
  • Avoid agents that underperform on specific types of tasks
  • Adapt to your team’s preferences automatically

All of this happens behind the scenes.


πŸ“Š What You May See in the UI

Depending on your workspace configuration, you may see:

βœ“ Agent usage patterns

Which agents your workspace uses most frequently.

βœ“ High-level success indicators

Whether agents usually produce acceptable results on the first try.

βœ“ Review-driven learning

When your approvals or requests for changes help shape future decisions.

βœ“ Task-type preferences

Which agents work best for enhancements, bug fixes, documentation, refactors, upgrades, etc.

βœ“ Marketplace agent performance

If you install marketplace agents, CoffeeBreak shows how well they perform in your environment.

These insights are always high-level β€” they never expose internal algorithms.


🎯 How CoffeeBreak Uses These Insights

CoffeeBreak uses performance signals to:

βœ“ Improve agent selection

Tasks are routed to the agents most likely to succeed.

βœ“ Reduce unnecessary retries

Better routing = fewer refinement loops.

βœ“ Accelerate PR approval

Agents that consistently produce acceptable output get selected more often.

βœ“ Personalize behavior per workspace

Every workspace gets its own learning profile.


πŸ§‘β€πŸ’» What You Control

You influence agent performance insights through:

  • Your PR reviews
  • Approvals or requested changes
  • Confidence thresholds
  • Workspace rules
  • Installed marketplace agents
  • Clear task definitions

CoffeeBreak uses your feedback to adapt β€” no manual tuning is required.


πŸ”’ Privacy & Security

Agent performance data is:

  • Workspace-scoped
  • Never shared across tenants
  • Not used to influence other customers
  • Isolated per organization

🧩 For Marketplace Developers

If you’re building custom agents:

  • CoffeeBreak will automatically begin evaluating them
  • High-performing agents will be selected more often
  • Poorly performing agents will be used less

See:

  • external/CreateACustomAgent.md
  • external/AgentMetadataSpec.md