Agent Self-Evaluation â?5 è½´èªè¯ä¼°
ä»»å¡å®æåï¼å¯¹è¾åºè¿è¡ç»æåèªè¯ãè¿ä¸æ¯éè¿/å¤±è´¥é¨æ§ï¼èæ¯å»æåææ¥éª¤ï¼å¨ç¨æ·ä¹åæè·éæ¼ãæ è®°è¿åº¦èªä¿¡ã?surfaced æ¹è¿åºåã?
è§¦åæ¡ä»¶
- ç¼åè·?3+ æä»¶æ?50+ è¡ä»£ç ?- 宿夿¥éª¤å·¥ä½æµï¼å®ç?â?æµè¯ â?审æ¥ï¼?- è°è¯ä¼è¯æ¶å 3+ 次å°è¯?- 产åºè®¾è®¡ææ¡£ãæ¶æå³çæä¹¦é¢åæ
- ç¨æ·é?飿å¤å¥½ï¼?æ?è¯ä»·ä¸ä¸ä½ èªå·±"
5 个è¯ä¼°è½´
| è½? | é®é¢ | æè·ä»ä¹? |
|---|---|---|
| *åç¡®æ? | äºå®ã声æåè¾åºæ£ç¡®åï¼ | å¹»è§ãéè¯?API åç§°ã䏿£ç¡®è¯æ³ãé误éè¿? |
| *宿´æ? | è¦çäºç¨æ·è¦æ±çææå 容åï¼? | éæ¼çè¾¹çæ åµãæªå¤ççé误路å¾ãéå¿çéæ±ãè·³è¿çåä»»å? |
| *æ¸ æ°åº? | è§£éå¯çè§£ä¸ç»æè¯å¥½åï¼ | æ··æ·çè§£éãæ å®ä¹çæ¯è¯ã缺å°ä¸ä¸æãåé? |
| *坿使? | ç¨æ·å¯ä»¥ç«å³åºäºè¾åºè¡å¨åï¼ | 模ç³å»ºè®®ãç¼ºå°æ¥éª¤ã?ä½ åºè¯?X"ä½ä¸å±ç¤ºå¦ä½åãæ éªè¯è·¯å¾ |
| *ç®æ´æ? | 使ç¨äºæå°å¿ è¦çè¯?token åï¼ | åä½ãè¿åº¦è§£éãéåéå¤ç¨æ·é®é¢ãå¡«å å å®? |
è¯åæ å
5 â?åè¶ï¼æ åçæ¹è¿å¯è½
4 â?è¯å¥½ï¼åªæå°ççµï¼æ å®è´¨æ§å·®è·?3 â?è¶³å¤ï¼æ»¡è¶³è¯·æ±ä½è³å°ä¸ä¸ªè½´æææ¾å¼±ç?2 â?å¼±ï¼ææç¡®å·®è·å½±åå¯ç¨æ§æ£ç¡®æ?1 â?å·®ï¼æ ¹æ¬æªæ»¡è¶³è¯·æ±æå
å«é大é误
è¯æ®è§å
*æ¯ä¸ªä½äº 5 åçå¿ é¡»å¼ç¨å ·ä½è¯æ®ã?
3 åä¸è½åªè¯?å¯ä»¥æ´å¥½"ââå¿ é¡»è¯´å?缺å°ä»ä¹?æ?éå¨åªé**ã? å£å·ï¼?"å±ç¤ºå·®è·ï¼ä¸åªæ¯å½åå®ã?
工使µ?
Step 1: æ¶éåå§ææ
æ¶éè¦è¯ä¼°çå 容ï¼?
- åå§ç¨æ·è¯·æ±ï¼ä»å¯¹è¯ä¸å读ï¼
- æç»ååº?è¾åºï¼å¯äº¤ä»ç©ï¼
- éªè¯æ£ç¡®æ§çä»»ä½å·¥å
·è¾åºï¼æµè¯ç»æãéåºç ãlint è¾åºï¼?- 任塿鴿¶å°çä»»ä½ç¨æ·åé¦ï¼çº æ£ã?åè¯ä¸æ¬?ã?é£ä¸å¯?ï¼?```
### Step 2: ç¬ç«è¯åæ¯ä¸ªè½?
é个å¤ç 5 个轴ã对æ¯ä¸ªï¼?
1. é
读轴é®é¢?2. å¨è¾åºä¸æ¥æ¾è¯æ®ï¼æç¼ºä¹è¯æ®ï¼?3. åé
åæ° 1-5
4. 妿忰 < 5ï¼åä¸å¥æ¹è¿è¯´æå¼ç¨å·®è·?
**ä¸è¦**å
å¨å¿ä¸å¹³ååæ°ç¶åååå·¥ä½ãæ¯ä¸ªè½´æ°é²è¯åã?
### Step 3: 产åºè¯ä¼°æ¥å
æ¥åå¿
é¡»å
æ¬ï¼?
- ä¸è¡æè¦?- 5 è½´è¯åå¡ï¼æ¯è½´çåæ° + è¯æ®ï¼?- æ»åï¼ç®åå¹³åï¼åèäºå ¥å?1 ä½å°æ°ï¼
- æå½±åæåºç 1-3 ä¸ªå ·ä½æ¹è¿?- èªæ£ï¼?ç¨æ·ä¼åæè¿ä¸ªè¯ä¼°åï¼?
### Step 4: åºç¨æ¹è¿
妿任ä½è½´è¯å?3 æä»¥ä¸ï¼
1. 说æä½ 伿ä¹åä¸å?2. 妿差è·å¯å¨ < 30 ç§å
ä¿®å¤ï¼ç¼ºå°é¾æ¥ã䏿¸
æ°æªè¾ï¼ï¼ç«å³ä¿®å¤
3. 妿差è·éè¦è¿å·¥ï¼æç¡®æ è®°ï¼?è¿ä¸ªè½´è¯å?[åå ] å 为 [è¯æ®]ãç¨ [å
·ä½ä¿®å¤] éæ°è¿è¡å¯è½ä¼æé«å° [åæ°]ã?
## æ¥å模æ¿
```markdown
## Self-Evaluation Report
**Task**: {task description}
**Overall Score**: {average}/5
### Scorecard
| Axis | Score | Evidence |
|------|-------|----------|
| Accuracy | {1-5} | {specific evidence or "No gaps found"} |
| Completeness | {1-5} | {specific evidence or "No gaps found"} |
| Clarity | {1-5} | {specific evidence or "No gaps found"} |
| Actionability | {1-5} | {specific evidence or "No gaps found"} |
| Conciseness | {1-5} | {specific evidence or "No gaps found"} |
### Top Improvements
1. {highest impact improvement}
2. {second highest}
3. {third highest}
### Self-Check
Would the user agree with this assessment? {Yes/No, why}
示ä¾
ç¤ºä¾ 1: è¯å¥½è¯ä¼°ï¼?+ åï¼
## Self-Evaluation Report
**Task**: Add retry logic to HTTP client
**Overall Score**: 4.6/5
### Scorecard
| Axis | Score | Evidence |
|------|-------|----------|
| Accuracy | 5 | All API calls correct. Verified: retries use exponential backoff. No hallucinated methods. |
| Completeness | 4 | Covered happy path + 3 error cases. Missing: timeout handling for hung connections. |
| Clarity | 5 | Code comments explain backoff formula. PR description links to incident. |
| Actionability | 5 | Single merge. No follow-up tasks. Tests pass. |
| Conciseness | 4 | 47 lines total. The retry loop could be extracted into a helper to drop ~8 lines. |
### Top Improvements
1. Add timeout handling for hung connections (Completeness)
2. Extract retry loop into helper function (Conciseness)
### Self-Check
Would the user agree? Yes â?one clear gap (timeout) identified, fix is straightforward.
ç¤ºä¾ 2: å¼±è¯ä¼°ï¼2-3 åï¼
## Self-Evaluation Report
**Task**: Add retry logic to HTTP client
**Overall Score**: 2.8/5
### Scorecard
| Axis | Score | Evidence |
|------|-------|----------|
| Accuracy | 2 | Used urllib3 which doesn't match our httpx-based codebase. Wrong library. |
| Completeness | 3 | Works for GET. POST/PUT not handled (user said "all HTTP requests"). |
| Clarity | 4 | Code is readable. Good variable names. |
| Actionability | 2 | "Add tests" mentioned but no test file created. User has to write tests before merging. |
| Conciseness | 3 | 120 lines. Retry config duplicated in 3 places instead of one shared RetryConfig object. |
### Top Improvements
1. Switch to httpx transport (Accuracy â?wrong library)
2. Extend to all HTTP methods (Completeness â?POST/PUT missing)
3. Consolidate retry config into single object (Conciseness â?3x duplication)
### Self-Check
Would the user agree? Yes â?wrong library is critical, must fix before merging.
忍¡å¼?
"Everything is a 5"
FAIL: Accuracy: 5 â?All good.
Completeness: 5 â?Everything covered.
Clarity: 5 â?Clear.
æ è¯æ®å¼ç¨ãè¿æ¯èªæç¥è´ºï¼ä¸æ¯è¯ä¼°ãçæ£ç 5 éè¦è¯ææ²¡ææ¹è¿ç©ºé´ã?
Over-penalizing for scope creep
FAIL: Completeness: 2 â?Didn't handle WebSocket connections or gRPC streaming (user didn't ask for these)
åªéå¯¹ç¨æ·å®é 请æ±çå 容è¯ä¼°ï¼ä¸æ¯ä½ å¯è½é¢å¤æå»ºçå 容ã?
Using the evaluation to re-litigate
FAIL: "As I said earlier, this approach is wrong. Score: 1"
è¯ä¼°æ¯å ³äºäº¤ä»çè¾åºï¼ä¸æ¯å ³äºéæ°äºè®ºå·²ç»ååºç设计å³çãå¦ææ¹æ³é误ï¼åºè¯¥å¨äº¤ä»åæè·ã?
Mixing personal preference with objective gaps
FAIL: "Score: 3. I don't like Python decorators."
"ä¸åæ¬?䏿¯è¯æ®ãå¼ç¨å ·ä½çå¯è¯»æ§ã坿µè¯æ§ææ£ç¡®æ§é®é¢ï¼æä¿æåæ?4+ã?
æä½³å®è·?
- *è¯ä¼°è¾åºï¼ä¸æ¯è¿ç¨ã? ç¨æ·å ³å¿ä½ 交ä»äºä»ä¹ï¼ä¸æ¯ä½ è±äºå¤å°æ¬¡è¿ä»£ã?- *æ¯ä¸ªå¼±è½´ä¸ä¸ªæ¹è¿ã? ä¸è¦ä¸ºä¸ä¸ªè½´ååº 5 ä»¶äºââéæ©æé«å½±åå·®è·ã?- *å°æ¹è¿ä¸ç¨æ·å½±åç»å®ã? "缺å°é误å¤çæå³çç¨æ·ç?API è°ç¨ä¼éé»å´©æº? æ¯?"æ·»å é误å¤ç" æ´å¥½ã?- *å ·ä½è¯´æ"ä¿®å¤"çæ ·åã? "ç¨ä¸ºéè¯é ç½®ç?httpx ä¼ è¾éæ°è¿è¡" æ¯?"ä¿®å¤åºé®é¢? æ´å¥½ã?- *使ç¨å·¥å ·è¾åºä½ä¸ºè¯æ®ã? 妿æµè¯éè¿ï¼å¼ç¨å®ä»¬ã妿?lint å¹²åï¼å¼ç¨å®ãä¸è¦çæµââgrep è¯æã?- *妿æ¾ä¸å°ä»»ä½å·®è·ï¼æ´åªåå°è¯ã? 5 个轴çå®ç¾åæ°å¾ç½è§ãé®ï¼?å¦æææ¯ç¨æ·ï¼è¿ä¸ªè¾åºçä»ä¹ä¼è®©æç¦æ¼ï¼?
ä¸ç°æè§åçå ³ç³»
| ç°æè§å | æ¬æè½å¢å¼? |
|---|---|
| SOUL.md è§å 8: è¾åºåé夿£æ? | 5 è½´ç³»ç»åè¯ä¼° |
| SOUL.md è§å 9: ç¶æç®¡ç? | è¯æ®è§åï¼ä½äº?5 åå¿ é¡»è¯æ®ï¼ |
| SOUL.md è§å 10: è¾åºé¿åº¦æ§å¶ | ç®æ´æ§è½´ |
| coding-framework Step 7: æ¶å°¾æ£æ? | ç»æåè¯åå¡ |
ç®å使ç?
ä¸éè¦æ¯æ¬¡é½å®æ´æ¥åã对äºå¿«éæ£æ¥ï¼
## Quick Self-Check
- Accuracy: {1-5} â?{one-line evidence}
- Completeness: {1-5} â?{one-line evidence}
- Clarity: {1-5} â?{one-line evidence}
- Actionability: {1-5} â?{one-line evidence}
- Conciseness: {1-5} â?{one-line evidence}
**Overall**: {average}/5
**Top fix**: {highest impact improvement}
*5 è½´èªè¯ä¼°ï¼å¨ç¨æ·ä¹åæè·éæ¼ï¼ç¨è¯æ®è¯´è¯ã?
