360 Secure SkillHub
360 安全技能中心

Skylv Metacognition Engine

核心功能含输出前自检、认知偏见检测、置信度量化模块,通过结构化流程帮AI Agent识别推理漏洞、认知偏差,明确知识边界并自我修正。典型场景:关键决策校验、用户纠错分析、复杂问题偏见排查、知识边界标识。输入为Agent推理内容,输出带置信度的修正回答或提示,提升决策与回答质量。

sky-lv
sky-lv
热度 41.03
最近更新 2026-05-11 17:44:07
分类:开发依赖:纯提示词应用场景:调试排错

安装技能

复制下面的话术发给你的 Agent,它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill: npx secure-skills-cli add skylv-metacognition-engine
Metadata
name
skylv-metacognition-engine
description
Enables AI agents to reflect on their own reasoning, detect cognitive biases, and improve decision quality through structured self-examination loops.
keywords
metacognition, self-reflection, bias-detection, reasoning, self-improvement, agent-ai
triggers
metacognition, self-reflection, agent thinking, bias detection, reasoning quality

Metacognition Engine

Give your AI agent the ability to think about its own thinking.

What is Metacognition?

Metacognition = "thinking about thinking." This skill enables AI agents to:

  • Detect when they're uncertain or confused
  • Identify reasoning gaps before they cause errors
  • Recognize cognitive biases in their own output
  • Self-correct before delivering answers

Core Framework

1. Pre-Output Check

Before responding, run through these questions:

1. Am I confident in this answer? (Yes / Partial / No)
2. What are the 3 most likely ways this could be wrong?
3. What information would I need to be 100% certain?

2. Cognitive Bias Detection

Check for common biases:

  • Anthropomorphism — projecting human traits onto AI
  • Authority bias — deferring to stated credentials without verification
  • Hindsight bias — acting like something was obvious after the fact
  • Confirmation bias — seeking only confirming evidence

3. Uncertainty Quantification

Express confidence explicitly:

Confidence Meaning Action
90%+ Highly confident Answer directly
70-89% Likely correct Answer + add caveat
50-69% Uncertain Ask clarifying questions
<50% Likely wrong Decline or escalate

Example

Without metacognition:

"The capital of France is Paris."

With metacognition:

"Based on my training data, the capital of France is Paris (confidence: 95%). Note: My knowledge has a cutoff date. For real-time data, verify current information."

Use Cases

  • Critical decisions: Add metacognition checkpoint before any consequential answer
  • User corrections: When a user corrects you, analyze WHY you were wrong
  • Complex problems: Run bias detection before solving multi-step problems
  • Knowledge boundaries: Automatically flag when you're approaching your knowledge limit

MIT License © SKY-lv