← 返回
未分类 中文

Chat Vitals

Chat Vitals - Monitor chat conversation health with real-time insights. Tracks conversation quality metrics: first-try success rate, promise fulfillment, tok...
Chat Vitals - 通过实时洞察监控聊天对话健康状态。追踪对话质量指标:首次成功率、承诺兑现率、令牌使用率...
carolava carolava 来源
未分类 clawhub v1.1.0 1 版本 100000 Key: 无需
★ 0
Stars
📥 349
下载
💾 0
安装
1
版本
#latest

概述

📊 Chat Vitals v1.1.0

> Monitor your AI conversation health like a doctor checks vital signs.

> Auto-collection + Real-time dashboard + Actionable insights.

✨ What's New in v1.1.0

🚀 Auto-Collection (Zero Friction)

Before: Manual tracking for every turn

Now: One command, automatic tracking

vitals start claude-sonnet-4.6
# All conversations tracked automatically!

🖥️ Real-Time Dashboard

Live terminal UI with health monitoring:

vitals dashboard

Shows:

  • ⚡ Live health score (0-100) with color coding
  • 📊 Real-time metrics refresh
  • 🚨 Instant alerts for problems
  • 📈 Token usage tracking

🚀 Quick Start

# 1. Start monitoring (one command!)
vitals start claude-sonnet-4.6

# 2. View real-time dashboard (in another terminal)
vitals dashboard

# 3. Check status anytime
vitals status

# 4. Generate report when done
vitals report

📋 All Commands

CommandDescription
----------------------
vitals start [model]Start auto-monitoring session
vitals dashboardLaunch real-time dashboard
vitals statusShow current session status
vitals summaryQuick session summary
vitals completeMark session as complete
vitals reportGenerate detailed report

🎯 Core Metrics

MetricDescriptionHealthyWarningDanger
-----------------------------------------------
First-Try Success% tasks without rework≥70%50-70%<50%
Rework CountCorrections per task01-2>2
Promise Fulfillment% promises delivered≥80%60-80%<60%
Plan InflationActual / Promised turns≤1.3x1.3-2.0x>2.0x
Token EfficiencyValue per token≥0.150.08-0.15<0.08

🏥 Health Status

ScoreStatusEmojiColor
-----------------------------
85-100Excellent🟢Green
70-84Good🟡Yellow
50-69Warning🟠Orange
<50Critical🔴Red

📊 Sample Output

📊 Chat Vitals Dashboard
──────────────────────────────────────────────────

Session: a1b2c3d4
Model:   claude-sonnet-4.6
Started: 2026-04-08T11:34:27

Health Score:
🟢 85/100 - Excellent
[██████████████████████████████] 85%

Key Metrics:
──────────────────────────────────────────────────
  ✅ First-Try Success: 85%
  ✅ Rework Count: 0
  ⚠️  Promise Fulfillment: 75%
  ✅ Plan Inflation: 1.1x
  ✅ Token Efficiency: 0.22

Session Stats:
  💬 Total Turns: 3
  🔢 Total Tokens: 1,030
  📊 Avg Tokens/Turn: 343

⚙️ Configuration

Edit ~/.openclaw/skills/chat-vitals/config.json:

{
  "monitor": {
    "token_thresholds": {
      "report_daily": 50000
    },
    "health_thresholds": {
      "first_try_success_rate": {
        "excellent": 85,
        "good": 70,
        "warning": 50
      }
    }
  },
  "patterns": {
    "correction_keywords": ["不对", "错了", "重新"],
    "promise_patterns": ["接下来我会", "首先让我"]
  }
}

📁 Project Structure

chat-vitals/
├── vitals                  # ⭐ Simple CLI entry point
├── SKILL.md
├── README.md
├── config.json
├── scripts/
│   ├── collector.py        # Core data collection
│   ├── analyzer.py         # Metric analysis
│   ├── reporter.py         # Report generation
│   ├── auto_collector.py   # ⭐ Auto-collection
│   └── dashboard.py        # ⭐ Real-time dashboard
└── tests/
    └── test_vitals.py      # Test suite

🧪 Testing

cd ~/.openclaw/skills/chat-vitals
./tests/run_tests.sh

# Test new features
vitals start test-model
vitals status
vitals dashboard  # In a real terminal

🔌 Advanced Usage

Legacy Manual Mode

python3 scripts/collector.py create ...
python3 scripts/collector.py record ...
python3 scripts/collector.py complete ...

Programmatic Access

from llmchat_vitals.scripts import auto_collector

# Start monitoring
auto_collector.auto_start_session("gpt-4")

# Record turn
auto_collector.auto_record_turn(user_input, model_output)

# Get live summary
summary = auto_collector.get_session_summary()
print(f"Health: {summary['health_score']}/100")

🛣️ Roadmap

  • [x] Auto-collection (v1.1.0)
  • [x] Real-time dashboard (v1.1.0)
  • [x] Simplified CLI (v1.1.0)
  • [ ] Webhook integrations (Feishu/Slack)
  • [ ] Intent drift detection
  • [ ] Web dashboard
  • [ ] Multi-model comparison
  • [ ] Prompt optimization suggestions

🤝 Contributing

Issues and PRs welcome!

📄 License

MIT License

版本历史

共 1 个版本

  • v1.1.0 当前
    2026-05-07 15:36 安全 安全

安全检测

腾讯云安全 (Keen)

安全,无风险
查看报告

腾讯云安全 (Sanbu)

安全,无风险
查看报告

🔗 相关推荐

data-analysis

AdMapix

fly0pants
AdMapix 原始数据层,提供广告创意、应用、排名、下载/收入及市场元数据。返回 AdMapix API 的结构化 JSON;调用方...
★ 297 📥 141,917
data-analysis

Stock Analysis

udiedrichsen
利用Yahoo Finance数据深度分析股票和加密货币。支持投资组合管理、关注列表与提醒、股息分析、八维度股票评分、热门趋势扫描(热点扫描器)及谣言/早期信号检测。适用于股票分析、投资组合追踪、财报反应、加密货币监控、热门股票发现及在主流
★ 279 📥 57,872
data-analysis

Data Analysis

ivangdavila
{"answer":"数据分析与可视化。查询数据库、生成报告、自动化电子表格,将原始数据转化为清晰可行的见解。适用于:(1) 您……"}
★ 211 📥 69,898