← 返回
AI智能 Key 中文

StripFeed

Fetch any URL as clean, AI-ready Markdown with token counts and caching. Strip ads, nav, scripts, and noise from web pages.
抓取任意URL并转换为纯净、适配AI的Markdown,支持Token计数与缓存。去除网页中的广告、导航、脚本及噪音。
atlasopenclaw
AI智能 clawhub v1.0.0 1 版本 99861.9 Key: 需要
★ 0
Stars
📥 723
下载
💾 25
安装
1
版本
#latest

概述

StripFeed

Convert any URL to clean Markdown optimized for LLM consumption. Strips ads, navigation, scripts, and noise. Returns token counts so you know exactly how much context you're using.

When to use this skill

Use StripFeed whenever you need to read a web page, article, documentation, or any URL content. It produces much cleaner output than raw HTML fetching and tells you the token cost.

Authentication

All requests require the STRIPFEED_API_KEY environment variable. Pass it as a Bearer token:

Authorization: Bearer $STRIPFEED_API_KEY

Get a free API key at https://www.stripfeed.dev (200 requests/month, no credit card).

Fetch a single URL

curl -s "https://www.stripfeed.dev/api/v1/fetch?url=URL_HERE" \
  -H "Authorization: Bearer $STRIPFEED_API_KEY"

This returns clean Markdown directly as the response body (Content-Type: text/markdown).

Parameters

ParameterRequiredDescription
-------------------------------------------------------------------------------------------------------------
urlYesThe URL to fetch (must be http or https)
formatNoOutput format: markdown (default), json, text, html. Pro only except markdown.
selectorNoCSS selector to extract specific content (e.g. article, .content, #main). Pro only.
cacheNoSet to false to bypass cache and force a fresh fetch
ttlNoCache TTL in seconds (default: 3600, max: 86400 for Pro)
max_tokensNoTruncate output to fit within this token budget
modelNoAI model ID for cost tracking (e.g. claude-sonnet-4-6, gpt-4o)

JSON format (recommended for structured responses)

When you need metadata alongside the content, use format=json:

curl -s "https://www.stripfeed.dev/api/v1/fetch?url=URL_HERE&format=json" \
  -H "Authorization: Bearer $STRIPFEED_API_KEY"

JSON response includes:

{
  "markdown": "# Page Title\n\nClean content...",
  "url": "https://example.com",
  "title": "Page Title",
  "tokens": 1250,
  "originalTokens": 15000,
  "savingsPercent": 91.7,
  "cached": false,
  "fetchMs": 430,
  "format": "json",
  "truncated": false,
  "selector": null,
  "model": null
}

Response headers

Every response includes these headers:

  • X-StripFeed-Tokens - Token count of the stripped content
  • X-StripFeed-Original-Tokens - Token count of the raw HTML (before stripping)
  • X-StripFeed-Savings-Percent - Percentage of tokens saved
  • X-StripFeed-Cache - HIT or MISS
  • X-StripFeed-Fetch-Ms - Time to fetch the URL (0 if cached)
  • X-StripFeed-Format - Output format used

Batch fetch (Pro plan)

Fetch up to 10 URLs in a single request:

curl -s -X POST "https://www.stripfeed.dev/api/v1/batch" \
  -H "Authorization: Bearer $STRIPFEED_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"urls": ["https://example.com", "https://example.org"]}'

URLs can also include selectors:

{
  "urls": [
    { "url": "https://example.com", "selector": "article" },
    { "url": "https://example.org" }
  ],
  "model": "claude-sonnet-4-6"
}

Batch response:

{
  "results": [
    { "url": "...", "markdown": "...", "tokens": 1250, "status": 200 },
    { "url": "...", "error": "Failed to fetch", "status": 502 }
  ],
  "total": 2,
  "success": 1,
  "failed": 1
}

Individual URL errors don't break the batch. Check each result's status field.

Error handling

StatusMeaning
----------------------------------------------
401Missing or invalid API key
403Feature requires Pro plan
422Invalid URL, format, or parameter
429Rate limit or monthly quota exceeded
502Target URL unreachable or returned error
504Target URL timed out (9s limit)

Tips

  • Default format is markdown which returns raw text. Use format=json when you need token counts and metadata in the response body.
  • Responses are cached for 1 hour by default. Use cache=false for real-time content.
  • The max_tokens parameter is useful to fit content within your context window budget.
  • Use selector to grab only the main content (e.g. selector=article or selector=.post-content) and skip sidebars/footers.
  • Free plan: 200 requests/month, markdown format only. Pro plan ($19/mo): 100K requests, all formats, selectors, batch endpoint.

版本历史

共 1 个版本

  • v1.0.0 当前
    2026-03-30 06:56 安全 安全

安全检测

腾讯云安全 (Keen)

安全,无风险
查看报告

腾讯云安全 (Sanbu)

安全,无风险
查看报告

🔗 相关推荐

ai-intelligence

Self-Improving + Proactive Agent

ivangdavila
自我反思+自我批评+自我学习+自组织记忆。智能体评估自身工作、发现错误并持续改进。
★ 1,358 📥 318,467
ai-intelligence

ontology

oswalpalash
类型化知识图谱,用于结构化智能体记忆与可组合技能。支持创建/查询实体(人员、项目、任务、事件、文档)及关联...
★ 712 📥 243,883
ai-intelligence

Nano Banana Pro

steipete
使用 Nano Banana Pro (Gemini 3 Pro Image) 生成或编辑图像。支持文生图、图生图及 1K/2K/4K 分辨率,适用于图像创建、修改及编辑请求,使用 --input-image 指定输入图像。
★ 418 📥 115,240