← 返回
数据分析 中文

Ghostfetch

CLI web search and page fetcher for LLM agents. Search DuckDuckGo/Brave/Bing/Google, fetch pages as markdown, and extract links — single binary, no browser r...
用于 LLM 代理的命令行网页搜索与页面抓取工具,支持 DuckDuckGo/Brave/Bing/Google,提取页面为 Markdown 并抽取链接,单一二进制,无需浏览器。
neothelobster
数据分析 clawhub v1.1.0 1 版本 100000 Key: 无需
★ 1
Stars
📥 650
下载
💾 8
安装
1
版本
#fetch#latest#scraping#search#web

概述

Ghostfetch

Web search and page fetcher for AI agents. Single binary, no browser needed. Fetches pages with browser-like TLS fingerprints for reliable access.

Use for: web searches, fetching page content as markdown, extracting links, and gathering information from the web.

Commands

Search the web

ghostfetch "your search query"                    # Search DuckDuckGo (default)
ghostfetch "query" -e brave                       # Search with Brave
ghostfetch "query" -e google                      # Search with Google
ghostfetch "query" -e bing                        # Search with Bing
ghostfetch "query" -n 5                           # Limit to 5 results
ghostfetch "query" --json                         # JSON output with metadata

Search engines: duckduckgo (default), brave, bing, google

Fetch pages

ghostfetch fetch https://example.com              # Fetch page (raw HTML)
ghostfetch fetch https://example.com -m           # Fetch as markdown (reader mode — preferred)
ghostfetch fetch https://example.com --markdown-full  # Full page as markdown (not just main content)
ghostfetch fetch https://example.com --json       # JSON with body, status, headers, cookies
ghostfetch fetch https://example.com --raw        # Raw HTML without processing
ghostfetch fetch url1 url2 url3 -p 3              # Fetch multiple URLs in parallel

Always use -m (markdown mode) when reading page content — it extracts the main content and converts to clean markdown, saving tokens vs raw HTML.

Extract links

ghostfetch links https://example.com              # Extract all links from page
ghostfetch links https://example.com -f "github"  # Filter links by regex pattern
ghostfetch links https://example.com --json       # JSON output

Flags Reference

FlagShortDefaultWhat it does
-----------------------------------
--engine-educkduckgoSearch engine to use
--results-n10Number of search results
--markdown-mfalseConvert to markdown (reader mode)
--markdown-fullfalseFull page markdown (not just main content)
--json-jfalseJSON output with metadata
--rawfalseRaw HTML output
--max-parallel-p5Max parallel fetches
--filter-fFilter links by regex
--timeout-t30sRequest timeout
--browser-bchromeBrowser fingerprint: chrome, firefox
--no-cookiesfalseDisable cookie persistence
--follow-LtrueFollow redirects
--verbose-vfalsePrint request/response details
--captcha-serviceCaptcha service: 2captcha, anticaptcha
--captcha-keyCaptcha service API key

Decision Guide

I want to...Use this
------------------------
Search the webghostfetch "query"
Search with specific engineghostfetch "query" -e brave
Read a web pageghostfetch fetch -m
Read multiple pages at onceghostfetch fetch url1 url2 url3 -m -p 3
Find links on a pageghostfetch links
Find specific linksghostfetch links -f "pattern"
Get structured dataghostfetch fetch --json

Examples

Research a topic

ghostfetch "rust async runtime comparison 2026" -n 5
ghostfetch fetch https://tokio.rs -m

Scrape structured data

ghostfetch fetch https://api.example.com/data --json

Find all GitHub links on a page

ghostfetch links https://awesome-list.com -f "github.com"

Installation

The ghostfetch binary must be in your PATH. Build from source:

git clone https://github.com/neothelobster/ghostfetch.git
cd ghostfetch
go build -o ghostfetch .
cp ghostfetch ~/.openclaw/workspace/tools/

Or run the included setup.sh which clones at a pinned commit with verification.

Requires Go 1.21+ to build. No runtime dependencies.

Security

  • Read-only tool — output goes to stdout only, no file write capability
  • No custom headers or POST bodies — cannot leak secrets to external endpoints
  • No data is stored except optional cookie jars (disabled with --no-cookies)
  • All network requests go directly from your machine — no proxy or third-party service
  • The setup script clones from GitHub at a pinned commit with verification
  • Source code: https://github.com/neothelobster/ghostfetch

版本历史

共 1 个版本

  • v1.1.0 当前
    2026-03-29 21:17 安全 安全

安全检测

腾讯云安全 (Keen)

安全,无风险
查看报告

腾讯云安全 (Sanbu)

安全,无风险
查看报告

🔗 相关推荐

data-analysis

Data Analysis

ivangdavila
{"answer":"数据分析与可视化。查询数据库、生成报告、自动化电子表格,将原始数据转化为清晰可行的见解。适用于:(1) 您……"}
★ 198 📥 65,124
data-analysis

Excel / XLSX

ivangdavila
创建、检查和编辑 Microsoft Excel 工作簿及 XLSX 文件,支持可靠的公式、日期、类型、格式、重算及模板保留功能。
★ 368 📥 140,470
data-analysis

Stock Analysis

udiedrichsen
{"answer":"基于雅虎财经数据,分析股票与加密货币。支持投资组合管理、自选股预警、股息分析、8维评分、热门趋势扫描及传闻/早期信号探测。适用于股票分析、持仓追踪、财报异动、加密监控、热门股追踪或提前发掘非主流传闻。"}
★ 270 📥 56,977