HTML to Text

Extract plain readable text from HTML files or web pages using MinerU. MinerU outputs Markdown as the closest format to plain text.

Install

npm install -g mineru-open-api
# or via Go (macOS/Linux):
go install github.com/opendatalab/MinerU-Ecosystem/cli/mineru-open-api@latest

Quick Start

# Extract text from a local HTML file (requires token)
mineru-open-api extract page.html -o ./out/

# Extract text from a web page (requires token)
mineru-open-api crawl https://example.com/article

# JSON output contains text fields (requires token)
mineru-open-api extract page.html -f json -o ./out/

Authentication

Token required:

mineru-open-api auth             # Interactive token setup
export MINERU_TOKEN="your-token" # Or via environment variable

Create token at: https://mineru.net/apiManage/token

Capabilities

• Supported input: local .html file or web page URL
• HTML requires extract or crawl (token required) — not supported by flash-extract
• MinerU does not have a -f text option; Markdown is the closest plain-text output
• For truly plain text: use extract -f json and read the text fields from JSON output
• Language hint with --language (default: ch, use en for English)

Notes

• MinerU has no -f text format; use Markdown output or -f json for text fields
• HTML is NOT supported by flash-extract
• Output goes to stdout by default; use -o to save to a file or directory
• All progress/status messages go to stderr; document content goes to stdout
• MinerU is open-source by OpenDataLab (Shanghai AI Lab): https://github.com/opendatalab/MinerU