Fetch

Turn public URLs into usable local content.

Core Philosophy

1. Fetch only public web content.
2. Prefer clean extracted text over noisy raw HTML.
3. Save both the raw response and structured extraction locally.
4. Keep a simple local job history so previous fetches are easy to inspect.

Runtime Requirements

• Python 3 must be available as python3
• No external packages required

Safety Boundaries

• Public URLs only
• No login flows
• No cookies or browser automation
• No API keys or credentials
• No external uploads or cloud sync
• All fetched data is stored locally only

Local Storage

All data is stored under:

• ~/.openclaw/workspace/memory/fetch/jobs.json
• ~/.openclaw/workspace/memory/fetch/pages/

Key Workflows

• Fetch URL: fetch_url.py --url "https://example.com"
• Save cleaned output: save_output.py --url "https://example.com" --title "Example"
• List history: list_jobs.py
• Show job details: show_job.py --id JOB-XXXX

Scripts