tools / web

Web

internetdocuments7 tools

Search the web and turn a page into Markdown, PDF, a screenshot, or its metadata; find an existing archived snapshot.

Tools

archive-snapshot.py

● networkpython3

Look up whether archive.ph already has a snapshot of a URL -- GET /newest/<url> and report its Location header on a redirect. Lookup only: never submits a new snapshot, so it can't be used to force-archive something that isn't already there. Prints nothing (not an error) when no snapshot exists -- the caller falls back to the original link.

page-metadata.py

● networkpython3

Fetch a URL and extract its <title> and Open Graph tags (og:title, og:description, og:image) -- stdlib html.parser only, no external service.

page-to-markdown.py

● networkpython3

Extract clean, readable Markdown article text from any web page using Trafilatura, stripping ads, navigations, sidebars, and boilerplate.

1 param · 1 outputdetails →

page-to-pdf.py

● networkheadless-browser

Render a webpage to a PDF (headless Chromium via Playwright) -- the print-to-PDF cousin of web/screenshot.py. Pass headers=<json object> to send extra request headers, as in web/screenshot.py.

2 params · 1 outputdetails →

screenshot.py

● networkheadless-browser

Capture a full-page PNG screenshot of a webpage (headless Chromium via Playwright). Pass headers=<json object> to send extra request headers. settle_ms (default 2000) is an extra wait after page load, for pages whose real content only appears after their own async JS runs.

3 params · 1 outputdetails →

search.py

● networkpython3

Search the web through DuckDuckGo and print one "title<TAB>url<TAB>snippet" result per line, with no API key required. Set site to constrain results to a single domain, timelimit to d, w, m, or y for recency, and region for locale-weighted results. Pairs with page-to-markdown to turn a query into full article text.

5 paramsdetails →

wiki-summary.py

● networkpython3

The lead summaries of the Wikipedia articles that best match one or more topics (Wikipedia's own search, then each article's page summary), written to summary.md as each article's title, link and a few paragraphs. Topics are separated by semicolons (cat behavior; object permanence) and share the byte budget. An article whose title shares no word with its topic is not taken (a search for a sentence finds noise), so a topic may find nothing; a query nothing matches still succeeds, and summary.md says no article was found, so a workflow that cites it goes on with no evidence rather than stopping. A rate limit or a server error exits 75 (temporary: fragletc --retry). Unlike web/page-to-markdown it needs no URL, only words.

3 params · 1 outputdetails →

Get it

This directory is the skill — SKILL.md lists the tools and the tools sit beside it. As one file, into any Agent Skills directory:

curl -fsSL https://tools.ofthemachine.com/web.tar.gz | tar xz -C ~/.claude/skills