pagesift
pagesift is Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Pyth.... It is ranked #515 on the AI Radar, in RAG & memory, first seen 1 days ago and shared in 1 post (3.2k views).
GitHub - YOLOW92/pagesift: Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Python/Node SDKs. Single Rust binary. · GitHub Skip to content Navigation Menu Sign in Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation pagesift Public…
What people said about pagesift on X
💸 快到夸张，pagesift 能把网页、PDF、Office 文档一键转成 AI 能直接吃的 Markdown，还能自己部署，省下 Firecrawl 这类云服务的月费。 pagesift 的 README 里自己跑了基准：PDF 转 Markdown 每页 2.4 毫秒，比 pypdf 快 20 多倍；处理 PDF 峰值内存 32 MB，Docling 要 3.6 GB 以上。 做 RAG 或者让 Agent 读资料，最烦的就是喂数据这一步：网页要一个爬虫，PDF 要一个解析库，扫描件还得另找 OCR，Word、Excel、电子书又各是一套，最后拼出一条又慢又脆的流水线。 它是一个 Rust…
— @Ryrenz, 1 days ago · 74 likes · see the post
Alternatives to pagesift
- Boo Bench — Leaderboard + paper
- auto-ontology — Auto Ontology 🔥
- arXiv.org — Contextual embeddings represent chunks of a document with respect to the document's global context. These models are…
- ModelBest — ModelBest — On-Device Open-Source Model Platform
- liteparse — A fast, helpful, and open-source document parser. Contribute to run-llama/liteparse development by creating an account…
- OpenDocRouter — Set the model to llamaindex/ocria-1 in your parse request to try it. New accounts start with $5 in credit
pagesift in numbers
- Rank on the AI Radar: #515 of 10395
- Shared in 1 post by 1 account: @Ryrenz
- 3.2k views on those posts
- First seen 1 days ago, last shared 1 days ago
- Pricing seen by AGK Intelligence: open source
- Market: RAG & memory
FAQ
What is pagesift?
Self-hosted web scraper, crawler and document parser for AI agents: URLs, PDFs with OCR and Office files to clean Markdown/JSON. Firecrawl- and Jina-compatible API, MCP server, agent endpoint, Pyth... It was first shared on X 1 days ago and is ranked #515 on the AI Radar.
Is pagesift free?
It is open source.
Who shared pagesift?
1 account on X, including @Ryrenz, in 1 post totalling 3.2k views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 65.6k posts from 5k X accounts over the last 14 days, 10.4k tools, 19 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 14:20 UTC. Full method.