跳到主要内容
Supermarket
返回能力市场
MCP Server
data
MIT

xberg

Polyglot document intelligence with a Rust core: extract text, metadata, images, tables, and structured data from 106 formats across 140 file extensions, plus code intelligence for 371 languages. Fifteen bindings, with CLI, REST API, and MCP server.

xberg-ioxberg-io
93/ 100

公开评测 · 综合采用结论

证据充分,整体质量与安全表现优秀

查看评测依据 评测我的项目基于公开项目证据,非安全认证或安装推荐
9.4kstars
586forks
最近更新 4小时前
评测生成时间(北京时间)
本报告引擎
v3.10.0
当前引擎
v3.16.0

本报告与当前引擎使用不同规则;原分数不会自动更新,不同版本的分数不宜直接对比。

重新评测此项目

进入后确认来源与额度,提交才会创建任务。

Evaluation report

综合采用结论

93
A+
满分 100
值得推荐低风险
决策摘要

证据充分,整体质量与安全表现优秀

100%
高置信度
100
文档
100
安全
87
质量
100
活跃
69
采用
  • 基础评测完成+25/25确定性评分与静态安全扫描已完成
  • README 有效证据+25/2522,905 个去重后的有效字符
  • 独立证据来源+20/205 类非重复证据,重复文件不叠加
  • 仓库元数据+10/10已取得仓库状态与采用数据
  • 活跃记录+5/5已取得最近提交时间
  • AI 复核+15/15已完成结构化 AI 证据复核
How it works · 架构图

Xberg 文档智能引擎架构

README展示核心引擎、多种部署模式(库、CLI、REST、MCP)及外部依赖(OCR、嵌入等),无明确时间顺序,适合架构图。

AI 提取 · 证据约束

左右滑动查看完整图示

Xberg 文档智能引擎架构README展示核心引擎、多种部署模式(库、CLI、REST、MCP)及外部依赖(OCR、嵌入等),无明确时间顺序,适合架构图。调用调用调用使用使用核心引擎处理提取CLI命令行接口REST APIHTTP服务MCP服务器AI集成OCR后端文本识别嵌入服务向量生成
图示依据
  • • 部署模式表列出库、CLI、REST、MCP、Docker
  • • OCR后端部分列出Tesseract、PaddleOCR等
  • • 嵌入部分说明本地和提供商托管
五维表现
Xberg 提供跨格式文档提取、OCR、代码智能等广泛能力,示例清晰,安装方式多样。但作为 MCP Server,缺少具体工具调用示例和错误处理细节,设计证据有限。
质量证据
  • README中列出107格式、141扩展名、371语言
  • 安装部分提供pip、npm、cargo等命令
  • Quick Start展示Rust提取示例
  • MCP Server部分列出9个工具、3个提示词、4个资源
  • CLI Reference列出14个命令
采用建议
优势
  • 问题与用途描述
  • 有效 README
  • 安装或接入步骤
  • 可执行示例
  • 未发现已知高风险模式
关注点
  • MCP工具的具体输入输出参数未详细说明
  • 错误处理和排障信息不足
  • 设计细节如权限边界、安全默认值未展示
  • 部分功能需额外feature,但未说明默认包含哪些
适合

需要多格式文档提取的开发者、构建RAG管道的团队、需要OCR和代码智能的场景、希望集成到AI助手(如Claude)的用户

不建议直接用于

需要轻量级单一格式提取的场景、对MCP工具参数有严格要求的集成、需要详细错误处理文档的运维团队

也有自己的公开项目?先看完证据,再用当前规则生成独立报告。

评测我的项目 →
文档证据
100/100
问题与用途描述10 分
有效 README12 分
安装或接入步骤14 分
可执行示例16 分
输入、参数或工具说明11 分
输出或结果说明9 分
限制、权限或边界12 分
错误处理或排障8 分
许可证信息5 分
结构化章节3 分
安全证据
低风险
未发现已知高风险模式

静态扫描不是安全保证,生产接入前仍应人工复核权限和数据边界。

方法、证据与局限展开
数据来源

GitHub Repository API

扫描范围

25 个文件 · 142,454 字符

评测引擎

v3.10.0 · AI 复核已启用(deepseek-chat)

局限
  • 静态评测不会安装或执行项目代码
  • 安全扫描基于高信号文件与已知模式,不能替代人工审计
  • 流行度只反映采用程度,不代表安全或工程质量

30 天热度趋势

README

Xberg

Xberg

Rust CI Coverage Built with alef Rust Python Node.js WASM Java Go C# PHP Ruby Elixir Dart Kotlin Swift Zig C FFI Docker Helm chart License Documentation Hugging Face
Join Discord Live Demo GitHub Stars

The fast, precise document-intelligence engine — for every language.

Point Xberg at anything — a PDF, a scanned image, a spreadsheet, an audio file, a URL, a whole archive, or a source tree — and get back clean text, tables, metadata, and structured data. One engine handles format detection, reading, OCR, and extraction, so you never stitch a pipeline together from a dozen libraries.

107 formats · 141 file extensions · 371 code languages · 15 language bindings · 6 output formats · OCR · transcription · embeddings

The fastest, most precise open-source document and PDF-to-Markdown engine — see the benchmarks.

Install · What you get · Capabilities · CLI · Docs

Xberg is the next iteration of Kreuzberg. Same document-intelligence engine, rebuilt and rebranded under a fresh v1 line.


What you get

Point Xberg at anything — a PDF, a spreadsheet, a scanned image, an audio file, a URL, an archive, a source tree — and get back clean, structured content you can use right away. One core does the format detection, reading, and extraction, so you don't assemble a pipeline yourself. Call it from Rust, Python, Node.js, Go, Java, C#, Ruby, PHP, Elixir, Dart, Swift, Zig, WASM, Kotlin, or C FFI, and run it as a library, CLI tool, REST API, or MCP server.

CapabilityWhat you get
107 document formatsPDFs, Office, images, HTML, email, e-books, scientific publications, and structured data across 141 file extensions, with intelligent MIME detection and bounded extraction controls.
URLs & the webPoint Xberg at an http(s) URL — it fetches and extracts a single document, or crawls and follows links (Auto / Document / Crawl modes via the crawlberg engine). Requires the url-ingestion feature.
Audio & video transcriptionSpeech-to-text from MP3, M4A, WAV, WebM, and MP4 tracks via Whisper ONNX (tiny → large-v3). Requires the transcription feature.
Archives, traversedList and recursively extract nested .zip, .tar, .gz, .7z — documents inside documents — guarded by zip-bomb, compression-ratio, and nesting-depth limits.
OCR on demandTesseract, PaddleOCR, Candle, or VLM backends — fallback chains, confidence scores, language auto-detection, extensible via plugins.
Layout & tablesML layout models (PP-DocLayout-V3, RT-DETR) and table structure (TATR, SLANet) reconstruct reading order and cell grids for clean Markdown.
Code intelligenceFunctions, classes, imports, symbols, docstrings from 371 programming languages. Syntax-aware chunking for RAG pipelines.
Embeddings & searchLocal (ONNX) or provider-hosted embeddings (165 providers via liter-llm), sparse and late-interaction, cross-encoder reranking.
EnrichmentNER, keyword extraction (YAKE/RAKE), summarization, translation, redaction, page classification, QR detection, language detection, token reduction (TOON).
Structured extractionSchema-driven JSON straight from any document via local (Ollama, LM Studio, vLLM) or hosted LLMs — no prompt engineering.
6 output formatsPlain text, Markdown, Djot, HTML, JSON tree, or Docling DocTags, plus registered custom renderers.
Runs anywhereLibrary, CLI (14 commands), REST API (xberg serve), MCP server, Docker, Helm — CPU by default, no GPU required. Content-hash caching, parallel batch, per-file timeouts.

Capabilities marked requires a feature are Cargo feature flags on the core crate (url-ingestion, transcription, reranker, layout/ORT). Prebuilt language packages and the Docker image bundle the common set; a from-source build enables only what you select.


Installation

Language Packages

Python
pip install xberg

See Python README for full documentation.

Node.js / TypeScript
npm install @xberg-io/xberg

See Node.js README for full documentation.

Rust
cargo add xberg

See Rust README for full documentation.

Go
go get github.com/xberg-io/xberg/packages/go@latest

⚠️ The repository root is not a Go module — go get github.com/xberg-io/xberg will fail. Always target the /packages/go subdirectory as shown above.

See Go README for full documentation.

Java

Available on Maven Central as io.xberg:xberg. See Java README for the dependency snippet.

C#
dotnet add package XbergIo.Xberg

See C# README for full documentation.

Ruby
gem install xberg

See Ruby README for full documentation.

PHP
composer require xberg-io/xberg

See PHP README for full documentation.

Elixir

Add {:xberg, "~> 1.0"} to your mix.exs dependencies. See Elixir README for full documentation.

WebAssembly
npm install @xberg-io/xberg-wasm

See WebAssembly README for full documentation.

Kotlin (Android)

Available on Maven Central as io.xberg:xberg-android. See Kotlin README for the dependency snippet.

Swift

Add via Swift Package Manager. See Swift README for full documentation.

Dart / Flutter
dart pub add xberg

See Dart README for full documentation.

Zig

Add via zig fetch. See Zig README for full documentation.

C/C++ (FFI)

Build from source as part of this workspace. See C (FFI) README for full documentation.

CLI & Deployment

CLI Tool
brew install xberg-io/tap/xberg

Windows users can install the same binary through Scoop:

scoop bucket add xberg https://github.com/xberg-io/scoop-bucket
scoop install xberg

14 commands: extract, batch, detect, formats, version, cache, tree-sitter, doctor, serve, mcp, api, embed, chunk, and completions.

See CLI usage guide for detailed documentation.

Docker
docker pull ghcr.io/xberg-io/xberg:latest

Run in API, CLI, or MCP modes. See Docker guide for examples.

REST API Server
xberg serve --host 0.0.0.0 --port 8000

One POST endpoint handles all formats. Returns JSON or Markdown. Stream large files. See API server guide.

MCP Server
xberg mcp --transport stdio

9 tools (extract, extract_batch, detect_mime_type, cache_stats, list_formats, cache_clear, get_version, cache_manifest, cache_warm). 3 prompts (extract_document, extract_with_ocr, semantic_search). 4 resources (formats, models, OCR languages, embedding presets).

Add to Claude Desktop or Cursor:

{
  "mcpServers": {
    "xberg": { "command": "xberg", "args": ["mcp"] }
  }
}

See MCP integration guide.

AI Coding Assistants

Install the Xberg plugin from xberg-io/xberg. Ships extraction APIs, OCR backends, configuration, and language conventions.

Claude Code
/plugin marketplace add xberg-io/xberg
/plugin install xberg@xberg
Codex CLI
/plugins add https://github.com/xberg-io/xberg

Search for xberg and select Install Plugin.

Cursor

Settings → Plugins → Add from URL → https://github.com/xberg-io/xberg, then select xberg.

Gemini CLI
gemini extensions install https://github.com/xberg-io/xberg
Factory Droid
droid plugin marketplace add https://github.com/xberg-io/xberg
droid plugin install xberg@xberg
GitHub Copilot CLI
copilot plugin marketplace add https://github.com/xberg-io/xberg
copilot plugin install xberg@xberg
opencode

Add to opencode.json:

{
  "$schema": "https://opencode.ai/config.json",
  "plugin": ["@xberg-io/opencode-xberg"]
}

Quick Start

Extract text from a document:

use xberg::{extract, ExtractInput, ExtractionConfig};

#[tokio::main]
async fn main() -> xberg::Result<()> {
    let config = ExtractionConfig::default();
    let output = extract(
        ExtractInput::from_uri("document.pdf"),
        &config
    ).await?;

    println!("{}", output.results[0].content);
    Ok(())
}

Common use cases — see Quick start guide for language-specific examples, OCR, batch processing, and API configuration.


Capabilities

Full feature list

Supported File Formats (107 formats · 141 file extensions · 56 MIME aliases)

107 formats across 140 unique file extensions, with 56 compatibility MIME aliases, intelligent format detection, and comprehensive metadata extraction.

Office Documents

CategoryFormatsCapabilities
Word Processing.docx, .docm, .doc, .dotx, .dotm, .dot, .odt, .pages, .wpd, .wp, .wp5, .wp6Full text, tables, images, metadata, styles
Spreadsheets.xlsx, .xlsm, .xlsb, .xls, .xla, .xlam, .xltm, .xltx, .xlt, .ods, .numbersSheet data, formulas, cell metadata, charts
Presentations.pptx, .pptm, .ppt, .pps, .ppsx, .potx, .potm, .pot, .odp, .keySlides, speaker notes, images, metadata
PDF.pdfText, tables, images, metadata, OCR support
eBooks.epub, .fb2Chapters, metadata, embedded resources
Database.dbf, .sqlite, .sqlite3, .db, .gpkg, .gpkxBounded table extraction, schema metadata, GeoPackage detection
Hangul.hwp, .hwpxKorean document format, text extraction

Images (OCR-Enabled)

CategoryFormatsFeatures
Raster.png, .jpg, .jpeg, .gif, .webp, .bmp, .tiff, .tifOCR, table detection, EXIF metadata, dimensions, color space
Advanced.jp2, .jpg2, .j2c, .j2k, .jpc, .jbig2, .jb2, .pnm, .pbm, .pgm, .ppmOCR via pure-Rust JPEG2000 decoder, JBIG2 support, table detection
HEIC family.heic, .heics, .heif, .heifs, .hif, .avif, .avcsEXIF metadata, optional pixel decoding
Vector.svgDOM parsing, embedded text, graphics metadata

Audio & Video

CategoryFormatsFeatures
Audio.mp3, .mpga, .m4a, .wav, .webmWhisper transcription
MP4 audio track.mp4, .mpg4, .mp4v, .m4vAudio-track transcription only
MPEG audio track.mpeg, .mpg, .mpe, .m1v, .m2vAudio-track transcription only
WebM audio track.webmAudio-track transcription only

Web & Data

CategoryFormatsFeatures
Markup.html, .htm, .xhtml, .xht, .xml, .kml, .svgDOM parsing, metadata (Open Graph, Twitter Card), link extraction
Structured Data.json, .geojson, .jsonl, .ndjson, .yaml, .yml, .toml, .csv, .tsvSchema detection, nested structures, validation
Text & Markdown.txt, .adoc, .asciidoc, .vtt, .md, .markdown, .commonmark, .qmd, .rmd, .djot, .dj, .mdx, .doctags, .rst, .org, .rtfAsciiDoc, CommonMark, MyST Markdown, Quarto, R Markdown, Djot, MDX, DocTags, reStructuredText, Org Mode

Email & Archives

CategoryFormatsFeatures
Email.eml, .msg, .pstHeaders, body (HTML/plain), attachments, threading
Archives.zip, .tar, .tgz, .gz, .7zFile listing, nested archives, metadata, recursive extraction

Academic & Scientific

CategoryFormatsFeatures
Citations.bib, .ris, .nbib, .enwStructured parsing: RIS, PubMed/MEDLINE, EndNote XML, BibTeX/BibLaTeX
Scientific.tex, .latex, .typ, .typst, .jats, .nxmlLaTeX, Typst, PubMed JATS
Text notebooks.ipynb, .md, .py, .R, .jlJupyter, MyST-NB, Jupytext percent/light, saved outputs, cell visibility tags
Publishing.fb2, .docbook, .dbk, .docbook4, .docbook5, .opmlFictionBook, DocBook XML, OPML outlines

Code Intelligence (371 Languages)

Extract structure from 371 programming languages via tree-sitter:

FeatureDescription
Structure ExtractionFunctions, classes, methods, structs, interfaces, enums
Import/Export AnalysisModule dependencies, re-exports, wildcard imports
Symbol ExtractionVariables, constants, type aliases, properties
Docstring ParsingGoogle, NumPy, Sphinx, JSDoc, RustDoc, and 10+ formats
Syntax-Aware ChunkingSplit code by semantic boundaries for RAG pipelines
DiagnosticsParse errors with line/column positions

Powered by tree-sitter-language-pack.

Output Formats (6)

FormatUse caseExample
PlainRaw text, no markup"Chapter 1\nIntroduction"
MarkdownReadable, structured, RAG-friendly"# Chapter 1\n## Introduction"
DjotModern lightweight markupSimilar to Markdown but stricter
HTMLStyled, browser-ready<h1>Chapter 1</h1>
JSONMachine-readable tree structureHierarchical sections with heading levels
DocTagsDocling-compatible tag stream for document elements and tables<text>Chapter 1</text>

Deployment Modes

ModeCommandTransportUse case
Libraryxberg::extract()Async functionsEmbed in your application
CLIxberg extract document.pdf14 commandsScripts, batch jobs, CI/CD
REST APIxberg serveHTTP POSTMicroservice, serverless deployment
MCP Serverxberg mcpstdio or HTTPClaude, Cursor, IDE agents
Dockerdocker run ghcr.io/xberg-io/xbergAll modesContainer deployment

OCR Backends

  • Tesseract — Native C FFI (Linux/macOS/Windows) and WASM (browser)
  • PaddleOCR — ONNX Runtime, mobile-optimized models
  • Candle — Pure Rust, CPU-only, lightweight
  • VLM — GPT-4 Vision, Claude Vision, Gemini Vision, or 165 providers via liter-llm

Fallback chains. Extensible via plugin system.

Embeddings

Local (ONNX Runtime):

  • Preset models: fast, balanced (default), quality, multilingual
  • Dimensions: 384, 768, 1024

Provider-hosted:

  • OpenAI, Anthropic, Google, Hugging Face, Mistral, Cohere, and 165 providers total
  • Via liter-llm integration

Reranking:

  • Local ONNX rerankers (cross-encoder models)
  • Provider-hosted: Cohere Rerank, others

Structured LLM Extraction

Local engines: Ollama, LM Studio, vLLM

Remote: OpenAI, Anthropic, Google, Mistral, Cohere, and 165 providers via liter-llm

Schema validation. Temperature, top-p, frequency penalty tuning.

Enrichment

  • NER — GLiNER or LLM-based entity recognition
  • Redaction — Mask PII (phone, email, SSN, credit card, addresses)
  • Summarization — Document and section summaries via LLM
  • Translation — Multi-language via LLM
  • Page Classification — Tag document pages (cover, toc, content, etc.)
  • QR Code Detection — Extract and decode QR codes from images
  • Keyword Extraction — YAKE or RAKE algorithms
  • Language Detection — Detect document language
  • Layout Detection — RT-DETR + TATR models for document structure
  • Table Extraction — Cell-level structure and content
  • Token Reduction — TOON wire format (~30–50% fewer tokens than JSON)

CLI Reference

All 14 commands
CommandSubcommandsPurpose
extract—Extract text from a single document (path, URL, or stdin)
batch—Extract from multiple documents in parallel
detect—Identify MIME type of a file
formats—List all supported formats and MIME types
version—Show Xberg version
cachestats, clear, manifest, warmManage extraction cache and models
tree-sitterdownload, list, cache-dir, cleanManage code-intelligence grammars
doctor—Diagnose the local installation and runtime dependencies
serve—Start REST API server (default: http://127.0.0.1:8000)
mcp—Start MCP server (stdio or HTTP transport)
apischemaOutput OpenAPI 3.1 specification
embed—Generate embeddings for text (local or provider-hosted)
chunk—Split text into chunks (text, markdown, YAML, or semantic)
completions—Generate shell completion scripts

Run xberg --help or xberg <command> --help for detailed options.


Documentation

Full guides, API references for every binding, format reference, and configuration docs live at xberg.io.


Built with Xberg

Projects that declare Xberg as a dependency. Xberg was previously published as kreuzberg, and most of these projects declare the package under that name.

ProjectWhat it isStars
basemindAI context and content layer for coding agents over one MCP server: code map, document RAG, shared memory and web crawlStars
deluluA suite of MCP servers and CLI tools that give your LLM better search and fewer hallucinationsStars
docs-mcp-serverGrounded documentation MCP server, an open-source alternative to Context7, Nia and Ref.ToolsStars
eratoThe open-source AI platformStars
fastmail-cliCLI and MCP server for Fastmail: email, contacts, masked email, attachments and text extractionStars
ghfdb-portalWeb portal for the Global Heat Flow DatabaseStars
hawki-toolkit-file-converterPrepares and converts PDF files for the HAWKI toolkitStars
haystack-core-integrationsIntegrations that extend Haystack with extra components and document storesStars
kreuzaktA search engine for humans and computers, aimed at your most boring documentsStars
lilbeeThe whole local AI stack in one executable, with conversational search and cited answers over your files, code and the webStars
llm-workflow-enginePower CLI and workflow manager for LLMsStars
MANSPIDERSpiders entire networks for files sitting on SMB shares, searching filenames or contents with regexStars
otoroshi-llm-extensionConnect, secure and manage LLM models behind one OpenAI-compatible APIStars
sift-kgTurns a collection of documents into a knowledge graph, extracting entities and relationships with an LLMStars
sirchmunkTurns raw data into a self-evolving, real-time search and intelligence layerStars
support-chatbotLevel-1 support chatbot for the Netherlands Red Cross 510 teamStars

Using Xberg in your project? Open a PR adding it to this list.


Contributing

Contributions are welcome! See CONTRIBUTING.md for guidelines.

Join our Discord community for questions and discussion.


Part of Xberg.io

  • Xberg — the open-source content-intelligence engine: text, tables, and metadata from 107 formats (141 file extensions), with OCR, transcription, and code intelligence. MIT.
  • Xberg Pro — a complete self-hosted content-intelligence backend in a single container. Commercial.
  • Xberg Enterprise — the distributed, governed content-intelligence platform, scaled on Kubernetes with team governance and support. Commercial.
  • crawlberg — web crawling and scraping with HTML→Markdown and headless-Chrome fallback.
  • html-to-markdown — fast, lossless HTML→Markdown engine.
  • liter-llm — universal LLM API client with native bindings for 14 languages and 165 providers.
  • tree-sitter-language-pack — tree-sitter grammars and code-intelligence primitives.
  • alef — the polyglot binding generator that produces every per-language binding across the 5 polyglot repos.

License

MIT License (MIT) — see LICENSE for details.