加载中
正在获取最新内容，请稍候...
delta-rs: 高性能 Delta Lake Rust 库与 Python 绑定
本项目提供一个高性能的原生 Rust 库，用于读写 Delta Lake，并包含易于使用的 Python 绑定。它 enables efficient data processing without JVM overhead.
Rust
Added on 2025年5月30日2,800
Stars485
ForksRust
LanguageProject Introduction
Summary
A high-performance native Rust library for interacting with Delta Lake, featuring robust Python bindings for broad accessibility and use.
Problem Solved
Existing Delta Lake connectors often rely on the JVM or have performance limitations for certain workloads. This project aims to provide a native, high-performance alternative in Rust with convenient Python access.
Core Features
高性能读写
Leverage Rust's performance for fast read and write operations on Delta Lake tables.
Python 绑定
Seamlessly access Delta Lake functionalities directly from Python applications.
Delta Lake 功能支持
Supports essential Delta Lake features like schema evolution, time travel, and ACID transactions.
Tech Stack
Rust
Python
Delta Lake Format
PyO3 (for Python bindings)
使用场景
本项目可在多种场景下提供高效的 Delta Lake 交互能力：
场景一：高效数据摄取 (Ingestion)
Details
Quickly load data into Delta Lake tables from various sources using native Rust or Python scripts for better performance.
User Value
Reduce data loading times and improve ingestion throughput.
场景二：原生数据应用开发
Details
Develop custom data processing applications or microservices in Rust that directly read from and write to Delta Lake without external dependencies like Spark.
User Value
Build lean, fast, and easily deployable data applications.
场景三：Python 数据分析加速
Details
Utilize Python for analytics and machine learning workflows on Delta Lake, leveraging the performance of the underlying Rust implementation.
User Value
Enhance performance of data analysis scripts interacting with Delta Lake.
Recommended Projects
You might be interested in these projects
bentomlBentoML
BentoML is an open-source framework for building, shipping, and scaling production AI applications. Easily serve ML models as APIs, create job queues, build LLM apps, and orchestrate multi-model inference pipelines.
Python
7848850
pola-rspolars
Polars是一个高性能、多线程、内存高效的DataFrame库，采用Rust语言构建，旨在成为处理大规模数据的快速解决方案。
Rust
342072279
apacheiceberg
Apache Iceberg is an open table format for huge analytic datasets. Iceberg adds high-performance read and write using a table format that evolves.
Java
76592642