加载中
正在获取最新内容，请稍候...
Apache Polaris - The Interoperable Open Source Catalog for Apache Iceberg
Apache Polaris is the interoperable, open source catalog for Apache Iceberg, providing a central metadata service to manage Iceberg tables across various data processing engines.
Java
Added on 2025年6月29日1,558
Stars263
ForksJava
LanguageProject Introduction
Summary
Apache Polaris is an open source catalog service designed specifically for Apache Iceberg. It acts as a central point for managing Iceberg table metadata, facilitating interoperability and consistency across multiple data processing frameworks and applications.
Problem Solved
Managing Apache Iceberg tables across a diverse landscape of processing engines (like Spark, Flink, Trino, Presto) can be challenging without a single, authoritative metadata catalog. Polaris solves this by providing an open, interoperable service.
Core Features
Centralized Metadata Management
Provides a centralized metadata service for Apache Iceberg tables, enabling consistent access across different compute engines.
Access Control and Security
Offers robust security features and access control mechanisms to govern who can access and modify Iceberg table metadata.
Tech Stack
Java
Spring Boot
Maven
REST API
OAuth2/OIDC
使用场景
Apache Polaris can be used in various scenarios where a centralized, interoperable catalog is needed for Apache Iceberg tables.
场景一：统一多引擎访问
Details
Use Polaris as the central metadata store for Iceberg tables accessed by multiple compute engines (e.g., Spark batch jobs, Flink streaming applications, Trino/Presto for interactive queries).
User Value
Ensures all engines see the same, consistent view of the Iceberg table metadata, simplifying data access and management.
场景二：集中式数据安全与治理
Details
Implement fine-grained access control and security policies within Polaris to govern read/write permissions on Iceberg tables based on user identity or role.
User Value
Simplifies compliance and enhances data security by centralizing access management logic for the data lake.
Recommended Projects
You might be interested in these projects
MHSanaei3x-ui
A web panel for managing Xray servers, providing an easy-to-use interface for multi-protocol (Vmess, Vless, Trojan, ShadowSocks, Wireguard) and multi-user management with features like traffic limits, expiry dates, and IP restrictions.
JavaScript
209024522
RVC-BossGPT-SoVITS
探索GPT-SoVITS，一个强大的开源工具，仅需1分钟语音数据即可实现高质量的语音合成（TTS）和少样本语音克隆。加速你的AI语音项目开发。
Python
462355088
fleetdmfleet
An open-source platform designed for IT, security, and infrastructure teams to manage and secure endpoints across diverse operating systems and environments.
Go
5118598