加载中
正在获取最新内容，请稍候...
Log Aggregation System - Like Prometheus, For Logs
A horizontally scalable, highly available, multi-tenant log aggregation system designed for modern distributed systems, inspired by Prometheus.
Go
Added on 2025年6月22日25,803
Stars3,696
ForksGo
LanguageProject Introduction
Summary
This project offers a cost-effective and scalable solution for collecting, storing, and querying logs. By indexing metadata labels instead of full log content, it provides operational simplicity and significantly lower infrastructure costs for logging at scale.
Problem Solved
Traditional log management systems often struggle with high ingest costs, expensive indexing, and complex scaling when dealing with terabytes or petabytes of log data generated by large, distributed applications.
Core Features
Index-Sparse Architecture
Utilizes a unique architecture that stores logs in object storage (like S3 or GCS) and uses a small, searchable index, drastically reducing storage costs compared to traditional systems.
Label-Based Querying
Provides a powerful query language (like LogQL) optimized for log analysis, allowing fast filtering and aggregation across potentially vast amounts of log data using labels.
Tech Stack
Go
gRPC
Apache Parquet
Protocol Buffers
Kubernetes
Object Storage (S3/GCS compatible)
Use Cases
Ideal for various scenarios requiring scalable and cost-efficient log management:
Cloud-Native & Kubernetes Logging
Details
Collect logs from containerized applications running on Kubernetes, enabling centralized searching and analysis for debugging and performance monitoring.
User Value
Simplifies logging architecture in ephemeral container environments and reduces logging infrastructure costs.
Distributed System Log Centralization
Details
Gather log data from distributed services and applications running across multiple data centers or cloud regions, facilitating centralized observability.
User Value
Provides a single pane of glass for log data, improving visibility and accelerating incident response across distributed systems.
Recommended Projects
You might be interested in these projects
kubernetes-sigsexternal-dns
Automates the synchronization of Kubernetes resources (like Services and Ingresses) with external DNS providers, enabling dynamic service discovery and access.
Go
82452697
oryhydra
Ory Hydra is the only web-scale, fully customizable, OpenID Certified™ OpenID Connect and OAuth2 Provider in the world. Written in Go, it's a cloud-native, headless, API-first solution relied upon by major companies for web-scale security.
Go
162231542
camundacamunda
A robust framework for automating complex business processes and workflows, providing visibility, scalability, and resilience.
Java
3662669