加载中
正在获取最新内容，请稍候...
Apache DolphinScheduler - 现代数据编排平台
Apache DolphinScheduler is a modern, open-source data orchestration platform designed to build and manage high-performance workflows with a low-code interface. It simplifies complex task dependencies and scheduling for big data ETL, machine learning, and more.
Java
Added on 2025年6月10日13,559
Stars4,814
ForksJava
LanguageProject Introduction
Summary
Apache DolphinScheduler is a distributed and expandable workflow orchestration platform. It is designed to address the challenges of complex task dependencies in big data workflows, offering a user-friendly interface and powerful scheduling capabilities.
Problem Solved
Managing complex, distributed data workflows manually or with traditional schedulers is often cumbersome, prone to errors, and difficult to scale. Apache DolphinScheduler addresses these challenges by providing a distributed, fault-tolerant, and user-friendly platform for workflow orchestration.
Core Features
Workflow Definition and Visualization
Define and visualize workflows intuitively using a drag-and-drop low-code interface.
Robust Task Scheduling
Reliable scheduling based on time, events, or dependencies, with retry and fault tolerance mechanisms.
Tech Stack
Java
Spring Boot
Vue.js
MySQL/PostgreSQL
ZooKeeper/etcd
Apache Flink
Apache Spark
使用场景
Apache DolphinScheduler can be applied in various scenarios requiring automated task execution and workflow management:
Building and managing ETL/ELT pipelines
Details
Automate the extraction, transformation, and loading of data from various sources into data warehouses or data lakes.
User Value
Ensures data freshness and reliability for analytics and reporting.
Automating Machine Learning workflows
Details
Orchestrate sequences of tasks for data preparation, model training, evaluation, and deployment.
User Value
Streamlines the ML lifecycle and improves reproducibility.
Recommended Projects
You might be interested in these projects
zed-industrieszed
Zed is a blazing-fast, collaborative code editor from the creators of Atom and Tree-sitter, designed for modern development workflows.
Rust
607384394
modelscopeFunASR
A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.
Python
111011125
mullvadmullvadvpn-app
Official open-source desktop and mobile client application for the Mullvad VPN service, designed for enhanced online privacy and security.
Rust
5819405