Independent Science + Technology

Author: William Guo

The $0 Scheduler That Almost Cost a Compny Everything

Post date April 16, 2025
Post author By William Guo
Post categories In alibaba-cloud-migration, apache-dolphinscheduler, big-data-platform, cpu-limits-in-dolphinscheduler, cpu-load-spikes, dolphinscheduler, jvm-memory-settings, open source

Stop Moving Data Manually—Let DolphinScheduler’s Output Variables Do the Heavy Lifting For You

Post date March 20, 2025
Post author By William Guo
Post categories In apache-dolphinscheduler, data-engineering, dolphinscheduler-guide, opensource, programming, shell-scripts, technical-writing, workflow-orchestration

Big Data Scheduling Is Getting Smarter, But Will It Ever Be Smart Enough?

Post date March 6, 2025
Post author By William Guo
Post categories In apache-dolphinscheduler, big-data-workflow, big-data-workflow-scheduling, machine-learning, opensource, technology-trends, workflow-orchestration, workflow-scheduling

Everything You Need to Know About The Apache DolphinScheduler Version Upgrade

Post date February 25, 2025
Post author By William Guo
Post categories In apache-dolphinscheduler, bigdata, data-science, how-to-upgrade-apache, opensource, technical-writing, upgrade, upgrade-dolphinscheduler

Struggling With DolphinScheduler Setup? This FAQ Can Help

Post date February 19, 2025
Post author By William Guo
Post categories In apache-dolphinscheduler, apache-environment-setup, apache-service-startup, big-data-task-orchestration, dolphinscheduler-faq, faq, open source, technical-writing

Take the Guesswork Out of Installing DolphinScheduler—Here’s How to Do It

Post date February 13, 2025
Post author By William Guo
Post categories In ambari, ambari-custom-service, ambari-for-dolphinscheduler, apache, apache-dolphinscheduler, hadoop, managing-hadoop-clusters, open source

The Chinese Software Industry is Shifting From the Dinosaur Model to the Monkey-Troop Model

Post date February 11, 2025
Post author By William Guo
Post categories In deep-learning, deepseek, dinosaur-software, it-infrastructure, llms, monkey-troop-software, software, top

Using DolphinScheduler API to Achieve Efficient Batch Workflow Import and Script Deployment

Post date January 22, 2025
Post author By William Guo
Post categories In apache-dolphinscheduler, api, batch-workflow-import, beginners-guide, bigdata, dolphinscheduler-api, opensource, script-deployment

The King Combination: Efficiently Completing Heterogeneous Data Integration with DolphinScheduler 3.1. and SeaTunnel 2.3.

Post date January 15, 2025
Post author By William Guo
Post categories In apache-dolphinscheduler, apache-seatunnel, bigdata, data-integration, data-orchestration, data-science, king-combination, seatunnel

The Annual Question: Bugs Caused by Week-Based Year Formatting in Java

Post date January 8, 2025
Post author By William Guo
Post categories In apache-dolphinscheduler, date, java, open source, standardization-challenges, technical-writing, week-based-year-formatting, week-numbering-issues

I Built An Automatic Proposal Generation Large Language Model and Open-Sourced It on GitHub

Post date November 13, 2024
Post author By William Guo
Post categories In artificial-intelligence, automatic-proposal-generation, gans, github, llms, machine-learning, open-source-llm-models, opensource

Solutions for Failing to Create Tenants in Apache DolphinScheduler

Post date November 8, 2024
Post author By William Guo
Post categories In apache-dolphinscheduler, bigdata, create-a-tenant-in-apache, creating-tenants-fails, database, multi-tenant, opensource, tenants-issue-apache

How to Track the YARN Task Status in DolphinScheduler

Post date November 3, 2024
Post author By William Guo
Post categories In abstractyarntask, apache-dolphinscheduler, apache-dolphinscheduler-guide, dolphinscheduler, flink-stream-application, worker-task-relationship, yarn, yarn-task-status

Analyzing Apache DolphinScheduler’s Fault Tolerance Mechanism

Post date October 27, 2024
Post author By William Guo
Post categories In apachedolphinscheduler, dag-workflow, distributed-systems, fault-tolerance, master-node-failover, multi-node-deployment, worker-node-failover, yarn

Source Code Analysis of Apache SeaTunnel Zeta Engine (Part 3): Server-Side Task Submission

Post date September 20, 2024
Post author By William Guo
Post categories In apacheseatunnel, bigdata, data-integration, data-science, hackernoon-top-story, opensource, server-side-task-submission, source-code-analysis

Source Code Analysis of Apache SeaTunnel Zeta Engine (Part 2): Task Submission Process on the Client Side

Post date September 12, 2024
Post author By William Guo
Post categories In apache-guide, apacheseatunnel, bigdata, client-server, coding, data-science, seatunnel, technical-blog

Source Code Analysis of Apache SeaTunnel Zeta Engine (Part 1): Server Initialization

Post date September 12, 2024
Post author By William Guo
Post categories In apache-guide, apache-seatunnel, bigdata, data, data-science, seatunnel, source-code-analysis, zeta-engine

A 10-Minute Deep Dive Into the Core Architecture of Apache SeaTunnel and DataX

Post date August 30, 2024
Post author By William Guo
Post categories In apache-seatunnel-guide, apacheseatunnel, architecture-of-seatunnel, bigdata, comparison, data-integration, datax, issues-with-datax

Breaking Down the Worker Task Execution in Apache DolphinScheduler

Post date August 23, 2024
Post author By William Guo
Post categories In apache-dolphinscheduler, bigdata, cloud-computing-integration, data-engineering, distributed-systems, open source software, visual-dag-operations, workflow-orchestration

How to Release a New Version of an Open Source Project Under the Apache Software Foundation

Post date August 23, 2024
Post author By William Guo
Post categories In apache-dolphinscheduler, apache-release-management, apache-software-foundation, asf-release-guide, dependency-verification, open source software, opensource, pmc-permissions

Solutions for Upgrading Apache DolphinScheduler from Version 1.3.4 to 3.1.2

Post date August 8, 2024
Post author By William Guo
Post categories In apache-dolphinscheduler, apache-dolphinscheduler-issue, big-data, dolphinscheduler-error, dolphinscheduler-update-issue, opensource, resource-center-error, task-instance-log-loss

How to Enable Auto-Start for Apache DolphinScheduler

Post date July 13, 2024
Post author By William Guo
Post categories In apache-dolphinscheduler, apache-dolphinscheduler-guide, bigdata, data-science, how-to-enable-auto-start, linux, workflow-automation

Nothing left to load.