Implementation Notes

Before digging into details of implementations, you should read architecture-and-requirements first to understand overall requirements and architecture.

Here're sub topics of Submarine implementations:

• Submarine Storage: How to store metadata, logs, metrics, etc. of Submarine.
• Submarine Environment: How environments created, managed, stored in Submarine.
• Submarine Experiment: How experiments managed, stored, and how the predefined experiment template works.
• Submarine Notebook: How experiments managed, stored, and how the predefined experiment template works.
• Submarine Server: How Submarine server is designed, architecture, implementation notes, etc.

Working-in-progress designs, Below are designs which are working-in-progress, we will move them to the upper section once design & review is finished:

• Submarine HA Design: How Submarine HA can be achieved, using RAFT, etc.
• Submarine services deployment module: How to deploy submarine services to k8s, YARN or cloud.