Tensorboard
Write to LogDirs by the environment variableβ
Environment variableβ
SUBMARINE_TENSORBOARD_LOG_DIR
: Exist in every experiment container. You just need to direct your logs to$(SUBMARINE_TENSORBOARD_LOG_DIR)
(NOTICE: it is()
not{}
), and you can inspect the process on the tensorboard webpage.
Exampleβ
{
"meta": {
"name": "tensorflow-tensorboard-dist-mnist",
"namespace": "default",
"framework": "TensorFlow",
"cmd": "python /var/tf_mnist/mnist_with_summaries.py --log_dir=$(SUBMARINE_TENSORBOARD_LOG_DIR) --learning_rate=0.01 --batch_size=20",
"envVars": {
"ENV_1": "ENV1"
}
},
"environment": {
"image": "apache/submarine:tf-mnist-with-summaries-1.0"
},
"spec": {
"Worker": {
"replicas": 1,
"resources": "cpu=1,memory=512M"
}
}
}
Connect to the tensorboard webpageβ
- Open the experiment page in the workbench, and Click the
TensorBoard
button.
- Inspect the process on tensorboard page.