HPE2-N69 Using HPE AI and Machine Learning Questions and Answers

The OS supported for setting up a simple demo cluster for HPE Machine Learning Development Environment for the open source Determined on a local machine is Red Hat 7-based Linux. Red Hat 7-based Linux is an open source operating system that is used extensively in enterprise applications. It provides a stable and secure platform for running applications and is suitable for use in a demo cluster.

The best recommendation for an ML engineer running experiments on HPE Machine Learning Development Environment to keep more of the checkpoints is to adjust the experiment config's checkpoint storage settings to save more of the latest and best checkpoints. This can be done by monitoring ongoing trials in the WebUI and clicking checkpoint flags to auto-save the desired checkpoints. Additionally, the engineer should double-check that the checkpoint storage location is operating under 90% of total capacity to ensure that enough capacity is available to store the checkpoints. Finally, they can adjust the checkpoint storage settings to save checkpoints to a shared file system instead of cloud storage if desired.

Implementing hyperparameter optimization (HPO) manually can be time-consuming and demand a great deal of expertise. HPO is not a joint ML and IT Ops effort and it can be implemented on TensorFlow models, so these are not the primary challenges faced by ML teams. Additionally, ML teams often have access to large enough data sets to make HPO feasible and worthwhile.