ML Commons cluster settings

    Description

    If true, ML Commons tasks and models run machine learning (ML) tasks on ML nodes only. If false, tasks and models run on ML nodes first. If no ML nodes exist, tasks and models run on data nodes. Don’t set as “false” on production cluster.

    Values

    • Default value: false

    Dispatch tasks to ML node

    Setting

    1. plugins.ml_commons.task_dispatch_policy: round_robin

    Description

    Values

    • Dafault value: round_robin
    • Value range: round_robin or least_load

    Setting

    When returning runtime information with the , ML Commons will run a regular sync up job to sync up newly loaded or unloaded models on each node. When set to 0, ML Commons immediately stops sync up jobs.

    Values

    • Default value: 10
    • Value range: [0, 86,400]

    Predict monitoring requests

    Setting

    Description

    Value range

    • Default value: 100
    • Value range: [0, 100,000,000]

    Setting

    Description

    Controls how many upload model tasks can run in parallel on one node. If set to 0, you cannot upload models to any node.

    • Default value: 10
    • Value range: [0, 10]

    Load model tasks per node

    Setting

    1. plugins.ml_commons.max_load_model_tasks_per_node: 10

    Description

    Values

    • Default value: 10
    • Value range: [0, 10]

    Setting

    Description

    The default value allows uploading a model file from any http/https/ftp/local file. You can change this value to restrict trusted model URL

    Values

    • Default value: