Automatic parameters versioning
Parameters versioning is automatic when the
MlflowNodeHook is added to the hook list of the
mlflow.yml configuration file has a parameter called
flatten_dict_params which enables to log as distinct parameters the (key, value) pairs of a ```Dict`` parameter.
You do not need any additional configuration to benefit from parameters versioning.
MlflowNodeHook operates under the hood?
The medium post which introduces hooks explains in detail the differents execution steps
Kedro executes when the user calls the
kedro run command.
MlflowNodeHook registers the parameters before each node (entry point number 3 on above picture) by calling
mlflow.log_parameter(param_name, param_value) on each parameters of the node.
Frequently Asked Questions
Will parameters be recorded if the pipeline fails during execution?
The parameters are registered node by node (and not in a single batch at the beginning of the execution). If the pipeline fails in the middle of its execution, the parameters of the nodes who have been run will be recorded, but not the parameters of non executed nodes.
How are parameters detected by the plugin?
The hook detects parameters through their prefix
params: or the value
parameters. These are the reserved keywords used by Kedro to define parameters in the