You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
I need a way to visualize how my model is learning during training, which is a comparison between training loss and test loss.
Describe the solution you'd like
An event handler that enables the ability to extract loss during training.
Describe alternatives you've considered
Running the model for x epochs, evaluating the model, then retraining the model in a loop. This unfortunately does not work for all models, such as LightGbm that can't be retrained.
varkfold= ctx.BinaryClassification.CrossValidate(training, estimator, param.kfold);varbestModel= kfold.OrderByDescending(p => p.Metrics.Accuracy).Select(p => p.Model).First();vartestOutput= bestModel.Transform(test);varmetrics= ctx.BinaryClassification.Evaluate(testOutput);// This code doesn't work as estimator is IEstimator<ITransform> and bestModel is ITransform. Not sure how you would do this...estimator=bestModel;
Additional context
Ultimately, I am trying to analyze what the models I'm comparing are actually doing and so far I haven't found any documentation or any straightforward way to do it.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
I need a way to visualize how my model is learning during training, which is a comparison between training loss and test loss.
Describe the solution you'd like
An event handler that enables the ability to extract loss during training.
Describe alternatives you've considered
Running the model for x epochs, evaluating the model, then retraining the model in a loop. This unfortunately does not work for all models, such as LightGbm that can't be retrained.
Additional context
Ultimately, I am trying to analyze what the models I'm comparing are actually doing and so far I haven't found any documentation or any straightforward way to do it.
The text was updated successfully, but these errors were encountered: