How to quantify ‘compute cost’ of training of xgboost model?

Question

I want to quantify compute cost of hyper-parameter search for xgboost model. One way can be to measure training time with one particular hyper parameter configuration chosen for training and use it as proxy for compute cost. Can we quantify compute cost based on hyper parameters of this model depending upon value of hyper parameters chosen e.g., analytical expression based on max depth, num of estimators, min child weight, gamma etc or can you suggest some other way to quantify this compute cost?
I want to measure for each particular hyper parameters chosen for training on same set of data what will be the model performance and compute cost!

Cameron Chandler · Answer

If you have the time on hand, you could simply measure the time taken for all combinations of hyper parameter values in a Grid Search, preferably with repetition. It's unlikely that any theoretical analytical expression will provide adequate accuracy for predicting the compute cost, as there as so many factors that contribute noise to the compute time.
You could even build a regression model to predict the computing cost of new hyper parameter combinations if you wanted to.

How to quantify ‘compute cost’ of training of xgboost model?

One Answer

Add your own answers!

Ask a Question