How to treat data transformation choices as hyperparemeters?

So, the question talks about how to treat transformation choices as hyper parameters.

How I would go about it is the following:

Use one baseline model architecture for the data and then repeat the following:

1. Instantiate the baseline model (effectively make sure all of the weights are initialised)
2. Create the transformed dataset
3. Train the model
4. Compute generalisation performance measures (AUC, precision, recall, whatever).

Then compare the generalisation performance across all of the data transforms to find the "best" transformation which improves a generalisation metric which is appropriate for your task.

What shepan6 is suggesting is basically to manually search for the best "transformation choice hyperparameters" by trying them all and seeing what performs best.

This is a good idea (I upvoted), but if you want to go further, you can use a package like hyperopt and manually define an "objective" function that accepts a parameter that decides on which transformation to use.