Stacking/Concatenating/Combining two vector space models

Question

I have two vector-space models,  with different dimensions.

The number of vectors in one model is the same as the number of vectors in the other. I.E: if I have vector representation for a car in one model,  I have vector representation for a car in the other model, but the number of dimensions can be different.

I want to combine these models (and then cluster using the combined model),  I cannot average (BoW) or add these models together as stated earlier they have different dimensions.

I was going to simply concatenate the vectors. Is this valid or  is there better way to do this?

Also before you concatenate should you normalize?

SR_ml · Answer

It is perfectly valid to concatenate the vectors from two different models. It will be necessary however to experiment with the two approaches, i.e. either using individual vectors from one of the models or concatenating the vectors, before you can determine which method will produce better clustering results. It is also valid to normalize word vectors, but again requires experimentation to determine whether this approach will provide superior results.

Answered by SR_ml on November 27, 2020

Stacking/Concatenating/Combining two vector space models

One Answer

Add your own answers!

Ask a Question