Is there any library available for balancing imbalanced text dataset?

Question

I have a text dataset similar to newsgroup dataset, the problem with the dataset is that it is highly imbalanced. So is there any readily built library that will do upsampling or downsampling with a function call?

deep learning nlp preprocessing text

Adhira Deogade · Accepted Answer

from imblearn.over_sampling import ADASYN, SMOTE, RandomOverSampler
from imblearn.under_sampling import NearMiss, RandomUnderSampler

ros = RandomOverSampler(random_state=777)
X_ROS, y_ROS = ros.fit_sample(testing_tfidf, testing_target)

smt = SMOTE(random_state=777, k_neighbors=1)
rus = RandomUnderSampler(random_state=777)

Good article for reference

oaksandbrooms · Answer

Here is a good blog for handling this in R.
Class imbalance

Is there any library available for balancing imbalanced text dataset?

2 Answers

Add your own answers!

Ask a Question