GEE, How to Remove Vertex Pixels

I made a classification mask of the layer and get the following figure:

I got several vertex pixels. A vertex pixel is a pixel that attaches to a bigger group by just one vertex (shown in red circles).

Is there a way to remove these pixels? I have tried the connectedPixelCount method but it looks like it will group the entire thing into one instead of masking the vertex pixel.