How to get justified subcaptions with subfloat in revtex

I know that the documentclass revtex4-1 is incompatible with the caption (and subcaption) package and thus when using the subfig package I need to add the option as elaborated by karlkoeller and egreg.

However, even with the option I still get subcaptions that are not justified. The main caption is nicely justified, but long subcaptions are not. On the other hand, changing the justification to [justification=raggedright] works as expected. Also with documentclass{article} things are fine.

Any way of making long _sub_captions justified in revtex4-1?

Minimum example:

documentclass[reprint,amsmath,amssymb,aps,prd]{revtex4-1}
% documentclass{article}  % works with docclass article but not with revtex
usepackage{graphicx}
usepackage{subfig}  
% raggedright works, justified does not
usepackage{todonotes}

begin{document}

begin{figure*}[htb]
    centering
    subfloat[Long text here. Long text here. Long irregular text here. 
    More irregular text here. Long text here. Broken up with some other words. 
    Trying to show the ragged effect left and right. 
    Addsomeveryextremelylongwords tomakethingsworse andthus moreclear.]
    {missingfigure[figwidth=5cm]{}}
    hspace{1cm}
    subfloat[Long text here. Long text here. Long irregular text here. 
    More irregular text here. Long text here. Broken up with some other words. 
    Trying to show the ragged effect left and right. 
    Addsomeveryextremelylongwords tomakethingsworse andthus moreclear.]
    {missingfigure[figwidth=5cm]{}}
    caption{Large caption spanning both subfigures. 
    This caption actually is justified as it is supposed to be. 
    Unfortunately the same does not go for the subcaptions above 
    which are not justified. Using ``raggedright'' in the captionsetup 
    actually works also on the subcaptions. ``justified'' however does not.}
end{figure*}

end{document}