Comma after "then" and before "when"

Should there be a comma after the "then" in the following sentence?

If things get more complicated, then, when the others arrive, we’ll need to put in more effort.

If there a comma there makes sense, why should it be there? I feel like there should be a stop there, but it looks very weird to me.