Is there any 'for + NP + to-infinitive' where the NP is not the semantic subject of the infinitive?

"Subject" is a syntactic and not a semantic function. If you are talking about semantic roles, in your example "you" is a potential undergoer who is expected to perform something. In a sentence such as: "it was hard for him to leave", instead, "him" encodes an experiencer.