Converting latitude, longitude to image coordinates

I have a 2D image and I know a given pixel in the image corresponds to a particular latitude longitude (so basically a reference point). The image I have is a camera image of an outdoor scene and I have the possibility to identify the (lat, long) of some of the points on that camera scene.

How could one transform a given latitude, longitude to a pixel coordinates given this information. I am guessing just one reference point is not enough and perhaps we need at last two to establish the spatial resolution. Is that sufficient information to transform latitude, longitude to image coordinates.