Scale and pan background reference with camera

While not perfect, you could paint a plane and use it as a reference image. A great explanation: Reference image on planes

Not exactly what you’re looking for but hopefully will help in the meantime.