Project texture painting from reference image

Don’t know if this would be hard to implement, but the ability to project the colours of the reference image onto the mesh according to your viewpoint at the time would be a great addition to the current texture painting tools. It would let you sculpt/model precisely over a reference image, and then vertex paint it exactly from the same image.