Using deep learning to transfer image

I'm wondering if there a way to enable a CNN to learn the non-linear transfer between two images. For example, the original image looks like

The target image looks like

I would like to develop a CNN that learns the pixel-wise relationship between the two images. Please suggest where I should start?