GANcraft aims at solving the world-to-world translation problem. Given a semantically labeled block world such as those from the popular game Minecraft, GANcraft is able to convert it to a new world which shares the same layout but with added photorealism. The new world can then be rendered from arbitrary viewpoints to produce images and videos that are both view-consistent and photorealistic.

https://flowingdata.com/2021/04/20/converting-minecraft-worlds-to-photorealistic-ones-using-neural-networks/