Current Generative Adversarial Networks (GANs) produce photorealisticrenderings of portrait images. Embedding real images into the latent spaceof such models enables high-level image editing. While recent methodsprovide considerable semantic control over the (re-)generated images, theycan only generate a limited set of viewpoints and cannot...
-
December 2021 (v1)Journal articleUploaded on: December 4, 2022
-
June 2021 (v1)Journal article
There has recently been great interest in neural rendering methods. Some approaches use 3D geometry reconstructed with Multi-View Stereo (MVS) but cannot recover from the errors of this process, while others directly learn a volumetric neural representation, but suffer from expensive training and inference. We introduce a general approach that...
Uploaded on: December 4, 2022 -
July 2023 (v1)Journal article
Radiance Field methods have recently revolutionized novel-view synthesisof scenes captured with multiple photos or videos. However, achieving highvisual quality still requires neural networks that are costly to train and render,while recent faster methods inevitably trade off speed for quality. Forunbounded and complete scenes (rather than...
Uploaded on: May 7, 2023 -
April 26, 2021 (v1)Journal article
Image-based rendering (IBR) provides a rich toolset for free-viewpoint navigation in captured scenes. Many methods exist, usually with an emphasis either on image quality or rendering speed. In this paper we identify common IBR artifacts and combine the strengths of different algorithms to strike a good balance in the speed/quality tradeoff....
Uploaded on: December 4, 2022 -
July 26, 2023 (v1)Journal article
Radiance Field methods have recently revolutionized novel-view synthesisof scenes captured with multiple photos or videos. However, achieving highvisual quality still requires neural networks that are costly to train and render,while recent faster methods inevitably trade off speed for quality. Forunbounded and complete scenes (rather than...
Uploaded on: December 25, 2023 -
December 2022 (v1)Journal article
View-dependent effects such as reflections pose a substantial challenge for image-based and neural rendering algorithms. Above all, curved reflectors are particularly hard, as they lead to highly non-linear reflection flows as the camera moves. We introduce a new point-based representation to compute Neural Point Catacaustics allowing...
Uploaded on: December 3, 2022 -
April 22, 2024 (v1)Conference paper
Recent work has demonstrated that Generative Adversarial Networks (GANs) can be trained to generate 3D content from2D image collections, by synthesizing features for neural radiance field rendering. However, most such solutions generateradiance, with lighting entangled with materials. This results in unrealistic appearance, since lighting...
Uploaded on: March 9, 2024 -
May 2023 (v1)Journal article
Neural Radiance Fields (NeRFs) have revolutionized novel view synthesis for captured scenes, with recent methods allowing interactive free-viewpoint navigation and fast training for scene reconstruction. However, the implicit representations used by these methods — often including neural networks and complex encodings— make them difficult to...
Uploaded on: March 25, 2023 -
December 2020 (v1)Journal article
Recent rendering advances dramatically reduce the cost of global illumination. But even with hardware acceleration, complex light paths with multiple glossy interactions are still expensive; our new algorithm stores these paths in precomputed light probes and reprojects them at runtime to provide interactivity. Combined with traditional light...
Uploaded on: December 4, 2022