CS-598 AI and Graphics

D.A. Forsyth --- 3310 Siebel Center

Lecture Times Time: MW 11h00-12h15, Location: ONLINE

A closer look at Positional Encoding, NeRF and Tomography

Groups, rules, etc. You can do this in groups of up to five. There will be four such homeworks. Each student should have done: all exercises; at least one challenge; at least one project. Project ideas are ideas - you can do different projects, by discussion with me. You may use code from any source, as long as you acknowledge it. Due date: last day of semester for everything.

Exercise (for everyone)

Investigate the effect of using random Fourier features for image encoding, as in the Tancik et al paper. For at least five images (your choice; be sensible)

Challenge

Produce a reconstruction of the 2D Shepp Logan phantom, at 512 x 512 resolution, from 20 angular projections, as sketched in the Tancik paper. Represent the phantom as an MLP applied to a random Fourier feature embedding. My experience: I've found it hard to get good reconstructions.

Possible project

Make a learned sampler for a NeRF representation