James Tompkin

Assistant Professor

Visual Computing


Follow @brownvc

Brown student researcher?
Group Onboarding Process

Contact



Office hours: Weds 12:00pm noon EST
Book appointment

Brown folks: Save an email,
use GCal 'Find a Time'
Instructions

Center for Information Technology
Room 547
115 Waterman Street
Providence, RI, 02912

James Tompkin

Assistant Professor

Visual Computing


Follow @brownvc

Brown student researcher?
Group Onboarding Process

Contact



Office hours: Weds 12:00pm noon EST
Book appointment

Brown folks: Save an email,
use GCal 'Find a Time'
Instructions

Center for Information Technology
Room 547
115 Waterman Street
Providence, RI, 02912


I am a visual computing researcher—computer vision, computer graphics, and human-computer interaction. My lab develops techniques for camera-captured media to remove barriers from image and video creation, editing, and interaction. This requires image and scene reconstruction techniques, especially from multi-camera systems, and with applications on 2D, multi-view, and VR/AR displays.




ScaNeRF: Scalable Bundle-Adjusting Neural Radiance Fields for Large-Scale Scene Rendering
Xiuchao Wu, Jiamin Xu, Xin Zhang, Hujun Bao, Qixing Huang, Yujun Shen, James Tompkin, Weiwei Xu
ACM Transactions on Graphics (SIGGRAPH Asia), 2023
Semantic Attention Flow Fields
International Conference on Computer Vision (ICCV), 2023
Neural Fields for Structured Lighting
Aarrushi Shandilya, Benjamin Attal, Christian Richardt, James Tompkin, Matthew O'Toole
International Conference on Computer Vision (ICCV), 2023
Are Multi-view Edges Incomplete for Depth Estimation?
International Journal of Computer Vision (IJCV), 2024
On Human-like Biases in CNNs for the Perception of Slant from Texture
Yuanhao Wang, Qian Zhang, Celine Aubuchon, Jovan Kemp, Fulvio Domini, James Tompkin
ACM Transactions on Applied Perception, 2023
Scalable Neural Indoor Scene Rendering
Xiuchao Wu, Jiamin Xu, Zihan Zhu, Hujun Bao, Qixing Huang, James Tompkin, Weiwei Xu
ACM Transactions on Graphics (SIGGRAPH), 2022
Neural Fields in Visual Computing and Beyond
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar
Eurographics State of the Art Report + CVPR Tutorial + SIGGRAPH Course, 2022
FloatingFusion: Depth from ToF and Image-stabilized Stereo Cameras
Andreas Meuleman, Hakyeong Kim, James Tompkin, Min H. Kim
European Conference on Computer Vision (ECCV), 2022
TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis
Benjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim, Christian Richardt, James Tompkin, Matthew O'Toole
Advances in Neural Information Processing Systems (NeurIPS), 2021
Differentiable Diffusion for Dense Depth Estimation from Multi-view Images
Numair Khan, Min H. Kim, James Tompkin
Computer Vision and Pattern Recognition (CVPR), 2021
MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images
European Conference on Computer Vision (ECCV), 2020
Generating Handwriting via Decoupled Style Descriptors
Atsunobu Kotani, Stefanie Tellex, James Tompkin
European Conference on Computer Vision (ECCV), 2020
View-consistent 4D Light Field Superpixel Segmentation
International Conference on Computer Vision (ICCV), 2019
This work also produces an occlusion-aware piecewise planar scene reconstruction as a byproduct!
Joint 5D Pen Input for Light Field Displays
James Tompkin, Samuel Muff, James McCann, Hanspeter Pfister, Jan Kautz, Marc Alexa, Wojciech Matusik
User Interface Software and Technology (UIST), 2015
Also at SIGGRAPH Emerging Technologies 2012: Interactive Light Field Painting
Blind Video Temporal Consistency
Nicolas Bonneel, James Tompkin, Kalyan Sunkavalli, Deqing Sun, Sylvain Paris, Hanspeter Pfister
ACM Transactions on Graphics (SIGGRAPH Asia), 2015
Interactive Intrinsic Video Editing
Nicolas Bonneel, Kalyan Sunkavalli, James Tompkin, Deqing Sun, Sylvain Paris, Hanspeter Pfister
ACM Transactions on Graphics (SIGGRAPH Asia), 2014
Content-adaptive Lenticular Prints
James Tompkin, Simon Heinzle, Jan Kautz, Wojciech Matusik
ACM Transactions on Graphics (SIGGRAPH), 2013
Printing light field displays with varying spatio-angular resolution.
Videoscapes: Exploring Sparse Unstructured Video Collections
James Tompkin, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH), 2012

Removing the Quality Tax in Controllable Face Generation
Yiwen Huang, Zhiqiu Yu, Xinjie Yi, Yue Wang, James Tompkin
Winter Conference on Applications of Computer Vision (WACV) and AI for Content Creation (AI4CC) @ CVPR 2023, 2024
ScaNeRF: Scalable Bundle-Adjusting Neural Radiance Fields for Large-Scale Scene Rendering
Xiuchao Wu, Jiamin Xu, Xin Zhang, Hujun Bao, Qixing Huang, Yujun Shen, James Tompkin, Weiwei Xu
ACM Transactions on Graphics (SIGGRAPH Asia), 2023
Semantic Attention Flow Fields
International Conference on Computer Vision (ICCV), 2023
Neural Fields for Structured Lighting
Aarrushi Shandilya, Benjamin Attal, Christian Richardt, James Tompkin, Matthew O'Toole
International Conference on Computer Vision (ICCV), 2023
Are Multi-view Edges Incomplete for Depth Estimation?
International Journal of Computer Vision (IJCV), 2024
On Human-like Biases in CNNs for the Perception of Slant from Texture
Yuanhao Wang, Qian Zhang, Celine Aubuchon, Jovan Kemp, Fulvio Domini, James Tompkin
ACM Transactions on Applied Perception, 2023
How Can Deep Neural Networks Aid Visualization Perception Research? Three Studies on Correlation Judgments in Scatterplots
Fumeng Yang, Yuxin Ma, Lane Harrison, James Tompkin, David H. Laidlaw
SIGCHI, 2023
Learning Vector Quantized Shape Codes for Amodal Blastomere Instance Segmentation
Won-Dong Jang, Donglai Wei, Xingxuan Zhang, Brian Leahy, Helen Yang, James Tompkin, Dalit Ben-Yosef, Daniel Needleman, Hanspeter Pfister
IEEE International Symposium on Biomedical Imaging (ISBI), 2023
Scalable Neural Indoor Scene Rendering
Xiuchao Wu, Jiamin Xu, Zihan Zhu, Hujun Bao, Qixing Huang, James Tompkin, Weiwei Xu
ACM Transactions on Graphics (SIGGRAPH), 2022
Neural Fields in Visual Computing and Beyond
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar
Eurographics State of the Art Report + CVPR Tutorial + SIGGRAPH Course, 2022
FloatingFusion: Depth from ToF and Image-stabilized Stereo Cameras
Andreas Meuleman, Hakyeong Kim, James Tompkin, Min H. Kim
European Conference on Computer Vision (ECCV), 2022
Differentiable Appearance Acquisition from a Flash/No-flash RGB-D Pair
Hyun Jin Ku, Hyunho Ha, Joo Ho Lee, Dahyun Kang, James Tompkin, Min H. Kim
International Conference on Computational Photography (ICCP), 2022
Dually Noted: Layout-Aware Annotations with Smartphone Augmented Reality
Jing Qian, Qi Sun, Curtis Wigington, Han L. Han, Tong Sun, Jennifer Healey, James Tompkin, Jeff Huang
SIGCHI, 2022
YouMVOS: An Actor-centric Multi-shot Video Object Segmentation Dataset
Donglai Wei, Siddhant Kharbanda, Sarthak Arora, Roshan Roy, Nishant Jain, Akash Palrecha, Tanav Shah, Shray Mathur, Ritik Mathur, Abhijay Kemka, Anirudh Chakravarthy, Zudi Lin, Won-Dong Jang, Yansong Tang, Song Bai, James Tompkin, Philip H.S. Torr, Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2022
Deferred Spatio-temporal Consistency for Dynamic Scene Novel View Synthesis
Beatrix-Emőke Fülöp-Balogh, Eleanor Tursman, James Tompkin, Nicholas Bonneel, Julie Digne
Computers and Graphics, 2022
Learning Physically-based Face Material and Lighting Decomposition
International Conference on Computational Visual Media, 2022
Also appeared at CVPR 2021 Workshop on AI for Content Creation
Visual Cue Effects on a Classification Accuracy Estimation Task in Immersive Scatterplots
Fumeng Yang, James Tompkin, Lane Harrison, David H Laidlaw
Transactions on Visualization and Computer Graphics, 2022
TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis
Benjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim, Christian Richardt, James Tompkin, Matthew O'Toole
Advances in Neural Information Processing Systems (NeurIPS), 2021
Testing using Privileged Information by Adapting Features with Statistical Dependence
Kwang In Kim, James Tompkin
International Conference on Computer Vision (ICCV), 2021
Differentiable Diffusion for Dense Depth Estimation from Multi-view Images
Numair Khan, Min H. Kim, James Tompkin
Computer Vision and Pattern Recognition (CVPR), 2021
GaussiGAN: Controllable Image Synthesis with 3D Gaussians from Unposed Silhouettes
BMVC 2021 and CVPR Workshop on AI for Content Creation, 2021
Improving Remote Environment Visualization through 360 6DoF Multi-sensor Fusion for VR Telerobotics
Austin Sumigray, Eliot Laidlaw, James Tompkin, Stefanie Tellex
Human-Robot Interaction (Late Breaking Report), 2021
Scalable Scalable Vector Graphics: Automatic Translation of Interactive SVGs to a Multithread VDOM for Fast Rendering
Michail Schwab, David Saffo, Nicholas Bond, Shash Sinha, Cody Dunne, Jeff Huang, James Tompkin, Michelle M. Borkin
Transactions on Visualization and Computer Graphics (TVCG), 2021
MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images
European Conference on Computer Vision (ECCV), 2020
Generating Handwriting via Decoupled Style Descriptors
Atsunobu Kotani, Stefanie Tellex, James Tompkin
European Conference on Computer Vision (ECCV), 2020
4D Light Field Depth Estimation
Numair Khan, Min H. Kim, James Tompkin
BMVC, 2021
Fast 4D depth with accurate occlusion edges across two papers:
Edge-aware Bi-directional Diffusion for Dense Depth Estimation from Light Fields
and
View-consistent 4D Light Field Depth Estimation
Shape from Tracing: Towards Reconstructing 3D Object Geometry and SVBRDF Material from Images via Differentiable Path Tracing
International Conference on 3D Vision (3DV), 2020
Capture, Reconstruction, and Representation of the Visual Real World for Virtual Reality
Christian Richardt, James Tompkin, Gordon Wetzstein
Real VR—Immersive Digital Reality, 2020
Generating Object Stamps
CVPR Workshop on AI for Content Creation, 2020
Towards Untrusted Social Video Verification to Combat Deepfakes via Face Geometry Consistency
Eleanor Tursman, Marilyn George, Seny Kamara, James Tompkin
CVPR Workshop on Media Forensics, 2020
VisConnect: Distributed Event Synchronization for Collaborative Visualization
Michail Schwab, David Saffo, Yixuan Zhang, Shash Sinha, Cristina Nita-Rotaru, James Tompkin, Cody Dunne, Michelle A. Borkin
Transactions on Visualization and Computer Graphics (IEEE Visualization), 2020
Channel Embedding for Informative Protein Identification from Highly Multiplexed Images
Salma A. Magid, Won-Dong Jang, Denis Schapiro, Donglai Wei, James Tompkin, Peter Sorger, Hanspeter Pfister
MICCAI, 2020
View-consistent 4D Light Field Superpixel Segmentation
International Conference on Computer Vision (ICCV), 2019
This work also produces an occlusion-aware piecewise planar scene reconstruction as a byproduct!
Portal-ble: Intuitive Free-Hand Manipulation in Unbounded Smartphone-based Augmented Reality
Jing Qian, Jiaju Ma, Xiangyu Li, Benjamin Attal, Haoming Lai, James Tompkin, John Hughes, Jeff Huang
User Interface Software and Technology (UIST), 2019
Real-time Virtual Object Insertion for Moving 360° Videos
Joanna Tarko, James Tompkin, Christian Richardt
VRCAI, 2019
Evaluating Pan and Zoom Timelines and Sliders
Michail Schwab, Sicheng Hao, Olga Vitek, James Tompkin, Jeff Huang, Michelle A. Borkin
SIGCHI, 2019
EasyPZ.js: Interaction Binding for Pan and Zoom Visualizations
Michail Schwab, James Tompkin, Jeff Huang, Michelle A. Borkin
Transactions on Visualization and Computer Graphics (IEEE Visualization short paper), 2019
One-line SVG pan/zoom, plus a pan/zoom injecting bookmark for any SVG!
Communicating and Controlling Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays
Eric Rosen, David Whitney, Elizabeth Phillips, Gary Chien, James Tompkin, George Konidaris, Stefanie Tellex
International Journal of Robotics Research, 2019
Unsupervised Attention-guided Image to Image Translation
Youssef A. Mejjati, Christian Richardt, James Tompkin, Darren Cosker, Kwang In Kim
Neural Information Processing Systems (NeurIPS), 2018
Improving Shape Deformation in Unsupervised Image-to-Image Translation
European Conference on Computer Vision (ECCV), 2018
Evaluating 'Graphical Perception' with CNNs
Daniel Haehn, James Tompkin, Hanspeter Pfister
Transactions on Visualization and Computer Graphics (IEEE Visualization), 2018
Guided Proofreading of Automatic Segmentations for Connectomics
Daniel Haehn, Verena Kaynig, James Tompkin, Jeff W. Lichtman, Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2018
High-order Tensor Regularization with Application to Attribute Ranking
Kwang In Kim, Juhyun Park, James Tompkin
Computer Vision and Pattern Recognition (CVPR), 2018
The Eye of the Typer: A Benchmark and Analysis of Gaze Behavior during Typing
Alexandra Papoutsaki, Aaron Gokaslan, James Tompkin, Yuze He, Jeff Huang
ACM Symposium on Eye Tracking Research and Applications (ETRA), 2018
CriteriaSliders: Learning Continuous Database Criteria via Interactive Ranking
James Tompkin, Kwang In Kim, Hanspeter Pfister, Christian Theobalt
British Machine Vision Conference, 2017
Consistent Video Filtering for Camera Arrays
Nicolas Bonneel, James Tompkin, Deqing Sun, Oliver Wang, Kalyan Sunkavalli, Sylvain Paris, Hanspeter Pfister
Computer Graphics Forum (Eurographics), 2017
We could have called it Blind Video Spatio-Temporal Consistency as it follows up Blind Video Temporal Consistency.
Predictor Combination at Test Time
Kwang In Kim, James Tompkin, Christian Richardt
International Conference on Computer Vision (ICCV), 2017
Piggybacking Robots: Human-Robot Overtrust in University Dormitory Security
Serena Booth, James Tompkin, Krzysztof Gajos, Jim Waldo, Hanspeter Pfister, Radhika Nagpal
Conference on Human-Robot Interaction (HRI), 2017
Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays
Eric Rosen, David Whitney, Elizabeth Phillips, Gary Chien, James Tompkin, George Konidaris, Stefanie Tellex
International Symposium on Robotics Research, 2017
Hierarchical Visual Feature Analysis for City Street View Datasets
Lezhi Li, James Tompkin, Panagiotis Michalatos, Hanspeter Pfister
IEEE Visualization Workshop on Visual Analytics for Deep Learning, 2017
Scalable Interactive Visualization for Connectomics
Daniel Haehn, John Hoffer, Brian Matejek, Adi Suissa-Peleg, Ali K. Al-Awami, Lee Kamentsky, Felix Gonda, Eagon Meng, William Zhang, Richard Schalek, Alyssa Wilson, Toufiq Parag, Johanna Beyer, Verena Kaynig, Thouis R. Jones, James Tompkin, Markus Hadwiger, Jeff W. Lichtman, Hanspeter Pfister
MDPI Informatics—Special Issue on Scalable Interactive Visualization, 2017
booc.io: An Education System with Hierarchical Concept Maps and Dynamic Non-linear Learning Plans
Michail Schwab, Hendrik Strobelt, James Tompkin, Colin Fredericks, Connor Huff, Dana Higgins, Anton Strezhnev, Maya Komisarchik, Gary King, Hanspeter Pfister
Transactions on Visualization and Computer Graphics (IEEE Visualization), 2016
Interactive Multicut Video Segmentation
Evgeny Levinkov, James Tompkin, Nicolas Bonneel, Steffen Kirchhoff, Bjoern Andres, Hanspeter Pfister
Pacific Graphics 2016 (Short Paper), 2016
PDF
Joint 5D Pen Input for Light Field Displays
James Tompkin, Samuel Muff, James McCann, Hanspeter Pfister, Jan Kautz, Marc Alexa, Wojciech Matusik
User Interface Software and Technology (UIST), 2015
Also at SIGGRAPH Emerging Technologies 2012: Interactive Light Field Painting
Generalizing Wave Gestures from Sparse Examples for Real-time Character Control
Helge Rhodin, James Tompkin, Kwang In Kim, Edilson de Aguiar, Hanspeter Pfister, Hans-Peter Seidel, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH Asia), 2015
Builds upon project: Direct Motion Mapping
Blind Video Temporal Consistency
Nicolas Bonneel, James Tompkin, Kalyan Sunkavalli, Deqing Sun, Sylvain Paris, Hanspeter Pfister
ACM Transactions on Graphics (SIGGRAPH Asia), 2015
Computational Design of Metallophone Contact Sounds
Gaurav Bharaj, David I.W. Levin, James Tompkin, Yun Fei, Hanspeter Pfister, Wojciech Matusik, Changxi Zheng
ACM Transactions on Graphics (SIGGRAPH Asia), 2015
Computational Design of Walking Automata
Gaurav Bharaj, Stelian Coros, Bernhard Thomaszewski, James Tompkin, Bernd Bickel, Hanspeter Pfister
ACM Symposium on Computer Animation (SCA), 2015
Semi-supervised Learning with Explicit Relationship Regularization
Kwang In Kim, James Tompkin, Hanspeter Pfister, Christian Theobalt
Computer Vision and Pattern Recognition (CVPR), 2015
Context-guided Diffusion for Label Propagation on Graphs
Kwang In Kim, James Tompkin, Hanspeter Pfister, Christian Theobalt
International Conference on Computer Vision (ICCV), 2015
Local High-order Regularization on Data Manifolds
Kwang In Kim, James Tompkin, Hanspeter Pfister, Christian Theobalt
Computer Vision and Pattern Recognition (CVPR), 2015
Interactive Intrinsic Video Editing
Nicolas Bonneel, Kalyan Sunkavalli, James Tompkin, Deqing Sun, Sylvain Paris, Hanspeter Pfister
ACM Transactions on Graphics (SIGGRAPH Asia), 2014
Efficient Learning of Image Super-resolution and Compression Artifact Removal with Semi-local Gaussian Processes
Younghee Kwon, Kwang In Kim, James Tompkin, Jin Hyung Kim, Christian Theobalt
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2014
Device Effect on Panoramic Video+Context Tasks
Fabrizio Pece, James Tompkin, Hanspeter Pfister, Jan Kautz, Christian Theobalt
European Conference on Visual Media Production (CVMP), 2014
Related project: Vidicontexts
Interactive Motion Mapping for Real-time Character Control
Helge Rhodin, James Tompkin, Kwang In Kim, Kiran Varanasi, Hans-Peter Seidel, Christian Theobalt
Computer Graphics Forum (Eurographics), 2014
Related project: Generalized Wave Gestures
Automatic Noise Modeling for Ghost-free HDR Reconstruction
Miguel Granados, Kwang In Kim, James Tompkin, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH Asia), 2013
Curvature-aware Regularization on Riemannian Submanifolds
Kwang In Kim, James Tompkin, Christian Theobalt
International Conference on Computer Vision (ICCV), 2013
Video Collections in Panoramic Contexts
James Tompkin, Fabrizio Pece, Rajvi Shah, Shahram Izadi, Jan Kautz, Christian Theobalt
User Interface Software and Technology (UIST), 2013
Related study into display device effect: Device Effect on Panoramic Video+Context Tasks
Preference and Artifact Analysis for Video Collections of Places
James Tompkin, Min H. Kim, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Applied Perception (TAP), 2013
Content-adaptive Lenticular Prints
James Tompkin, Simon Heinzle, Jan Kautz, Wojciech Matusik
ACM Transactions on Graphics (SIGGRAPH), 2013
Printing light field displays with varying spatio-angular resolution.
Exploring Sparse Unstructured Video Collections of Places
EngD Thesis @ University College London, 2013
Interactive Viewpoint Video Textures
Philippe Levieux, James Tompkin, Jan Kautz
European Conference on Visual Media Production (CVMP), 2012
Alt title: Light Field Video Textures
Background Inpainting for Videos with Dynamic Objects and a Free-moving Camera
Miguel Granados, Kwang In Kim, James Tompkin, Jan Kautz, Christian Theobalt
European Conference on Computer Vision (ECCV), 2012
Match Graph Construction for Large Image Databases
Kwang In Kim, James Tompkin, Martin Theobald, Jan Kautz, Christian Theobalt
European Conference on Computer Vision (ECCV), 2012
Useful for building correspondence graphs for image matching, e.g., in search or large-scale reconstruction.
Videoscapes: Exploring Sparse Unstructured Video Collections
James Tompkin, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH), 2012
Interactive Light Field Painting
James Tompkin, Samuel Muff, Stanislav Jakuschevskij, Jim McCann, Jan Kautz, Marc Alexa, Wojciech Matusik
SIGGRAPH Emerging Technologies, 2012
Early demo of our later UIST 2015 publication Joint 5D Pen Input for Light Field Displays.
How Not to Be Seen - Object Removal from Videos of Crowded Scenes
Miguel Granados, James Tompkin, Kwang In Kim, Oliver Grau, Jan Kautz, Christian Theobalt
Computer Graphics Forum (Eurographics), 2012
Interactive Multi-perspective Imagery from Photos and Videos
Henrik Lieng, James Tompkin, Jan Kautz
Computer Graphics Forum (Eurographics), 2012
Video-based Characters - Creating New Human Performances from a Multi-view Video Database
Feng Xu, Yebin Liu, Carsten Stoll, James Tompkin, Gaurav Bharaj, Qionghai Dai, Hans-Peter Seidel, Jan Kautz, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH), 2011
Towards Moment Images: Automatic Cinemagraphs
James Tompkin, Fabrizio Pece, Kartic Subr, Jan Kautz
European Conference on Visual Media Production (CVMP), 2011
Novel P300 BCI Interfaces to Directly Select Physical and Virtual Objects
Beste F. Yuksel, Michael Donnerer, James Tompkin, Anthony Steed
International Brain-Computer Interface Conference (BCI), 2011
PDF
A Novel Brain-computer Interface using a Multi-touch Surface
Beste F. Yuksel, Michael Donnerer, James Tompkin, Anthony Steed
ACM Transactions on Computer-Human Interaction (SIGCHI), 2010
DIY Design Process for Interactive Surfaces
Jennifer G. Sheridan, James Tompkin, Abel Maciel, George Roussos
British HCI Group Annual Conference on People and Computers (BCS-HCI), 2009
Webpage contains many projects and events! Schematics and WebGL model viewer!
Venues: A Networked Visual Instrument
MSci Dissertation @ King's College, London, 2006
PDF

ScaNeRF: Scalable Bundle-Adjusting Neural Radiance Fields for Large-Scale Scene Rendering
Xiuchao Wu, Jiamin Xu, Xin Zhang, Hujun Bao, Qixing Huang, Yujun Shen, James Tompkin, Weiwei Xu
ACM Transactions on Graphics (SIGGRAPH Asia), 2023
Semantic Attention Flow Fields
International Conference on Computer Vision (ICCV), 2023
Neural Fields for Structured Lighting
Aarrushi Shandilya, Benjamin Attal, Christian Richardt, James Tompkin, Matthew O'Toole
International Conference on Computer Vision (ICCV), 2023
Are Multi-view Edges Incomplete for Depth Estimation?
International Journal of Computer Vision (IJCV), 2024
Scalable Neural Indoor Scene Rendering
Xiuchao Wu, Jiamin Xu, Zihan Zhu, Hujun Bao, Qixing Huang, James Tompkin, Weiwei Xu
ACM Transactions on Graphics (SIGGRAPH), 2022
Neural Fields in Visual Computing and Beyond
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar
Eurographics State of the Art Report + CVPR Tutorial + SIGGRAPH Course, 2022
FloatingFusion: Depth from ToF and Image-stabilized Stereo Cameras
Andreas Meuleman, Hakyeong Kim, James Tompkin, Min H. Kim
European Conference on Computer Vision (ECCV), 2022
Differentiable Appearance Acquisition from a Flash/No-flash RGB-D Pair
Hyun Jin Ku, Hyunho Ha, Joo Ho Lee, Dahyun Kang, James Tompkin, Min H. Kim
International Conference on Computational Photography (ICCP), 2022
Deferred Spatio-temporal Consistency for Dynamic Scene Novel View Synthesis
Beatrix-Emőke Fülöp-Balogh, Eleanor Tursman, James Tompkin, Nicholas Bonneel, Julie Digne
Computers and Graphics, 2022
Learning Physically-based Face Material and Lighting Decomposition
International Conference on Computational Visual Media, 2022
Also appeared at CVPR 2021 Workshop on AI for Content Creation
TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis
Benjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim, Christian Richardt, James Tompkin, Matthew O'Toole
Advances in Neural Information Processing Systems (NeurIPS), 2021
Differentiable Diffusion for Dense Depth Estimation from Multi-view Images
Numair Khan, Min H. Kim, James Tompkin
Computer Vision and Pattern Recognition (CVPR), 2021
Improving Remote Environment Visualization through 360 6DoF Multi-sensor Fusion for VR Telerobotics
Austin Sumigray, Eliot Laidlaw, James Tompkin, Stefanie Tellex
Human-Robot Interaction (Late Breaking Report), 2021
MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images
European Conference on Computer Vision (ECCV), 2020
4D Light Field Depth Estimation
Numair Khan, Min H. Kim, James Tompkin
BMVC, 2021
Fast 4D depth with accurate occlusion edges across two papers:
Edge-aware Bi-directional Diffusion for Dense Depth Estimation from Light Fields
and
View-consistent 4D Light Field Depth Estimation
Shape from Tracing: Towards Reconstructing 3D Object Geometry and SVBRDF Material from Images via Differentiable Path Tracing
International Conference on 3D Vision (3DV), 2020
Capture, Reconstruction, and Representation of the Visual Real World for Virtual Reality
Christian Richardt, James Tompkin, Gordon Wetzstein
Real VR—Immersive Digital Reality, 2020
View-consistent 4D Light Field Superpixel Segmentation
International Conference on Computer Vision (ICCV), 2019
This work also produces an occlusion-aware piecewise planar scene reconstruction as a byproduct!
Real-time Virtual Object Insertion for Moving 360° Videos
Joanna Tarko, James Tompkin, Christian Richardt
VRCAI, 2019
Automatic Noise Modeling for Ghost-free HDR Reconstruction
Miguel Granados, Kwang In Kim, James Tompkin, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH Asia), 2013
Preference and Artifact Analysis for Video Collections of Places
James Tompkin, Min H. Kim, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Applied Perception (TAP), 2013
Exploring Sparse Unstructured Video Collections of Places
EngD Thesis @ University College London, 2013
Background Inpainting for Videos with Dynamic Objects and a Free-moving Camera
Miguel Granados, Kwang In Kim, James Tompkin, Jan Kautz, Christian Theobalt
European Conference on Computer Vision (ECCV), 2012
Match Graph Construction for Large Image Databases
Kwang In Kim, James Tompkin, Martin Theobald, Jan Kautz, Christian Theobalt
European Conference on Computer Vision (ECCV), 2012
Useful for building correspondence graphs for image matching, e.g., in search or large-scale reconstruction.
Videoscapes: Exploring Sparse Unstructured Video Collections
James Tompkin, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH), 2012
Video-based Characters - Creating New Human Performances from a Multi-view Video Database
Feng Xu, Yebin Liu, Carsten Stoll, James Tompkin, Gaurav Bharaj, Qionghai Dai, Hans-Peter Seidel, Jan Kautz, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH), 2011

Removing the Quality Tax in Controllable Face Generation
Yiwen Huang, Zhiqiu Yu, Xinjie Yi, Yue Wang, James Tompkin
Winter Conference on Applications of Computer Vision (WACV) and AI for Content Creation (AI4CC) @ CVPR 2023, 2024
YouMVOS: An Actor-centric Multi-shot Video Object Segmentation Dataset
Donglai Wei, Siddhant Kharbanda, Sarthak Arora, Roshan Roy, Nishant Jain, Akash Palrecha, Tanav Shah, Shray Mathur, Ritik Mathur, Abhijay Kemka, Anirudh Chakravarthy, Zudi Lin, Won-Dong Jang, Yansong Tang, Song Bai, James Tompkin, Philip H.S. Torr, Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2022
Learning Physically-based Face Material and Lighting Decomposition
International Conference on Computational Visual Media, 2022
Also appeared at CVPR 2021 Workshop on AI for Content Creation
GaussiGAN: Controllable Image Synthesis with 3D Gaussians from Unposed Silhouettes
BMVC 2021 and CVPR Workshop on AI for Content Creation, 2021
Generating Handwriting via Decoupled Style Descriptors
Atsunobu Kotani, Stefanie Tellex, James Tompkin
European Conference on Computer Vision (ECCV), 2020
Generating Object Stamps
CVPR Workshop on AI for Content Creation, 2020
Real-time Virtual Object Insertion for Moving 360° Videos
Joanna Tarko, James Tompkin, Christian Richardt
VRCAI, 2019
Unsupervised Attention-guided Image to Image Translation
Youssef A. Mejjati, Christian Richardt, James Tompkin, Darren Cosker, Kwang In Kim
Neural Information Processing Systems (NeurIPS), 2018
Improving Shape Deformation in Unsupervised Image-to-Image Translation
European Conference on Computer Vision (ECCV), 2018
Consistent Video Filtering for Camera Arrays
Nicolas Bonneel, James Tompkin, Deqing Sun, Oliver Wang, Kalyan Sunkavalli, Sylvain Paris, Hanspeter Pfister
Computer Graphics Forum (Eurographics), 2017
We could have called it Blind Video Spatio-Temporal Consistency as it follows up Blind Video Temporal Consistency.
Interactive Multicut Video Segmentation
Evgeny Levinkov, James Tompkin, Nicolas Bonneel, Steffen Kirchhoff, Bjoern Andres, Hanspeter Pfister
Pacific Graphics 2016 (Short Paper), 2016
PDF
Joint 5D Pen Input for Light Field Displays
James Tompkin, Samuel Muff, James McCann, Hanspeter Pfister, Jan Kautz, Marc Alexa, Wojciech Matusik
User Interface Software and Technology (UIST), 2015
Also at SIGGRAPH Emerging Technologies 2012: Interactive Light Field Painting
Blind Video Temporal Consistency
Nicolas Bonneel, James Tompkin, Kalyan Sunkavalli, Deqing Sun, Sylvain Paris, Hanspeter Pfister
ACM Transactions on Graphics (SIGGRAPH Asia), 2015
Interactive Intrinsic Video Editing
Nicolas Bonneel, Kalyan Sunkavalli, James Tompkin, Deqing Sun, Sylvain Paris, Hanspeter Pfister
ACM Transactions on Graphics (SIGGRAPH Asia), 2014
Efficient Learning of Image Super-resolution and Compression Artifact Removal with Semi-local Gaussian Processes
Younghee Kwon, Kwang In Kim, James Tompkin, Jin Hyung Kim, Christian Theobalt
Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2014
Background Inpainting for Videos with Dynamic Objects and a Free-moving Camera
Miguel Granados, Kwang In Kim, James Tompkin, Jan Kautz, Christian Theobalt
European Conference on Computer Vision (ECCV), 2012
Interactive Light Field Painting
James Tompkin, Samuel Muff, Stanislav Jakuschevskij, Jim McCann, Jan Kautz, Marc Alexa, Wojciech Matusik
SIGGRAPH Emerging Technologies, 2012
Early demo of our later UIST 2015 publication Joint 5D Pen Input for Light Field Displays.
How Not to Be Seen - Object Removal from Videos of Crowded Scenes
Miguel Granados, James Tompkin, Kwang In Kim, Oliver Grau, Jan Kautz, Christian Theobalt
Computer Graphics Forum (Eurographics), 2012
Interactive Multi-perspective Imagery from Photos and Videos
Henrik Lieng, James Tompkin, Jan Kautz
Computer Graphics Forum (Eurographics), 2012
Towards Moment Images: Automatic Cinemagraphs
James Tompkin, Fabrizio Pece, Kartic Subr, Jan Kautz
European Conference on Visual Media Production (CVMP), 2011

Scalable Neural Indoor Scene Rendering
Xiuchao Wu, Jiamin Xu, Zihan Zhu, Hujun Bao, Qixing Huang, James Tompkin, Weiwei Xu
ACM Transactions on Graphics (SIGGRAPH), 2022
Neural Fields in Visual Computing and Beyond
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar
Eurographics State of the Art Report + CVPR Tutorial + SIGGRAPH Course, 2022
FloatingFusion: Depth from ToF and Image-stabilized Stereo Cameras
Andreas Meuleman, Hakyeong Kim, James Tompkin, Min H. Kim
European Conference on Computer Vision (ECCV), 2022
Differentiable Appearance Acquisition from a Flash/No-flash RGB-D Pair
Hyun Jin Ku, Hyunho Ha, Joo Ho Lee, Dahyun Kang, James Tompkin, Min H. Kim
International Conference on Computational Photography (ICCP), 2022
Deferred Spatio-temporal Consistency for Dynamic Scene Novel View Synthesis
Beatrix-Emőke Fülöp-Balogh, Eleanor Tursman, James Tompkin, Nicholas Bonneel, Julie Digne
Computers and Graphics, 2022
TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis
Benjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim, Christian Richardt, James Tompkin, Matthew O'Toole
Advances in Neural Information Processing Systems (NeurIPS), 2021
Differentiable Diffusion for Dense Depth Estimation from Multi-view Images
Numair Khan, Min H. Kim, James Tompkin
Computer Vision and Pattern Recognition (CVPR), 2021
MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images
European Conference on Computer Vision (ECCV), 2020
4D Light Field Depth Estimation
Numair Khan, Min H. Kim, James Tompkin
BMVC, 2021
Fast 4D depth with accurate occlusion edges across two papers:
Edge-aware Bi-directional Diffusion for Dense Depth Estimation from Light Fields
and
View-consistent 4D Light Field Depth Estimation
Shape from Tracing: Towards Reconstructing 3D Object Geometry and SVBRDF Material from Images via Differentiable Path Tracing
International Conference on 3D Vision (3DV), 2020
Towards Untrusted Social Video Verification to Combat Deepfakes via Face Geometry Consistency
Eleanor Tursman, Marilyn George, Seny Kamara, James Tompkin
CVPR Workshop on Media Forensics, 2020
View-consistent 4D Light Field Superpixel Segmentation
International Conference on Computer Vision (ICCV), 2019
This work also produces an occlusion-aware piecewise planar scene reconstruction as a byproduct!
Consistent Video Filtering for Camera Arrays
Nicolas Bonneel, James Tompkin, Deqing Sun, Oliver Wang, Kalyan Sunkavalli, Sylvain Paris, Hanspeter Pfister
Computer Graphics Forum (Eurographics), 2017
We could have called it Blind Video Spatio-Temporal Consistency as it follows up Blind Video Temporal Consistency.
Joint 5D Pen Input for Light Field Displays
James Tompkin, Samuel Muff, James McCann, Hanspeter Pfister, Jan Kautz, Marc Alexa, Wojciech Matusik
User Interface Software and Technology (UIST), 2015
Also at SIGGRAPH Emerging Technologies 2012: Interactive Light Field Painting
Content-adaptive Lenticular Prints
James Tompkin, Simon Heinzle, Jan Kautz, Wojciech Matusik
ACM Transactions on Graphics (SIGGRAPH), 2013
Printing light field displays with varying spatio-angular resolution.
Interactive Viewpoint Video Textures
Philippe Levieux, James Tompkin, Jan Kautz
European Conference on Visual Media Production (CVMP), 2012
Alt title: Light Field Video Textures
Interactive Light Field Painting
James Tompkin, Samuel Muff, Stanislav Jakuschevskij, Jim McCann, Jan Kautz, Marc Alexa, Wojciech Matusik
SIGGRAPH Emerging Technologies, 2012
Early demo of our later UIST 2015 publication Joint 5D Pen Input for Light Field Displays.
Interactive Multi-perspective Imagery from Photos and Videos
Henrik Lieng, James Tompkin, Jan Kautz
Computer Graphics Forum (Eurographics), 2012
Video-based Characters - Creating New Human Performances from a Multi-view Video Database
Feng Xu, Yebin Liu, Carsten Stoll, James Tompkin, Gaurav Bharaj, Qionghai Dai, Hans-Peter Seidel, Jan Kautz, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH), 2011

Removing the Quality Tax in Controllable Face Generation
Yiwen Huang, Zhiqiu Yu, Xinjie Yi, Yue Wang, James Tompkin
Winter Conference on Applications of Computer Vision (WACV) and AI for Content Creation (AI4CC) @ CVPR 2023, 2024
Scalable Neural Indoor Scene Rendering
Xiuchao Wu, Jiamin Xu, Zihan Zhu, Hujun Bao, Qixing Huang, James Tompkin, Weiwei Xu
ACM Transactions on Graphics (SIGGRAPH), 2022
Dually Noted: Layout-Aware Annotations with Smartphone Augmented Reality
Jing Qian, Qi Sun, Curtis Wigington, Han L. Han, Tong Sun, Jennifer Healey, James Tompkin, Jeff Huang
SIGCHI, 2022
YouMVOS: An Actor-centric Multi-shot Video Object Segmentation Dataset
Donglai Wei, Siddhant Kharbanda, Sarthak Arora, Roshan Roy, Nishant Jain, Akash Palrecha, Tanav Shah, Shray Mathur, Ritik Mathur, Abhijay Kemka, Anirudh Chakravarthy, Zudi Lin, Won-Dong Jang, Yansong Tang, Song Bai, James Tompkin, Philip H.S. Torr, Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2022
GaussiGAN: Controllable Image Synthesis with 3D Gaussians from Unposed Silhouettes
BMVC 2021 and CVPR Workshop on AI for Content Creation, 2021
Improving Remote Environment Visualization through 360 6DoF Multi-sensor Fusion for VR Telerobotics
Austin Sumigray, Eliot Laidlaw, James Tompkin, Stefanie Tellex
Human-Robot Interaction (Late Breaking Report), 2021
Scalable Scalable Vector Graphics: Automatic Translation of Interactive SVGs to a Multithread VDOM for Fast Rendering
Michail Schwab, David Saffo, Nicholas Bond, Shash Sinha, Cody Dunne, Jeff Huang, James Tompkin, Michelle M. Borkin
Transactions on Visualization and Computer Graphics (TVCG), 2021
MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images
European Conference on Computer Vision (ECCV), 2020
Portal-ble: Intuitive Free-Hand Manipulation in Unbounded Smartphone-based Augmented Reality
Jing Qian, Jiaju Ma, Xiangyu Li, Benjamin Attal, Haoming Lai, James Tompkin, John Hughes, Jeff Huang
User Interface Software and Technology (UIST), 2019
Guided Proofreading of Automatic Segmentations for Connectomics
Daniel Haehn, Verena Kaynig, James Tompkin, Jeff W. Lichtman, Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2018
The Eye of the Typer: A Benchmark and Analysis of Gaze Behavior during Typing
Alexandra Papoutsaki, Aaron Gokaslan, James Tompkin, Yuze He, Jeff Huang
ACM Symposium on Eye Tracking Research and Applications (ETRA), 2018
CriteriaSliders: Learning Continuous Database Criteria via Interactive Ranking
James Tompkin, Kwang In Kim, Hanspeter Pfister, Christian Theobalt
British Machine Vision Conference, 2017
Joint 5D Pen Input for Light Field Displays
James Tompkin, Samuel Muff, James McCann, Hanspeter Pfister, Jan Kautz, Marc Alexa, Wojciech Matusik
User Interface Software and Technology (UIST), 2015
Also at SIGGRAPH Emerging Technologies 2012: Interactive Light Field Painting
Generalizing Wave Gestures from Sparse Examples for Real-time Character Control
Helge Rhodin, James Tompkin, Kwang In Kim, Edilson de Aguiar, Hanspeter Pfister, Hans-Peter Seidel, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH Asia), 2015
Builds upon project: Direct Motion Mapping
Video Collections in Panoramic Contexts
James Tompkin, Fabrizio Pece, Rajvi Shah, Shahram Izadi, Jan Kautz, Christian Theobalt
User Interface Software and Technology (UIST), 2013
Related study into display device effect: Device Effect on Panoramic Video+Context Tasks
Interactive Viewpoint Video Textures
Philippe Levieux, James Tompkin, Jan Kautz
European Conference on Visual Media Production (CVMP), 2012
Alt title: Light Field Video Textures
Interactive Multi-perspective Imagery from Photos and Videos
Henrik Lieng, James Tompkin, Jan Kautz
Computer Graphics Forum (Eurographics), 2012
Towards Moment Images: Automatic Cinemagraphs
James Tompkin, Fabrizio Pece, Kartic Subr, Jan Kautz
European Conference on Visual Media Production (CVMP), 2011
DIY Design Process for Interactive Surfaces
Jennifer G. Sheridan, James Tompkin, Abel Maciel, George Roussos
British HCI Group Annual Conference on People and Computers (BCS-HCI), 2009
Webpage contains many projects and events! Schematics and WebGL model viewer!
Venues: A Networked Visual Instrument
MSci Dissertation @ King's College, London, 2006
PDF

ScaNeRF: Scalable Bundle-Adjusting Neural Radiance Fields for Large-Scale Scene Rendering
Xiuchao Wu, Jiamin Xu, Xin Zhang, Hujun Bao, Qixing Huang, Yujun Shen, James Tompkin, Weiwei Xu
ACM Transactions on Graphics (SIGGRAPH Asia), 2023
Semantic Attention Flow Fields
International Conference on Computer Vision (ICCV), 2023
Neural Fields for Structured Lighting
Aarrushi Shandilya, Benjamin Attal, Christian Richardt, James Tompkin, Matthew O'Toole
International Conference on Computer Vision (ICCV), 2023
Scalable Neural Indoor Scene Rendering
Xiuchao Wu, Jiamin Xu, Zihan Zhu, Hujun Bao, Qixing Huang, James Tompkin, Weiwei Xu
ACM Transactions on Graphics (SIGGRAPH), 2022
Neural Fields in Visual Computing and Beyond
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar
Eurographics State of the Art Report + CVPR Tutorial + SIGGRAPH Course, 2022
Deferred Spatio-temporal Consistency for Dynamic Scene Novel View Synthesis
Beatrix-Emőke Fülöp-Balogh, Eleanor Tursman, James Tompkin, Nicholas Bonneel, Julie Digne
Computers and Graphics, 2022
TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis
Benjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim, Christian Richardt, James Tompkin, Matthew O'Toole
Advances in Neural Information Processing Systems (NeurIPS), 2021
Improving Remote Environment Visualization through 360 6DoF Multi-sensor Fusion for VR Telerobotics
Austin Sumigray, Eliot Laidlaw, James Tompkin, Stefanie Tellex
Human-Robot Interaction (Late Breaking Report), 2021
MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images
European Conference on Computer Vision (ECCV), 2020
Preference and Artifact Analysis for Video Collections of Places
James Tompkin, Min H. Kim, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Applied Perception (TAP), 2013
Exploring Sparse Unstructured Video Collections of Places
EngD Thesis @ University College London, 2013
Interactive Viewpoint Video Textures
Philippe Levieux, James Tompkin, Jan Kautz
European Conference on Visual Media Production (CVMP), 2012
Alt title: Light Field Video Textures
Videoscapes: Exploring Sparse Unstructured Video Collections
James Tompkin, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH), 2012
Video-based Characters - Creating New Human Performances from a Multi-view Video Database
Feng Xu, Yebin Liu, Carsten Stoll, James Tompkin, Gaurav Bharaj, Qionghai Dai, Hans-Peter Seidel, Jan Kautz, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH), 2011

Differentiable Diffusion for Dense Depth Estimation from Multi-view Images
Numair Khan, Min H. Kim, James Tompkin
Computer Vision and Pattern Recognition (CVPR), 2021
4D Light Field Depth Estimation
Numair Khan, Min H. Kim, James Tompkin
BMVC, 2021
Fast 4D depth with accurate occlusion edges across two papers:
Edge-aware Bi-directional Diffusion for Dense Depth Estimation from Light Fields
and
View-consistent 4D Light Field Depth Estimation
View-consistent 4D Light Field Superpixel Segmentation
International Conference on Computer Vision (ICCV), 2019
This work also produces an occlusion-aware piecewise planar scene reconstruction as a byproduct!
Joint 5D Pen Input for Light Field Displays
James Tompkin, Samuel Muff, James McCann, Hanspeter Pfister, Jan Kautz, Marc Alexa, Wojciech Matusik
User Interface Software and Technology (UIST), 2015
Also at SIGGRAPH Emerging Technologies 2012: Interactive Light Field Painting
Content-adaptive Lenticular Prints
James Tompkin, Simon Heinzle, Jan Kautz, Wojciech Matusik
ACM Transactions on Graphics (SIGGRAPH), 2013
Printing light field displays with varying spatio-angular resolution.
Interactive Viewpoint Video Textures
Philippe Levieux, James Tompkin, Jan Kautz
European Conference on Visual Media Production (CVMP), 2012
Alt title: Light Field Video Textures
Interactive Light Field Painting
James Tompkin, Samuel Muff, Stanislav Jakuschevskij, Jim McCann, Jan Kautz, Marc Alexa, Wojciech Matusik
SIGGRAPH Emerging Technologies, 2012
Early demo of our later UIST 2015 publication Joint 5D Pen Input for Light Field Displays.

Dually Noted: Layout-Aware Annotations with Smartphone Augmented Reality
Jing Qian, Qi Sun, Curtis Wigington, Han L. Han, Tong Sun, Jennifer Healey, James Tompkin, Jeff Huang
SIGCHI, 2022
Visual Cue Effects on a Classification Accuracy Estimation Task in Immersive Scatterplots
Fumeng Yang, James Tompkin, Lane Harrison, David H Laidlaw
Transactions on Visualization and Computer Graphics, 2022
MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images
European Conference on Computer Vision (ECCV), 2020
Capture, Reconstruction, and Representation of the Visual Real World for Virtual Reality
Christian Richardt, James Tompkin, Gordon Wetzstein
Real VR—Immersive Digital Reality, 2020
Portal-ble: Intuitive Free-Hand Manipulation in Unbounded Smartphone-based Augmented Reality
Jing Qian, Jiaju Ma, Xiangyu Li, Benjamin Attal, Haoming Lai, James Tompkin, John Hughes, Jeff Huang
User Interface Software and Technology (UIST), 2019
Real-time Virtual Object Insertion for Moving 360° Videos
Joanna Tarko, James Tompkin, Christian Richardt
VRCAI, 2019
Communicating and Controlling Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays
Eric Rosen, David Whitney, Elizabeth Phillips, Gary Chien, James Tompkin, George Konidaris, Stefanie Tellex
International Journal of Robotics Research, 2019
Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays
Eric Rosen, David Whitney, Elizabeth Phillips, Gary Chien, James Tompkin, George Konidaris, Stefanie Tellex
International Symposium on Robotics Research, 2017
Device Effect on Panoramic Video+Context Tasks
Fabrizio Pece, James Tompkin, Hanspeter Pfister, Jan Kautz, Christian Theobalt
European Conference on Visual Media Production (CVMP), 2014
Related project: Vidicontexts
Video Collections in Panoramic Contexts
James Tompkin, Fabrizio Pece, Rajvi Shah, Shahram Izadi, Jan Kautz, Christian Theobalt
User Interface Software and Technology (UIST), 2013
Related study into display device effect: Device Effect on Panoramic Video+Context Tasks

MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images
European Conference on Computer Vision (ECCV), 2020
Real-time Virtual Object Insertion for Moving 360° Videos
Joanna Tarko, James Tompkin, Christian Richardt
VRCAI, 2019
Device Effect on Panoramic Video+Context Tasks
Fabrizio Pece, James Tompkin, Hanspeter Pfister, Jan Kautz, Christian Theobalt
European Conference on Visual Media Production (CVMP), 2014
Related project: Vidicontexts
Video Collections in Panoramic Contexts
James Tompkin, Fabrizio Pece, Rajvi Shah, Shahram Izadi, Jan Kautz, Christian Theobalt
User Interface Software and Technology (UIST), 2013
Related study into display device effect: Device Effect on Panoramic Video+Context Tasks

Removing the Quality Tax in Controllable Face Generation
Yiwen Huang, Zhiqiu Yu, Xinjie Yi, Yue Wang, James Tompkin
Winter Conference on Applications of Computer Vision (WACV) and AI for Content Creation (AI4CC) @ CVPR 2023, 2024
Neural Fields in Visual Computing and Beyond
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar
Eurographics State of the Art Report + CVPR Tutorial + SIGGRAPH Course, 2022
GaussiGAN: Controllable Image Synthesis with 3D Gaussians from Unposed Silhouettes
BMVC 2021 and CVPR Workshop on AI for Content Creation, 2021
Generating Handwriting via Decoupled Style Descriptors
Atsunobu Kotani, Stefanie Tellex, James Tompkin
European Conference on Computer Vision (ECCV), 2020
Generating Object Stamps
CVPR Workshop on AI for Content Creation, 2020
Unsupervised Attention-guided Image to Image Translation
Youssef A. Mejjati, Christian Richardt, James Tompkin, Darren Cosker, Kwang In Kim
Neural Information Processing Systems (NeurIPS), 2018
Improving Shape Deformation in Unsupervised Image-to-Image Translation
European Conference on Computer Vision (ECCV), 2018

How Can Deep Neural Networks Aid Visualization Perception Research? Three Studies on Correlation Judgments in Scatterplots
Fumeng Yang, Yuxin Ma, Lane Harrison, James Tompkin, David H. Laidlaw
SIGCHI, 2023
Visual Cue Effects on a Classification Accuracy Estimation Task in Immersive Scatterplots
Fumeng Yang, James Tompkin, Lane Harrison, David H Laidlaw
Transactions on Visualization and Computer Graphics, 2022
Scalable Scalable Vector Graphics: Automatic Translation of Interactive SVGs to a Multithread VDOM for Fast Rendering
Michail Schwab, David Saffo, Nicholas Bond, Shash Sinha, Cody Dunne, Jeff Huang, James Tompkin, Michelle M. Borkin
Transactions on Visualization and Computer Graphics (TVCG), 2021
VisConnect: Distributed Event Synchronization for Collaborative Visualization
Michail Schwab, David Saffo, Yixuan Zhang, Shash Sinha, Cristina Nita-Rotaru, James Tompkin, Cody Dunne, Michelle A. Borkin
Transactions on Visualization and Computer Graphics (IEEE Visualization), 2020
EasyPZ.js: Interaction Binding for Pan and Zoom Visualizations
Michail Schwab, James Tompkin, Jeff Huang, Michelle A. Borkin
Transactions on Visualization and Computer Graphics (IEEE Visualization short paper), 2019
One-line SVG pan/zoom, plus a pan/zoom injecting bookmark for any SVG!
Communicating and Controlling Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays
Eric Rosen, David Whitney, Elizabeth Phillips, Gary Chien, James Tompkin, George Konidaris, Stefanie Tellex
International Journal of Robotics Research, 2019
Evaluating 'Graphical Perception' with CNNs
Daniel Haehn, James Tompkin, Hanspeter Pfister
Transactions on Visualization and Computer Graphics (IEEE Visualization), 2018
Hierarchical Visual Feature Analysis for City Street View Datasets
Lezhi Li, James Tompkin, Panagiotis Michalatos, Hanspeter Pfister
IEEE Visualization Workshop on Visual Analytics for Deep Learning, 2017
Scalable Interactive Visualization for Connectomics
Daniel Haehn, John Hoffer, Brian Matejek, Adi Suissa-Peleg, Ali K. Al-Awami, Lee Kamentsky, Felix Gonda, Eagon Meng, William Zhang, Richard Schalek, Alyssa Wilson, Toufiq Parag, Johanna Beyer, Verena Kaynig, Thouis R. Jones, James Tompkin, Markus Hadwiger, Jeff W. Lichtman, Hanspeter Pfister
MDPI Informatics—Special Issue on Scalable Interactive Visualization, 2017
booc.io: An Education System with Hierarchical Concept Maps and Dynamic Non-linear Learning Plans
Michail Schwab, Hendrik Strobelt, James Tompkin, Colin Fredericks, Connor Huff, Dana Higgins, Anton Strezhnev, Maya Komisarchik, Gary King, Hanspeter Pfister
Transactions on Visualization and Computer Graphics (IEEE Visualization), 2016

On Human-like Biases in CNNs for the Perception of Slant from Texture
Yuanhao Wang, Qian Zhang, Celine Aubuchon, Jovan Kemp, Fulvio Domini, James Tompkin
ACM Transactions on Applied Perception, 2023
How Can Deep Neural Networks Aid Visualization Perception Research? Three Studies on Correlation Judgments in Scatterplots
Fumeng Yang, Yuxin Ma, Lane Harrison, James Tompkin, David H. Laidlaw
SIGCHI, 2023
Visual Cue Effects on a Classification Accuracy Estimation Task in Immersive Scatterplots
Fumeng Yang, James Tompkin, Lane Harrison, David H Laidlaw
Transactions on Visualization and Computer Graphics, 2022
Evaluating 'Graphical Perception' with CNNs
Daniel Haehn, James Tompkin, Hanspeter Pfister
Transactions on Visualization and Computer Graphics (IEEE Visualization), 2018
Preference and Artifact Analysis for Video Collections of Places
James Tompkin, Min H. Kim, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Applied Perception (TAP), 2013
Exploring Sparse Unstructured Video Collections of Places
EngD Thesis @ University College London, 2013

How Can Deep Neural Networks Aid Visualization Perception Research? Three Studies on Correlation Judgments in Scatterplots
Fumeng Yang, Yuxin Ma, Lane Harrison, James Tompkin, David H. Laidlaw
SIGCHI, 2023
Learning Vector Quantized Shape Codes for Amodal Blastomere Instance Segmentation
Won-Dong Jang, Donglai Wei, Xingxuan Zhang, Brian Leahy, Helen Yang, James Tompkin, Dalit Ben-Yosef, Daniel Needleman, Hanspeter Pfister
IEEE International Symposium on Biomedical Imaging (ISBI), 2023
YouMVOS: An Actor-centric Multi-shot Video Object Segmentation Dataset
Donglai Wei, Siddhant Kharbanda, Sarthak Arora, Roshan Roy, Nishant Jain, Akash Palrecha, Tanav Shah, Shray Mathur, Ritik Mathur, Abhijay Kemka, Anirudh Chakravarthy, Zudi Lin, Won-Dong Jang, Yansong Tang, Song Bai, James Tompkin, Philip H.S. Torr, Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2022
Towards Untrusted Social Video Verification to Combat Deepfakes via Face Geometry Consistency
Eleanor Tursman, Marilyn George, Seny Kamara, James Tompkin
CVPR Workshop on Media Forensics, 2020
Channel Embedding for Informative Protein Identification from Highly Multiplexed Images
Salma A. Magid, Won-Dong Jang, Denis Schapiro, Donglai Wei, James Tompkin, Peter Sorger, Hanspeter Pfister
MICCAI, 2020
Evaluating 'Graphical Perception' with CNNs
Daniel Haehn, James Tompkin, Hanspeter Pfister
Transactions on Visualization and Computer Graphics (IEEE Visualization), 2018
Guided Proofreading of Automatic Segmentations for Connectomics
Daniel Haehn, Verena Kaynig, James Tompkin, Jeff W. Lichtman, Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2018

Computational Design of Metallophone Contact Sounds
Gaurav Bharaj, David I.W. Levin, James Tompkin, Yun Fei, Hanspeter Pfister, Wojciech Matusik, Changxi Zheng
ACM Transactions on Graphics (SIGGRAPH Asia), 2015
Computational Design of Walking Automata
Gaurav Bharaj, Stelian Coros, Bernhard Thomaszewski, James Tompkin, Bernd Bickel, Hanspeter Pfister
ACM Symposium on Computer Animation (SCA), 2015
Content-adaptive Lenticular Prints
James Tompkin, Simon Heinzle, Jan Kautz, Wojciech Matusik
ACM Transactions on Graphics (SIGGRAPH), 2013
Printing light field displays with varying spatio-angular resolution.

Generalizing Wave Gestures from Sparse Examples for Real-time Character Control
Helge Rhodin, James Tompkin, Kwang In Kim, Edilson de Aguiar, Hanspeter Pfister, Hans-Peter Seidel, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH Asia), 2015
Builds upon project: Direct Motion Mapping
Interactive Motion Mapping for Real-time Character Control
Helge Rhodin, James Tompkin, Kwang In Kim, Kiran Varanasi, Hans-Peter Seidel, Christian Theobalt
Computer Graphics Forum (Eurographics), 2014
Related project: Generalized Wave Gestures

Dually Noted: Layout-Aware Annotations with Smartphone Augmented Reality
Jing Qian, Qi Sun, Curtis Wigington, Han L. Han, Tong Sun, Jennifer Healey, James Tompkin, Jeff Huang
SIGCHI, 2022
Scalable Scalable Vector Graphics: Automatic Translation of Interactive SVGs to a Multithread VDOM for Fast Rendering
Michail Schwab, David Saffo, Nicholas Bond, Shash Sinha, Cody Dunne, Jeff Huang, James Tompkin, Michelle M. Borkin
Transactions on Visualization and Computer Graphics (TVCG), 2021
VisConnect: Distributed Event Synchronization for Collaborative Visualization
Michail Schwab, David Saffo, Yixuan Zhang, Shash Sinha, Cristina Nita-Rotaru, James Tompkin, Cody Dunne, Michelle A. Borkin
Transactions on Visualization and Computer Graphics (IEEE Visualization), 2020
Portal-ble: Intuitive Free-Hand Manipulation in Unbounded Smartphone-based Augmented Reality
Jing Qian, Jiaju Ma, Xiangyu Li, Benjamin Attal, Haoming Lai, James Tompkin, John Hughes, Jeff Huang
User Interface Software and Technology (UIST), 2019
Evaluating Pan and Zoom Timelines and Sliders
Michail Schwab, Sicheng Hao, Olga Vitek, James Tompkin, Jeff Huang, Michelle A. Borkin
SIGCHI, 2019
EasyPZ.js: Interaction Binding for Pan and Zoom Visualizations
Michail Schwab, James Tompkin, Jeff Huang, Michelle A. Borkin
Transactions on Visualization and Computer Graphics (IEEE Visualization short paper), 2019
One-line SVG pan/zoom, plus a pan/zoom injecting bookmark for any SVG!
Guided Proofreading of Automatic Segmentations for Connectomics
Daniel Haehn, Verena Kaynig, James Tompkin, Jeff W. Lichtman, Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2018
The Eye of the Typer: A Benchmark and Analysis of Gaze Behavior during Typing
Alexandra Papoutsaki, Aaron Gokaslan, James Tompkin, Yuze He, Jeff Huang
ACM Symposium on Eye Tracking Research and Applications (ETRA), 2018
CriteriaSliders: Learning Continuous Database Criteria via Interactive Ranking
James Tompkin, Kwang In Kim, Hanspeter Pfister, Christian Theobalt
British Machine Vision Conference, 2017
Piggybacking Robots: Human-Robot Overtrust in University Dormitory Security
Serena Booth, James Tompkin, Krzysztof Gajos, Jim Waldo, Hanspeter Pfister, Radhika Nagpal
Conference on Human-Robot Interaction (HRI), 2017
Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays
Eric Rosen, David Whitney, Elizabeth Phillips, Gary Chien, James Tompkin, George Konidaris, Stefanie Tellex
International Symposium on Robotics Research, 2017
Hierarchical Visual Feature Analysis for City Street View Datasets
Lezhi Li, James Tompkin, Panagiotis Michalatos, Hanspeter Pfister
IEEE Visualization Workshop on Visual Analytics for Deep Learning, 2017
Scalable Interactive Visualization for Connectomics
Daniel Haehn, John Hoffer, Brian Matejek, Adi Suissa-Peleg, Ali K. Al-Awami, Lee Kamentsky, Felix Gonda, Eagon Meng, William Zhang, Richard Schalek, Alyssa Wilson, Toufiq Parag, Johanna Beyer, Verena Kaynig, Thouis R. Jones, James Tompkin, Markus Hadwiger, Jeff W. Lichtman, Hanspeter Pfister
MDPI Informatics—Special Issue on Scalable Interactive Visualization, 2017
booc.io: An Education System with Hierarchical Concept Maps and Dynamic Non-linear Learning Plans
Michail Schwab, Hendrik Strobelt, James Tompkin, Colin Fredericks, Connor Huff, Dana Higgins, Anton Strezhnev, Maya Komisarchik, Gary King, Hanspeter Pfister
Transactions on Visualization and Computer Graphics (IEEE Visualization), 2016
Joint 5D Pen Input for Light Field Displays
James Tompkin, Samuel Muff, James McCann, Hanspeter Pfister, Jan Kautz, Marc Alexa, Wojciech Matusik
User Interface Software and Technology (UIST), 2015
Also at SIGGRAPH Emerging Technologies 2012: Interactive Light Field Painting
Generalizing Wave Gestures from Sparse Examples for Real-time Character Control
Helge Rhodin, James Tompkin, Kwang In Kim, Edilson de Aguiar, Hanspeter Pfister, Hans-Peter Seidel, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH Asia), 2015
Builds upon project: Direct Motion Mapping
Device Effect on Panoramic Video+Context Tasks
Fabrizio Pece, James Tompkin, Hanspeter Pfister, Jan Kautz, Christian Theobalt
European Conference on Visual Media Production (CVMP), 2014
Related project: Vidicontexts
Interactive Motion Mapping for Real-time Character Control
Helge Rhodin, James Tompkin, Kwang In Kim, Kiran Varanasi, Hans-Peter Seidel, Christian Theobalt
Computer Graphics Forum (Eurographics), 2014
Related project: Generalized Wave Gestures
Video Collections in Panoramic Contexts
James Tompkin, Fabrizio Pece, Rajvi Shah, Shahram Izadi, Jan Kautz, Christian Theobalt
User Interface Software and Technology (UIST), 2013
Related study into display device effect: Device Effect on Panoramic Video+Context Tasks
Exploring Sparse Unstructured Video Collections of Places
EngD Thesis @ University College London, 2013
Videoscapes: Exploring Sparse Unstructured Video Collections
James Tompkin, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH), 2012
Interactive Light Field Painting
James Tompkin, Samuel Muff, Stanislav Jakuschevskij, Jim McCann, Jan Kautz, Marc Alexa, Wojciech Matusik
SIGGRAPH Emerging Technologies, 2012
Early demo of our later UIST 2015 publication Joint 5D Pen Input for Light Field Displays.
Novel P300 BCI Interfaces to Directly Select Physical and Virtual Objects
Beste F. Yuksel, Michael Donnerer, James Tompkin, Anthony Steed
International Brain-Computer Interface Conference (BCI), 2011
PDF
A Novel Brain-computer Interface using a Multi-touch Surface
Beste F. Yuksel, Michael Donnerer, James Tompkin, Anthony Steed
ACM Transactions on Computer-Human Interaction (SIGCHI), 2010
DIY Design Process for Interactive Surfaces
Jennifer G. Sheridan, James Tompkin, Abel Maciel, George Roussos
British HCI Group Annual Conference on People and Computers (BCS-HCI), 2009
Webpage contains many projects and events! Schematics and WebGL model viewer!
Venues: A Networked Visual Instrument
MSci Dissertation @ King's College, London, 2006
PDF

How Can Deep Neural Networks Aid Visualization Perception Research? Three Studies on Correlation Judgments in Scatterplots
Fumeng Yang, Yuxin Ma, Lane Harrison, James Tompkin, David H. Laidlaw
SIGCHI, 2023
Learning Vector Quantized Shape Codes for Amodal Blastomere Instance Segmentation
Won-Dong Jang, Donglai Wei, Xingxuan Zhang, Brian Leahy, Helen Yang, James Tompkin, Dalit Ben-Yosef, Daniel Needleman, Hanspeter Pfister
IEEE International Symposium on Biomedical Imaging (ISBI), 2023
Neural Fields in Visual Computing and Beyond
Yiheng Xie, Towaki Takikawa, Shunsuke Saito, Or Litany, Shiqin Yan, Numair Khan, Federico Tombari, James Tompkin, Vincent Sitzmann, Srinath Sridhar
Eurographics State of the Art Report + CVPR Tutorial + SIGGRAPH Course, 2022
YouMVOS: An Actor-centric Multi-shot Video Object Segmentation Dataset
Donglai Wei, Siddhant Kharbanda, Sarthak Arora, Roshan Roy, Nishant Jain, Akash Palrecha, Tanav Shah, Shray Mathur, Ritik Mathur, Abhijay Kemka, Anirudh Chakravarthy, Zudi Lin, Won-Dong Jang, Yansong Tang, Song Bai, James Tompkin, Philip H.S. Torr, Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR), 2022
Testing using Privileged Information by Adapting Features with Statistical Dependence
Kwang In Kim, James Tompkin
International Conference on Computer Vision (ICCV), 2021
Channel Embedding for Informative Protein Identification from Highly Multiplexed Images
Salma A. Magid, Won-Dong Jang, Denis Schapiro, Donglai Wei, James Tompkin, Peter Sorger, Hanspeter Pfister
MICCAI, 2020
High-order Tensor Regularization with Application to Attribute Ranking
Kwang In Kim, Juhyun Park, James Tompkin
Computer Vision and Pattern Recognition (CVPR), 2018
CriteriaSliders: Learning Continuous Database Criteria via Interactive Ranking
James Tompkin, Kwang In Kim, Hanspeter Pfister, Christian Theobalt
British Machine Vision Conference, 2017
Predictor Combination at Test Time
Kwang In Kim, James Tompkin, Christian Richardt
International Conference on Computer Vision (ICCV), 2017
Semi-supervised Learning with Explicit Relationship Regularization
Kwang In Kim, James Tompkin, Hanspeter Pfister, Christian Theobalt
Computer Vision and Pattern Recognition (CVPR), 2015
Context-guided Diffusion for Label Propagation on Graphs
Kwang In Kim, James Tompkin, Hanspeter Pfister, Christian Theobalt
International Conference on Computer Vision (ICCV), 2015
Local High-order Regularization on Data Manifolds
Kwang In Kim, James Tompkin, Hanspeter Pfister, Christian Theobalt
Computer Vision and Pattern Recognition (CVPR), 2015
Curvature-aware Regularization on Riemannian Submanifolds
Kwang In Kim, James Tompkin, Christian Theobalt
International Conference on Computer Vision (ICCV), 2013
Match Graph Construction for Large Image Databases
Kwang In Kim, James Tompkin, Martin Theobald, Jan Kautz, Christian Theobalt
European Conference on Computer Vision (ECCV), 2012
Useful for building correspondence graphs for image matching, e.g., in search or large-scale reconstruction.

Workshops and Courses

Neural Fields in Visual Computing
CVPR 2022 + SIGGRAPH 2023

AI for Content Creation
CVPR 2019–2023

New England Compter Vision Symposium
Brown 2019

Video for Virtual Reality
SIGGRAPH 2017

User-centric Computational Videography
SIGGRAPH 2015

University Courses

CSCI 2000—Computer Science Research Methods or How to be a CS PhD Student
Brown University
2021 Fall.

CSCI 1430—Introduction to Computer Vision
Brown University
2022 Spring, 2021 Spring, 2020 Spring, 2019 Spring, 2017 Fall, 2017 Spring.

CSCI 1290—Computational Photography and Image Manipulation
Brown University
2023 Fall, 2020 Fall, 2018 Fall.

CSCI 2951-I—Computer Vision for Graphics and Interaction
Brown University
2019 Fall, 2018 Fall, 2018 Spring.

GISP 0002—NFTs, Blockchain, and Art, led by Ally Zhu and Nikolas Lazar
Brown University
2022 Spring.

CS171—Visualization
Harvard University
2016 Spring, 2015 Spring.

Computer Vision for Computer Graphics
Max-Planck-Institute for Informatics
2013 Summer.

Doctoral Students

2016–2021
Onto: Meta Reality Labs Research Scientist
Publications:
2018–
Publications:
2021–
Publications:
2021–
    2022–

      Masters Students

      Yiwen (Nick) Huang
      2021–2023
      Onto: Flawless AI
      Publications:
      2020–2022
      Onto: UMass Amherst PhD
      Publications:
      2019–2021
      Onto: UToronto PhD
      Publications:
      2016–2020
      Onto: US Congressional Innovation Scholar
      Publications:
      2018–2020
      Onto: Stanford PhD
      Publications:
      2018–2020
      Onto: Facebook AI on VR/AR
      Publications:
      2018–2020
      Onto: Google
        2019–2020
        Onto: Harvard RA; Allen Institute for AI Residency
        Publications:
        2017–2019
        Onto: CMU PhD
        Publications:
        2017–2019
        Onto: Facebook AI Residency, Cornell PhD
        Publications:

        Undergraduate Students

        2021–2023
        Onto: CMU Research Masters
        Publications:
        2022–2023
        Onto: Harvard Data Science Masters
        Publications:
        2021–2023
        Onto: Harvard Computational Science and Engineering Masters
        Publications:
        2020–2022
        Publications:
        2017–2020
        Onto: UC Berkeley PhD
        Publications:
        2019–2021
        Onto: Common Sense Machines
        Publications:
        Henry Stone
        2018–2020
        Publications:
        Lucas Kasser
        2018–2019
        Publications:
        2017–2018
        Onto: Allen Institute for AI Residency; UWashington PhD
        Publications:

        Extended Family PhDs

        2018–2021
        Onto: Synthesia
        Publications:
        2014–2020
        Onto: Google
        Publications:
        2014–2019
        Onto: UMass Boston Faculty
        Publications:
        2014–2017
        Onto: AI Foundation / Flawless AI
        Publications:

        Biography (2022)

        James Tompkin is the John E. Savage Assistant Professor of Computer Science at Brown University. His research at the intersection of computer vision, computer graphics, and human-computer interaction helps develop new visual computing tools and experiences. His doctoral work at University College London on large-scale video processing and exploration techniques led to creative exhibition work in the Museum of the Moving Image in New York City. Postdoctoral work at Max-Planck-Institute for Informatics and Harvard University helped create new methods to edit content within images and videos. Recent research has developed new techniques for low-level depth reconstruction, view synthesis for VR, and content editing and generation.

        Academic lineage

        Please find my research summary video from 2015—our newer lab work is on the 'Research' tab.



        SIGGRAPH 50th—2023

        I supported SIGGRAPH's 50th conference in 2023 as the chair of the Posters program, which was coincidentally running its 20th iteration too. Here's a meta-poster about the program's history and its outstanding contributors (low-res PNG).


        Exhibitions

        I support the Discover program and club at Brown/RISD to pair arts and science students and put on an exhibition. I also try to contribute myself.

        Bad Art @ Brown, 2018
        with Aaron Gokaslan and Vivek Ramanujan

        Rear Window Augmented
        with Jeff Desom

        Museum of the Moving Image
        New York City
        7th Nov. 2015 to 10th April 2016

        ISCP
        New York City
        7–9th November 2014

        Festival Imaginales
        Epinal, France

        26–29th May 2014

        Luxembourg Film Festival
        28th February to 9th March 2014

        Faculty Applications

        To share my experience, here is the material I sent to Brown in Dec. 2015.
        CV (Sept. 2016)
        Research Statement
        Teaching Statement