James Tompkin

Assistant Professor



Contact

Office hours: Tues 1–2pm
Book appointment

Brown GCal: Use 'Find a Time'
Instructions


Follow @jamestompkin

Thomas J. Watson Sr. Center for Information Technology
Room 547
115 Waterman Street
Providence, RI, 02912

Teaching

SIGGRAPH Courses

Video for Virtual Reality
SIGGRAPH 2017

User-centric Computational
Videography

SIGGRAPH 2015

University Courses

Fall 2019:
CSCI 2951-I—Computer Vision for Graphics and Interaction
Brown University

Spring 2019:
CSCI 1430—Introduction to Computer Vision
Brown University

Fall 2018:
CSCI 1290—Computational Photography and Image Manipulation
Brown University

Spring 2016:
CS171—Visualization
Harvard University

Spring 2015:
CS171—Visualization
Harvard University

Summer 2013:
Computer Vision for
Computer Graphics

Max-Planck-Institute
for Informatics

Exhibitions

Bad Art @ Brown
with Aaron Gokaslan and Vivek Ramanujan

Rear Window Augmented
with Jeff Desom

Museum of the Moving Image
New York City
7th Nov. 2015 to 10th April 2016

ISCP
New York City
7–9th November 2014

Festival Imaginales
Epinal, France

26–29th May 2014

Luxembourg Film Festival
28th February to 9th March 2014

Press (Selected)

2017

Piggybacking Robots
Vice, IEEE Spectrum

2016

Brown CS intro
Brown CS News

2015

Computational Design of Metallophone Contact Sounds
Popular Science, Wired, Gizmodo, NSF Science360.

Rear Window Augmented
The Wall Street Journal

Archive
2014

Automatic Noise Modeling for Ghost-free HDR Reconstruction
Informatik Spektrum cover, February

2013

Light Field Painting
Architect

How Not To Be Seen
Slashdot

2012

Video Inpainting
YouTube—125k views so far
Galileo (TV program, ProSieben German channel)
Informatik Spektrum cover, April

2009

Adaptive Architecture
TimeOut London—Digital Cities: London's Future exhibition

Faculty Applications

To share my experience, here is the material I sent to Brown in Dec. 2015.
CV (Sept. 2016)
Research Statement
Teaching Statement

Acknowledgements

My intrepid collaborators and co-authors!

My funding agencies: the UK EPSRC, the BBC, Intel, the US National Science Foundation, and the US Defense Advanced Research Projects Agency.

The open source Web com­munity: HTML5 Boiler­plate, Ryan Johnston, Joshua N. Hibbert, Practical­Typo­graphy.com, and EB Gara­mond.

MP4 download (200MB)

How can we make video a creative medium for  every­one?
How can computation re­move bar­riers from interaction?
How can image understanding help us ex­plore media?

To help answer these questions, I cre­ate gra­phics, vision, and inter­action tech­niques which improve our under­standing of the connections within media.

Academic lineage

Publications—2019

View-consistent 4D Light Field Superpixel Segmentation
Numair Khan, Qian Zhang, Lucas Kasser, Henry Stone, Min H. Kim, James Tompkin
ICCV
Portal-ble: Intuitive Free-Hand Manipulation in Unbounded Smartphone-based Augmented Reality
Jing Qian, Jiaju Ma, Xiangyu Li, Benjamin Attal, Haoming Lai,
James Tompkin, John Hughes, Jeff Huang
UIST
Evaluating Pan and Zoom Timelines and Sliders
Michail Schwab, Sicheng Hao, Olga Vitek, James Tompkin, Jeff Huang, Michelle A. Borkin
CHI
EasyPZ.js: Interaction Binding for Pan and Zoom Visualizations
Michail Schwab, James Tompkin, Jeff Huang, Michelle Borkin
IEEE Visualization (Short Paper)
Webpage (Github, docu, jsFiddle, bl.ocks.org examples...)
One-line SVG pan/zoom, plus a pan/zoom injecting bookmark for any SVG!
Communicating and Controlling Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays
Eric Rosen, David Whitney, Elizabeth Phillips, Gary Chien,
James Tompkin, George Konidaris, Stefanie Tellex
International Journal of Robotics Research

2018

Unsupervised Attention-guided Image to Image Translation
Youssef A. Mejjati, Christian Richardt, James Tompkin, Darren Cosker, Kwang In Kim
Neural Information Processing Systems (NeurIPS 2018)
Improving Shape Deformation in Unsupervised Image-to-Image Translation
Aaron Gokaslan, Vivek Ramanujan, Daniel Ritchie, Kwang In Kim, James Tompkin
European Conference on Computer Vision (ECCV 2018)
Evaluating 'Graphical Perception' with CNNs
Daniel Haehn, James Tompkin, Hanspeter Pfister
Transactions on Visualization and Computer Graphics (IEEE Visualization 2018)
Guided Proofreading of Automatic Segmentations for Connectomics
Daniel Haehn, Verena Kaynig, James Tompkin, Jeff W. Lichtman, Hanspeter Pfister
Computer Vision and Pattern Recognition (CVPR 2018)
High-order Tensor Regularization with Application to Attribute Ranking
Kwang In Kim, Juhyun Park, James Tompkin
IEEE Computer Vision and Pattern Recognition (CVPR 2018)
The Eye of the Typer: A Benchmark and Analysis of Gaze Behavior during Typing
Alexandra Papoutsaki, Aaron Gokaslan, James Tompkin, Yuze He, Jeff Huang
ACM Symposium on Eye Tracking Research and Applications (ETRA 2018)

2017

CriteriaSliders: Learning Continuous Database Criteria via Interactive Ranking
James Tompkin, Kwang in Kim, Hanspeter Pfister, Christian Theobalt
British Machine Vision Conference (Spotlight)
Consistent Video Filtering for Camera Arrays
Nicolas Bonneel, James Tompkin, Deqing Sun, Oliver Wang, Kalyan Sunkavalli, Sylvain Paris, Hanspeter Pfister
Computer Graphics Forum (Eurographics)
Predictor Combination at Test Time
Kwang In Kim, James Tompkin, Christian Richardt
International Conference on Computer Vision
Piggybacking Robots: Human-Robot Overtrust in University Dormitory Security
Serena Booth, James Tompkin, Krzysztof Gajos, Jim Waldo, Hanspeter Pfister, Radhika Nagpal
Conference on Human-Robot Interaction
Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays
Eric Rosen, David Whitney, Elizabeth Phillips, Gary Chien, James Tompkin, George Konidaris, Stefanie Tellex
International Symposium on Robotics Research
Hierarchical Visual Feature Analysis for City Street View Datasets
Lezhi Li, James Tompkin, Panagiotis Michalatos, Hanspeter Pfister
IEEE Visualization Workshop on Visual Analytics for Deep Learning
Scalable Interactive Visualization for Connectomics
Daniel Haehn, John Hoffer, Brian Matejek, Adi Suissa-Peleg, Ali K. Al-Awami, Lee Kamentsky, Felix Gonda, Eagon Meng, William Zhang, Richard Schalek, Alyssa Wilson, Toufiq Parag, Johanna Beyer, Verena Kaynig, Thouis R. Jones, James Tompkin, Markus Hadwiger, Jeff W. Lichtman, and Hanspeter Pfister
MDPI Informatics—Special Issue on Scalable Interactive Visualization

2016

booc.io: An Education System with Hierarchical Concept Maps and Dynamic Non-linear Learning Plans
Micha Schwab, Hendrik Strobelt, James Tompkin, Colin Fredericks, Connor Huff, Dana Higgins, Anton Strezhnev, Maya Komisarchik, Gary King, Hanspeter Pfister
IEEE VIS 2016
Interactive Multicut Video Segmentation
Evgeny Levinkov, James Tompkin, Nicolas Bonneel, Steffen Kirchhoff, Bjoern Andres, Hanspeter Pfister
Pacific Graphics 2016 (Short Paper)

2015

Joint 5D Pen Input for Light Field Displays
James Tompkin, Samuel Muff, James McCann, Hanspeter Pfister, Jan Kautz, Marc Alexa, Wojciech Matusik
ACM User Interface Software and Technology (UIST 2015)
Generalizing Wave Gestures from Sparse Examples for Real-time Character Control
Helge Rhodin, James Tompkin, Kwang In Kim, Edilson de Aguiar, Hanspeter Pfister, Hans-Peter Seidel, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH Asia 2015)
Related project websites: Direct Motion Mapping
Blind Video Temporal Consistency
Nicolas Bonneel, James Tompkin, Kalyan Sunkavalli, Deqing Sun, Sylvain Paris, Hanspeter Pfister
ACM Transactions on Graphics (SIGGRAPH Asia 2015)
Computational Design of Metallophone Contact Sounds
Gaurav Bharaj, David I.W. Levin, James Tompkin, Yun Fei, Hanspeter Pfister, Wojciech Matusik, Changxi Zheng
ACM Transactions on Graphics (SIGGRAPH Asia 2015)
Computational Design of Walking Automata
Gaurav Bharaj, Stelian Coros, Bernhard Thomaszewski, James Tompkin, Bernd Bickel, Hanspeter Pfister
ACM Symposium on Computer Animation (SCA 2015)
Context-guided Diffusion for Label Propagation on Graphs
Kwang In Kim, James Tompkin, Hanspeter Pfister, Christian Theobalt
International Conference on Computer Vision (ICCV 2015)
Semi-supervised Learning with Explicit Relationship Regularization
Kwang In Kim, James Tompkin, Hanspeter Pfister, Christian Theobalt
IEEE Computer Vision and Pattern Recognition (CVPR 2015)
Local High-order Regularization on Data Manifolds
Kwang In Kim, James Tompkin, Hanspeter Pfister, Christian Theobalt
IEEE Computer Vision and Pattern Recognition (CVPR 2015)

2014

Interactive Intrinsic Video Editing
Nicolas Bonneel, Kalyan Sunkavalli, James Tompkin, Deqing Sun, Sylvain Paris, Hanspeter Pfister
ACM Transactions on Graphics (SIGGRAPH Asia 2014)
Efficient Learning of Image Super-resolution and Compression Artifact Removal with Semi-local Gaussian Processes
Younghee Kwon, Kwang In Kim, James Tompkin, Jin Hyung Kim, and Christian Theobalt
Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
Device Effect on Panoramic Video+Context Tasks
Fabrizio Pece, James Tompkin, Hanspeter Pfister, Jan Kautz, Christian Theobalt
European Conference on Visual Media Production (CVMP 2014)
Paper Supplemental
Related project websites: Vidicontexts
Interactive Motion Mapping for Real-time Character Control
Helge Rhodin, James Tompkin, Kwang In Kim, Kiran Varanasi, Hans-Peter Seidel, Christian Theobalt
Computer Graphics Forum (Eurographics 2014)

2013

Automatic Noise Modeling for Ghost-free HDR Reconstruction
Miguel Granados, Kwang In Kim, James Tompkin, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH Asia 2013)
Curvature-aware Regularization on Riemannian Submanifolds
Kwang In Kim, James Tompkin, Christian Theobalt
International Conference on Computer Vision (ICCV 2013)
Video Collections in Panoramic Contexts
James Tompkin, Fabrizio Pece, Rajvi Shah, Shahram Izadi, Jan Kautz, Christian Theobalt
User Interface Software and Technology (UIST 2013)
Preference and Artifact Analysis for Video Collections of Places
James Tompkin, Min H. Kim, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Applied Perception (TAP)
Content-adaptive Lenticular Prints
James Tompkin, Simon Heinzle, Jan Kautz, Wojciech Matusik
ACM Transactions on Graphics (SIGGRAPH 2013)
Exploring Sparse Unstructured Video Collections of Places
James Tompkin
EngD Thesis @ University College London

2012

Interactive Viewpoint Video Textures
Philippe Levieux, James Tompkin, Jan Kautz
European Conference on Visual Media Production (CVMP 2012)
Background Inpainting for Videos with Dynamic Objects and a Free-moving Camera
Miguel Granados, Kwang In Kim, James Tompkin, Jan Kautz, Christian Theobalt
European Conference on Computer Vision (ECCV 2012)
Match Graph Construction for Large Image Databases
Kwang In Kim, James Tompkin, Martin Theobald, Jan Kautz, Christian Theobalt
European Conference on Computer Vision (ECCV 2012)
Videoscapes: Exploring Sparse Unstructured Video Collections
James Tompkin, Kwang In Kim, Jan Kautz, Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH 2012)
Interactive Light Field Painting
James Tompkin, Samuel Muff, Stanislav Jakuschevskij, Jim McCann, Jan Kautz, Marc Alexa, Wojciech Matusik
SIGGRAPH 2012 Emerging Technologies
How Not to Be Seen - Object Removal from Videos of Crowded Scenes
Miguel Granados, James Tompkin, Kwang In Kim, Oliver Grau, Jan Kautz, Christian Theobalt
Computer Graphics Forum (Eurographics 2012)
Interactive Multi-perspective Imagery from Photos and Videos
Henrik Lieng, James Tompkin, Jan Kautz
Computer Graphics Forum (Eurographics 2012)

2011

Video-based Characters - Creating New Human Performances from a Multi-view Video Database
Feng Xu, Yebin Liu, Carsten Stoll, James Tompkin, Gaurav Bharaj, Qionghai Dai, Hans-Peter Seidel, Jan Kautz, and Christian Theobalt
ACM Transactions on Graphics (SIGGRAPH 2011)
Towards Moment Images: Automatic Cinemagraphs
James Tompkin, Fabrizio Pece, Kartic Subr, Jan Kautz
European Conference on Visual Media Production (CVMP 2011)
Novel P300 BCI Interfaces to Directly Select Physical and Virtual Objects
Beste F. Yuksel, Michael Donnerer, James Tompkin, Anthony Steed
International Brain-Computer Interface Conference (BCI 2011)

2010

A Novel Brain-computer Interface using a Multi-touch Surface
Beste F. Yuksel, Michael Donnerer, James Tompkin, and Anthony Steed
ACM Transactions on Computer-Human Interaction (SIGCHI 2010)

2009

DIY Design Process for Interactive Surfaces
Jennifer G. Sheridan, James Tompkin, Abel Maciel, and George Roussos
British HCI Group Annual Conference on People and Computers (BCS-HCI 2009)

2006

Venues: A Networked Visual Instrument
James Tompkin
MSci Dissertation @ King's College, London