Issue Downloads
Iterative Text-Based Editing of Talking-Heads Using Neural Retargeting
We present a text-based tool for editing talking-head video that enables an iterative editing workflow. On each iteration users can edit the wording of the speech, further refine mouth motions if necessary to reduce artifacts, and manipulate non-verbal ...
Real-time Global Illumination Decomposition of Videos
We propose the first approach for the decomposition of a monocular color video into direct and indirect illumination components in real time. We retrieve, in separate layers, the contribution made to the scene appearance by the scene reflectance, the ...
Dirty Pixels: Towards End-to-end Image Processing and Perception
Real-world, imaging systems acquire measurements that are degraded by noise, optical aberrations, and other imperfections that make image processing for human viewing and higher-level perception tasks challenging. Conventional cameras address this problem ...
Vid2Player: Controllable Video Sprites That Behave and Appear Like Professional Tennis Players
We present a system that converts annotated broadcast video of tennis matches into interactively controllable video sprites that behave and appear like professional tennis players. Our approach is based on controllable video textures and utilizes domain ...
Primary-space Adaptive Control Variates Using Piecewise-polynomial Approximations
We present an unbiased numerical integration algorithm that handles both low-frequency regions and high-frequency details of multidimensional integrals. It combines quadrature and Monte Carlo integration by using a quadrature-based approximation as a ...
Learning Multimodal Affinities for Textual Editing in Images
Nowadays, as cameras are rapidly adopted in our daily routine, images of documents are becoming both abundant and prevalent. Unlike natural images that capture physical objects, document-images contain a significant amount of text with critical semantics ...
Vectorization for Fast, Analytic, and Differentiable Visibility
In Computer Graphics, the two main approaches to rendering and visibility involve ray tracing and rasterization. However, a limitation of both approaches is that they essentially use point sampling. This is the source of noise and aliasing, and also ...
SketchGNN: Semantic Sketch Segmentation with Graph Neural Networks
We introduce SketchGNN, a convolutional graph neural network for semantic segmentation and labeling of freehand vector sketches. We treat an input stroke-based sketch as a graph with nodes representing the sampled points along input strokes and edges ...
Single Depth View Based Real-Time Reconstruction of Hand-Object Interactions
Reconstructing hand-object interactions is a challenging task due to strong occlusions and complex motions. This article proposes a real-time system that uses a single depth stream to simultaneously reconstruct hand poses, object shape, and rigid/non-...
Imaging with Local Speckle Intensity Correlations: Theory and Practice
Recent advances in computational imaging have significantly expanded our ability to image through scattering layers such as biological tissues by exploiting the auto-correlation properties of captured speckle intensity patterns. However, most experimental ...
Self-Similar Fractal Drawings Inspired by M. C. Escher’s Print Square Limit
A fractal tiling (f-tiling) is a kind of rarely explored tiling by similar polygonal tiles which possesses self-similarity and the boundary of which is a fractal. Based on a tiling by similar isosceles right triangles, Dutch graphic artist M. C. Escher ...
Unsupervised Shape Completion via Deep Prior in the Neural Tangent Kernel Perspective
We present a novel approach for completing and reconstructing 3D shapes from incomplete scanned data by using deep neural networks. Rather than being trained on supervised completion tasks and applied on a testing shape, the network is optimized from ...
Mid-Air Drawing of Curves on 3D Surfaces in Virtual Reality
Complex 3D curves can be created by directly drawing mid-air in immersive environments (Augmented and Virtual Realities). Drawing mid-air strokes precisely on the surface of a 3D virtual object, however, is difficult, necessitating a projection of the mid-...
Supervoxel Convolution for Online 3D Semantic Segmentation
Online 3D semantic segmentation, which aims to perform real-time 3D scene reconstruction along with semantic segmentation, is an important but challenging topic. A key challenge is to strike a balance between efficiency and segmentation accuracy. There ...