Tavi Halperin

Computer Vision and Deep Learning Researcher @ Lightricks
tavihalperin@gmail
Google Scholar   |    Linkedin   |    Github    |    CV

Researcher and team lead at the research department at Lightricks. My focus is on state-of-the-art algorithms and neural networks that can also run on mobile devices. Specifically interested in video processing.
Previously, I did a Phd in Computer Science at the Hebrew University of Jerusalem. My thesis was about video processing, geometry, and using deep learning to jointly learn from audio and video. My advisor was Prof. Shmuel Peleg.

Publications

Endless Loops: Detecting and Animating Periodic Patterns in Still Images

Tavi Halperin, Hanit Hakim, Orestis Vantzos, Gershon Hochman, Gal Nachmana, Netai Benaim, Lior Sassy, Michael Kupchik, Ofir Bibi, Ohad Fried

ACM Transactions on Graphics (Proc. SIGGRAPH), 2021

project   arXiv   video   supplementary   mobile app  blogpost 

Neural separation of observed and unobserved distributions

Tavi Halperin, Ariel Ephrat and Yedid Hoshen

International Conference on Machine Learning (ICML) 2019

arXiv   code  

Dynamic Temporal Alignment of Speech to Lips

Tavi Halperin*, Ariel Ephrat* and Shmuel Peleg

IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2019

arXiv   code   video  

[*equal contribution]

Clear Skies Ahead: Towards Real-Time Automatic Sky Replacement in Video

Tavi Halperin, Harel Cain, Ofir Bibi and Michael Werman

Eurographics 2019

arXiv   video  

Seeing through noise: Speaker separation and enhancement using visually-derived speech

Aviv Gabbay, Ariel Ephrat, Tavi Halperin and Shmuel Peleg

IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2018

arXiv   project   video  

An Epipolar Line from a Single Pixel

Tavi Halperin and Michael Werman

IEEE Winter Conference on Applications of Computer Vision (WACV) 2018

arXiv   video  

Improved Speech Reconstruction from Silent Video

Ariel Ephrat*, Tavi Halperin* and Shmuel Peleg

ICCV Workshop on Computer Vision for Audio-Visual Media 2017

arXiv   project   video  

[*equal contribution]

Egosampling: Wide view hyperlapse from egocentric videos

Tavi Halperin, Yair Poleg, Chetan Arora and Shmuel Peleg

IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 2017

pdf  

Epipolar geometry based on line similarity

Gil Ben-Artzi, Tavi Halperin, Michael Werman and Shmuel Peleg

International Conference on Pattern Recognition (ICPR) 2016

pdf  

EgoSampling: Fast-Forward and Stereo for Egocentric Videos

Yair Poleg, Tavi Halperin, Chetan Arora and Shmuel Peleg

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015

pdf   project   video  

Patents

Method and system for enhancing a speech signal of a human speaker in a video using visual information

Shmuel Peleg, Asaph Shamir, Tavi Halperin, Aviv Gabbay, Ariel Ephrat

U.S. Patent 10,475,465

Method and system for generating adaptive fast forward of egocentric videos‏

Shmuel Peleg, Yair Poleg, Tavi Halperin and Chetan Arora

U.S. Patent 9,672,626