Ohad Fried

Email: ofried-at-idc-dot-ac-dot-il
New: Received a 4-year grant from the Israel Science Foundation!
New: Tentative lab name: The Media Analysis & SynthesiS (MASS) lab. Let me know what you think :)
New: More research highlighted by Two Minute Papers.
New: "Dynamic Guidance for Decluttering Photographic Compositions" was conditionally accepted to UIST 2021.
New: Our research was highlighted in the SIGGRAPH 2021 Technical Papers Trailer.
New: "Endless Loops: Detecting and Animating Periodic Patterns in Still Images" accepted to SIGGRAPH 2021.
New: We will teach a course on Neural Rendering @ SIGGRAPH 2021.
New: Our research was highlighted by Two Minute Papers.
New: "Deepfaked online content is highly effective in manipulating people's attitudes and intentions" preprint is out.
New: "Iterative Text-based Editing of Talking-heads Using Neural Retargeting" accepted to ACM Transactions on Graphics.
New: Our white paper on evaluating facial recognition technology is out.
About Me
I am a senior lecturer (assistant professor) of computer science at The Interdisciplinary Center Herzliya. Prior to that, I was a postdoctoral research scholar at Stanford University, working with Prof. Maneesh Agrawala. For my PhD I worked with Prof. Adam Finkelstein as part of the Princeton Graphics group. I hold an M.Sc. in Computer Science and a B.Sc. in Computational Biology, both from The Hebrew University. My work lies in the intersection of computer graphics, computer vision, and HCI. More specifically, my research focuses on tools, algorithms, and new paradigms for photo and video editing and synthesis.
Publications
J. L. E, K. Y. Zhai, J. Echevarria, O. Fried, P. Hanrahan and J. A. Landay.
"Dynamic Guidance for Decluttering Photographic Compositions."
ACM User Interface Software and Technology Symposium (UIST), 2021.
[webpage] [video (presentation)] [video (short)] [video (shorter)] [pdf]
A. Tewari, O. Fried, J. Thies, V. Sitzmann, S. Lombardi, Z. Xu, T. Simon, M. Nießner, E. Tretschk, L. Liu, B. Mildenhall, P. Srinivasan, R. Pandey, S. Orts-Escolano, S. Fanello, M. Guo, G. Wetzstein, J.-Y. Zhu, C. Theobalt, M. Agrawala, D. B Goldman and M. Zollhöfer.
"Advances in Neural Rendering."
ACM SIGGRAPH Courses, 2021.
[webpage] [video-1] [video-2]
T. Halperin, H. Hakim, O. Vantzos, G. Hochman, N. Benaim, L. Sassy, M. Kupchik, O. Bibi and O. Fried.
"Endless Loops: Detecting and Animating Periodic Patterns in Still Images."
ACM Transactions on Graphics (Proc. SIGGRAPH), 2021.
[webpage] [video] [blog]
X. Yao, O. Fried, K. Fatahalian and M. Agrawala.
"Iterative Text-based Editing of Talking-heads Using Neural Retargeting."
ACM Transactions on Graphics, 2021.
[webpage] [video] [pdf] [supp]
R. Or-El, S. Sengupta, O. Fried, E. Shechtman and I. Kemelmacher-Shlizerman.
"Lifespan Age Transformation Synthesis."
ECCV, 2020.
[webpage] [pdf] [dataset] [code] [colab notebook] [bib]
S. Agarwal, H. Farid, O. Fried and M. Agrawala. "Detecting Deep-Fake Videos from Phoneme-Viseme Mismatches."
CVPR Workshop on Media Forensics, 2020
[pdf] [bib]
A. Tewari*, O. Fried*, J. Thies*, V. Sitzmann*, S. Lombardi, K. Sunkavalli, R. Martin-Brualla, T. Simon, J. Saragih, M. Nießner, R. Pandey, S. Fanello, G. Wetzstein, J.-Y. Zhu, C. Theobalt, M. Agrawala, E. Shechtman, D. B Goldman and M. Zollhöfer. (* equal contribution)
"State of the Art on Neural Rendering."
Computer Graphics Forum (Eurographics STAR report), 2020
[pdf] [talk] [bib]
J. L. E, O. Fried, J. Lu, J. Zhang, R. Mech, J. Echevarria, P. Hanrahan and J. A. Landay.
"Adaptive Photographic Composition Guidance."
CHI, 2020
[webpage] [pdf] [video] [talk] [bib]
O. Fried, J. Jacobs, A. Finkelstein and M. Agrawala.
"Editing Self Image."
Communications of the ACM, 2020
[pdf] [bib]
O. Fried, A. Tewari, M. Zollhöfer, A. Finkelstein, E. Shechtman, D. B Goldman, K. Genova, Z. Jin, C. Theobalt and M. Agrawala.
"Text-based Editing of Talking-head Video."
ACM Transactions on Graphics (Proc. SIGGRAPH), 2019
[webpage] [pdf] [video] [bib]
J. L. E, O. Fried and M. Agrawala.
"Optimizing Portrait Lighting at Capture-Time Using a 360 Camera as a Light Probe."
ACM User Interface Software and Technology Symposium (UIST), 2019
[pdf] [webpage (supplementary material, visualizations)] [video] [talk] [bib]
O. Fried and M. Agrawala.
"Puppet Dubbing."
The 30th Eurographics Symposium on Rendering (EGSR), 2019
[pdf] [video] [results] [bib]
D. Danon, H. Averbuch-Elor, O. Fried and D. Cohen-Or.
"Unsupervised Natural Image Patch Learning."
Computational Visual Media, 2019
[pdf] [bib]
B. Ward, M. Ward, O. Fried and B. Paskhover.
"Nasal Distortion in Short-Distance Photographs: The Selfie Effect."
JAMA Facial Plastic Surgery, 2018
[pdf] [bib]

O. Fried and B. Paskhover.
"Perceived Facial Distortions in Selfies Are Explained by Viewing Habits—Reply."
JAMA Facial Plastic Surgery, 2018
[pdf] [bib]
O. Fried, S. Avidan and D. Cohen-Or.
"Patch2Vec: Globally Consistent Image Patch Representation."
Computer Graphics Forum (Proc. Pacific Graphics), 2017
[pdf] [video] [supp] [bib]
O. Fried.
"Photo Manipulation, The Easy Way."
PhD Dissertation, Princeton University, 2017 [pdf] [bib]
O. Fried, E. Shechtman, D. B Goldman and A. Finkelstein.
"Perspective-aware Manipulation of Portrait Photos."
ACM Transactions on Graphics (Proc. SIGGRAPH), 2016
[webpage] [pdf] [video] [bib]
H. Chang, O. Fried, Y. Liu, S. DiVerdi and A. Finkelstein.
"Palette-based Photo Recoloring."
ACM Transactions on Graphics (Proc. SIGGRAPH), 2015
[pdf] [video] [demo] [webpage] [bib]
O. Fried, E. Shechtman, D. B Goldman and A. Finkelstein.
"Finding Distractors In Images."
28th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
[pdf] [video] [webpage] [data] [code] [popular-science-article] [bib]
O. Fried, S. DiVerdi, M. Halber, E. Sizikova and A. Finkelstein.
"IsoMatch: Creating Informative Grid Layouts."
36th Annual Conference of the European Association for Computer Graphics (Eurographics), 2015
[pdf] [video] [code] [bib]
O. Fried, Z. Jin, R. Oda and A. Finkelstein.
"AudioQuilt: 2D Arrangements of Audio Samples using Metric Learning and Kernelized Sorting."
14th International Conference on New Interfaces for Musical Expression (NIME), 2014
[pdf] [video] [bib]
O. Fried, and R. Fiebrink.
"Cross-modal sound mapping using deep learning."
Proc. New Interfaces for Musical Expression (NIME), 2013
[pdf] [video] [bib]
O. Fried.
"Texture Synthesis for Particle Infused Textures."
Masters Thesis, The Hebrew University of Jerusalem, Israel, 2012 [pdf]
O. Fried.
"Single-cell Resolution Analysis of Yeast Response to Osmo-Stress."
Undergrad Thesis, The Hebrew University of Jerusalem, Israel, 2010
Preprints
S. Hughes, O. Fried, M. Ferguson, C. Hughes, R. Hughes, X. Yao and I. Hussey.
"Deepfaked online content is highly effective in manipulating people's attitudes and intentions."
PsyArXiv, 2021.
[pdf] [supp]
Tutorials
A. Tewari*, O. Fried*, J. Thies*, V. Sitzmann*, S. Lombardi, K. Sunkavalli, R. Martin-Brualla, T. Simon, J. Saragih, M. Nießner, R. Pandey, S. Fanello, G. Wetzstein, J.-Y. Zhu, C. Theobalt, M. Agrawala, E. Shechtman, D. B Goldman and M. Zollhöfer. (* equal contribution)
"Neural Rendering."
CVPR Tutorial, 2020
[webpage] [morning session] [afternoon session]
Media Coverage
"Two Minute Papers" highlighted several of our research projects throughout the years.

Deepfakes as a force for good (while being mindful of potential misuse): [digitaltrends]

Our YouTube video reached 350,000 views! (For a technical research video with no cats nor babies...)

Our work on Text-based Editing of Talking-head Video (2019) received some media attention. While I would have liked to see more on the exciting legitimate use cases, most stories focus on the fake-news angle (which is to be expected given the current political climate.) Hopefully this will help highlight the current issues with video authentication and more broadly, with misinformation.
[Stanford] [Washington Post] [Vice] [Fox News] [The Verge] [WorldStarHipHop] [Mashable] [Daily Mail] [The Register] [Business Insider] [TNW] [Observer] [Dazed] [ynet (he)] and more:
[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32].

Another interesting read that mentions our research: [Washington Post].

Wired video on photography, referencing some of our past research: [video].

Our research letter in JAMA Facial Plastic Surgery received some media attention! As of April 6, 2018 it has the #1 Altmetric score in JAMA Facial Plastic Surgery (#1 of 566) and is in the top 0.02% of all outputs tracked by Altmetric (#2219 of 9,569,234). [Altmetric]

Nasal Distortion in Short-Distance Photographs: The Selfie Effect (2018)
[CNN] [The Washington Post] [CBS News] [Forbes] [Wired] [The Verge] [ABC] [Newsweek] [Vox] [Daily Mail] [cnet] and many more:
[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 133, 134, 135, 136, 137, 138].

Face Warp, Art of Science (2017)
[PAW]

Radio story on the future of media manipulation (2017, in German)
[webpage] [mp3]

Perspective-aware Manipulation of Portrait Photos (2016)
[Gizmodo] [Motherboard] [Lonely Planet] [Forbes] [CNN] [FastCompany] [CACM] [DPReview] [DailyMail] [Yahoo Tech] [Digital Trends] [Gizmag] [Wired DE] [Spiegel] [PetaPixel] [TOI] [Science 2.0] [cnet] [NJ] [DIYPhotography] [designboom] [Fstoppers] [Inverse] [Princeton] [ICSJ] [Two Minute Papers]

Finding Distractors In Images (2015)
[Popular Science] [MSN] [Daily Mail] [Princeton] [IBT] [Yahoo] [ephotozine]
[Adobe MAX (video)] [TNW] [Inverse] [PAW]

Exposed, Art of Science (2013)
[Wired] [Popular Science] [Princeton] [National Geographic] [Gizmodo] [LiveScience] [Maxisciences]
Grants, Awards & Honors
[IDC  ] Israel Science Foundation, personal research grant (4 years), 2021.
[IDC  ] Industry grant, Lightricks Ltd.

[Post ] The Brown Institute for Media Innovation, Fellow 2017-2019
[Post ] The Brown Institute for Media Innovation, Magic Grant 2018-2019
[Post ] The Brown Institute for Media Innovation, Magic Grant 2017-2018
[Ph.D.] Siebel Scholar, Class of 2017
[Ph.D.] Google PhD Fellowship, 2014-2016
[Ph.D.] Gordon Y.S. Wu Fellowship in Engineering, 2012-2013
[M.S. ] Scholarship of excellence, School of Computer Science, The Hebrew University, 2010-2011
[B.Sc.] Graduated magna cum laude
[B.Sc.] Amirim interdisciplinary honors program, 2007-2010
[B.Sc.] Scholarship of excellence, The Hebrew University, 2007-2010
[B.Sc.] Dean's list for 2007/8, 2008/9 and 2009/10
Patents
Image Distractor Detection and Processing, US9665962 B2
Optimizing Photo Album Layouts, US9424671 B1
Teaching
The Interdisciplinary Center Herzliya — "Advanced Programming", fall 2020, fall 2021
The Interdisciplinary Center Herzliya — "Advanced Seminar on Neural Rendering", spring 2021
Stanford University — "Computational Video Manipulation", spring 2019
Princeton University — Teaching Assistant, "Computer Graphics", spring 2013
Princeton University — Teaching Assistant, "Computer Vision", fall 2013
Princeton University — Teaching Assistant, "MATLAB short course on programming", fall 2013
Hebrew University of Jerusalem, Israel — "Introduction to Software and System Security", fall 2011/12
Hebrew University of Jerusalem, Israel — "Introduction to Software and System Security", spring 2011
Service
SIGGRAPH Technical Papers Committee 2022
Technical Papers Reviewer 2021, 2020, 2019, 2017, 2016, 2015
Posters Adjunct Committee 2017
CVPR Reviewer 2022, 2020 (outstanding reviewer), 2019, 2018, 2017
ICLR Reviewer 2022
ICCV Reviewer 2021, 2017
TPAMI Reviewer 2021
SIGGRAPH Asia Reviewer 2021, 2020, 2019, 2018
UIST Reviewer 2021
ECCV Reviewer 2020, 2018
Computer Graphics Forum Reviewer 2019, 2016, 2015
Transactions on Graphics Reviewer 2018, 2016
Transactions on Applied Perception Reviewer 2018
International Journal of Human-Computer Interaction Reviewer 2018
The Visual Computer Reviewer 2017
Transactions on Multimedia Reviewer 2017
Transactions on Image Processing Reviewer 2016