Yawar Siddiqui

prof_pic.jpg

yawarnihal[at]gmail[dot]com

Hi! I’m Yawar. I am a Research Scientist at Reality Labs, Meta in Munich. I did my PhD at the Visual Computing and Artificial Intelligence group of Prof. Matthias Niessner at the Technical University of Munich, Germany. My work focuses on 3D reconstruction, scene understanding and 3D generative models.

Before my PhD, I did a Masters in Informatics at TUM, Germany, and my Bachelors in Computer Science at Jamia Millia Islamia, New Delhi, India, graduating with high distinction and at the top of the class respectively.

In the past, I have worked with Adobe Systems in India as a software engineer. During my time at TUM, I’ve had the pleasure of interning with Thabo Beeler and Derek Bradley at Disney Research in Zurich, with Peter Konschieder at Meta Reality Labs also in Zurich, and with Andrea Vedaldi, David Novotny, Roman Shapovalov and Natalia Nevarova at GenAI, Meta in London.


Research

  1. assetgen.gif
    ARXIV24
    Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materials
    Yawar Siddiqui, Tom Monnier, Filippos Kokkinos, Mahendra Kariya, Yanir Kleiman, Emilien Garreau, Oran Gafni, Natalia Neverova, Andrea Vedaldi, Roman Shapovalov, and David Novotny
    arXiv preprint arXiv:2407.02445, 2024
    Project PDF Video
  2. 3dgen.gif
    ARXIV24
  3. meshgpt.gif
    CVPR24
    (Highlight)
    MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers
    Yawar Siddiqui, Antonio Alliegro, Alexey Artemov, Tatiana Tommasi, Daniele Sirigatti, Vladislav Rosov, Angela Dai, and Matthias Nießner
    In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024
    Project PDF Video Code
  4. polydiff.gif
    ARXIV23
    PolyDiff: Generating 3D Polygonal Meshes with Diffusion Models
    Antonio Alliegro, Yawar Siddiqui, Tatiana Tommasi, and Matthias Nießner
    arXiv preprint arXiv:2312.11417, 2023
    PDF Video
  5. text2tex.gif
    ICCV23
    Text2Tex: Text-driven Texture Synthesis via Diffusion Models
    Dave Zhenyu Chen, Yawar Siddiqui, Hsin-Ying Lee, Sergey Tulyakov, and Matthias Nießner
    In Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023
    Project PDF Video Code
  6. panopli.gif
    CVPR23
    (Highlight)
    Panoptic Lifting for 3D Scene Understanding with Neural Fields
    Yawar Siddiqui, Lorenzo Porzi, Samuel Rota Buló, Norman Müller, Matthias Nießner, Angela Dai, and Peter Kontschieder
    In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023
    Project PDF Video Code
  7. diffrf.gif
    CVPR23
    (Highlight)
    DiffRF: Rendering-Guided 3D Radiance Field Diffusion
    Norman Müller, Yawar Siddiqui, Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder, and Matthias Nießner
    In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023
    Project PDF Video
  8. texturify.gif
    ECCV22
    Texturify: Generating textures on 3d shape surfaces
    Yawar Siddiqui, Justus Thies, Fangchang Ma, Qi Shan, Matthias Nießner, and Angela Dai
    In Computer Vision–ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part III, 2022
    Project PDF Video Code
  9. retrievalfuse.gif
    ICCV21
    Retrievalfuse: Neural 3d scene reconstruction with a database
    Yawar Siddiqui, Justus Thies, Fangchang Ma, Qi Shan, Matthias Nießner, and Angela Dai
    In Proceedings of the IEEE/CVF International Conference on Computer Vision, 2021
    Project PDF Video Code
  10. spsg.gif
    CVPR21
    Spsg: Self-supervised photometric scene generation from rgb-d scans
    Angela Dai, Yawar Siddiqui, Justus Thies, Julien Valentin, and Matthias Nießner
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021
    Project PDF Video Code
  11. viewal.gif
    CVPR20
    Viewal: Active learning with viewpoint entropy for semantic segmentation
    Yawar Siddiqui, Julien Valentin, and Matthias Nießner
    In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020
    Project PDF Video Code
  12. clustering.gif
    ARXIV18
    Clustering with deep learning: Taxonomy and new methods
    Elie Aljalbout, Vladimir Golkov, Yawar Siddiqui, Maximilian Strobel, and Daniel Cremers
    arXiv preprint arXiv:1801.07648, 2018
    PDF Code

Invited Talks

  • [Google Munich, September 2024]   Creating Relightable 3D Assets in Less Than a Minute
  • [Autodesk AI, July 2024]   3D Content Creation using Reconstruction and Generation
  • [CVPR 3DMV Workshop, June 2024]   MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers
  • [Apple, 3D Reconstruction Team, December 2023]   MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers
  • [Talking Papers Podcast, July 2023]   Panoptic Lifting for 3D Scene Understanding with Neural Fields
  • [CVPR Workshop for Compositional 3D Vision, June 2023]   Panoptic Lifting for 3D Scene Understanding with Neural Fields
  • [CVPR Workshop for Scene Understanding, June 2023]   Panoptic Lifting for 3D Scene Understanding with Neural Fields
  • [HiGraphics, February 2023]  Panoptic Lifting for 3D Scene Understanding with Neural Fields

Teaching


Seminar on Neural Radiance Fields

Course Coordinator, Winter 2022/23, Summer 2023

Machine Learning for 3D Geometry

Teaching Assistant, Summer 2021

Advanced Deep Learning for Computer Vision

Teaching Assistant, Winter 2020/21

Introduction to Deep Learning

Teaching Assistant, Winter 2019/20

Reviewer Experience

Reviewed in the past for NeurIPS24, CVPR24, CVPR23, ICCV21, ECCV22, SIGGRAPH24, SIGGRAPH-Asia24, SIGGRAPH-Asia23, VMV24.