@shariq_farooq Profile picture

Shariq Farooq

@shariq_farooq

PhD @ KAUST👨‍💻 | Worked with @intel , @Adobe , @Stanford @ucl | Author of ZoeDepth, AdaBins, LooseControl | Exploring the 3D world, one image at a time 🔍 |

Similar User
Bernard Ghanem photo

@BernardSGhanem

Peter Wonka photo

@peter_wonka

Rameen Abdal photo

@AbdalRameen

Chen Zhao photo

@CathyChenZhao

Habib Slim photo

@habib__slim

Juan C. Pérez photo

@juancprzs

Samuel Horváth photo

@sam_hrvth

Kumail Alhamoud photo

@KumailAlhamoud

Shuming Liu photo

@shuming96

Sara Rojas Martinez photo

@SarisRo

Fares Fourati photo

@FaresFouratii

María A. Bravo photo

@MariaAleBravo

Yasir Ghunaim photo

@YasirGhunaim

Vex Watson 🤖🧬 photo

@VexWatson

Alejandro Pardo photo

@PardoAlejo

Pinned

Our work, ZoeDepth, has been **rejected** from ICCV. But I am absolutely thrilled at how well it was received by the community! Here are some of my favorite use cases 👇

ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depth abs: arxiv.org/abs/2302.12288

Tweet Image 1


Shariq Farooq Reposted

I am hiring 3 postdocs at #KAUST to develop an Artificial Scientist for discovering novel chemical materials for carbon capture. Join this project with @FaccioAI at the intersection of RL and Material Science. Learn more and apply: faccio.ai/postdoctoral-p…

Tweet Image 1

Shariq Farooq Reposted

Introducing Sora, our text-to-video model. Sora can create videos of up to 60 seconds featuring highly detailed scenes, complex camera motion, and multiple characters with vibrant emotions. openai.com/sora Prompt: “Beautiful, snowy…


Shariq Farooq Reposted

This video was generated by Sora. That's the new model by OpenAI. The most advanced text-to-video tool created so far. I'll share the videos here. Absolutely insane. Prompt: This close-up shot of a Victoria crowned pigeon showcases its striking blue plumage and red chest. Its…


Shariq Farooq Reposted

Testing Image to #3D in ZoeDepth and exporting out to Blender - still need to figure out how to map the image back Thanks @shariq_farooq ! 🤘


Shariq Farooq Reposted

Cinematic Title Background: 1) Prompt 3D texture in #midjourney 2) Clean BG in #photoshop 3) 2D animate in @AdobeVideo #aftereffects 4) Image to #3D in ZoeDepth 5) 3D Animation in @maxon #cinema4d 3-part tutorial starting here 😎 youtu.be/4rR737Wzcj4?si…


Shariq Farooq Reposted

This paper has received significantly less attention than it deserves, so let me shed a bit more light on it and describe why it's so good: 1. It turns out that the classical U-Net image diffusion backbone, which the entire community has been happily building upon during the…

Analyzing and Improving the Training Dynamics of Diffusion Models paper page: huggingface.co/papers/2312.02… Diffusion models currently dominate the field of data-driven image synthesis with their unparalleled scaling to large datasets. In this paper, we identify and rectify several…

Tweet Image 1


😍😍

Need more control over your generations? Create the foreground and background separately and use ZoeDepth to create the 3D background. A quick tutorial here. I’ll be using this for my next project together with 3D.CSM.AI #makebigfilms



Shariq Farooq Reposted

Check out my most recent work with @peter_wonka : "Text2AC-Zero" for generating videos of Animated Characters using pre-trained 2D diffusion models. Our approach is temporally consistent, zero-shot and requires only text prompt as input. Project page: abdo-eldesokey.github.io/text2ac-zero/


PatchFusion lifts ZoeDepth to very high resolution and natively supports 4K+ input! Can’t wait to see the community trying it out for various applications where ZoeDepth couldn’t provide the details!

PatchFusion: An End-to-End Tile-Based Framework for High-Resolution Monocular Metric Depth Estimation @Gradio demo is out on @huggingface demo: huggingface.co/spaces/zhyever… run with docker: huggingface.co/spaces/zhyever… duplicate space with private gpu and no queue:…



Shariq Farooq Reposted

PatchFusion: An End-to-End Tile-Based Framework for High-Resolution Monocular Metric Depth Estimation @Gradio demo is out on @huggingface demo: huggingface.co/spaces/zhyever… run with docker: huggingface.co/spaces/zhyever… duplicate space with private gpu and no queue:…


Shariq Farooq Reposted

Two excellent Depth estimation models have recently come out- 1⃣PatchDiffusion (@zhenyu_li9955,@shariq_farooq et al.) 2⃣Marigold from ETH Zürich team (@KBingxin, @AntonObukhov1 et al.) Code and examples in tweets below

Tweet Image 1
Tweet Image 2

Shariq Farooq Reposted

Researchers presented LooseControl, a model that can change AI-generated images by using 3D boxes. You can set up the boxes, and the tool will generate an image based on their positions and sizes. Try the demo: 80.lv/articles/turni… #AI #GenerativeAI #controlnet #technews


Shariq Farooq Reposted

Proud of Adobe Research 🔥🥹✨

LooseControl was just released and it's so good! 🔥 It enables depth-map conditioned image generation, but unlike ControlNet, the 3D boxes enable less strict control with simple bounding boxes. And look at how stable it is across frames! More examples (with code) below ⬇️⬇️



Shariq Farooq Reposted

PatchFusion was just released. Compared to ZoeDepth, it predicts depth maps with much finer details, just look at the comparison below! 🤯 Its main contribution is a new Global-to-Local module and Consistency-Aware Training. More examples below (with code) ⬇️⬇️


Shariq Farooq Reposted

LooseControl was just released and it's so good! 🔥 It enables depth-map conditioned image generation, but unlike ControlNet, the 3D boxes enable less strict control with simple bounding boxes. And look at how stable it is across frames! More examples (with code) below ⬇️⬇️


PatchFusion, our new 4K depth estimation model, significantly improves the details and quality of depth maps produced by ZoeDepth 👇

Check our new work PatchFusion! It estimates high-resolution metric depth with intricate details for high-resolution input image. Zhenyu Li, Shariq Farooq Bhat (@shariq_farooq), Peter Wonka (@peter_wonka) Webpage: zhyever.github.io/patchfusion/



Shariq Farooq Reposted

🚀 Excited to share our SIGGRAPH Asia work! 📚 iNVS: Repurposing Diffusion Inpainters for Novel View Synthesis 🔍TLDR: Maximize reuse of source image pixels for novel view synthesis from a single image. 🔗 Website: yashkant.github.io/invs 🌐 #SIGGRAPHAsia2023 #Research #iNVS


Loading...

Something went wrong.


Something went wrong.