Replacing Real-Time the High-Resolution Meeting Background Freely.
👉See image results with interactive zoom-in
- Real-TimeHigh-Resolution Background Matting,;
- Replacing our background in meeting screen;
- Replace background withany sizephoto you want;
- Cross mutil-platform, like zoom plugin, web-browser, miniprogram in PC, mobile and iPad, any platform with web service;
- IFLYTEK voice translation between Chinese and English;
- ...
- [Jan 09 2021]PhotoMatte85dataset is now published.
- [Dec 21 2020] We updated our project to MIT License, which permits commercial use!
- HD videos(bySengupta et al.) (Our model is more robust on HD footage)
- 4K videos and images
- VideoMatte240K (Coming soon)
- PhotoMatte85
- setup enviroment
#git clone https://github /Charmve/TimeWarp.git
#cd TimeWarp
#pip install -r requirements.txt
-
download dataset and model
Download
-
run test code
- Video
# cd TimeWarp
# bash test_video.sh
- Image
# cd TimeWarp
# Python 3 test_image.py
➡️Web Demo by Gradio:Matting your own images from your browser.
We provide several scripts in this repo for you to experiment with our model. More detailed instructions are included in the files.
inference_images.py
:Perform matting on a directory of images.inference_video.py
:Perform matting on a video.inference_webcam.py
:An interactive matting demo using your webcam.
Additionally, you can try our notebooks in Google Colab for performing matting on images and videos.
We provide a demo application that pipes webcam video through our model and outputs to a virtual camera. The script only works on Linux system and can be used in Zoom meetings. For more information, checkout:
Developers in the community has helped us build a web demo. SeeCommunity Projectssection below.
You can run our model usingPyTorch,TorchScript,TensorFlow,andONNX.For detail about using our model, please check out theUsage / Documentationpage.
- Đơn khối GPU thực hiện 4K độ phân giải mỗi giây 30 bức, Washington đại học thật khi video moi đồ lại thăng cấp, lông tóc chi tiết đúng chỗ
- Toàn bộ thế giới đều là ngươi lục mạc: Cái này video moi đồ đổi bối cảnh phương pháp thực sự thật giả khó phân biệt
Training code will be released upon acceptance of the paper.
gantt
dateFormat YYYY-MM-DD
title TimeWarp Development Processing
section image matting
architecture design:done, des1, 2020-11-06,2020-12-20
video matting:active, des2, 2021-01-07, 3d
chrome extension plus: des3, after des2, 7d
video meeting architecture: des4, after des3, 5d
- More update processing details, please clickHEREto seeCHANGLOG.
Business ✉️ email:yidazhang1@gmail
-
GitHubdiscussions 💬orissues 💭
-
QQ Group: 697948168 (password: TimeWarp)
-
Email: yidazhang1#gmail
[1] Real-Time High-Resolution Background Matting. Shanchuan Lin*, Andrey Ryabtsev*, Soumyadip Sengupta.[GitHub]|[arXiv]|[data]
[2] Background Matting: The World is Your Green Screen. Soumyadip Sengupta, Vivek Jayaram, Brian Curless, et.al. CVPR 2020.[GitHub]|[arXiv]
[3] MODNet: Is a Green Screen Really Necessary for Real-Time Portrait Matting? [GitHub] |[arXiv]
[4] High-Resolution Deep Image Matting. Haichao Yu, Ning Xu, Zilong Huang. [GitHub] |[arXiv]
[5] End-to-end Animal Image Matting. Jizhizi Li, Jing Zhang, Stephen J. Maybank.[GitHub]|[arXiv].
[6] BGMv2-webcam-plugin-linux.https://github /andreyryabtsev/BGMv2-webcam-plugin-linux
[7] Chrome-extensions-samples.https://github /GoogleChrome/chrome-extensions-samples
[8] Zoom Video Ingester.https://github /harvard-dce/zoom-recording-ingester
[9] Zoom Recording Downloader.https://github /ricardorodrigues-ca/zoom-recording-downloader
[10] PaperswithCode. Image Matting.https://paperswithcode /task/image-matting
This work is licensed under theCreative Commons Attribution NonCommercial ShareAlike 4.0 License.
Thanks forPeterL1n,et al.
Feel free to ask any questions, open a PR if you feel something can be done differently!
Created byCharmve&maiwei.aiCommunity | Deployed onGradio.app