Awesome ML Kit gives Unity developers easy way to employ optimized real-time ML models centered around computer vision.DocumentationForum threadBackground matting demo videoThe current set of models includes1. High-quality background removal/background matting based on RobustVideoMatting (optimized for Unity, both horizontal and vertical (portrait) video aspect ratio supported)2. Depth estimation by single imageFeatures1. Sample scene for each model2. Specially made visualizations with different post effects3. Select solid color / image / video as background replacement; put Unity content between foreground & background layers4. Different model versions for Quality / Speed tradeoff5. Linear/Gamma color spaces supported5. WebCamTexture support6. Unity VideoPlayer integration7. AVPro Live Camera integration (recommended)Ideal for+ Media installations+ Apps with video streaming (e.g. can be used with Agora.io)+ KiosksPerformanceNVidia RTX3070+ Background removal: 300 FPS+ Depth estimation: 400 FPSNVidia GTX1050Ti (mobile)+ Background removal: 50 FPS+ Depth estimation: 80 FPSNote: only desktop platforms currently supported (tested on Windows DX11 and Linux Vulkan)Unity versions: 2021/2022 and above
