High-quality background removal / matting and monocular image depth estimation for Unity Barracuda and SentisAwesome ML Kit gives Unity developers easy way to employ optimized real-time ML models centered around computer vision.DocumentationForum threadBackground matting demo videoThe current set of models includes1. High-quality background removal/background matting based on RobustVideoMatting. Optimized for Unity, both horizontal and vertical/portrait video aspect ratio supported2. Depth estimation by single imageFeatures1. Sample scene for each model. Specially made visualizations with different post effects. Additional 3d scene, background blur and glitch scenes2. Select solid color / image / video as background replacement; put Unity content between foreground & background layers3. Different model versions for Quality / Speed tradeoff4. Linear/Gamma color spaces supported5. WebCamTexture support6. Unity VideoPlayer integration7. AVPro Live Camera integration (recommended instead of WebCamTexture)8. AVPro Video 3 integraionIdeal for+ Video processing+ Media installations+ Apps with video streaming (e.g. can be used with Agora.io)+ KiosksPerformance (barracuda)NVidia RTX3070+ Background removal: 300 FPS+ Depth estimation: 400 FPSNVidia GTX1050Ti (mobile)+ Background removal: 50 FPS+ Depth estimation: 80 FPSNote: only desktop platforms currently supported (tested on Windows DX11 and Linux Vulkan)Unity versions: 2021 and above (Unity 6 now supported)
