Change log:

• Tested on latest Unity LTS versions Unity 2021, 2022 and Unity 6
• Native: AudioOutput C++ to C# wrapper now allows to receive raw PCM audio from incoming calls via a separate thread
• Native: New passive audio layer added that blocks microphone and speaker access to allow Unity side users to handle their own playback and recording
• Native: New Unity AudioOutput example added. It shows how audio can be played back via an AudioSource with a panning effect applied
• Android: Added compatibility for Unity 6 “GameCanvas” flag in project settings
• Android: New Java-side VideoInput API added. This allows java side code to provide video data to a video call.
• Android: New Unity example added at extra/android/video that uses a custom camera capturer to change settings such as flash and zoom. Can be customized via ZoomFlashSessionConfigurator.java
• Mac: Removed some built-in WebRTC features that were inaccessible from C#

Update: Fixed in v1.0.6

If you create a new project for Android in Unity 6 and experience a crash on start-up please watch out for the following setting in the Android Build Settings under Edit -> Project Settings -> Player -> Android tab > scroll to Configuration:

This need to be set manually to Activity and GameActivity unticked on newly created projects. Existing projects upgraded from earlier Unity versions do not require any changes.

The main new feature for V1.0.4 is a new option to send raw audio and select the audio input device. For now Native(Win, Mac, iOS, Android) uses a different system than WebGL but this will be merged in the future.

Please help testing the new system via the scenes extra/AudioInput for Native platforms and extra/AudioWeb for WebGL.

Changelog:

• WebGL: Added new extra/AudioWeb example to show selection of audio input devices (will be merged with AudioInput scene later)
• Native: AudioInput C# calls added to allow sending of raw audio
• Native: extra/AudioInput example added. This demonstrates sending audio from an AudioSource or using Unity Microphone for audio input device selection
• Native: Added wrapper methods to control hardware audio effects
• Native: Turned off hardware audio effects by default. Echo cancellation will be handed via software now
• Native: AudioInput now supports multiple parallel audio input devices
• Windows: AudioOptions.echo_cancellation=true should work correctly now even if no incoming audio is received
• Fixed issues that could cause the video codec to automatically fallback to VP8
• Added readme files and a header to example apps
• Windows: Added workaround for playback issues via the Experimental audio layer if Dolby surround is used. For microphone access issues AudioInput can be used as a workaround.
• Signaling Server: Added support for tokens to allow only registered users to access the server
• Signaling Server: Removed the packaged zip file. Use https://github.com/because-why-not/awrtc_signaling instead.

We are looking for testers for the experimental Vision OS versions of WebRTC and WebRTC Video Chat.

For access to the vision pro build of WebRTC Video Chat please send your Unity Asset Store Invoice ID via e-mail to contact@because-why-not.com or contact @Christoph via Discord

You can also test the ports of libwebrtc and com.unity.webrtc:

• libwebrtc builds: webrtc visionpro releases
• libwebrtc source code and build scripts: webrtc visionpro github
• com.unity.webrtc fork test project with binaries: uwebrtc_visionpro_testproj releases
• com.unity.webrtc fork source code and build scripts: uwebrtc_visionpro github

• Update to WebRTC 120
• Mac: MacOSX min version is now 10.15
• iOS: Rebuild with iOS SDK 17.2
• Android: Rebuild with Android NDK 25 and SDK 34
• Android: minSdkVersion is now 21 for all architectures
• Changed setup of the native logger to ensure any errors during init are printed by default
• WebGL: Added BrowserMediaConfig to give access to more WebGL specific features. See folder scripts/browser
• WebGL: Selection of an input device is now in testing. Set it by using BrowserMediaConfig.AudioInputDevice and
  (UnityCallFactory.Instance.InternalFactory as Byn.Awrtc.Browser.BrowserCallFactory).GetAudioInputDevices().\
•  WebGL: Audio is now processed via the Web Audio API allowing audio processing within the Java Script plugin
• WebGL: Basic support for spatial audio via panning added via new method BrowserWebRtcCall.SetVolumePan
• WebGL: Improved autoplay block resolution. If a browser blocks audio play it will be resolved once the user interacts
  with the unity Canvas. iOS Safari might block autoplay until several touch interactions are received.

WebRTC Video Chat:

• WebGL: Fixed an issue with incorrectly setting the bitrate in Safari
• Android: Fixed a memory leak when shutting down the local camera
• Minor changes in preparation for the next HoloLens 2 update

Holo Video Chat:

• Added support for I420p frames output, skipping a copy and moving image processing to the GPU
• Output of ARGB frames is sped up
• VideoInput will move images to C++ and convert them in a single step and speed up image processing
• Reduced memory usage and reliance on C# garbage collectio
• Added a very high quality setting but with 15 FPS
• Improved documentation and made sure the xml IDE docs are included

WebRtc Video Chat:

• Updated and Tested with unity 2021 and 2022 LTS. The Unity C# projects will now require the newer Unity versions but the C# API continues to work with Unity 2020
• MediaConfig.VideoBitrateKbits added to allow setting a target birate (appears to default to 2500 kbits which is too low for HD and higher)
• MediaConfig.VideoContentHint added. This can be set to motion, detail or text to optimize the video stream for specific content
• MAINTAIN_RESOLUTION flag is removed. Set VideoContentHint to detail instead
• MediaConfig.VideoCodecs added. This allows to set a list of codecs to priotize (VP8, VP9, AV1 are usually supported. H264 on iOS and some browsers)
• RequestStats and RtcStatsEvent added to BrowserWebRtcCall (webgl) and NativeWebRtcCall(all other except UWP). This can be used to check on the current bitrate, used codecs and more
• Native: NativeMediaConfig.FrameBuffer = true is now the default to help with fluent video playback at low render FPS
• The VideoInput example scene now shows an animated panorama image to allow testing with different birate requrements
• WebGL: Calling Unity_Media_EnableScreenCapture(“screen”, true) allows capturing the screen with system audio if supported by the browser.

Holo Video Chat:

• Fixed several issues within the wrapper that could cause stalls (deadlock in the SDK) and crashes (leaking of the video tracks that resulted in the camera to remain active)
• fixed crash causing issue when deactivating EyeTracking. This resulted in the system to restart accessing the camera directly while the VideoTransformer might still access the camera
• camera access is now delayed by 2 seconds or so
• Made the log more chatty to hopefully better be able to reproduce any crashes
• Added different VideoQuality structs to make changing it easier

The new version is now available in the asset store.

Changelog:

• Updated to WebRTC 110
• From now on, example apps will be saved in Unity 2020. The C# API will continue to work in Unity 2019.
• Android: min API level should be set to 21 now
• Logging enhancements: Most logs now include the ownership hierarchy to manage multiple parallel calls
• Updated all third party dependencies including websocket-sharp and all WebGL npm dependencies
• awrtc_signaling: updated dependencies and changed the default config to support IPv6
• Fixed some incorrect namespaces in Byn.Awrtc.Native.dll
• Native: Major changes in how the audio functions. Let me know if any new bugs show up
• Native: Added first experimental support for custom AudioInput via the C# wrapper WebRtcCSharp.AudioInput. Example apps will be made available later.
• Native: Added UnityCallFactory.Config for testing purposes. It will allow turning on global experimental changes such as the new windows audio module
• Native: Added NativeMediaConfig.FrameBuffer. If set to true this will add a 1 frame long frame buffer to smooth the video frame rate.
• Native: Added NativeMediaConfig.ReturnLocalVideo. This is true by default and can be set to false to increase performance if access to the local video feed is not required within C#
• Native: Added PeerFactoryConfig to the native API to allow changing global settings and use multiple factories in parallel in the future
• Windows: Added support for the newer WebRTC audio module. This can be set via the UnityCallFactory.Config (must be set before the factory is initialized)

From now on a docker based setup is supported for the signaling server. With this setting up a new signaling server should only take a few minutes including getting a SSL certificate from letsencrypt.

Requirements:

• basic understanding of the linux command line, ssh and docker
• a linux server with docker and docker-compose installed (tested with ubuntu 22)
• a public domain that points to your servers IP address
• an open TCP port 80 and 443

For more info please check out the awrtc_signaling_docker github repository.

You can find it here: Holo Video Chat

Holo Video Chat contains a port of the WebRTC Video Chat plugin for UWP x86, x64 and ARM 32 for the HoloLens 2. It includes the same ICall, IMediaNetwork and IVideoInput C# interfaces that are available for the other platforms.

Holo Video Chat is compatible to WebRTC Video Chat on a network level and it can be used to connect the HoloLens 2 to all other platforms including browser based apps developed on top of awrtc_browser.

For more information check out the Holo Video Chat guide!