update to m114

[cloudwebrtc]

Patches Group:

1, Readme and License aaf97b7

• Add Apache-2.0 license and some notes to README.md (Add Apache-2.0 license and some note to README.md. #9).
• Updated readme detailing changes from original (Updated readme detailing changes from original #42)
• Adding membrane framework (Adding membrane framework #51)

2, Audio Device Optimization 56b7119

• allow listen-only mode in AudioUnit, adjust when category changes (allow listen-only mode in AudioUnit, adjust when category changes #2)
• release mic when category changes (Release mic when category changes #5)
• Change defaults to iOS defaults (Change AVAudioSession defaults to iOS defaults #7)
• Sync audio session config (Sync audio session config #8)
• feat: support bypass voice processing for iOS. (feat: support bypass voice processing for iOS. #15)
• Remove MacBookPro audio pan right code ([Mac] Remove MacBookPro audio panning #22)
• fix: Fix can't open mic alone when built-in AEC is enabled. ([Windows] Fix can't open mic alone when built-in AEC is enabled. #29)
• feat: add audio device changes detect for Windows. (feat: add audio device changes detect for windows. #41)
• fix Linux compile (fix Linux compile #47)
• AudioUnit: Don't rely on category switch for mic indicator to turn off (AudioUnit: Don't rely on category switch for mic indicator to turn off #52)
• Stop recording on mute (turn off mic indicator) (Stop recording on mute (turn off mic indicator) #55)
• Cherry pick audio selection from m97 release (Cherry pick audio selection from m97 release #35)
• [Mac] Allow audio device selection ([Mac] Allow audio device selection #21)
• Simplify output / input audio device setting and getting through properties (Simplify output / input audio device setting and getting through properties #80)

3, Simulcast support for iOS/Android. 03dc44e

• Simulcast support for iOS SDK (Simulcast support for iOS SDK #4)
• Support for simulcast in Android SDK (Support for simulcast in Android SDK #3)
• include simulcast headers for mac also (Include simulcast headers for mac also #10)
• Fix simulcast using hardware encoder on Android (Fix simulcast using hardware encoder on Android #48)

4, Android improvements 378dc0b

• Start/Stop receiving stream method for VideoTrack (Start/Stop receiving stream method for VideoTrack #25)
• Properly remove observer upon deconstruction (Properly remove observer upon deconstruction #26)
• feat: Expose setCodecPreferences/getCapabilities for android. (feat: Expose setCodecPreferences/getCapabilities for android. #61)
• fix: add WrappedVideoDecoderFactory.java. (fix: add WrappedVideoDecoderFactory.java. #74)

5, Darwin improvements 2abe97d

• [Mac/iOS] feat: Add RTCYUVHelper for darwin. ([Mac/iOS] feat: Add RTCYUVHelper for darwin. #28)
• Cross-platform RTCMTLVideoView for both iOS / macOS (Cross-platform RTCMTLVideoView for both iOS / macOS #40)
• rotationOverride should not be assign (Fix: rotationOverride should not be assign #44)
• [ObjC] Expose properties / methods required for AV1 codec support ([ObjC] Expose properties / methods required for AV1 codec support #60)
• Workaround: Render PixelBuffer in RTCMTLVideoView (Workaround: Render PixelBuffer in RTCMTLVideoView #58)
• Improve iOS/macOS H264 encoder (Improve H264 encoder #70)
• Fix the video encoder not resuming correctly upon foregrounding (Fix video encoder not resuming correctly upon foregrounding #75)

6, Desktop Capture for macOS. bd6ba72

• [Mac] feat: Support screen capture for macOS. ([Mac] feat: Support screen capture for macOS. #24)
• fix: Get thumbnails asynchronously. (fix: Get thumbnails asynchronously. #37)
• fix: Use CVPixelBuffer to build DesktopCapture Frame, fix the crash caused by non-CVPixelBuffer frame in (Fixed macOS desktop capture crash with simulcast enabled #63)
• Fix the crash when setting the fps of the virtual camera. (Fix the crash when setting the fps of the virtual camera. #62)

7, Frame Cryptor Support. 4dd33c6

• feat: Frame Cryptor (aes gcm/cbc). (feat: Frame Cryptor (aes gcm/cbc). #54)
• feat: key ratchet/derive. (feat: key ratchet/derive. #66)
• fix: skip invalid key when decryption failed. (fix: skip invalid key when decryption failed. #81)

8, Other improvements. e86aeee

• Added yuv_helper (Added yuv_helper #57)
• ABGRToI420, ARGBToI420 & ARGBToRGB24 (ABGRToI420, ARGBToI420 & ARGBToRGB24 #65)

[cloudwebrtc]

hey @hiroshihorie, when you have time, can you help to see this diff 56b7119? I spent a lot of time re-adapting this big patch (which works fine), maybe you can take a look and prevent me from triggering new bugs.

[hiroshihorie]

@cloudwebrtc Sure, does it work fine ? Would like to compile it and test it out or can you send me a framework ?

[cloudwebrtc]

@hiroshihorie sure, here is the framework
https://github.com/webrtc-sdk/Specs/releases/tag/114.5735.01

Yes, it can run correctly on flutter iOS/macOS, and I also fixed the bug that the iOS enters the background and stops sending video track, maybe you can check that it works correctly in Swift

[davidzhao]

yay 🎆

[hiroshihorie]

Great job !