Skip to content

Add on-device AI video enhancement with Play Services Media Effect Enhancement - #195

Open
MayuriKhinvasara wants to merge 1 commit into
mainfrom
VideoEnhance
Open

MayuriKhinvasara wants to merge 1 commit into
mainfrom
VideoEnhance

Conversation

@MayuriKhinvasara

Copy link
Copy Markdown
Contributor
  • Integrate Play Services Media Effect Enhancement SDK (16.0.0-beta08) in EnhancementMode.SURFACE for on-device AI video enhancement (Tonemap, Deblur & Denoise, and 2x RAISR Upscale).
  • Implement zero-copy GPU surface transcode pipeline (MediaExtractor -> hardware MediaCodec decoder -> session.inputSurface -> EnhancementSession -> hardware MediaCodec encoder -> MediaMuxer).
  • Enforce suspension-safe 1-to-1 frame lockstep backpressure via Channel.CONFLATED and onSurfaceProcessed callback.
  • Preserve BT.709 SDR color metadata, apply decode-order PTS queue remapping, copy audio track losslessly, and cap output resolution at 2560x1440 (2K).
  • Add background session pre-warming at app startup and post-run re-warm for 0 ms perceived session initialization latency.

…ect Enhancement

- Integrate Play Services Media Effect Enhancement SDK (16.0.0-beta08) in EnhancementMode.SURFACE for on-device AI video enhancement (Tonemap, Deblur & Denoise, and 2x RAISR Upscale).
- Implement zero-copy GPU surface transcode pipeline (MediaExtractor -> hardware MediaCodec decoder -> session.inputSurface -> EnhancementSession -> hardware MediaCodec encoder -> MediaMuxer).
- Enforce suspension-safe 1-to-1 frame lockstep backpressure via Channel.CONFLATED and onSurfaceProcessed callback.
- Preserve BT.709 SDR color metadata, apply decode-order PTS queue remapping, copy audio track losslessly, and cap output resolution at 2560x1440 (2K).
- Add background session pre-warming at app startup and post-run re-warm for 0 ms perceived session initialization latency.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants