How to read frames from video as bitmaps in UWP

Question

Can I upload a video and extract individual frames (like images) from Universal Windows Applications?

Answer 1

There are two namespaces that allow you to receive frames:

• "Windows.Media.Capture namespace." Use it if you want to capture video from the camera, then read "Processing Media Using MediaFrameReader" https://docs.microsoft.com/en-us/windows/uwp/audio-video-camera/process-media-frames-with -mediaframereader
• "Windows.Media.Playback namespace." Use it if you want to get frames from a file or video stream. Scroll to "Use MediaPlayer in frame server mode" at https://docs.microsoft.com/en-us/windows/uwp/audio-video-camera/play-audio-and-video-with-mediaplayer

Answer 2

Can I upload a video and extract individual frames (like images) from Universal Windows Applications?

You can use MediaComposition.GetThumbnailAsync to get the image stream from the video. Then you can use RandomAccessStream.CopyAsync to convert IInputStream to InMemoryRandomAccessStream . We can add IRandomAccessStream to install BitmapSource.SetSource .

For instance:

private async void Button_Click(object sender, RoutedEventArgs e) { FileOpenPicker openPicker = new FileOpenPicker(); foreach (string extension in FileExtensions.Video) { openPicker.FileTypeFilter.Add(extension); } StorageFile file = await openPicker.PickSingleFileAsync(); var thumbnail = await GetThumbnailAsync(file); BitmapImage bitmapImage = new BitmapImage(); InMemoryRandomAccessStream randomAccessStream = new InMemoryRandomAccessStream(); await RandomAccessStream.CopyAsync(thumbnail, randomAccessStream); randomAccessStream.Seek(0); bitmapImage.SetSource(randomAccessStream); MyImage.Source = bitmapImage; } public async Task<IInputStream> GetThumbnailAsync(StorageFile file) { var mediaClip = await MediaClip.CreateFromFileAsync(file); var mediaComposition = new MediaComposition(); mediaComposition.Clips.Add(mediaClip); return await mediaComposition.GetThumbnailAsync( TimeSpan.FromMilliseconds(5000), 0, 0, VideoFramePrecision.NearestFrame); } internal class FileExtensions { public static readonly string[] Video = new string[] { ".mp4", ".wmv" }; }