AVAssetReader && AVAssetWriter

对媒体数据资源进行简单的转码或裁剪，使用 AVAssetExportSession 类便足够了，但是更深层次的修改媒体资源，便需要用到 AVAssetReader 类和 AVAssetWriter 类。

AVAssetReader

AVAssetReader 只能与一个资源 asset 相关联，且不能用来读取实时数据，在开始读取数据之前，需要为 reader 添加 AVAssetReaderOutput 的实例对象。这个实例对象描述的是待读取的数据资源来源类型，通常使用 AVAssetReaderAudioMixOutput 、AVAssetReaderTrackOutput 、AVAssetReaderVideoCompositionOutput 三种子类。

使用该类读取媒体资源，其提供的初始化方法与一个 asset 相关联。

  1. //对于提供的参数 asset ，如果是可被修改的，那么在开始读取操作后，对其进行了修改，之后的读取操作都是无效的
  2. + (nullable instancetype)assetReaderWithAsset:(AVAsset *)asset error:(NSError * _Nullable * _Nullable)outError;
  3. - (nullable instancetype)initWithAsset:(AVAsset *)asset error:(NSError * _Nullable * _Nullable)outError NS_DESIGNATED_INITIALIZER;
  5. //当前读取操作的状态，可取值有 AVAssetReaderStatusUnknown 、AVAssetReaderStatusReading 、
  6. AVAssetReaderStatusCompleted 、AVAssetReaderStatusFailed 、AVAssetReaderStatusCancelled
  7. @property (readonly) AVAssetReaderStatus status;
  8. //当 status 的值为 AVAssetReaderStatusFailed 时，描述错误信息
  9. @property (readonly, nullable) NSError *error;
  12. //限制可读取的资源的时间范围
  13. @property (nonatomic) CMTimeRange timeRange;
  15. //判断能否添加该数据源
  16. - (BOOL)canAddOutput:(AVAssetReaderOutput *)output;
  17. //添加数据源
  18. - (void)addOutput:(AVAssetReaderOutput *)output;
  20. //开始读取
  21. - (BOOL)startReading;
  22. //结束读取
  23. - (void)cancelReading;

AVAssetReaderOutput

AVAssetReaderOutput 是用来描述待读取的数据的抽象类，读取资源时，应创建该类的对象，并添加到相应的 AVAssetReader 实例对象中去。

  1. //获取的媒体数据的类型
  2. @property (nonatomic, readonly) NSString *mediaType;
  4. //是否拷贝缓存中的数据到客户端，默认 YES ，客户端可以随意修改数据，但是为优化性能，通常设为 NO
  5. @property (nonatomic) BOOL alwaysCopiesSampleData NS_AVAILABLE(10_8, 5_0);
  7. //同步获取下一个缓存数据，使用返回的数据结束后，应使用 CFRelease 函数将其释放
  8. //当错误或没有数据可读取时，返回 NULL ，返回空后，应检查相关联的 reader 的状态
  9. - (nullable CMSampleBufferRef)copyNextSampleBuffer CF_RETURNS_RETAINED;
  11. //是否支持重新设置数据的读取时间范围，即能否修改 reader 的 timeRange 属性
  12. @property (nonatomic) BOOL supportsRandomAccess NS_AVAILABLE(10_10, 8_0);
  13. //设置重新读取的时间范围，这个时间范围集合中的每一个时间范围的开始时间必需是增长的且各个时间范围不能重叠
  14. //应在 reader 调用 copyNextSampleBuffer 方法返回 NULL 之后才可调用
  15. - (void)resetForReadingTimeRanges:(NSArray<NSValue *> *)timeRanges NS_AVAILABLE(10_10, 8_0);
  16. //该方法调用后，上面的方法即不可再调用，同时 reader 的状态也不会被阻止变为 AVAssetReaderStatusCompleted 了
  17. - (void)markConfigurationAsFinal NS_AVAILABLE(10_10, 8_0);

AVAssetReaderTrackOutput

AVAssetReaderTrackOutput 是 AVAssetReaderOutput 的子类，它用来描述待读取的数据来自 asset track ，在读取前，还可以对数据的格式进行修改。

  1. //初始化方法，参数中指定了 track 和 媒体的格式
  2. //指定的 track 应在 reader 的 asset 中
  3. + (instancetype)assetReaderTrackOutputWithTrack:(AVAssetTrack *)track outputSettings:(nullable NSDictionary<NSString *, id> *)outputSettings;
  4. - (instancetype)initWithTrack:(AVAssetTrack *)track outputSettings:(nullable NSDictionary<NSString *, id> *)outputSettings NS_DESIGNATED_INITIALIZER;
  6. //指定音频处理时的算法
  7. @property (nonatomic, copy) NSString *audioTimePitchAlgorithm NS_AVAILABLE(10_9, 7_0);

AVAssetReaderAudioMixOutput

AVAssetReaderAudioMixOutput 是 AVAssetReaderOutput 的子类，它用来描述待读取的数据来自音频组合数据。创建该类实例对象提供的参数 audioTracks 集合中的每一个 asset track 都属于相应的 reader 中的 asset 实例对象，且类型为 AVMediaTypeAudio 。

  1. + (instancetype)assetReaderAudioMixOutputWithAudioTracks:(NSArray<AVAssetTrack *> *)audioTracks audioSettings:(nullable NSDictionary<NSString *, id> *)audioSettings;
  2. - (instancetype)initWithAudioTracks:(NSArray<AVAssetTrack *> *)audioTracks audioSettings:(nullable NSDictionary<NSString *, id> *)audioSettings NS_DESIGNATED_INITIALIZER

AVAssetReaderVideoCompositionOutput

AVAssetReaderVideoCompositionOutput 是 AVAssetReaderOutput 的子类，该类用来表示要读取的类是组合的视频数据。
同 AVAssetReaderAudioMixOutput 类似，该类也提供了两个创建实例的方法，需要提供的参数的 videoTracks 集合中每一个 track 都是 与 reader 相关联的 asset 中的 track 。

  1. + (instancetype)assetReaderVideoCompositionOutputWithVideoTracks:(NSArray<AVAssetTrack *> *)videoTracks videoSettings:(nullable NSDictionary<NSString *, id> *)videoSettings;
  2. - (instancetype)initWithVideoTracks:(NSArray<AVAssetTrack *> *)videoTracks videoSettings:(nullable NSDictionary<NSString *, id> *)videoSettings NS_DESIGNATED_INITIALIZER;

AVAssetWriter

AVAssetWriter 类可以将媒体数据从多个源写入指定文件格式的单个文件。我们也不需要将 asset writer 对象与特定 asset 相关联，但必须为要创建的每个输出文件使用单独的 asset writer。由于 asset writer 可以从多个来源写出媒体数据，因此我们必须为每个要被写入到输出文件的轨道创建一个 AVAssetWriterInput 对象。每个 AVAssetWriterInput 对象都期望以 CMSampleBufferRef 对象的形式接收数据，但是如果要将 CVPixelBufferRef 对象附加到 asset writer，可以使用 AVAssetWriterInputPixelBufferAdaptor 类。

  1. // AVAssetWriter 创建函数，需要指定输出文件的 URL 和所需的文件类型
  2. + (nullable instancetype)assetWriterWithURL:(NSURL *)outputURL fileType:(AVFileType)outputFileType error:(NSError * _Nullable * _Nullable)outError;
  3. - (nullable instancetype)initWithURL:(NSURL *)outputURL fileType:(AVFileType)outputFileType error:(NSError * _Nullable * _Nullable)outError NS_DESIGNATED_INITIALIZER;

AVAssetWriterInput

想要用 asset writer 来写媒体数据，必须至少设置一个 asset writer input。例如，如果数据源已经使用 CMSampleBufferRef 类来表示，那么使用 AVAssetWriterInput 类即可。

  1. - (instancetype)initWithMediaType:(AVMediaType)mediaType outputSettings:(nullable NSDictionary<NSString *, id> *)outputSettings;
  2. 使用例子
  3. 在本例子中，我们创建 ResourceSession 用于管理我们的资源读取和写入，该类主要有以下两个方法
  5. @interface ResourceSession : NSObject
  6. // 使用指定的 asset 初始化 session
  7. - (instancetype)initWithAsset:(AVAsset *)asset;
  9. // 开始转换
  10. - (void)startWithOutputURL:(NSURL *)url;
  12. @end

我们需要将 asset 资源中 videoTrack 和 audioTrack 的数据给读取出来，并写入到指定文件中；所以这里我们统一使用 SampleBufferChannel 这个类目去处理 SampleBuffer 的读取和写入功能

  1. @interface SampleBufferChannel () {
  2.     // 写入队列
  3.     dispatch_queue_t _serializationQueue;
  4.     // 完成回调
  5.     dispatch_block_t _completionHandler;
  6. }
  7. // 媒体类型
  8. @property (nonatomic, copy) NSString *mediaType;
  9. // 数据读取
  10. @property (nonatomic, strong) AVAssetReaderOutput *assetReaderOutput;
  11. // 数据写入
  12. @property (nonatomic, strong) AVAssetWriterInput *assetWriterInput;
  14. @end
  16. @implementation SampleBufferChannel
  17. // 初始化当前输入输出
  18. - (instancetype)initWithAssetReaderOutput:(AVAssetReaderOutput *)assetReaderOutput
  19.                          assetWriterInput:(AVAssetWriterInput *)assetWriterInput {
  20.     if (self = [super init]) {
  21.         _assetReaderOutput = assetReaderOutput;
  22.         _assetWriterInput = assetWriterInput;
  23.         _serializationQueue = dispatch_queue_create("com.SampleBufferChannel.serialQueue", NULL);
  24.     }
  25.     return self;
  26. }
  27. // 开始读取
  28. - (void)startWithDelegate:(id <SampleBufferChannelDelegate>)delegate completionHandler:(dispatch_block_t)completionHandler {
  29.     _completionHandler = [completionHandler copy];
  30.     __weak typeof(self) weakSelf = self;
  31.     // AVAssetWriterInput 请求媒体数据，当 readyForMoreMediaData 的时候可以写入
  32.     [self.assetWriterInput requestMediaDataWhenReadyOnQueue:_serializationQueue usingBlock:^{
  33.         __strong typeof(weakSelf) strongSelf = weakSelf;
  34.         BOOL completedOrFailed = NO;
  35.         while ([strongSelf.assetWriterInput isReadyForMoreMediaData] && !completedOrFailed) {
  36.         // 获取下一个 SampleBuffer 写入，当到结束时间点的时候，返回空
  37.             CMSampleBufferRef sampleBuffer = [strongSelf.assetReaderOutput copyNextSampleBuffer];
  38.             if (sampleBuffer) {
  39.                 // 写入数据
  40.                 BOOL success = [strongSelf.assetWriterInput appendSampleBuffer:sampleBuffer];
  41.                 CFRelease(sampleBuffer);
  42.                 sampleBuffer = NULL;
  43.                 completedOrFailed = !success;
  44.             } else {
  45.                 completedOrFailed = YES;
  46.             }
  47.         }
  48.         if (completedOrFailed) {
  49.             [strongSelf callCompletionHandler];
  50.         }
  51.     }];
  52. }
  54. - (void)callCompletionHandler {
  55.     // let the asset writer know that we will not be appending any more samples to this input
  56.     [self.assetWriterInput markAsFinished];
  57.     if (_completionHandler) {
  58.         _completionHandler();
  59.     }
  60. }
  62. @end

回到我们的 ResourceSession，实现我们的初始化函数

  1. - (instancetype)initWithAsset:(AVAsset *)asset {
  2.     self = [super init];
  3.     if (self) {
  4.         _asset = asset;
  5.         _serializationQueue = dispatch_queue_create("com.ResourceSession.serialQueue", NULL);
  6.     }
  7.     return self;
  8. }

开始转换

  1. - (void)startWithOutputURL:(NSURL *)url {
  2.     self.outputURL = url;
  3.     NSArray *keys = @[@"tracks", @"duration"];
  4.     __weak typeof(self) weakSelf = self;
  5.     // 判断当前属性是否已经准备好
  6.     [self.asset loadValuesAsynchronouslyForKeys:keys completionHandler:^{
  7.         __strong typeof(weakSelf) strongSelf = weakSelf;
  8.         dispatch_async(strongSelf->_serializationQueue, ^{
  9.             BOOL success = YES;
  10.             NSError *localError = nil;
  11.             // 获取对应属性
  12.             success = ([strongSelf.asset statusOfValueForKey:@"tracks" error:&localError] == AVKeyValueStatusLoaded);
  13.             if (success) {
  14.                 success = ([strongSelf.asset statusOfValueForKey:@"duration" error:&localError] == AVKeyValueStatusLoaded);
  15.             }
  16.             if (success) {
  17.                 strongSelf.timeRange = CMTimeRangeMake(kCMTimeZero, strongSelf.asset.duration);
  18.                 NSFileManager *fm = [NSFileManager defaultManager];
  19.                 NSString *path = [url path];
  20.                 if ([fm fileExistsAtPath:path]) {
  21.                     success = [fm removeItemAtPath:path error:&localError];
  22.                 }
  23.             }
  24.             if (success) {
  25.                 // 创建并初始化 Reader、Writer
  26.                 success = [strongSelf setupReaderAndWriterReturningError:&localError];
  27.             }
  28.             if (success) {
  29.                 // 开始转换
  30.                 success = [self startReadingAndWritingReturningError:&localError];
  31.             }
  32.             if (!success) {
  33.                 NSLog(@"not success");
  34.                 [self.assetReader cancelReading];
  35.                 [self.assetWriter cancelWriting];
  36.             }
  37.         });
  38.     }];
  39. }
  40. 创建并初始化 Reader、Writer
  42. - (BOOL)setupReaderAndWriterReturningError:(NSError **)outError {
  43.     BOOL success = YES;
  44.     NSError *localError = nil;
  45.     // 创建 AVAssetReader
  46.     self.assetReader = [[AVAssetReader alloc] initWithAsset:self.asset error:&localError];
  47.     success = self.assetReader != nil;
  48.     if (success) {
  49.         // 创建 AVAssetWriter
  50.         self.assetWriter = [[AVAssetWriter alloc] initWithURL:self.outputURL fileType:AVFileTypeMPEG4 error:&localError];
  51.         success = self.assetWriter != nil;
  52.     }
  53.     if (!success) {
  54.         *outError = localError;
  55.         return success;
  56.     }
  57.     AVAssetTrack *audioTrack = nil;
  58.     AVAssetTrack *videoTrack = nil;
  59.     // 获取 Audio Track
  60.     NSArray *audioTracks = [self.asset tracksWithMediaType:AVMediaTypeAudio];
  61.     if ([audioTracks count] > 0) {
  62.         audioTrack = [audioTracks objectAtIndex:0];
  63.     }
  64.     // 获取 Video Track
  65.     NSArray *videoTracks = [self.asset tracksWithMediaType:AVMediaTypeVideo];
  66.     if ([videoTracks count] > 0) {
  67.         videoTrack = [videoTracks objectAtIndex:0];
  68.     }
  69.     if (audioTrack) {
  70.         // 设置指定读入格式为 PCM
  71.         NSDictionary *decompressionAudioSettings = @{AVFormatIDKey: @(kAudioFormatLinearPCM)};
  72.         // 指定 track、setting 初始化 AVAssetReaderOutput
  73.         AVAssetReaderOutput *output = [AVAssetReaderTrackOutput assetReaderTrackOutputWithTrack:audioTrack outputSettings:decompressionAudioSettings];
  74.         [self.assetReader addOutput:output];
  76.         AudioChannelLayout stereoChannelLayout = {
  77.             .mChannelLayoutTag = kAudioChannelLayoutTag_Stereo,
  78.             .mChannelBitmap = 0,
  79.             .mNumberChannelDescriptions = 0
  80.         };
  81.         NSData *channelLayoutAsData = [NSData dataWithBytes:&stereoChannelLayout length:offsetof(AudioChannelLayout, mChannelDescriptions)];
  83.         // 指定输出格式
  84.         NSDictionary *compressionAudioSettings = @{AVFormatIDKey: @(kAudioFormatMPEG4AAC),
  85.                                                    AVEncoderBitRateKey: @(128000),
  86.                                                    AVSampleRateKey: @(44100),
  87.                                                    AVChannelLayoutKey: channelLayoutAsData,
  88.                                                    AVNumberOfChannelsKey: @(2)};
  89.         AVAssetWriterInput *input = [AVAssetWriterInput assetWriterInputWithMediaType:[audioTrack mediaType] outputSettings:compressionAudioSettings];
  90.         // 添加 input
  91.         [self.assetWriter addInput:input];
  92.         self.audioSampleBufferChannel = [[SampleBufferChannel alloc] initWithAssetReaderOutput:output assetWriterInput:input];
  93.     }
  94.     if (videoTrack) {
  95.          // 设置指定读入格式 ARGB
  96.         NSDictionary *decompressionVideoSettings = @{(id)kCVPixelBufferPixelFormatTypeKey: @(kCVPixelFormatType_32ARGB),
  97.                                                      (id)kCVPixelBufferIOSurfacePropertiesKey: @{}};
  98.         AVAssetReaderOutput *output = [AVAssetReaderTrackOutput assetReaderTrackOutputWithTrack:videoTrack outputSettings:decompressionVideoSettings];
  99.         [self.assetReader addOutput:output];
  101.         // 获取当前视频 formatDescription
  102.         CMFormatDescriptionRef formatDescription = NULL;
  103.         NSArray *formatDescriptions = [videoTrack formatDescriptions];
  104.         if ([formatDescriptions count] > 0) {
  105.             formatDescription = (__bridge CMFormatDescriptionRef)[formatDescriptions objectAtIndex:0];
  106.         }
  108.         // 获取视频尺寸
  109.         CGSize trackDimensions = CGSizeZero;
  110.         if (formatDescription) {
  111.             trackDimensions = CMVideoFormatDescriptionGetPresentationDimensions(formatDescription, false, false);
  112.         } else {
  113.             trackDimensions = [videoTrack naturalSize];
  114.         }
  116.         // Grab clean aperture, pixel aspect ratio from format description
  117.         NSDictionary *compressionSettings = nil;
  118.         if (formatDescription) {
  119.             NSDictionary *cleanAperture = nil;
  120.             NSDictionary *pixelAspectRatio = nil;
  121.             CFDictionaryRef cleanApertureFromCMFormatDescription = CMFormatDescriptionGetExtension(formatDescription, kCMFormatDescriptionExtension_CleanAperture);
  122.             if (cleanApertureFromCMFormatDescription) {
  123.                 cleanAperture = @{AVVideoCleanApertureWidthKey: (NSNumber *)CFDictionaryGetValue(cleanApertureFromCMFormatDescription, kCMFormatDescriptionKey_CleanApertureWidth),
  124.                                   AVVideoCleanApertureHeightKey:  (NSNumber *)CFDictionaryGetValue(cleanApertureFromCMFormatDescription, kCMFormatDescriptionKey_CleanApertureHeight),
  125.                                   AVVideoCleanApertureHorizontalOffsetKey: (NSNumber *)CFDictionaryGetValue(cleanApertureFromCMFormatDescription, kCMFormatDescriptionKey_CleanApertureHorizontalOffset),
  126.                                   AVVideoCleanApertureVerticalOffsetKey: (NSNumber *)CFDictionaryGetValue(cleanApertureFromCMFormatDescription, kCMFormatDescriptionKey_CleanApertureVerticalOffset)};
  127.             }
  128.             CFDictionaryRef pixelAspectRatioFromCMFormatDescription = CMFormatDescriptionGetExtension(formatDescription, kCMFormatDescriptionExtension_PixelAspectRatio);
  129.             if (pixelAspectRatioFromCMFormatDescription) {
  130.                 pixelAspectRatio = @{AVVideoPixelAspectRatioHorizontalSpacingKey: (NSNumber *)CFDictionaryGetValue(pixelAspectRatioFromCMFormatDescription, kCMFormatDescriptionKey_PixelAspectRatioHorizontalSpacing),
  131.                                      AVVideoPixelAspectRatioVerticalSpacingKey: (NSNumber *)CFDictionaryGetValue(pixelAspectRatioFromCMFormatDescription, kCMFormatDescriptionKey_PixelAspectRatioVerticalSpacing)};
  132.             }
  133.             if (cleanAperture || pixelAspectRatio)
  134.             {
  135.                 NSMutableDictionary *mutableCompressionSettings = [NSMutableDictionary dictionary];
  136.                 if (cleanAperture)
  137.                     [mutableCompressionSettings setObject:cleanAperture forKey:AVVideoCleanApertureKey];
  138.                 if (pixelAspectRatio)
  139.                     [mutableCompressionSettings setObject:pixelAspectRatio forKey:AVVideoPixelAspectRatioKey];
  140.                 compressionSettings = mutableCompressionSettings;
  141.             }
  142.         }
  143.         // 指定输出格式 H.264
  144.         NSMutableDictionary *videoSettings = @{AVVideoCodecKey: AVVideoCodecTypeH264,
  145.                                                AVVideoWidthKey: @(trackDimensions.width),
  146.                                                AVVideoHeightKey: @(trackDimensions.height)}.mutableCopy;
  147.         if (compressionSettings) {
  148.             videoSettings[AVVideoCompressionPropertiesKey] = compressionSettings;
  149.         }
  150.         AVAssetWriterInput *input = [AVAssetWriterInput assetWriterInputWithMediaType:[videoTrack mediaType] outputSettings:videoSettings];
  151.         [self.assetWriter addInput:input];
  152.         self.videoSampleBufferChannel = [[SampleBufferChannel alloc] initWithAssetReaderOutput:output assetWriterInput:input];
  153.     }
  154.     if (outError) {
  155.         *outError = localError;
  156.     }
  157.     return success;
  158. }

开始转换

  1. - (BOOL)startReadingAndWritingReturningError:(NSError **)outError {
  2.     BOOL success = YES;
  3.     NSError *localError = nil;
  5.     // start
  6.     success = [self.assetReader startReading];
  7.     if (!success) {
  8.         localError = self.assetReader.error;
  9.     }
  10.     if (success) {
  11.         success = [self.assetWriter startWriting];
  12.         if (!success) {
  13.             localError = self.assetWriter.error;
  14.         }
  15.     }
  16.     if (success) {
  17.         dispatch_group_t dispatchGroup = dispatch_group_create();
  18.         [self.assetWriter startSessionAtSourceTime:self.timeRange.start];
  19.         if (self.audioSampleBufferChannel) {
  20.             dispatch_group_enter(dispatchGroup);
  21.             [self.audioSampleBufferChannel startWithDelegate:self completionHandler:^{
  22.                 dispatch_group_leave(dispatchGroup);
  23.             }];
  24.         }
  25.         if (self.videoSampleBufferChannel)
  26.         {
  27.             dispatch_group_enter(dispatchGroup);
  28.             [self.videoSampleBufferChannel startWithDelegate:self completionHandler:^{
  29.                 dispatch_group_leave(dispatchGroup);
  30.             }];
  31.         }
  32.         dispatch_group_notify(dispatchGroup, _serializationQueue, ^{
  33.             // end
  34.             BOOL finalSuccess = YES;
  35.             NSError *finalError = nil;
  36.             if (self.cancelled) {
  37.                 [self.assetReader cancelReading];
  38.                 [self.assetWriter cancelWriting];
  39.             } else {
  40.                 if (self.assetReader.status == AVAssetReaderStatusFailed) {
  41.                     finalSuccess = NO;
  42.                     finalError = self.assetReader.error;
  43.                 }
  44.                 if (finalSuccess) {
  45.                     [self.assetWriter finishWritingWithCompletionHandler:^{
  46.                         NSLog(@"finished");
  47.                     }];
  48.                 }
  49.             }
  50.         });
  51.     }
  52.     if (outError) {
  53.         *outError = localError;
  54.     }
  56.     return success;
  57. }

如果你正在跳槽或者正准备跳槽不妨动动小手，添加一下咱们的交流群1012951431来获取一份详细的大厂面试资料为你的跳槽多添一份保障。

更多精彩分享