OMX Codec介绍

概述

OMX Codec是stagefrightplayer中负责解码的模块。

由于遵循openmax接口规范，因此结构稍微有点复杂，这里就依照awesomeplayer中的调用顺序来介绍。

主要分如下几步：

1 mClient->connect

2 InitAudioDecoder & InitVideoDecoder

3 消息通信机制模型的介绍

4 解码过程介绍

先看下类图

这里OMX Codec是以service的方式提供服务的。Awesomeplayer中通过mOmx(IOMX) 作为客户端通过binder方式与OMX 通信完成解码的工作

下面一句具体代码分析

1 mClient->connect

在awesomeplayer的构造函数中调用，具体代码如下

[html] view plain copy

1. AwesomePlayer::AwesomePlayer()

2. {

3. ******

4. CHECK_EQ(mClient.connect(), (status_t)OK);

5. ******

6. }

看下具体实现

[html] view plain copy

1. status_t OMXClient::connect() {

2. sp<IServiceManager> sm = defaultServiceManager();

3. sp<IBinder> binder = sm->getService(String16("media.player"));

4. sp<IMediaPlayerService> service = interface_cast<IMediaPlayerService>(binder);

5.

6. CHECK(service.get() != NULL);

7.

8. mOMX = service->getOMX();

9. CHECK(mOMX.get() != NULL);

10.

11. if (!mOMX->livesLocally(NULL /* node */, getpid())) {

12. ALOGI("Using client-side OMX mux.");

13. mOMX = new MuxOMX(mOMX);

14. }

15.

16. return OK;

17. }

这里主要就是通过binder机制与mediaplayerservice通信来完成，具体实现看mediaplayerservice

[html] view plain copy

1. sp<IOMX> MediaPlayerService::getOMX() {

2. Mutex::Autolock autoLock(mLock);

3. if (mOMX.get() == NULL) {

4. mOMX = new OMX;

5. }

6. return mOMX;

7. }

主要就是构造一个OMX对象返回给上层保存在mClient的IOMX对象mOmx中

看下构造函数都做了啥

[html] view plain copy

1. OMX::OMX()

2. : mMaster(new OMXMaster),

3. mNodeCounter(0) {

4. }

在构造函数中又调用了OMXMaster的构造函数，代码如下

[html] view plain copy

1. OMXMaster::OMXMaster()

2. : mVendorLibHandle(NULL) {

3. addVendorPlugin();

4. addPlugin(new SoftOMXPlugin);

5. }

这里OMXMaster可以看成是解码器的入口，通过makeComponentInstance建立解码器的实例，之后就可以进行解码操作了。

这里我们以软件解码器插件为例来看整个流程，主要是addPlugin(newSoftOMXPlugin);先看SoftOMXPlugin构造函数

[html] view plain copy

1. SoftOMXPlugin::SoftOMXPlugin() {

2. }

是空的~~

再看下addPlugin代码

[html] view plain copy

1. void OMXMaster::addPlugin(OMXPluginBase *plugin) {

2. Mutex::Autolock autoLock(mLock);

3.

4. mPlugins.push_back(plugin);

5.

6. OMX_U32 index = 0;

7.

8. char name[128];

9. OMX_ERRORTYPE err;

10. while ((err = plugin->enumerateComponents(

11. name, sizeof(name), index++)) == OMX_ErrorNone) {

12. String8 name8(name);

13.

14. if (mPluginByComponentName.indexOfKey(name8) >= 0) {

15. ALOGE("A component of name '%s' already exists, ignoring this one.",

16. name8.string());

17.

18. continue;

19. }

20.

21. mPluginByComponentName.add(name8, plugin);

22. }

23.

24. if (err != OMX_ErrorNoMore) {

25. ALOGE("OMX plugin failed w/ error 0x%08x after registering %d "

26. "components", err, mPluginByComponentName.size());

27. }

28. }

这里传入的plugin参数时上面SoftOMXPlugin 构造函数产生的实例

从代码可以看出主要是将enumerateComponents枚举出来的各种解码器存放在成员变量mPluginByComponentName中，类型为 KeyedVector<String8, OMXPluginBase *>

看下enumerateComponents实现

[html] view plain copy

1. static const struct {

2. const char *mName;

3. const char *mLibNameSuffix;

4. const char *mRole;

5.

6. } kComponents[] = {

7. { "OMX.google.aac.decoder", "aacdec", "audio_decoder.aac" },

8. { "OMX.google.aac.encoder", "aacenc", "audio_encoder.aac" },

9. { "OMX.google.amrnb.decoder", "amrdec", "audio_decoder.amrnb" },

10. { "OMX.google.amrnb.encoder", "amrnbenc", "audio_encoder.amrnb" },

11. { "OMX.google.amrwb.decoder", "amrdec", "audio_decoder.amrwb" },

12. { "OMX.google.amrwb.encoder", "amrwbenc", "audio_encoder.amrwb" },

13. { "OMX.google.h264.decoder", "h264dec", "video_decoder.avc" },

14. { "OMX.google.h264.encoder", "h264enc", "video_encoder.avc" },

15. { "OMX.google.g711.alaw.decoder", "g711dec", "audio_decoder.g711alaw" },

16. { "OMX.google.g711.mlaw.decoder", "g711dec", "audio_decoder.g711mlaw" },

17. { "OMX.google.h263.decoder", "mpeg4dec", "video_decoder.h263" },

18. { "OMX.google.h263.encoder", "mpeg4enc", "video_encoder.h263" },

19. { "OMX.google.mpeg4.decoder", "mpeg4dec", "video_decoder.mpeg4" },

20. { "OMX.google.mpeg4.encoder", "mpeg4enc", "video_encoder.mpeg4" },

21. { "OMX.google.mp3.decoder", "mp3dec", "audio_decoder.mp3" },

22. { "OMX.google.vorbis.decoder", "vorbisdec", "audio_decoder.vorbis" },

23. { "OMX.google.vpx.decoder", "vpxdec", "video_decoder.vpx" },

24. { "OMX.google.raw.decoder", "rawdec", "audio_decoder.raw" },

25. { "OMX.google.flac.encoder", "flacenc", "audio_encoder.flac" },

26. };

[html] view plain copy

1. OMX_ERRORTYPE SoftOMXPlugin::enumerateComponents(

2. OMX_STRING name,

3. size_t size,

4. OMX_U32 index) {

5. if (index >= kNumComponents) {

6. return OMX_ErrorNoMore;

7. }

8.

9. strcpy(name, kComponents[index].mName);

10.

11. return OMX_ErrorNone;

12. }

这里enumerateComponents主要就是将数组kComponents中的以为index下标的plugin传递出来

这里只是将插件名字返回最终存储在mPluginByComponentName列表中

后面还会通过makeComponentInstance产生实际的解码器实例，后面再详细看

至此mClient->connect()就结束了。

这里的主要工作就是通过getOMX（）在mediaplayerservice端构造一个OMX实例，并返回给mClient的IOMX成员mOmx中

而且在OMX的构造函数中调用OMXMaster的构造函数，可以通过makeComponentInstance 建立实际的解码器实例。

2 InitAudioDecoder & InitVideoDecoder

awesomeplayer构造函数结束后，在setDataSource之后会调用prepare方法，其实现中会调用initAudioDecoder和initVideoDecoder

由于在setDataSource中已经拿到了对应的解码器信息，因此此处initAudioDecoder 便可以构造实际的解码器了。以audio为例

[html] view plain copy

1. status_t AwesomePlayer::initAudioDecoder() {

2. mAudioSource = OMXCodec::Create(

3.

4. mClient.interface(), mAudioTrack->getFormat(),

5. false, // createEncoder

6.

7. mAudioTrack);}

8.

9. status_t err = mAudioSource->start();

10.

11. return mAudioSource != NULL ? OK : UNKNOWN_ERROR;

12.

13. }

这里只列出的主要操作，下面依次来看OMXCodec::Create和mAudioSource->start的主要工作

代码比较多，我们这里主要将重要的代码列出，无关代码省略

[html] view plain copy

1. sp<MediaSource> OMXCodec::Create(*）

2. {

3.

4. findMatchingCodecs(

5. mime, createEncoder, matchComponentName, flags, &matchingCodecs);

6.

7. sp<OMXCodecObserver> observer = new OMXCodecObserver;

8. IOMX::node_id node = 0;

9.

10. status_t err = omx->allocateNode(componentName, observer, &node);

11.

12. sp<OMXCodec> codec = new OMXCodec(

13. omx, node, quirks, flags,

14. createEncoder, mime, componentName,

15. source, nativeWindow);

16.

17. observer->setCodec(codec);

18.

19. err = codec->configureCodec(meta);

20.

21. }

下面依次来看每个过程

2.1 findMatchingCodecs

先看下代码

[html] view plain copy

1. void OMXCodec::findMatchingCodecs(

2. const char *mime,

3. bool createEncoder, const char *matchComponentName,

4. uint32_t flags,

5. Vector<CodecNameAndQuirks> *matchingCodecs) {

6. matchingCodecs->clear();

7.

8. const MediaCodecList *list = MediaCodecList::getInstance();

9. if (list == NULL) {

10. return;

11. }

12.

13. size_t index = 0;

14. for (;;) {

15. ssize_t matchIndex =

16. list->findCodecByType(mime, createEncoder, index);

17.

18. if (matchIndex < 0) {

19. break;

20. }

21.

22. index = matchIndex + 1;

23.

24. const char *componentName = list->getCodecName(matchIndex);

25.

26. // If a specific codec is requested, skip the non-matching ones.

27. if (matchComponentName && strcmp(componentName, matchComponentName)) {

28. continue;

29. }

30.

31. // When requesting software-only codecs, only push software codecs

32. // When requesting hardware-only codecs, only push hardware codecs

33. // When there is request neither for software-only nor for

34. // hardware-only codecs, push all codecs

35. if (((flags & kSoftwareCodecsOnly) && IsSoftwareCodec(componentName)) ||

36. ((flags & kHardwareCodecsOnly) && !IsSoftwareCodec(componentName)) ||

37. (!(flags & (kSoftwareCodecsOnly | kHardwareCodecsOnly)))) {

38.

39. ssize_t index = matchingCodecs->add();

40. CodecNameAndQuirks *entry = &matchingCodecs->editItemAt(index);

41. entry->mName = String8(componentName);

42. entry->mQuirks = getComponentQuirks(list, matchIndex);

43.

44. ALOGV("matching '%s' quirks 0x%08x",

45. entry->mName.string(), entry->mQuirks);

46. }

47. }

48.

49. if (flags & kPreferSoftwareCodecs) {

50. matchingCodecs->sort(CompareSoftwareCodecsFirst);

51. }

52. }

从代码可以看到主要就是从MediaCodecList找到与传入的matchComponentName对应的解码器

MediaCodecList 的实现不看了，感兴趣的看下，主要就是从/etc/media_codecs.xml解析出支持的解码器并匹配出对应的解码器

举例：<MediaCodec name="OMX.google.mp3.decoder" type="audio/mpeg" />

这里需要注意的是在前面我们看到 kComponents 数组定义了支持的解码器，这里/etc/media_codecs.xml 也列出了对应的解码器，这里名字要对应上

这里找到符合条件的解码器便通过matchingCodecs->add()添加一个项，并将各个成员赋值，主要是name

最终符合条件的插件便都放在了matchingCodecs列表中

2.2 allocateNode

这里主要有如下重要代码

sp<OMXCodecObserver> observer = new OMXCodecObserver;
IOMX::node_id node = 0;

status_t err = omx->allocateNode(componentName, observer, &node);

observer的作用主要用于消息传递。

这里allocateNode主要是调用service端的OMX类来完成工作（省略中间的binder操作）

[html] view plain copy

1. status_t OMX::allocateNode(

2. const char *name, const sp<IOMXObserver> &observer, node_id *node) {

3. Mutex::Autolock autoLock(mLock);

4.

5. *node = 0;

6.

7. OMXNodeInstance *instance = new OMXNodeInstance(this, observer);

8.

9. OMX_COMPONENTTYPE *handle;

10. OMX_ERRORTYPE err = mMaster->makeComponentInstance(

11. name, &OMXNodeInstance::kCallbacks,

12. instance, &handle);

13.

14. if (err != OMX_ErrorNone) {

15. ALOGV("FAILED to allocate omx component '%s'", name);

16.

17. instance->onGetHandleFailed();

18.

19. return UNKNOWN_ERROR;

20. }

21.

22. *node = makeNodeID(instance);

23. mDispatchers.add(*node, new CallbackDispatcher(instance));

24.

25. instance->setHandle(*node, handle);

26.

27. mLiveNodes.add(observer->asBinder(), instance);

28. observer->asBinder()->linkToDeath(this);

29.

30. return OK;

31. }

首先构造了OMXNodeInstance，封装了传入的observer参数，作为消息传递的载体

调用mMaster->makeComponentInstance生成实际的解码器实例

生成node_id

将node_id与实际的解码器handle保存在instance中，最终instance会保存在OMX的mLiveNodes列表中

这样OMXCodec就可以通过OMXNodeInstance与解码器通信了，具体参考下面通信模型。

后面会介绍通信过程。这里重点讲解一下与解码器的操作

上面代码中通过mMaster->makeComponentInstance创建了解码器的实例，这里我们以android自带的mp3 解码器为例来讲解

通过上面介绍mp3解码器对应的项为（/etc/media_codecs.xml）：

而findMatchingCodecs 传入的字符串为：audio/mpeg 以此为依据进行匹配

这里找到对应的解码器后，解码器的名字为：OMX.google.mp3.decoder

这样便可以通过查表（数组kComponents ）得到实际的解码器了

实际的mp3解码器代码文件为：framework/av/media/libstagefright/codecs/mp3dec/SoftMP3.cpp

调用的方法为：mMaster->makeComponentInstance 实际代码是

[html] view plain copy

1. OMX_ERRORTYPE OMXMaster::makeComponentInstance(

2. const char *name,

3. const OMX_CALLBACKTYPE *callbacks,

4. OMX_PTR appData,

5. OMX_COMPONENTTYPE **component) {

6. Mutex::Autolock autoLock(mLock);

7.

8. *component = NULL;

9.

10. ssize_t index = mPluginByComponentName.indexOfKey(String8(name));

11.

12. if (index < 0) {

13. return OMX_ErrorInvalidComponentName;

14. }

15.

16. OMXPluginBase *plugin = mPluginByComponentName.valueAt(index);

17. OMX_ERRORTYPE err =

18. plugin->makeComponentInstance(name, callbacks, appData, component);

19.

20. if (err != OMX_ErrorNone) {

21. return err;

22. }

23.

24. mPluginByInstance.add(*component, plugin);

25.

26. return err;

27. }

主要是调用插件的makeComponentInstance方法

这里插件是通过OMXMaster构造函数addPlugin(new SoftOMXPlugin);加载的插件，因此这里makeComponentInstance 是SoftOMXPlugin 的方法

看下具体实现

[html] view plain copy

1. OMX_ERRORTYPE SoftOMXPlugin::makeComponentInstance(

2. const char *name,

3. const OMX_CALLBACKTYPE *callbacks,

4. OMX_PTR appData,

5. OMX_COMPONENTTYPE **component) {

6. ALOGV("makeComponentInstance '%s'", name);

7.

8. for (size_t i = 0; i < kNumComponents; ++i) {

9. if (strcmp(name, kComponents[i].mName)) {

10. continue;

11. }

12.

13. AString libName = "libstagefright_soft_";

14. libName.append(kComponents[i].mLibNameSuffix);

15. libName.append(".so");

16.

17. void *libHandle = dlopen(libName.c_str(), RTLD_NOW);

18.

19. if (libHandle == NULL) {

20. ALOGE("unable to dlopen %s", libName.c_str());

21.

22. return OMX_ErrorComponentNotFound;

23. }

24.

25. typedef SoftOMXComponent *(*CreateSoftOMXComponentFunc)(

26. const char *, const OMX_CALLBACKTYPE *,

27. OMX_PTR, OMX_COMPONENTTYPE **);

28.

29. CreateSoftOMXComponentFunc createSoftOMXComponent =

30. (CreateSoftOMXComponentFunc)dlsym(

31. libHandle,

32. "_Z22createSoftOMXComponentPKcPK16OMX_CALLBACKTYPE"

33. "PvPP17OMX_COMPONENTTYPE");

34.

35. if (createSoftOMXComponent == NULL) {

36. dlclose(libHandle);

37. libHandle = NULL;

38.

39. return OMX_ErrorComponentNotFound;

40. }

41.

42. sp<SoftOMXComponent> codec =

43. (*createSoftOMXComponent)(name, callbacks, appData, component);

44.

45. if (codec == NULL) {

46. dlclose(libHandle);

47. libHandle = NULL;

48.

49. return OMX_ErrorInsufficientResources;

50. }

51.

52. OMX_ERRORTYPE err = codec->initCheck();

53. if (err != OMX_ErrorNone) {

54. dlclose(libHandle);

55. libHandle = NULL;

56.

57. return err;

58. }

59.

60. codec->incStrong(this);

61. codec->setLibHandle(libHandle);

62.

63. return OMX_ErrorNone;

64. }

65.

66. return OMX_ErrorInvalidComponentName;

67. }

这里主要是通过枚举kComponents找到对应的解码器记录

{ "OMX.google.mp3.decoder", "mp3dec", "audio_decoder.mp3" },

这里可以看到每个库都是以.so的方式提供的，命名符合如下规则：libstagefright_soft_mp3dec.so

通过dlopen加载后通过dlsym找到createSoftOMXComponent方法并执行，这里每个解码器都应该实现此函数

这里看下mp3的具体实现

[html] view plain copy

1. android::SoftOMXComponent *createSoftOMXComponent(

2. const char *name, const OMX_CALLBACKTYPE *callbacks,

3. OMX_PTR appData, OMX_COMPONENTTYPE **component) {

4. return new android::SoftMP3(name, callbacks, appData, component);

5. }

主要工作就是构造了SoftMP3的类对象并返回，这里注意并没有将解码器句柄返回给上层，而是在构造函数中将这种联系放在给定的OMX_COMPONENTTYPE **component参数中

看下构造函数

[html] view plain copy

1. SoftMP3::SoftMP3(

2. const char *name,

3. const OMX_CALLBACKTYPE *callbacks,

4. OMX_PTR appData,

5. OMX_COMPONENTTYPE **component)

6. : SimpleSoftOMXComponent(name, callbacks, appData, component),

7. mConfig(new tPVMP3DecoderExternal),

8. mDecoderBuf(NULL),

9. mAnchorTimeUs(0),

10. mNumFramesOutput(0),

11. mNumChannels(2),

12. mSamplingRate(44100),

13. mSignalledError(false),

14. mOutputPortSettingsChange(NONE) {

15. initPorts();

16. initDecoder();

17. }

这里就是基本的初始化操作，这里SoftMP3是继承自SimpleSoftOMXComponent，因此会调用其构造函数，如下

[html] view plain copy

1. SimpleSoftOMXComponent::SimpleSoftOMXComponent(

2. const char *name,

3. const OMX_CALLBACKTYPE *callbacks,

4. OMX_PTR appData,

5. OMX_COMPONENTTYPE **component)

6. : SoftOMXComponent(name, callbacks, appData, component),

7. mLooper(new ALooper),

8. mHandler(new AHandlerReflector<SimpleSoftOMXComponent>(this)),

9. mState(OMX_StateLoaded),

10. mTargetState(OMX_StateLoaded) {

11. mLooper->setName(name);

12. mLooper->registerHandler(mHandler);

13.

14. mLooper->start(

15. false, // runOnCallingThread

16. false, // canCallJava

17. ANDROID_PRIORITY_FOREGROUND);

18. }

这里主要是构造了Alooper 对象来处理消息，以及调用了父类也就是SoftOMXComponent的构造函数

关于alooper的工作原理，后面会有一篇专门的文章介绍。

[html] view plain copy

1. SoftOMXComponent::SoftOMXComponent(

2. const char *name,

3. const OMX_CALLBACKTYPE *callbacks,

4. OMX_PTR appData,

5. OMX_COMPONENTTYPE **component)

6. : mName(name),

7. mCallbacks(callbacks),

8. mComponent(new OMX_COMPONENTTYPE),

9. mLibHandle(NULL) {

10. mComponent->nSize = sizeof(*mComponent);

11. mComponent->pComponentPrivate = this;

12. mComponent->SetParameter = SetParameterWrapper;

13. *********

14. mComponent->UseEGLImage = NULL;

15. mComponent->ComponentRoleEnum = NULL;

16. *component = mComponent;

17.

18. }

这里才是构造component的地方，并初始化了其中的方法，如

mComponent->SetParameter = SetParameterWrapper;

[html] view plain copy

1. OMX_ERRORTYPE SoftOMXComponent::SetParameterWrapper(

2. OMX_HANDLETYPE component,

3. OMX_INDEXTYPE index,

4. OMX_PTR params) {

5. SoftOMXComponent *me =

6. (SoftOMXComponent *)

7. ((OMX_COMPONENTTYPE *)component)->pComponentPrivate;

8.

9. return me->setParameter(index, params);

10. }

这里初始化了mComponent 的SetParameter 方法为SoftOMXComponent::SetParameterWrapper而从构造函数知道

mComponent->pComponentPrivate = this;

因此实际调用的是this->SetParameter 也就是其子类的实现

（这里很重要，请注意理解透彻）

通过上面分析可以知道，android已经为解码器的消息传递通过两个父类及SoftOMXComponent和SimpleSoftOMXComponent完成了

后面解码器只要从SimpleSoftOMXComponent 继承并实现对应的消息处理就可以了

在mp3的构造函数中还有如下语句

initPorts(); 主要作用是配置解码器的输入输出
initDecoder(); 实际的解码器

这里需要注意的是在SoftMP3的代码里便可以调用实际解码器的init decoder等操作了，而SoftMP3可以认为是实际解码器的封装

具体调用顺序会在后面消息处理阶段介绍。

到这里allocateNode 就介绍完了：主要工作就是建立与解码器的联系 observer nodeid，以及找到实际的解码器并初始化

2.3OMXCodec构造函数

后面的执行语句如下：

sp<OMXCodec> codec = new OMXCodec(
omx, node, quirks, flags,
createEncoder, mime, componentName,
source, nativeWindow);

具体实现如下

[html] view plain copy

1. OMXCodec::OMXCodec(

2. const sp<IOMX> &omx, IOMX::node_id node,

3. uint32_t quirks, uint32_t flags,

4. bool isEncoder,

5. const char *mime,

6. const char *componentName,

7. const sp<MediaSource> &source,

8. const sp<ANativeWindow> &nativeWindow)

9. : mOMX(omx),

10. mOMXLivesLocally(omx->livesLocally(node, getpid())),

11. mNode(node),

12. mQuirks(quirks),

13. mFlags(flags),

14. mIsEncoder(isEncoder),

15. mIsVideo(!strncasecmp("video/", mime, 6)),

16. mMIME(strdup(mime)),

17. mComponentName(strdup(componentName)),

18. mSource(source),

19. mCodecSpecificDataIndex(0),

20. mState(LOADED),

21. mInitialBufferSubmit(true),

22. mSignalledEOS(false),

23. mNoMoreOutputData(false),

24. mOutputPortSettingsHaveChanged(false),

25. mSeekTimeUs(-1),

26. mSeekMode(ReadOptions::SEEK_CLOSEST_SYNC),

27. mTargetTimeUs(-1),

28. mOutputPortSettingsChangedPending(false),

29. mSkipCutBuffer(NULL),

30. mLeftOverBuffer(NULL),

31. mPaused(false),

32. mNativeWindow(

33. (!strncmp(componentName, "OMX.google.", 11)

34. || !strcmp(componentName, "OMX.Nvidia.mpeg2v.decode"))

35. ? NULL : nativeWindow) {

36. mPortStatus[kPortIndexInput] = ENABLED;

37. mPortStatus[kPortIndexOutput] = ENABLED;

38.

39. setComponentRole();

40. }

这里主要就是将之前的所有工作，都保存在OMXCodec实例中，之后awesomeplayer便直接操作OMXCodec（mAudioSource）了

这里 setComponentRole();主要是设置角色（编码器还是解码器），后面再介绍消息传递时介绍。

这里还要注意的是OMXCodec继承自MediaSource&MediaBufferObserver

因此才可以作为输出模块的数据源

2.4 配置解码器

observer->setCodec(codec);

err = codec->configureCodec(meta);

这两部分在我们后面介绍完消息机制之后，读者可自行回来分析

上面介绍了create的操作

下面介绍mAudioSource->start 的操作

[html] view plain copy

1. status_t OMXCodec::start(MetaData *meta) {

2.

3. mSource->start(params.get())；

4.

5. return init();

6.

7. }

只列出了重要代码，其中mSource->start是指启动解码器的数据源MediaSource，这里也就是extractor中通过getTrack拿到的mediaSource。比较简单不说了

看下init实现，省略无关代码

[html] view plain copy

1. status_t OMXCodec::init() {

2. err = allocateBuffers();

3. return mState == ERROR ? UNKNOWN_ERROR : OK;

4. }

主要工作是通过allocateBuffers申请内存

[html] view plain copy

1. status_t OMXCodec::allocateBuffers() {

2. status_t err = allocateBuffersOnPort(kPortIndexInput);

3.

4. if (err != OK) {

5. return err;

6. }

7.

8. return allocateBuffersOnPort(kPortIndexOutput);

9. }

这里分别申请输入和输出的buffer

这里分段来看allocateBuffersOnPort函数

[html] view plain copy

1. status_t OMXCodec::allocateBuffersOnPort(OMX_U32 portIndex) {

2.

3. OMX_PARAM_PORTDEFINITIONTYPE def;

4. InitOMXParams(&def);

5. def.nPortIndex = portIndex;

6.

7. err = mOMX->getParameter(

8. mNode, OMX_IndexParamPortDefinition, &def, sizeof(def));

9.

10. size_t totalSize = def.nBufferCountActual * def.nBufferSize;

11. mDealer[portIndex] = new MemoryDealer(totalSize, "OMXCodec");

这里开头先通过命令OMX_IndexParamPortDefinition获取解码器配置的大小

然后构造MemoryDealer实例，存放buffer数量及大小信息

这里命令的传输过程请参考消息通讯机制模型的介绍，看完再回来理解这部分

以mp3为例，在SoftMP3的构造函数中会调用initPorts来初始化OMX_PARAM_PORTDEFINITIONTYPE对象

里面会确定buffer的大小：包括有几个buffer，每个buffer的容量等

这里OMX_IndexParamPortDefinition主要是查询此信息，然后就知道要申请多少内存了

[html] view plain copy

1. for (OMX_U32 i = 0; i < def.nBufferCountActual; ++i) {

2. sp<IMemory> mem = mDealer[portIndex]->allocate(def.nBufferSize);

3. CHECK(mem.get() != NULL);

4.

5. BufferInfo info;

6. info.mData = NULL;

7. info.mSize = def.nBufferSize;

8. err = mOMX->useBuffer(mNode, portIndex, mem, &buffer);

9.

10. if (mem != NULL) {

11. info.mData = mem->pointer();

12. }

13.

14. info.mBuffer = buffer;

15. info.mStatus = OWNED_BY_US;

16. info.mMem = mem;

17. info.mMediaBuffer = NULL;

18.

19. mPortBuffers[portIndex].push(info);

20.

21. CODEC_LOGV("allocated buffer %p on %s port", buffer,

22. portIndex == kPortIndexInput ? "input" : "output");

23. }

下面是一个循环（忽略了secure等无关代码）

主要是申请内存，并为每个内存新建一个BufferInfo变量，最终都放在mPortBuffers[index]对应的栈中

至此InitAudioDecoder 便执行完毕了，主要做了两件事：建立实际的解码器+申请buffer

3 消息通信机制模型的介绍

当与解码器的联系建立之后，后面的工作主要就是传递消息由解码器处理将处理结果返回给调用者

但前面的介绍对消息模型并不清晰，这里专门介绍一下

下面就以 OMXCodec构造函数中的 setComponentRole();为例来介绍此过程

具体代码如下：

[html] view plain copy

1. void OMXCodec::setComponentRole() {

2. setComponentRole(mOMX, mNode, mIsEncoder, mMIME);

3. }

[html] view plain copy

1. // static

2. void OMXCodec::setComponentRole(

3. const sp<IOMX> &omx, IOMX::node_id node, bool isEncoder,

4. const char *mime) {

5. struct MimeToRole {

6. const char *mime;

7. const char *decoderRole;

8. const char *encoderRole;

9. };

10.

11. static const MimeToRole kMimeToRole[] = {

12. { MEDIA_MIMETYPE_AUDIO_MPEG,

13. "audio_decoder.mp3", "audio_encoder.mp3" },

14. { MEDIA_MIMETYPE_AUDIO_MPEG_LAYER_I,

15. "audio_decoder.mp1", "audio_encoder.mp1" },

16. { MEDIA_MIMETYPE_AUDIO_MPEG_LAYER_II,

17. "audio_decoder.mp2", "audio_encoder.mp2" },

18. { MEDIA_MIMETYPE_AUDIO_AMR_NB,

19. "audio_decoder.amrnb", "audio_encoder.amrnb" },

20. { MEDIA_MIMETYPE_AUDIO_AMR_WB,

21. "audio_decoder.amrwb", "audio_encoder.amrwb" },

22. { MEDIA_MIMETYPE_AUDIO_AAC,

23. "audio_decoder.aac", "audio_encoder.aac" },

24. { MEDIA_MIMETYPE_AUDIO_VORBIS,

25. "audio_decoder.vorbis", "audio_encoder.vorbis" },

26. { MEDIA_MIMETYPE_AUDIO_G711_MLAW,

27. "audio_decoder.g711mlaw", "audio_encoder.g711mlaw" },

28. { MEDIA_MIMETYPE_AUDIO_G711_ALAW,

29. "audio_decoder.g711alaw", "audio_encoder.g711alaw" },

30. { MEDIA_MIMETYPE_VIDEO_AVC,

31. "video_decoder.avc", "video_encoder.avc" },

32. { MEDIA_MIMETYPE_VIDEO_MPEG4,

33. "video_decoder.mpeg4", "video_encoder.mpeg4" },

34. { MEDIA_MIMETYPE_VIDEO_H263,

35. "video_decoder.h263", "video_encoder.h263" },

36. { MEDIA_MIMETYPE_VIDEO_VPX,

37. "video_decoder.vpx", "video_encoder.vpx" },

38. { MEDIA_MIMETYPE_AUDIO_RAW,

39. "audio_decoder.raw", "audio_encoder.raw" },

40. { MEDIA_MIMETYPE_AUDIO_FLAC,

41. "audio_decoder.flac", "audio_encoder.flac" },

42. };

43.

44. static const size_t kNumMimeToRole =

45. sizeof(kMimeToRole) / sizeof(kMimeToRole[0]);

46.

47. size_t i;

48. for (i = 0; i < kNumMimeToRole; ++i) {

49. if (!strcasecmp(mime, kMimeToRole[i].mime)) {

50. break;

51. }

52. }

53.

54. if (i == kNumMimeToRole) {

55. return;

56. }

57.

58. const char *role =

59. isEncoder ? kMimeToRole[i].encoderRole

60. : kMimeToRole[i].decoderRole;

61.

62. if (role != NULL) {

63. OMX_PARAM_COMPONENTROLETYPE roleParams;

64. InitOMXParams(&roleParams);

65.

66. strncpy((char *)roleParams.cRole,

67. role, OMX_MAX_STRINGNAME_SIZE - 1);

68.

69. roleParams.cRole[OMX_MAX_STRINGNAME_SIZE - 1] = '\0';

70.

71. status_t err = omx->setParameter(

72. node, OMX_IndexParamStandardComponentRole,

73. &roleParams, sizeof(roleParams));

74.

75. if (err != OK) {

76. ALOGW("Failed to set standard component role '%s'.", role);

77. }

78. }

79. }

这里是解码器因此role == audio_decoder.mp3

这里主要执行了如下步骤：

InitOMXParams(&roleParams);

status_t err = omx->setParameter(
node, OMX_IndexParamStandardComponentRole,
&roleParams, sizeof(roleParams));

其中InitOMXParams主要是初始化roleParams变量

主要是靠setParameter来完成工作：记录下传递进来的参数：OMX_IndexParamStandardComponentRole 是具体命令 roleParams 是具体参数，而node 则是与service的桥梁

具体调用的是OMX的方法（service端的，不了解可参考第一部分mClient->connect的介绍）

[html] view plain copy

1. status_t OMX::setParameter(

2. node_id node, OMX_INDEXTYPE index,

3. const void *params, size_t size) {

4. return findInstance(node)->setParameter(

5. index, params, size);

6. }

首先是通过nodeID得到了OMXNodeInstance（这里OMXNodeInstance是封装了observer的实例）

继续进入instance

[html] view plain copy

1. status_t OMXNodeInstance::setParameter(

2. OMX_INDEXTYPE index, const void *params, size_t size) {

3. Mutex::Autolock autoLock(mLock);

4.

5. OMX_ERRORTYPE err = OMX_SetParameter(

6. mHandle, index, const_cast<void *>(params));

7.

8. return StatusFromOMXError(err);

9. }

看下 OMX_SetParameter实现

[html] view plain copy

1. #define OMX_SetParameter( \

2. hComponent, \

3. nParamIndex, \

4. pComponentParameterStructure) \

5. ((OMX_COMPONENTTYPE*)hComponent)->SetParameter( \

6. hComponent, \

7. nParamIndex, \

8. pComponentParameterStructure) /* Macro End */

这里可以看到主要是通过OMX_COMPONENTTYPE对象（也就是SoftMP3父类构造函数初始化过的对象）来完成工作

这里在SoftOMXComponent没有具体实现，在SimpleSoftOMXComponent中，如下

[html] view plain copy

1. OMX_ERRORTYPE SimpleSoftOMXComponent::setParameter(

2. OMX_INDEXTYPE index, const OMX_PTR params) {

3. Mutex::Autolock autoLock(mLock);

4.

5. CHECK(isSetParameterAllowed(index, params));

6.

7. return internalSetParameter(index, params);

8. }

[html] view plain copy

1. OMX_ERRORTYPE SimpleSoftOMXComponent::setParameter(

2. OMX_INDEXTYPE index, const OMX_PTR params) {

3. Mutex::Autolock autoLock(mLock);

4.

5. CHECK(isSetParameterAllowed(index, params));

6.

7. return internalSetParameter(index, params);

8. }

[html] view plain copy

1. OMX_ERRORTYPE SoftMP3::internalSetParameter(

2. OMX_INDEXTYPE index, const OMX_PTR params) {

3. switch (index) {

4. case OMX_IndexParamStandardComponentRole:

5. {

6. const OMX_PARAM_COMPONENTROLETYPE *roleParams =

7. (const OMX_PARAM_COMPONENTROLETYPE *)params;

8.

9. if (strncmp((const char *)roleParams->cRole,

10. "audio_decoder.mp3",

11. OMX_MAX_STRINGNAME_SIZE - 1)) {

12. return OMX_ErrorUndefined;

13. }

14.

15. return OMX_ErrorNone;

16. }

17.

18. default:

19. return SimpleSoftOMXComponent::internalSetParameter(index, params);

20. }

21. }

[html] view plain copy

1. OMX_ERRORTYPE SoftMP3::internalSetParameter(

2. OMX_INDEXTYPE index, const OMX_PTR params) {

3. switch (index) {

4. case OMX_IndexParamStandardComponentRole:

5. {

6. const OMX_PARAM_COMPONENTROLETYPE *roleParams =

7. (const OMX_PARAM_COMPONENTROLETYPE *)params;

8.

9. if (strncmp((const char *)roleParams->cRole,

10. "audio_decoder.mp3",

11. OMX_MAX_STRINGNAME_SIZE - 1)) {

12. return OMX_ErrorUndefined;

13. }

14.

15. return OMX_ErrorNone;

16. }

17.

18. default:

19. return SimpleSoftOMXComponent::internalSetParameter(index, params);

20. }

21. }

这里需要注意的是调用的internalSetParameter是SoftMP3的实现，而不是SimpleSoftOMXComponent 中的，代码如下

传入的命令为：OMX_IndexParamStandardComponentRole，处理完毕后返回OMX_ErrorNone

这里通过OMXCodec变量借由OMXNodeInstance得到OMX_COMPONENTYPE句柄，就获得了与解码器实际通信的能力。

4 解码过程介绍

下面介绍如何通过OMXCodec驱动解码一帧数据

这里建立了OMXCodec实例之后，在awesomeplayer中的audioplayer的fillbuffer中

mAudioPlayer便通过mSource->read(&mInputBuffer, &options来读取pcm数据

这里mSource为mAudioSource

看下read函数

具体代码在OMXCodec.cpp中，我们分段来看

[html] view plain copy

1. status_t OMXCodec::read(

2.

3. MediaBuffer **buffer, const ReadOptions *options) {

4.

5. status_t err = OK;

6.

7. *buffer = NULL;

8.

9. Mutex::Autolock autoLock(mLock);

10.

11. if (mState != EXECUTING && mState != RECONFIGURING) {

12.

13. return UNKNOWN_ERROR;

14.

15. }

[html] view plain copy

1. status_t OMXCodec::read(

2.

3. MediaBuffer **buffer, const ReadOptions *options) {

4.

5. status_t err = OK;

6.

7. *buffer = NULL;

8.

9. Mutex::Autolock autoLock(mLock);

10.

11. if (mState != EXECUTING && mState != RECONFIGURING) {

12.

13. return UNKNOWN_ERROR;

14.

15. }

前面设置好参数后，会经过几次回调将状态设置成EXECUTING

这里需要注意的是mInitialBufferSubmit默认是true

[html] view plain copy

1. if (mInitialBufferSubmit) {

2. mInitialBufferSubmit = false;

3. drainInputBuffers();

4. fillOutputBuffers();

5. }

[html] view plain copy

1. if (mInitialBufferSubmit) {

2. mInitialBufferSubmit = false;

3. drainInputBuffers();

4. fillOutputBuffers();

5. }

drainInputBuffers可以认为从extractor读取一包数据

fillOutputBuffers是解码一包数据并放在输出buffer中

忽略seek代码

[html] view plain copy

1. size_t index = *mFilledBuffers.begin(); mFilledBuffers.erase(mFilledBuffers.begin());

2. BufferInfo *info = &mPortBuffers[kPortIndexOutput].editItemAt(index);

3. CHECK_EQ((int)info->mStatus, (int)OWNED_BY_US);

4. info->mStatus = OWNED_BY_CLIENT;

5. info->mMediaBuffer->add_ref();

6. if (mSkipCutBuffer != NULL) {

7. mSkipCutBuffer->submit(info->mMediaBuffer);

8. }

9. *buffer = info->mMediaBuffer;

10. return OK;

11. }

[html] view plain copy

1. size_t index = *mFilledBuffers.begin(); mFilledBuffers.erase(mFilledBuffers.begin());

2. BufferInfo *info = &mPortBuffers[kPortIndexOutput].editItemAt(index);

3. CHECK_EQ((int)info->mStatus, (int)OWNED_BY_US);

4. info->mStatus = OWNED_BY_CLIENT;

5. info->mMediaBuffer->add_ref();

6. if (mSkipCutBuffer != NULL) {

7. mSkipCutBuffer->submit(info->mMediaBuffer);

8. }

9. *buffer = info->mMediaBuffer;

10. return OK;

11. }

这里我们将输出缓冲区中的bufferinfo取出来，并将其中的mediabuffer赋值给传递进来的参数buffer，当decoder解码出来数据后会将存放数据的buffer放在mFilledBuffers中，因此audioplayer每次从omxcodec读取数据时，会从mFilledBuffers中取。区别在于，当mFilledBuffers为空时会等待解码器解码并填充数据，如果有数据，则直接取走数据。

在audioplayer->start代码中用到这里返回的mediabuffer做了一些事情，后面设置了一些参数如

info->mStatus = OWNED_BY_CLIENT;

说明此info归client所有，client释放后会归还的，这里多啰嗦一句，通过设置mStatus可以让这一块内存由不同的模块来支配，如其角色有如下几个：

enum BufferStatus {

OWNED_BY_US,

OWNED_BY_COMPONENT,

OWNED_BY_NATIVE_WINDOW,

OWNED_BY_CLIENT,

};

显然component是解码器的，client是外部比如audioplayer的。

info->mMediaBuffer->add_ref();是增加一个引用，估计release的时候用~~

下面着重分析下如何从extractor读数据，和如何解码数据

4.1 看下 drainInputBuffers();实现

[html] view plain copy

1. 4.1 看下 drainInputBuffers();实现

2. [html] view plain copy

3. 1.

4.   name="code" class="html">void OMXCodec::drainInputBuffers() {  


2.         for (size_t i = 0; i <</span> buffers->size(); ++i) {   
3.             BufferInfo *info = &buffers->editItemAt(i);   
4.             if (info->mStatus != OWNED_BY_US) {   
5.                 continue;   
6.             }   
7.             if (!drainInputBuffer(info)) {   
8.                 break;   
9.             }   
10.            if (mFlags & kOnlySubmitOneInputBufferAtOneTime) {   
11.                break;   
12.            }      
13.        }   
14. }

5.

6. 这里解释下，我们可能申请了多个输入缓冲区，因此是一个循环，先检查我们有没有权限使用即OWNED_BY_US，这一缓冲区获取完数据后会检测

7. kOnlySubmitOneInputBufferAtOneTime即每次只允许读一个包，否则循环都读满。

8. 下面继续跟进drainInputBuffer(info),忽略无关代码：

9. [html] view plain copy

1. bool OMXCodec::drainInputBuffer(BufferInfo *info) {

2. **********

3. status_t err;

4. bool signalEOS = false;

5. int64_t timestampUs = 0;

6. size_t offset = 0;

7. int32_t n = 0;

8. for (;;) {

9. MediaBuffer *srcBuffer;

10. err = mSource->read(&srcBuffer);

11. size_t remainingBytes = info->mSize - offset;

12. 下面是判断从extractor读取到的数据是不是超过了总大小

13. if (srcBuffer->range_length() > remainingBytes) {

14. if (offset == 0) {

15. srcBuffer->release();

16. srcBuffer = NULL;

17.

18. setState(ERROR);

19. return false;

20. }

21. mLeftOverBuffer = srcBuffer;

22. break;

23. } memcpy((uint8_t *)info->mData + offset,

24. (const uint8_t *)srcBuffer->data()

25. + srcBuffer->range_offset(),

26. srcBuffer->range_length());

27. offset += srcBuffer->range_length();

28. if (releaseBuffer) {

29. srcBuffer->release();

30. srcBuffer = NULL;

31. }

32. 数据读取完毕后将srcBufferrelease掉

33. }

34. err = mOMX->emptyBuffer(

35. mNode, info->mBuffer, 0, offset,

36. flags, timestampUs);

37. info->mStatus = OWNED_BY_COMPONENT;

38. }

这里读取完毕后将缓冲区的状态设置成OWNED_BY_COMPONENT 解码器就可以解码了

这里可以看出来读取数据时实现了一次拷贝~~，而不是用的同一块缓冲区，注意下

读取数据可以参考前面介绍的extractor的内容，比较简单不说了。

下面看读取数据完毕后调用mOMX->emptyBuffer都干了些啥

通过前面我们很容易的理解实际调用的是

omx::emptybufferèOMXNodeInstance::emptyBuffer,

从代码可以看到最终调用的是

((OMX_COMPONENTTYPE*)hComponent)->EmptyThisBuffer()

实际代码在SimpleSoftOMXComponent.cpp中，具体如下

[html] view plain copy

1. OMX_ERRORTYPE SimpleSoftOMXComponent::emptyThisBuffer(

2. OMX_BUFFERHEADERTYPE *buffer) {

3. sp msg = new AMessage(kWhatEmptyThisBuffer, mHandler->id());

4. msg->setPointer("header", buffer);

5. msg->post();

6. return OMX_ErrorNone;

7. }

可以看到就是发了一条命令kWhatEmptyThisBuffer

通过handler->id确定了自己发的还得自己收，处理函数如下：

[html] view plain copy

1. void SimpleSoftOMXComponent::onMessageReceived(const sp &msg) {

2. Mutex::Autolock autoLock(mLock);

3. uint32_t msgType = msg->what();

4. ALOGV("msgType = %d", msgType);

5. switch (msgType) {

6. ********

7. case kWhatEmptyThisBuffer:

8. case kWhatFillThisBuffer:

9. {

10. OMX_BUFFERHEADERTYPE *header;

11. CHECK(msg->findPointer("header", (void **)&header));

12. CHECK(mState == OMX_StateExecuting && mTargetState == mState);

13. bool found = false;

14. size_t portIndex = (kWhatEmptyThisBuffer == msgType)? header->nInputPortIndex: header->nOutputPortIndex;

15. PortInfo *port = &mPorts.editItemAt(portIndex);

16. for (size_t j = 0; j < port->mBuffers.size(); ++j) {

17. BufferInfo *buffer = &port->mBuffers.editItemAt(j);

18.

19. if (buffer->mHeader == header) {

20. CHECK(!buffer->mOwnedByUs);

21. buffer->mOwnedByUs = true;

22. CHECK((msgType == kWhatEmptyThisBuffer

23. && port->mDef.eDir == OMX_DirInput)|| (port->mDef.eDir == OMX_DirOutput));

24. port->mQueue.push_back(buffer);

25. onQueueFilled(portIndex);

26. found = true;

27. break;

28. }

29. }

30. CHECK(found);

31. break;

32. }

33. default:

34. TRESPASS();

35. break;

36. }

37. }

从代码这里来看这两个case都走同一套代码，而且都是通过onQueueFilled来处理，这样我们就引出了实际的处理函数，也就是onQueueFilled，

以mp3为例这里具体实现在SoftMP3中。

具体解释看代码中注释

[html] view plain copy

1. void SoftMP3::onQueueFilled(OMX_U32 portIndex) {

2. if (mSignalledError || mOutputPortSettingsChange != NONE) {

3. return;

4. }

5.

6. 获取输入输出链表

7.

8. List *> &inQueue = getPortQueue(0);

9. List *> &outQueue = getPortQueue(1);

10.

11. while (!inQueue.empty() && !outQueue.empty()) {

12.

13. 各自取输入输出缓冲区中的第一个缓冲区

14. BufferInfo *inInfo = *inQueue.begin();

15. OMX_BUFFERHEADERTYPE *inHeader = inInfo->mHeader;

16.

17. BufferInfo *outInfo = *outQueue.begin();

18. OMX_BUFFERHEADERTYPE *outHeader = outInfo->mHeader;

19.

20. 判断缓冲区是不是没有数据，若果第一个都没有那就是没有

21.

22. if (inHeader->nFlags & OMX_BUFFERFLAG_EOS) {

23. inQueue.erase(inQueue.begin());

24. inInfo->mOwnedByUs = false;

25. notifyEmptyBufferDone(inHeader);

26.

27. if (!mIsFirst) {

28. // pad the end of the stream with 529 samples, since that many samples

29. // were trimmed off the beginning when decoding started

30. outHeader->nFilledLen =

31. kPVMP3DecoderDelay * mNumChannels * sizeof(int16_t);

32.

33. memset(outHeader->pBuffer, 0, outHeader->nFilledLen);

34. } else {

35. // Since we never discarded frames from the start, we won't have

36. // to add any padding at the end either.

37. outHeader->nFilledLen = 0;

38. }

39.

40. outHeader->nFlags = OMX_BUFFERFLAG_EOS;

41.

42. outQueue.erase(outQueue.begin());

43. outInfo->mOwnedByUs = false;

44. notifyFillBufferDone(outHeader);

45. return;

46. }

47.

48.

49.

50. 如果offset==0说明是第一包的开头，需要读取pts，请结合extractor理解

51.

52. if (inHeader->nOffset == 0) {

53. mAnchorTimeUs = inHeader->nTimeStamp;

54. mNumFramesOutput = 0;

55. }

56.

57. mConfig->pInputBuffer =

58. inHeader->pBuffer + inHeader->nOffset;

59.

60. mConfig->inputBufferCurrentLength = inHeader->nFilledLen;

61. mConfig->inputBufferMaxLength = 0;

62. mConfig->inputBufferUsedLength = 0;

63.

64. mConfig->outputFrameSize = kOutputBufferSize / sizeof(int16_t);

65.

66. mConfig->pOutputBuffer =

67. reinterpret_cast *>(outHeader->pBuffer);

68.

69. ERROR_CODE decoderErr;

70.

71. 上面是配置参数下面调用自己的解码器进行解码

72. if ((decoderErr = pvmp3_framedecoder(mConfig, mDecoderBuf))

73. != NO_DECODING_ERROR) {

74. ***出错处理*

75.

76. 这里注意如果解码失败，则填充0数据，也就是静音帧

77. // play silence instead.

78. memset(outHeader->pBuffer,

79. 0,

80. mConfig->outputFrameSize * sizeof(int16_t));

81.

82. mConfig->inputBufferUsedLength = inHeader->nFilledLen;

83. } else if (mConfig->samplingRate != mSamplingRate

84. || mConfig->num_channels != mNumChannels) {

85.

86. 这里说明参数发生了改变，即采样率等改变了，需要重新设置输出

87. mSamplingRate = mConfig->samplingRate;

88. mNumChannels = mConfig->num_channels;

89.

90. notify(OMX_EventPortSettingsChanged, 1, 0, NULL);

91. mOutputPortSettingsChange = AWAITING_DISABLED;

92. return;

93. }

94.

95. if (mIsFirst) {

96. mIsFirst = false;

97. // The decoder delay is 529 samples, so trim that many samples off

98. // the start of the first output buffer. This essentially makes this

99. // decoder have zero delay, which the rest of the pipeline assumes.

100. outHeader->nOffset =

101. kPVMP3DecoderDelay * mNumChannels * sizeof(int16_t);

102.

103. outHeader->nFilledLen =

104. mConfig->outputFrameSize * sizeof(int16_t) - outHeader->nOffset;

105. } else {

106. outHeader->nOffset = 0;

107. outHeader->nFilledLen = mConfig->outputFrameSize * sizeof(int16_t);

108. }

109.

110. outHeader->nTimeStamp =

111. mAnchorTimeUs

112. + (mNumFramesOutput * 1000000ll) / mConfig->samplingRate;

113.

114. outHeader->nFlags = 0;

115.

116. CHECK_GE(inHeader->nFilledLen, mConfig->inputBufferUsedLength);

117.

118. inHeader->nOffset += mConfig->inputBufferUsedLength;

119. inHeader->nFilledLen -= mConfig->inputBufferUsedLength;

120.

121. mNumFramesOutput += mConfig->outputFrameSize / mNumChannels;

122.

123. 如果输入缓冲区数据都解码完了，则调用notifyEmptyBufferDone

124.

125. if (inHeader->nFilledLen == 0) {

126. inInfo->mOwnedByUs = false;

127. inQueue.erase(inQueue.begin());

128. inInfo = NULL;

129. notifyEmptyBufferDone(inHeader);

130. inHeader = NULL;

131. }

132.

133. outInfo->mOwnedByUs = false;

134. outQueue.erase(outQueue.begin());

135. outInfo = NULL;

136.

137. 这是将解码出来的数据告诉外部，通过调用notifyFillBufferDone

138.

139. notifyFillBufferDone(outHeader);

140. outHeader = NULL;

141. }

142.}

10. </li><li class="alt">} </li><li>} </li></ol>

11. </div>

12. <pre code_snippet_id="122244" snippet_file_name="blog_20131221_41_3116414" style="DISPLAY: none" class="html" name="code">void SoftMP3::onQueueFilled(OMX_U32 portIndex) {

13. if (mSignalledError || mOutputPortSettingsChange != NONE) {

14. return;

15. }

16.

17. 获取输入输出链表

18.

19. List<BufferInfo *> &inQueue = getPortQueue(0);

20. List<BufferInfo *> &outQueue = getPortQueue(1);

21.

22. while (!inQueue.empty() && !outQueue.empty()) {

23.

24. 各自取输入输出缓冲区中的第一个缓冲区

25. BufferInfo *inInfo = *inQueue.begin();

26. OMX_BUFFERHEADERTYPE *inHeader = inInfo->mHeader;

27.

28. BufferInfo *outInfo = *outQueue.begin();

29. OMX_BUFFERHEADERTYPE *outHeader = outInfo->mHeader;

30.

31. 判断缓冲区是不是没有数据，若果第一个都没有那就是没有

32.

33. if (inHeader->nFlags & OMX_BUFFERFLAG_EOS) {

34. inQueue.erase(inQueue.begin());

35. inInfo->mOwnedByUs = false;

36. notifyEmptyBufferDone(inHeader);

37.

38. if (!mIsFirst) {

39. // pad the end of the stream with 529 samples, since that many samples

40. // were trimmed off the beginning when decoding started

41. outHeader->nFilledLen =

42. kPVMP3DecoderDelay * mNumChannels * sizeof(int16_t);

43.

44. memset(outHeader->pBuffer, 0, outHeader->nFilledLen);

45. } else {

46. // Since we never discarded frames from the start, we won't have

47. // to add any padding at the end either.

48. outHeader->nFilledLen = 0;

49. }

50.

51. outHeader->nFlags = OMX_BUFFERFLAG_EOS;

52.

53. outQueue.erase(outQueue.begin());

54. outInfo->mOwnedByUs = false;

55. notifyFillBufferDone(outHeader);

56. return;

57. }

58.

59.

60.

61. 如果offset==0说明是第一包的开头，需要读取pts，请结合extractor理解

62.

63. if (inHeader->nOffset == 0) {

64. mAnchorTimeUs = inHeader->nTimeStamp;

65. mNumFramesOutput = 0;

66. }

67.

68. mConfig->pInputBuffer =

69. inHeader->pBuffer + inHeader->nOffset;

70.

71. mConfig->inputBufferCurrentLength = inHeader->nFilledLen;

72. mConfig->inputBufferMaxLength = 0;

73. mConfig->inputBufferUsedLength = 0;

74.

75. mConfig->outputFrameSize = kOutputBufferSize / sizeof(int16_t);

76.

77. mConfig->pOutputBuffer =

78. reinterpret_cast<int16_t *>(outHeader->pBuffer);

79.

80. ERROR_CODE decoderErr;

81.

82. 上面是配置参数下面调用自己的解码器进行解码

83. if ((decoderErr = pvmp3_framedecoder(mConfig, mDecoderBuf))

84. != NO_DECODING_ERROR) {

85. ***出错处理*

86.

87. 这里注意如果解码失败，则填充0数据，也就是静音帧

88. // play silence instead.

89. memset(outHeader->pBuffer,

90. 0,

91. mConfig->outputFrameSize * sizeof(int16_t));

92.

93. mConfig->inputBufferUsedLength = inHeader->nFilledLen;

94. } else if (mConfig->samplingRate != mSamplingRate

95. || mConfig->num_channels != mNumChannels) {

96.

97. 这里说明参数发生了改变，即采样率等改变了，需要重新设置输出

98. mSamplingRate = mConfig->samplingRate;

99. mNumChannels = mConfig->num_channels;

100.

101. notify(OMX_EventPortSettingsChanged, 1, 0, NULL);

102. mOutputPortSettingsChange = AWAITING_DISABLED;

103. return;

104. }

105.

106. if (mIsFirst) {

107. mIsFirst = false;

108. // The decoder delay is 529 samples, so trim that many samples off

109. // the start of the first output buffer. This essentially makes this

110. // decoder have zero delay, which the rest of the pipeline assumes.

111. outHeader->nOffset =

112. kPVMP3DecoderDelay * mNumChannels * sizeof(int16_t);

113.

114. outHeader->nFilledLen =

115. mConfig->outputFrameSize * sizeof(int16_t) - outHeader->nOffset;

116. } else {

117. outHeader->nOffset = 0;

118. outHeader->nFilledLen = mConfig->outputFrameSize * sizeof(int16_t);

119. }

120.

121. outHeader->nTimeStamp =

122. mAnchorTimeUs

123. + (mNumFramesOutput * 1000000ll) / mConfig->samplingRate;

124.

125. outHeader->nFlags = 0;

126.

127. CHECK_GE(inHeader->nFilledLen, mConfig->inputBufferUsedLength);

128.

129. inHeader->nOffset += mConfig->inputBufferUsedLength;

130. inHeader->nFilledLen -= mConfig->inputBufferUsedLength;

131.

132. mNumFramesOutput += mConfig->outputFrameSize / mNumChannels;

133.

134. 如果输入缓冲区数据都解码完了，则调用notifyEmptyBufferDone

135.

136. if (inHeader->nFilledLen == 0) {

137. inInfo->mOwnedByUs = false;

138. inQueue.erase(inQueue.begin());

139. inInfo = NULL;

140. notifyEmptyBufferDone(inHeader);

141. inHeader = NULL;

142. }

143.

144. outInfo->mOwnedByUs = false;

145. outQueue.erase(outQueue.begin());

146. outInfo = NULL;

147.

148. 这是将解码出来的数据告诉外部，通过调用notifyFillBufferDone

149.

150. notifyFillBufferDone(outHeader);

151. outHeader = NULL;

152. }

153. 下面分析下，如何将输入缓冲区释放和将输出缓冲区中的数据传递出去

154. A、输入部分的清空

155. [html] view plain copy

156. 1. void SoftOMXComponent::notifyEmptyBufferDone(OMX_BUFFERHEADERTYPE *header) {

157. 2.

158. 3. (*mCallbacks->EmptyBufferDone)(

159. 4.

160. 5. mComponent, mComponent->pApplicationPrivate, header);

161. 6.

162. 7. }

163. 通知外面我们emptythisbuffer完工了，具体调用的是OMXNodeInstance中的方法，具体怎么传进去的，大家可以自己分析下：

164. [html] view plain copy

165. 1. OMX_ERRORTYPE OMXNodeInstance::OnEmptyBufferDone(

166. 2. OMX_IN OMX_HANDLETYPE hComponent,

167. 3. OMX_IN OMX_PTR pAppData,

168. 4. OMX_IN OMX_BUFFERHEADERTYPE* pBuffer) {

169. 5. OMXNodeInstance *instance = static_cast *>(pAppData);

170. 6. if (instance->mDying) {

171. 7. return OMX_ErrorNone;

172. 8. }

173. 9. return instance->owner()->OnEmptyBufferDone(instance->nodeID(), pBuffer);

174. 10. }

175. OMXNodeInstance的ownner是OMX，因此代码为

176. [html] view plain copy

177. 1. OMX_ERRORTYPE OMX::OnEmptyBufferDone(

178. 2.

179. 3. node_id node, OMX_IN OMX_BUFFERHEADERTYPE *pBuffer) {

180. 4.

181. 5. ALOGV("OnEmptyBufferDone buffer=%p", pBuffer);

182. 6.

183. 7. omx_message msg;

184. 8.

185. 9. msg.type = omx_message::EMPTY_BUFFER_DONE;

186. 10.

187. 11. msg.node = node;

188. 12.

189. 13. msg.u.buffer_data.buffer = pBuffer;

190. 14.

191. 15. findDispatcher(node)->post(msg);

192. 16.

193. 17. return OMX_ErrorNone;

194. 18.

195. 19. }

196. 其中findDispatcher定义如下

197. [html] view plain copy

198. 1. sp OMX::findDispatcher(node_id node) {

199. 2. Mutex::Autolock autoLock(mLock);

200. 3. ssize_t index = mDispatchers.indexOfKey(node);

201. 4. return index < 0 ? NULL : mDispatchers.valueAt(index);

202. 5. }

203. 这里mDispatcher在之前allocateNode中通过mDispatchers.add(*node, new CallbackDispatcher(instance)); 创建的

204. 看下实际的实现可知道，CallbackDispatcher的post方法最终会调用dispatch

205. [html] view plain copy

206. 1. void OMX::CallbackDispatcher::dispatch(const omx_message &msg) {

207. 2. if (mOwner == NULL) {

208. 3. ALOGV("Would have dispatched a message to a node that's already gone.");

209. 4. return;

210. 5. }

211. 6. mOwner->onMessage(msg);

212. 7. }

213. 而owner是OMXNodeInstance，因此消息饶了一圈还是到了OMXNodeInstance的OnMessage方法接收了

214. [html] view plain copy

215. 1. void OMXNodeInstance::onMessage(const omx_message &msg) {

216. 2. if (msg.type == omx_message::FILL_BUFFER_DONE) {

217. 3. OMX_BUFFERHEADERTYPE *buffer =

218. 4. static_cast *>(

219. 5. msg.u.extended_buffer_data.buffer);

220. 6.

221. 7. BufferMeta *buffer_meta =

222. 8. static_cast *>(buffer->pAppPrivate);

223. 9.

224. 10. buffer_meta->CopyFromOMX(buffer);

225. 11. }

226. 12.

227. 13. mObserver->onMessage(msg);

228. 14. }

229. 而onMessage又将消息传递到 mObserver中，也就是在OMXCodec::Create中构造的OMXCodecObserver对象，其OnMessage实现如下

230. [html] view plain copy

231. 1. virtual void onMessage(const omx_message &msg) {

232. 2. sp codec = mTarget.promote();

233. 3.

234. 4. if (codec.get() != NULL) {

235. 5. Mutex::Autolock autoLock(codec->mLock);

236. 6. codec->on_message(msg);

237. 7. codec.clear();

238. 8. }

239. 9. }

240. 最终还是传递给了OMXCodec里，具体看下：

241. [html] view plain copy

242. 1. void OMXCodec::on_message(const omx_message &msg) {

243. 2. switch (msg.type) {

244. 3. ************

245. 4. case omx_message::EMPTY_BUFFER_DONE:

246. 5. {

247. 6. IOMX::buffer_id buffer = msg.u.extended_buffer_data.buffer;

248. 7. Vector *buffers = &mPortBuffers[kPortIndexInput];

249. 8. size_t i = 0;

250. 9. while (i < buffers->size() && (*buffers)[i].mBuffer != buffer) {

251. 10. ++i;

252. 11. }

253. 12. BufferInfo* info = &buffers->editItemAt(i);

254. 13. info->mStatus = OWNED_BY_US;

255. 14. // Buffer could not be released until empty buffer done is called.

256. 15. if (info->mMediaBuffer != NULL) {

257. 16. info->mMediaBuffer->release();

258. 17. info->mMediaBuffer = NULL;

259. 18. }

260. 19. drainInputBuffer(&buffers->editItemAt(i));

261. 20. break;

262. 21. }

263. 22. ****************

264. 23. }

265.
这部分很绕，但搞清楚就好了，请大家仔细阅读，此处虽然调用了info->mMediaBuffer->release();但是由于其引用始终大于0，因此不会真正的release

266. 二是当release完毕后，会调用drainInputBuffer(&buffers->editItemAt(i));来填充数据

267. 也就是说当我们启动一次解码播放后，会在此处循环读取数和据解码数据。而输出数据在后面的filloutbuffer中。

268.

269. B、输出数据的清空notifyFillBufferDone(outHeader);

270. [html] view plain copy

271. 1. void SoftOMXComponent::notifyFillBufferDone(OMX_BUFFERHEADERTYPE *header) {

272. 2. (*mCallbacks->FillBufferDone)(

273. 3. mComponent, mComponent->pApplicationPrivate, header);

274. 4. }

275. [html] view plain copy

276. 1. OMX_ERRORTYPE OMX::OnFillBufferDone(

277. 2. node_id node, OMX_IN OMX_BUFFERHEADERTYPE *pBuffer) {

278. 3. ALOGV("OnFillBufferDone buffer=%p", pBuffer);

279. 4. omx_message msg;

280. 5. msg.type = omx_message::FILL_BUFFER_DONE;

281. 6. msg.node = node;

282. 7. msg.u.extended_buffer_data.buffer = pBuffer;

283. 8. msg.u.extended_buffer_data.range_offset = pBuffer->nOffset;

284. 9. msg.u.extended_buffer_data.range_length = pBuffer->nFilledLen;

285. 10. msg.u.extended_buffer_data.flags = pBuffer->nFlags;

286. 11. msg.u.extended_buffer_data.timestamp = pBuffer->nTimeStamp;

287. 12. msg.u.extended_buffer_data.platform_private = pBuffer->pPlatformPrivate;

288. 13. msg.u.extended_buffer_data.data_ptr = pBuffer->pBuffer;

289. 14. findDispatcher(node)->post(msg);

290. 15. return OMX_ErrorNone;

291. 16. }

292. 最终处理在OMXCodec.cpp中

293. [html] view plain copy

294. 1. void OMXCodec::on_message(const omx_message &msg) {

295. 2. {

296. 3. case omx_message::FILL_BUFFER_DONE:

297. 4. info->mStatus = OWNED_BY_US;

298. 5. mFilledBuffers.push_back(i);

299. 6. mBufferFilled.signal();

300. 7. break;

301. 8. }

302. 9. }

303.
主体就这么几句，先将mStatus设置成OWNED_BY_US，这样component便不能操作了，后面将这个buffer push到mFilledBuffers中。

304.

305. 4.2 fillOutputBuffers

306. [html] view plain copy

307. 1. void OMXCodec::fillOutputBuffers() {

308. 2. CHECK_EQ((int)mState, (int)EXECUTING);

309. 3. Vector *buffers = &mPortBuffers[kPortIndexOutput];

310. 4. for (size_t i = 0; i < buffers->size(); ++i) {

311. 5. BufferInfo *info = &buffers->editItemAt(i);

312. 6. if (info->mStatus == OWNED_BY_US) {

313. 7. fillOutputBuffer(&buffers->editItemAt(i));

314. 8. }

315. 9. }

316. 10. }

317. 找到一个输出缓冲区bufferinfo，启动输出

318. [html] view plain copy

319. 1. void OMXCodec::fillOutputBuffer(BufferInfo *info) {

320. 2. **************

321. 3. status_t err = mOMX->fillBuffer(mNode, info->mBuffer);

322. 4. info->mStatus = OWNED_BY_COMPONENT;

323. 5. }

324. 下面和解码流程类似，我们依次来看：

325. [html] view plain copy

326. 1. status_t OMXNodeInstance::fillBuffer(OMX::buffer_id buffer) {

327. 2. Mutex::Autolock autoLock(mLock);

328. 3. OMX_BUFFERHEADERTYPE *header = (OMX_BUFFERHEADERTYPE *)buffer;

329. 4. header->nFilledLen = 0;

330. 5. header->nOffset = 0;

331. 6. header->nFlags = 0;

332. 7. OMX_ERRORTYPE err = OMX_FillThisBuffer(mHandle, header);

333. 8. return StatusFromOMXError(err);

334. 9. }

335. 进行一些初始化后，调用进入了softMP3中，也就是

336. [html] view plain copy

337. 1. OMX_ERRORTYPE SimpleSoftOMXComponent::fillThisBuffer(

338. 2. OMX_BUFFERHEADERTYPE *buffer) {

339. 3. sp msg = new AMessage(kWhatFillThisBuffer, mHandler->id());

340. 4. msg->setPointer("header", buffer);

341. 5. msg->post();

342. 6. return OMX_ErrorNone;

343. 7. }

344. 同理，接收程序也在本文件中：

345. [html] view plain copy

346. 1. void SimpleSoftOMXComponent::onMessageReceived(const sp &msg) {

347. 2. Mutex::Autolock autoLock(mLock);

348. 3. uint32_t msgType = msg->what();

349. 4. ALOGV("msgType = %d", msgType);

350. 5. switch (msgType) {

351. 6. case kWhatEmptyThisBuffer:

352. 7. case kWhatFillThisBuffer:

353. 8. {

354. 9. OMX_BUFFERHEADERTYPE *header;

355. 10. CHECK(msg->findPointer("header", (void **)&header));

356. 11. CHECK(mState == OMX_StateExecuting && mTargetState == mState);

357. 12. bool found = false;

358. 13. size_t portIndex = (kWhatEmptyThisBuffer == msgType)?

359. 14. header->nInputPortIndex: header->nOutputPortIndex;

360. 15. PortInfo *port = &mPorts.editItemAt(portIndex);

361. 16. for (size_t j = 0; j < port->mBuffers.size(); ++j) {

362. 17. BufferInfo *buffer = &port->mBuffers.editItemAt(j);

363. 18. if (buffer->mHeader == header) {

364. 19. CHECK(!buffer->mOwnedByUs);

365. 20. buffer->mOwnedByUs = true;

366. 21. CHECK((msgType == kWhatEmptyThisBuffer

367. 22. && port->mDef.eDir == OMX_DirInput)

368. 23. || (port->mDef.eDir == OMX_DirOutput));

369. 24. port->mQueue.push_back(buffer);

370. 25. onQueueFilled(portIndex);

371. 26. found = true;

372. 27. break;

373. 28. }

374. 29. }

375. 30. CHECK(found);

376. 31. break;

377. 32. }

378. 33. default:

379. 34. TRESPASS();

380. 35. break;

381. 36. }

382. 37.

383. 38. }

384.
也会调用void SoftMP3::onQueueFilled执行一次解码操作，然后再通过

385. notifyEmptyBufferDone(inHeader);

386. notifyFillBufferDone(outHeader);

387. 两个函数来推进播放进度。

388. 【结束】

OMX Codec介绍

浏览过的版块