feat(build): 升级ONNX Runtime至1.28.0并支持NNAPI硬件加速 - #538
Open
kingzcheung wants to merge 1 commit into
Open
Conversation
- 将ONNX Runtime版本从1.20.0升级到1.28.0 - 修改构建脚本以从源码编译ONNX Runtime，启用NNAPI执行提供程序 - 添加Android NDK和SDK自动检测逻辑 - 实现NNAPI硬件加速支持，提升ARM64设备推理性能 - 增加构建缓存机制避免重复编译 feat(inference): 迁移AI推理服务到独立进程架构 - 新增InferenceService用于处理ONNX模型推理，运行在独立进程中 - 实现IPC客户端InferenceClient与推理服务通信 - 将手写识别、预测文本等功能迁移到新架构 - 使用AIDL接口实现跨进程方法调用 - 采用独立进程设计，避免推理崩溃影响输入法主进程 refactor(speech): 更新语音识别后端为IPC架构 - 将SherpaAsrBackend替换为IpcSherpaAsrBackend - 语音识别功能通过IPC与推理服务通信 - 改进错误提示信息和初始化逻辑 - 统一本地模型管理方式 perf(native): 集成NNAPI执行提供程序优化 - 在handwriting、onnx和punctuation模块中启用NNAPI - 添加OnnxTryEnableNnapi函数动态加载NNAPI提供程序 - 实现CPU回退机制确保兼容性 - 启用FP16精度优化以提升推理速度
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
feat(inference): 迁移AI推理服务到独立进程架构
refactor(speech): 更新语音识别后端为IPC架构
perf(native): 集成NNAPI执行提供程序优化
概述
简要描述此 PR 的目的和改动内容。
关联 Issue
Closes #（填写关联 issue 号）
改动类型
自测清单
./gradlew test并通过备注
补充说明（如有）。