MindIE
面向推理执行部署，使能应用高效落地。昇腾推理引擎，基于昇腾硬件的运行加速、调试调优、快速迁移部署的高性能深度学习推理框架，分层开放满足各类需求，统一接口使能极简开发，沉淀能力构筑极致性能
倍级性能
使用MindIE，模型推理吞吐数倍提升，时延大幅降低，推理成本大幅下降
极简部署
MindIE支持单机、多机、大规模专家并行等极简的推理部署
降低负载
通过高效内存管理，KVCache压缩等多种优化技术，降低大量负载
开放兼容
支持MindIE Service服务化，以及vLLM、OpenAI、Triton等多种接口
MindIE助力昇腾易部署、高性能推理
MindIE视图生成
通过MindIE SD进行高性能视图生成推理和可视化
MindIE文本生成
通过MindIE LLM进行文本生成推理，服务化端到端推理全流程加速
第三方引擎推理
昇腾平台支持开源和客户自研推理引擎如vLLM等，并为其提供推理加速
应用使能（RAG、Agent等）
MindIE
推理引擎
推理服务
推理模型套件
加速套件
'%3e%3cpath%20d='M11.79%205.12C12.75%205.12%2013.52%204.35%2013.52%203.39C13.52%202.44%2012.75%201.66%2011.79%201.66C10.83%201.66%2010.06%202.44%2010.06%203.39C10.06%204.35%2010.83%205.12%2011.79%205.12ZM11.79%204.21C12.24%204.21%2012.61%203.84%2012.61%203.39C12.61%202.94%2012.24%202.58%2011.79%202.58C11.34%202.58%2010.98%202.94%2010.98%203.39C10.98%203.84%2011.34%204.21%2011.79%204.21ZM9.13%203.82C9.37%203.74%209.5%203.48%209.42%203.24C9.34%203%209.08%202.87%208.84%202.95C4.88%204.31%202.17%208.05%202.17%2012.3C2.17%2013.03%202.25%2013.75%202.4%2014.45C2.46%2014.7%202.7%2014.86%202.95%2014.8C3.2%2014.75%203.35%2014.5%203.3%2014.26C3.16%2013.62%203.08%2012.96%203.08%2012.3C3.08%208.44%205.54%205.05%209.13%203.82ZM15.27%202.96C19.22%204.33%2021.92%208.06%2021.92%2012.3C21.92%2013.03%2021.84%2013.75%2021.68%2014.45C21.63%2014.69%2021.38%2014.85%2021.14%2014.8C20.89%2014.74%2020.73%2014.5%2020.79%2014.25C20.93%2013.61%2021%2012.96%2021%2012.3C21%208.45%2018.55%205.07%2014.97%203.83C14.73%203.75%2014.61%203.48%2014.69%203.25C14.77%203.01%2015.04%202.88%2015.27%202.96ZM5.38%2017.39C5.38%2018.35%204.6%2019.12%203.65%2019.12C2.69%2019.12%201.92%2018.35%201.92%2017.39C1.92%2016.43%202.69%2015.66%203.65%2015.66C4.6%2015.66%205.38%2016.43%205.38%2017.39ZM19.94%2019.12C20.89%2019.12%2021.67%2018.35%2021.67%2017.39C21.67%2016.43%2020.89%2015.66%2019.94%2015.66C18.98%2015.66%2018.21%2016.43%2018.21%2017.39C18.21%2018.35%2018.98%2019.12%2019.94%2019.12ZM4.46%2017.39C4.46%2017.84%204.1%2018.21%203.65%2018.21C3.2%2018.21%202.83%2017.84%202.83%2017.39C2.83%2016.94%203.2%2016.58%203.65%2016.58C4.1%2016.58%204.46%2016.94%204.46%2017.39ZM19.94%2018.21C20.38%2018.21%2020.75%2017.84%2020.75%2017.39C20.75%2016.94%2020.38%2016.58%2019.94%2016.58C19.49%2016.58%2019.12%2016.94%2019.12%2017.39C19.12%2017.84%2019.49%2018.21%2019.94%2018.21ZM18.54%2019.13C18.7%2019.32%2018.68%2019.61%2018.49%2019.78C16.71%2021.31%2014.44%2022.17%2012.04%2022.17C9.79%2022.17%207.64%2021.41%205.91%2020.04C5.81%2019.95%205.7%2019.87%205.6%2019.78C5.41%2019.62%205.39%2019.33%205.55%2019.13C5.72%2018.94%206.01%2018.92%206.2%2019.09C6.29%2019.17%206.38%2019.24%206.48%2019.32C8.05%2020.57%209.99%2021.26%2012.04%2021.26C14.22%2021.26%2016.28%2020.48%2017.89%2019.08C18.08%2018.92%2018.37%2018.94%2018.54%2019.13Z'%20fill='%23000000'%20fill-opacity='1.000000'%20fill-rule='evenodd'/%3e%3cpath%20d='M6.15%208.01C6.61%207.34%207.53%207.17%208.2%207.63C8.62%207.92%208.84%208.38%208.84%208.85C8.84%208.97%208.83%209.09%208.79%209.21L10.48%2010.37C11.06%209.9%2011.9%209.84%2012.55%2010.29C12.8%2010.46%2012.99%2010.69%2013.12%2010.94L14.76%2010.62C14.8%2010.42%2014.88%2010.23%2015%2010.05C15.46%209.38%2016.38%209.21%2017.05%209.67C17.47%209.96%2017.69%2010.42%2017.69%2010.89C17.69%2011.18%2017.61%2011.47%2017.43%2011.73C16.97%2012.4%2016.05%2012.57%2015.38%2012.11C15.16%2011.96%2014.99%2011.75%2014.88%2011.53L13.29%2011.84C13.27%2012.14%2013.17%2012.43%2012.99%2012.7C12.67%2013.16%2012.16%2013.42%2011.63%2013.44L11.13%2015.2C11.52%2015.49%2011.73%2015.94%2011.73%2016.39C11.73%2016.68%2011.65%2016.97%2011.47%2017.23C11.01%2017.9%2010.09%2018.07%209.42%2017.61C9%2017.32%208.78%2016.86%208.78%2016.39C8.78%2016.1%208.86%2015.81%209.04%2015.56C9.32%2015.14%209.79%2014.92%2010.25%2014.92L10.74%2013.23C10.69%2013.21%2010.64%2013.17%2010.59%2013.14C10.1%2012.81%209.84%2012.26%209.84%2011.71C9.84%2011.51%209.87%2011.31%209.94%2011.11L8.3%209.99C7.81%2010.39%207.08%2010.45%206.53%2010.06C6.11%209.78%205.89%209.32%205.89%208.85C5.89%208.56%205.97%208.27%206.15%208.01ZM7.68%208.39C7.43%208.21%207.08%208.27%206.9%208.53C6.84%208.63%206.8%208.74%206.8%208.85C6.8%209.03%206.89%209.2%207.05%209.31C7.3%209.48%207.65%209.42%207.83%209.17C7.89%209.07%207.92%208.96%207.92%208.85C7.92%208.67%207.84%208.5%207.68%208.39ZM15.9%2011.35C16.15%2011.53%2016.5%2011.46%2016.67%2011.21C16.74%2011.11%2016.77%2011%2016.77%2010.89C16.77%2010.71%2016.69%2010.54%2016.53%2010.43C16.28%2010.26%2015.93%2010.32%2015.75%2010.57C15.69%2010.67%2015.65%2010.78%2015.65%2010.89C15.65%2011.07%2015.74%2011.25%2015.9%2011.35ZM12.03%2011.04C11.66%2010.79%2011.15%2010.88%2010.9%2011.25C10.8%2011.39%2010.75%2011.55%2010.75%2011.71C10.75%2011.97%2010.88%2012.23%2011.11%2012.39C11.48%2012.64%2011.98%2012.55%2012.24%2012.18C12.34%2012.03%2012.38%2011.87%2012.38%2011.72C12.38%2011.46%2012.26%2011.2%2012.03%2011.04ZM9.94%2016.85C10.19%2017.03%2010.54%2016.97%2010.72%2016.71C10.78%2016.61%2010.82%2016.5%2010.82%2016.39C10.82%2016.22%2010.73%2016.04%2010.57%2015.93C10.32%2015.76%209.97%2015.82%209.8%2016.08C9.73%2016.17%209.7%2016.28%209.7%2016.39C9.7%2016.57%209.78%2016.75%209.94%2016.85Z'%20fill='%23000000'%20fill-opacity='1.000000'%20fill-rule='evenodd'/%3e%3c/g%3e%3c/svg%3e)
MindIE Service 昇腾推理服务第三方
'%3e%3cpath%20d='M9.79%205C9.79%203.64%2010.89%202.54%2012.25%202.54C13.6%202.54%2014.7%203.64%2014.7%205C14.7%206.16%2013.88%207.14%2012.79%207.39L12.44%2011.04L11.55%2010.95L11.88%207.42C10.7%207.24%209.79%206.22%209.79%205ZM13.79%205C13.79%204.14%2013.1%203.44%2012.25%203.44C11.39%203.44%2010.7%204.14%2010.7%205C10.7%205.85%2011.39%206.54%2012.25%206.54C13.1%206.54%2013.79%205.85%2013.79%205ZM16.31%209.5C16.31%208.42%2017.19%207.54%2018.26%207.54C19.34%207.54%2020.21%208.42%2020.21%209.5C20.21%2010.57%2019.34%2011.44%2018.26%2011.44C17.77%2011.44%2017.32%2011.26%2016.97%2010.96L14.3%2012.38L13.88%2011.58L16.45%2010.21C16.36%209.99%2016.31%209.75%2016.31%209.5ZM19.31%209.5C19.31%208.91%2018.84%208.44%2018.26%208.44C17.68%208.44%2017.21%208.91%2017.21%209.5C17.21%2010.07%2017.68%2010.54%2018.26%2010.54C18.84%2010.54%2019.31%2010.07%2019.31%209.5ZM2.54%2010.5C2.54%209.42%203.42%208.54%204.5%208.54C5.57%208.54%206.45%209.42%206.45%2010.5C6.45%2010.59%206.44%2010.68%206.43%2010.76L9.98%2012.49L9.59%2013.3L6.1%2011.6C5.75%2012.11%205.16%2012.44%204.5%2012.44C3.42%2012.44%202.54%2011.57%202.54%2010.5ZM5.54%2010.5C5.54%209.91%205.08%209.44%204.5%209.44C3.91%209.44%203.45%209.91%203.45%2010.5C3.45%2011.07%203.91%2011.54%204.5%2011.54C5.08%2011.54%205.54%2011.07%205.54%2010.5ZM14.15%2013.47L16.95%2014.89C17.39%2014.23%2018.14%2013.79%2019%2013.79C20.35%2013.79%2021.45%2014.89%2021.45%2016.25C21.45%2017.6%2020.35%2018.69%2019%2018.69C17.64%2018.69%2016.54%2017.6%2016.54%2016.25C16.54%2016.07%2016.56%2015.89%2016.6%2015.72L13.75%2014.28L14.15%2013.47ZM20.54%2016.25C20.54%2015.39%2019.85%2014.69%2019%2014.69C18.14%2014.69%2017.45%2015.39%2017.45%2016.25C17.45%2017.1%2018.14%2017.79%2019%2017.79C19.85%2017.79%2020.54%2017.1%2020.54%2016.25ZM10.2%2014.73L10.85%2015.36L8.62%2017.67C8.98%2018.1%209.2%2018.65%209.2%2019.25C9.2%2020.6%208.1%2021.69%206.75%2021.69C5.39%2021.69%204.29%2020.6%204.29%2019.25C4.29%2017.89%205.39%2016.79%206.75%2016.79C7.17%2016.79%207.58%2016.9%207.93%2017.1L10.2%2014.73ZM12.82%2015.44L13.06%2017.3C13.12%2017.3%2013.18%2017.29%2013.25%2017.29C14.32%2017.29%2015.2%2018.17%2015.2%2019.25C15.2%2020.32%2014.32%2021.19%2013.25%2021.19C12.17%2021.19%2011.29%2020.32%2011.29%2019.25C11.29%2018.56%2011.65%2017.95%2012.19%2017.6L11.92%2015.55L12.82%2015.44ZM8.29%2019.25C8.29%2018.39%207.6%2017.69%206.75%2017.69C5.89%2017.69%205.2%2018.39%205.2%2019.25C5.2%2020.1%205.89%2020.79%206.75%2020.79C7.6%2020.79%208.29%2020.1%208.29%2019.25ZM14.29%2019.25C14.29%2018.66%2013.83%2018.19%2013.25%2018.19C12.66%2018.19%2012.2%2018.66%2012.2%2019.25C12.2%2019.82%2012.66%2020.29%2013.25%2020.29C13.83%2020.29%2014.29%2019.82%2014.29%2019.25Z'%20fill='%23303030'%20fill-opacity='1.000000'%20fill-rule='evenodd'/%3e%3cpath%20d='M9.29%2013.25C9.29%2011.75%2010.5%2010.54%2012%2010.54C13.49%2010.54%2014.7%2011.75%2014.7%2013.25C14.7%2014.74%2013.49%2015.94%2012%2015.94C10.5%2015.94%209.29%2014.74%209.29%2013.25ZM13.79%2013.25C13.79%2012.25%2012.99%2011.44%2012%2011.44C11%2011.44%2010.2%2012.25%2010.2%2013.25C10.2%2014.24%2011%2015.04%2012%2015.04C12.99%2015.04%2013.79%2014.24%2013.79%2013.25Z'%20fill='%23303030'%20fill-opacity='1.000000'%20fill-rule='evenodd'/%3e%3c/g%3e%3c/svg%3e)
MindIE SD
多模态生成'%3e%3cpath%20d='M13%2021.49C13%2021.74%2012.8%2021.94%2012.55%2021.94L5.5%2021.94C4.42%2021.94%203.54%2021.07%203.54%2019.99L3.54%204.99C3.54%203.92%204.42%203.04%205.5%203.04L18.5%203.04C19.57%203.04%2020.45%203.92%2020.45%204.99L20.45%2012.75C20.45%2012.99%2020.24%2013.19%2020%2013.19C19.75%2013.19%2019.54%2012.99%2019.54%2012.75L19.54%204.99C19.54%204.41%2019.08%203.94%2018.5%203.94L5.5%203.94C4.91%203.94%204.45%204.41%204.45%204.99L4.45%2019.99C4.45%2020.57%204.91%2021.04%205.5%2021.04L12.55%2021.04C12.8%2021.04%2013%2021.25%2013%2021.49ZM17%206.54C17.24%206.54%2017.45%206.75%2017.45%206.99C17.45%207.24%2017.24%207.44%2017%207.44L7%207.44C6.75%207.44%206.54%207.24%206.54%206.99C6.54%206.75%206.75%206.54%207%206.54L17%206.54ZM15.45%2010.99C15.45%2010.75%2015.24%2010.54%2015%2010.54L7%2010.54C6.75%2010.54%206.54%2010.75%206.54%2010.99C6.54%2011.24%206.75%2011.44%207%2011.44L15%2011.44C15.24%2011.44%2015.45%2011.24%2015.45%2010.99ZM13.45%2014.99C13.45%2014.75%2013.24%2014.54%2013%2014.54L7%2014.54C6.75%2014.54%206.54%2014.75%206.54%2014.99C6.54%2015.24%206.75%2015.44%207%2015.44L13%2015.44C13.24%2015.44%2013.45%2015.24%2013.45%2014.99Z'%20fill='%23000000'%20fill-opacity='1.000000'%20fill-rule='evenodd'/%3e%3cpath%20d='M18.44%2022.19C18.69%2022.19%2018.89%2021.99%2018.89%2021.75L18.89%2019.23L21.5%2019.23C21.74%2019.23%2021.95%2019.03%2021.95%2018.78C21.95%2018.53%2021.74%2018.33%2021.5%2018.33L18.89%2018.33L18.89%2015.85C18.89%2015.6%2018.69%2015.4%2018.44%2015.4C18.19%2015.4%2017.99%2015.6%2017.99%2015.85L17.99%2018.33L15.5%2018.33C15.25%2018.33%2015.04%2018.53%2015.04%2018.78C15.04%2019.03%2015.25%2019.23%2015.5%2019.23L17.99%2019.23L17.99%2021.75C17.99%2021.99%2018.19%2022.19%2018.44%2022.19Z'%20fill='%23000000'%20fill-opacity='1.000000'%20fill-rule='evenodd'/%3e%3c/g%3e%3c/svg%3e)
MindIE LLM
文本生成
vLLM / SGLang
文本生成
MindIE Turbo 推理模型加速库 可选MindIE SD
多模态生成
MindIE SD是视图生成加速套件，提供了一系列的软件加速方案，提高视图生成性能。
了解关键场景的核心技术
服务化集成部署
提供全面易用的服务化能力，提供自研方案和开源方案，方便业务集成部署
- 开放的MindIE服务化部署MindIE服务化开放支持多种第三方API ，如Triton、OpenAI，TGI，vLLM等，支持调用、会话管理、请求调度等
- vLLM开源生态全面支持通过vLLM Ascend开源项目，vLLM开源全面支持昇腾，核心特性全面支持
开发资源
快速上手
在线的开箱5步视频，帮助你轻易上手MindIE的使用之路
进阶学习
提供丰富的在线的课程，带你进一步学习MindIE的相关知识，成为专家
开发文档
查看MindIE产品技术文档，了解更多详细技术细节
开源项目
了解MindIE与开源社区的合作项目，其中包括昇腾vLLM适配层开源项目vllm-ascend等，点击查看开源项目内容
模型支持列表
MindIE支持的大语言和多模态模型及版本
故障案例
提供海量的问题分析思路和解决办法
点击推理开发，获取推理场景相关资源
客户案例
南方航空
南方航空使用昇腾MindIE部署深度求索DeepSeek大模型，深入探索人工智能算力底座在航班运行、物流运输、旅客服务、经营管理等场景的创新实践路径
深圳龙岗
使用MindIE接入部署DeepSeek助力政务和市民平台，方便政务处理和市民事务咨询等
东南大学
基于MindIE实现DeepSeek本地化部署，接入校园信息服务门户、数智东南app，为全校师生提供本地化服务，可同时支持800人在线问答，日均1亿+tokens