Skip to main content
Use a Qualcomm-provided Jupyter notebook to prepare, optimize, and deploy large language models (LLMs) on Qualcomm platforms in an interactive and step-by-step environment. The Jupyter notebooks offer full transparency and customization during model preparation and execution. The following image depicts the three primary steps, along with their corresponding Jupyter notebooks, that are commonly used throughout the workflow: model preparation, model conversion, and model execution. Three-stage Jupyter notebook workflow: model preparation, model conversion, and model execution The following table summarizes the Jupyter notebook workflow for GenAI models. This workflow is applicable for multiple categories of GenAI models, including LLM and vision models.
Jupyter notebooks for model export are available in Qualcomm Package Manager. Navigate to Tools and search for Generative AI Tutorials to view the available notebooks.