K230 SDK Practical Tutorial

• K230 Practical Basics - Hello World
  • Overview
  • Environment Preparation
    • Hardware Environment
    • Software Environment
    • Code Writing
    • Compiling an Executable for Small Core Linux
    • Compiling an Executable for Big Core RT-Smart
    • Running the Program
    • Advanced Big Core Program Compilation
• K230 AI Practical - HHB Neural Network Model Deployment Tool
  • Preface
    • Overview
    • Target Audience
    • Abbreviation Definitions
    • Revision History
  • 1. Overview
    • 1.1 HHB
    • 1.2 SHL
  • 2. HHB Model Compilation
    • 2.1 Environment Setup
    • 2.2 Model Compilation
  • 3. Demo
    • 3.1 Environment Setup
    • 3.2 Compile the Demo
    • Start Compilation
    • 3.3 Running the Demo
• K230 GPU Application Practice - Drawing Cool Graphics with VGLite
  • Preface
    • Overview
    • Audience
    • Acronym Definitions
    • Revision History
  • Concept Introduction
    • Basics of Vector Graphics
    • GPU Basics
  • Using the VGLite API
    • Preparing the Development Environment
      • make
      • CMake
    • Display
  • Drawing
    • Some Preparations
    • Polygon
    • Curves
    • Bitmap Fill
    • Gradient
• K230 RVV Practical Guide
  • Overview
  • Environment Preparation
    • Hardware Environment
    • Software Environment
  • Using RVV Functionality
    • Source Code Writing
      • Source Code
      • SCONS Configuration File
    • Compilation
    • Execution
    • Disassembly
• K230 USB Practical Application - UVC Transmission of YUV and Encoded Streams
  • Overview
  • 1. Environment Preparation
    • 1.1 Hardware Environment
    • 1.2 Software Environment
  • 2. SDK UVC Demo Experience
    • 2.1 Compile and Flash Firmware with Release SDK
    • 2.2 Execute Command to Test Demo
  • 3. How to Develop UVC Functionality
    • 3.1 USB/UVC Protocol
    • 3.1.1 USB Protocol
    • 3.1.2 UVC Protocol
    • 3.1.2.1 UVC Descriptors
    • 3.1.2.2 UVC Video Stream Format Selection
    • 3.1.2.3 UVC Video Stream Payload
    • 3.2 Linux Driver Layer
    • 3.2.1 Controller Driver
    • 3.2.2 Gadget Driver
    • 3.3 UVC-Gadget Application Layer
    • 3.4 Recommended Reference Materials
• K230 Image Practical - Boot Video and Boot Logo
  • Overview
  • 1. Environment Preparation
    • 1.1 Hardware Environment
    • 1.2 Software Environment
  • 2. Source Code Location
  • Source Code Analysis
  • 3. Program Execution
• K230 Coding in Action - rtsp sever build and stream
  • 1. Environmental preparation
    • 1.1 Hardware Environment
    • 1.2 Software Environment
    • 1.3 Run Preparation
  • 2. Introduction to the source code
    • 2.1 Source code location
    • 2.2 Source code introduction
      • 2.2.1 Main steps of the procedure
        • 2.2.1.1 Audio and video streaming process
        • 2.2.1.2 Voice intercom program
  • 3. Program execution
    • 3.1 RTSP push audio and video streaming
      • 3.1.1 Parameter description
      • 3.1.2 Compiling the Program
      • 3.1.3 Run the program
    • 3.2 Voice intercom
      • 3.2.1 Compiling the Program
      • 3.2.2 Description of rtsp_server parameters
      • 3.2.3 Run the program
  • 4. Run sharefs
• K230 Audio in Action - Audio capture, playback, codec
  • Reader object
  • Definition of acronyms
  • Revision history
  • 1. Overview
  • 2. Environmental preparation
    • 2.1 Hardware Environment
    • 2.2 Compiling the Program
      • 2.2.1 Compilation method
      • 2.2.2 Code Location
  • 3. Big core audio in action
    • 3.1 Parameter description
    • 3.2 Audio Capture
    • 3.2.1 I2S audio capture
    • 3.2.2 PDM audio capture
    • 3.3 Audio Playback
      • 3.3.1 I2S audio playback
    • 3.4 Audio codec
      • 3.4.1 Audio Coding
      • 3.4.2 Audio Decoding
    • 3.5 Loopback test
    • 3.5.1 I2S acquisition playback loop
    • 3.5.2 PDM acquisition playback loopback
    • 3.5.3 Codec loopback
  • 4. Little core audio in action
    • 4.1 Parameter description
    • 4.2 Audio Capture Coding
    • 4.3 Audio decoding playback
    • 4.4 Codec loopback
• K230 Scenario Practice - Smart Door Lock POC
  • K230 Smart Door Lock
    • Hardware Environment
    • Overview
    • Notes
    • Source Code Location
      • Compiling the Program
      • Running the Program
      • Function Demonstration
      • OTA
• K230 Scene Practice - Smart Door Lock POC - 3D Structured Light
  • K230 Smart Door Lock
    • Hardware Environment
    • Overview
    • Notes
    • Source Code Location
      • Compiling the Program
      • Running the Program
      • Function Demonstration
      • OTA
• K230 Practical Scenario - Maoyan POC
  • K230 Maoyan
    • Hardware Environment
  • Overview
  • Functional Demonstration
    • Doorbell Mode
      • Local Doorbell Voice Intercom
      • Remote Doorbell Video Intercom
  • Limitations and Notes
  • Source Code Location
  • Compiling the Program
    • Peephole Device
    • Simulated Mobile Device
  • Running the Program
    • Running the Peephole Device End Program
    • Running the Simulated Mobile End
• K230 Scenario Practice - Dictionary Pen POC
  • K230 Dictionary Pen
    • Hardware Environment
    • Overview
    • Notes
    • Source Code Location
      • Compiling the Program
      • Running the Program
      • Function Demonstration
• K230 Scenario Practice - DPU Depth Camera POC
  • K230 DPU Depth Camera
    • Hardware Environment
  • Overview
  • Instructions
  • Update Driver
  • Function Demonstration
• Introduction to K230 AI Demo
  • K230 AI Demo
    • Overview
    • Hardware Environment
    • Source Code Location
    • Compiling and Running the Program
      • a. Self-Compiling Board Image
    • b. Directly Download the Official Board Image
• K230 Fancy POC Introduction
  • K230 Fancy POC
    • Overview
    • Hardware Environment
    • Source Code Location
    • Compiling and Running the Program
      • a. Self-compiled Board Image
      • b. Direct Download of Official Board Image
• K230 SDK CanMV Board Demo User Guide
  • Preface
    • Overview
    • Intended Audience
    • Abbreviation Definitions
    • Revision History
  • 1. Overview
  • 2. Demo Introduction
    • 2.1 Display_demo
      • 2.1.1 Display_demo Introduction
      • 2.1.2 Feature Description
      • 2.1.3 Dependency Resources
      • 2.1.4 Usage Instructions
        • 2.1.4.1 Compilation
        • 2.1.4.2 Execution
    • 2.2 Venc_demo
      • 2.2.1 Venc_demo Introduction
      • 2.2.2 Feature Description
      • 2.2.3 Dependency Resources
      • 2.2.4 Usage Instructions
        • 2.2.4.1 mpp_demo Execution
        • 2.2.4.2 MAPI Encoding Demo
        • 2.2.4.3 Viewing Results
    • 2.3 Nonai_2d_demo
      • 2.3.1 Nonai_2d_demo Introduction
      • 2.3.2 Feature Description
      • 2.3.3 Dependency Resources
      • 2.3.4 Usage Instructions
        • 2.3.4.1 Execution
        • 2.3.4.2 Viewing Results
    • 2.4 Vdec_demo
      • 2.4.1 Vdec_demo Introduction
      • 2.4.2 Feature Description
      • 2.4.3 Dependency Resources
      • 2.4.4 Usage Instructions
        • 2.4.4.1 Execution
          • 2.4.4.1.1 VDEC Binding VO Decoding Display
          • 2.4.4.1.2 MAPI VDEC Binding VO Decoding Display
        • 2.4.4.2 Viewing Results
    • 2.5 Audio_demo
      • 2.5.1 Audio_demo Introduction
      • 2.5.2 Feature Description
        • 2.5.2.1 Audio Input
        • 2.5.2.2 Audio Output
        • 2.5.2.3 Audio Input and Output
        • 2.5.2.4 Audio Encoding and Decoding
      • 2.5.3 Usage Instructions
        • 2.5.3.1 Compilation
        • 2.5.3.2 Execution
          • 2.5.3.2.1 I2S Audio Input Test
          • 2.5.3.2.2 I2S Audio Output Test
          • 2.5.3.2.3 I2S Audio Input and Output API Interface Test
          • 2.5.3.2.4 System Bind Test for I2S Audio Input and Output Modules
          • 2.5.3.2.5 Encoding Test
          • 2.5.3.2.6 Decoding Test
          • 2.5.3.2.7 Audio Full Process Test
          • 2.5.3.2.8 mapi Audio Test
    • 2.6 Vicap_demo
      • 2.6.1 Vicap_demo Introduction
      • 2.6.2 Feature Description
      • 2.6.3 Dependency Resources
      • 2.6.4 Usage Instructions
        • 2.6.4.1 Compilation
        • 2.6.4.2 Execution
    • 2.7 DMA_demo
      • 2.7.1 DMA_demo Introduction
        • 2.7.1.1 Non-binding Mode
        • 2.7.1.2 Binding Mode
      • 2.7.2 Feature Description
      • 2.7.3 Dependency Resources
      • 2.7.4 Usage Instructions
        • 2.7.4.1 Compilation
        • 2.7.4.2 Execution
    • 2.8 USB_demo
      • 2.8.1 USB_demo Introduction
      • 2.8.2 Feature Description
      • 2.8.3 Dependency Resources
      • 2.8.4 Usage Instructions
        • 2.8.4.1 Simulating USB Drive as a Device
        • 2.8.4.2 Connecting USB Drive as a Host
        • 2.8.4.3 Simulating Mouse/Keyboard as a Device
        • 2.8.4.4 Connecting Mouse/Keyboard as a Host
    • 2.9 GPU_demo
      • 2.9.1 GPU_demo Introduction
      • 2.9.2 Feature Description
      • 2.9.3 Dependency Resources
      • 2.9.4 Usage Instructions
        • 2.9.4.1 tiger
        • 2.9.4.2 linearGrad
        • 2.9.4.3 imgIndex
        • 2.9.4.4 vglite_drm
        • 2.9.4.5 vglite_cube
    • 2.10 DRM Display Demo
      • 2.10.1 Demo Introduction
      • 2.10.2 Feature Description
      • 2.10.3 Dependency Resources
      • 2.10.4 Usage Instructions
        • 2.10.4.1 Compilation
        • 2.10.4.2 Execution
    • 2.11 LVGL Demo
      • 2.11.1 Demo Introduction
      • 2.11.3 Dependency Resources
      • 2.11.3 Usage Instructions
        • 2.11.3.1 Compilation
        • 2.11.3.2 Execution
    • 2.12 RTSP Streaming Demo
      • 2.12.1 Demo Introduction
      • 2.12.2 Feature Description
      • 2.12.3 Dependency Resources
      • 2.12.4 Usage Instructions
        • 2.12.4.1 Compilation
    • 2.12.4.2 Execution
    • 2.13 FaceAeDemo
      • 2.13.1 Demo Introduction
      • 2.13.2 Compilation
      • 2.13.3 Execution
    • 2.14 FFT Demo
      • 2.14.1 Demo Introduction
      • 2.14.2 Feature Description
      • 2.14.3 Dependency Resources
      • 2.14.4 Usage Instructions
        • 2.14.4.1 Compilation
        • 2.14.4.2 Execution
    • 2.15 SDIO WIFI
      • 2.15.1 Demo Introduction
      • 2.15.2 Compilation
      • 2.14.5 Execution
        • 2.14.5.1 STA Testing
        • 2.14.5.2 AP Testing
    • 2.15 UVC_demo
      • 2.15.1 uvc_demo Introduction
      • 2.15.2 Feature Description
      • 2.15.3 Dependency Resources
      • 2.15.4 Usage Instructions
        • 2.15.4.1 Compilation
        • 2.15.4.2 Execution
    • 2.16 YUV Sensor Demo
      • 2.16.1 Demo Introduction
      • 2.16.2 Feature Description
      • 2.16.3 Dependency Resources
      • 2.16.4 Usage Instructions
• K230 SDK EVB Board Demo User Guide
  • Preface
    • Overview
    • Intended Audience
    • Abbreviations
    • Revision History
  • 1. Overview
  • 2. Demo Introduction
    • 2.1 Display_demo
      • 2.1.1 Introduction to display_demo
      • 2.1.2 Feature Description
      • 2.1.3 Dependency Resources
      • 2.1.4 Usage Instructions
        • 2.1.4.1 Compilation
        • 2.1.4.2 Execution
    • 2.2 Venc_demo
      • 2.2.1 Introduction to Venc_demo
      • 2.2.2 Feature Description
      • 2.2.3 Dependency Resources
      • 2.2.4 Usage Instructions
        • 2.2.4.1 mpp_demo Execution
        • 2.2.4.2 MAPI Encoding Demo
        • 2.2.4.3 Viewing Results
    • 2.3 Nonai_2d_demo
      • 2.3.1 Introduction to Nonai_2d_demo
      • 2.3.2 Feature Description
      • 2.3.3 Dependency Resources
      • 2.3.4 Usage Instructions
        • 2.3.4.1 Execution
        • 2.3.4.2 Viewing Results
    • 2.4 Vdec_demo
      • 2.4.1 Introduction to Vdec_demo
      • 2.4.2 Feature Description
      • 2.4.3 Dependency Resources
      • 2.4.4 Usage Instructions
        • 2.4.4.1 Execution
          • 2.4.4.1.1 VDEC Binding VO Decoding Display
          • 2.4.4.1.2 MAPI VDEC Binding VO Decoding Display
        • 2.4.4.2 Viewing Results
    • 2.5 Audio_demo
      • 2.5.1 Introduction to audio_demo
      • 2.5.2 Feature Description
        • 2.5.2.1 Audio Input
        • 2.5.2.2 Audio Output
      • 2.5.2.3 Audio Input and Output
        • 2.5.2.4 Audio Codec
        • 2.5.2.5 Data Link
        • 2.5.2.6 Notes
      • 2.5.3 Dependency Resources
      • 2.5.4 Usage Instructions
        • 2.5.4.1 Compilation
        • 2.5.4.2 Execution
          • 2.5.4.2.1 I2S Audio Input Test
          • 2.5.4.2.2 PDM Audio Input Test
          • 2.5.4.2.3 I2S Audio Output Test
          • 2.5.4.2.4 I2S Audio Input and Output API Interface Test
          • 2.5.4.2.5 I2S Audio Input and Output Module System Binding Test
          • 2.5.4.2.6 PDM Audio Input, I2S Output API Interface Test
          • 2.5.4.2.7 PDM Audio Input, I2S Output System Binding Test
          • 2.5.4.2.8 Encoding Test
          • 2.5.4.2.9 Decoding Test
          • 2.5.4.2.10 Full Audio Process Test
          • 2.5.4.2.11 MAPI Audio Test
    • Translation to English
    • 2.6 Vicap_demo
      • 2.6.1 Introduction to vicap_demo
      • 2.6.2 Feature Description
      • 2.6.3 Dependency Resources
      • 2.6.4 Usage Instructions
        • 2.6.4.1 Compilation
        • 2.6.4.2 Execution
    • 2.7 DMA_demo
      • 2.7.1 Introduction to DMA_demo
        • 2.7.1.1 Non-binding Mode
        • 2.7.1.2 Binding Mode
      • 2.7.2 Feature Description
      • 2.7.3 Dependency Resources
      • 2.7.4 Usage Instructions
        • 2.7.4.1 Compilation
        • 2.7.4.2 Execution
    • 2.8 DPU_demo
      • 2.8.1 Introduction to dpu_demo
        • 2.8.1.1 Non-binding Mode
        • 2.8.1.2 Binding Mode
      • 2.8.2 Feature Description
      • 2.8.3 Dependency Resources
      • 2.8.4 Usage Instructions
        • 2.8.4.1 Compilation
        • 2.8.4.2 Execution
    • 2.9 UVC_demo
      • 2.9.1 Introduction to uvc_demo
      • 2.9.2 Feature Description
      • 2.9.3 Dependency Resources
      • 2.9.4 Usage Instructions
        • 2.9.4.1 Compilation
        • 2.9.4.2 Execution
    • 2.10 USB_demo
      • 2.10.1 Introduction to USB_demo
      • 2.10.2 Feature Description
      • 2.10.3 Dependency Resources
      • 2.10.4 Usage Instructions
        • 2.10.4.1 Simulate a USB Drive as a Device
        • 2.10.4.2 Connect a USB Drive as a Host
        • 2.10.4.3 Simulate a Mouse/Keyboard as a Device
        • 2.10.4.4 Connect a Mouse/Keyboard as a Host
    • 2.11 GPU_demo
      • 2.11.1 Introduction to GPU_demo
      • 2.11.2 Feature Description
      • 2.11.3 Dependency Resources
      • 2.11.4 Usage Instructions
        • 2.11.4.1 tiger
        • 2.11.4.2 linearGrad
        • 2.11.4.3 imgIndex
        • 2.11.4.4 vglite_drm
        • 2.11.4.5 vglite_cube
    • 2.12 DRM Display Demo
      • 2.12.1 Introduction to the Demo
      • 2.12.2 Feature Description
      • 2.12.3 Dependency Resources
      • 2.12.4 Usage Instructions
        • 2.12.4.1 Compilation
        • 2.12.4.2 Execution
    • 2.13 LVGL Demo
      • 2.13.1 Introduction to the Demo
      • 2.13.3 Dependency Resources
      • 2.13.2 Feature Description
      • 2.13.4 Usage Instructions
        • 2.13.4.1 Compilation
        • 2.13.4.2 Execution
    • 2.14 RTSP Streaming Demo
      • 2.14.1 Introduction to the Demo
      • 2.14.2 Feature Description
      • 2.14.3 Dependency Resources
      • 2.14.4 Usage Instructions
        • 2.14.4.1 Compilation
        • 2.14.4.2 Execution
    • 2.15 FaceAeDemo
      • 2.15.1 Demo Introduction
      • 2.15.2 Compilation
      • 2.15.3 Execution
    • 2.16 DPU_Vicap_demo
      • 2.16.1 Demo Introduction
      • 2.16.2 Feature Description
      • 2.16.3 Dependency Resources
      • 2.16.4 Usage Instructions
        • 2.16.4.1 Compilation
        • 2.16.4.2 Execution
        • 2.16.4.3 Results
    • 2.17 VICAP_DMA_DPU_demo
      • 2.17.1 Demo Introduction
      • 2.17.2 Feature Description
      • 2.17.3 Dependency Resources
      • 2.17.4 Usage Instructions
        • 2.17.4.1 Compilation
        • 2.17.4.2 Execution
    • 2.18 Voice Intercom Demo
      • 2.18.1 Demo Introduction
      • 2.18.2 Feature Description
      • 2.18.3 Dependency Resources
      • 2.18.4 Usage Instructions
        • 2.18.4.1 Compilation
        • 2.18.4.2 rtsp_server Parameter Description
        • 2.18.4.3 Execution
    • 2.19 Depth Map Display Demo
      • 2.19.1 Demo Introduction
      • 2.19.2 Feature Description
      • 2.19.3 Dependency Resources
      • 2.19.4 Usage Instructions
        • 2.19.4.1 Compilation
        • 2.19.4.2 Execution
    • 2.20 OTA Remote Upgrade Demo
      • 2.20.1 Demo Introduction
      • 2.20.2 Feature Description
      • 2.20.3 Dependency Resources
      • 2.20.4 Usage Instructions
        • 2.20.4.1 Creating an Upgrade Package
        • 2.20.4.2 Compiling Device-side Programs
        • 2.20.4.3 Execution
    • 2.21 FFT Demo
      • 2.21.1 Demo Introduction
      • 2.21.2 Feature Description
      • 2.21.3 Dependency Resources
      • 2.21.4 Usage Instructions
        • 2.21.4.1 Compilation
        • 2.21.4.2 Execution
• K230D SDK Zero Board Demo Usage Guide
  • Foreword
    • Overview
    • Intended Audience
    • Abbreviation Definitions
    • Revision History
  • 1. Overview
  • 2. Demo Introduction
    • 2.1 Vicap_demo
      • 2.1.1 Vicap_demo Introduction
      • 2.1.2 Feature Description
      • 2.1.3 Dependency Resources
      • 2.1.4 Usage Instructions
        • 2.1.4.1 Compilation
        • 2.1.4.2 Execution
    • 2.2 DMA_demo
      • 2.2.1 DMA_demo Introduction
        • 2.2.1.1 Non-Binding Mode
        • 2.2.1.2 Binding Mode
      • 2.2.2 Feature Description
      • 2.2.3 Dependency Resources
      • 2.2.4 Usage Instructions
        • 2.2.4.1 Compilation
        • 2.2.4.2 Execution
    • 2.3 USB_demo
      • 2.3.1 USB_demo Introduction
      • 2.3.2 Feature Description
      • 2.3.3 Dependency Resources
      • 2.3.4 Usage Instructions
        • 2.3.4.1 Simulate USB Drive as Device
        • 2.3.4.2 Connect USB Drive as Host
        • 2.3.4.3 Simulate Mouse and Keyboard as Device
        • 2.3.4.4 Connect Mouse and Keyboard as Host
    • 2.4 FFT Demo
      • 2.4.1 Demo Introduction
      • 2.4.2 Feature Description
      • 2.4.3 Dependency Resources
      • 2.4.4 Usage Instructions
        • 2.4.4.1 Compilation
        • 2.4.4.2 Execution