K230 SDK Development Guide

• K230 RVV Performance Optimization Description
  • Preface
    • Overview
    • Audience
    • Revision History
  • 1. Overview
  • 2. RVV Application Scenarios
    • 2.1 Without RVV Optimization
    • 2.2 With RVV Optimization
    • 2.3 Performance Analysis and Description
    • 2.4 RVV Optimization Example
      • 2.4.1 RVV Code
      • 2.4.2 Core Code Explanation
      • 2.4.3 Adding RVV Operator Process
    • 2.5 Tips
• K230 Memory Optimization Guide
  • Memory Analysis
  • Memory Optimization
  • Small-core Memory Optimization
    • Linux Module Deletion
    • LVGL Display Memory Optimization
  • Large-core Memory Optimization
    • Memory Reuse
    • Multimedia Memory Optimization
    • ISP Memory Usage Optimization
    • RT-Smart System Memory Optimization
      • Heap Memory Optimization
      • Page Memory Optimization
  • Memory Optimization Results
• K230 Memory Analysis Guide
  • Small Core Memory Usage Analysis
    • Static Memory Usage in Linux Kernel
      • size Tool
      • ksize.py Script
    • Dynamic Memory Usage Analysis in Linux
      • free
      • /proc/meminfo Node
  • Large Core Memory Usage Analysis
    • Static Analysis
      • Using the size Tool
    • Dynamic Analysis
      • Heap Memory
      • Page Memory
      • Multimedia Dedicated Memory
• K230 Boot Optimization Guide
  • K230 Boot Sequence
  • Boot Time Measurement
    • Software Measurement
    • Hardware Measurement
    • External Observation
  • System Trimming
    • Small Core Trimming
      • Linux Image Trimming
      • Rootfs Trimming
      • File System Selection
    • Large Core Trimming
      • Large Core Application Trimming
    • Trimming Effects
  • Uboot Boot Optimization
  • Linux Boot Optimization
    • Remove Kernel Boot Print
    • Compile Time-Consuming Drivers as Modules
    • Application Startup Optimization
  • Large Core Boot Optimization
    • RT-Smart Boot
    • Application Optimization
  • Other Optimizations
  • Optimization Effects
• Introduction to K230 Big-Little Core Communication with Sharefs
  • Overview
  • Environment Preparation
    • Hardware Environment
    • Software Environment
  • Usage
    • Running sharefs
    • Creating, Writing, and Viewing Files
    • Creating Folders
    • Reading Files
    • Loading Files
    • Deleting Files
    • Others
    • Notes
• K230 OpenBLAS Development Guide
  • Preface
    • Overview
    • Target Audience
    • Abbreviation Definitions
    • Revision History
  • 1. Introduction to OpenBLAS
  • 2. Test Case Compilation
  • 3. Test Case Execution Demonstration
    • 3.1 level_1 Test Case
    • 3.2 level_2 Test Case
    • 3.3 level_3 Test Case
    • 3.4 Fortran Interface Test Case
  • 4. OpenBLAS Cross Compilation
    • 4.1 Setting Up the OpenBLAS Compilation Environment
      • 4.1.1 Git Code Download
      • 4.1.2 Applying Patch Package
    • 4.3 OpenBLAS Compilation
• K230 OpenCV Development Guide
  • Preface
    • Overview
    • Target Audience
    • Abbreviation Definitions
    • Revision History
  • 1. Introduction to OpenCV
  • 2. Example of Test Case Compilation
  • 3. Example of Running Test Cases
    • 3.1 opencv_calcHist
    • 3.2 opencv_threshold
    • 3.3 opencv_findContours
    • 3.4 opencv_features2d
    • 3.5 opencv_objdetect
  • 4. Cross-compilation and Use of the Original Version of OpenCV Library
    • 4.1 Download OpenCV Source Code
    • 4.2 Apply Patch Package
    • 4.3 Cross-compile OpenCV Static Library
    • 4.4 Compile Executable Program
• K230 Camera Sensor Adaptation Guide
  • Preface
    • Overview
    • Target Audience
    • Acronyms and Definitions
    • Revision History
  • 1. Overview
  • 2. Camera Sensor Framework
    • 2.1 Framework Introduction
  • 3. Sensor Adaptation Preparations
  • 4. Sensor Adaptation Example
    • 4.1 Define Supported Sensor Types
    • 4.2 Sensor Driver Adaptation
      • 4.2.1 Define Sensor Register Configuration List
      • 4.2.2 Define Supported Sensor Modes
      • 4.2.3 Implement Sensor Operation Interfaces
    • Translation to English
      • 4.2.4 Define the sensor driver structure
      • 4.2.5 Update the sensor driver list
    • 4.3 Update the sensor configuration information list
    • 4.4 Add sensor configuration files
    • 4.5 Porting existing sensor drivers
• K230 Power Consumption Management Adaptation Guide
  • Preface
    • Overview
    • Target Audience
    • Abbreviation Definitions
    • Revision History
  • 1. Overview
  • 2. Large Core Power Control
    • 2.1 Control Framework Introduction
      • 2.1.1 Power Management Domains
      • 2.1.2 Control Strategies
      • 2.1.3 Thermal Protection
      • 2.1.4 Power and Clock
      • 2.1.5 CPU1
      • 2.1.6 KPU
      • 2.1.7 DPU
      • 2.1.8 VPU
      • 2.1.9 DISPLAY
    • 2.2 Usage
      • 2.2.1 Using Manual Mode
      • 2.2.2 Using Other Modes
      • 2.2.3 Using Thermal Protection
      • 2.2.4 Using Custom Frequencies
    • 2.3 API Reference
      • 2.3.1 kd_mpi_pm_set_reg
      • 2.3.2 kd_mpi_pm_get_reg
      • 2.3.3 kd_mpi_pm_get_profiles
      • 2.3.4 kd_mpi_pm_get_stat
      • 2.3.5 kd_mpi_pm_set_governor
      • 2.3.6 kd_mpi_pm_get_governor
      • 2.3.7 kd_mpi_pm_set_profile
      • 2.3.8 kd_mpi_pm_get_profile
      • 2.3.9 kd_mpi_pm_set_profile_lock
      • 2.3.10 kd_mpi_pm_set_profile_unlock
      • 2.3.11 kd_mpi_pm_set_thermal_protect
      • 2.3.12 kd_mpi_pm_get_thermal_protect
      • 2.3.13 kd_mpi_pm_set_thermal_shutdown
      • 2.3.14 kd_mpi_pm_get_thermal_shutdown
      • 2.3.15 kd_mpi_pm_set_clock
      • 2.3.16 kd_mpi_pm_set_power
      • 2.3.17 kd_mpi_pm_runtime_runstage
    • 2.4 Data Structures
      • 2.4.1 k_pm_domain
      • 2.4.2 k_pm_governor
      • 2.4.3 k_pm_profile
      • 2.4.4 k_runtimestage_id
    • 2.5 Error Codes
  • 3. Low-Power Core Control
    • 3.1 Control Framework Introduction
    • 3.1.1 cpu_freq
• K230 VICAP SENSOR Parameter Partition Reference
  • Preface
    • Overview
    • Audience
    • Abbreviation Definitions
    • Revision Record
  • 1. Overview
    • 1.1 Overview
  • 2. Production Process Reference
    • 2.1 Flowchart
    • 2.2 Production Steps
      • 2.2.1 Convert Header File
      • 2.2.2 Convert Binary File
        • 2.2.2.1 Header Production
        • 2.2.2.2 Configuration Parameter Binary File Production
        • 2.2.2.3 Padding Generation
        • 2.2.2.4 Dewarp Parameter Configuration
        • 2.2.2.5 Merging Files
        • 2.2.2.6 Scripted Production of Binary Files
        • 2.2.2.6 Applying Parameter Partition
      • 2.2.3 Usage Method
      • 2.2.4 Precautions
• K230 LCD Adaptation Guide
  • Preface
    • Overview
    • Target Audience
    • Abbreviation Definitions
    • Revision History
  • 1. Overview
  • 2. LCD Adaptation Preparation Work
  • 3. LCD Adaptation Example
    • 3.1 Define Supported LCD Types
    • 3.2 LCD Driver Adaptation
      • 3.2.1 Add LCD Initialization Code
      • 3.2.2 Implement LCD Operation Interface
      • 3.2.3 Define LCD Driver Structure
      • 3.2.4 Update LCD Driver List
    • 3.3 Update LCD Configuration Information List
• K230 PMU User Guide
  • 1. Function introduction
  • 2. User Control
    • 2.1 PMU Device Tree Configuration
    • 2.2 PMU file control
    • 2.3 PMU events are reported
    • 2.4 PMU shutdown control
  • 3. Hardware connection
  • 4. Precautions
• K230 SDK IoT WiFi AiW4211LV10 User Guide
  • Preface
    • Overview
    • Reader Object
    • Definition of Acronyms
    • Revision History
  • 1. Function Introduction
  • 2. Module Dependencies
    • 2.1 Software Environment
    • 2.2 Hardware Environment
  • 3. Module Configuration
    • 3.1 SDK Directory Structure
    • 3.2 Customized Modifications
  • 4. Firmware Compilation
    • 4.1 Compilation Environment
    • 4.2 Compilation Methods
  • 5. Module Starts
    • 5.1 Firmware Flashing
    • 5.2 Driver Loading
    • 5.3 Parameter Configuration
      • 5.3.1 Configure AP Access Through the Network
      • 5.3.2 Configure AP Access Through Messages
        • 5.3.2.1 Configuration via the Configuration Tool
        • 5.3.2.2 Configure by Calling APIs
    • 5.4 System Hibernation
      • 5.4.1 Configuring Hibernation Through Tools
      • 5.4.2 Sleep by Calling the API
      • 5.4.3 Sleep by Monitoring Levels
    • 5.5 System Wake
      • 5.5.1 Key Wake-up
      • 5.5.2 Wake on LAN
  • 6. API Reference
    • 6.1 Config Interface
      • 6.1.1 API
      • 6.1.2 Data Structures
        • 6.1.2.1 wifi_config_t
        • 6.1.2.2 wifi_sleep_t
        • 6.1.2.3 wifi_connect_t
        • 6.1.2.4 wifi_keepalive_t
    • 6.2 Sleep Interface
  • 7. WiFi Function Limitation
• K230 SDK IoT WiFi AiW4211LV10 Driver Development Guide
  • Preface
    • Overview
    • Reader Object
    • Definition of Acronyms
    • Revision History
  • 1. Function Introduction
  • 2. Module Dependencies
    • 2.1 Operating System
    • 2.2 Hardware Environment
  • 3. Module Configuration
    • 3.1 Device Tree Modification
      • 3.1.1 Configure Pin Function
      • 3.1.2 Configure the GPIO Controller
      • 3.1.3 Configure SDHCI1 Parameters
    • 3.2 Kernel Configuration Items
    • 3.3 SDIO Master Adds Scanning Interface
  • 4. Module Compilation
  • 5. Module Starts
    • 5.1 WiFi Firmware
    • 5.2 Driver Loading
    • 5.3 Network Configuration
  • 6. API Reference
    • 6.1 Config Interface
      • 6.1.1 API
      • 6.1.2 Data Structures
        • 6.1.2.1 wifi_config_t
      • 6.1.2.2 wifi_sleep_t
      • 6.1.2.3 wifi_connect_t
      • 6.1.2.4 wifi_keepalive_t
    • 6.2 Sleep Interface
  • 7. Basic Performance Test
    • 7.1 Throughput Testing
  • 7.2 File Transfer Testing
• K230 nncase Development Guide
  • Preface
    • Overview
    • Target Audience
    • Abbreviation Definitions
    • Revision History
  • 1. Overview
    • 1.1 What is nncase
    • 1.2 nncase Architecture
    • 1.3 Development Environment
      • 1.3.1 Operating System
      • 1.3.2 Software Environment
      • 1.3.3 Hardware Environment
  • 2. Model Compilation APIs (Python)
    • 2.1 Supported Operators
      • 2.1.1 TFLite Operators
      • 2.1.2 ONNX Operators
    • 2.2 APIs
      • 2.2.1 CompileOptions
        • 2.2.1.1 Preprocessing Workflow
        • 2.2.1.2 Dynamic Shape Parameters
        • 2.2.1.3 Parameter Configuration Example
      • 2.2.2 ImportOptions
      • 2.2.3 PTQTensorOptions
      • 2.2.4 set_tensor_data
      • 2.2.5 Compiler
      • 2.2.6 import_tflite
      • 2.2.7 import_onnx
      • 2.2.8 use_ptq
      • 2.2.9 compile
      • 2.2.10 gencode_tobytes
    • 2.3 Examples
      • 2.3.1 Compiling a TFLite Model
      • 2.3.2 Compiling an ONNX Model
  • 3. Simulator APIs (Python)
    • 3.1 APIs
      • 3.1.1 MemoryRange
    • 3.1.2 RuntimeTensor
      • 3.1.3 from_numpy
      • 3.1.4 copy_to
      • 3.1.5 to_numpy
      • 3.1.6 Simulator
      • 3.1.7 load_model
      • 3.1.8 get_input_desc
      • 3.1.9 get_output_desc
      • 3.1.10 get_input_tensor
      • 3.1.11 set_input_tensor
      • 3.1.12 get_output_tensor
      • 3.1.13 set_output_tensor
      • 3.1.14 run
    • 3.2 Examples
  • 4. KPU Runtime APIs (C++)
    • 4.1 Introduction
    • 4.2 APIs
      • 4.2.1 hrt::create
      • 4.2.2 hrt::sync
      • 4.2.3 interpreter::load_model
      • 4.2.4 interpreter::inputs_size
      • 4.2.5 interpreter::outputs_size
      • 4.2.6 interpreter::input_shape
      • 4.2.7 interpreter::output_shape
      • 4.2.8 interpreter::input_tensor
      • 4.2.9 interpreter::output_tensor
      • 4.2.10 interpreter::run
    • 4.3 Example
  • 5. AI2D Runtime APIs (C++)
    • 5.1 Introduction
      • 5.1.1 Supported Format Conversions
      • 5.1.2 Function Descriptions
    • 5.2 APIs
      • 5.2.1 ai2d_format
      • 5.2.2 ai2d_interp_method
      • 5.2.3 ai2d_interp_mode
      • 5.2.4 ai2d_pad_mode
      • 5.2.5 ai2d_datatype_t
      • 5.2.6 ai2d_crop_param_t
      • 5.2.7 ai2d_shift_param_t
      • 5.2.8 ai2d_pad_param_t
      • 5.2.9 ai2d_resize_param_t
      • 5.2.10 ai2d_affine_param_t
      • 5.2.11 ai2d_builder::ai2d_builder
      • 5.2.12 ai2d_builder::build_schedule
      • 5.2.13 ai2d_builder::invoke
    • 5.3 Example
    • 5.4 Notes
• K230 SDK nncase Version Correspondence
  • Preface
    • Overview
    • Intended Audience
  • K230 SDK and nncase Version Correspondence
• K230 Debian Ubuntu Instructions
  • Preface
    • Overview
    • Target Audience
    • Abbreviation Definitions
    • Revision History
  • 1. Image Description
  • 2. Creating and Verifying the K230 Debian Root Filesystem
    • 2.1 Environment
    • 2.2 Creating the Debian Root Filesystem
    • 2.3 Creating the Image
    • 2.3 GCC Verification
  • 3. Creating and Verifying the K230 Ubuntu 23 System
    • 3.1 Environment
    • 3.2 Creating the K230 Ubuntu Root Filesystem
    • 3.3 Creating and Verifying the Image
    • 3.4 GCC Verification
  • 4. Adding Qt and LXQt Support
    • 4.1 Installing Qt, LXQt
    • 4.2 Running Qt Example
  • 5. References
• K230 SDK Burntool User Guide
  • Introduction
    • Overview
    • Target Audience
    • Abbreviations
    • Revision History
  • 1. Purpose of K230 Burning Tool
  • 2. How to Use the K230 Burning Tool
  • 3. K230 USB Burning Mechanism
  • 4. How to Develop K230 Burning Tool loader.bin
• K230 SDK Dewarp User Guide
  • Preface
    • Overview
    • Target Audience
    • Abbreviation Definitions
    • Revision History
  • 1. Introduction to Dewarp Calibration
    • 1.1 Capturing Images
    • 1.3 Dewarp Modes Introduction
      • Lens Correction
      • Split Screen
    • 1.2 Executing the Calibration Program
  • 2. Using Dewarp with the VICAP Module
    • Lens Correction Mode
    • Split Screen Mode
• K230 ISP Image Tuning Guide
  • Preface
    • Overview
    • Target Audience
    • Revision History
  • 1. Overview of K230 ISP Image Tuning
  • 2. Calibration
    • 2.1 Overview
    • 2.2 Black Level Correction
      • 2.2.1 Principle and Significance of Black Level Calibration
      • 2.2.2 Collecting RAW Images for Black Level Calibration
      • 2.2.3 Starting Calibration Using the Calibration Tool
    • 2.3 Lens Shading Correction
      • 2.3.1 Basic Principle and Significance of LSC Calibration
      • 2.3.2 Collecting RAW Images for LSC Calibration
      • 2.3.3 Starting Calibration Using the Calibration Tool
    • 2.4 Color Correction
      • 2.4.1 Principle of CCM Calibration
      • 2.4.2 Collecting RAW Images for CC Calibration
      • 2.4.3 Starting Calibration Using the Calibration Tool
    • 2.5 Auto White Balance
    • 2.5.1 Basic Principle and Significance of AWB Calibration
      • 2.5.2 Starting Calibration Using the Calibration Tool
      • 2.5.3 Calibration of AWB Parameter K_Factor
    • 2.6 Noise Calibration
      • 2.6.1 Principle and Significance of Noise Profile Calibration
      • 2.6.2 Collecting RAW Images for Noise Profile Calibration
      • 2.6.3 Starting Calibration Using the Calibration Tool
    • 2.7 Chromatic Aberration Correction
      • 2.7.1 Principle and Significance of CAC Calibration
      • 2.7.2 Collecting RAW Images for CAC Calibration
      • 2.7.3 Starting Calibration Using the Calibration Tool
  • 3. Module Introduction
    • 3.1 BLS
      • 3.1.1 Function Description
      • 3.1.2 Main Parameters
      • 3.1.3 Debugging Strategy
    • 3.2 LSC
      • 3.2.1 Function Description
      • 3.2.2 Main Parameters
    • 3.3 Dgain
      • 3.3.1 Function Description
      • 3.3.2 Main Parameters
    • 3.4 AE
      • 3.4.1 Function Description
      • 3.4.2 Main Parameters
    • 3.5 AWB
      • 3.5.1 Function Description
      • 3.5.2 Main Parameters
      • 3.5.3 Explanation of kFactor Calibration
    • 3.6 WDR
      • 3.6.1 Function Description
      • 3.6.2 Main Parameters
      • 3.6.3 Debugging Strategy
    • 3.7 GE
      • 3.7.1 Function Description
      • 3.7.2 Main Parameters
    • 3.8 DPCC
      • 3.8.1 Function Description
      • 3.8.2 Main Parameters
    • 3.9 DPF
      • 3.9.1 Function Description
      • 3.9.2 Main Parameters
    • 3.10 3DNR
      • 3.10.1 Function Description
      • 3.10.2 Main Parameters
      • 3.10.3 Debugging Strategy
    • 3.11 Demosaic
      • 3.11.1 Function Description
      • 3.11.2 Main Parameters
      • 3.11.3 Debugging Strategy
    • 3.12 ManualWB
      • 3.12.1 Function Description
      • 3.12.2 Main Parameters
    • 3.13 CCM
      • 3.13.1 Function Description
      • 3.13.2 Main Parameters
    • 3.14 Gamma
      • 3.14.1 Function Description
      • 3.14.2 Main Parameters
      • 3.14.3 Debugging Strategy
    • 3.15 EE
      • 3.15.1 Function Description
      • 3.15.2 Main Parameters
    • 3.16 CA
      • 3.16.1 Function Description
      • 3.16.2 Main Parameters
    • 3.17 DCI
      • 3.17.1 Function Description
    • 3.17.2 Main Parameters
    • 3.18 CProcess (Color Processing)
      • 3.18.1 Function Description
      • 3.18.2 Main Parameters
    • 3.19 Compand
      • 3.19.1 Function Description
      • 3.19.2 Main Parameters
    • 3.20 CAC (Chromatic Aberration Correction)
      • 3.20.1 Function Description
      • 3.20.2 Main Parameters
• K230 ISP Initialization Configuration Guide
  • Preface
    • Overview
    • Target Audience
    • Revision History
  • 1. Overview of K230 ISP Initialization Configuration
  • 2. xml File
    • 2.1 Overview
    • 2.2 Creating Folders for Calibration Parameter Files
    • 2.3 Generating the xml File Using the K230 ISP Calibration Tool
    • 2.4 AWB Parameter K_Factor
  • 3. manual.json File
    • 3.1 CHdrv2
      • 3.1.1 Function Description
      • 3.1.2 Main Parameters
    • 3.2 CGreenEqu
    • 3.3 CRgbIR
      • 3.3.1 Function Description
      • 3.3.2 Main Parameters
    • 3.4 CManualWb
    • 3.5 CCcm
    • 3.6 CDgain
    • 3.7 CCpdv1
    • 3.8 Bls
      • 3.8.1 Function Description
      • 3.8.2 Main Parameters
    • 3.9 CGamma64
    • 3.10 CDpcc
    • 3.11 CDpf
    • 3.12 CLscv2
    • 3.13 CWdrv4
    • 3.14 C3dnrv3_1
    • 3.15 CCproc
    • 3.16 CEEv1
      • 3.16.1 Function Description
      • 3.16.2 Main Parameters
    • 3.17 CDmscv2
      • 3.17.1 Function Description
      • 3.17.2 Main Parameters
  • 4. auto.json File
    • 4.1 AdaptiveAe
      • 4.1.1 Function Description
      • 4.1.2 Main Parameters
    • 4.2 Awbv2
      • 4.2.1 Function Description
      • 4.2.2 Main Parameters
    • 4.3 Af
      • 4.3.1 Function Description
      • 4.3.2 Main Parameters
    • 4.4 ALscv2
      • 4.4.1 Function Description
      • 4.4.2 Main Parameters
    • 4.5 Others
      • 4.5.1 Description of Parameters Outside the Tables
      • 4.5.2 Description of Parameters Inside the Tables
• K230 ISP Tuning Tool User Guide
  • Preface
    • Overview
    • Audience
    • Abbreviations
    • Revision History
  • 1. Module Software Architecture
  • 2. Tuning Tool Connection and Activation
    • 2.1 Tool Acquisition Path
    • 2.2 Startup Procedure
  • 3. Tuning Tool Interface Introduction
    • 3.1 Connect to Board-side Tuning Server
      • 3.1.1 Connect to Board-side Tuning Server Using HTTP
    • 3.2 Create/Select Project
      • 3.2.1 Create Debugging Project
    • 3.3 Online Debugging Interface and Function Description
      • 3.3.1 Bypass Settings
      • 3.3.2 Auto Focus Control (Focus Control)
      • 3.3.3 Auto Exposure Control (Exposure Control)
      • 3.3.4 Auto White Balance (White Balance)
      • 3.3.5 Exposure Statistics
      • 3.3.6 Auto Focus Measurement
      • 3.3.7 High Dynamic Range
      • 3.3.8 Compand
      • 3.3.9 Black Level Subtraction
      • 3.3.10 RGB Infrared Radiation
      • 3.3.11 Lens Shading Correction
      • 3.3.12 Digital Gain
      • 3.3.13 Wide Dynamic Range
      • 3.3.14 Green Equilibrate
      • 3.3.15 Defect Pixel Cluster Correction
      • 3.3.16 Denoising Prefilter
      • 3.3.17 3D Noise Reduction
      • 3.3.18 Demosaic
      • 3.3.19 Color Correction Matrix
      • 3.3.20 Gamma Correction
      • 3.3.21 Edge Enhance
      • 3.3.22 Color Processing
    • 3.4 Capture Image
    • 3.4.1 Set Image Format and Size
      • 3.4.2 Capture Image
    • 3.5 Import and Export Parameters
      • 3.5.1 Import Parameters
      • 3.5.2 Export Parameters