K230 SDK Development Guide

• K230 RVV optimization performance description
  • Disclaimer
  • Trademark Notice
  • Directory
  • preface
    • Overview
    • Reader object
    • Revision history
  • 1. Overview
  • 2. RVV application scenarios
    • 2.1 RVV optimization is not enabled
    • 2.2 Enable RVV optimization
    • 2.3 Performance Analysis and Description
    • 2.4 RVV optimization example
      • 2.4.1 RVV code
      • 2.4.2 Core Code Description
      • 2.4.3 Add RVV operator process
    • 2.5 tips
• K230 Memory Optimization Guide
  • Disclaimer
  • Trademark Notice
  • Memory analysis
  • Memory optimization
  • Small-core memory optimization
    • Linux module removal
    • LVGL shows memory optimization
  • Big core memory optimization
    • Memory multiplexing
    • Multimedia memory optimization
    • ISP memory usage optimization
    • RT-Smart system memory optimization
      • Heap memory optimization
      • Page memory optimization
  • Memory optimization effects
• K230 Memory Analysis Guide
  • Disclaimer
  • Trademark Notice
  • Little core memory footprint analysis
    • The Linux kernel is statically occupied
      • Size tool
      • ksize.py Screenplay
      • nm command
    • Linux dynamic occupancy analysis
      • free
      • /proc/meminfo node
  • Big core memory consumption analysis
    • Static analysis
      • Use the size tool
    • Dynamic analysis
      • Heap memory
      • Page memory
      • Dedicated memory for multimedia
• K230 Boot Optimization Guide
  • Disclaimer
  • Trademark Notice
  • K230 boot sequence
  • Start-up time measurement
    • Software measurement
    • Hardware measurement
    • External observations
  • System cropping
    • Little core cropping
      • Linux image pruning
      • rootfs cropping
      • File system selection
    • Big core cropping
      • Big core app cropping
    • Crop effect
  • uboot startup optimization
  • Linux boot optimization
    • Remove kernel boot printing
    • Organize time-consuming drivers into modules
    • Application startup optimization
  • Big Core startup optimization
    • RT-Smart starts
    • Application optimization
  • Other optimizations
  • Optimize performance
• K230 Inter Processer Communication Sharefs Usage
  • Disclaimer
  • Trademark Notice
  • overview
  • Environment preparation
    • Hardware environment
    • Software environment
  • use
    • Sharefs runs
    • File creation, write, view
    • Folder creation
    • File read
    • File loading
    • File deletion
    • other
    • Notes
• K230 OpenBLAS Development Guide
  • disclaimer
  • Trademark Notice
  • directory
  • preface
    • overview
    • Reader object
    • Definition of acronyms
    • Revision history
  • 1.Introduction to OpenBLAS
  • 2. Test case compilation
  • 3. Test case run demo
    • 3.1 level_1 Test Cases
    • 3.2 level_2 Test Cases
    • 3.3 level_3 Test Cases
    • 3.4 Fortran Interface Test Cases
  • 4.OpenBLAS cross-compilation
    • 4.1 OpenBLAS compilation environment is set up
      • 4.1.1 Git code download
      • 4.1.2 Patch Service Pack Application
    • 4.3 OpenBLAS compilation
• K230 OpenCV Development Guide
  • disclaimer
  • Trademark Notice
  • directory
  • preface
    • overview
    • Reader object
    • Definition of acronyms
    • Revision history
  • 1. Introduction to OpenCV
  • 2. Test case compilation example
  • 3. Test case run example
    • 3.1 opencv_calcHist
    • 3.2 opencv_threshold
    • 3.3 opencv_findContours
    • 3.4 opencv_features2d
    • 3.5 opencv_objdetect
  • 4. Cross-compilation and use of the original version of OpenCV library
    • 4.1 Download the OpenCV source code
    • 4.2 Apply patch service packs
    • 4.3 Cross-compiling OpenCV static libraries
    • 4.4 Compiling Executable Programs
• K230 Camera Sensor Adaptation Guide
  • Disclaimer
  • Trademark Notice
  • Directory
  • preface
    • Overview
    • Reader object
    • Definition of acronyms
    • Revision history
  • 1. Overview
  • 2. Camera Sensor Framework
    • 2.1 Introduction to the framework
  • 3. Sensor adaptation preparation
  • 4. Sensor adaptation example
    • 4.1 Define supported sensor types
    • 4.2 Sensor driver adaptation
      • 4.2.1 Define the list of sensor register configurations
      • 4.2.2 Define the modes supported by the sensor
      • 4.2.3 Implement the sensor operation interface
      • 4.2.4 Define the sensor-driven structure
      • 4.2.5 Update the sensor driver list
    • 4.3 Update the list of sensor configuration information
    • 4.4 Add sensor configuration file
• K230 Power Management Usage Guide
  • Disclaimer
  • Trademark Notice
  • Directory
  • preface
    • Overview
    • Reader object
    • Definition of acronyms
    • Revision history
  • 1. Overview
  • 2. Big core power consumption control
    • 2.1 Introduction to the control framework
      • 2.1.1 Power Management Domains
      • 2.1.2 Control Policies
      • 2.1.3 Thermal Protection
      • 2.1.4 Power Supply and Clock
      • 2.1.5 CPU1
      • 2.1.6 KPU
      • 2.1.7 DPU
      • 2.1.8 VPU
      • 2.1.9 DISPLAY
    • 2.2 Usage
      • 2.2.1 Use manual mode
      • 2.2.2 Use other modes
      • 2.2.3 Use thermal protection
      • 2.2.4 Use custom frequencies
    • 2.3 API Reference
      • 2.3.1 kd_mpi_pm_set_reg
      • 2.3.2 kd_mpi_pm_get_reg
      • 2.3.3 kd_mpi_pm_get_profiles
      • 2.3.4 kd_mpi_pm_get_stat
      • 2.3.5 kd_mpi_pm_set_governor
      • 2.3.6 kd_mpi_pm_get_governor
      • 2.3.7 kd_mpi_pm_set_profile
      • 2.3.8 kd_mpi_pm_get_profile
      • 2.3.9 kd_mpi_pm_set_profile_lock
      • 2.3.10 kd_mpi_pm_set_profile_unlock
      • 2.3.11 kd_mpi_pm_set_thermal_protect
      • 2.3.12 kd_mpi_pm_get_thermal_protect
      • 2.3.13 kd_mpi_pm_set_thermal_shutdown
      • 2.3.14 kd_mpi_pm_get_thermal_shutdown
      • 2.3.15 kd_mpi_pm_set_clock
      • 2.3.16 kd_mpi_pm_set_power
      • 2.3.17 kd_mpi_pm_runtime_runstage
    • 2.4 Data Structures
      • 2.4.1 k_pm_domain
      • 2.4.2 k_pm_governor
      • 2.4.3 k_pm_profile
      • 2.4.4 k_runtimestage_id
    • 2.5 Error Codes
  • 3. Little core power consumption control
    • 3.1 Introduction to the control framework
    • 3.1.1 cpu_freq
• K230 VICAP SENSOR Parameter Partition Reference
  • Disclaimer
  • Trademark Notice
  • Directory
  • preface
    • Overview
    • Reader object
    • Definition of acronyms
    • Revision history
  • 1. Overview
    • 1.1 Overview
  • 2. Production process reference
    • 2.1 Flowchart
    • 2.2 Production steps
      • 2.2.1 Convert header files
      • 2.2.2 Converting binaries
        • 2.2.2.1 Header creation
        • 2.2.2.2 Configuration parameter binary file creation
        • 2.2.2.3 padding file
        • 2.2.2.4 Dewarp parameter configuration
        • 2.2.2.5 Merge files
        • 2.2.2.6 Scripting binary files
        • 2.2.2.6 Punching into the parameter partition
      • 2.2.3 Usage
      • 2.2.4 Precautions
• K230 PMU User Guide
  • Disclaimer
  • Trademark Notice
  • Directory
  • preface
    • Overview
    • Reader object
    • Definition of acronyms
    • Revision history
  • 1. Function introduction
  • 2. User Control
    • 2.1 PMU Device Tree Configuration
    • 2.2 PMU file control
    • 2.3 PMU events are reported
    • 2.4 PMU shutdown control
  • 3. Hardware connection
  • 4. Precautions
• K230 SDK IoT WiFi AiW4211LV10 User Guide
  • Disclaimer
  • Trademark Notice
  • Directory
  • Preface
    • Overview
    • Reader Object
    • Definition of Acronyms
    • Revision History
  • 1. Function Introduction
  • 2. Module Dependencies
    • 2.1 Software Environment
    • 2.2 Hardware Environment
  • 3. Module Configuration
    • 3.1 SDK Directory Structure
    • 3.2 Customized Modifications
  • 4. Firmware Compilation
    • 4.1 Compilation Environment
    • 4.2 Compilation Methods
  • 5. Module Starts
    • 5.1 Firmware Flashing
    • 5.2 Driver Loading
    • 5.3 Parameter Configuration
      • 5.3.1 Configure AP Access Through the Network
      • 5.3.2 Configure AP Access Through Messages
        • 5.3.2.1 Configuration via the Configuration Tool
        • 5.3.2.2 Configure by Calling APIs
    • 5.4 System Hibernation
      • 5.4.1 Configuring Hibernation Through Tools
      • 5.4.2 Sleep by Calling the API
      • 5.4.3 Sleep by Monitoring Levels
    • 5.5 System Wake
      • 5.5.1 Key Wake-up
      • 5.5.2 Wake on LAN
  • 6. API Reference
    • 6.1 Config Interface
      • 6.1.1 API
      • 6.1.2 Data Structures
        • 6.1.2.1 wifi_config_t
        • 6.1.2.2 wifi_sleep_t
        • 6.1.2.3 wifi_connect_t
        • 6.1.2.4 wifi_keepalive_t
    • 6.2 Sleep Interface
  • 7. WiFi Function Limitation
• K230 SDK IoT WiFi AiW4211LV10 Driver Development Guide
  • Disclaimer
  • Trademark Notice
  • Directory
  • Preface
    • Overview
    • Reader Object
    • Definition of Acronyms
    • Revision History
  • 1. Function Introduction
  • 2. Module Dependencies
    • 2.1 Operating System
    • 2.2 Hardware Environment
  • 3. Module Configuration
    • 3.1 Device Tree Modification
      • 3.1.1 Configure Pin Function
      • 3.1.2 Configure the GPIO Controller
      • 3.1.3 Configure SDHCI1 Parameters
    • 3.2 Kernel Configuration Items
    • 3.3 SDIO Master Adds Scanning Interface
  • 4. Module Compilation
  • 5. Module Starts
    • 5.1 WiFi Firmware
    • 5.2 Driver Loading
    • 5.3 Network Configuration
  • 6. API Reference
    • 6.1 Config Interface
      • 6.1.1 API
      • 6.1.2 Data Structures
        • 6.1.2.1 wifi_config_t
      • 6.1.2.2 wifi_sleep_t
      • 6.1.2.3 wifi_connect_t
      • 6.1.2.4 wifi_keepalive_t
    • 6.2 Sleep Interface
  • 7. Basic Performance Test
    • 7.1 Throughput Testing
  • 7.2 File Transfer Testing
• K230 nncase Development Guide
  • Disclaimer
  • Trademark Notice
  • Directory
  • preface
    • Overview
    • Reader object
    • Definition of acronyms
    • Revision history
  • 1. Overview
    • 1.1 What is nncase
    • 1.2 nncase architecture
    • 1.3 Development Environment
      • 1.3.1 Operating System
      • 1.3.2 Software Environment
      • 1.3.3 Hardware Environment
  • 2. Compiling Model APIs (Python)
    • 2.1 Supported operators
      • 2.1.1 tflite arithmetic
      • 2.1.2 ONNX arithmetic
    • 2.2 APIs
      • 2.2.1 CompileOptions
      • 2.2.2 ImportOptions
      • 2.2.3 PTQTensorOptions
      • 2.2.4 set_tensor_data
      • 2.2.5 Compiler
      • 2.2.6 import_tflite
      • 2.2.7 import_onnx
      • 2.2.8 use_ptq
      • 2.2.9 compile
      • 2.2.10 gencode_tobytes
    • 2.3 Examples
      • 2.3.1 Compiling the tflite model
      • 2.3.2 Compiling the ONNX model
  • 3. Simulator APIs (Python)
    • 3.1 APIs
      • 3.1.1 MemoryRange
      • 3.1.2 RuntimeTensor
      • 3.1.3 from_numpy
      • 3.1.4 copy_to
      • 3.1.5 to_numpy
      • 3.1.6 Simulator
      • 3.1.7 load_model
      • 3.1.8 get_input_desc
      • 3.1.9 get_output_desc
      • 3.1.10 get_input_tensor
      • 3.1.11 set_input_tensor
      • 3.1.12 get_output_tensor
      • 3.1.13 set_output_tensor
      • 3.1.14 run
    • 3.2 Examples
  • 4. KPU runtime APIs (C++)
    • 4.1 Introduction
    • 4.2 APIs
      • 4.2.1 hrt::create
      • 4.2.2 hrt::sync
      • 4.2.3 interpreter::load_model
      • 4.2.4 interpreter::inputs_size
      • 4.2.5 interpreter::outputs_size
      • 4.2.6 interpreter:: input_shape
      • 4.2.7 interpreter:: output_shape
      • 4.2.8 interpreter:: input_tensor
      • 4.2.9 interpreter:: output_tensor
      • 4.2.10 interpreter:: run
    • 4.3 Examples
  • 5. AI2D runtime APIs (C++)
    • 5.1 Introduction
      • 5.1.1 Supported format conversions
      • 5.1.2 Function Description
    • 5.2 APIs
      • 5.2.1 ai2d_format
      • 5.2.2 ai2d_interp_method
      • 5.2.3 ai2d_interp_mode
      • 5.2.4 ai2d_pad_mode
      • 5.2.5 ai2d_datatype_t
      • 5.2.6 ai2d_crop_param_t
      • 5.2.7 ai2d_shift_param_t
      • 5.2.8 ai2d_pad_param_t
      • 5.2.9 ai2d_resize_param_t
      • 5.2.10 ai2d_affine_param_t
      • 5.2.11 ai2d_builder:: ai2d_builder
      • 5.2.12 ai2d_builder:: build_schedule
      • 5.2.13 ai2d_builder:: invoke
    • 5.3 Examples
    • 5.4 Precautions
  • 6. FAQ
    • 6.1 xxx.whl is not a supported wheel on this platform. Error is reported when installing wheel package
    • 6.2 python: symbol lookup error error is reported when compiling the model
    • 6.3 std::bad_alloc error is reported when running the inference app on the board
    • 6.4 data.size_bytes() == size = false (bool) error is reported when running the App inference program on the board
• K230_SDK_nncase_version_correspondence
  • Disclaimer
  • Trademark Notice
  • Directory
  • preface
    • Overview
    • Reader object
  • Correspondence between SDK, CanMV version and nncase version
• K230 debian ubuntu Notes
  • Disclaimer
  • Trademark Notice
  • Directory
  • preface
    • Overview
    • Reader object
    • Definition of acronyms
    • Revision history
  • 1. download note
  • 2. k230 debian Rootfs build and verification
    • 2.1 environment
    • 2.2 debian rootfs build
    • 2.3image build
    • 1.3gcc test
  • 3. k230 ubuntu23 rootfs build
    • 3.1 environment
    • 3.2 k230 ubuntu rootfs build
    • 3.3 image build
    • 2.4 gcc test
  • 4.add Qt and lxqt
    • 4.1 install Qt, lxqt
    • 4.2 run Qt example
    • 4.3 run lxqt
  • 5. reference material
• K230 SDK Burntool User Guide
  • Disclaimer
  • Trademark Notice
  • Directory
  • Preface
    • Overview
    • Reader Object
    • Definition of Acronyms
    • Revision History
  • 1. Purpose of K230 burning tool
  • 2. How to use the K230 burning tool
  • 3. K230 USB burning mechanism
  • 4. How to develop the K230 burning tool loader.bin
• K230 SDK Dewarp User Guide
  • Disclaimer
  • Trademark Notice
  • Directory
  • Preface
    • Overview
    • Reader object
    • Definition of acronyms
    • Revision history
  • 1. Introduction to Dewarp calibration
    • 1.1 Grab images
    • 1.3 Import to the Dewarp pattern
      • Lens correction
      • Split screen
    • 1.2 Perform calibration procedures
  • 2. Dewarp works with the VICAP module
    • Lens correction mode
    • Split screen mode
• K230 ISP Image Tuning Guide
  • Disclaimer
  • Trademark Notice
  • Directory
  • Preface
    • Overview
    • Reader object
    • Revision history
  • 1. K230 ISP Image Tuning Overview
  • 2. Calibration
    • 2.1 Overview
    • 2.2 Black level correction
      • 2.2.1 The principle and significance of black level calibration
      • 2.2.2 Black level calibration acquisition RAW image
      • 2.2.3 Start calibration using the calibration tool
    • 2.3 Lens shading Correction
      • 2.3.1 Basic principle and significance of LSC calibration
      • 2.3.2 LSC calibration acquisition RAW image
      • 2.3.3 Start calibration using the calibration tool
    • 2.4 Color Correction
      • 2.4.1 CCM calibration principle
      • 2.4.2 CC calibration to acquire RAW images
      • 2.4.3 Start calibration using the calibration tool
    • 2.5 Auto White Balance
      • 2.5.1 Basic principle and significance of AWB calibration
      • 2.5.2 Start calibration using the calibration tool
      • 2.5.3 calibration of AWB parameter K_Factor
    • 2.6 Noise Calibration
      • 2.6.1 The principle and significance of Noise Profile calibration
      • 2.6.2 Noise Profile calibrated to acquire RAW images
      • 2.6.3 Start calibration using the calibration tool
    • 2.7 Chromatic Aberration Correction
      • 2.7.1 The principle and significance of CAC calibration
      • 2.7.2 CAC calibration acquisition RAW image
      • 2.7.3 Start calibration using the calibration tool
  • 3. Module introduction
    • 3.1 BLS
      • 3.1.1 Function Description
      • 3.1.2 Main parameters
      • 3.1.3 Tuning Strategy
    • 3.2 LSC
      • 3.2.1 Function Description
      • 3.2.2 Main parameters
    • 3.3 Dgain
      • 3.3.1 Function Description
      • 3.3.2 Main parameters
    • 3.4 AE
      • 3.4.1 Function Description
      • 3.4.2 Main parameters
    • 3.5 AWB
      • 3.5.1 Function Description
      • 3.5.2 Main parameters
      • 3.5.3 Parameter kFactor calibration instructions
    • 3.6 WDR
      • 3.6.1 Function Description
      • 3.6.2 Main parameters
      • 3.6.3 Tuning Strategies
    • 3.7 GE
      • 3.7.1 Function Description
      • 3.7.2 Main parameters
    • 3.8 DPCC
      • 3.8.1 Function Description
      • 3.8.2 Main parameters
    • 3.9 DPF
      • 3.9.1 Function Description
      • 3.9.2 Main parameters
    • 3.10 3DNR
      • 3.10.1 Function Description
      • 3.10.2 Main Parameters
      • 3.10.3 Tuning Strategies
    • 3.11 Demosaic
      • 3.11.1 Function Description
      • 3.11.2 Main Parameters
      • 3.11.3 Tuning Strategies
    • 3.12 ManualWB
      • 3.12.1 Function Description
      • 3.12.2 Main parameters
    • 3.13 CCM
      • 3.13.1 Function Description
      • 3.13.2 Main parameters
    • 3.14 Gamma
      • 3.14.1 Function Description
      • 3.14.2 Main parameters
      • 3.14.3 Tuning Strategies
    • 3.15 EE
      • 3.15.1 Function Description
      • 3.15.2 Main Parameters
    • 3.16 CA
      • 3.16.1 Function Description
      • 3.16.2 Main parameters
    • 3.17 DCI
      • 3.17.1 Function Description
      • 3.17.2 Main Parameters
    • 3.18 CProcess(Color Processing)
      • 3.18.1 Function Description
      • 3.18.2 Main Parameters
    • 3.19 Compand
      • 3.19.1 Function Description
      • 3.19.2 Main Parameters
    • 3.20 CAC (Chromatic Aberration Correction)
      • 3.20.1 Function Description
      • 3.20.2 Main Parameters
• K230 ISP Initial Setting
  • Disclaimer
  • Trademark Notice
  • Directory
  • Preface
    • Overview
    • Reader object
    • Revision history
  • 1. K230 ISP Initial Setting Overview
  • 2. xml file
    • 2.1 Overview
    • 2.2 Setup Calibration File Folders with Calibration Parameters
  • 2.3 Generate XML file using K230 ISP Calibration Tool
  • 2.4 AWB parameter K_Factor
  • 3. manual.json file
    • 3.1 CHdrv2
      • 3.1.1 Function Description
      • 3.1.2 Main Parameters
    • 3.2 CGreenEqu
    • 3.3 CRgbIR
      • 3.3.1 Function Description
      • 3.3.2 Main Parameters
    • 3.4 CManualWb
    • 3.5 CCcm
    • 3.6 CDgain
    • 3.7 CCpdv1
    • 3.8 Bls
      • 3.8.1 Function Description
      • 3.8.2 Main Parameters
    • 3.9 CGamma64
    • 3.10 CDpcc
    • 3.11 CDpf
    • 3.12 CLscv2
    • 3.13 CWdrv4
    • 3.14 C3dnrv3_1
    • 3.15 CCproc
    • 3.16 CEEv1
      • 3.16.1 Function Description
      • 3.16.2 Main Parameters
    • 3.17 CDmscv2
      • 3.17.1 Function Description
      • 3.17.2 Main Parameters
  • 4. auto.json file
    • 4.1 AdaptiveAe
      • 4.1.1 Function Description
      • 4.1.2 Main parameters
    • 4.2 Awbv2
      • 4.2.1 Function Description
      • 4.2.2 Main Parameters
    • 4.3 Af
      • 4.3.1 Function Description
      • 4.3.2 Main Parameters
    • 4.4 ALscv2
      • 4.4.1 Function Description
      • 4.4.2 Main Parameters
    • 4.5 Others
      • 4.5.1 Parameters description outside of “tables”
      • 4.5.2 Parameters description in “tables”
• K230 ISP Tuning Tool User Guide
  • Disclaimer
  • Trademark Notice
  • Directory
  • Preface
    • Overview
    • Reader object
    • Definition of acronyms
    • Revision history
  • 1.Module software architecture
  • 2.Connection and activation of the Tuning Tool
    • 2.1 Tool Get Path
    • 2.2 Initiation Process
  • 3.Introduction to the Tuning Tool interface
    • 3.1 Connect the board-end tuning-server
      • 3.1.1 Use HTTP to connect to the board-end tuning-server
    • 3.2 Create/Select Project
      • 3.2.1 Create Project
    • 3.3 Online Tuning interface and function description
      • 3.3.1 Bypass Settings
      • 3.3.2 Auto Focus Control (Focus Control)
      • 3.3.3 Auto Exposure Control (Exposure Control)
      • 3.3.4 Auto White Balance (White Balance)
      • 3.3.5 Exposure Statics
      • 3.3.6 Auto Focus Measurement
      • 3.3.7 High Dynamic Range
      • 3.3.8 Compand
      • 3.3.9 Black Level Subtraction
      • 3.3.10 RGB Infrared Radiation
      • 3.3.11 Lens Shading Correction
      • 3.3.12 Digital Gain
      • 3.3.13 Wide Dynamic Range
      • 3.3.14 Green Equilibrate
      • 3.3.15 Defect Pixel Cluster Correction
      • 3.3.16 Denoising Prefilter
      • 3.3.17 3D Noise Reduction
      • 3.3.18 Demosaic
      • 3.3.19 Color Correction Matrix
      • 3.3.20 Gamma Correction
      • 3.3.21 Edge Enhance
      • 3.3.22 Color Processing
    • 3.4 Capture images
      • 3.4.1 Set image format and size
      • 3.4.2 Acquiring images
    • 3.5 Import and export of parameters
      • 3.5.1 Parameter Import
      • 3.5.2 Parameter export