1 Introduction 11.1 Overview 11.2 Development History 31.3 Neural Network Model 61.4 Popular Neural Network 71.4.1 Convolutional Neural Network 71.4.2 Recurrent Neural Network 81.4.3 Reinforcement Learning 91.5 Neural Network Classification 91.5.1 Supervised learning 101.5.2 Semi-supervised learning 101.5.3 Unsupervised learning 111.6 Neural Network Operation 111.6.1 Training 111.6.2 Inference 121.7 Application Development 121.7.1 Business Planning 141.7.2 Network Design 141.7.3 Data Engineering 141.7.4 System Integration 15Exercise 162 Neural Network 172.1 Convolutional Layer 192.2 Activation Layer 202.3 Pooling Layer 212.4 Batch Normalization 222.5 Dropout Layer 222.6 Fully Connected Layer 23Exercise 243 Machine Vision 253.1 Object Recognition 253.2 Feature Matching 273.3 Facial Recognition 283.4 Gesture Recognition 303.5 Machine Vision Applications 313.5.1 Medical Diagnosis 313.5.2 Retail Applications 323.5.3 Airport Security 33Exercise 344 Natural Language Processing 354.1 Neural Network Model 364.1.1 Convolutional Neural Network 364.1.2 Recurrent Neural Network 374.1.2.1 Long Short-Term Memory Network 384.1.3 Recursive Neural Network 394.1.4 Reinforcement Learning 404.2 Natural Language Processing Applications 414.2.1 Virtual Assistant 414.2.2 Language Translation 424.2.3 Machine Transcription 43Exercise 455 Autonomous Vehicle 465.1 Levels of Driving Automation 465.2 Autonomous Technology 485.2.1 Computer Vision 485.2.2 Sensor Fusion 495.2.3 Localization 515.2.4 Path Planning 525.2.5 Drive Control 525.3 Communication Strategies 535.3.1 Vehicle-to-Vehicle Communication 545.3.2 Vehicle-to-Infrastructure Communication 545.3.3 Vehicle-to-Pedestrian Communication 555.4 Law Legislation 565.4.1 Human Behavior 575.4.2 Lability 575.4.3 Regulation 585.5 Future Challenges 585.5.1 Road Rules Variation 585.5.2 Unified Communication Protocol 585.5.3 Safety Standard and Guideline 595.5.4 Weather/Disaster 59Exercise 606 Drone 616.1 Drone Design 616.2 Drone Structure 626.2.1 Camera 636.2.2 Gyro Stabilization 636.2.3 Collision Avoidance 646.2.4 Global Positioning System 646.2.5 Sensors 646.3 Drone Regulation 656.3.1 Recreational Rules 656.3.2 Commercial Rules 666.4 Applications 666.4.1 Infrastructure Inspection 666.4.2 Civil Construction 676.4.3 Agriculture 686.4.4 Emergency Rescue 69Exercise 707 Healthcare 717.1 Telemedicine 717.2 Medical Diagnosis 727.3 Medical Imaging 737.4 Smart Medical Device 747.5 Electronic Health Record 767.6 Medical Billing 777.7 Drug Development 787.8 Clinical Trial 797.9 Medical Robotics 807.10 Elderly Care 817.11 Future Challenges 82Exercise 848 Finance 858.1 Fraud Prevention 858.2 Financial Forecast 888.3 Stock Trading 898.4 Banking 918.5 Accounting 948.6 Insurance 95Exercise 969 Retail 979.1 E-Commerce 989.2 Virtual Shopping 1009.3 Product Promotion 1029.4 Store Management 1039.5 Warehouse Management 1049.6 Inventory Management 1069.7 Supply Chain 108Exercise 11010 Manufacturing 11110.1 Defect Detection 11210.2 Quality Assurance 11310.3 Production Integration 11410.4 Generative Design 11510.5 Predictive Maintenance 11710.6 Environment Sustainability 11810.7 Manufacturing Optimization 119Exercise 12111 Agriculture 12211.1 Crop and Soil Monitoring 12311.2 Agricultural Robot 12511.3 Pest Control 12611.4 Precision Farming 127Exercise 12912 Smart City 13012.1 Smart Transportation 13112.2 Smart Parking 13212.3 Waste Management 13312.4 Smart Grid 13412.5 Environmental Conservation 135Exercise 13713 Government 13813.1 Information Technology 14013.2 Human Service 14113.3 Law Enforcement 14413.3.4 Augmenting Human Movement 14713.4 Homeland Security 14713.5 Legislation 14913.6 Ethics 15213.7 Public Perspective 155Exercise 15914 Computing Platform 16014.1 Central Processing Unit 16014.1.1 System Architecture 16114.1.2 Advanced Vector Extension 16414.1.3 Math Kernel Library for Deep Neural Network 16514.2 Graphics Processing Unit 16514.2.1 Tensor Core Architecture 16714.2.2 NVLink2 Configuration 16714.2.3 High Bandwidth Memory 16914.3 Tensor Processing Unit 17014.3.1 System Architecture 17014.3.2 Brain Floating Point Format 17114.3.3 Cloud Configuration 17214.4 Neural Processing Unit 17314.4.1 System Architecture 17314.4.2 Deep Compression 17414.4.3 Dynamic Memory Allocation 17414.4.4 Edge AI Server 175Exercise 176Appendix A Kneron Neural Processing Unit 178Appendix B Object Detection (Overview) 179B.1 Kneron Environment Setup 179B.2 Python Installation 180B.3 Library Installation 184B.4 Driver Installation 185B.5 Model Installation 186B.6 Image/Camera Detection 186B.7 Yolo Class List 190Appendix C Object Detection - Hardware 192C.1 Library Setup 192C.2 System Parameters 193C.3 NPU Initialization 194C.4 Image Detection 195C.5 Camera Detection 197Appendix D Hardware Transfer Mode 199D.1 Serial Transfer Mode 199D.2 Pipeline Transfer Mode 201D.3 Parallel Transfer Mode 203Appendix E Object Detection - Software (Optional) 205E.1 Library Setup 205E.2 Image Detection 207E.3 Video Detection 208Reference 211
Albert Chun Chen Liu, Ph.D., is the CEO of Kneron and an Adjunct Associate Professor at National Tsing Hua University, National Chiao Tung University, and National Cheng Kung University, Taiwan.Oscar Ming Kin Law, Ph.D., is the director of engineering at Kneron. He has over 20 years of experience in the semiconductor industry and has published more than 70 patents in various areas.Iain Law studies Economics and Data Science at the University of California, San Diego. He has worked on several artificial intelligence projects including the LEGO smart robot and DJI Tello smart drone for STEM education.