摘要
基于光热冲击效应的激光捕获技术是用于干燥固体界面上微纳物体的捕获及操控的重要工具。为进一步满足复杂场景中的条件需求,提出了一种基于深度学习图像反馈的闭环控制系统,引入了目标检测与定位算法,实现了微纳物体的稳定、高精度捕获和智能运动控制。该系统能够将输入的控制参数处理为光热冲镊平台的控制信号,并在控制过程中使用YOLOv8和OpenCV算法处理系统采集的显微图像,对物体位置进行动态反馈,实现系统智能化闭环控制。实验表明,所设计的控制模块的控制分辨率为38.2 nm,图像反馈模块的检测分辨率为85.3 nm,整体系统对物体的检测误差为116.1 nm,闭环控制误差为108.9 nm。此外,采用路径控制与手势触摸等多种控制方法,验证了该控制系统的灵活性和稳定性。研究结果为在干固体界面上的复杂场景中微纳物体的智能化操控提供了参考。
Objective In the microscopic world,laser trapping is an effective method for the precise manipulation of micro-/nano-objects.Conventional optical tweezers are based on the principle of photon momentum exchange,which generates optical forces on the order of piconewtons(~10^(-12)N).However,overcoming the motion resistance of micro-/nano-objects at solid interfaces is challenging as it typically requires forces on the order of micronewtons(~10^(-6)N).Owing to their limitations,conventional optical tweezers are typically used in fluid environments,such as vacuum/air and liquids.Trapping and manipulating objects on solid interfaces can be challenging.Scholars have attempted to actuate micro-/nano-objects using pulsed lasers based on the principle of surface elastic waves to manipulate objects in direct adsorption contact with dry solid surfaces(solid-gas interfaces).However,this technique has yet to result in the stable trapping of objects.For techniques that do not offer trapping,a random misalignment between an object’s center of mass and the spot center introduces uncertainty in the direction of motion.This uncertainty hinders the precise,continuous,and arbitrary control of the object’s motion.Photothermal-Shock tweezers enable the laser trapping and manipulation of metallic nanomaterials on dry solid interfaces via the photothermal shock effect.Hence,their application is wide ranging.Additionally,the utilization and maintenance of laser-trapping methods typically necessitate the use of intricate equipment and specialized debugging techniques,which imposes numerous limitations on the operating environment and the personnel operating the equipment.This goal of this study is to design a micro-/nano-object control system based on deep learning.The system will enable the high-precision laser trapping and intelligent motion control of objects at dry solid interfaces via a photothermal-shock tweezer platform.Methods This paper presents a micro-/nano-object control system comprising three components:a photothermal-shock tweezer platform,an integrated control module,and an image-feedback module.The composition of the control module and the method of operating the photothermal-shock tweezer platform,including the hardware-structure construction and the corresponding control program design,are analyzed.The resolution and control range of the control module are analyzed via calculation and testing.The image-feedback module of the system is designed to detect the position of micro-/nano-objects in microscopic images and to provide dynamic feedback.The image-feedback module uses the YOLOv8 model for object detection and the OpenCV algorithm for center-of-mass localization.The models mentioned above are trained using a customized dataset created from microscopic images.Subsequently,they are tested on various sample images,and the detection resolution and error are analyzed.Finally,an experimental setup is constructed,as shown in Fig.1,and motion-control experiments are conducted on multiple samples to evaluate the overall system performance.Results and Discussions The trained YOLOv8 model and OpenCV algorithm are used by the image-feedback module to locate the center of mass in various types of microscopically acquired images(Fig.5).The average detection error of the module is 116.1 nm.Motion-control experiments are conducted using the overall system.In the experiments,Pd nanosheets measuring approximately 10μm are used,and a transparent silicon-dioxide sheet is used as the substrate.The system controls the laser to trap the nanosheet sample and actuate it along a predetermined path(Fig.7).The average control error of the spot is 71.8 nm,whereas that of the sample is 108.9 nm.The data shown in Table 1 indicate that the control system successfully realizes the nanoscale closed-loop control of micro-/nano-objects on dry solid interfaces with a high degree of control freedom and a small control error.Additionally,the sample is tested at varying speeds(Fig.8),and the system’s control errors at different speeds are obtained experimentally(Table.2).As the sample’s movement speed increases,the control accuracy of the system decreases.If the sample propagates extremely rapidly owing to the system setting,then it will not satisfy the response time required for the laser spot to re-trap the sample.Consequently,the sample will be outside the trapping range of the laser spot,thus causing the system to lose control of the sample.Within certain limits,the rate at which the sample is re-trapped can be increased by increasing the pulse frequency of the laser(Fig.9).Thus,the micro-/nano-objects can be guaranteed to remain in the trap at higher laser-spot motion speeds.In addition,the use of higher-quality laser spots,flat-surface substrates,and smaller nanosheets allows objects to be trapped more rapidly and stably.For the control system designed in this study,the samples can be stabilized via numerous experimental trials when the system is specified to propagate at a speed of 5μm/s or less.Conclusions A control system for micro-/nano-objects is proposed in this study.Combining this system with image feedback based on deep learning,high-precision laser trapping and the intelligent control of micro-/nano-objects on dry solid interfaces are realized by integrating the control of a photothermal-shock tweezer experimental platform.The system can realize the laser trapping and path control of objects based on the parameter input as well as identify and locate objects in microscopic images via the YOLOv 8 and OpenCV algorithms.This method provides dynamic feedback regarding the trapping state of the system,thus enabling the intelligent control of objects.Additionally,the modularized design of the system and the gesture-control method endow the system with a certain level of compatibility and flexibility that facilitates the expansion of functions in different application scenarios as well as the operation and use of personnel in different fields.
作者
张尹峥
刘鸿江
朱润琳
刘逸飞
谷付星
Zhang Yinzheng;Liu Hongjiang;Zhu Runlin;Liu Yifei;Gu Fuxing(School of Optical-Electrical and Computer Engineering,University of Shanghai for Science and Technology,Shanghai 200093,China)
出处
《中国激光》
EI
CAS
CSCD
北大核心
2024年第15期211-221,共11页
Chinese Journal of Lasers
基金
国家自然科学基金项目(62122054)
上海市自然科学基金(21ZR1481100)
上海市教委“曙光计划”(22SG44)。
关键词
激光捕获
光操控
深度学习
光热冲镊
智能控制
laser trapping
optical manipulation
deep learning
photothermal-shock tweezers
intelligent control