지능형 로봇을 위한 생체모사형 카메라 연구 최신 지견
Recent Trends in Bioinspired Camera Systems for Intelligent Robotics
1
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
지능형 로봇 시대가 도래함에 따라 이미지 센서 또는 카메라 모듈에도 각 수요처에 따른 제품군의 다양화 필요성이 대두되고 있다. 이와 동시에 초소형/저전력 구동부터 하드웨어 레벨 물체 인식까지, 기존 카메라에서 구현하기 어려운 성능에 대한 수요도 늘고 있다. 한편 인간의 눈을 비롯한 자연계 동물의 눈 구조 및 기능의 우수함과 다양성은 미래 비전 시스템 개발에 큰 영감을 준다. 특히 동물의 서식지 및 생활 환경에 적응하기 위해 생태학적으로 진화한 눈에는 기존의 카메라에서 볼 수 없던 기능이 다수 존재하기 때문에, 최근 이를 모방하기 위한 연구가 활발히 이루어지고 있다. 이러한 생체모사형 카메라의 분야는 크게 렌즈 광학계, 이미지 센서, 나노포토닉 구조, 뉴런/시냅스 모사로 나눌 수 있으며, 최근에는 이를 모두 통합하여 하나의 완성된 비전 시스템을 만들기 위한 시도가 이루어지고 있다. 본 리뷰에서는 세부기술별로 나누어 연구 동향을 살피기보다는, 기술의 발전 방향에 따른 생체모사형 카메라 연구의 흐름을 추적하고자 한다.
Abstract
With the advent of the intelligent robotics era, there is an increasing demand for a variety of image sensors and camera modules to meet the needs of various applications. At the same time, demand is growing for performance such as ultra-compact size, low-power operation, and hardware-levelobject recognition that is difficult to achieve with existing cameras. The superior structures and functionalities of natural eyes, including those of humans and other animals, provide significant inspiration for the development of next-generation artificial vision systems. In particular, the unique characteristics of animal eyes, which have evolved ecologically to adapt to specific habitats and environments, exhibit functionalities beyond those found in conventional cameras. Consequently, research aiming to mimic these natural optical systems has become very active. Bioinspired camerascan generally be categorized into lens optics, image sensors, nanophotonic structures, and neuron/synapse mimics. Recently, there have been attemptsto integrate all these components into a complete vision system. This review aims to trace trends in bioinspired cameras, focusing not on the technicalaspects of individual components but on overall directions in technological advancement.
참고문헌 (34)
- L. P. Lee, "Inspirations from biological optics for advanced photonic systems", Science, 310, pp.1148~1150 (2005)
- I. Jung, "Dynamically tunable hemispherical electronic eye camera system with adjustable zoom capability", Proc. Natl. Acad. Sci, 108, pp.1788~1793 (2011)
- T. Wu, "Design and fabrication of silicon tessellated structures for monocentric imagers", Microsyst. Nanoeng, 2, pp.16019~ (2016)
- H. C. Ko, "A hemispherical electronic eye camera based on compressible silicon optoelectronics", Nature, 454, pp.748~753 (2008)
- L. Gu, "A biomimetic eye with a hemispherical perovskite nanowire array retina", Nature, 581, pp.278~282 (2020)
- C. Choi, "Human eye-inspired soft optoelectronic device using high-density MoS2-graphene curved image sensor array", Nat. Commun, 8, pp.1664~ (2017)
- Z. Rao, "Curvy, shape-adaptive imagers based on printed optoelectronic pixels with a kirigami design", Nat. Electron, 4, pp.513~521 (2021)
- B. Guenter, "Highly curved image sensors : A practical approach for improved optical performance", Opt. Express, 25, pp.13010~13023 (2017)
- X. Chen, "Small form factor high-resolution camera, U.S. Patent US20140253677A", ~ (2014)
- K. Sugie, "Imaging device, Japan Patent JP2018074217A", ~ (2018)
- M. Aschwanden, "Optical device with variable focus, World Intellectual Property Organization (WIPO) WO2017118656A1", ~ (2017)
- M. Kim, "An aquatic-vision-inspired camera based on a monocentric lens and a silicon nanorod photodiode array", Nat. Electron, 3, pp.546~553 (2020)
- M. Kim, "Cuttlefish eye–inspired artificial vision for high-quality imaging under uneven illumination conditions", Sci. Robot, 8, pp.eade4698~ (2023)
- J. Park, "Avian eye–inspired perovskite artificial vision system for foveated and multispectral imaging", Sci. Robot, 9, pp.eadk6903~ (2024)
- M. S. Kim, "Feline eye–inspired artificial vision for enhanced camouflage breaking under diverse light conditions", Sci. Adv, 10, pp.eadp2809~ (2024)
- Y. Ding, "Uncooled self-powered hemispherical biomimetic pit organ for mid- to long-infrared imaging", Sci. Adv, 8, pp.eabq8432~ (2022)
- J. Tanida, "Thin observation module by bound optics(TOMBO) : Concept and experimental verification", Appl. Opt, 40, pp.1806~1813 (2001)
- J. Tanida, "Color imaging with an integrated compound imaging system", Opt. Express, 11, pp.2109~2117 (2003)
- R. Horisaki, "Irregular lens arrangement design to improve imaging performance of compound-eye imaging systems", Appl. Phys. Express, 3, pp.022501~ (2010)
- A. Akin, "Hemispherical multiple camera system for highresolution omni-directional light field imaging", IEEE J. Emerg. Sel. Top. Circuits Syst, 3, pp.137~144 (2013)
- Y. M. Song, "Digital cameras with designs inspired by the arthropod eye", Nature, 497, pp.95~99 (2013)
- D. Floreano, "Miniature curved artificial compound eyes", Proc. Natl. Acad. Sci, 110, pp.9267~9272 (2013)
- M. Lee, "An amphibious artificial vision system with a panoramic visual field", Nat. Electron, 5, pp.452~459 (2022)
- A. Altaqui, "Mantis shrimp–inspired organic photodetector for simultaneous hyperspectral and polarimetric imaging", Sci. Adv, 7, pp.eabe3196~ (2021)
- Q. Fan, "Trilobiteinspired neural nanophotonic light-field camera with extreme depth-of-field", Nat. Commun, 13, pp.2130~ (2022)
- Y. Zhou, "An ultrawide field-of-view pinhole compound eye using hemispherical nanowire array for robot vision", Sci. Robot, 9, pp.eadi8666~ (2024)
- B. J. Bae, "Stereoscopic artificial compound eyes for spatiotemporal perception in three-dimensional space", Sci. Robot, 9, pp.eadl3606~ (2024)
- H. J. Jang, "Double-sided anti-reflection nanostructures on optical convex lenses for imaging applications", Coatings, 9, pp.404~ (2019)
- B. A. Palmer, "The image-forming mirror in the eye of the scallop", Science, 358, pp.1172~1175 (2017)
- J. S. T. Smalley, "Subwavelength pixelated CMOS color sensors based on anti-Hermitian metasurface", Nat. Commun, 11, pp.3916~ (2020)
- M. Cho, "Color arrestor pixels for high-fidelity, high-sensitivity imaging sensors", Nanophotonics, 13, pp.2971~2982 (2024)
- P. Xie, "Birdlike broadband neuromorphic visual sensor arrays for fusion imaging", Nat. Commun, 15, pp.8298~ (2024)
- D. Lee, "In-sensor image memorization and encoding via optical neurons for biostimulus domain reduction toward visual cognitive processing", Nat. Commun, 13, pp.5223~ (2022)
- F. Liao, "Bioinspired in-sensor visual adaptation for accurate perception", Nat. Electron, 5, pp.84~91 (2022)