Ultra-wide spectrum photosynapse array with 64k-scale for neuromorphic fusion imaging

Bio-inspired photosynapse hardware with wide spectrum information fusion imaging and neuromorphic processing is promising for complex environments perception. However, integrating ultra-wide spectrum responsivity within a single photosynapse device and scaling to a large array has remained challenging. Here, we demonstrate a 64k-scale (65,536 pixels) ultraviolet-to-mid-infrared photosynapse array based on carbon nanotube/molybdenum oxide heterojunctions. Typical photosynapse behaviors are confirmed in the wide spectrum region of 365 nm (ultraviolet), 532 nm (visible), 1064 nm (near infrared), and 10.6 μm (mid-infrared). A polydopamine-mediated surface treatment enables homogeneous deposition of carbon nanotube/molybdenum oxide films across heterogeneous transistor substrates with 99.96% yield. The photosynapse array enhances image frame similarity from 0.897 to 0.965 in dynamic trajectory prediction. Furthermore, the wide spectrum neuromorphic fusion imaging using photosynapse array achieves 99.58% accuracy in trajectory recognition under challenging conditions, surpassing the 63.93% with visible light alone. This work contributes to paving the way for next-generation autonomous perception. Next-generation autonomous systems call for robust perception capabilities in diverse environments. Dun et al. report an ultraviolet-to-mid-infrared photosynapse array with 65,536 pixels and efficient in situ processing capabilities for dynamic trajectory recognition under challenging conditions.