Optical signal processing and VLSI system design for 5G radio for advanced waveforms

Abstract This work presents an integrated framework combining optical signal processing and VLSI system design for the performance evaluation and optimization of 5G waveform candidates under different modulation schemes. The analysis focuses on four major waveforms – OFDM, FBMC, NOMA, and OTFS – and examines their performance based on bit error rate (BER), peak-to-average power ratio (PAPR), and power spectral density (PSD) metrics. Simulation results demonstrate that OTFS outperforms the other waveforms, achieving a BER of 10 −3 at an SNR range of 7–10 dB, corresponding to an SNR gain of up to 8 dB over OFDM. Furthermore, OTFS exhibits a PAPR reduction of approximately 3.5 dB and the lowest out-of-band emissions with a PSD of around −310 dBW/MHz, indicating superior spectral efficiency and reduced interference. These characteristics make OTFS a promising waveform for high-mobility, high-capacity 5G and future 6G communication environments. The integration of optical signal processing techniques enhances system bandwidth and energy efficiency, while VLSI-based architectures support low-latency, high-throughput implementation. Future advancements will explore optical-VLSI codesign and machine learning–assisted frameworks for real-time adaptive processing, improving scalability, power optimization, and intelligent signal handling in next-generation wireless and optical communication systems.