Evaluating Distributed Communication Architectures for GPU-Accelerated Image Encoding

Artificial intelligence (AI) has transformed how we engage with visual data, particularly within the context of enterprises. Multi-modal codification systems enable the creation of semantic connections between text and visual data using AI models. This opens new markets for businesses by enabling visual search engines, recommendation systems, and automatic tagging of visual data. However, implementing these systems presents significant technical challenges. The typical workflow involves encoding images using an AI model, converting these representations into semantic vectors, and inserting them into databases optimized for fast searches. This not only affects technical efficiency but also impacts the ability of companies to scale these systems to a commercial level. This paper presents a comprehensive comparative analysis of communication architectures for large-scale image encoding systems, evaluating gRPC, RabbitMQ, serverless Lambda, and SageMaker approaches across performance and resource efficiency dimensions. Through controlled experiments processing up to 18,000 images using the SigLIP model, we establish clear performance–architecture relationships that inform system design decisions for visual content-based search applications.