Introduction to Generative AI

Generative Artificial Intelligence (Generative AI) is a paradigm shift in computational intelligence - switching the role of machines in computational intelligence to creative synthesis. The Generative systems based on the underlying probability distributions of data can generate realistic and context-ually consistent output across modalities, including text, image, audio, and structured data, by learning the underlying probability distributions of the data. This chapter has given an in-depth introduction to the theoretical, architectural, and operational backgrounds of generative AI, and then proceeded to discuss how generative AI has been adapted to resource-constrained and distributed systems. It has talked about probabilistic modelling and latent space representation and the development of generative models and then it has touched on the computational issues like the complexity of training, quantization, and memory limitations.