Beyond accuracy: A Kernel-level Comparative Analysis of Quantum and Classical Support Vector Machines

Abstract Quantum kernel approaches have been touted as a possible way to gain representational advantages over classical machine learning techniques however most comparative work only looks at classification accuracy leaving the geometric structure of the kernels unexplored. We carry out a comprehensive kernel-level comparison between classical support vector machines (SVMs) with radial basis function (RBF) kernels and quantum support vector classifiers that use ZZFeatureMap and PauliFeatureMap fidelity kernels, tested on two synthetic and two real-world two-dimensional datasets. After applying centred kernel alignment(CKA), the Hilbert-Schmidt Independence Criterion (HSIC), eigenvalue spectrum analysis, spectral entropy, and effective rank. Firstly, shallow quantum kernels form a moderately aligned band with RBF across all datasets and conditions that is quite stable (CKA : 0.41 → 0.57), whereas going deeper in the circuit to two repetitions largely mismatches both alignment and accuracy with no representational gain (e.g. Iris cross-validation accuracy: 0.920 → 0.670, p = 0.0004). Secondly, depolarising noise surprisingly increases the quantum-classical kernel alignment, which means that near-term hardware kernels are structurally closer to RBF than noiseless simulations suggest. Thirdly, the scenarios that lead to maximum apparent quantum-classical divergence, small sample sizes and low noise, are precisely those most used to benchmark quantum kernel advantage. Kernel-level structural analysis is essential for meaningful evaluation of quantum machine learning methods.