Text‐Driven High‐Quality 3D Human Generation via Variational Gradient Estimation and Latent Reward Models

View at publisher
Authors: Pengfei Zhou, Xukun Shen, Yong Hu
Cited by: 0
References: 6

Abstract

ABSTRACT Recent advances in Score Distillation Sampling (SDS) have enabled text‐driven 3D human generation, yet the standard classifier‐free guidance (CFG) framework struggles with semantic misalignment and texture oversaturation due to limited model capacity. We propose a novel framework that decouples conditional and unconditional guidance via a dual‐model strategy: A pretrained diffusion model ensures geometric stability, while a preference‐tuned latent reward model enhances semantic fidelity. To further refine noise estimation, we introduce a lightweight U‐shaped Swin Transformer (U‐Swin) that regularizes predicted noise against the reward model, reducing gradient bias and local artifacts. Additionally, we design a time‐varying noise weighting mechanism to dynamically balance the two guidance signals during denoising, improving stability and texture realism. Extensive experiments show that our method significantly improves alignment with textual descriptions, enhances texture details, and outperforms state‐of‐the‐art baselines in both visual quality and semantic consistency.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis 3D Shape Modeling and Analysis Face recognition and analysis

Publication details

Journal / source
Computer Animation and Virtual Worlds
Volume
37
Issue
1
Publication date
1 January 2026
Language
EN