"Hate speech dataset with style perturbation"

Read full text
Authors: ruiling li
Cited by: 0

Abstract

"We present a style-perturbed benchmark for robustness evaluation in hate speech detection. The benchmark is constructed from three widely used datasets, namely IHC, SBIC, and DynaHate, and introduces multiple stylistic perturbation settings while preserving the original label semantics as much as possible. For each dataset, we retain the undisturbed version together with several perturbed variants, enabling controlled comparison between clean and style-shifted inputs. The resulting resource is designed to test whether a model relies on task-relevant semantic content or exhibits residual dependence on superficial stylistic cues. In addition to the perturbed texts and class labels, the benchmark preserves sample-level metadata to support reproducible evaluation and fine-grained analysis across perturbation types and annotation rounds. This benchmark provides a practical testbed for studying robustness, prediction consistency, and label stability under semantically preserving stylistic variation, and is particularly suitable for evaluating large language model based classifiers and causal content-style disentanglement methods."

Fields of Study & Subjects

Hate Speech and Cyberbullying Detection Adversarial Robustness in Machine Learning Authorship Attribution and Profiling

Publication details

Journal / source
IEEE DataPort
Publication date
16 March 2026
Language
EN
Document type
Dataset