Anonymous Artifact for Conference Submission
Summary
No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.
Summarise with VIRAT Free to try with your Science Catalogs account.Abstract
VisionOpsBench **A comprehensive benchmark for evaluating vision-language models on cloud operations tasks.** VisionOpsBench is a research artifact containing tools and components for: - **Exploring** cloud console interfaces automatically - **Collecting** operational trajectories with visual grounding - **Extracting** standard operating procedures (SOPs) from documentation - **Generating** understanding and grounding tasks for GUI agents - **Evaluating** multimodal models on cloud operations The VisionOpsBench dataset is available at: https://drive.google.com/drive/folders/158Mzb67Oxt52x2w2OVGVNCv7dRYuxXMu?usp=sharing
Fields of Study & Subjects
Multimodal Machine Learning Applications
Software Engineering Research
Robot Manipulation and Learning
Publication details
- Journal / source
- Zenodo (CERN European Organization for Nuclear Research)
- Publication date
- 27 March 2026
- Language
- EN