Alibaba Qwen3 VL 8B Thinking vs Google Gemini 2.5 Pro
Detailed comparison for LLMs
AlibabaGoogle
Head-to-Head Overview
Gemini 2.5 Pro is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Alibaba Qwen3 VL 8B Thinking and Google Gemini 2.5 Pro across the three attack methods.
Overall (ASR)
Qwen3 VL 8B Thinking
100.000
Gemini 2.5 Pro
16.080
TAP Attack Method (ASR)
Qwen3 VL 8B Thinking
100.000
Gemini 2.5 Pro
27.520
Crescendo Attack Method (ASR)
Qwen3 VL 8B Thinking
100.000
Gemini 2.5 Pro
19.080
Zero-Shot (ASR)
Qwen3 VL 8B Thinking
100.000
Gemini 2.5 Pro
1.640
Key Highlights
- Google Gemini 2.5 Pro has a lower Overall (ASR).
- Google Gemini 2.5 Pro has a lower TAP Attack Method (ASR).
- Google Gemini 2.5 Pro has a lower Crescendo Attack Method (ASR).
- Google Gemini 2.5 Pro has a lower Zero-Shot (ASR).
Metric Radar Chart
qwen3-vl-8b-thinking
gemini-2-5-pro