Alibaba Qwen 2.5 72B vs DeepSeek DeepSeek R1 Distill Llama 8B
Detailed comparison for LLMs
AlibabaDeepSeek
Head-to-Head Overview
Qwen 2.5 72B is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Alibaba Qwen 2.5 72B and DeepSeek DeepSeek R1 Distill Llama 8B across the three attack methods.
Overall (ASR)
Qwen 2.5 72B
26.350
DeepSeek R1 Distill Llama 8B
100.000
TAP Attack Method (ASR)
Qwen 2.5 72B
55.160
DeepSeek R1 Distill Llama 8B
100.000
Crescendo Attack Method (ASR)
Qwen 2.5 72B
23.660
DeepSeek R1 Distill Llama 8B
100.000
Zero-Shot (ASR)
Qwen 2.5 72B
0.250
DeepSeek R1 Distill Llama 8B
100.000
Key Highlights
- Alibaba Qwen 2.5 72B has a lower Overall (ASR).
- Alibaba Qwen 2.5 72B has a lower TAP Attack Method (ASR).
- Alibaba Qwen 2.5 72B has a lower Crescendo Attack Method (ASR).
- Alibaba Qwen 2.5 72B has a lower Zero-Shot (ASR).
Metric Radar Chart
qwen-2-5-72b
deepseek-r1-distill-llama-8b