Anthropic Claude 3.5 Sonnet v2 vs DeepSeek DeepSeek-R1-0528
Detailed comparison for LLMs
AnthropicDeepSeek
Head-to-Head Overview
DeepSeek-R1-0528 is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Anthropic Claude 3.5 Sonnet v2 and DeepSeek DeepSeek-R1-0528 across the three attack methods.
Overall (ASR)
Claude 3.5 Sonnet v2
4.390
DeepSeek-R1-0528
0
TAP Attack Method (ASR)
Claude 3.5 Sonnet v2
8.830
DeepSeek-R1-0528
0
Crescendo Attack Method (ASR)
Claude 3.5 Sonnet v2
3.810
DeepSeek-R1-0528
0
Zero-Shot (ASR)
Claude 3.5 Sonnet v2
0.540
DeepSeek-R1-0528
0
Key Highlights
- DeepSeek DeepSeek-R1-0528 has a lower Overall (ASR).
- DeepSeek DeepSeek-R1-0528 has a lower TAP Attack Method (ASR).
- DeepSeek DeepSeek-R1-0528 has a lower Crescendo Attack Method (ASR).
- DeepSeek DeepSeek-R1-0528 has a lower Zero-Shot (ASR).
Metric Radar Chart
claude-3-5-sonnet-v2
deepseek-r1-0528