Anthropic Claude 3.7 Sonnet vs Deepseek Deepseek R1
Detailed comparison for LLMs
AnthropicDeepseek
Head-to-Head Overview
Claude 3.7 Sonnet is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Anthropic Claude 3.7 Sonnet and Deepseek Deepseek R1 across the three attack methods.
Overall (ASR)
Claude 3.7 Sonnet
20.280
Deepseek R1
42.580
TAP Attack Method (ASR)
Claude 3.7 Sonnet
31.430
Deepseek R1
76.890
Crescendo Attack Method (ASR)
Claude 3.7 Sonnet
25.270
Deepseek R1
34.790
Zero-Shot (ASR)
Claude 3.7 Sonnet
0
Deepseek R1
16.080
Key Highlights
- Anthropic Claude 3.7 Sonnet has a lower Overall (ASR).
- Anthropic Claude 3.7 Sonnet has a lower TAP Attack Method (ASR).
- Anthropic Claude 3.7 Sonnet has a lower Crescendo Attack Method (ASR).
Metric Radar Chart
claude-3-7-sonnet
deepseek-r1