Anthropic Claude 3.7 Sonnet vs Mistral Mistral 8x22B
Detailed comparison for LLMs
AnthropicMistral
Head-to-Head Overview
Claude 3.7 Sonnet is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Anthropic Claude 3.7 Sonnet and Mistral Mistral 8x22B across the three attack methods.
Overall (ASR)
Claude 3.7 Sonnet
20.280
Mistral 8x22B
31.460
TAP Attack Method (ASR)
Claude 3.7 Sonnet
31.430
Mistral 8x22B
0
Crescendo Attack Method (ASR)
Claude 3.7 Sonnet
25.270
Mistral 8x22B
0
Zero-Shot (ASR)
Claude 3.7 Sonnet
0
Mistral 8x22B
12.180
Key Highlights
- Anthropic Claude 3.7 Sonnet has a lower Overall (ASR).
Metric Radar Chart
claude-3-7-sonnet
mistral-8x22b