Anthropic Claude 4.0 Sonnet vs Mistral Mistral Large 3 675B Base
Detailed comparison for LLMs
AnthropicMistral
Head-to-Head Overview
Claude 4.0 Sonnet is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Anthropic Claude 4.0 Sonnet and Mistral Mistral Large 3 675B Base across the three attack methods.
Overall (ASR)
Claude 4.0 Sonnet
13.630
Mistral Large 3 675B Base
100.000
TAP Attack Method (ASR)
Claude 4.0 Sonnet
22.020
Mistral Large 3 675B Base
100.000
Crescendo Attack Method (ASR)
Claude 4.0 Sonnet
14.790
Mistral Large 3 675B Base
100.000
Zero-Shot (ASR)
Claude 4.0 Sonnet
4.080
Mistral Large 3 675B Base
100.000
Key Highlights
- Anthropic Claude 4.0 Sonnet has a lower Overall (ASR).
- Anthropic Claude 4.0 Sonnet has a lower TAP Attack Method (ASR).
- Anthropic Claude 4.0 Sonnet has a lower Crescendo Attack Method (ASR).
- Anthropic Claude 4.0 Sonnet has a lower Zero-Shot (ASR).
Metric Radar Chart
claude-4-0-sonnet
mistral-large-3-675b-base