Anthropic Claude 3.7 Sonnet vs Mistral Mistral Large 3 675B Base
Detailed comparison for LLMs
AnthropicMistral
Head-to-Head Overview
Mistral Large 3 675B Base is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Anthropic Claude 3.7 Sonnet and Mistral Mistral Large 3 675B Base across the three attack methods.
Overall (ASR)
Claude 3.7 Sonnet
20.280
Mistral Large 3 675B Base
0
TAP Attack Method (ASR)
Claude 3.7 Sonnet
31.430
Mistral Large 3 675B Base
0
Crescendo Attack Method (ASR)
Claude 3.7 Sonnet
25.270
Mistral Large 3 675B Base
0
Zero-Shot (ASR)
Claude 3.7 Sonnet
0
Mistral Large 3 675B Base
0
Key Highlights
- Mistral Mistral Large 3 675B Base has a lower Overall (ASR).
- Mistral Mistral Large 3 675B Base has a lower TAP Attack Method (ASR).
- Mistral Mistral Large 3 675B Base has a lower Crescendo Attack Method (ASR).
Metric Radar Chart
claude-3-7-sonnet
mistral-large-3-675b-base