Anthropic Claude 3.7 Sonnet vs Mistral Ministral 3 3B Instruct 2512
Detailed comparison for LLMs
AnthropicMistral
Head-to-Head Overview
Claude 3.7 Sonnet is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Anthropic Claude 3.7 Sonnet and Mistral Ministral 3 3B Instruct 2512 across the three attack methods.
Overall (ASR)
Claude 3.7 Sonnet
20.280
Ministral 3 3B Instruct 2512
100.000
TAP Attack Method (ASR)
Claude 3.7 Sonnet
31.430
Ministral 3 3B Instruct 2512
100.000
Crescendo Attack Method (ASR)
Claude 3.7 Sonnet
25.270
Ministral 3 3B Instruct 2512
100.000
Zero-Shot (ASR)
Claude 3.7 Sonnet
0
Ministral 3 3B Instruct 2512
100.000
Key Highlights
Anthropic Claude 3.7 Sonnet has a lower Overall (ASR).
Anthropic Claude 3.7 Sonnet has a lower TAP Attack Method (ASR).
Anthropic Claude 3.7 Sonnet has a lower Crescendo Attack Method (ASR).