Anthropic Claude 3.5 Sonnet v2 vs Mistral Ministral 3 3B Instruct 2512
Detailed comparison for LLMs
AnthropicMistral
Head-to-Head Overview
Claude 3.5 Sonnet v2 is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Anthropic Claude 3.5 Sonnet v2 and Mistral Ministral 3 3B Instruct 2512 across the three attack methods.
Overall (ASR)
Claude 3.5 Sonnet v2
4.390
Ministral 3 3B Instruct 2512
100.000
TAP Attack Method (ASR)
Claude 3.5 Sonnet v2
8.830
Ministral 3 3B Instruct 2512
100.000
Crescendo Attack Method (ASR)
Claude 3.5 Sonnet v2
3.810
Ministral 3 3B Instruct 2512
100.000
Zero-Shot (ASR)
Claude 3.5 Sonnet v2
0.540
Ministral 3 3B Instruct 2512
100.000
Key Highlights
Anthropic Claude 3.5 Sonnet v2 has a lower Overall (ASR).
Anthropic Claude 3.5 Sonnet v2 has a lower TAP Attack Method (ASR).
Anthropic Claude 3.5 Sonnet v2 has a lower Crescendo Attack Method (ASR).
Anthropic Claude 3.5 Sonnet v2 has a lower Zero-Shot (ASR).