Anthropic Claude 3.5 Sonnet v1 vs Mistral Mistral NeMo Instruct
Detailed comparison for LLMs
AnthropicMistral
Head-to-Head Overview
Mistral NeMo Instruct is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Anthropic Claude 3.5 Sonnet v1 and Mistral Mistral NeMo Instruct across the three attack methods.
Overall (ASR)
Claude 3.5 Sonnet v1
16.010
Mistral NeMo Instruct
0
TAP Attack Method (ASR)
Claude 3.5 Sonnet v1
28.390
Mistral NeMo Instruct
0
Crescendo Attack Method (ASR)
Claude 3.5 Sonnet v1
19.310
Mistral NeMo Instruct
0
Zero-Shot (ASR)
Claude 3.5 Sonnet v1
0.350
Mistral NeMo Instruct
0
Key Highlights
- Mistral Mistral NeMo Instruct has a lower Overall (ASR).
- Mistral Mistral NeMo Instruct has a lower TAP Attack Method (ASR).
- Mistral Mistral NeMo Instruct has a lower Crescendo Attack Method (ASR).
- Mistral Mistral NeMo Instruct has a lower Zero-Shot (ASR).
Metric Radar Chart
claude-3-5-sonnet-v1
mistral-nemo-instruct