Meta Llama 3.1 405B Instruct vs Mistral Mistral 8x22B
Detailed comparison for LLMs
MetaMistral
Head-to-Head Overview
Mistral 8x22B is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Meta Llama 3.1 405B Instruct and Mistral Mistral 8x22B across the three attack methods.
Overall (ASR)
Llama 3.1 405B Instruct
100.000
Mistral 8x22B
31.460
TAP Attack Method (ASR)
Llama 3.1 405B Instruct
100.000
Mistral 8x22B
0
Crescendo Attack Method (ASR)
Llama 3.1 405B Instruct
100.000
Mistral 8x22B
0
Zero-Shot (ASR)
Llama 3.1 405B Instruct
100.000
Mistral 8x22B
12.180
Key Highlights
- Mistral Mistral 8x22B has a lower Overall (ASR).
- Mistral Mistral 8x22B has a lower Zero-Shot (ASR).
Metric Radar Chart
llama-3-1-405b-instruct
mistral-8x22b