Meta Llama 4 Maverick vs Mistral Mistral Large 3 675B Instruct 2512 Eagle
Detailed comparison for LLMs
MetaMistral
Head-to-Head Overview
Llama 4 Maverick is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Meta Llama 4 Maverick and Mistral Mistral Large 3 675B Instruct 2512 Eagle across the three attack methods.
Overall (ASR)
Llama 4 Maverick
27.650
Mistral Large 3 675B Instruct 2512 Eagle
100.000
TAP Attack Method (ASR)
Llama 4 Maverick
65.310
Mistral Large 3 675B Instruct 2512 Eagle
100.000
Crescendo Attack Method (ASR)
Llama 4 Maverick
14.600
Mistral Large 3 675B Instruct 2512 Eagle
100.000
Zero-Shot (ASR)
Llama 4 Maverick
3.040
Mistral Large 3 675B Instruct 2512 Eagle
100.000
Key Highlights
Meta Llama 4 Maverick has a lower Overall (ASR).
Meta Llama 4 Maverick has a lower TAP Attack Method (ASR).
Meta Llama 4 Maverick has a lower Crescendo Attack Method (ASR).
Meta Llama 4 Maverick has a lower Zero-Shot (ASR).