Mistral Mistral Large 3 675B Instruct 2512 NVFP4 vs OpenAI GPT-4o Mini
Detailed comparison for LLMs
MistralOpenAI
Head-to-Head Overview
GPT-4o Mini is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Mistral Mistral Large 3 675B Instruct 2512 NVFP4 and OpenAI GPT-4o Mini across the three attack methods.
Overall (ASR)
Mistral Large 3 675B Instruct 2512 NVFP4
100.000
GPT-4o Mini
26.670
TAP Attack Method (ASR)
Mistral Large 3 675B Instruct 2512 NVFP4
100.000
GPT-4o Mini
40.500
Crescendo Attack Method (ASR)
Mistral Large 3 675B Instruct 2512 NVFP4
100.000
GPT-4o Mini
33.100
Zero-Shot (ASR)
Mistral Large 3 675B Instruct 2512 NVFP4
100.000
GPT-4o Mini
6.410
Key Highlights
- OpenAI GPT-4o Mini has a lower Overall (ASR).
- OpenAI GPT-4o Mini has a lower TAP Attack Method (ASR).
- OpenAI GPT-4o Mini has a lower Crescendo Attack Method (ASR).
- OpenAI GPT-4o Mini has a lower Zero-Shot (ASR).
Metric Radar Chart
mistral-large-3-675b-instruct-2512-nvfp4
gpt-4o-mini