Google Gemini 2.0 Flash vs Mistral Mistral Large 3 675B Instruct 2512 NVFP4
Detailed comparison for LLMs
GoogleMistral
Head-to-Head Overview
Gemini 2.0 Flash is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Google Gemini 2.0 Flash and Mistral Mistral Large 3 675B Instruct 2512 NVFP4 across the three attack methods.
Overall (ASR)
Gemini 2.0 Flash
33.600
Mistral Large 3 675B Instruct 2512 NVFP4
100.000
TAP Attack Method (ASR)
Gemini 2.0 Flash
67.640
Mistral Large 3 675B Instruct 2512 NVFP4
100.000
Crescendo Attack Method (ASR)
Gemini 2.0 Flash
30.390
Mistral Large 3 675B Instruct 2512 NVFP4
100.000
Zero-Shot (ASR)
Gemini 2.0 Flash
2.770
Mistral Large 3 675B Instruct 2512 NVFP4
100.000
Key Highlights
Google Gemini 2.0 Flash has a lower Overall (ASR).
Google Gemini 2.0 Flash has a lower TAP Attack Method (ASR).
Google Gemini 2.0 Flash has a lower Crescendo Attack Method (ASR).
Google Gemini 2.0 Flash has a lower Zero-Shot (ASR).