Google Gemini 2.5 Pro vs Google Gemma 3n E4B Instructed
Detailed comparison for LLMs
GoogleGoogle
Head-to-Head Overview
Gemma 3n E4B Instructed is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Google Gemini 2.5 Pro and Google Gemma 3n E4B Instructed across the three attack methods.
Overall (ASR)
Gemini 2.5 Pro
16.080
Gemma 3n E4B Instructed
0
TAP Attack Method (ASR)
Gemini 2.5 Pro
27.520
Gemma 3n E4B Instructed
0
Crescendo Attack Method (ASR)
Gemini 2.5 Pro
19.080
Gemma 3n E4B Instructed
0
Zero-Shot (ASR)
Gemini 2.5 Pro
1.640
Gemma 3n E4B Instructed
0
Key Highlights
- Google Gemma 3n E4B Instructed has a lower Overall (ASR).
- Google Gemma 3n E4B Instructed has a lower TAP Attack Method (ASR).
- Google Gemma 3n E4B Instructed has a lower Crescendo Attack Method (ASR).
- Google Gemma 3n E4B Instructed has a lower Zero-Shot (ASR).
Metric Radar Chart
gemini-2-5-pro
gemma-3n-e4b-instructed