Google Gemma 3n E2B Instructed LiteRT vs OpenAI GPT-4o Mini
Detailed comparison for LLMs
GoogleOpenAI
Head-to-Head Overview
Gemma 3n E2B Instructed LiteRT is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Google Gemma 3n E2B Instructed LiteRT and OpenAI GPT-4o Mini across the three attack methods.
Overall (ASR)
Gemma 3n E2B Instructed LiteRT
0
GPT-4o Mini
26.670
TAP Attack Method (ASR)
Gemma 3n E2B Instructed LiteRT
0
GPT-4o Mini
40.500
Crescendo Attack Method (ASR)
Gemma 3n E2B Instructed LiteRT
0
GPT-4o Mini
33.100
Zero-Shot (ASR)
Gemma 3n E2B Instructed LiteRT
0
GPT-4o Mini
6.410
Key Highlights
- Google Gemma 3n E2B Instructed LiteRT has a lower Overall (ASR).
- Google Gemma 3n E2B Instructed LiteRT has a lower TAP Attack Method (ASR).
- Google Gemma 3n E2B Instructed LiteRT has a lower Crescendo Attack Method (ASR).
- Google Gemma 3n E2B Instructed LiteRT has a lower Zero-Shot (ASR).
Metric Radar Chart
gemma-3n-e2b-instructed-litert
gpt-4o-mini