Google Gemini 2.0 Flash Lite vs Meta Llama 3-7 DS
Detailed comparison for LLMs
GoogleMeta
Head-to-Head Overview
Gemini 2.0 Flash Lite is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Google Gemini 2.0 Flash Lite and Meta Llama 3-7 DS across the three attack methods.
Overall (ASR)
Gemini 2.0 Flash Lite
31.280
Llama 3-7 DS
32.180
TAP Attack Method (ASR)
Gemini 2.0 Flash Lite
63.850
Llama 3-7 DS
0
Crescendo Attack Method (ASR)
Gemini 2.0 Flash Lite
28.710
Llama 3-7 DS
0
Zero-Shot (ASR)
Gemini 2.0 Flash Lite
1.290
Llama 3-7 DS
10.540
Key Highlights
- Google Gemini 2.0 Flash Lite has a lower Overall (ASR).
- Google Gemini 2.0 Flash Lite has a lower Zero-Shot (ASR).
Metric Radar Chart
gemini-2-0-flash-lite
llama-3-7-ds