DeepSeek DeepSeek R1 Distill Llama 8B vs Google Gemini 2.0 Flash Lite
Detailed comparison for LLMs
DeepSeekGoogle
Head-to-Head Overview
Gemini 2.0 Flash Lite is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for DeepSeek DeepSeek R1 Distill Llama 8B and Google Gemini 2.0 Flash Lite across the three attack methods.
Overall (ASR)
DeepSeek R1 Distill Llama 8B
100.000
Gemini 2.0 Flash Lite
31.280
TAP Attack Method (ASR)
DeepSeek R1 Distill Llama 8B
100.000
Gemini 2.0 Flash Lite
63.850
Crescendo Attack Method (ASR)
DeepSeek R1 Distill Llama 8B
100.000
Gemini 2.0 Flash Lite
28.710
Zero-Shot (ASR)
DeepSeek R1 Distill Llama 8B
100.000
Gemini 2.0 Flash Lite
1.290
Key Highlights
- Google Gemini 2.0 Flash Lite has a lower Overall (ASR).
- Google Gemini 2.0 Flash Lite has a lower TAP Attack Method (ASR).
- Google Gemini 2.0 Flash Lite has a lower Crescendo Attack Method (ASR).
- Google Gemini 2.0 Flash Lite has a lower Zero-Shot (ASR).
Metric Radar Chart
deepseek-r1-distill-llama-8b
gemini-2-0-flash-lite