DeepSeek DeepSeek R1 Distill Llama 8B vs OpenAI GPT-4o
Detailed comparison for LLMs
DeepSeekOpenAI
Head-to-Head Overview
DeepSeek R1 Distill Llama 8B is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for DeepSeek DeepSeek R1 Distill Llama 8B and OpenAI GPT-4o across the three attack methods.
Overall (ASR)
DeepSeek R1 Distill Llama 8B
0
GPT-4o
22.840
TAP Attack Method (ASR)
DeepSeek R1 Distill Llama 8B
0
GPT-4o
39.580
Crescendo Attack Method (ASR)
DeepSeek R1 Distill Llama 8B
0
GPT-4o
25.560
Zero-Shot (ASR)
DeepSeek R1 Distill Llama 8B
0
GPT-4o
3.390
Key Highlights
- DeepSeek DeepSeek R1 Distill Llama 8B has a lower Overall (ASR).
- DeepSeek DeepSeek R1 Distill Llama 8B has a lower TAP Attack Method (ASR).
- DeepSeek DeepSeek R1 Distill Llama 8B has a lower Crescendo Attack Method (ASR).
- DeepSeek DeepSeek R1 Distill Llama 8B has a lower Zero-Shot (ASR).
Metric Radar Chart
deepseek-r1-distill-llama-8b
gpt-4o