Deepseek Deepseek V3 vs Meta Llama 3.1 405B Instruct
Detailed comparison for LLMs
DeepseekMeta
Head-to-Head Overview
Llama 3.1 405B Instruct is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Deepseek Deepseek V3 and Meta Llama 3.1 405B Instruct across the three attack methods.
Overall (ASR)
Deepseek V3
47.210
Llama 3.1 405B Instruct
0
TAP Attack Method (ASR)
Deepseek V3
79.540
Llama 3.1 405B Instruct
0
Crescendo Attack Method (ASR)
Deepseek V3
49.270
Llama 3.1 405B Instruct
0
Zero-Shot (ASR)
Deepseek V3
12.810
Llama 3.1 405B Instruct
0
Key Highlights
- Meta Llama 3.1 405B Instruct has a lower Overall (ASR).
- Meta Llama 3.1 405B Instruct has a lower TAP Attack Method (ASR).
- Meta Llama 3.1 405B Instruct has a lower Crescendo Attack Method (ASR).
- Meta Llama 3.1 405B Instruct has a lower Zero-Shot (ASR).
Metric Radar Chart
deepseek-v3
llama-3-1-405b-instruct