Anthropic Claude 3.5 Sonnet v1 vs Google Gemma 3n E4B
Detailed comparison for LLMs
AnthropicGoogle
Head-to-Head Overview
Gemma 3n E4B is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Anthropic Claude 3.5 Sonnet v1 and Google Gemma 3n E4B across the three attack methods.
Overall (ASR)
Claude 3.5 Sonnet v1
16.010
Gemma 3n E4B
0
TAP Attack Method (ASR)
Claude 3.5 Sonnet v1
28.390
Gemma 3n E4B
0
Crescendo Attack Method (ASR)
Claude 3.5 Sonnet v1
19.310
Gemma 3n E4B
0
Zero-Shot (ASR)
Claude 3.5 Sonnet v1
0.350
Gemma 3n E4B
0
Key Highlights
- Google Gemma 3n E4B has a lower Overall (ASR).
- Google Gemma 3n E4B has a lower TAP Attack Method (ASR).
- Google Gemma 3n E4B has a lower Crescendo Attack Method (ASR).
- Google Gemma 3n E4B has a lower Zero-Shot (ASR).
Metric Radar Chart
claude-3-5-sonnet-v1
gemma-3n-e4b