Anthropic Claude 3.5 Sonnet v1 vs Google Gemma 3 1B
Detailed comparison for LLMs
AnthropicGoogle
Head-to-Head Overview
Gemma 3 1B is the overall winner in this comparison!
LLM Metric
Comparison of Attack Success Rate (ASR) metrics for Anthropic Claude 3.5 Sonnet v1 and Google Gemma 3 1B across the three attack methods.
Overall (ASR)
Claude 3.5 Sonnet v1
16.010
Gemma 3 1B
0
TAP Attack Method (ASR)
Claude 3.5 Sonnet v1
28.390
Gemma 3 1B
0
Crescendo Attack Method (ASR)
Claude 3.5 Sonnet v1
19.310
Gemma 3 1B
0
Zero-Shot (ASR)
Claude 3.5 Sonnet v1
0.350
Gemma 3 1B
0
Key Highlights
- Google Gemma 3 1B has a lower Overall (ASR).
- Google Gemma 3 1B has a lower TAP Attack Method (ASR).
- Google Gemma 3 1B has a lower Crescendo Attack Method (ASR).
- Google Gemma 3 1B has a lower Zero-Shot (ASR).
Metric Radar Chart
claude-3-5-sonnet-v1
gemma-3-1b