Make of this what you will.
I'm interested in your take on it. IIRC Gemma family models too have a ~250k vocabulary size
Make of this what you will.