Vocab size calculator

Pick a preset or dial in your own shape — vocab V, hidden dim d, layers L, sequence length T, batch B, and dtype — and see the real cost: embedding parameters, untied LM head, logits FLOPs, and KV-cache bytes.