Enter the number of parameters (e.g., 7B = 7,000,000,000).
Memory Requirements 7B parameters
Data Type Bits per Weight Memory (GB) Memory (MiB) Memory (Bytes)
ⓘ This is the approximate memory to load the model weights only. Actual usage may be higher due to activations, gradients, and overhead.