LLM VRAM Calculator
Calculate the estimated VRAM requirements for an LLM based on parameter size and precision.
Enter the number of parameters in the LLM (in billions):
Select the precision:
FP32 (32-bit Floating Point)
FP16 (16-bit Floating Point)
FP8 (8-bit Floating Point)
INT8 (8-bit Integer)
FP4 (4-bit Floating Point)
INT4 (4-bit Integer)
Calculate VRAM