Model Training Time Calculator

Calculate the time required to train a model based on model size, hardware specs, and token count.

Model Size

Enter model size (0.5-1000)

Unit

Model size unit

B T

Check to select a GPU model, uncheck to input custom TFLOPs

Use GPU Model from List

GPU Model

Select a GPU model from the list

Number of GPUs

Total number of GPUs for training

1 1024

Training Tokens

Number of training tokens

1 1000

Unit

Token count unit

M B T

Model FLOPs Utilization (MFU) %

Efficiency of hardware utilization (50% is typical for low-end estimate)

10 100