measurement
Hu et al. applied LoRA to the GPT-3 175B model, which reduced the number of trainable parameters by 10,000 times while maintaining inference speed.

Authors

Sources

Referenced by nodes (1)