Pārlūkot izejas kodu

fix a bug in the config for use_fast_kernels

Brian Vaughan 1 gadu atpakaļ
vecāks
revīzija
3faf005226
1 mainītis faili ar 2 papildinājumiem un 2 dzēšanām
  1. 2 2
      configs/training.py

+ 2 - 2
configs/training.py

@@ -33,8 +33,8 @@ class train_config:
     dist_checkpoint_root_folder: str="PATH/to/save/FSDP/model" # will be used if using FSDP
     dist_checkpoint_folder: str="fine-tuned" # will be used if using FSDP
     save_optimizer: bool=False # will be used if using FSDP
-    use_fast_kernels: bool = False, # Enable using SDPA from PyTroch Accelerated Transformers, make use Flash Attention and Xformer memory-efficient kernels
+    use_fast_kernels: bool = False # Enable using SDPA from PyTroch Accelerated Transformers, make use Flash Attention and Xformer memory-efficient kernels
 
     
     
-    
+