parameters: (self)
docstring: Copy the .grad attribute from stored references to fp16 parameters to
          the .grad attribute of the main fp32 parameters that are directly
          updated by the optimizer.  :attr:`update_fp32_grads` only needs to be called if
          fp16_optimizer_obj.backward was called with update_fp32_grads=False.
docstring_summary: Copy the .grad attribute from stored references to fp16 parameters to
          the .grad attribute of the main fp32 parameters that are directly
          updated by the optimizer.  :attr:`update_fp32_grads` only needs to be called if
          fp16_optimizer_obj.backward was called with update_fp32_grads=False.
docstring_tokens: Copy the . grad attribute from stored references to fp16 parameters to the . grad attribute of the main fp32 parameters that are directly updated by the optimizer . : attr : update_fp32_grads only needs to be called if fp16_optimizer_obj . backward was called with update_fp32_grads = False .
function: def update_fp32_grads(self):
          """
          Copy the .grad attribute from stored references to fp16 parameters to
          the .grad attribute of the main fp32 parameters that are directly
          updated by the optimizer.  :attr:`update_fp32_grads` only needs to be called if
          fp16_optimizer_obj.backward was called with update_fp32_grads=False.
          """
          if self.dynamic_loss_scale:
              self._check_overflow()
              if self.overflow: return
          self._copy_grads_fp16_to_fp32()
          self._downscale_fp32()
function_tokens: def update_fp32_grads ( self ) : if self . dynamic_loss_scale : self . _check_overflow ( ) if self . overflow : return self . _copy_grads_fp16_to_fp32 ( ) self . _downscale_fp32 ( )