ipex-llm/docs/readthedocs/source/doc/DLlib/Overview/clipping.md
2022-10-17 17:18:53 -07:00

441 B

ConstantGradientClipping

Set constant gradient clipping during the training process.

model.setConstantGradientClipping(min, max)

param:

  • min: The minimum value to clip by.
  • max: The maximum value to clip by.

GradientClippingByL2Norm

Clip gradient to a maximum L2-Norm during the training process.

model.setGradientClippingByL2Norm(clipNorm)

param:

  • clipNorm: Gradient L2-Norm threshold