About torch.optim in the pytorch, the torch.optim file contains many optimizers, as shown in the following figure...