| |
| |
| ``mx.symbol.multi_lars`` |
| ================================================ |
| |
| Description |
| ---------------------- |
| |
| Compute the LARS coefficients of multiple weights and grads from their sums of square" |
| |
| |
| Usage |
| ---------- |
| |
| .. code:: r |
| |
| mx.symbol.multi_lars(...) |
| |
| Arguments |
| ------------------ |
| |
| +----------------------------------------+------------------------------------------------------------+ |
| | Argument | Description | |
| +========================================+============================================================+ |
| | ``lrs`` | NDArray-or-Symbol. | |
| | | | |
| | | Learning rates to scale by LARS coefficient | |
| +----------------------------------------+------------------------------------------------------------+ |
| | ``weights.sum.sq`` | NDArray-or-Symbol | |
| | | sum of square of weights arrays | |
| +----------------------------------------+------------------------------------------------------------+ |
| | ``grads.sum.sq`` | NDArray-or-Symbol | |
| | | sum of square of gradients arrays | |
| +----------------------------------------+------------------------------------------------------------+ |
| | ``wds`` | NDArray-or-Symbol | |
| | | weight decays | |
| +----------------------------------------+------------------------------------------------------------+ |
| | ``eta`` | float, required. | |
| | | | |
| | | LARS eta | |
| +----------------------------------------+------------------------------------------------------------+ |
| | ``eps`` | float, required. | |
| | | | |
| | | LARS eps | |
| +----------------------------------------+------------------------------------------------------------+ |
| | ``rescale.grad`` | float, optional, default=1. | |
| | | | |
| | | Gradient rescaling factor | |
| +----------------------------------------+------------------------------------------------------------+ |
| | ``name`` | string, optional. | |
| | | | |
| | | Name of the resulting symbol. | |
| +----------------------------------------+------------------------------------------------------------+ |
| |
| Value |
| ---------- |
| |
| ``out`` The result mx.symbol |
| |
| |
| Link to Source Code: http://github.com/apache/incubator-mxnet/blob/1.6.0/src/operator/contrib/multi_lars.cc#L37 |
| |