| <!DOCTYPE html > |
| <html> |
| <head> |
| <title>optimizer - MXNet - org.apache.mxnet.optimizer</title> |
| <meta name="description" content="optimizer - MXNet - org.apache.mxnet.optimizer" /> |
| <meta name="keywords" content="optimizer MXNet org.apache.mxnet.optimizer" /> |
| <meta http-equiv="content-type" content="text/html; charset=UTF-8" /> |
| |
| <link href="../../../../lib/template.css" media="screen" type="text/css" rel="stylesheet" /> |
| <link href="../../../../lib/diagrams.css" media="screen" type="text/css" rel="stylesheet" id="diagrams-css" /> |
| <script type="text/javascript" src="../../../../lib/jquery.js" id="jquery-js"></script> |
| <script type="text/javascript" src="../../../../lib/jquery-ui.js"></script> |
| <script type="text/javascript" src="../../../../lib/template.js"></script> |
| <script type="text/javascript" src="../../../../lib/tools.tooltip.js"></script> |
| |
| <script type="text/javascript"> |
| if(top === self) { |
| var url = '../../../../index.html'; |
| var hash = 'org.apache.mxnet.optimizer.package'; |
| var anchor = window.location.hash; |
| var anchor_opt = ''; |
| if (anchor.length >= 1) |
| anchor_opt = '@' + anchor.substring(1); |
| window.location.href = url + '#' + hash + anchor_opt; |
| } |
| </script> |
| |
| </head> |
| <body class="value"> |
| <div id="definition"> |
| <img alt="Package" src="../../../../lib/package_big.png" /> |
| <p id="owner"><a href="../../../package.html" class="extype" name="org">org</a>.<a href="../../package.html" class="extype" name="org.apache">apache</a>.<a href="../package.html" class="extype" name="org.apache.mxnet">mxnet</a></p> |
| <h1>optimizer</h1><span class="permalink"> |
| <a href="../../../../index.html#org.apache.mxnet.optimizer.package" title="Permalink" target="_top"> |
| <img src="../../../../lib/permalink.png" alt="Permalink" /> |
| </a> |
| </span> |
| </div> |
| |
| <h4 id="signature" class="signature"> |
| <span class="modifier_kind"> |
| <span class="modifier"></span> |
| <span class="kind">package</span> |
| </span> |
| <span class="symbol"> |
| <span class="name">optimizer</span> |
| </span> |
| </h4> |
| |
| <div id="comment" class="fullcommenttop"></div> |
| |
| |
| <div id="mbrsel"> |
| <div id="textfilter"><span class="pre"></span><span class="input"><input id="mbrsel-input" type="text" accesskey="/" /></span><span class="post"></span></div> |
| |
| |
| <div id="visbl"> |
| <span class="filtertype">Visibility</span> |
| <ol><li class="public in"><span>Public</span></li><li class="all out"><span>All</span></li></ol> |
| </div> |
| </div> |
| |
| <div id="template"> |
| <div id="allMembers"> |
| |
| |
| <div id="types" class="types members"> |
| <h3>Type Members</h3> |
| <ol><li name="org.apache.mxnet.optimizer.AdaDelta" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped"> |
| <a id="AdaDeltaextendsOptimizer"></a> |
| <a id="AdaDelta:AdaDelta"></a> |
| <h4 class="signature"> |
| <span class="modifier_kind"> |
| <span class="modifier"></span> |
| <span class="kind">class</span> |
| </span> |
| <span class="symbol"> |
| <a href="AdaDelta.html"><span class="name">AdaDelta</span></a><span class="result"> extends <a href="../Optimizer.html" class="extype" name="org.apache.mxnet.Optimizer">Optimizer</a></span> |
| </span> |
| </h4><span class="permalink"> |
| <a href="../../../../index.html#org.apache.mxnet.optimizer.package@AdaDeltaextendsOptimizer" title="Permalink" target="_top"> |
| <img src="../../../../lib/permalink.png" alt="Permalink" /> |
| </a> |
| </span> |
| <p class="shortcomment cmt">AdaDelta optimizer as described in Matthew D.</p><div class="fullcomment"><div class="comment cmt"><p>AdaDelta optimizer as described in Matthew D. Zeiler, 2012. |
| http://arxiv.org/abs/1212.5701 |
| </p></div></div> |
| </li><li name="org.apache.mxnet.optimizer.AdaGrad" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped"> |
| <a id="AdaGradextendsOptimizer"></a> |
| <a id="AdaGrad:AdaGrad"></a> |
| <h4 class="signature"> |
| <span class="modifier_kind"> |
| <span class="modifier"></span> |
| <span class="kind">class</span> |
| </span> |
| <span class="symbol"> |
| <a href="AdaGrad.html"><span class="name">AdaGrad</span></a><span class="result"> extends <a href="../Optimizer.html" class="extype" name="org.apache.mxnet.Optimizer">Optimizer</a></span> |
| </span> |
| </h4><span class="permalink"> |
| <a href="../../../../index.html#org.apache.mxnet.optimizer.package@AdaGradextendsOptimizer" title="Permalink" target="_top"> |
| <img src="../../../../lib/permalink.png" alt="Permalink" /> |
| </a> |
| </span> |
| <p class="shortcomment cmt">AdaGrad optimizer as described in Matthew D.</p><div class="fullcomment"><div class="comment cmt"><p>AdaGrad optimizer as described in Matthew D. Zeiler, 2012. |
| http://arxiv.org/pdf/1212.5701v1.pdf |
| </p></div></div> |
| </li><li name="org.apache.mxnet.optimizer.Adam" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped"> |
| <a id="AdamextendsOptimizer"></a> |
| <a id="Adam:Adam"></a> |
| <h4 class="signature"> |
| <span class="modifier_kind"> |
| <span class="modifier"></span> |
| <span class="kind">class</span> |
| </span> |
| <span class="symbol"> |
| <a href="Adam.html"><span class="name">Adam</span></a><span class="result"> extends <a href="../Optimizer.html" class="extype" name="org.apache.mxnet.Optimizer">Optimizer</a></span> |
| </span> |
| </h4><span class="permalink"> |
| <a href="../../../../index.html#org.apache.mxnet.optimizer.package@AdamextendsOptimizer" title="Permalink" target="_top"> |
| <img src="../../../../lib/permalink.png" alt="Permalink" /> |
| </a> |
| </span> |
| <p class="shortcomment cmt">Adam optimizer as described in [King2014]</p><div class="fullcomment"><div class="comment cmt"><p>Adam optimizer as described in [King2014]</p><p>[King2014] Diederik Kingma, Jimmy Ba, |
| Adam: A Method for Stochastic Optimization, |
| http://arxiv.org/abs/1412.6980 |
| </p></div></div> |
| </li><li name="org.apache.mxnet.optimizer.DCASGD" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped"> |
| <a id="DCASGDextendsOptimizer"></a> |
| <a id="DCASGD:DCASGD"></a> |
| <h4 class="signature"> |
| <span class="modifier_kind"> |
| <span class="modifier"></span> |
| <span class="kind">class</span> |
| </span> |
| <span class="symbol"> |
| <a href="DCASGD.html"><span class="name">DCASGD</span></a><span class="result"> extends <a href="../Optimizer.html" class="extype" name="org.apache.mxnet.Optimizer">Optimizer</a></span> |
| </span> |
| </h4><span class="permalink"> |
| <a href="../../../../index.html#org.apache.mxnet.optimizer.package@DCASGDextendsOptimizer" title="Permalink" target="_top"> |
| <img src="../../../../lib/permalink.png" alt="Permalink" /> |
| </a> |
| </span> |
| <p class="shortcomment cmt">DCASGD optimizer with momentum and weight regularization.</p><div class="fullcomment"><div class="comment cmt"><p>DCASGD optimizer with momentum and weight regularization. |
| Implementation of paper "Asynchronous Stochastic Gradient Descent with |
| Delay Compensation for Distributed Deep Learning" |
| </p></div></div> |
| </li><li name="org.apache.mxnet.optimizer.NAG" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped"> |
| <a id="NAGextendsOptimizer"></a> |
| <a id="NAG:NAG"></a> |
| <h4 class="signature"> |
| <span class="modifier_kind"> |
| <span class="modifier"></span> |
| <span class="kind">class</span> |
| </span> |
| <span class="symbol"> |
| <a href="NAG.html"><span class="name">NAG</span></a><span class="result"> extends <a href="../Optimizer.html" class="extype" name="org.apache.mxnet.Optimizer">Optimizer</a></span> |
| </span> |
| </h4><span class="permalink"> |
| <a href="../../../../index.html#org.apache.mxnet.optimizer.package@NAGextendsOptimizer" title="Permalink" target="_top"> |
| <img src="../../../../lib/permalink.png" alt="Permalink" /> |
| </a> |
| </span> |
| <p class="shortcomment cmt">SGD with nesterov.</p><div class="fullcomment"><div class="comment cmt"><p>SGD with nesterov. |
| It is implemented according to |
| https://github.com/torch/optim/blob/master/sgd.lua |
| </p></div></div> |
| </li><li name="org.apache.mxnet.optimizer.RMSProp" visbl="pub" data-isabs="false" fullComment="yes" group="Ungrouped"> |
| <a id="RMSPropextendsOptimizer"></a> |
| <a id="RMSProp:RMSProp"></a> |
| <h4 class="signature"> |
| <span class="modifier_kind"> |
| <span class="modifier"></span> |
| <span class="kind">class</span> |
| </span> |
| <span class="symbol"> |
| <a href="RMSProp.html"><span class="name">RMSProp</span></a><span class="result"> extends <a href="../Optimizer.html" class="extype" name="org.apache.mxnet.Optimizer">Optimizer</a></span> |
| </span> |
| </h4><span class="permalink"> |
| <a href="../../../../index.html#org.apache.mxnet.optimizer.package@RMSPropextendsOptimizer" title="Permalink" target="_top"> |
| <img src="../../../../lib/permalink.png" alt="Permalink" /> |
| </a> |
| </span> |
| <p class="shortcomment cmt">RMSProp optimizer as described in Tieleman & Hinton, 2012.</p><div class="fullcomment"><div class="comment cmt"><p>RMSProp optimizer as described in Tieleman & Hinton, 2012. |
| http://arxiv.org/pdf/1308.0850v5.pdf Eq(38) - Eq(45) by Alex Graves, 2013. |
| </p></div></div> |
| </li><li name="org.apache.mxnet.optimizer.SGD" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped"> |
| <a id="SGDextendsOptimizer"></a> |
| <a id="SGD:SGD"></a> |
| <h4 class="signature"> |
| <span class="modifier_kind"> |
| <span class="modifier"></span> |
| <span class="kind">class</span> |
| </span> |
| <span class="symbol"> |
| <a href="SGD.html"><span class="name">SGD</span></a><span class="result"> extends <a href="../Optimizer.html" class="extype" name="org.apache.mxnet.Optimizer">Optimizer</a></span> |
| </span> |
| </h4><span class="permalink"> |
| <a href="../../../../index.html#org.apache.mxnet.optimizer.package@SGDextendsOptimizer" title="Permalink" target="_top"> |
| <img src="../../../../lib/permalink.png" alt="Permalink" /> |
| </a> |
| </span> |
| <p class="shortcomment cmt">A very simple SGD optimizer with momentum and weight regularization.</p> |
| </li><li name="org.apache.mxnet.optimizer.SGLD" visbl="pub" data-isabs="false" fullComment="no" group="Ungrouped"> |
| <a id="SGLDextendsOptimizer"></a> |
| <a id="SGLD:SGLD"></a> |
| <h4 class="signature"> |
| <span class="modifier_kind"> |
| <span class="modifier"></span> |
| <span class="kind">class</span> |
| </span> |
| <span class="symbol"> |
| <a href="SGLD.html"><span class="name">SGLD</span></a><span class="result"> extends <a href="../Optimizer.html" class="extype" name="org.apache.mxnet.Optimizer">Optimizer</a></span> |
| </span> |
| </h4><span class="permalink"> |
| <a href="../../../../index.html#org.apache.mxnet.optimizer.package@SGLDextendsOptimizer" title="Permalink" target="_top"> |
| <img src="../../../../lib/permalink.png" alt="Permalink" /> |
| </a> |
| </span> |
| <p class="shortcomment cmt">Stochastic Langevin Dynamics Updater to sample from a distribution.</p> |
| </li></ol> |
| </div> |
| |
| |
| |
| |
| |
| |
| |
| |
| </div> |
| |
| <div id="inheritedMembers"> |
| |
| |
| </div> |
| |
| <div id="groupedMembers"> |
| <div class="group" name="Ungrouped"> |
| <h3>Ungrouped</h3> |
| |
| </div> |
| </div> |
| |
| </div> |
| |
| <div id="tooltip"></div> |
| |
| <div id="footer"> </div> |
| |
| |
| </body> |
| </html> |
