| <!DOCTYPE html> |
| <!--[if IE]><![endif]--> |
| <html> |
| |
| <head> |
| <meta charset="utf-8"> |
| <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"> |
| <title>Class UAX29URLEmailTokenizerImpl |
| | Apache Lucene.NET 4.8.0-beta00010 Documentation </title> |
| <meta name="viewport" content="width=device-width"> |
| <meta name="title" content="Class UAX29URLEmailTokenizerImpl |
| | Apache Lucene.NET 4.8.0-beta00010 Documentation "> |
| <meta name="generator" content="docfx 2.56.0.0"> |
| |
| <link rel="shortcut icon" href="https://lucenenet.apache.org/docs/4.8.0-beta00009/logo/favicon.ico"> |
| <link rel="stylesheet" href="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/docfx.vendor.css"> |
| <link rel="stylesheet" href="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/docfx.css"> |
| <link rel="stylesheet" href="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/main.css"> |
| <meta property="docfx:navrel" content="toc.html"> |
| <meta property="docfx:tocrel" content="analysis-common/toc.html"> |
| |
| <meta property="docfx:rel" content="https://lucenenet.apache.org/docs/4.8.0-beta00009/"> |
| |
| </head> |
| <body data-spy="scroll" data-target="#affix" data-offset="120"> |
| <div id="wrapper"> |
| <header> |
| |
| <nav id="autocollapse" class="navbar ng-scope" role="navigation"> |
| <div class="container"> |
| <div class="navbar-header"> |
| <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#navbar"> |
| <span class="sr-only">Toggle navigation</span> |
| <span class="icon-bar"></span> |
| <span class="icon-bar"></span> |
| <span class="icon-bar"></span> |
| </button> |
| |
| <a class="navbar-brand" href="/"> |
| <img id="logo" class="svg" src="https://lucenenet.apache.org/docs/4.8.0-beta00009/logo/lucene-net-color.png" alt=""> |
| </a> |
| </div> |
| <div class="collapse navbar-collapse" id="navbar"> |
| <form class="navbar-form navbar-right" role="search" id="search"> |
| <div class="form-group"> |
| <input type="text" class="form-control" id="search-query" placeholder="Search" autocomplete="off"> |
| </div> |
| </form> |
| </div> |
| </div> |
| </nav> |
| |
| <div class="subnav navbar navbar-default"> |
| <div class="container hide-when-search"> |
| <ul class="level0 breadcrumb"> |
| <li> |
| <a href="https://lucenenet.apache.org/docs/4.8.0-beta00009/">API</a> |
| <span id="breadcrumb"> |
| <ul class="breadcrumb"> |
| <li></li> |
| </ul> |
| </span> |
| </li> |
| </ul> |
| </div> |
| </div> |
| </header> |
| <div class="container body-content"> |
| |
| <div id="search-results"> |
| <div class="search-list"></div> |
| <div class="sr-items"> |
| <p><i class="glyphicon glyphicon-refresh index-loading"></i></p> |
| </div> |
| <ul id="pagination"></ul> |
| </div> |
| </div> |
| <div role="main" class="container body-content hide-when-search"> |
| |
| <div class="sidenav hide-when-search"> |
| <a class="btn toc-toggle collapse" data-toggle="collapse" href="#sidetoggle" aria-expanded="false" aria-controls="sidetoggle">Show / Hide Table of Contents</a> |
| <div class="sidetoggle collapse" id="sidetoggle"> |
| <div id="sidetoc"></div> |
| </div> |
| </div> |
| <div class="article row grid-right"> |
| <div class="col-md-10"> |
| <article class="content wrap" id="_content" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl"> |
| |
| |
| <h1 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl" class="text-break">Class UAX29URLEmailTokenizerImpl |
| </h1> |
| <div class="markdown level0 summary"><p>This class implements Word Break rules from the Unicode Text Segmentation |
| algorithm, as specified in |
| <a href="http://unicode.org/reports/tr29/">Unicode Standard Annex #29</a> |
| URLs and email addresses are also tokenized according to the relevant RFCs. |
| <p> |
| Tokens produced are of the following types: |
| <ul><li><ALPHANUM>: A sequence of alphabetic and numeric characters</li><li><NUM>: A number</li><li><URL>: A URL</li><li><EMAIL>: An email address</li><li><SOUTHEAST_ASIAN>: A sequence of characters from South and Southeast |
| Asian languages, including Thai, Lao, Myanmar, and Khmer</li><li><IDEOGRAPHIC>: A single CJKV ideographic character</li><li><HIRAGANA>: A single hiragana character</li><li><KATAKANA>: A sequence of katakana characters</li><li><HANGUL>: A sequence of Hangul characters</li></ul></p> |
| </div> |
| <div class="markdown level0 conceptual"></div> |
| <div class="inheritance"> |
| <h5>Inheritance</h5> |
| <div class="level0"><span class="xref">System.Object</span></div> |
| <div class="level1"><span class="xref">UAX29URLEmailTokenizerImpl</span></div> |
| </div> |
| <div classs="implements"> |
| <h5>Implements</h5> |
| <div><a class="xref" href="Lucene.Net.Analysis.Standard.IStandardTokenizerInterface.html">IStandardTokenizerInterface</a></div> |
| </div> |
| <div class="inheritedMembers"> |
| <h5>Inherited Members</h5> |
| <div> |
| <span class="xref">System.Object.Equals(System.Object)</span> |
| </div> |
| <div> |
| <span class="xref">System.Object.Equals(System.Object, System.Object)</span> |
| </div> |
| <div> |
| <span class="xref">System.Object.GetHashCode()</span> |
| </div> |
| <div> |
| <span class="xref">System.Object.GetType()</span> |
| </div> |
| <div> |
| <span class="xref">System.Object.MemberwiseClone()</span> |
| </div> |
| <div> |
| <span class="xref">System.Object.ReferenceEquals(System.Object, System.Object)</span> |
| </div> |
| <div> |
| <span class="xref">System.Object.ToString()</span> |
| </div> |
| </div> |
| <h6><strong>Namespace</strong>: <a class="xref" href="Lucene.Net.Analysis.Standard.html">Lucene.Net.Analysis.Standard</a></h6> |
| <h6><strong>Assembly</strong>: Lucene.Net.Analysis.Common.dll</h6> |
| <h5 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_syntax">Syntax</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public sealed class UAX29URLEmailTokenizerImpl : IStandardTokenizerInterface</code></pre> |
| </div> |
| <h3 id="constructors">Constructors |
| </h3> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl__ctor_System_IO_TextReader_.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.%23ctor(System.IO.TextReader)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9159">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl__ctor_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.#ctor*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl__ctor_System_IO_TextReader_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.#ctor(System.IO.TextReader)">UAX29URLEmailTokenizerImpl(TextReader)</h4> |
| <div class="markdown level1 summary"><p>Creates a new scanner</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public UAX29URLEmailTokenizerImpl(TextReader in)</code></pre> |
| </div> |
| <h5 class="parameters">Parameters</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Name</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.IO.TextReader</span></td> |
| <td><span class="parametername">in</span></td> |
| <td><p>the TextReader to read input from.</p> |
| </td> |
| </tr> |
| </tbody> |
| </table> |
| <h3 id="fields">Fields |
| </h3> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_AVOID_BAD_URL.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.AVOID_BAD_URL%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L54">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_AVOID_BAD_URL" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.AVOID_BAD_URL">AVOID_BAD_URL</h4> |
| <div class="markdown level1 summary"></div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public const int AVOID_BAD_URL = 2</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_EMAIL_TYPE.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.EMAIL_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9140">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_EMAIL_TYPE" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.EMAIL_TYPE">EMAIL_TYPE</h4> |
| <div class="markdown level1 summary"></div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public static readonly int EMAIL_TYPE</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_HANGUL_TYPE.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.HANGUL_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9138">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_HANGUL_TYPE" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.HANGUL_TYPE">HANGUL_TYPE</h4> |
| <div class="markdown level1 summary"></div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public static readonly int HANGUL_TYPE</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_HIRAGANA_TYPE.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.HIRAGANA_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9134">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_HIRAGANA_TYPE" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.HIRAGANA_TYPE">HIRAGANA_TYPE</h4> |
| <div class="markdown level1 summary"></div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public static readonly int HIRAGANA_TYPE</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_IDEOGRAPHIC_TYPE.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.IDEOGRAPHIC_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9132">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_IDEOGRAPHIC_TYPE" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.IDEOGRAPHIC_TYPE">IDEOGRAPHIC_TYPE</h4> |
| <div class="markdown level1 summary"></div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public static readonly int IDEOGRAPHIC_TYPE</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_KATAKANA_TYPE.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.KATAKANA_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9136">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_KATAKANA_TYPE" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.KATAKANA_TYPE">KATAKANA_TYPE</h4> |
| <div class="markdown level1 summary"></div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public static readonly int KATAKANA_TYPE</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_NUMERIC_TYPE.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.NUMERIC_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9120">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_NUMERIC_TYPE" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.NUMERIC_TYPE">NUMERIC_TYPE</h4> |
| <div class="markdown level1 summary"><p>Numbers</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public static readonly int NUMERIC_TYPE</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_SOUTH_EAST_ASIAN_TYPE.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.SOUTH_EAST_ASIAN_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9130">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_SOUTH_EAST_ASIAN_TYPE" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.SOUTH_EAST_ASIAN_TYPE">SOUTH_EAST_ASIAN_TYPE</h4> |
| <div class="markdown level1 summary"><p>Chars in class \p{Line_Break = Complex_Context} are from South East Asian |
| scripts (Thai, Lao, Myanmar, Khmer, etc.). Sequences of these are kept |
| together as as a single token rather than broken up, because the logic |
| required to break them at word boundaries is too complex for UAX#29. |
| <p> |
| See Unicode Line Breaking Algorithm: <a href="http://www.unicode.org/reports/tr14/#SA">http://www.unicode.org/reports/tr14/#SA</a></p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public static readonly int SOUTH_EAST_ASIAN_TYPE</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_URL_TYPE.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.URL_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9142">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_URL_TYPE" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.URL_TYPE">URL_TYPE</h4> |
| <div class="markdown level1 summary"></div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public static readonly int URL_TYPE</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_WORD_TYPE.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.WORD_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9117">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_WORD_TYPE" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.WORD_TYPE">WORD_TYPE</h4> |
| <div class="markdown level1 summary"><p>Alphanumeric sequences</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public static readonly int WORD_TYPE</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YYEOF.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YYEOF%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L47">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YYEOF" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YYEOF">YYEOF</h4> |
| <div class="markdown level1 summary"><p>This character denotes the end of file</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public static readonly int YYEOF</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YYINITIAL.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YYINITIAL%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L53">View Source</a> |
| </span> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YYINITIAL" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YYINITIAL">YYINITIAL</h4> |
| <div class="markdown level1 summary"><p>lexical states</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public const int YYINITIAL = 0</code></pre> |
| </div> |
| <h5 class="fieldValue">Field Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <h3 id="properties">Properties |
| </h3> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyChar.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyChar%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9144">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyChar_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyChar*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyChar" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyChar">YyChar</h4> |
| <div class="markdown level1 summary"></div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public int YyChar { get; }</code></pre> |
| </div> |
| <h5 class="propertyValue">Property Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyLength.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyLength%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9328">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyLength_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyLength*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyLength" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyLength">YyLength</h4> |
| <div class="markdown level1 summary"><p>Returns the length of the matched text region.</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public int YyLength { get; }</code></pre> |
| </div> |
| <h5 class="propertyValue">Property Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyState.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyState%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9289">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyState_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyState*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyState" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyState">YyState</h4> |
| <div class="markdown level1 summary"><p>Returns the current lexical state.</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public int YyState { get; }</code></pre> |
| </div> |
| <h5 class="propertyValue">Property Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyText.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyText%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9305">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyText_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyText*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyText" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyText">YyText</h4> |
| <div class="markdown level1 summary"><p>Returns the text matched by the current regular expression.</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public string YyText { get; }</code></pre> |
| </div> |
| <h5 class="propertyValue">Property Value</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.String</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <h3 id="methods">Methods |
| </h3> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_GetNextToken.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.GetNextToken%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9384">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_GetNextToken_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.GetNextToken*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_GetNextToken" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.GetNextToken">GetNextToken()</h4> |
| <div class="markdown level1 summary"><p>Resumes scanning until the next regular expression is matched, |
| the end of input is encountered or an I/O-Error occurs.</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public int GetNextToken()</code></pre> |
| </div> |
| <h5 class="returns">Returns</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td><p>the next token</p> |
| </td> |
| </tr> |
| </tbody> |
| </table> |
| <h5 class="exceptions">Exceptions</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Condition</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.IO.IOException</span></td> |
| <td><p>if any I/O-Error occurs</p> |
| </td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_GetText_Lucene_Net_Analysis_TokenAttributes_ICharTermAttribute_.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.GetText(Lucene.Net.Analysis.TokenAttributes.ICharTermAttribute)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9149">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_GetText_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.GetText*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_GetText_Lucene_Net_Analysis_TokenAttributes_ICharTermAttribute_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.GetText(Lucene.Net.Analysis.TokenAttributes.ICharTermAttribute)">GetText(ICharTermAttribute)</h4> |
| <div class="markdown level1 summary"><p>Fills ICharTermAttribute with the current token text.</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public void GetText(ICharTermAttribute t)</code></pre> |
| </div> |
| <h5 class="parameters">Parameters</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Name</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">Lucene.Net.Analysis.TokenAttributes.ICharTermAttribute</span></td> |
| <td><span class="parametername">t</span></td> |
| <td></td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyBegin_System_Int32_.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyBegin(System.Int32)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9296">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyBegin_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyBegin*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyBegin_System_Int32_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyBegin(System.Int32)">YyBegin(Int32)</h4> |
| <div class="markdown level1 summary"><p>Enters a new lexical state</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public void YyBegin(int newState)</code></pre> |
| </div> |
| <h5 class="parameters">Parameters</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Name</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td><span class="parametername">newState</span></td> |
| <td><p>the new lexical state</p> |
| </td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyCharAt_System_Int32_.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyCharAt(System.Int32)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9319">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyCharAt_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyCharAt*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyCharAt_System_Int32_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyCharAt(System.Int32)">YyCharAt(Int32)</h4> |
| <div class="markdown level1 summary"><p>Returns the character at position <code data-dev-comment-type="paramref" class="paramref">pos</code> from the |
| matched text. |
| <p> |
| It is equivalent to YyText[pos], but faster</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public char YyCharAt(int pos)</code></pre> |
| </div> |
| <h5 class="parameters">Parameters</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Name</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td><span class="parametername">pos</span></td> |
| <td><p>the position of the character to fetch. |
| A value from 0 to YyLength-1.</p> |
| </td> |
| </tr> |
| </tbody> |
| </table> |
| <h5 class="returns">Returns</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Char</span></td> |
| <td><p>the character at position pos</p> |
| </td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyClose.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyClose%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9248">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyClose_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyClose*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyClose" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyClose">YyClose()</h4> |
| <div class="markdown level1 summary"><p>Disposes the input stream.</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public void YyClose()</code></pre> |
| </div> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyPushBack_System_Int32_.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyPushBack(System.Int32)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9369">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyPushBack_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyPushBack*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyPushBack_System_Int32_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyPushBack(System.Int32)">YyPushBack(Int32)</h4> |
| <div class="markdown level1 summary"><p>Pushes the specified amount of characters back into the input stream. |
| <p> |
| They will be read again by then next call of the scanning method</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public void YyPushBack(int number)</code></pre> |
| </div> |
| <h5 class="parameters">Parameters</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Name</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.Int32</span></td> |
| <td><span class="parametername">number</span></td> |
| <td><p>the number of characters to be read again. |
| This number must not be greater than YyLength!</p> |
| </td> |
| </tr> |
| </tbody> |
| </table> |
| <span class="small pull-right mobile-hide"> |
| <span class="divider">|</span> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyReset_System_IO_TextReader_.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyReset(System.IO.TextReader)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a> |
| </span> |
| <span class="small pull-right mobile-hide"> |
| <a href="https://github.com/NightOwl888/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L9271">View Source</a> |
| </span> |
| <a id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyReset_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyReset*"></a> |
| <h4 id="Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YyReset_System_IO_TextReader_" data-uid="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.YyReset(System.IO.TextReader)">YyReset(TextReader)</h4> |
| <div class="markdown level1 summary"><p>Resets the scanner to read from a new input stream. |
| Does not close the old reader. |
| <p> |
| All internal variables are reset, the old input stream |
| <strong>cannot</strong> be reused (internal buffer is discarded and lost). |
| Lexical state is set to <a class="xref" href="Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl.html#Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl_YYINITIAL">YYINITIAL</a>. |
| <p> |
| Internal scan buffer is resized down to its initial length, if it has grown.</p> |
| </div> |
| <div class="markdown level1 conceptual"></div> |
| <h5 class="decalaration">Declaration</h5> |
| <div class="codewrapper"> |
| <pre><code class="lang-csharp hljs">public void YyReset(TextReader reader)</code></pre> |
| </div> |
| <h5 class="parameters">Parameters</h5> |
| <table class="table table-bordered table-striped table-condensed"> |
| <thead> |
| <tr> |
| <th>Type</th> |
| <th>Name</th> |
| <th>Description</th> |
| </tr> |
| </thead> |
| <tbody> |
| <tr> |
| <td><span class="xref">System.IO.TextReader</span></td> |
| <td><span class="parametername">reader</span></td> |
| <td><p>the new input stream </p> |
| </td> |
| </tr> |
| </tbody> |
| </table> |
| <h3 id="implements">Implements</h3> |
| <div> |
| <a class="xref" href="Lucene.Net.Analysis.Standard.IStandardTokenizerInterface.html">IStandardTokenizerInterface</a> |
| </div> |
| </article> |
| </div> |
| |
| <div class="hidden-sm col-md-2" role="complementary"> |
| <div class="sideaffix"> |
| <div class="contribution"> |
| <ul class="nav"> |
| <li> |
| <a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00010/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_UAX29URLEmailTokenizerImpl.md&value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.UAX29URLEmailTokenizerImpl%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A" class="contribution-link">Improve this Doc</a> |
| </li> |
| <li> |
| <a href="https://github.com/apache/lucenenet/blob/release/Lucene.Net_4_8_0_beta00010/src/Lucene.Net.Analysis.Common/Analysis/Standard/UAX29URLEmailTokenizerImpl.cs/#L44" class="contribution-link">View Source</a> |
| </li> |
| </ul> |
| </div> |
| <nav class="bs-docs-sidebar hidden-print hidden-xs hidden-sm affix" id="affix"> |
| <!-- <p><a class="back-to-top" href="#top">Back to top</a><p> --> |
| </nav> |
| </div> |
| </div> |
| </div> |
| </div> |
| |
| <footer> |
| <div class="grad-bottom"></div> |
| <div class="footer"> |
| <div class="container"> |
| <span class="pull-right"> |
| <a href="#top">Back to top</a> |
| </span> |
| Copyright © 2020 Licensed to the Apache Software Foundation (ASF) |
| |
| </div> |
| </div> |
| </footer> |
| </div> |
| |
| <script type="text/javascript" src="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/docfx.vendor.js"></script> |
| <script type="text/javascript" src="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/docfx.js"></script> |
| <script type="text/javascript" src="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/main.js"></script> |
| </body> |
| </html> |
