blob: d9b2ac5a548c58662de361f2e3c5458174d6026e [file] [log] [blame]
<!DOCTYPE html>
<!--[if IE]><![endif]-->
<html>
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
<title>Class UAX29URLEmailTokenizerImpl31
| Apache Lucene.NET 4.8.0-beta00013 Documentation </title>
<meta name="viewport" content="width=device-width">
<meta name="title" content="Class UAX29URLEmailTokenizerImpl31
| Apache Lucene.NET 4.8.0-beta00013 Documentation ">
<meta name="generator" content="docfx 2.56.2.0">
<link rel="shortcut icon" href="https://lucenenet.apache.org/docs/4.8.0-beta00009/logo/favicon.ico">
<link rel="stylesheet" href="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/docfx.vendor.css">
<link rel="stylesheet" href="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/docfx.css">
<link rel="stylesheet" href="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/main.css">
<meta property="docfx:navrel" content="toc.html">
<meta property="docfx:tocrel" content="analysis-common/toc.html">
<meta property="docfx:rel" content="https://lucenenet.apache.org/docs/4.8.0-beta00009/">
</head>
<body data-spy="scroll" data-target="#affix" data-offset="120">
<span id="forkongithub"><a href="https://github.com/apache/lucenenet" target="_blank">Fork me on GitHub</a></span>
<div id="wrapper">
<header>
<nav id="autocollapse" class="navbar ng-scope" role="navigation">
<div class="container">
<div class="navbar-header">
<button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#navbar">
<span class="sr-only">Toggle navigation</span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
</button>
<a class="navbar-brand" href="/">
<img id="logo" class="svg" src="https://lucenenet.apache.org/docs/4.8.0-beta00009/logo/lucene-net-color.png" alt="">
</a>
</div>
<div class="collapse navbar-collapse" id="navbar">
<form class="navbar-form navbar-right" role="search" id="search">
<div class="form-group">
<input type="text" class="form-control" id="search-query" placeholder="Search" autocomplete="off">
</div>
</form>
</div>
</div>
</nav>
<div class="subnav navbar navbar-default">
<div class="container hide-when-search">
<ul class="level0 breadcrumb">
<li>
<a href="https://lucenenet.apache.org/docs/4.8.0-beta00009/">API</a>
<span id="breadcrumb">
<ul class="breadcrumb">
<li></li>
</ul>
</span>
</li>
</ul>
</div>
</div>
</header>
<div class="container body-content">
<div id="search-results">
<div class="search-list"></div>
<div class="sr-items">
<p><i class="glyphicon glyphicon-refresh index-loading"></i></p>
</div>
<ul id="pagination"></ul>
</div>
</div>
<div role="main" class="container body-content hide-when-search">
<div class="sidenav hide-when-search">
<a class="btn toc-toggle collapse" data-toggle="collapse" href="#sidetoggle" aria-expanded="false" aria-controls="sidetoggle">Show / Hide Table of Contents</a>
<div class="sidetoggle collapse" id="sidetoggle">
<div id="sidetoc"></div>
</div>
</div>
<div class="article row grid-right">
<div class="col-md-10">
<article class="content wrap" id="_content" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31">
<h1 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31" class="text-break">Class UAX29URLEmailTokenizerImpl31
</h1>
<div class="markdown level0 summary"><p>This class implements UAX29URLEmailTokenizer, except with a bug
(<a href="https://issues.apache.org/jira/browse/LUCENE-3358">https://issues.apache.org/jira/browse/LUCENE-3358</a>) where Han and Hiragana
characters would be split from combining characters:
@deprecated This class is only for exact backwards compatibility</p>
</div>
<div class="markdown level0 conceptual"></div>
<div class="inheritance">
<h5>Inheritance</h5>
<div class="level0"><span class="xref">System.Object</span></div>
<div class="level1"><span class="xref">UAX29URLEmailTokenizerImpl31</span></div>
</div>
<div classs="implements">
<h5>Implements</h5>
<div><a class="xref" href="Lucene.Net.Analysis.Standard.IStandardTokenizerInterface.html">IStandardTokenizerInterface</a></div>
</div>
<div class="inheritedMembers">
<h5>Inherited Members</h5>
<div>
<span class="xref">System.Object.Equals(System.Object)</span>
</div>
<div>
<span class="xref">System.Object.Equals(System.Object, System.Object)</span>
</div>
<div>
<span class="xref">System.Object.GetHashCode()</span>
</div>
<div>
<span class="xref">System.Object.GetType()</span>
</div>
<div>
<span class="xref">System.Object.MemberwiseClone()</span>
</div>
<div>
<span class="xref">System.Object.ReferenceEquals(System.Object, System.Object)</span>
</div>
<div>
<span class="xref">System.Object.ToString()</span>
</div>
</div>
<h6><strong>Namespace</strong>: <a class="xref" href="Lucene.Net.Analysis.Standard.Std31.html">Lucene.Net.Analysis.Standard.Std31</a></h6>
<h6><strong>Assembly</strong>: Lucene.Net.Analysis.Common.dll</h6>
<h5 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_syntax">Syntax</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">[Obsolete(&quot;This class is only for exact backwards compatibility&quot;)]
public sealed class UAX29URLEmailTokenizerImpl31 : IStandardTokenizerInterface</code></pre>
</div>
<h3 id="constructors">Constructors
</h3>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31__ctor_System_IO_TextReader_.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.%23ctor(System.IO.TextReader)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3297">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31__ctor_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.#ctor*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31__ctor_System_IO_TextReader_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.#ctor(System.IO.TextReader)">UAX29URLEmailTokenizerImpl31(TextReader)</h4>
<div class="markdown level1 summary"><p>Creates a new scanner</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public UAX29URLEmailTokenizerImpl31(TextReader in)</code></pre>
</div>
<h5 class="parameters">Parameters</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Name</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.IO.TextReader</span></td>
<td><span class="parametername">in</span></td>
<td><p>the TextReader to read input from.</p>
</td>
</tr>
</tbody>
</table>
<h3 id="fields">Fields
</h3>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_EMAIL_TYPE.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.EMAIL_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3281">View Source</a>
</span>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_EMAIL_TYPE" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.EMAIL_TYPE">EMAIL_TYPE</h4>
<div class="markdown level1 summary"></div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public static readonly int EMAIL_TYPE</code></pre>
</div>
<h5 class="fieldValue">Field Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_HANGUL_TYPE.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.HANGUL_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3279">View Source</a>
</span>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_HANGUL_TYPE" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.HANGUL_TYPE">HANGUL_TYPE</h4>
<div class="markdown level1 summary"></div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public static readonly int HANGUL_TYPE</code></pre>
</div>
<h5 class="fieldValue">Field Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_HIRAGANA_TYPE.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.HIRAGANA_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3275">View Source</a>
</span>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_HIRAGANA_TYPE" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.HIRAGANA_TYPE">HIRAGANA_TYPE</h4>
<div class="markdown level1 summary"></div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public static readonly int HIRAGANA_TYPE</code></pre>
</div>
<h5 class="fieldValue">Field Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_IDEOGRAPHIC_TYPE.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.IDEOGRAPHIC_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3273">View Source</a>
</span>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_IDEOGRAPHIC_TYPE" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.IDEOGRAPHIC_TYPE">IDEOGRAPHIC_TYPE</h4>
<div class="markdown level1 summary"></div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public static readonly int IDEOGRAPHIC_TYPE</code></pre>
</div>
<h5 class="fieldValue">Field Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_KATAKANA_TYPE.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.KATAKANA_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3277">View Source</a>
</span>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_KATAKANA_TYPE" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.KATAKANA_TYPE">KATAKANA_TYPE</h4>
<div class="markdown level1 summary"></div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public static readonly int KATAKANA_TYPE</code></pre>
</div>
<h5 class="fieldValue">Field Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_NUMERIC_TYPE.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.NUMERIC_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3261">View Source</a>
</span>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_NUMERIC_TYPE" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.NUMERIC_TYPE">NUMERIC_TYPE</h4>
<div class="markdown level1 summary"><p>Numbers</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public static readonly int NUMERIC_TYPE</code></pre>
</div>
<h5 class="fieldValue">Field Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_SOUTH_EAST_ASIAN_TYPE.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.SOUTH_EAST_ASIAN_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3271">View Source</a>
</span>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_SOUTH_EAST_ASIAN_TYPE" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.SOUTH_EAST_ASIAN_TYPE">SOUTH_EAST_ASIAN_TYPE</h4>
<div class="markdown level1 summary"><p>Chars in class \p{Line_Break = Complex_Context} are from South East Asian
scripts (Thai, Lao, Myanmar, Khmer, etc.). Sequences of these are kept
together as as a single token rather than broken up, because the logic
required to break them at word boundaries is too complex for UAX#29.
<p>
See Unicode Line Breaking Algorithm: <a href="http://www.unicode.org/reports/tr14/#SA">http://www.unicode.org/reports/tr14/#SA</a></p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public static readonly int SOUTH_EAST_ASIAN_TYPE</code></pre>
</div>
<h5 class="fieldValue">Field Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_URL_TYPE.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.URL_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3283">View Source</a>
</span>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_URL_TYPE" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.URL_TYPE">URL_TYPE</h4>
<div class="markdown level1 summary"></div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public static readonly int URL_TYPE</code></pre>
</div>
<h5 class="fieldValue">Field Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_WORD_TYPE.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.WORD_TYPE%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3258">View Source</a>
</span>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_WORD_TYPE" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.WORD_TYPE">WORD_TYPE</h4>
<div class="markdown level1 summary"><p>Alphanumeric sequences</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public static readonly int WORD_TYPE</code></pre>
</div>
<h5 class="fieldValue">Field Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YYEOF.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YYEOF%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L34">View Source</a>
</span>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YYEOF" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YYEOF">YYEOF</h4>
<div class="markdown level1 summary"><p>This character denotes the end of file</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public static readonly int YYEOF</code></pre>
</div>
<h5 class="fieldValue">Field Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YYINITIAL.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YYINITIAL%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L40">View Source</a>
</span>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YYINITIAL" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YYINITIAL">YYINITIAL</h4>
<div class="markdown level1 summary"><p>lexical states</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public const int YYINITIAL = 0</code></pre>
</div>
<h5 class="fieldValue">Field Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<h3 id="properties">Properties
</h3>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyChar.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyChar%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3285">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyChar_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyChar*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyChar" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyChar">YyChar</h4>
<div class="markdown level1 summary"></div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public int YyChar { get; }</code></pre>
</div>
<h5 class="propertyValue">Property Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyLength.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyLength%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3454">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyLength_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyLength*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyLength" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyLength">YyLength</h4>
<div class="markdown level1 summary"><p>Returns the length of the matched text region.</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public int YyLength { get; }</code></pre>
</div>
<h5 class="propertyValue">Property Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyState.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyState%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3423">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyState_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyState*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyState" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyState">YyState</h4>
<div class="markdown level1 summary"><p>Returns the current lexical state.</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public int YyState { get; }</code></pre>
</div>
<h5 class="propertyValue">Property Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyText.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyText%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3436">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyText_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyText*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyText" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyText">YyText</h4>
<div class="markdown level1 summary"><p>Returns the text matched by the current regular expression.</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public string YyText { get; }</code></pre>
</div>
<h5 class="propertyValue">Property Value</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.String</span></td>
<td></td>
</tr>
</tbody>
</table>
<h3 id="methods">Methods
</h3>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_GetNextToken.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.GetNextToken%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3506">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_GetNextToken_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.GetNextToken*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_GetNextToken" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.GetNextToken">GetNextToken()</h4>
<div class="markdown level1 summary"><p>Resumes scanning until the next regular expression is matched,
the end of input is encountered or an I/O-Error occurs.</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public int GetNextToken()</code></pre>
</div>
<h5 class="returns">Returns</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td><p>the next token </p>
</td>
</tr>
</tbody>
</table>
<h5 class="exceptions">Exceptions</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Condition</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.IO.IOException</span></td>
<td><p>if any I/O-Error occurs </p>
</td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_GetText_Lucene_Net_Analysis_TokenAttributes_ICharTermAttribute_.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.GetText(Lucene.Net.Analysis.TokenAttributes.ICharTermAttribute)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3288">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_GetText_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.GetText*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_GetText_Lucene_Net_Analysis_TokenAttributes_ICharTermAttribute_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.GetText(Lucene.Net.Analysis.TokenAttributes.ICharTermAttribute)">GetText(ICharTermAttribute)</h4>
<div class="markdown level1 summary"><p>Fills CharTermAttribute with the current token text.</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public void GetText(ICharTermAttribute t)</code></pre>
</div>
<h5 class="parameters">Parameters</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Name</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">Lucene.Net.Analysis.TokenAttributes.ICharTermAttribute</span></td>
<td><span class="parametername">t</span></td>
<td></td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyBegin_System_Int32_.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyBegin(System.Int32)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3429">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyBegin_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyBegin*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyBegin_System_Int32_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyBegin(System.Int32)">YyBegin(Int32)</h4>
<div class="markdown level1 summary"><p>Enters a new lexical state</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public void YyBegin(int newState)</code></pre>
</div>
<h5 class="parameters">Parameters</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Name</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td><span class="parametername">newState</span></td>
<td><p>the new lexical state</p>
</td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyCharAt_System_Int32_.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyCharAt(System.Int32)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3447">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyCharAt_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyCharAt*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyCharAt_System_Int32_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyCharAt(System.Int32)">YyCharAt(Int32)</h4>
<div class="markdown level1 summary"><p>Returns the character at position <tt>pos</tt> from the
matched text. </p>
<p>It is equivalent to YyText[pos], but faster</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public char YyCharAt(int pos)</code></pre>
</div>
<h5 class="parameters">Parameters</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Name</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td><span class="parametername">pos</span></td>
<td><p>the position of the character to fetch.
A value from 0 to YyLength-1.</p>
</td>
</tr>
</tbody>
</table>
<h5 class="returns">Returns</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Char</span></td>
<td><p>the character at position pos</p>
</td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyClose.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyClose%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3382">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyClose_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyClose*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyClose" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyClose">YyClose()</h4>
<div class="markdown level1 summary"><p>Closes the input stream.</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public void YyClose()</code></pre>
</div>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyPushBack_System_Int32_.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyPushBack(System.Int32)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3491">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyPushBack_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyPushBack*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyPushBack_System_Int32_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyPushBack(System.Int32)">YyPushBack(Int32)</h4>
<div class="markdown level1 summary"><p>Pushes the specified amount of characters back into the input stream.</p>
<p>They will be read again by then next call of the scanning method</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public void YyPushBack(int number)</code></pre>
</div>
<h5 class="parameters">Parameters</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Name</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.Int32</span></td>
<td><span class="parametername">number</span></td>
<td><p>the number of characters to be read again.
This number must not be greater than YyLength!</p>
</td>
</tr>
</tbody>
</table>
<span class="small pull-right mobile-hide">
<span class="divider">|</span>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyReset_System_IO_TextReader_.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyReset(System.IO.TextReader)%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A">Improve this Doc</a>
</span>
<span class="small pull-right mobile-hide">
<a href="https://github.com/NightOwl888/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L3404">View Source</a>
</span>
<a id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyReset_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyReset*"></a>
<h4 id="Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YyReset_System_IO_TextReader_" data-uid="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.YyReset(System.IO.TextReader)">YyReset(TextReader)</h4>
<div class="markdown level1 summary"><p>Resets the scanner to read from a new input stream.
Does not close the old reader.</p>
<p>All internal variables are reset, the old input stream
<strong>cannot</strong> be reused (internal buffer is discarded and lost).
Lexical state is set to <a class="xref" href="Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31.html#Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31_YYINITIAL">YYINITIAL</a>.</p>
<p>Internal scan buffer is resized down to its initial length, if it has grown.</p>
</div>
<div class="markdown level1 conceptual"></div>
<h5 class="decalaration">Declaration</h5>
<div class="codewrapper">
<pre><code class="lang-csharp hljs">public void YyReset(TextReader reader)</code></pre>
</div>
<h5 class="parameters">Parameters</h5>
<table class="table table-bordered table-striped table-condensed">
<thead>
<tr>
<th>Type</th>
<th>Name</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td><span class="xref">System.IO.TextReader</span></td>
<td><span class="parametername">reader</span></td>
<td><p>the new input stream </p>
</td>
</tr>
</tbody>
</table>
<h3 id="implements">Implements</h3>
<div>
<a class="xref" href="Lucene.Net.Analysis.Standard.IStandardTokenizerInterface.html">IStandardTokenizerInterface</a>
</div>
</article>
</div>
<div class="hidden-sm col-md-2" role="complementary">
<div class="sideaffix">
<div class="contribution">
<ul class="nav">
<li>
<a href="https://github.com/apache/lucenenet/new/docs/4.8.0-beta00013/websites/apidocs/apiSpec/new?filename=Lucene_Net_Analysis_Standard_Std31_UAX29URLEmailTokenizerImpl31.md&amp;value=---%0Auid%3A%20Lucene.Net.Analysis.Standard.Std31.UAX29URLEmailTokenizerImpl31%0Asummary%3A%20'*You%20can%20override%20summary%20for%20the%20API%20here%20using%20*MARKDOWN*%20syntax'%0A---%0A%0A*Please%20type%20below%20more%20information%20about%20this%20API%3A*%0A%0A" class="contribution-link">Improve this Doc</a>
</li>
<li>
<a href="https://github.com/apache/lucenenet/blob/fix/apidocs-layout/src/Lucene.Net.Analysis.Common/Analysis/Standard/Std31/UAX29URLEmailTokenizerImpl31.cs/#L30" class="contribution-link">View Source</a>
</li>
</ul>
</div>
<nav class="bs-docs-sidebar hidden-print hidden-xs hidden-sm affix" id="affix">
<!-- <p><a class="back-to-top" href="#top">Back to top</a><p> -->
</nav>
</div>
</div>
</div>
</div>
<footer>
<div class="grad-bottom"></div>
<div class="footer">
<div class="container">
<span class="pull-right">
<a href="#top">Back to top</a>
</span>
Copyright © 2020 The Apache Software Foundation, Licensed under the <a href='http://www.apache.org/licenses/LICENSE-2.0' target='_blank'>Apache License, Version 2.0</a><br> <small>Apache Lucene.Net, Lucene.Net, Apache, the Apache feather logo, and the Apache Lucene.Net project logo are trademarks of The Apache Software Foundation. <br>All other marks mentioned may be trademarks or registered trademarks of their respective owners.</small>
</div>
</div>
</footer>
</div>
<script type="text/javascript" src="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/docfx.vendor.js"></script>
<script type="text/javascript" src="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/docfx.js"></script>
<script type="text/javascript" src="https://lucenenet.apache.org/docs/4.8.0-beta00009/styles/main.js"></script>
</body>
</html>