Publish built docs triggered by e6c75870a2c465aae4787605f91a9dff47b0e911
diff --git a/_sources/autoapi/datafusion/context/index.rst.txt b/_sources/autoapi/datafusion/context/index.rst.txt index fe3bde4..02b4374 100644 --- a/_sources/autoapi/datafusion/context/index.rst.txt +++ b/_sources/autoapi/datafusion/context/index.rst.txt
@@ -42,6 +42,7 @@ datafusion.context.ArrowArrayExportable datafusion.context.ArrowStreamExportable datafusion.context.PhysicalOptimizerRuleExportable + datafusion.context.QueryPlannerExportable datafusion.context.RuntimeEnvBuilder datafusion.context.SQLOptions datafusion.context.SessionConfig @@ -92,6 +93,22 @@ .. py:method:: __datafusion_physical_optimizer_rule__() -> object +.. py:class:: QueryPlannerExportable + + Bases: :py:obj:`Protocol` + + + Type hint for object that has a __datafusion_query_planner__ PyCapsule. + + The method returns a PyCapsule wrapping an ``FFI_QueryPlanner``, typically + produced by a separate compiled extension. ``session`` is the + :py:class:`SessionContext` the planner is being installed on; take the + extension codecs from it rather than building your own. + + + .. py:method:: __datafusion_query_planner__(session: Any) -> object + + .. py:class:: RuntimeEnvBuilder Runtime configuration options. @@ -451,16 +468,31 @@ df = ctx.read_csv("data.csv") - .. py:method:: __datafusion_logical_extension_codec__() -> Any + .. py:method:: __datafusion_logical_extension_codec__(session: Any = None) -> Any Access the PyCapsule FFI_LogicalExtensionCodec. + ``session`` is accepted so a context satisfies the same protocol an + extension library implements, where the argument is how the library + reaches the session it is being installed on. A context already is one, + so the argument is ignored. - .. py:method:: __datafusion_physical_extension_codec__() -> Any + + .. py:method:: __datafusion_physical_extension_codec__(session: Any = None) -> Any Access the PyCapsule FFI_PhysicalExtensionCodec. + See :meth:`__datafusion_logical_extension_codec__` for ``session``. + + + + .. py:method:: __datafusion_query_planner__(session: Any = None) -> Any + + Access the ``FFI_QueryPlanner`` PyCapsule for the current planner. + + See :meth:`__datafusion_logical_extension_codec__` for ``session``. + .. py:method:: __datafusion_task_context_provider__() -> Any @@ -1463,6 +1495,52 @@ + .. py:method:: set_query_planner(planner: QueryPlannerExportable | _typeshed.CapsuleType) -> None + + Install a custom query planner on this session. + + The planner is imported through its ``__datafusion_query_planner__`` + PyCapsule and installed on this context, in the same way + :meth:`~SessionContext.add_physical_optimizer_rule` installs a rule. + The query planner is part of the session state, so it applies to this + context and to every context sharing its session — including ones + already returned by + :meth:`~SessionContext.with_logical_extension_codec` and friends. + + A session holds exactly one planner, so calling this again replaces the + previous one rather than layering. To chain planners, have the new + planner wrap the capsule from + :meth:`~SessionContext.__datafusion_query_planner__`, captured + *before* the new planner is installed. + + Install any extension codecs before a layered planner. Installing a + codec afterwards rebuilds the installed planner against it, but not the + fallback inside it, which keeps the codecs it was imported with. Note + also that the planner is built against the codecs of the context this + method is called on, so installing the same planner again on a different + handle rebinds the session's planner to *that* handle's codecs. + + :param planner: Object exposing ``__datafusion_query_planner__`` (see + :class:`QueryPlannerExportable`) or a raw + ``datafusion_query_planner`` PyCapsule. + + .. rubric:: Examples + + >>> from my_extension import DistributedQueryPlanner # doctest: +SKIP + >>> ctx = SessionContext() + >>> ctx.set_query_planner(DistributedQueryPlanner()) # doctest: +SKIP + >>> ctx.sql("SELECT * FROM remote_table").collect() # doctest: +SKIP + + Layer a planner on top of the one already installed by capturing + the existing planner first: + + >>> fallback = ctx.__datafusion_query_planner__() # doctest: +SKIP + >>> ctx.set_query_planner( + ... DistributedQueryPlanner(fallback=fallback) + ... ) # doctest: +SKIP + + + .. py:method:: sql(query: str, options: SQLOptions | None = None, param_values: dict[str, Any] | None = None, **named_params: Any) -> datafusion.dataframe.DataFrame Create a :py:class:`~datafusion.DataFrame` from SQL query text. @@ -1682,6 +1760,13 @@ ``__datafusion_logical_extension_codec__`` (see :py:class:`~datafusion.user_defined.LogicalExtensionCodecExportable`). + The returned context shares its session state with the original, so a + later registration on either is visible to both. If a custom query + planner is installed, it is rebuilt against the new codec on the shared + session, so the original context plans with the new codec too. This + happens on the shared session, so it takes effect even if the returned + context is discarded. + .. py:method:: with_physical_extension_codec(codec: datafusion.user_defined.PhysicalExtensionCodecExportable | _typeshed.CapsuleType) -> SessionContext @@ -1692,6 +1777,13 @@ ``__datafusion_physical_extension_codec__`` (see :py:class:`~datafusion.user_defined.PhysicalExtensionCodecExportable`). + The returned context shares its session state with the original, so a + later registration on either is visible to both. If a custom query + planner is installed, it is rebuilt against the new codec on the shared + session, so the original context plans with the new codec too. This + happens on the shared session, so it takes effect even if the returned + context is discarded. + .. py:method:: with_python_udf_inlining(*, enabled: bool) -> SessionContext @@ -1731,7 +1823,13 @@ regardless of the toggle. Returns a new :class:`SessionContext` with the toggle applied; - the original session is unchanged. + the original context's own codec settings are unchanged. The + returned context shares its session state with the original, so + a later registration on either is visible to both. If a custom + query planner is installed, it is rebuilt against the new codecs + on the shared session, so the original context plans with them + too. This happens on the shared session, so it takes effect even + if the returned context is discarded. .. rubric:: Examples
diff --git a/_sources/autoapi/datafusion/user_defined/index.rst.txt b/_sources/autoapi/datafusion/user_defined/index.rst.txt index 6e25059..555c33a 100644 --- a/_sources/autoapi/datafusion/user_defined/index.rst.txt +++ b/_sources/autoapi/datafusion/user_defined/index.rst.txt
@@ -292,8 +292,13 @@ Type hint for objects exposing ``__datafusion_logical_extension_codec__``. + ``session`` is the :py:class:`~datafusion.context.SessionContext` the codec + is being installed on. Take the task context provider from it rather than + building a session of your own, so the decode callbacks resolve names + against the session that runs the query. - .. py:method:: __datafusion_logical_extension_codec__() -> object + + .. py:method:: __datafusion_logical_extension_codec__(session: Any) -> object .. py:class:: PhysicalExtensionCodecExportable @@ -303,8 +308,10 @@ Type hint for objects exposing ``__datafusion_physical_extension_codec__``. + See :py:class:`LogicalExtensionCodecExportable` for ``session``. - .. py:method:: __datafusion_physical_extension_codec__() -> object + + .. py:method:: __datafusion_physical_extension_codec__(session: Any) -> object .. py:class:: ScalarUDF(name: str, func: collections.abc.Callable[Ellipsis, _R], input_fields: list[pyarrow.Field], return_field: pyarrow.Field, volatility: Volatility | str)
diff --git a/_sources/contributor-guide/ffi.md.txt b/_sources/contributor-guide/ffi.md.txt index bf65cad..31cd939 100644 --- a/_sources/contributor-guide/ffi.md.txt +++ b/_sources/contributor-guide/ffi.md.txt
@@ -232,6 +232,202 @@ As we continue to expose more of the DataFusion features, we intend to follow this same design pattern. +## Query Planners Across Multiple Libraries + +A query can involve three independent native libraries: `datafusion-python`, a library +that owns table providers or functions, and a library that owns the query planner. The +examples use two separate extension crates so each role has a distinct shared-library +identity: + +- [`datafusion-ffi-example`] owns providers, functions, and their codecs. +- [`datafusion-ffi-query-planner-example`] owns the planner and its configuration. + +The `SessionContext` owns the codecs used for the exchange and supplies them to the +foreign planner. This lets the planner decode provider-owned objects and lets +`datafusion-python` decode the physical plan returned by the planner. The examples use +process-local tokens to demonstrate ownership; production codecs should serialize +durable metadata instead. + +The current Python API has one external logical codec and one external physical codec. +Installing another codec replaces the prior codec rather than composing a registry. +The example therefore has one external codec owner, and the planner uses built-in +physical nodes. Install the provider codecs before the planner where possible. + +The current FFI logical codec supports providers and UDFs but not arbitrary custom +`LogicalPlan::Extension` nodes. See both example READMEs for the supported flow and +local build commands. + +### Capsule getters receive the session they are installed on + +`__datafusion_query_planner__`, `__datafusion_logical_extension_codec__`, and +`__datafusion_physical_extension_codec__` all take the `SessionContext` the object is +being installed on, the same way `__datafusion_table_provider__` does: + +```rust +fn __datafusion_physical_extension_codec__<'py>( + &self, + py: Python<'py>, + session: Bound<'py, PyAny>, +) -> PyResult<Bound<'py, PyCapsule>> { + let runtime = get_tokio_runtime().handle().clone(); + let ctx_provider = ffi_task_context_provider_from_pycapsule(&session)?; + let ffi = FFI_PhysicalExtensionCodec::new(inner, Some(runtime), ctx_provider); + PyCapsule::new_with_value(py, ffi, cr"datafusion_physical_extension_codec") +} +``` + +This exists because the FFI constructors need things an extension library does not +have. `FFI_{Logical,Physical}ExtensionCodec::new` needs a `TaskContextProvider` for the +decode callbacks the codec will receive, and `FFI_QueryPlanner::new` needs both codecs +on top of that. Taking them from the session is what keeps a library from constructing +a `SessionContext` purely to satisfy a parameter — an empty one resolves nothing, and +`FFI_TaskContextProvider` holds it weakly, so a context built inline in the getter is +already dropped by the time the capsule is used. + +A planner uses `FFI_QueryPlanner::new_with_ffi_codecs` with the two codecs it takes off +the session, and never touches a provider directly. That also matches what installation +does anyway: `set_query_planner` builds the planner against the codecs of the session +that will run the query. + +`SessionContext` accepts the argument on all three getters and ignores it, so a session +satisfies the same protocol an extension library implements. When you export the current +planner to wrap it, `ctx.__datafusion_query_planner__()` and +`ctx.__datafusion_query_planner__(ctx)` are both fine. + +### A codec decodes against the session that is running the query + +Because the provider comes from the host, a decode callback running inside an extension +library resolves names against the session running the query. A function registered with +`ctx.register_udf(...)` is visible to a foreign codec decoding a node that references it +by name, and the handle is live rather than a snapshot, so a registration made after the +codec is installed is visible too. + +This is covered in +`examples/datafusion-ffi-query-planner-example/python/tests/_test_three_library_query_planner.py`, +where the example codecs take a `require_udf_on_decode` name and resolve it out of the +task context they are handed. + +### One session, one `Arc<SessionContext>` + +Every codec handed to a foreign object carries an `FFI_TaskContextProvider`, and that +type holds its provider **weakly**. A registered catalog provider upgrades the handle on +every `supports_filters_pushdown` and every `scan`. Those handles are bound to one +particular `Arc<SessionContext>` allocation, not to the logical session, so anything that +replaces the allocation orphans all of them and the next query fails with +`TaskContextProvider went out of scope over FFI boundary`. + +So a `PySessionContext` keeps the `Arc<SessionContext>` it was created with for its whole +life. Installing a query planner writes the new `SessionState` back through +`state_ref()`, exactly as `add_physical_optimizer_rule` does, rather than deriving a +replacement context. The session id is carried across that rewrite — `SessionStateBuilder` +mints a fresh one otherwise — so `session_id()` and every `TaskContext` the session hands +out keep agreeing. + +Repairing the damage instead of avoiding it does not work in general. A context can +rebuild the codecs it holds in its own fields, but a codec already embedded in a +registered `FFI_CatalogProvider` — and in every `FFI_SchemaProvider` and +`FFI_TableProvider` minted from it — is not reachable from Python at all. Nor can the +codec simply retain the session that built it: a codec handed to a provider is routinely +registered straight back into that same session, which would close the cycle +`SessionContext -> catalog -> FFI provider -> FFI codec -> SessionContext` and leak it. + +`SessionContext.enable_url_table` is the one exception. It clones the underlying +`SessionContext`, so the returned context has an allocation of its own and must not +outlive the receiver. + +### What a derived context shares + +`with_logical_extension_codec`, `with_physical_extension_codec`, and +`with_python_udf_inlining` return a new `SessionContext` wrapping the *same* underlying +session. Only the Python-side codec settings differ; catalogs, tables, registered +functions, and configuration are the one shared session, so a registration on either +side is visible to both. + +`set_query_planner` does not return anything. The query planner lives in `SessionState`, +so it is a property of the session rather than of a handle on it, and installing one is +visible to every context sharing that session — including ones a `with_*` call returned +earlier. Installing a codec on a session that already has a foreign planner rebuilds +that planner against the new codec for the same reason: there is one planner, and it has +to carry the codecs currently in force. This happens on the shared session, so it takes +effect even if the returned context is discarded — `ctx.with_python_udf_inlining(...)` +whose result is thrown away still leaves the session's planner carrying the codecs of +that discarded handle. A call that changes nothing is exempt: asking for the inlining +setting a context already has returns a handle without touching the session. + +The rule that falls out of this is worth stating on its own, because it is the one thing +that surprises people: + +> The session's query planner carries the codecs of the handle that most recently +> installed one. Every other path — `Expr.to_bytes(ctx)`, `ExecutionPlan.to_bytes(ctx)`, +> registering a provider — uses the codecs of the handle you call it on. + +Those can be different handles, and then one session has two codecs in effect at once: + +```python +ctx = ctx.with_logical_extension_codec(codec_a) +ctx.set_query_planner(planner) +ctx.with_logical_extension_codec(codec_b) # discarded + +Expr.to_bytes(expr, ctx) # encodes with codec_a -- ctx's own field +ctx.sql(...).collect() # plans with codec_b -- installed via the discarded handle +``` + +Chaining `ctx = ctx.with_...(...)`, as the example below does, keeps the two in step. +`test_the_planner_and_the_handle_can_hold_different_codecs` pins the divergence. + +```python +ctx = SessionContext(config) +ctx = ctx.with_logical_extension_codec(provider_logical_codec) +ctx = ctx.with_physical_extension_codec(provider_physical_codec) +ctx.set_query_planner(planner) +ctx.register_udf(my_udf) +``` + +Order is a readability preference rather than a requirement — installing a codec after a +planner rebuilds the planner against it. + +A session holds exactly one query planner. Calling `set_query_planner` again replaces the +installed planner instead of layering another one. To chain planners, have the new +planner wrap the capsule returned by `SessionContext.__datafusion_query_planner__()`, +captured before the new planner is installed, and delegate to it explicitly. + +### Rebinding a planner's codecs is one level deep + +The rebuild above swaps the codecs on the installed `ForeignQueryPlanner` handle, and +only that handle. A planner that wraps a fallback resolved that fallback when *it* was +installed, and holds the result inside its own library's private data — behind a +`create_physical_plan` function pointer, with no Python-side handle. A codec installed +afterwards therefore reaches the outer planner and not the fallback, which keeps +whichever codecs were in force when it was imported. + +Neither side can repair that: + +- **The host cannot reach it.** `FFI_QueryPlanner::new_with_ffi_codecs` unwraps exactly + one `ForeignQueryPlanner` layer. There is no deeper handle to unwrap — the same + situation as a codec embedded in a registered `FFI_CatalogProvider`. +- **The planner library cannot re-derive it.** `FFI_QueryPlanner` holds its codecs by + value, and `Session` exposes no accessor for the ones the host currently has, so + `create_physical_plan` cannot pick them up from the session it is handed. The rebuild + has to be eager, and an eager rebuild only sees the top layer. + +A fix has to come from upstream, and is tracked in +[apache/datafusion#24762](https://github.com/apache/datafusion/issues/24762). + +The stale codecs stay usable rather than dangling — they hold weak handles to the one +`Arc<SessionContext>` that Rule 6 keeps alive — so the effect is a fallback hop +serializing with an older codec, not a failure. It is also invisible to the examples +here, which use one fallback in the same cdylib as its wrapper; `datafusion-ffi` +short-circuits a same-library hop rather than serializing, so no codec runs. A fallback +in a *different* library would serialize, and would do it with the codecs it was +imported with. + +So install the codecs before a layered planner. If a codec has to go in afterwards, +install the outer planner again *on the handle that holds the new codec* — that re-runs +its getter, which re-imports the fallback against that handle's codecs. Re-installing on +the original handle rebinds the session's planner back to the original handle's codecs +instead, which is the trap +`test_reinstalling_a_planner_rebinds_the_session_to_that_handles_codecs` pins. + ## Alternative Approach Suppose you needed to expose some other features of DataFusion and you could not wait @@ -257,3 +453,5 @@ the latest status, we recommend reviewing the code in the [datafusion-ffi] crate. [datafusion-ffi]: https://crates.io/crates/datafusion-ffi +[`datafusion-ffi-example`]: https://github.com/apache/datafusion-python/tree/main/examples/datafusion-ffi-example +[`datafusion-ffi-query-planner-example`]: https://github.com/apache/datafusion-python/tree/main/examples/datafusion-ffi-query-planner-example
diff --git a/_sources/user-guide/io/table_provider.md.txt b/_sources/user-guide/io/table_provider.md.txt index 3c436ba..5dc2dc0 100644 --- a/_sources/user-guide/io/table_provider.md.txt +++ b/_sources/user-guide/io/table_provider.md.txt
@@ -29,6 +29,11 @@ A complete example can be found in the [examples folder](https://github.com/apache/datafusion-python/tree/main/examples). +The method takes the `SessionContext` it is being registered on. Take whatever +the FFI constructor needs from that session — here the logical extension codec — +rather than building one inside your library. See the {ref}`ffi` guide for the +full capsule protocol. + ```rust #[pymethods] impl MyTableProvider { @@ -36,13 +41,13 @@ fn __datafusion_table_provider__<'py>( &self, py: Python<'py>, + session: Bound<'py, PyAny>, ) -> PyResult<Bound<'py, PyCapsule>> { - let name = cr"datafusion_table_provider".into(); - let provider = Arc::new(self.clone()); - let provider = FFI_TableProvider::new(provider, false, None); + let codec = ffi_logical_codec_from_pycapsule(session, None)?; + let provider = FFI_TableProvider::new_with_ffi_codec(provider, false, None, codec); - PyCapsule::new_bound(py, provider, Some(name.clone())) + PyCapsule::new_with_value(py, provider, cr"datafusion_table_provider") } } ```
diff --git a/_sources/user-guide/upgrade-guides.md.txt b/_sources/user-guide/upgrade-guides.md.txt index 360e053..29085bc 100644 --- a/_sources/user-guide/upgrade-guides.md.txt +++ b/_sources/user-guide/upgrade-guides.md.txt
@@ -19,6 +19,128 @@ # Upgrade Guides +## DataFusion 55.0.0 + +This release extends the change made in 52.0.0 to the remaining {ref}`ffi` hook +methods. Users who contribute their own `LogicalExtensionCodec` or +`PhysicalExtensionCodec` via FFI must update +`__datafusion_logical_extension_codec__` and +`__datafusion_physical_extension_codec__` to accept an additional +`session: Bound<PyAny>` parameter, and take the `TaskContextProvider` from that +session rather than constructing a `SessionContext` of their own. + +Before: + +```rust +fn __datafusion_physical_extension_codec__<'py>( + &self, + py: Python<'py>, +) -> PyResult<Bound<'py, PyCapsule>> { + let ctx_provider: Arc<dyn TaskContextProvider> = Arc::clone(&self.ctx_provider); + let ffi = FFI_PhysicalExtensionCodec::new(inner, Some(runtime), &ctx_provider); + PyCapsule::new_with_value(py, ffi, cr"datafusion_physical_extension_codec") +} +``` + +After: + +```rust +fn __datafusion_physical_extension_codec__<'py>( + &self, + py: Python<'py>, + session: Bound<'py, PyAny>, +) -> PyResult<Bound<'py, PyCapsule>> { + let ctx_provider = ffi_task_context_provider_from_pycapsule(&session)?; + let ffi = FFI_PhysicalExtensionCodec::new(inner, Some(runtime), ctx_provider); + PyCapsule::new_with_value(py, ffi, cr"datafusion_physical_extension_codec") +} +``` + +The dropped `&` on the last argument is not a typo. That parameter is +`impl Into<FFI_TaskContextProvider>`, so it accepts either an +`&Arc<dyn TaskContextProvider>`, as before, or an `FFI_TaskContextProvider`, +which is what `ffi_task_context_provider_from_pycapsule` hands back. Both forms +compile; the argument changes because the provider now comes from the session +rather than from a field. + +A codec that keeps its own `SessionContext` still compiles, but its decode +callbacks resolve names against that empty session instead of the one running +the query, so a function registered with `SessionContext.register_udf` is not +visible to it. Taking the provider from `session` also removes a lifetime +hazard: `FFI_TaskContextProvider` holds its provider weakly, so a context +constructed inside the getter is already dropped by the time the capsule is +used. + +`SessionContext` accepts the argument on its own capsule getters and ignores +it, so existing calls such as `ctx.__datafusion_logical_extension_codec__()` +continue to work unchanged. + +New in this release, `__datafusion_query_planner__` follows the same protocol. +It receives the session and takes both extension codecs from it, so a planner +library never builds a `TaskContextProvider` at all. Install one with +`SessionContext.set_query_planner(planner)`, which mutates the session the same +way `add_physical_optimizer_rule` does and returns nothing — the query planner +lives in `SessionState`, so it belongs to the session rather than to a +particular handle on it. See the {ref}`ffi` guide for the full protocol. + +### Mismatched extension libraries now fail loudly + +Objects imported through the capsule protocol are checked against the major +version of `datafusion-ffi` this package was built with. A table provider, +extension codec, or query planner produced by a library built against a +different DataFusion major version now raises an `ImportError` naming the +version found and the one expected, instead of being used as-is. Table +providers previously performed no such check. + +This is a diagnostic rather than a soundness guarantee — reading the version +out of the struct already assumes the local field layout — but it turns the +common "extension library built against the wrong DataFusion" mistake into a +clear message rather than undefined behaviour on first use. + +`FFI_TaskContextProvider`, `FFI_TableProviderFactory`, and `FFI_ExtensionOptions` +carry no version field, so objects of those types cannot be checked. + +### Changes to the `datafusion-python-util` crate + +Extension libraries written in Rust usually depend on the +`datafusion-python-util` crate for the helpers that read these capsules. Two of +those helpers changed, because the getter they call now takes the session. + +`ffi_logical_codec_from_pycapsule` takes a second argument. Pass `Some(session)` +when importing an object from another library, so its getter receives the +session it is being installed on. Pass `None` when the object *is* a session and +you are asking it for what it holds: + +```rust +// Before +let codec = ffi_logical_codec_from_pycapsule(obj)?; + +// After +let codec = ffi_logical_codec_from_pycapsule(obj, Some(session))?; +``` + +`physical_codec_from_pycapsule` has been **removed**. It called +`__datafusion_physical_extension_codec__` with no arguments, which no longer +matches the protocol, so against an updated codec it raised a bare `TypeError` +and against an outdated one it silently produced a codec bound to the wrong +session. Use `ffi_physical_codec_from_pycapsule`, which passes the session: + +```rust +// Before +let codec: Arc<dyn PhysicalExtensionCodec> = physical_codec_from_pycapsule(&obj)?; + +// After +let ffi = ffi_physical_codec_from_pycapsule(obj, Some(session))?; +let codec: Arc<dyn PhysicalExtensionCodec> = (&ffi).into(); +``` + +`physical_optimizer_rule_from_pycapsule` and `task_context_from_pycapsule` are +unchanged. Their hooks take no session. + +Calling a getter that still has the old signature now raises an `ImportError` +naming the method, with the original `TypeError` retained as its `__cause__`, +rather than a bare `TypeError`. + ## DataFusion 54.0.0 The `Config` class has been removed. It was a standalone wrapper around
diff --git a/autoapi/datafusion/context/index.html b/autoapi/datafusion/context/index.html index 343133f..79fb2d2 100644 --- a/autoapi/datafusion/context/index.html +++ b/autoapi/datafusion/context/index.html
@@ -528,19 +528,22 @@ <tr class="row-odd"><td><p><a class="reference internal" href="#datafusion.context.PhysicalOptimizerRuleExportable" title="datafusion.context.PhysicalOptimizerRuleExportable"><code class="xref py py-obj docutils literal notranslate"><span class="pre">PhysicalOptimizerRuleExportable</span></code></a></p></td> <td><p>Type hint for object that has __datafusion_physical_optimizer_rule__ PyCapsule.</p></td> </tr> -<tr class="row-even"><td><p><a class="reference internal" href="#datafusion.context.RuntimeEnvBuilder" title="datafusion.context.RuntimeEnvBuilder"><code class="xref py py-obj docutils literal notranslate"><span class="pre">RuntimeEnvBuilder</span></code></a></p></td> +<tr class="row-even"><td><p><a class="reference internal" href="#datafusion.context.QueryPlannerExportable" title="datafusion.context.QueryPlannerExportable"><code class="xref py py-obj docutils literal notranslate"><span class="pre">QueryPlannerExportable</span></code></a></p></td> +<td><p>Type hint for object that has a __datafusion_query_planner__ PyCapsule.</p></td> +</tr> +<tr class="row-odd"><td><p><a class="reference internal" href="#datafusion.context.RuntimeEnvBuilder" title="datafusion.context.RuntimeEnvBuilder"><code class="xref py py-obj docutils literal notranslate"><span class="pre">RuntimeEnvBuilder</span></code></a></p></td> <td><p>Runtime configuration options.</p></td> </tr> -<tr class="row-odd"><td><p><a class="reference internal" href="#datafusion.context.SQLOptions" title="datafusion.context.SQLOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">SQLOptions</span></code></a></p></td> +<tr class="row-even"><td><p><a class="reference internal" href="#datafusion.context.SQLOptions" title="datafusion.context.SQLOptions"><code class="xref py py-obj docutils literal notranslate"><span class="pre">SQLOptions</span></code></a></p></td> <td><p>Options to be used when performing SQL queries.</p></td> </tr> -<tr class="row-even"><td><p><a class="reference internal" href="#datafusion.context.SessionConfig" title="datafusion.context.SessionConfig"><code class="xref py py-obj docutils literal notranslate"><span class="pre">SessionConfig</span></code></a></p></td> +<tr class="row-odd"><td><p><a class="reference internal" href="#datafusion.context.SessionConfig" title="datafusion.context.SessionConfig"><code class="xref py py-obj docutils literal notranslate"><span class="pre">SessionConfig</span></code></a></p></td> <td><p>Session configuration options.</p></td> </tr> -<tr class="row-odd"><td><p><a class="reference internal" href="#datafusion.context.SessionContext" title="datafusion.context.SessionContext"><code class="xref py py-obj docutils literal notranslate"><span class="pre">SessionContext</span></code></a></p></td> +<tr class="row-even"><td><p><a class="reference internal" href="#datafusion.context.SessionContext" title="datafusion.context.SessionContext"><code class="xref py py-obj docutils literal notranslate"><span class="pre">SessionContext</span></code></a></p></td> <td><p>This is the main interface for executing queries and creating DataFrames.</p></td> </tr> -<tr class="row-even"><td><p><a class="reference internal" href="#datafusion.context.TableProviderExportable" title="datafusion.context.TableProviderExportable"><code class="xref py py-obj docutils literal notranslate"><span class="pre">TableProviderExportable</span></code></a></p></td> +<tr class="row-odd"><td><p><a class="reference internal" href="#datafusion.context.TableProviderExportable" title="datafusion.context.TableProviderExportable"><code class="xref py py-obj docutils literal notranslate"><span class="pre">TableProviderExportable</span></code></a></p></td> <td><p>Type hint for object that has __datafusion_table_provider__ PyCapsule.</p></td> </tr> </tbody> @@ -590,6 +593,22 @@ </dd></dl> <dl class="py class"> +<dt class="sig sig-object py" id="datafusion.context.QueryPlannerExportable"> +<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">datafusion.context.</span></span><span class="sig-name descname"><span class="pre">QueryPlannerExportable</span></span><a class="headerlink" href="#datafusion.context.QueryPlannerExportable" title="Link to this definition">#</a></dt> +<dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">Protocol</span></code></p> +<p>Type hint for object that has a __datafusion_query_planner__ PyCapsule.</p> +<p>The method returns a PyCapsule wrapping an <code class="docutils literal notranslate"><span class="pre">FFI_QueryPlanner</span></code>, typically +produced by a separate compiled extension. <code class="docutils literal notranslate"><span class="pre">session</span></code> is the +<a class="reference internal" href="#datafusion.context.SessionContext" title="datafusion.context.SessionContext"><code class="xref py py-class docutils literal notranslate"><span class="pre">SessionContext</span></code></a> the planner is being installed on; take the +extension codecs from it rather than building your own.</p> +<dl class="py method"> +<dt class="sig sig-object py" id="datafusion.context.QueryPlannerExportable.__datafusion_query_planner__"> +<span class="sig-name descname"><span class="pre">__datafusion_query_planner__</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Any</span></span></em><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><span class="pre">object</span></span></span><a class="headerlink" href="#datafusion.context.QueryPlannerExportable.__datafusion_query_planner__" title="Link to this definition">#</a></dt> +<dd></dd></dl> + +</dd></dl> + +<dl class="py class"> <dt class="sig sig-object py" id="datafusion.context.RuntimeEnvBuilder"> <em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">datafusion.context.</span></span><span class="sig-name descname"><span class="pre">RuntimeEnvBuilder</span></span><a class="headerlink" href="#datafusion.context.RuntimeEnvBuilder" title="Link to this definition">#</a></dt> <dd><p>Runtime configuration options.</p> @@ -1047,14 +1066,26 @@ </div> <dl class="py method"> <dt class="sig sig-object py" id="datafusion.context.SessionContext.__datafusion_logical_extension_codec__"> -<span class="sig-name descname"><span class="pre">__datafusion_logical_extension_codec__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><span class="pre">Any</span></span></span><a class="headerlink" href="#datafusion.context.SessionContext.__datafusion_logical_extension_codec__" title="Link to this definition">#</a></dt> +<span class="sig-name descname"><span class="pre">__datafusion_logical_extension_codec__</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Any</span></span><span class="w"> </span><span class="o"><span class="pre">=</span></span><span class="w"> </span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><span class="pre">Any</span></span></span><a class="headerlink" href="#datafusion.context.SessionContext.__datafusion_logical_extension_codec__" title="Link to this definition">#</a></dt> <dd><p>Access the PyCapsule FFI_LogicalExtensionCodec.</p> +<p><code class="docutils literal notranslate"><span class="pre">session</span></code> is accepted so a context satisfies the same protocol an +extension library implements, where the argument is how the library +reaches the session it is being installed on. A context already is one, +so the argument is ignored.</p> </dd></dl> <dl class="py method"> <dt class="sig sig-object py" id="datafusion.context.SessionContext.__datafusion_physical_extension_codec__"> -<span class="sig-name descname"><span class="pre">__datafusion_physical_extension_codec__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><span class="pre">Any</span></span></span><a class="headerlink" href="#datafusion.context.SessionContext.__datafusion_physical_extension_codec__" title="Link to this definition">#</a></dt> +<span class="sig-name descname"><span class="pre">__datafusion_physical_extension_codec__</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Any</span></span><span class="w"> </span><span class="o"><span class="pre">=</span></span><span class="w"> </span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><span class="pre">Any</span></span></span><a class="headerlink" href="#datafusion.context.SessionContext.__datafusion_physical_extension_codec__" title="Link to this definition">#</a></dt> <dd><p>Access the PyCapsule FFI_PhysicalExtensionCodec.</p> +<p>See <a class="reference internal" href="#datafusion.context.SessionContext.__datafusion_logical_extension_codec__" title="datafusion.context.SessionContext.__datafusion_logical_extension_codec__"><code class="xref py py-meth docutils literal notranslate"><span class="pre">__datafusion_logical_extension_codec__()</span></code></a> for <code class="docutils literal notranslate"><span class="pre">session</span></code>.</p> +</dd></dl> + +<dl class="py method"> +<dt class="sig sig-object py" id="datafusion.context.SessionContext.__datafusion_query_planner__"> +<span class="sig-name descname"><span class="pre">__datafusion_query_planner__</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Any</span></span><span class="w"> </span><span class="o"><span class="pre">=</span></span><span class="w"> </span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><span class="pre">Any</span></span></span><a class="headerlink" href="#datafusion.context.SessionContext.__datafusion_query_planner__" title="Link to this definition">#</a></dt> +<dd><p>Access the <code class="docutils literal notranslate"><span class="pre">FFI_QueryPlanner</span></code> PyCapsule for the current planner.</p> +<p>See <a class="reference internal" href="#datafusion.context.SessionContext.__datafusion_logical_extension_codec__" title="datafusion.context.SessionContext.__datafusion_logical_extension_codec__"><code class="xref py py-meth docutils literal notranslate"><span class="pre">__datafusion_logical_extension_codec__()</span></code></a> for <code class="docutils literal notranslate"><span class="pre">session</span></code>.</p> </dd></dl> <dl class="py method"> @@ -2216,6 +2247,52 @@ </dd></dl> <dl class="py method"> +<dt class="sig sig-object py" id="datafusion.context.SessionContext.set_query_planner"> +<span class="sig-name descname"><span class="pre">set_query_planner</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">planner</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><a class="reference internal" href="#datafusion.context.QueryPlannerExportable" title="datafusion.context.QueryPlannerExportable"><span class="pre">QueryPlannerExportable</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </span><span class="pre">_typeshed.CapsuleType</span></span></em><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><span class="pre">None</span></span></span><a class="headerlink" href="#datafusion.context.SessionContext.set_query_planner" title="Link to this definition">#</a></dt> +<dd><p>Install a custom query planner on this session.</p> +<p>The planner is imported through its <code class="docutils literal notranslate"><span class="pre">__datafusion_query_planner__</span></code> +PyCapsule and installed on this context, in the same way +<a class="reference internal" href="#datafusion.context.SessionContext.add_physical_optimizer_rule" title="datafusion.context.SessionContext.add_physical_optimizer_rule"><code class="xref py py-meth docutils literal notranslate"><span class="pre">add_physical_optimizer_rule()</span></code></a> installs a rule. +The query planner is part of the session state, so it applies to this +context and to every context sharing its session — including ones +already returned by +<a class="reference internal" href="#datafusion.context.SessionContext.with_logical_extension_codec" title="datafusion.context.SessionContext.with_logical_extension_codec"><code class="xref py py-meth docutils literal notranslate"><span class="pre">with_logical_extension_codec()</span></code></a> and friends.</p> +<p>A session holds exactly one planner, so calling this again replaces the +previous one rather than layering. To chain planners, have the new +planner wrap the capsule from +<a class="reference internal" href="#datafusion.context.SessionContext.__datafusion_query_planner__" title="datafusion.context.SessionContext.__datafusion_query_planner__"><code class="xref py py-meth docutils literal notranslate"><span class="pre">__datafusion_query_planner__()</span></code></a>, captured +<em>before</em> the new planner is installed.</p> +<p>Install any extension codecs before a layered planner. Installing a +codec afterwards rebuilds the installed planner against it, but not the +fallback inside it, which keeps the codecs it was imported with. Note +also that the planner is built against the codecs of the context this +method is called on, so installing the same planner again on a different +handle rebinds the session’s planner to <em>that</em> handle’s codecs.</p> +<dl class="field-list simple"> +<dt class="field-odd">Parameters<span class="colon">:</span></dt> +<dd class="field-odd"><p><strong>planner</strong> – Object exposing <code class="docutils literal notranslate"><span class="pre">__datafusion_query_planner__</span></code> (see +<a class="reference internal" href="#datafusion.context.QueryPlannerExportable" title="datafusion.context.QueryPlannerExportable"><code class="xref py py-class docutils literal notranslate"><span class="pre">QueryPlannerExportable</span></code></a>) or a raw +<code class="docutils literal notranslate"><span class="pre">datafusion_query_planner</span></code> PyCapsule.</p> +</dd> +</dl> +<p class="rubric">Examples</p> +<div class="doctest highlight-default notranslate"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="kn">from</span><span class="w"> </span><span class="nn">my_extension</span><span class="w"> </span><span class="kn">import</span> <span class="n">DistributedQueryPlanner</span> +<span class="gp">>>> </span><span class="n">ctx</span> <span class="o">=</span> <span class="n">SessionContext</span><span class="p">()</span> +<span class="gp">>>> </span><span class="n">ctx</span><span class="o">.</span><span class="n">set_query_planner</span><span class="p">(</span><span class="n">DistributedQueryPlanner</span><span class="p">())</span> +<span class="gp">>>> </span><span class="n">ctx</span><span class="o">.</span><span class="n">sql</span><span class="p">(</span><span class="s2">"SELECT * FROM remote_table"</span><span class="p">)</span><span class="o">.</span><span class="n">collect</span><span class="p">()</span> +</pre></div> +</div> +<p>Layer a planner on top of the one already installed by capturing +the existing planner first:</p> +<div class="doctest highlight-default notranslate"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="n">fallback</span> <span class="o">=</span> <span class="n">ctx</span><span class="o">.</span><span class="n">__datafusion_query_planner__</span><span class="p">()</span> +<span class="gp">>>> </span><span class="n">ctx</span><span class="o">.</span><span class="n">set_query_planner</span><span class="p">(</span> +<span class="gp">... </span> <span class="n">DistributedQueryPlanner</span><span class="p">(</span><span class="n">fallback</span><span class="o">=</span><span class="n">fallback</span><span class="p">)</span> +<span class="gp">... </span><span class="p">)</span> +</pre></div> +</div> +</dd></dl> + +<dl class="py method"> <dt class="sig sig-object py" id="datafusion.context.SessionContext.sql"> <span class="sig-name descname"><span class="pre">sql</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">query</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">str</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">options</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><a class="reference internal" href="#datafusion.context.SQLOptions" title="datafusion.context.SQLOptions"><span class="pre">SQLOptions</span></a><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </span><span class="pre">None</span></span><span class="w"> </span><span class="o"><span class="pre">=</span></span><span class="w"> </span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">param_values</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">dict</span><span class="p"><span class="pre">[</span></span><span class="pre">str</span><span class="p"><span class="pre">,</span></span><span class="w"> </span><span class="pre">Any</span><span class="p"><span class="pre">]</span></span><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </span><span class="pre">None</span></span><span class="w"> </span><span class="o"><span class="pre">=</span></span><span class="w"> </span><span class="default_value"><span class="pre">None</span></span></em>, <em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">named_params</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Any</span></span></em><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><a class="reference internal" href="../dataframe/index.html#datafusion.dataframe.DataFrame" title="datafusion.dataframe.DataFrame"><span class="pre">datafusion.dataframe.DataFrame</span></a></span></span><a class="headerlink" href="#datafusion.context.SessionContext.sql" title="Link to this definition">#</a></dt> <dd><p>Create a <code class="xref py py-class docutils literal notranslate"><span class="pre">DataFrame</span></code> from SQL query text.</p> @@ -2452,6 +2529,12 @@ <p>Only FFI codecs are supported. Pass any object implementing <code class="docutils literal notranslate"><span class="pre">__datafusion_logical_extension_codec__</span></code> (see <a class="reference internal" href="../user_defined/index.html#datafusion.user_defined.LogicalExtensionCodecExportable" title="datafusion.user_defined.LogicalExtensionCodecExportable"><code class="xref py py-class docutils literal notranslate"><span class="pre">LogicalExtensionCodecExportable</span></code></a>).</p> +<p>The returned context shares its session state with the original, so a +later registration on either is visible to both. If a custom query +planner is installed, it is rebuilt against the new codec on the shared +session, so the original context plans with the new codec too. This +happens on the shared session, so it takes effect even if the returned +context is discarded.</p> </dd></dl> <dl class="py method"> @@ -2461,6 +2544,12 @@ <p>Only FFI codecs are supported. Pass any object implementing <code class="docutils literal notranslate"><span class="pre">__datafusion_physical_extension_codec__</span></code> (see <a class="reference internal" href="../user_defined/index.html#datafusion.user_defined.PhysicalExtensionCodecExportable" title="datafusion.user_defined.PhysicalExtensionCodecExportable"><code class="xref py py-class docutils literal notranslate"><span class="pre">PhysicalExtensionCodecExportable</span></code></a>).</p> +<p>The returned context shares its session state with the original, so a +later registration on either is visible to both. If a custom query +planner is installed, it is rebuilt against the new codec on the shared +session, so the original context plans with the new codec too. This +happens on the shared session, so it takes effect even if the returned +context is discarded.</p> </dd></dl> <dl class="py method"> @@ -2499,7 +2588,13 @@ regardless of the toggle.</p> </div> <p>Returns a new <a class="reference internal" href="#datafusion.context.SessionContext" title="datafusion.context.SessionContext"><code class="xref py py-class docutils literal notranslate"><span class="pre">SessionContext</span></code></a> with the toggle applied; -the original session is unchanged.</p> +the original context’s own codec settings are unchanged. The +returned context shares its session state with the original, so +a later registration on either is visible to both. If a custom +query planner is installed, it is rebuilt against the new codecs +on the shared session, so the original context plans with them +too. This happens on the shared session, so it takes effect even +if the returned context is discarded.</p> <p class="rubric">Examples</p> <div class="doctest highlight-default notranslate"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="kn">import</span><span class="w"> </span><span class="nn">pyarrow</span><span class="w"> </span><span class="k">as</span><span class="w"> </span><span class="nn">pa</span> <span class="gp">>>> </span><span class="kn">from</span><span class="w"> </span><span class="nn">datafusion</span><span class="w"> </span><span class="kn">import</span> <span class="n">SessionContext</span><span class="p">,</span> <span class="n">Expr</span><span class="p">,</span> <span class="n">col</span><span class="p">,</span> <span class="n">udf</span> @@ -2602,6 +2697,10 @@ <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.PhysicalOptimizerRuleExportable.__datafusion_physical_optimizer_rule__"><code class="docutils literal notranslate"><span class="pre">PhysicalOptimizerRuleExportable.__datafusion_physical_optimizer_rule__()</span></code></a></li> </ul> </li> +<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.QueryPlannerExportable"><code class="docutils literal notranslate"><span class="pre">QueryPlannerExportable</span></code></a><ul class="nav section-nav flex-column"> +<li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.QueryPlannerExportable.__datafusion_query_planner__"><code class="docutils literal notranslate"><span class="pre">QueryPlannerExportable.__datafusion_query_planner__()</span></code></a></li> +</ul> +</li> <li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.RuntimeEnvBuilder"><code class="docutils literal notranslate"><span class="pre">RuntimeEnvBuilder</span></code></a><ul class="nav section-nav flex-column"> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.RuntimeEnvBuilder.with_disk_manager_disabled"><code class="docutils literal notranslate"><span class="pre">RuntimeEnvBuilder.with_disk_manager_disabled()</span></code></a></li> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.RuntimeEnvBuilder.with_disk_manager_os"><code class="docutils literal notranslate"><span class="pre">RuntimeEnvBuilder.with_disk_manager_os()</span></code></a></li> @@ -2641,6 +2740,7 @@ <li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext"><code class="docutils literal notranslate"><span class="pre">SessionContext</span></code></a><ul class="nav section-nav flex-column"> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.__datafusion_logical_extension_codec__"><code class="docutils literal notranslate"><span class="pre">SessionContext.__datafusion_logical_extension_codec__()</span></code></a></li> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.__datafusion_physical_extension_codec__"><code class="docutils literal notranslate"><span class="pre">SessionContext.__datafusion_physical_extension_codec__()</span></code></a></li> +<li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.__datafusion_query_planner__"><code class="docutils literal notranslate"><span class="pre">SessionContext.__datafusion_query_planner__()</span></code></a></li> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.__datafusion_task_context_provider__"><code class="docutils literal notranslate"><span class="pre">SessionContext.__datafusion_task_context_provider__()</span></code></a></li> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.__repr__"><code class="docutils literal notranslate"><span class="pre">SessionContext.__repr__()</span></code></a></li> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext._convert_file_sort_order"><code class="docutils literal notranslate"><span class="pre">SessionContext._convert_file_sort_order()</span></code></a></li> @@ -2705,6 +2805,7 @@ <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.remove_optimizer_rule"><code class="docutils literal notranslate"><span class="pre">SessionContext.remove_optimizer_rule()</span></code></a></li> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.session_id"><code class="docutils literal notranslate"><span class="pre">SessionContext.session_id()</span></code></a></li> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.session_start_time"><code class="docutils literal notranslate"><span class="pre">SessionContext.session_start_time()</span></code></a></li> +<li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.set_query_planner"><code class="docutils literal notranslate"><span class="pre">SessionContext.set_query_planner()</span></code></a></li> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.sql"><code class="docutils literal notranslate"><span class="pre">SessionContext.sql()</span></code></a></li> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.sql_with_options"><code class="docutils literal notranslate"><span class="pre">SessionContext.sql_with_options()</span></code></a></li> <li class="toc-h4 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion.context.SessionContext.table"><code class="docutils literal notranslate"><span class="pre">SessionContext.table()</span></code></a></li>
diff --git a/autoapi/datafusion/user_defined/index.html b/autoapi/datafusion/user_defined/index.html index 2966d1d..ee7521e 100644 --- a/autoapi/datafusion/user_defined/index.html +++ b/autoapi/datafusion/user_defined/index.html
@@ -810,9 +810,13 @@ <em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">datafusion.user_defined.</span></span><span class="sig-name descname"><span class="pre">LogicalExtensionCodecExportable</span></span><a class="headerlink" href="#datafusion.user_defined.LogicalExtensionCodecExportable" title="Link to this definition">#</a></dt> <dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">Protocol</span></code></p> <p>Type hint for objects exposing <code class="docutils literal notranslate"><span class="pre">__datafusion_logical_extension_codec__</span></code>.</p> +<p><code class="docutils literal notranslate"><span class="pre">session</span></code> is the <a class="reference internal" href="../context/index.html#datafusion.context.SessionContext" title="datafusion.context.SessionContext"><code class="xref py py-class docutils literal notranslate"><span class="pre">SessionContext</span></code></a> the codec +is being installed on. Take the task context provider from it rather than +building a session of your own, so the decode callbacks resolve names +against the session that runs the query.</p> <dl class="py method"> <dt class="sig sig-object py" id="datafusion.user_defined.LogicalExtensionCodecExportable.__datafusion_logical_extension_codec__"> -<span class="sig-name descname"><span class="pre">__datafusion_logical_extension_codec__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><span class="pre">object</span></span></span><a class="headerlink" href="#datafusion.user_defined.LogicalExtensionCodecExportable.__datafusion_logical_extension_codec__" title="Link to this definition">#</a></dt> +<span class="sig-name descname"><span class="pre">__datafusion_logical_extension_codec__</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Any</span></span></em><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><span class="pre">object</span></span></span><a class="headerlink" href="#datafusion.user_defined.LogicalExtensionCodecExportable.__datafusion_logical_extension_codec__" title="Link to this definition">#</a></dt> <dd></dd></dl> </dd></dl> @@ -822,9 +826,10 @@ <em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">datafusion.user_defined.</span></span><span class="sig-name descname"><span class="pre">PhysicalExtensionCodecExportable</span></span><a class="headerlink" href="#datafusion.user_defined.PhysicalExtensionCodecExportable" title="Link to this definition">#</a></dt> <dd><p>Bases: <code class="xref py py-obj docutils literal notranslate"><span class="pre">Protocol</span></code></p> <p>Type hint for objects exposing <code class="docutils literal notranslate"><span class="pre">__datafusion_physical_extension_codec__</span></code>.</p> +<p>See <a class="reference internal" href="#datafusion.user_defined.LogicalExtensionCodecExportable" title="datafusion.user_defined.LogicalExtensionCodecExportable"><code class="xref py py-class docutils literal notranslate"><span class="pre">LogicalExtensionCodecExportable</span></code></a> for <code class="docutils literal notranslate"><span class="pre">session</span></code>.</p> <dl class="py method"> <dt class="sig sig-object py" id="datafusion.user_defined.PhysicalExtensionCodecExportable.__datafusion_physical_extension_codec__"> -<span class="sig-name descname"><span class="pre">__datafusion_physical_extension_codec__</span></span><span class="sig-paren">(</span><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><span class="pre">object</span></span></span><a class="headerlink" href="#datafusion.user_defined.PhysicalExtensionCodecExportable.__datafusion_physical_extension_codec__" title="Link to this definition">#</a></dt> +<span class="sig-name descname"><span class="pre">__datafusion_physical_extension_codec__</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">session</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Any</span></span></em><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">→</span> <span class="sig-return-typehint"><span class="pre">object</span></span></span><a class="headerlink" href="#datafusion.user_defined.PhysicalExtensionCodecExportable.__datafusion_physical_extension_codec__" title="Link to this definition">#</a></dt> <dd></dd></dl> </dd></dl>
diff --git a/contributor-guide/ffi.html b/contributor-guide/ffi.html index 25f7438..64369b0 100644 --- a/contributor-guide/ffi.html +++ b/contributor-guide/ffi.html
@@ -688,6 +688,182 @@ As we continue to expose more of the DataFusion features, we intend to follow this same design pattern.</p> </section> +<section id="query-planners-across-multiple-libraries"> +<h2>Query Planners Across Multiple Libraries<a class="headerlink" href="#query-planners-across-multiple-libraries" title="Link to this heading">#</a></h2> +<p>A query can involve three independent native libraries: <code class="docutils literal notranslate"><span class="pre">datafusion-python</span></code>, a library +that owns table providers or functions, and a library that owns the query planner. The +examples use two separate extension crates so each role has a distinct shared-library +identity:</p> +<ul class="simple"> +<li><p><a class="reference external" href="https://github.com/apache/datafusion-python/tree/main/examples/datafusion-ffi-example"><code class="docutils literal notranslate"><span class="pre">datafusion-ffi-example</span></code></a> owns providers, functions, and their codecs.</p></li> +<li><p><a class="reference external" href="https://github.com/apache/datafusion-python/tree/main/examples/datafusion-ffi-query-planner-example"><code class="docutils literal notranslate"><span class="pre">datafusion-ffi-query-planner-example</span></code></a> owns the planner and its configuration.</p></li> +</ul> +<p>The <code class="docutils literal notranslate"><span class="pre">SessionContext</span></code> owns the codecs used for the exchange and supplies them to the +foreign planner. This lets the planner decode provider-owned objects and lets +<code class="docutils literal notranslate"><span class="pre">datafusion-python</span></code> decode the physical plan returned by the planner. The examples use +process-local tokens to demonstrate ownership; production codecs should serialize +durable metadata instead.</p> +<p>The current Python API has one external logical codec and one external physical codec. +Installing another codec replaces the prior codec rather than composing a registry. +The example therefore has one external codec owner, and the planner uses built-in +physical nodes. Install the provider codecs before the planner where possible.</p> +<p>The current FFI logical codec supports providers and UDFs but not arbitrary custom +<code class="docutils literal notranslate"><span class="pre">LogicalPlan::Extension</span></code> nodes. See both example READMEs for the supported flow and +local build commands.</p> +<section id="capsule-getters-receive-the-session-they-are-installed-on"> +<h3>Capsule getters receive the session they are installed on<a class="headerlink" href="#capsule-getters-receive-the-session-they-are-installed-on" title="Link to this heading">#</a></h3> +<p><code class="docutils literal notranslate"><span class="pre">__datafusion_query_planner__</span></code>, <code class="docutils literal notranslate"><span class="pre">__datafusion_logical_extension_codec__</span></code>, and +<code class="docutils literal notranslate"><span class="pre">__datafusion_physical_extension_codec__</span></code> all take the <code class="docutils literal notranslate"><span class="pre">SessionContext</span></code> the object is +being installed on, the same way <code class="docutils literal notranslate"><span class="pre">__datafusion_table_provider__</span></code> does:</p> +<div class="highlight-rust notranslate"><div class="highlight"><pre><span></span><span class="k">fn</span><span class="w"> </span><span class="nf">__datafusion_physical_extension_codec__</span><span class="o"><'</span><span class="na">py</span><span class="o">></span><span class="p">(</span> +<span class="w"> </span><span class="o">&</span><span class="bp">self</span><span class="p">,</span> +<span class="w"> </span><span class="n">py</span><span class="p">:</span><span class="w"> </span><span class="nc">Python</span><span class="o"><'</span><span class="na">py</span><span class="o">></span><span class="p">,</span> +<span class="w"> </span><span class="n">session</span><span class="p">:</span><span class="w"> </span><span class="nc">Bound</span><span class="o"><'</span><span class="na">py</span><span class="p">,</span><span class="w"> </span><span class="n">PyAny</span><span class="o">></span><span class="p">,</span> +<span class="p">)</span><span class="w"> </span><span class="p">-></span><span class="w"> </span><span class="nc">PyResult</span><span class="o"><</span><span class="n">Bound</span><span class="o"><'</span><span class="na">py</span><span class="p">,</span><span class="w"> </span><span class="n">PyCapsule</span><span class="o">>></span><span class="w"> </span><span class="p">{</span> +<span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">runtime</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">get_tokio_runtime</span><span class="p">().</span><span class="n">handle</span><span class="p">().</span><span class="n">clone</span><span class="p">();</span> +<span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">ctx_provider</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">ffi_task_context_provider_from_pycapsule</span><span class="p">(</span><span class="o">&</span><span class="n">session</span><span class="p">)</span><span class="o">?</span><span class="p">;</span> +<span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">ffi</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">FFI_PhysicalExtensionCodec</span><span class="p">::</span><span class="n">new</span><span class="p">(</span><span class="n">inner</span><span class="p">,</span><span class="w"> </span><span class="nb">Some</span><span class="p">(</span><span class="n">runtime</span><span class="p">),</span><span class="w"> </span><span class="n">ctx_provider</span><span class="p">);</span> +<span class="w"> </span><span class="n">PyCapsule</span><span class="p">::</span><span class="n">new_with_value</span><span class="p">(</span><span class="n">py</span><span class="p">,</span><span class="w"> </span><span class="n">ffi</span><span class="p">,</span><span class="w"> </span><span class="n">cr</span><span class="s">"datafusion_physical_extension_codec"</span><span class="p">)</span> +<span class="p">}</span> +</pre></div> +</div> +<p>This exists because the FFI constructors need things an extension library does not +have. <code class="docutils literal notranslate"><span class="pre">FFI_{Logical,Physical}ExtensionCodec::new</span></code> needs a <code class="docutils literal notranslate"><span class="pre">TaskContextProvider</span></code> for the +decode callbacks the codec will receive, and <code class="docutils literal notranslate"><span class="pre">FFI_QueryPlanner::new</span></code> needs both codecs +on top of that. Taking them from the session is what keeps a library from constructing +a <code class="docutils literal notranslate"><span class="pre">SessionContext</span></code> purely to satisfy a parameter — an empty one resolves nothing, and +<code class="docutils literal notranslate"><span class="pre">FFI_TaskContextProvider</span></code> holds it weakly, so a context built inline in the getter is +already dropped by the time the capsule is used.</p> +<p>A planner uses <code class="docutils literal notranslate"><span class="pre">FFI_QueryPlanner::new_with_ffi_codecs</span></code> with the two codecs it takes off +the session, and never touches a provider directly. That also matches what installation +does anyway: <code class="docutils literal notranslate"><span class="pre">set_query_planner</span></code> builds the planner against the codecs of the session +that will run the query.</p> +<p><code class="docutils literal notranslate"><span class="pre">SessionContext</span></code> accepts the argument on all three getters and ignores it, so a session +satisfies the same protocol an extension library implements. When you export the current +planner to wrap it, <code class="docutils literal notranslate"><span class="pre">ctx.__datafusion_query_planner__()</span></code> and +<code class="docutils literal notranslate"><span class="pre">ctx.__datafusion_query_planner__(ctx)</span></code> are both fine.</p> +</section> +<section id="a-codec-decodes-against-the-session-that-is-running-the-query"> +<h3>A codec decodes against the session that is running the query<a class="headerlink" href="#a-codec-decodes-against-the-session-that-is-running-the-query" title="Link to this heading">#</a></h3> +<p>Because the provider comes from the host, a decode callback running inside an extension +library resolves names against the session running the query. A function registered with +<code class="docutils literal notranslate"><span class="pre">ctx.register_udf(...)</span></code> is visible to a foreign codec decoding a node that references it +by name, and the handle is live rather than a snapshot, so a registration made after the +codec is installed is visible too.</p> +<p>This is covered in +<code class="docutils literal notranslate"><span class="pre">examples/datafusion-ffi-query-planner-example/python/tests/_test_three_library_query_planner.py</span></code>, +where the example codecs take a <code class="docutils literal notranslate"><span class="pre">require_udf_on_decode</span></code> name and resolve it out of the +task context they are handed.</p> +</section> +<section id="one-session-one-arc-sessioncontext"> +<h3>One session, one <code class="docutils literal notranslate"><span class="pre">Arc<SessionContext></span></code><a class="headerlink" href="#one-session-one-arc-sessioncontext" title="Link to this heading">#</a></h3> +<p>Every codec handed to a foreign object carries an <code class="docutils literal notranslate"><span class="pre">FFI_TaskContextProvider</span></code>, and that +type holds its provider <strong>weakly</strong>. A registered catalog provider upgrades the handle on +every <code class="docutils literal notranslate"><span class="pre">supports_filters_pushdown</span></code> and every <code class="docutils literal notranslate"><span class="pre">scan</span></code>. Those handles are bound to one +particular <code class="docutils literal notranslate"><span class="pre">Arc<SessionContext></span></code> allocation, not to the logical session, so anything that +replaces the allocation orphans all of them and the next query fails with +<code class="docutils literal notranslate"><span class="pre">TaskContextProvider</span> <span class="pre">went</span> <span class="pre">out</span> <span class="pre">of</span> <span class="pre">scope</span> <span class="pre">over</span> <span class="pre">FFI</span> <span class="pre">boundary</span></code>.</p> +<p>So a <code class="docutils literal notranslate"><span class="pre">PySessionContext</span></code> keeps the <code class="docutils literal notranslate"><span class="pre">Arc<SessionContext></span></code> it was created with for its whole +life. Installing a query planner writes the new <code class="docutils literal notranslate"><span class="pre">SessionState</span></code> back through +<code class="docutils literal notranslate"><span class="pre">state_ref()</span></code>, exactly as <code class="docutils literal notranslate"><span class="pre">add_physical_optimizer_rule</span></code> does, rather than deriving a +replacement context. The session id is carried across that rewrite — <code class="docutils literal notranslate"><span class="pre">SessionStateBuilder</span></code> +mints a fresh one otherwise — so <code class="docutils literal notranslate"><span class="pre">session_id()</span></code> and every <code class="docutils literal notranslate"><span class="pre">TaskContext</span></code> the session hands +out keep agreeing.</p> +<p>Repairing the damage instead of avoiding it does not work in general. A context can +rebuild the codecs it holds in its own fields, but a codec already embedded in a +registered <code class="docutils literal notranslate"><span class="pre">FFI_CatalogProvider</span></code> — and in every <code class="docutils literal notranslate"><span class="pre">FFI_SchemaProvider</span></code> and +<code class="docutils literal notranslate"><span class="pre">FFI_TableProvider</span></code> minted from it — is not reachable from Python at all. Nor can the +codec simply retain the session that built it: a codec handed to a provider is routinely +registered straight back into that same session, which would close the cycle +<code class="docutils literal notranslate"><span class="pre">SessionContext</span> <span class="pre">-></span> <span class="pre">catalog</span> <span class="pre">-></span> <span class="pre">FFI</span> <span class="pre">provider</span> <span class="pre">-></span> <span class="pre">FFI</span> <span class="pre">codec</span> <span class="pre">-></span> <span class="pre">SessionContext</span></code> and leak it.</p> +<p><code class="docutils literal notranslate"><span class="pre">SessionContext.enable_url_table</span></code> is the one exception. It clones the underlying +<code class="docutils literal notranslate"><span class="pre">SessionContext</span></code>, so the returned context has an allocation of its own and must not +outlive the receiver.</p> +</section> +<section id="what-a-derived-context-shares"> +<h3>What a derived context shares<a class="headerlink" href="#what-a-derived-context-shares" title="Link to this heading">#</a></h3> +<p><code class="docutils literal notranslate"><span class="pre">with_logical_extension_codec</span></code>, <code class="docutils literal notranslate"><span class="pre">with_physical_extension_codec</span></code>, and +<code class="docutils literal notranslate"><span class="pre">with_python_udf_inlining</span></code> return a new <code class="docutils literal notranslate"><span class="pre">SessionContext</span></code> wrapping the <em>same</em> underlying +session. Only the Python-side codec settings differ; catalogs, tables, registered +functions, and configuration are the one shared session, so a registration on either +side is visible to both.</p> +<p><code class="docutils literal notranslate"><span class="pre">set_query_planner</span></code> does not return anything. The query planner lives in <code class="docutils literal notranslate"><span class="pre">SessionState</span></code>, +so it is a property of the session rather than of a handle on it, and installing one is +visible to every context sharing that session — including ones a <code class="docutils literal notranslate"><span class="pre">with_*</span></code> call returned +earlier. Installing a codec on a session that already has a foreign planner rebuilds +that planner against the new codec for the same reason: there is one planner, and it has +to carry the codecs currently in force. This happens on the shared session, so it takes +effect even if the returned context is discarded — <code class="docutils literal notranslate"><span class="pre">ctx.with_python_udf_inlining(...)</span></code> +whose result is thrown away still leaves the session’s planner carrying the codecs of +that discarded handle. A call that changes nothing is exempt: asking for the inlining +setting a context already has returns a handle without touching the session.</p> +<p>The rule that falls out of this is worth stating on its own, because it is the one thing +that surprises people:</p> +<blockquote> +<div><p>The session’s query planner carries the codecs of the handle that most recently +installed one. Every other path — <code class="docutils literal notranslate"><span class="pre">Expr.to_bytes(ctx)</span></code>, <code class="docutils literal notranslate"><span class="pre">ExecutionPlan.to_bytes(ctx)</span></code>, +registering a provider — uses the codecs of the handle you call it on.</p> +</div></blockquote> +<p>Those can be different handles, and then one session has two codecs in effect at once:</p> +<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="n">ctx</span> <span class="o">=</span> <span class="n">ctx</span><span class="o">.</span><span class="n">with_logical_extension_codec</span><span class="p">(</span><span class="n">codec_a</span><span class="p">)</span> +<span class="n">ctx</span><span class="o">.</span><span class="n">set_query_planner</span><span class="p">(</span><span class="n">planner</span><span class="p">)</span> +<span class="n">ctx</span><span class="o">.</span><span class="n">with_logical_extension_codec</span><span class="p">(</span><span class="n">codec_b</span><span class="p">)</span> <span class="c1"># discarded</span> + +<span class="n">Expr</span><span class="o">.</span><span class="n">to_bytes</span><span class="p">(</span><span class="n">expr</span><span class="p">,</span> <span class="n">ctx</span><span class="p">)</span> <span class="c1"># encodes with codec_a -- ctx's own field</span> +<span class="n">ctx</span><span class="o">.</span><span class="n">sql</span><span class="p">(</span><span class="o">...</span><span class="p">)</span><span class="o">.</span><span class="n">collect</span><span class="p">()</span> <span class="c1"># plans with codec_b -- installed via the discarded handle</span> +</pre></div> +</div> +<p>Chaining <code class="docutils literal notranslate"><span class="pre">ctx</span> <span class="pre">=</span> <span class="pre">ctx.with_...(...)</span></code>, as the example below does, keeps the two in step. +<code class="docutils literal notranslate"><span class="pre">test_the_planner_and_the_handle_can_hold_different_codecs</span></code> pins the divergence.</p> +<div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="n">ctx</span> <span class="o">=</span> <span class="n">SessionContext</span><span class="p">(</span><span class="n">config</span><span class="p">)</span> +<span class="n">ctx</span> <span class="o">=</span> <span class="n">ctx</span><span class="o">.</span><span class="n">with_logical_extension_codec</span><span class="p">(</span><span class="n">provider_logical_codec</span><span class="p">)</span> +<span class="n">ctx</span> <span class="o">=</span> <span class="n">ctx</span><span class="o">.</span><span class="n">with_physical_extension_codec</span><span class="p">(</span><span class="n">provider_physical_codec</span><span class="p">)</span> +<span class="n">ctx</span><span class="o">.</span><span class="n">set_query_planner</span><span class="p">(</span><span class="n">planner</span><span class="p">)</span> +<span class="n">ctx</span><span class="o">.</span><span class="n">register_udf</span><span class="p">(</span><span class="n">my_udf</span><span class="p">)</span> +</pre></div> +</div> +<p>Order is a readability preference rather than a requirement — installing a codec after a +planner rebuilds the planner against it.</p> +<p>A session holds exactly one query planner. Calling <code class="docutils literal notranslate"><span class="pre">set_query_planner</span></code> again replaces the +installed planner instead of layering another one. To chain planners, have the new +planner wrap the capsule returned by <code class="docutils literal notranslate"><span class="pre">SessionContext.__datafusion_query_planner__()</span></code>, +captured before the new planner is installed, and delegate to it explicitly.</p> +</section> +<section id="rebinding-a-planner-s-codecs-is-one-level-deep"> +<h3>Rebinding a planner’s codecs is one level deep<a class="headerlink" href="#rebinding-a-planner-s-codecs-is-one-level-deep" title="Link to this heading">#</a></h3> +<p>The rebuild above swaps the codecs on the installed <code class="docutils literal notranslate"><span class="pre">ForeignQueryPlanner</span></code> handle, and +only that handle. A planner that wraps a fallback resolved that fallback when <em>it</em> was +installed, and holds the result inside its own library’s private data — behind a +<code class="docutils literal notranslate"><span class="pre">create_physical_plan</span></code> function pointer, with no Python-side handle. A codec installed +afterwards therefore reaches the outer planner and not the fallback, which keeps +whichever codecs were in force when it was imported.</p> +<p>Neither side can repair that:</p> +<ul class="simple"> +<li><p><strong>The host cannot reach it.</strong> <code class="docutils literal notranslate"><span class="pre">FFI_QueryPlanner::new_with_ffi_codecs</span></code> unwraps exactly +one <code class="docutils literal notranslate"><span class="pre">ForeignQueryPlanner</span></code> layer. There is no deeper handle to unwrap — the same +situation as a codec embedded in a registered <code class="docutils literal notranslate"><span class="pre">FFI_CatalogProvider</span></code>.</p></li> +<li><p><strong>The planner library cannot re-derive it.</strong> <code class="docutils literal notranslate"><span class="pre">FFI_QueryPlanner</span></code> holds its codecs by +value, and <code class="docutils literal notranslate"><span class="pre">Session</span></code> exposes no accessor for the ones the host currently has, so +<code class="docutils literal notranslate"><span class="pre">create_physical_plan</span></code> cannot pick them up from the session it is handed. The rebuild +has to be eager, and an eager rebuild only sees the top layer.</p></li> +</ul> +<p>A fix has to come from upstream, and is tracked in +<a class="reference external" href="https://github.com/apache/datafusion/issues/24762">apache/datafusion#24762</a>.</p> +<p>The stale codecs stay usable rather than dangling — they hold weak handles to the one +<code class="docutils literal notranslate"><span class="pre">Arc<SessionContext></span></code> that Rule 6 keeps alive — so the effect is a fallback hop +serializing with an older codec, not a failure. It is also invisible to the examples +here, which use one fallback in the same cdylib as its wrapper; <code class="docutils literal notranslate"><span class="pre">datafusion-ffi</span></code> +short-circuits a same-library hop rather than serializing, so no codec runs. A fallback +in a <em>different</em> library would serialize, and would do it with the codecs it was +imported with.</p> +<p>So install the codecs before a layered planner. If a codec has to go in afterwards, +install the outer planner again <em>on the handle that holds the new codec</em> — that re-runs +its getter, which re-imports the fallback against that handle’s codecs. Re-installing on +the original handle rebinds the session’s planner back to the original handle’s codecs +instead, which is the trap +<code class="docutils literal notranslate"><span class="pre">test_reinstalling_a_planner_rebinds_the_session_to_that_handles_codecs</span></code> pins.</p> +</section> +</section> <section id="alternative-approach"> <h2>Alternative Approach<a class="headerlink" href="#alternative-approach" title="Link to this heading">#</a></h2> <p>Suppose you needed to expose some other features of DataFusion and you could not wait @@ -765,6 +941,14 @@ <li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#inspiration-from-arrow">Inspiration from Arrow</a></li> <li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#implementation-details">Implementation Details</a></li> <li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#pyo3-class-mutability-guidelines">PyO3 class mutability guidelines</a></li> +<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#query-planners-across-multiple-libraries">Query Planners Across Multiple Libraries</a><ul class="visible nav section-nav flex-column"> +<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#capsule-getters-receive-the-session-they-are-installed-on">Capsule getters receive the session they are installed on</a></li> +<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#a-codec-decodes-against-the-session-that-is-running-the-query">A codec decodes against the session that is running the query</a></li> +<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#one-session-one-arc-sessioncontext">One session, one <code class="docutils literal notranslate"><span class="pre">Arc<SessionContext></span></code></a></li> +<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#what-a-derived-context-shares">What a derived context shares</a></li> +<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#rebinding-a-planner-s-codecs-is-one-level-deep">Rebinding a planner’s codecs is one level deep</a></li> +</ul> +</li> <li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#alternative-approach">Alternative Approach</a></li> <li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#status-of-work">Status of Work</a></li> </ul>
diff --git a/contributor-guide/index.html b/contributor-guide/index.html index 647f16b..2b8009c 100644 --- a/contributor-guide/index.html +++ b/contributor-guide/index.html
@@ -517,6 +517,7 @@ <li class="toctree-l2"><a class="reference internal" href="ffi.html#inspiration-from-arrow">Inspiration from Arrow</a></li> <li class="toctree-l2"><a class="reference internal" href="ffi.html#implementation-details">Implementation Details</a></li> <li class="toctree-l2"><a class="reference internal" href="ffi.html#pyo3-class-mutability-guidelines">PyO3 class mutability guidelines</a></li> +<li class="toctree-l2"><a class="reference internal" href="ffi.html#query-planners-across-multiple-libraries">Query Planners Across Multiple Libraries</a></li> <li class="toctree-l2"><a class="reference internal" href="ffi.html#alternative-approach">Alternative Approach</a></li> <li class="toctree-l2"><a class="reference internal" href="ffi.html#status-of-work">Status of Work</a></li> </ul>
diff --git a/genindex.html b/genindex.html index b18b48d..709b96b 100644 --- a/genindex.html +++ b/genindex.html
@@ -566,6 +566,12 @@ </ul></li> <li><a href="autoapi/datafusion/context/index.html#datafusion.context.PhysicalOptimizerRuleExportable.__datafusion_physical_optimizer_rule__">__datafusion_physical_optimizer_rule__() (datafusion.context.PhysicalOptimizerRuleExportable method)</a> </li> + <li><a href="autoapi/datafusion/context/index.html#datafusion.context.QueryPlannerExportable.__datafusion_query_planner__">__datafusion_query_planner__() (datafusion.context.QueryPlannerExportable method)</a> + + <ul> + <li><a href="autoapi/datafusion/context/index.html#datafusion.context.SessionContext.__datafusion_query_planner__">(datafusion.context.SessionContext method)</a> +</li> + </ul></li> <li><a href="autoapi/datafusion/user_defined/index.html#datafusion.user_defined.ScalarUDFExportable.__datafusion_scalar_udf__">__datafusion_scalar_udf__() (datafusion.user_defined.ScalarUDFExportable method)</a> </li> <li><a href="autoapi/datafusion/context/index.html#datafusion.context.TableProviderExportable.__datafusion_table_provider__">__datafusion_table_provider__() (datafusion.context.TableProviderExportable method)</a> @@ -3357,6 +3363,8 @@ <td style="width: 33%; vertical-align: top;"><ul> <li><a href="autoapi/datafusion/functions/index.html#datafusion.functions.quantile_cont">quantile_cont() (in module datafusion.functions)</a> </li> + <li><a href="autoapi/datafusion/context/index.html#datafusion.context.QueryPlannerExportable">QueryPlannerExportable (class in datafusion.context)</a> +</li> </ul></td> <td style="width: 33%; vertical-align: top;"><ul> <li><a href="autoapi/datafusion/index.html#datafusion.CsvReadOptions.quote">quote (datafusion.CsvReadOptions attribute)</a> @@ -3735,6 +3743,8 @@ <li><a href="autoapi/datafusion/dataframe_formatter/index.html#datafusion.dataframe_formatter.set_formatter">(in module datafusion.dataframe_formatter)</a> </li> </ul></li> + <li><a href="autoapi/datafusion/context/index.html#datafusion.context.SessionContext.set_query_planner">set_query_planner() (datafusion.context.SessionContext method)</a> +</li> <li><a href="autoapi/datafusion/ipc/index.html#datafusion.ipc.set_sender_ctx">set_sender_ctx() (in module datafusion.ipc)</a> </li> <li><a href="autoapi/datafusion/ipc/index.html#datafusion.ipc.set_worker_ctx">set_worker_ctx() (in module datafusion.ipc)</a>
diff --git a/objects.inv b/objects.inv index a7683f2..0bc25d7 100644 --- a/objects.inv +++ b/objects.inv Binary files differ
diff --git a/searchindex.js b/searchindex.js index a9a2d6f..ef25015 100644 --- a/searchindex.js +++ b/searchindex.js
@@ -1 +1 @@ -Search.setIndex({"alltitles": {"API Reference": [[20, null], [41, "api-reference"]], "Accessing the Calling Session": [[36, "accessing-the-calling-session"]], "Additional Resources": [[43, "additional-resources"]], "Aggregate Functions": [[28, "aggregate-functions"], [36, "aggregate-functions"], [38, "aggregate-functions"]], "Aggregated vs Per-Partition Metrics": [[41, "aggregated-vs-per-partition-metrics"]], "Aggregation": [[28, null]], "Alternative Approach": [[21, "alternative-approach"]], "Apache Iceberg": [[40, "apache-iceberg"]], "Arrays": [[30, "arrays"]], "Arrow": [[47, null]], "Attributes": [[4, "attributes"], [5, "attributes"], [7, "attributes"], [13, "attributes"], [19, "attributes"]], "Available Functions": [[38, "available-functions"]], "Available Metrics": [[41, "available-metrics"]], "Avro": [[48, null]], "Basic Operations": [[29, null]], "Basic Rendering": [[43, "basic-rendering"]], "Basic worker-pool example": [[44, "basic-worker-pool-example"]], "Benchmark Example": [[39, "benchmark-example"]], "Best Practices": [[43, "best-practices"]], "Boolean": [[30, "boolean"]], "Built-in Functions": [[42, "built-in-functions"]], "CSV": [[49, null]], "Casting": [[31, "casting"]], "Catalog": [[40, "catalog"]], "Classes": [[0, "classes"], [1, "classes"], [2, "classes"], [3, "classes"], [4, "classes"], [7, "classes"], [8, "classes"], [9, "classes"], [10, "classes"], [14, "classes"], [15, "classes"], [16, "classes"], [17, "classes"], [18, "classes"], [19, "classes"]], "Column": [[30, "column"]], "Column Names as Function Arguments": [[42, "column-names-as-function-arguments"]], "Column Selections": [[34, null]], "Common DataFrame Operations": [[42, "common-dataframe-operations"]], "Common Operations": [[32, null]], "Comparing subsets within a group": [[28, "comparing-subsets-within-a-group"]], "Concepts": [[27, null]], "Conditional": [[31, "conditional"]], "Conditional expressions": [[30, "conditional-expressions"]], "Configuration": [[39, null]], "Configuring the Formatter": [[43, "configuring-the-formatter"]], "Contributor Guide": [[22, null]], "Core Classes": [[42, "core-classes"]], "Core abstractions": [[7, "core-abstractions"]], "Create in-memory": [[40, "create-in-memory"]], "Creating DataFrames": [[42, "creating-dataframes"]], "Cube": [[28, "cube"]], "Custom Cell Formatters": [[43, "custom-cell-formatters"]], "Custom Cell and Header Builders": [[43, "custom-cell-and-header-builders"]], "Custom Style Providers": [[43, "custom-style-providers"]], "Custom Table Provider": [[40, "custom-table-provider"], [53, null]], "Data Sources": [[40, null]], "DataFrame": [[27, "dataframe"]], "DataFrame API": [[35, "dataframe-api"]], "DataFrame Rendering": [[43, null]], "DataFrames": [[42, null]], "DataFusion 52.0.0": [[55, "datafusion-52-0-0"]], "DataFusion 53.0.0": [[55, "datafusion-53-0-0"]], "DataFusion 54.0.0": [[55, "datafusion-54-0-0"]], "DataFusion in Python": [[24, null]], "Delta Lake": [[40, "delta-lake"]], "Disabling Python UDF inlining": [[44, "disabling-python-udf-inlining"]], "Disambiguating Columns with DataFrame.col()": [[33, "disambiguating-columns-with-dataframe-col"]], "Distinct": [[28, "distinct"]], "Distributing work": [[44, null]], "Duplicate Keys": [[33, "duplicate-keys"]], "End-to-End Example": [[41, "end-to-end-example"]], "Example": [[24, "example"]], "Execute as Stream": [[42, "execute-as-stream"]], "Execution Metrics": [[41, null], [42, "execution-metrics"]], "Explicit Grouping Sets": [[28, "explicit-grouping-sets"]], "Exporting from DataFusion": [[47, "exporting-from-datafusion"]], "Expression Classes": [[42, "expression-classes"]], "Expression-level distribution": [[44, "expression-level-distribution"]], "Expressions": [[27, "expressions"], [30, null]], "FAQ": [[36, "faq"]], "Filter": [[28, "filter"]], "Full Join": [[33, "full-join"]], "Function Reference": [[35, "function-reference"]], "Functions": [[3, "functions"], [4, "functions"], [5, "functions"], [6, "functions"], [7, "functions"], [11, "functions"], [12, "functions"], [19, "functions"], [30, "functions"], [31, null]], "Grouping Sets": [[28, "grouping-sets"]], "Guidelines for Separating Python and Rust Code": [[23, "guidelines-for-separating-python-and-rust-code"]], "HTML Rendering": [[42, "html-rendering"]], "Handling Missing Values": [[31, "handling-missing-values"]], "How to develop": [[23, "how-to-develop"]], "IO": [[50, null]], "If you are an agent author": [[26, "if-you-are-an-agent-author"]], "Implementation Details": [[21, "implementation-details"]], "Important Considerations": [[39, "important-considerations"]], "Importing to DataFusion": [[47, "importing-to-datafusion"]], "Improving Build Speed": [[23, "improving-build-speed"]], "Inner Join": [[33, "inner-join"]], "Inspiration from Arrow": [[21, "inspiration-from-arrow"]], "Install": [[24, "install"]], "Installation": [[46, "installation"]], "Installing the skill": [[26, "installing-the-skill"]], "Introduction": [[23, null], [46, null]], "JSON": [[51, null]], "Joins": [[33, null]], "Labels": [[41, "labels"]], "Lambda functions": [[30, "lambda-functions"]], "Left Anti Join": [[33, "left-anti-join"]], "Left Join": [[33, "left-join"]], "Left Semi Join": [[33, "left-semi-join"]], "Links": [[25, null]], "Literal": [[30, "literal"]], "Local file": [[40, "local-file"]], "Mathematical": [[31, "mathematical"]], "Maximizing CPU Usage": [[39, "maximizing-cpu-usage"]], "Memory and Display Controls": [[43, "memory-and-display-controls"]], "Module Contents": [[0, "module-contents"], [1, "module-contents"], [2, "module-contents"], [3, "module-contents"], [4, "module-contents"], [6, "module-contents"], [8, "module-contents"], [10, "module-contents"], [11, "module-contents"], [12, "module-contents"], [13, "module-contents"], [14, "module-contents"], [15, "module-contents"], [16, "module-contents"], [17, "module-contents"], [18, "module-contents"], [19, "module-contents"]], "Null Treatment": [[28, "null-treatment"], [38, "null-treatment"]], "Object Store": [[40, "object-store"]], "Ordering": [[28, "ordering"], [38, "ordering"]], "Other": [[31, "other"]], "Other DataFrame Libraries": [[40, "other-dataframe-libraries"]], "Overview": [[41, "overview"], [42, "overview"]], "Package Contents": [[5, "package-contents"], [7, "package-contents"], [9, "package-contents"]], "Parameterized queries": [[54, "parameterized-queries"]], "Parquet": [[52, null]], "Partitions": [[38, "partitions"]], "Performance Optimization with Shared Styles": [[43, "performance-optimization-with-shared-styles"]], "Portability requirements for inline Python UDFs": [[44, "portability-requirements-for-inline-python-udfs"]], "Practical considerations": [[44, "practical-considerations"]], "PyArrow": [[42, "pyarrow"]], "PyO3 class mutability guidelines": [[21, "pyo3-class-mutability-guidelines"]], "Python 3.14 default change": [[44, "python-3-14-default-change"]], "Python Extensions": [[21, null]], "Query-level distribution via Apache Ballista": [[44, "query-level-distribution-via-apache-ballista"]], "Query-level distribution via datafusion-distributed": [[44, "query-level-distribution-via-datafusion-distributed"]], "Quick start": [[7, "quick-start"]], "Reading the Physical Plan Tree": [[41, "reading-the-physical-plan-tree"]], "Reference: session context slots": [[44, "reference-session-context-slots"]], "Registering Views": [[37, null]], "Registering shared UDFs on workers": [[44, "registering-shared-udfs-on-workers"]], "Returns:": [[4, "returns"], [4, "id1"], [7, "returns"], [7, "id1"]], "Rollup": [[28, "rollup"]], "Running & Installing pre-commit hooks": [[23, "running-installing-pre-commit-hooks"]], "SQL": [[35, "sql"], [54, null]], "Scalar Functions": [[36, "scalar-functions"]], "Security": [[44, "security"]], "See also": [[44, "see-also"]], "Session Context": [[27, "session-context"]], "Setting Parameters": [[28, "setting-parameters"], [38, "setting-parameters"]], "Spark-Compatible Functions": [[35, null]], "Status of Work": [[21, "status-of-work"]], "String": [[31, "string"]], "Structs": [[30, "structs"]], "Submodules": [[5, "submodules"], [7, "submodules"], [9, "submodules"]], "Table Functions": [[36, "table-functions"]], "Temporal": [[31, "temporal"]], "Terminal Operations": [[42, "terminal-operations"]], "Testing membership in a list": [[30, "testing-membership-in-a-list"]], "The FFI Approach": [[21, "the-ffi-approach"]], "The Primary Issue": [[21, "the-primary-issue"]], "UDWF options": [[36, "udwf-options"]], "Update Dependencies": [[23, "update-dependencies"]], "Upgrade Guides": [[55, null]], "User Defined Catalog and Schema": [[40, "user-defined-catalog-and-schema"]], "User Guide": [[45, null]], "User-Defined Aggregate Functions": [[28, "user-defined-aggregate-functions"]], "User-Defined Functions": [[36, null]], "User-Defined Window Functions": [[38, "user-defined-window-functions"]], "Using AI Coding Assistants": [[26, null]], "What is published": [[26, "what-is-published"]], "What the skill covers": [[26, "what-the-skill-covers"]], "What travels with the expression": [[44, "what-travels-with-the-expression"]], "When Are Metrics Available?": [[41, "when-are-metrics-available"]], "When not to use a UDF": [[36, "when-not-to-use-a-udf"]], "Why a Separate Namespace?": [[35, "why-a-separate-namespace"]], "Window Frame": [[38, "window-frame"]], "Window Functions": [[36, "window-functions"], [38, null]], "Working with the Formatter Directly": [[43, "working-with-the-formatter-directly"]], "Zero-copy streaming to Arrow-based Python libraries": [[42, "zero-copy-streaming-to-arrow-based-python-libraries"]], "datafusion": [[7, null]], "datafusion.catalog": [[0, null]], "datafusion.context": [[1, null]], "datafusion.dataframe": [[2, null]], "datafusion.dataframe_formatter": [[3, null]], "datafusion.expr": [[4, null]], "datafusion.functions": [[5, null]], "datafusion.functions.spark": [[6, null]], "datafusion.input": [[9, null]], "datafusion.input.base": [[8, null]], "datafusion.input.location": [[10, null]], "datafusion.io": [[11, null]], "datafusion.ipc": [[12, null]], "datafusion.object_store": [[13, null]], "datafusion.options": [[14, null]], "datafusion.plan": [[15, null]], "datafusion.record_batch": [[16, null]], "datafusion.substrait": [[17, null]], "datafusion.unparser": [[18, null]], "datafusion.user_defined": [[19, null]], "fill_null": [[31, "fill-null"]]}, "docnames": ["autoapi/datafusion/catalog/index", "autoapi/datafusion/context/index", "autoapi/datafusion/dataframe/index", "autoapi/datafusion/dataframe_formatter/index", "autoapi/datafusion/expr/index", "autoapi/datafusion/functions/index", "autoapi/datafusion/functions/spark/index", "autoapi/datafusion/index", "autoapi/datafusion/input/base/index", "autoapi/datafusion/input/index", "autoapi/datafusion/input/location/index", "autoapi/datafusion/io/index", "autoapi/datafusion/ipc/index", "autoapi/datafusion/object_store/index", "autoapi/datafusion/options/index", "autoapi/datafusion/plan/index", "autoapi/datafusion/record_batch/index", "autoapi/datafusion/substrait/index", "autoapi/datafusion/unparser/index", "autoapi/datafusion/user_defined/index", "autoapi/index", "contributor-guide/ffi", "contributor-guide/index", "contributor-guide/introduction", "index", "links", "user-guide/ai-coding-assistants", "user-guide/basics", "user-guide/common-operations/aggregations", "user-guide/common-operations/basic-info", "user-guide/common-operations/expressions", "user-guide/common-operations/functions", "user-guide/common-operations/index", "user-guide/common-operations/joins", "user-guide/common-operations/select-and-filter", "user-guide/common-operations/spark-functions", "user-guide/common-operations/udf-and-udfa", "user-guide/common-operations/views", "user-guide/common-operations/windows", "user-guide/configuration", "user-guide/data-sources", "user-guide/dataframe/execution-metrics", "user-guide/dataframe/index", "user-guide/dataframe/rendering", "user-guide/distributing-work", "user-guide/index", "user-guide/introduction", "user-guide/io/arrow", "user-guide/io/avro", "user-guide/io/csv", "user-guide/io/index", "user-guide/io/json", "user-guide/io/parquet", "user-guide/io/table_provider", "user-guide/sql", "user-guide/upgrade-guides"], "envversion": {"sphinx": 64, "sphinx.domains.c": 3, "sphinx.domains.changeset": 1, "sphinx.domains.citation": 1, "sphinx.domains.cpp": 9, "sphinx.domains.index": 1, "sphinx.domains.javascript": 3, "sphinx.domains.math": 2, "sphinx.domains.python": 4, "sphinx.domains.rst": 2, "sphinx.domains.std": 2}, "filenames": ["autoapi/datafusion/catalog/index.rst", "autoapi/datafusion/context/index.rst", "autoapi/datafusion/dataframe/index.rst", "autoapi/datafusion/dataframe_formatter/index.rst", "autoapi/datafusion/expr/index.rst", "autoapi/datafusion/functions/index.rst", "autoapi/datafusion/functions/spark/index.rst", "autoapi/datafusion/index.rst", "autoapi/datafusion/input/base/index.rst", "autoapi/datafusion/input/index.rst", "autoapi/datafusion/input/location/index.rst", "autoapi/datafusion/io/index.rst", "autoapi/datafusion/ipc/index.rst", "autoapi/datafusion/object_store/index.rst", "autoapi/datafusion/options/index.rst", "autoapi/datafusion/plan/index.rst", "autoapi/datafusion/record_batch/index.rst", "autoapi/datafusion/substrait/index.rst", "autoapi/datafusion/unparser/index.rst", "autoapi/datafusion/user_defined/index.rst", "autoapi/index.rst", "contributor-guide/ffi.md", "contributor-guide/index.md", "contributor-guide/introduction.md", "index.md", "links.md", "user-guide/ai-coding-assistants.md", "user-guide/basics.md", "user-guide/common-operations/aggregations.md", "user-guide/common-operations/basic-info.md", "user-guide/common-operations/expressions.md", "user-guide/common-operations/functions.md", "user-guide/common-operations/index.md", "user-guide/common-operations/joins.md", "user-guide/common-operations/select-and-filter.md", "user-guide/common-operations/spark-functions.md", "user-guide/common-operations/udf-and-udfa.md", "user-guide/common-operations/views.md", "user-guide/common-operations/windows.md", "user-guide/configuration.md", "user-guide/data-sources.md", "user-guide/dataframe/execution-metrics.md", "user-guide/dataframe/index.md", "user-guide/dataframe/rendering.md", "user-guide/distributing-work.md", "user-guide/index.md", "user-guide/introduction.md", "user-guide/io/arrow.md", "user-guide/io/avro.md", "user-guide/io/csv.md", "user-guide/io/index.md", "user-guide/io/json.md", "user-guide/io/parquet.md", "user-guide/io/table_provider.md", "user-guide/sql.md", "user-guide/upgrade-guides.md"], "indexentries": {"__add__() (datafusion.expr method)": [[7, "datafusion.Expr.__add__", false]], "__add__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__add__", false]], "__aiter__() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.__aiter__", false]], "__aiter__() (datafusion.record_batch.recordbatchstream method)": [[16, "datafusion.record_batch.RecordBatchStream.__aiter__", false]], "__aiter__() (datafusion.recordbatchstream method)": [[7, "datafusion.RecordBatchStream.__aiter__", false]], "__and__() (datafusion.expr method)": [[7, "datafusion.Expr.__and__", false]], "__and__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__and__", false]], "__anext__() (datafusion.record_batch.recordbatchstream method)": [[16, "datafusion.record_batch.RecordBatchStream.__anext__", false]], "__anext__() (datafusion.recordbatchstream method)": [[7, "datafusion.RecordBatchStream.__anext__", false]], "__arrow_c_array__() (datafusion.context.arrowarrayexportable method)": [[1, "datafusion.context.ArrowArrayExportable.__arrow_c_array__", false]], "__arrow_c_array__() (datafusion.record_batch.recordbatch method)": [[16, "datafusion.record_batch.RecordBatch.__arrow_c_array__", false]], "__arrow_c_array__() (datafusion.recordbatch method)": [[7, "datafusion.RecordBatch.__arrow_c_array__", false]], "__arrow_c_stream__() (datafusion.context.arrowstreamexportable method)": [[1, "datafusion.context.ArrowStreamExportable.__arrow_c_stream__", false]], "__arrow_c_stream__() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.__arrow_c_stream__", false]], "__call__() (datafusion.aggregateudf method)": [[7, "datafusion.AggregateUDF.__call__", false]], "__call__() (datafusion.dataframe_formatter.cellformatter method)": [[3, "datafusion.dataframe_formatter.CellFormatter.__call__", false]], "__call__() (datafusion.scalarudf method)": [[7, "datafusion.ScalarUDF.__call__", false]], "__call__() (datafusion.tablefunction method)": [[7, "datafusion.TableFunction.__call__", false]], "__call__() (datafusion.user_defined.aggregateudf method)": [[19, "datafusion.user_defined.AggregateUDF.__call__", false]], "__call__() (datafusion.user_defined.scalarudf method)": [[19, "datafusion.user_defined.ScalarUDF.__call__", false]], "__call__() (datafusion.user_defined.tablefunction method)": [[19, "datafusion.user_defined.TableFunction.__call__", false]], "__call__() (datafusion.user_defined.windowudf method)": [[19, "datafusion.user_defined.WindowUDF.__call__", false]], "__call__() (datafusion.windowudf method)": [[7, "datafusion.WindowUDF.__call__", false]], "__datafusion_aggregate_udf__() (datafusion.user_defined.aggregateudfexportable method)": [[19, "datafusion.user_defined.AggregateUDFExportable.__datafusion_aggregate_udf__", false]], "__datafusion_logical_extension_codec__() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.__datafusion_logical_extension_codec__", false]], "__datafusion_logical_extension_codec__() (datafusion.user_defined.logicalextensioncodecexportable method)": [[19, "datafusion.user_defined.LogicalExtensionCodecExportable.__datafusion_logical_extension_codec__", false]], "__datafusion_physical_extension_codec__() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.__datafusion_physical_extension_codec__", false]], "__datafusion_physical_extension_codec__() (datafusion.user_defined.physicalextensioncodecexportable method)": [[19, "datafusion.user_defined.PhysicalExtensionCodecExportable.__datafusion_physical_extension_codec__", false]], "__datafusion_physical_optimizer_rule__() (datafusion.context.physicaloptimizerruleexportable method)": [[1, "datafusion.context.PhysicalOptimizerRuleExportable.__datafusion_physical_optimizer_rule__", false]], "__datafusion_scalar_udf__() (datafusion.user_defined.scalarudfexportable method)": [[19, "datafusion.user_defined.ScalarUDFExportable.__datafusion_scalar_udf__", false]], "__datafusion_table_provider__() (datafusion.context.tableproviderexportable method)": [[1, "datafusion.context.TableProviderExportable.__datafusion_table_provider__", false]], "__datafusion_table_provider_factory__() (datafusion.tableproviderfactoryexportable method)": [[7, "datafusion.TableProviderFactoryExportable.__datafusion_table_provider_factory__", false]], "__datafusion_task_context_provider__() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.__datafusion_task_context_provider__", false]], "__datafusion_window_udf__() (datafusion.user_defined.windowudfexportable method)": [[19, "datafusion.user_defined.WindowUDFExportable.__datafusion_window_udf__", false]], "__eq__() (datafusion.expr method)": [[7, "datafusion.Expr.__eq__", false]], "__eq__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__eq__", false]], "__eq__() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.__eq__", false]], "__eq__() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.__eq__", false]], "__ge__() (datafusion.expr method)": [[7, "datafusion.Expr.__ge__", false]], "__ge__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__ge__", false]], "__getitem__() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.__getitem__", false]], "__getitem__() (datafusion.expr method)": [[7, "datafusion.Expr.__getitem__", false]], "__getitem__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__getitem__", false]], "__gt__() (datafusion.expr method)": [[7, "datafusion.Expr.__gt__", false]], "__gt__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__gt__", false]], "__invert__() (datafusion.expr method)": [[7, "datafusion.Expr.__invert__", false]], "__invert__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__invert__", false]], "__iter__() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.__iter__", false]], "__iter__() (datafusion.record_batch.recordbatchstream method)": [[16, "datafusion.record_batch.RecordBatchStream.__iter__", false]], "__iter__() (datafusion.recordbatchstream method)": [[7, "datafusion.RecordBatchStream.__iter__", false]], "__le__() (datafusion.expr method)": [[7, "datafusion.Expr.__le__", false]], "__le__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__le__", false]], "__lt__() (datafusion.expr method)": [[7, "datafusion.Expr.__lt__", false]], "__lt__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__lt__", false]], "__mod__() (datafusion.expr method)": [[7, "datafusion.Expr.__mod__", false]], "__mod__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__mod__", false]], "__mul__() (datafusion.expr method)": [[7, "datafusion.Expr.__mul__", false]], "__mul__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__mul__", false]], "__ne__() (datafusion.expr method)": [[7, "datafusion.Expr.__ne__", false]], "__ne__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__ne__", false]], "__next__() (datafusion.record_batch.recordbatchstream method)": [[16, "datafusion.record_batch.RecordBatchStream.__next__", false]], "__next__() (datafusion.recordbatchstream method)": [[7, "datafusion.RecordBatchStream.__next__", false]], "__or__() (datafusion.expr method)": [[7, "datafusion.Expr.__or__", false]], "__or__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__or__", false]], "__radd__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__radd__", false]], "__radd__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__radd__", false]], "__rand__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__rand__", false]], "__rand__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__rand__", false]], "__reduce__() (datafusion.expr method)": [[7, "datafusion.Expr.__reduce__", false]], "__reduce__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__reduce__", false]], "__repr__() (datafusion.aggregateudf method)": [[7, "datafusion.AggregateUDF.__repr__", false]], "__repr__() (datafusion.catalog method)": [[7, "datafusion.Catalog.__repr__", false]], "__repr__() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.__repr__", false]], "__repr__() (datafusion.catalog.cataloglist method)": [[0, "datafusion.catalog.CatalogList.__repr__", false]], "__repr__() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.__repr__", false]], "__repr__() (datafusion.catalog.table method)": [[0, "datafusion.catalog.Table.__repr__", false]], "__repr__() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.__repr__", false]], "__repr__() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.__repr__", false]], "__repr__() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.__repr__", false]], "__repr__() (datafusion.expr method)": [[7, "datafusion.Expr.__repr__", false]], "__repr__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__repr__", false]], "__repr__() (datafusion.expr.sortexpr method)": [[4, "datafusion.expr.SortExpr.__repr__", false]], "__repr__() (datafusion.expr.windowframe method)": [[4, "datafusion.expr.WindowFrame.__repr__", false]], "__repr__() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.__repr__", false]], "__repr__() (datafusion.metric method)": [[7, "datafusion.Metric.__repr__", false]], "__repr__() (datafusion.metricsset method)": [[7, "datafusion.MetricsSet.__repr__", false]], "__repr__() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.__repr__", false]], "__repr__() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.__repr__", false]], "__repr__() (datafusion.plan.metric method)": [[15, "datafusion.plan.Metric.__repr__", false]], "__repr__() (datafusion.plan.metricsset method)": [[15, "datafusion.plan.MetricsSet.__repr__", false]], "__repr__() (datafusion.scalarudf method)": [[7, "datafusion.ScalarUDF.__repr__", false]], "__repr__() (datafusion.table method)": [[7, "datafusion.Table.__repr__", false]], "__repr__() (datafusion.tablefunction method)": [[7, "datafusion.TableFunction.__repr__", false]], "__repr__() (datafusion.user_defined.aggregateudf method)": [[19, "datafusion.user_defined.AggregateUDF.__repr__", false]], "__repr__() (datafusion.user_defined.scalarudf method)": [[19, "datafusion.user_defined.ScalarUDF.__repr__", false]], "__repr__() (datafusion.user_defined.tablefunction method)": [[19, "datafusion.user_defined.TableFunction.__repr__", false]], "__repr__() (datafusion.user_defined.windowudf method)": [[19, "datafusion.user_defined.WindowUDF.__repr__", false]], "__repr__() (datafusion.windowframe method)": [[7, "datafusion.WindowFrame.__repr__", false]], "__repr__() (datafusion.windowudf method)": [[7, "datafusion.WindowUDF.__repr__", false]], "__richcmp__() (datafusion.expr method)": [[7, "datafusion.Expr.__richcmp__", false]], "__richcmp__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__richcmp__", false]], "__rmod__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__rmod__", false]], "__rmod__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__rmod__", false]], "__rmul__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__rmul__", false]], "__rmul__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__rmul__", false]], "__ror__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__ror__", false]], "__ror__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__ror__", false]], "__rsub__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__rsub__", false]], "__rsub__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__rsub__", false]], "__rtruediv__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__rtruediv__", false]], "__rtruediv__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__rtruediv__", false]], "__slots__ (datafusion.catalog.table attribute)": [[0, "datafusion.catalog.Table.__slots__", false]], "__slots__ (datafusion.table attribute)": [[7, "datafusion.Table.__slots__", false]], "__str__() (datafusion.user_defined.volatility method)": [[19, "datafusion.user_defined.Volatility.__str__", false]], "__sub__() (datafusion.expr method)": [[7, "datafusion.Expr.__sub__", false]], "__sub__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__sub__", false]], "__truediv__() (datafusion.expr method)": [[7, "datafusion.Expr.__truediv__", false]], "__truediv__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__truediv__", false]], "_build_expandable_cell() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_expandable_cell", false]], "_build_html_footer() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_html_footer", false]], "_build_html_header() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_html_header", false]], "_build_regular_cell() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_regular_cell", false]], "_build_table_body() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_table_body", false]], "_build_table_container_start() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_table_container_start", false]], "_build_table_header() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_table_header", false]], "_convert_file_sort_order() (datafusion.context.sessioncontext static method)": [[1, "datafusion.context.SessionContext._convert_file_sort_order", false]], "_convert_table_partition_cols() (datafusion.context.sessioncontext static method)": [[1, "datafusion.context.SessionContext._convert_table_partition_cols", false]], "_create_table_udf() (datafusion.tablefunction static method)": [[7, "datafusion.TableFunction._create_table_udf", false]], "_create_table_udf() (datafusion.user_defined.tablefunction static method)": [[19, "datafusion.user_defined.TableFunction._create_table_udf", false]], "_create_table_udf_decorator() (datafusion.tablefunction static method)": [[7, "datafusion.TableFunction._create_table_udf_decorator", false]], "_create_table_udf_decorator() (datafusion.user_defined.tablefunction static method)": [[19, "datafusion.user_defined.TableFunction._create_table_udf_decorator", false]], "_create_window_udf() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF._create_window_udf", false]], "_create_window_udf() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF._create_window_udf", false]], "_create_window_udf_decorator() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF._create_window_udf_decorator", false]], "_create_window_udf_decorator() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF._create_window_udf_decorator", false]], "_custom_cell_builder (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._custom_cell_builder", false]], "_custom_header_builder (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._custom_header_builder", false]], "_default_formatter (datafusion.dataframe_formatter.formattermanager attribute)": [[3, "datafusion.dataframe_formatter.FormatterManager._default_formatter", false]], "_format_cell_value() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._format_cell_value", false]], "_from_internal() (datafusion.aggregateudf class method)": [[7, "datafusion.AggregateUDF._from_internal", false]], "_from_internal() (datafusion.scalarudf class method)": [[7, "datafusion.ScalarUDF._from_internal", false]], "_from_internal() (datafusion.user_defined.aggregateudf class method)": [[19, "datafusion.user_defined.AggregateUDF._from_internal", false]], "_from_internal() (datafusion.user_defined.scalarudf class method)": [[19, "datafusion.user_defined.ScalarUDF._from_internal", false]], "_from_internal() (datafusion.user_defined.windowudf class method)": [[19, "datafusion.user_defined.WindowUDF._from_internal", false]], "_from_internal() (datafusion.windowudf class method)": [[7, "datafusion.WindowUDF._from_internal", false]], "_get_cell_value() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._get_cell_value", false]], "_get_default_css() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._get_default_css", false]], "_get_default_name() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF._get_default_name", false]], "_get_default_name() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF._get_default_name", false]], "_get_javascript() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._get_javascript", false]], "_inner (datafusion.catalog.table attribute)": [[0, "datafusion.catalog.Table._inner", false]], "_inner (datafusion.table attribute)": [[7, "datafusion.Table._inner", false]], "_is_pycapsule() (in module datafusion.user_defined)": [[19, "datafusion.user_defined._is_pycapsule", false]], "_max_rows (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._max_rows", false]], "_normalize_input_types() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF._normalize_input_types", false]], "_normalize_input_types() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF._normalize_input_types", false]], "_null_treatment (datafusion.expr.window attribute)": [[4, "datafusion.expr.Window._null_treatment", false]], "_order_by (datafusion.expr.window attribute)": [[4, "datafusion.expr.Window._order_by", false]], "_partition_by (datafusion.expr.window attribute)": [[4, "datafusion.expr.Window._partition_by", false]], "_r (in module datafusion.user_defined)": [[19, "datafusion.user_defined._R", false]], "_raw (datafusion.metric attribute)": [[7, "datafusion.Metric._raw", false]], "_raw (datafusion.metricsset attribute)": [[7, "datafusion.MetricsSet._raw", false]], "_raw (datafusion.plan.metric attribute)": [[15, "datafusion.plan.Metric._raw", false]], "_raw (datafusion.plan.metricsset attribute)": [[15, "datafusion.plan.MetricsSet._raw", false]], "_raw_plan (datafusion.executionplan attribute)": [[7, "datafusion.ExecutionPlan._raw_plan", false]], "_raw_plan (datafusion.logicalplan attribute)": [[7, "datafusion.LogicalPlan._raw_plan", false]], "_raw_plan (datafusion.plan.executionplan attribute)": [[15, "datafusion.plan.ExecutionPlan._raw_plan", false]], "_raw_plan (datafusion.plan.logicalplan attribute)": [[15, "datafusion.plan.LogicalPlan._raw_plan", false]], "_raw_schema (datafusion.catalog.schema attribute)": [[0, "datafusion.catalog.Schema._raw_schema", false]], "_raw_write_options (datafusion.dataframe.dataframewriteoptions attribute)": [[2, "datafusion.dataframe.DataFrameWriteOptions._raw_write_options", false]], "_raw_write_options (datafusion.dataframewriteoptions attribute)": [[7, "datafusion.DataFrameWriteOptions._raw_write_options", false]], "_reconstruct() (datafusion.expr class method)": [[7, "datafusion.Expr._reconstruct", false]], "_reconstruct() (datafusion.expr.expr class method)": [[4, "datafusion.expr.Expr._reconstruct", false]], "_refresh_formatter_reference() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter._refresh_formatter_reference", false]], "_register_object_store_for_path() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext._register_object_store_for_path", false]], "_repr_html_() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame._repr_html_", false]], "_to_pyarrow_types (datafusion.expr attribute)": [[7, "datafusion.Expr._to_pyarrow_types", false]], "_to_pyarrow_types (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr._to_pyarrow_types", false]], "_type_formatters (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._type_formatters", false]], "_udaf (datafusion.aggregateudf attribute)": [[7, "datafusion.AggregateUDF._udaf", false]], "_udaf (datafusion.user_defined.aggregateudf attribute)": [[19, "datafusion.user_defined.AggregateUDF._udaf", false]], "_udf (datafusion.scalarudf attribute)": [[7, "datafusion.ScalarUDF._udf", false]], "_udf (datafusion.user_defined.scalarudf attribute)": [[19, "datafusion.user_defined.ScalarUDF._udf", false]], "_udtf (datafusion.tablefunction attribute)": [[7, "datafusion.TableFunction._udtf", false]], "_udtf (datafusion.user_defined.tablefunction attribute)": [[19, "datafusion.user_defined.TableFunction._udtf", false]], "_udwf (datafusion.user_defined.windowudf attribute)": [[19, "datafusion.user_defined.WindowUDF._udwf", false]], "_udwf (datafusion.windowudf attribute)": [[7, "datafusion.WindowUDF._udwf", false]], "_validate_bool() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter._validate_bool", false]], "_validate_formatter_parameters() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter._validate_formatter_parameters", false]], "_validate_positive_int() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter._validate_positive_int", false]], "_window_frame (datafusion.expr.window attribute)": [[4, "datafusion.expr.Window._window_frame", false]], "_wrap_session_kwarg_for_udtf() (in module datafusion.user_defined)": [[19, "datafusion.user_defined._wrap_session_kwarg_for_udtf", false]], "abs() (datafusion.expr method)": [[7, "datafusion.Expr.abs", false]], "abs() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.abs", false]], "abs() (in module datafusion.functions)": [[5, "datafusion.functions.abs", false]], "abs() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.abs", false]], "accumulator (class in datafusion)": [[7, "datafusion.Accumulator", false]], "accumulator (class in datafusion.user_defined)": [[19, "datafusion.user_defined.Accumulator", false]], "acos() (datafusion.expr method)": [[7, "datafusion.Expr.acos", false]], "acos() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.acos", false]], "acos() (in module datafusion.functions)": [[5, "datafusion.functions.acos", false]], "acosh() (datafusion.expr method)": [[7, "datafusion.Expr.acosh", false]], "acosh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.acosh", false]], "acosh() (in module datafusion.functions)": [[5, "datafusion.functions.acosh", false]], "add_months() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.add_months", false]], "add_physical_optimizer_rule() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.add_physical_optimizer_rule", false]], "aggregate (in module datafusion.expr)": [[4, "datafusion.expr.Aggregate", false]], "aggregate() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.aggregate", false]], "aggregatefunction (in module datafusion.expr)": [[4, "datafusion.expr.AggregateFunction", false]], "aggregateudf (class in datafusion)": [[7, "datafusion.AggregateUDF", false]], "aggregateudf (class in datafusion.user_defined)": [[19, "datafusion.user_defined.AggregateUDF", false]], "aggregateudfexportable (class in datafusion.user_defined)": [[19, "datafusion.user_defined.AggregateUDFExportable", false]], "alias (in module datafusion.expr)": [[4, "datafusion.expr.Alias", false]], "alias() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.alias", false]], "alias() (datafusion.expr method)": [[7, "datafusion.Expr.alias", false]], "alias() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.alias", false]], "alias() (in module datafusion.functions)": [[5, "datafusion.functions.alias", false]], "allow_single_file_parallelism (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.allow_single_file_parallelism", false]], "allow_single_file_parallelism (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.allow_single_file_parallelism", false]], "amazons3 (in module datafusion.object_store)": [[13, "datafusion.object_store.AmazonS3", false]], "analyze (in module datafusion.expr)": [[4, "datafusion.expr.Analyze", false]], "any_match() (in module datafusion.functions)": [[5, "datafusion.functions.any_match", false]], "append (datafusion.dataframe.insertop attribute)": [[2, "datafusion.dataframe.InsertOp.APPEND", false]], "append (datafusion.insertop attribute)": [[7, "datafusion.InsertOp.APPEND", false]], "approx_distinct() (in module datafusion.functions)": [[5, "datafusion.functions.approx_distinct", false]], "approx_median() (in module datafusion.functions)": [[5, "datafusion.functions.approx_median", false]], "approx_percentile_cont() (in module datafusion.functions)": [[5, "datafusion.functions.approx_percentile_cont", false]], "approx_percentile_cont_with_weight() (in module datafusion.functions)": [[5, "datafusion.functions.approx_percentile_cont_with_weight", false]], "array() (in module datafusion.functions)": [[5, "datafusion.functions.array", false]], "array() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.array", false]], "array_agg() (in module datafusion.functions)": [[5, "datafusion.functions.array_agg", false]], "array_any_match() (in module datafusion.functions)": [[5, "datafusion.functions.array_any_match", false]], "array_any_value() (in module datafusion.functions)": [[5, "datafusion.functions.array_any_value", false]], "array_append() (in module datafusion.functions)": [[5, "datafusion.functions.array_append", false]], "array_cat() (in module datafusion.functions)": [[5, "datafusion.functions.array_cat", false]], "array_compact() (in module datafusion.functions)": [[5, "datafusion.functions.array_compact", false]], "array_concat() (in module datafusion.functions)": [[5, "datafusion.functions.array_concat", false]], "array_contains() (in module datafusion.functions)": [[5, "datafusion.functions.array_contains", false]], "array_contains() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.array_contains", false]], "array_dims() (datafusion.expr method)": [[7, "datafusion.Expr.array_dims", false]], "array_dims() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_dims", false]], "array_dims() (in module datafusion.functions)": [[5, "datafusion.functions.array_dims", false]], "array_distance() (in module datafusion.functions)": [[5, "datafusion.functions.array_distance", false]], "array_distinct() (datafusion.expr method)": [[7, "datafusion.Expr.array_distinct", false]], "array_distinct() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_distinct", false]], "array_distinct() (in module datafusion.functions)": [[5, "datafusion.functions.array_distinct", false]], "array_element() (in module datafusion.functions)": [[5, "datafusion.functions.array_element", false]], "array_empty() (datafusion.expr method)": [[7, "datafusion.Expr.array_empty", false]], "array_empty() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_empty", false]], "array_empty() (in module datafusion.functions)": [[5, "datafusion.functions.array_empty", false]], "array_except() (in module datafusion.functions)": [[5, "datafusion.functions.array_except", false]], "array_extract() (in module datafusion.functions)": [[5, "datafusion.functions.array_extract", false]], "array_filter() (in module datafusion.functions)": [[5, "datafusion.functions.array_filter", false]], "array_has() (in module datafusion.functions)": [[5, "datafusion.functions.array_has", false]], "array_has_all() (in module datafusion.functions)": [[5, "datafusion.functions.array_has_all", false]], "array_has_any() (in module datafusion.functions)": [[5, "datafusion.functions.array_has_any", false]], "array_indexof() (in module datafusion.functions)": [[5, "datafusion.functions.array_indexof", false]], "array_intersect() (in module datafusion.functions)": [[5, "datafusion.functions.array_intersect", false]], "array_join() (in module datafusion.functions)": [[5, "datafusion.functions.array_join", false]], "array_length() (datafusion.expr method)": [[7, "datafusion.Expr.array_length", false]], "array_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_length", false]], "array_length() (in module datafusion.functions)": [[5, "datafusion.functions.array_length", false]], "array_max() (in module datafusion.functions)": [[5, "datafusion.functions.array_max", false]], "array_min() (in module datafusion.functions)": [[5, "datafusion.functions.array_min", false]], "array_ndims() (datafusion.expr method)": [[7, "datafusion.Expr.array_ndims", false]], "array_ndims() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_ndims", false]], "array_ndims() (in module datafusion.functions)": [[5, "datafusion.functions.array_ndims", false]], "array_normalize() (in module datafusion.functions)": [[5, "datafusion.functions.array_normalize", false]], "array_pop_back() (datafusion.expr method)": [[7, "datafusion.Expr.array_pop_back", false]], "array_pop_back() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_pop_back", false]], "array_pop_back() (in module datafusion.functions)": [[5, "datafusion.functions.array_pop_back", false]], "array_pop_front() (datafusion.expr method)": [[7, "datafusion.Expr.array_pop_front", false]], "array_pop_front() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_pop_front", false]], "array_pop_front() (in module datafusion.functions)": [[5, "datafusion.functions.array_pop_front", false]], "array_position() (in module datafusion.functions)": [[5, "datafusion.functions.array_position", false]], "array_positions() (in module datafusion.functions)": [[5, "datafusion.functions.array_positions", false]], "array_prepend() (in module datafusion.functions)": [[5, "datafusion.functions.array_prepend", false]], "array_push_back() (in module datafusion.functions)": [[5, "datafusion.functions.array_push_back", false]], "array_push_front() (in module datafusion.functions)": [[5, "datafusion.functions.array_push_front", false]], "array_remove() (in module datafusion.functions)": [[5, "datafusion.functions.array_remove", false]], "array_remove_all() (in module datafusion.functions)": [[5, "datafusion.functions.array_remove_all", false]], "array_remove_n() (in module datafusion.functions)": [[5, "datafusion.functions.array_remove_n", false]], "array_repeat() (in module datafusion.functions)": [[5, "datafusion.functions.array_repeat", false]], "array_repeat() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.array_repeat", false]], "array_replace() (in module datafusion.functions)": [[5, "datafusion.functions.array_replace", false]], "array_replace_all() (in module datafusion.functions)": [[5, "datafusion.functions.array_replace_all", false]], "array_replace_n() (in module datafusion.functions)": [[5, "datafusion.functions.array_replace_n", false]], "array_resize() (in module datafusion.functions)": [[5, "datafusion.functions.array_resize", false]], "array_reverse() (in module datafusion.functions)": [[5, "datafusion.functions.array_reverse", false]], "array_slice() (in module datafusion.functions)": [[5, "datafusion.functions.array_slice", false]], "array_sort() (in module datafusion.functions)": [[5, "datafusion.functions.array_sort", false]], "array_to_string() (in module datafusion.functions)": [[5, "datafusion.functions.array_to_string", false]], "array_transform() (in module datafusion.functions)": [[5, "datafusion.functions.array_transform", false]], "array_union() (in module datafusion.functions)": [[5, "datafusion.functions.array_union", false]], "arrays_overlap() (in module datafusion.functions)": [[5, "datafusion.functions.arrays_overlap", false]], "arrays_zip() (in module datafusion.functions)": [[5, "datafusion.functions.arrays_zip", false]], "arrow_cast() (in module datafusion.functions)": [[5, "datafusion.functions.arrow_cast", false]], "arrow_field() (in module datafusion.functions)": [[5, "datafusion.functions.arrow_field", false]], "arrow_metadata() (in module datafusion.functions)": [[5, "datafusion.functions.arrow_metadata", false]], "arrow_try_cast() (in module datafusion.functions)": [[5, "datafusion.functions.arrow_try_cast", false]], "arrow_typeof() (datafusion.expr method)": [[7, "datafusion.Expr.arrow_typeof", false]], "arrow_typeof() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.arrow_typeof", false]], "arrow_typeof() (in module datafusion.functions)": [[5, "datafusion.functions.arrow_typeof", false]], "arrowarrayexportable (class in datafusion.context)": [[1, "datafusion.context.ArrowArrayExportable", false]], "arrowstreamexportable (class in datafusion.context)": [[1, "datafusion.context.ArrowStreamExportable", false]], "ascending() (datafusion.expr.sortexpr method)": [[4, "datafusion.expr.SortExpr.ascending", false]], "ascii() (datafusion.expr method)": [[7, "datafusion.Expr.ascii", false]], "ascii() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.ascii", false]], "ascii() (in module datafusion.functions)": [[5, "datafusion.functions.ascii", false]], "ascii() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.ascii", false]], "asin() (datafusion.expr method)": [[7, "datafusion.Expr.asin", false]], "asin() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.asin", false]], "asin() (in module datafusion.functions)": [[5, "datafusion.functions.asin", false]], "asinh() (datafusion.expr method)": [[7, "datafusion.Expr.asinh", false]], "asinh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.asinh", false]], "asinh() (in module datafusion.functions)": [[5, "datafusion.functions.asinh", false]], "atan() (datafusion.expr method)": [[7, "datafusion.Expr.atan", false]], "atan() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.atan", false]], "atan() (in module datafusion.functions)": [[5, "datafusion.functions.atan", false]], "atan2() (in module datafusion.functions)": [[5, "datafusion.functions.atan2", false]], "atanh() (datafusion.expr method)": [[7, "datafusion.Expr.atanh", false]], "atanh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.atanh", false]], "atanh() (in module datafusion.functions)": [[5, "datafusion.functions.atanh", false]], "avg() (in module datafusion.functions)": [[5, "datafusion.functions.avg", false]], "avg() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.avg", false]], "base64() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.base64", false]], "baseinputsource (class in datafusion.input.base)": [[8, "datafusion.input.base.BaseInputSource", false]], "between (in module datafusion.expr)": [[4, "datafusion.expr.Between", false]], "between() (datafusion.expr method)": [[7, "datafusion.Expr.between", false]], "between() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.between", false]], "bin() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bin", false]], "binaryexpr (in module datafusion.expr)": [[4, "datafusion.expr.BinaryExpr", false]], "bit_and() (in module datafusion.functions)": [[5, "datafusion.functions.bit_and", false]], "bit_count() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bit_count", false]], "bit_get() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bit_get", false]], "bit_length() (datafusion.expr method)": [[7, "datafusion.Expr.bit_length", false]], "bit_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.bit_length", false]], "bit_length() (in module datafusion.functions)": [[5, "datafusion.functions.bit_length", false]], "bit_or() (in module datafusion.functions)": [[5, "datafusion.functions.bit_or", false]], "bit_xor() (in module datafusion.functions)": [[5, "datafusion.functions.bit_xor", false]], "bitmap_bit_position() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bitmap_bit_position", false]], "bitmap_bucket_number() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bitmap_bucket_number", false]], "bitmap_count() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bitmap_count", false]], "bitwise_not() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bitwise_not", false]], "bloom_filter_enabled (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.bloom_filter_enabled", false]], "bloom_filter_enabled (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.bloom_filter_enabled", false]], "bloom_filter_fpp (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.bloom_filter_fpp", false]], "bloom_filter_fpp (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.bloom_filter_fpp", false]], "bloom_filter_fpp (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.bloom_filter_fpp", false]], "bloom_filter_fpp (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.bloom_filter_fpp", false]], "bloom_filter_ndv (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.bloom_filter_ndv", false]], "bloom_filter_ndv (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.bloom_filter_ndv", false]], "bloom_filter_ndv (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.bloom_filter_ndv", false]], "bloom_filter_ndv (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.bloom_filter_ndv", false]], "bloom_filter_on_write (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.bloom_filter_on_write", false]], "bloom_filter_on_write (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.bloom_filter_on_write", false]], "bool_and() (in module datafusion.functions)": [[5, "datafusion.functions.bool_and", false]], "bool_or() (in module datafusion.functions)": [[5, "datafusion.functions.bool_or", false]], "brotli (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.BROTLI", false]], "btrim() (datafusion.expr method)": [[7, "datafusion.Expr.btrim", false]], "btrim() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.btrim", false]], "btrim() (in module datafusion.functions)": [[5, "datafusion.functions.btrim", false]], "build_table() (datafusion.input.base.baseinputsource method)": [[8, "datafusion.input.base.BaseInputSource.build_table", false]], "build_table() (datafusion.input.location.locationinputplugin method)": [[10, "datafusion.input.location.LocationInputPlugin.build_table", false]], "build_table() (datafusion.input.locationinputplugin method)": [[9, "datafusion.input.LocationInputPlugin.build_table", false]], "cache() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.cache", false]], "canonical_name() (datafusion.expr method)": [[7, "datafusion.Expr.canonical_name", false]], "canonical_name() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.canonical_name", false]], "cardinality() (datafusion.expr method)": [[7, "datafusion.Expr.cardinality", false]], "cardinality() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cardinality", false]], "cardinality() (in module datafusion.functions)": [[5, "datafusion.functions.cardinality", false]], "case (in module datafusion.expr)": [[4, "datafusion.expr.Case", false]], "case() (in module datafusion.functions)": [[5, "datafusion.functions.case", false]], "case_builder (datafusion.expr.casebuilder attribute)": [[4, "datafusion.expr.CaseBuilder.case_builder", false]], "casebuilder (class in datafusion.expr)": [[4, "datafusion.expr.CaseBuilder", false]], "cast (in module datafusion.expr)": [[4, "datafusion.expr.Cast", false]], "cast() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.cast", false]], "cast() (datafusion.expr method)": [[7, "datafusion.Expr.cast", false]], "cast() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cast", false]], "cast_to_type() (in module datafusion.functions)": [[5, "datafusion.functions.cast_to_type", false]], "catalog (class in datafusion)": [[7, "datafusion.Catalog", false]], "catalog (class in datafusion.catalog)": [[0, "datafusion.catalog.Catalog", false]], "catalog (datafusion.catalog attribute)": [[7, "datafusion.Catalog.catalog", false]], "catalog (datafusion.catalog.catalog attribute)": [[0, "datafusion.catalog.Catalog.catalog", false]], "catalog() (datafusion.catalog.cataloglist method)": [[0, "datafusion.catalog.CatalogList.catalog", false]], "catalog() (datafusion.catalog.catalogproviderlist method)": [[0, "datafusion.catalog.CatalogProviderList.catalog", false]], "catalog() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.catalog", false]], "catalog_list (datafusion.catalog.cataloglist attribute)": [[0, "datafusion.catalog.CatalogList.catalog_list", false]], "catalog_names() (datafusion.catalog.cataloglist method)": [[0, "datafusion.catalog.CatalogList.catalog_names", false]], "catalog_names() (datafusion.catalog.catalogproviderlist method)": [[0, "datafusion.catalog.CatalogProviderList.catalog_names", false]], "catalog_names() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.catalog_names", false]], "cataloglist (class in datafusion.catalog)": [[0, "datafusion.catalog.CatalogList", false]], "catalogprovider (class in datafusion.catalog)": [[0, "datafusion.catalog.CatalogProvider", false]], "catalogproviderlist (class in datafusion.catalog)": [[0, "datafusion.catalog.CatalogProviderList", false]], "cbrt() (datafusion.expr method)": [[7, "datafusion.Expr.cbrt", false]], "cbrt() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cbrt", false]], "cbrt() (in module datafusion.functions)": [[5, "datafusion.functions.cbrt", false]], "ceil() (datafusion.expr method)": [[7, "datafusion.Expr.ceil", false]], "ceil() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.ceil", false]], "ceil() (in module datafusion.functions)": [[5, "datafusion.functions.ceil", false]], "ceil() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.ceil", false]], "cellformatter (class in datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.CellFormatter", false]], "char() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.char", false]], "char_length() (datafusion.expr method)": [[7, "datafusion.Expr.char_length", false]], "char_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.char_length", false]], "char_length() (in module datafusion.functions)": [[5, "datafusion.functions.char_length", false]], "character_length() (datafusion.expr method)": [[7, "datafusion.Expr.character_length", false]], "character_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.character_length", false]], "character_length() (in module datafusion.functions)": [[5, "datafusion.functions.character_length", false]], "children() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.children", false]], "children() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.children", false]], "chr() (datafusion.expr method)": [[7, "datafusion.Expr.chr", false]], "chr() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.chr", false]], "chr() (in module datafusion.functions)": [[5, "datafusion.functions.chr", false]], "clear_sender_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.clear_sender_ctx", false]], "clear_worker_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.clear_worker_ctx", false]], "coalesce() (in module datafusion.functions)": [[5, "datafusion.functions.coalesce", false]], "coerce_to_expr() (in module datafusion.expr)": [[4, "datafusion.expr.coerce_to_expr", false]], "coerce_to_expr_list() (in module datafusion.expr)": [[4, "datafusion.expr.coerce_to_expr_list", false]], "coerce_to_expr_or_none() (in module datafusion.expr)": [[4, "datafusion.expr.coerce_to_expr_or_none", false]], "col (in module datafusion)": [[7, "datafusion.col", false]], "col() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.col", false]], "col() (in module datafusion.functions)": [[5, "datafusion.functions.col", false]], "collect() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.collect", false]], "collect_column() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.collect_column", false]], "collect_list() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.collect_list", false]], "collect_metrics() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.collect_metrics", false]], "collect_metrics() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.collect_metrics", false]], "collect_partitioned() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.collect_partitioned", false]], "collect_set() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.collect_set", false]], "column (in module datafusion)": [[7, "datafusion.column", false]], "column (in module datafusion.expr)": [[4, "datafusion.expr.Column", false]], "column() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.column", false]], "column() (datafusion.expr static method)": [[7, "datafusion.Expr.column", false]], "column() (datafusion.expr.expr static method)": [[4, "datafusion.expr.Expr.column", false]], "column_index_truncate_length (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.column_index_truncate_length", false]], "column_index_truncate_length (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.column_index_truncate_length", false]], "column_name() (datafusion.expr method)": [[7, "datafusion.Expr.column_name", false]], "column_name() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.column_name", false]], "column_specific_options (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.column_specific_options", false]], "column_specific_options (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.column_specific_options", false]], "comment (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.comment", false]], "comment (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.comment", false]], "compression (class in datafusion.dataframe)": [[2, "datafusion.dataframe.Compression", false]], "compression (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.compression", false]], "compression (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.compression", false]], "concat() (in module datafusion.functions)": [[5, "datafusion.functions.concat", false]], "concat() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.concat", false]], "concat_ws() (in module datafusion.functions)": [[5, "datafusion.functions.concat_ws", false]], "config_internal (datafusion.context.runtimeenvbuilder attribute)": [[1, "datafusion.context.RuntimeEnvBuilder.config_internal", false]], "config_internal (datafusion.context.sessionconfig attribute)": [[1, "datafusion.context.SessionConfig.config_internal", false]], "config_internal (datafusion.runtimeenvbuilder attribute)": [[7, "datafusion.RuntimeEnvBuilder.config_internal", false]], "config_internal (datafusion.sessionconfig attribute)": [[7, "datafusion.SessionConfig.config_internal", false]], "configure_formatter() (in module datafusion)": [[7, "datafusion.configure_formatter", false]], "configure_formatter() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.configure_formatter", false]], "consumer (class in datafusion.substrait)": [[17, "datafusion.substrait.Consumer", false]], "contains() (in module datafusion.functions)": [[5, "datafusion.functions.contains", false]], "copied_config() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.copied_config", false]], "copyto (in module datafusion.expr)": [[4, "datafusion.expr.CopyTo", false]], "corr() (in module datafusion.functions)": [[5, "datafusion.functions.corr", false]], "cos() (datafusion.expr method)": [[7, "datafusion.Expr.cos", false]], "cos() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cos", false]], "cos() (in module datafusion.functions)": [[5, "datafusion.functions.cos", false]], "cosh() (datafusion.expr method)": [[7, "datafusion.Expr.cosh", false]], "cosh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cosh", false]], "cosh() (in module datafusion.functions)": [[5, "datafusion.functions.cosh", false]], "cosine_distance() (in module datafusion.functions)": [[5, "datafusion.functions.cosine_distance", false]], "cot() (datafusion.expr method)": [[7, "datafusion.Expr.cot", false]], "cot() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cot", false]], "cot() (in module datafusion.functions)": [[5, "datafusion.functions.cot", false]], "count() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.count", false]], "count() (in module datafusion.functions)": [[5, "datafusion.functions.count", false]], "count_star() (in module datafusion.functions)": [[5, "datafusion.functions.count_star", false]], "covar() (in module datafusion.functions)": [[5, "datafusion.functions.covar", false]], "covar_pop() (in module datafusion.functions)": [[5, "datafusion.functions.covar_pop", false]], "covar_samp() (in module datafusion.functions)": [[5, "datafusion.functions.covar_samp", false]], "crc32() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.crc32", false]], "create() (datafusion.tableproviderfactory method)": [[7, "datafusion.TableProviderFactory.create", false]], "create_dataframe() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.create_dataframe", false]], "create_dataframe_from_logical_plan() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.create_dataframe_from_logical_plan", false]], "createcatalog (in module datafusion.expr)": [[4, "datafusion.expr.CreateCatalog", false]], "createcatalogschema (in module datafusion.expr)": [[4, "datafusion.expr.CreateCatalogSchema", false]], "created_by (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.created_by", false]], "created_by (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.created_by", false]], "createexternaltable (in module datafusion.expr)": [[4, "datafusion.expr.CreateExternalTable", false]], "createfunction (in module datafusion.expr)": [[4, "datafusion.expr.CreateFunction", false]], "createfunctionbody (in module datafusion.expr)": [[4, "datafusion.expr.CreateFunctionBody", false]], "createindex (in module datafusion.expr)": [[4, "datafusion.expr.CreateIndex", false]], "creatememorytable (in module datafusion.expr)": [[4, "datafusion.expr.CreateMemoryTable", false]], "createview (in module datafusion.expr)": [[4, "datafusion.expr.CreateView", false]], "csc() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.csc", false]], "csvreadoptions (class in datafusion)": [[7, "datafusion.CsvReadOptions", false]], "csvreadoptions (class in datafusion.options)": [[14, "datafusion.options.CsvReadOptions", false]], "ctx (datafusion.context.sessioncontext attribute)": [[1, "datafusion.context.SessionContext.ctx", false]], "cube() (datafusion.expr.groupingset static method)": [[4, "datafusion.expr.GroupingSet.cube", false]], "cume_dist() (in module datafusion.functions)": [[5, "datafusion.functions.cume_dist", false]], "current_date() (in module datafusion.functions)": [[5, "datafusion.functions.current_date", false]], "current_time() (in module datafusion.functions)": [[5, "datafusion.functions.current_time", false]], "current_timestamp() (in module datafusion.functions)": [[5, "datafusion.functions.current_timestamp", false]], "custom_css (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.custom_css", false]], "data_page_row_count_limit (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.data_page_row_count_limit", false]], "data_page_row_count_limit (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.data_page_row_count_limit", false]], "data_pagesize_limit (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.data_pagesize_limit", false]], "data_pagesize_limit (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.data_pagesize_limit", false]], "data_type_or_field_to_field() (in module datafusion.user_defined)": [[19, "datafusion.user_defined.data_type_or_field_to_field", false]], "data_types_or_fields_to_field_list() (in module datafusion.user_defined)": [[19, "datafusion.user_defined.data_types_or_fields_to_field_list", false]], "dataframe (class in datafusion.dataframe)": [[2, "datafusion.dataframe.DataFrame", false]], "dataframehtmlformatter (class in datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter", false]], "dataframewriteoptions (class in datafusion)": [[7, "datafusion.DataFrameWriteOptions", false]], "dataframewriteoptions (class in datafusion.dataframe)": [[2, "datafusion.dataframe.DataFrameWriteOptions", false]], "datafusion": [[7, "module-datafusion", false]], "datafusion.catalog": [[0, "module-datafusion.catalog", false]], "datafusion.context": [[1, "module-datafusion.context", false]], "datafusion.dataframe": [[2, "module-datafusion.dataframe", false]], "datafusion.dataframe_formatter": [[3, "module-datafusion.dataframe_formatter", false]], "datafusion.expr": [[4, "module-datafusion.expr", false]], "datafusion.functions": [[5, "module-datafusion.functions", false]], "datafusion.functions.spark": [[6, "module-datafusion.functions.spark", false]], "datafusion.input": [[9, "module-datafusion.input", false]], "datafusion.input.base": [[8, "module-datafusion.input.base", false]], "datafusion.input.location": [[10, "module-datafusion.input.location", false]], "datafusion.io": [[11, "module-datafusion.io", false]], "datafusion.ipc": [[12, "module-datafusion.ipc", false]], "datafusion.object_store": [[13, "module-datafusion.object_store", false]], "datafusion.options": [[14, "module-datafusion.options", false]], "datafusion.plan": [[15, "module-datafusion.plan", false]], "datafusion.record_batch": [[16, "module-datafusion.record_batch", false]], "datafusion.substrait": [[17, "module-datafusion.substrait", false]], "datafusion.unparser": [[18, "module-datafusion.unparser", false]], "datafusion.user_defined": [[19, "module-datafusion.user_defined", false]], "date_add() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.date_add", false]], "date_bin() (in module datafusion.functions)": [[5, "datafusion.functions.date_bin", false]], "date_diff() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.date_diff", false]], "date_format() (in module datafusion.functions)": [[5, "datafusion.functions.date_format", false]], "date_part() (in module datafusion.functions)": [[5, "datafusion.functions.date_part", false]], "date_part() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.date_part", false]], "date_sub() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.date_sub", false]], "date_trunc() (in module datafusion.functions)": [[5, "datafusion.functions.date_trunc", false]], "date_trunc() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.date_trunc", false]], "datepart() (in module datafusion.functions)": [[5, "datafusion.functions.datepart", false]], "datetrunc() (in module datafusion.functions)": [[5, "datafusion.functions.datetrunc", false]], "deallocate (in module datafusion.expr)": [[4, "datafusion.expr.Deallocate", false]], "decode() (in module datafusion.functions)": [[5, "datafusion.functions.decode", false]], "default() (datafusion.unparser.dialect static method)": [[18, "datafusion.unparser.Dialect.default", false]], "default_str_repr() (datafusion.dataframe.dataframe static method)": [[2, "datafusion.dataframe.DataFrame.default_str_repr", false]], "defaultstyleprovider (class in datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.DefaultStyleProvider", false]], "degrees() (datafusion.expr method)": [[7, "datafusion.Expr.degrees", false]], "degrees() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.degrees", false]], "degrees() (in module datafusion.functions)": [[5, "datafusion.functions.degrees", false]], "delimiter (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.delimiter", false]], "delimiter (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.delimiter", false]], "dense_rank() (in module datafusion.functions)": [[5, "datafusion.functions.dense_rank", false]], "deregister_object_store() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_object_store", false]], "deregister_schema() (datafusion.catalog method)": [[7, "datafusion.Catalog.deregister_schema", false]], "deregister_schema() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.deregister_schema", false]], "deregister_schema() (datafusion.catalog.catalogprovider method)": [[0, "datafusion.catalog.CatalogProvider.deregister_schema", false]], "deregister_table() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.deregister_table", false]], "deregister_table() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.deregister_table", false]], "deregister_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_table", false]], "deregister_udaf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_udaf", false]], "deregister_udf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_udf", false]], "deregister_udtf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_udtf", false]], "deregister_udwf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_udwf", false]], "describe() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.describe", false]], "describetable (in module datafusion.expr)": [[4, "datafusion.expr.DescribeTable", false]], "deserialize() (datafusion.substrait.serde static method)": [[17, "datafusion.substrait.Serde.deserialize", false]], "deserialize_bytes() (datafusion.substrait.serde static method)": [[17, "datafusion.substrait.Serde.deserialize_bytes", false]], "df (datafusion.dataframe.dataframe attribute)": [[2, "datafusion.dataframe.DataFrame.df", false]], "dfschema (in module datafusion)": [[7, "datafusion.DFSchema", false]], "dialect (class in datafusion.unparser)": [[18, "datafusion.unparser.Dialect", false]], "dialect (datafusion.unparser.dialect attribute)": [[18, "datafusion.unparser.Dialect.dialect", false]], "dictionary_enabled (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.dictionary_enabled", false]], "dictionary_enabled (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.dictionary_enabled", false]], "dictionary_enabled (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.dictionary_enabled", false]], "dictionary_enabled (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.dictionary_enabled", false]], "dictionary_page_size_limit (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.dictionary_page_size_limit", false]], "dictionary_page_size_limit (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.dictionary_page_size_limit", false]], "digest() (in module datafusion.functions)": [[5, "datafusion.functions.digest", false]], "display() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.display", false]], "display() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.display", false]], "display() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.display", false]], "display() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.display", false]], "display_graphviz() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.display_graphviz", false]], "display_graphviz() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.display_graphviz", false]], "display_indent() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.display_indent", false]], "display_indent() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.display_indent", false]], "display_indent() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.display_indent", false]], "display_indent() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.display_indent", false]], "display_indent_schema() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.display_indent_schema", false]], "display_indent_schema() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.display_indent_schema", false]], "distinct (in module datafusion.expr)": [[4, "datafusion.expr.Distinct", false]], "distinct() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.distinct", false]], "distinct() (datafusion.expr method)": [[7, "datafusion.Expr.distinct", false]], "distinct() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.distinct", false]], "distinct_on() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.distinct_on", false]], "dmlstatement (in module datafusion.expr)": [[4, "datafusion.expr.DmlStatement", false]], "dot_product() (in module datafusion.functions)": [[5, "datafusion.functions.dot_product", false]], "drop() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.drop", false]], "dropcatalogschema (in module datafusion.expr)": [[4, "datafusion.expr.DropCatalogSchema", false]], "dropfunction (in module datafusion.expr)": [[4, "datafusion.expr.DropFunction", false]], "droptable (in module datafusion.expr)": [[4, "datafusion.expr.DropTable", false]], "dropview (in module datafusion.expr)": [[4, "datafusion.expr.DropView", false]], "duckdb() (datafusion.unparser.dialect static method)": [[18, "datafusion.unparser.Dialect.duckdb", false]], "elapsed_compute (datafusion.metricsset property)": [[7, "datafusion.MetricsSet.elapsed_compute", false]], "elapsed_compute (datafusion.plan.metricsset property)": [[15, "datafusion.plan.MetricsSet.elapsed_compute", false]], "element_at() (in module datafusion.functions)": [[5, "datafusion.functions.element_at", false]], "elt() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.elt", false]], "empty() (datafusion.expr method)": [[7, "datafusion.Expr.empty", false]], "empty() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.empty", false]], "empty() (in module datafusion.functions)": [[5, "datafusion.functions.empty", false]], "empty_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.empty_table", false]], "emptyrelation (in module datafusion.expr)": [[4, "datafusion.expr.EmptyRelation", false]], "enable_cell_expansion (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.enable_cell_expansion", false]], "enable_ident_normalization() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.enable_ident_normalization", false]], "enable_spark_functions() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.enable_spark_functions", false]], "enable_url_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.enable_url_table", false]], "encode() (datafusion.substrait.plan method)": [[17, "datafusion.substrait.Plan.encode", false]], "encode() (in module datafusion.functions)": [[5, "datafusion.functions.encode", false]], "encoding (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.encoding", false]], "encoding (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.encoding", false]], "encoding (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.encoding", false]], "encoding (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.encoding", false]], "end() (datafusion.expr.casebuilder method)": [[4, "datafusion.expr.CaseBuilder.end", false]], "ends_with() (in module datafusion.functions)": [[5, "datafusion.functions.ends_with", false]], "ensure_expr() (in module datafusion.expr)": [[4, "datafusion.expr.ensure_expr", false]], "ensure_expr_list() (in module datafusion.expr)": [[4, "datafusion.expr.ensure_expr_list", false]], "escape (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.escape", false]], "escape (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.escape", false]], "evaluate() (datafusion.accumulator method)": [[7, "datafusion.Accumulator.evaluate", false]], "evaluate() (datafusion.user_defined.accumulator method)": [[19, "datafusion.user_defined.Accumulator.evaluate", false]], "evaluate() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.evaluate", false]], "evaluate_all() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.evaluate_all", false]], "evaluate_all_with_rank() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.evaluate_all_with_rank", false]], "except_all() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.except_all", false]], "execute (in module datafusion.expr)": [[4, "datafusion.expr.Execute", false]], "execute() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.execute", false]], "execute_logical_plan() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.execute_logical_plan", false]], "execute_stream() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.execute_stream", false]], "execute_stream_partitioned() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.execute_stream_partitioned", false]], "execution_plan() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.execution_plan", false]], "executionplan (class in datafusion)": [[7, "datafusion.ExecutionPlan", false]], "executionplan (class in datafusion.plan)": [[15, "datafusion.plan.ExecutionPlan", false]], "exists (in module datafusion.expr)": [[4, "datafusion.expr.Exists", false]], "exp() (datafusion.expr method)": [[7, "datafusion.Expr.exp", false]], "exp() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.exp", false]], "exp() (in module datafusion.functions)": [[5, "datafusion.functions.exp", false]], "explain (in module datafusion.expr)": [[4, "datafusion.expr.Explain", false]], "explain() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.explain", false]], "explainformat (class in datafusion)": [[7, "datafusion.ExplainFormat", false]], "explainformat (class in datafusion.dataframe)": [[2, "datafusion.dataframe.ExplainFormat", false]], "expm1() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.expm1", false]], "expr (class in datafusion)": [[7, "datafusion.Expr", false]], "expr (class in datafusion.expr)": [[4, "datafusion.expr.Expr", false]], "expr (datafusion.expr attribute)": [[7, "datafusion.Expr.expr", false]], "expr (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.expr", false]], "expr() (datafusion.expr.sortexpr method)": [[4, "datafusion.expr.SortExpr.expr", false]], "expr_type_error (in module datafusion.expr)": [[4, "datafusion.expr.EXPR_TYPE_ERROR", false]], "extension (in module datafusion.expr)": [[4, "datafusion.expr.Extension", false]], "extract() (in module datafusion.functions)": [[5, "datafusion.functions.extract", false]], "factorial() (datafusion.expr method)": [[7, "datafusion.Expr.factorial", false]], "factorial() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.factorial", false]], "factorial() (in module datafusion.functions)": [[5, "datafusion.functions.factorial", false]], "factorial() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.factorial", false]], "file_compression_type (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.file_compression_type", false]], "file_compression_type (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.file_compression_type", false]], "file_extension (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.file_extension", false]], "file_extension (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.file_extension", false]], "file_sort_order (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.file_sort_order", false]], "file_sort_order (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.file_sort_order", false]], "filetype (in module datafusion.expr)": [[4, "datafusion.expr.FileType", false]], "fill_nan() (datafusion.expr method)": [[7, "datafusion.Expr.fill_nan", false]], "fill_nan() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.fill_nan", false]], "fill_null() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.fill_null", false]], "fill_null() (datafusion.expr method)": [[7, "datafusion.Expr.fill_null", false]], "fill_null() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.fill_null", false]], "filter (in module datafusion.expr)": [[4, "datafusion.expr.Filter", false]], "filter() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.filter", false]], "filter() (datafusion.expr method)": [[7, "datafusion.Expr.filter", false]], "filter() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.filter", false]], "find_in_set() (in module datafusion.functions)": [[5, "datafusion.functions.find_in_set", false]], "find_qualified_columns() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.find_qualified_columns", false]], "first_value() (in module datafusion.functions)": [[5, "datafusion.functions.first_value", false]], "flatten() (datafusion.expr method)": [[7, "datafusion.Expr.flatten", false]], "flatten() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.flatten", false]], "flatten() (in module datafusion.functions)": [[5, "datafusion.functions.flatten", false]], "floor() (datafusion.expr method)": [[7, "datafusion.Expr.floor", false]], "floor() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.floor", false]], "floor() (in module datafusion.functions)": [[5, "datafusion.functions.floor", false]], "floor() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.floor", false]], "format_html() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.format_html", false]], "format_str() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.format_str", false]], "format_string() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.format_string", false]], "formattermanager (class in datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.FormatterManager", false]], "frame_bound (datafusion.expr.windowframebound attribute)": [[4, "datafusion.expr.WindowFrameBound.frame_bound", false]], "from_arrow() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.from_arrow", false]], "from_bytes() (datafusion.executionplan static method)": [[7, "datafusion.ExecutionPlan.from_bytes", false]], "from_bytes() (datafusion.expr class method)": [[7, "datafusion.Expr.from_bytes", false]], "from_bytes() (datafusion.expr.expr class method)": [[4, "datafusion.expr.Expr.from_bytes", false]], "from_bytes() (datafusion.logicalplan static method)": [[7, "datafusion.LogicalPlan.from_bytes", false]], "from_bytes() (datafusion.plan.executionplan static method)": [[15, "datafusion.plan.ExecutionPlan.from_bytes", false]], "from_bytes() (datafusion.plan.logicalplan static method)": [[15, "datafusion.plan.LogicalPlan.from_bytes", false]], "from_dataset() (datafusion.catalog.table static method)": [[0, "datafusion.catalog.Table.from_dataset", false]], "from_dataset() (datafusion.table static method)": [[7, "datafusion.Table.from_dataset", false]], "from_json() (datafusion.substrait.plan static method)": [[17, "datafusion.substrait.Plan.from_json", false]], "from_pandas() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.from_pandas", false]], "from_polars() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.from_polars", false]], "from_proto() (datafusion.executionplan static method)": [[7, "datafusion.ExecutionPlan.from_proto", false]], "from_proto() (datafusion.logicalplan static method)": [[7, "datafusion.LogicalPlan.from_proto", false]], "from_proto() (datafusion.plan.executionplan static method)": [[15, "datafusion.plan.ExecutionPlan.from_proto", false]], "from_proto() (datafusion.plan.logicalplan static method)": [[15, "datafusion.plan.LogicalPlan.from_proto", false]], "from_pycapsule() (datafusion.aggregateudf static method)": [[7, "datafusion.AggregateUDF.from_pycapsule", false]], "from_pycapsule() (datafusion.scalarudf static method)": [[7, "datafusion.ScalarUDF.from_pycapsule", false]], "from_pycapsule() (datafusion.user_defined.aggregateudf static method)": [[19, "datafusion.user_defined.AggregateUDF.from_pycapsule", false]], "from_pycapsule() (datafusion.user_defined.scalarudf static method)": [[19, "datafusion.user_defined.ScalarUDF.from_pycapsule", false]], "from_pycapsule() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF.from_pycapsule", false]], "from_pycapsule() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF.from_pycapsule", false]], "from_pydict() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.from_pydict", false]], "from_pylist() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.from_pylist", false]], "from_str() (datafusion.dataframe.compression class method)": [[2, "datafusion.dataframe.Compression.from_str", false]], "from_substrait_plan() (datafusion.substrait.consumer static method)": [[17, "datafusion.substrait.Consumer.from_substrait_plan", false]], "from_unixtime() (datafusion.expr method)": [[7, "datafusion.Expr.from_unixtime", false]], "from_unixtime() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.from_unixtime", false]], "from_unixtime() (in module datafusion.functions)": [[5, "datafusion.functions.from_unixtime", false]], "from_utc_timestamp() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.from_utc_timestamp", false]], "gcd() (in module datafusion.functions)": [[5, "datafusion.functions.gcd", false]], "gen_series() (in module datafusion.functions)": [[5, "datafusion.functions.gen_series", false]], "generate_series() (in module datafusion.functions)": [[5, "datafusion.functions.generate_series", false]], "get_cell_style() (datafusion.dataframe_formatter.defaultstyleprovider method)": [[3, "datafusion.dataframe_formatter.DefaultStyleProvider.get_cell_style", false]], "get_cell_style() (datafusion.dataframe_formatter.styleprovider method)": [[3, "datafusion.dataframe_formatter.StyleProvider.get_cell_style", false]], "get_default_level() (datafusion.dataframe.compression method)": [[2, "datafusion.dataframe.Compression.get_default_level", false]], "get_field() (in module datafusion.functions)": [[5, "datafusion.functions.get_field", false]], "get_formatter() (datafusion.dataframe_formatter.formattermanager class method)": [[3, "datafusion.dataframe_formatter.FormatterManager.get_formatter", false]], "get_formatter() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.get_formatter", false]], "get_frame_units() (datafusion.expr.windowframe method)": [[4, "datafusion.expr.WindowFrame.get_frame_units", false]], "get_frame_units() (datafusion.windowframe method)": [[7, "datafusion.WindowFrame.get_frame_units", false]], "get_header_style() (datafusion.dataframe_formatter.defaultstyleprovider method)": [[3, "datafusion.dataframe_formatter.DefaultStyleProvider.get_header_style", false]], "get_header_style() (datafusion.dataframe_formatter.styleprovider method)": [[3, "datafusion.dataframe_formatter.StyleProvider.get_header_style", false]], "get_lower_bound() (datafusion.expr.windowframe method)": [[4, "datafusion.expr.WindowFrame.get_lower_bound", false]], "get_lower_bound() (datafusion.windowframe method)": [[7, "datafusion.WindowFrame.get_lower_bound", false]], "get_offset() (datafusion.expr.windowframebound method)": [[4, "datafusion.expr.WindowFrameBound.get_offset", false]], "get_range() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.get_range", false]], "get_sender_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.get_sender_ctx", false]], "get_upper_bound() (datafusion.expr.windowframe method)": [[4, "datafusion.expr.WindowFrame.get_upper_bound", false]], "get_upper_bound() (datafusion.windowframe method)": [[7, "datafusion.WindowFrame.get_upper_bound", false]], "get_worker_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.get_worker_ctx", false]], "global_ctx() (datafusion.context.sessioncontext class method)": [[1, "datafusion.context.SessionContext.global_ctx", false]], "googlecloud (in module datafusion.object_store)": [[13, "datafusion.object_store.GoogleCloud", false]], "graphviz (datafusion.dataframe.explainformat attribute)": [[2, "datafusion.dataframe.ExplainFormat.GRAPHVIZ", false]], "graphviz (datafusion.explainformat attribute)": [[7, "datafusion.ExplainFormat.GRAPHVIZ", false]], "greatest() (in module datafusion.functions)": [[5, "datafusion.functions.greatest", false]], "grouping() (in module datafusion.functions)": [[5, "datafusion.functions.grouping", false]], "grouping_sets() (datafusion.expr.groupingset static method)": [[4, "datafusion.expr.GroupingSet.grouping_sets", false]], "groupingset (class in datafusion.expr)": [[4, "datafusion.expr.GroupingSet", false]], "gzip (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.GZIP", false]], "has_header (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.has_header", false]], "has_header (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.has_header", false]], "head() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.head", false]], "hex() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.hex", false]], "higherorderfunction (in module datafusion.expr)": [[4, "datafusion.expr.HigherOrderFunction", false]], "hour() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.hour", false]], "http (in module datafusion.object_store)": [[13, "datafusion.object_store.Http", false]], "if_() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.if_", false]], "ifnull() (in module datafusion.functions)": [[5, "datafusion.functions.ifnull", false]], "ilike (in module datafusion.expr)": [[4, "datafusion.expr.ILike", false]], "ilike() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.ilike", false]], "immutable (datafusion.user_defined.volatility attribute)": [[19, "datafusion.user_defined.Volatility.Immutable", false]], "in_list() (in module datafusion.functions)": [[5, "datafusion.functions.in_list", false]], "include_rank() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.include_rank", false]], "indent (datafusion.dataframe.explainformat attribute)": [[2, "datafusion.dataframe.ExplainFormat.INDENT", false]], "indent (datafusion.explainformat attribute)": [[7, "datafusion.ExplainFormat.INDENT", false]], "initcap() (datafusion.expr method)": [[7, "datafusion.Expr.initcap", false]], "initcap() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.initcap", false]], "initcap() (in module datafusion.functions)": [[5, "datafusion.functions.initcap", false]], "inlist (in module datafusion.expr)": [[4, "datafusion.expr.InList", false]], "inner_product() (in module datafusion.functions)": [[5, "datafusion.functions.inner_product", false]], "inputs() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.inputs", false]], "inputs() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.inputs", false]], "insertop (class in datafusion)": [[7, "datafusion.InsertOp", false]], "insertop (class in datafusion.dataframe)": [[2, "datafusion.dataframe.InsertOp", false]], "instr() (in module datafusion.functions)": [[5, "datafusion.functions.instr", false]], "insubquery (in module datafusion.expr)": [[4, "datafusion.expr.InSubquery", false]], "intersect() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.intersect", false]], "into_view() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.into_view", false]], "is_causal() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.is_causal", false]], "is_correct_input() (datafusion.input.base.baseinputsource method)": [[8, "datafusion.input.base.BaseInputSource.is_correct_input", false]], "is_correct_input() (datafusion.input.location.locationinputplugin method)": [[10, "datafusion.input.location.LocationInputPlugin.is_correct_input", false]], "is_correct_input() (datafusion.input.locationinputplugin method)": [[9, "datafusion.input.LocationInputPlugin.is_correct_input", false]], "is_current_row() (datafusion.expr.windowframebound method)": [[4, "datafusion.expr.WindowFrameBound.is_current_row", false]], "is_following() (datafusion.expr.windowframebound method)": [[4, "datafusion.expr.WindowFrameBound.is_following", false]], "is_nan() (datafusion.expr method)": [[7, "datafusion.Expr.is_nan", false]], "is_nan() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.is_nan", false]], "is_nan() (in module datafusion.functions)": [[5, "datafusion.functions.is_nan", false]], "is_not_null() (datafusion.expr method)": [[7, "datafusion.Expr.is_not_null", false]], "is_not_null() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.is_not_null", false]], "is_null() (datafusion.expr method)": [[7, "datafusion.Expr.is_null", false]], "is_null() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.is_null", false]], "is_preceding() (datafusion.expr.windowframebound method)": [[4, "datafusion.expr.WindowFrameBound.is_preceding", false]], "is_unbounded() (datafusion.expr.windowframebound method)": [[4, "datafusion.expr.WindowFrameBound.is_unbounded", false]], "is_valid_utf8() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.is_valid_utf8", false]], "isfalse (in module datafusion.expr)": [[4, "datafusion.expr.IsFalse", false]], "isnan() (datafusion.expr method)": [[7, "datafusion.Expr.isnan", false]], "isnan() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.isnan", false]], "isnan() (in module datafusion.functions)": [[5, "datafusion.functions.isnan", false]], "isnotfalse (in module datafusion.expr)": [[4, "datafusion.expr.IsNotFalse", false]], "isnotnull (in module datafusion.expr)": [[4, "datafusion.expr.IsNotNull", false]], "isnottrue (in module datafusion.expr)": [[4, "datafusion.expr.IsNotTrue", false]], "isnotunknown (in module datafusion.expr)": [[4, "datafusion.expr.IsNotUnknown", false]], "isnull (in module datafusion.expr)": [[4, "datafusion.expr.IsNull", false]], "istrue (in module datafusion.expr)": [[4, "datafusion.expr.IsTrue", false]], "isunknown (in module datafusion.expr)": [[4, "datafusion.expr.IsUnknown", false]], "iszero() (datafusion.expr method)": [[7, "datafusion.Expr.iszero", false]], "iszero() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.iszero", false]], "iszero() (in module datafusion.functions)": [[5, "datafusion.functions.iszero", false]], "join (in module datafusion.expr)": [[4, "datafusion.expr.Join", false]], "join() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.join", false]], "join_on() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.join_on", false]], "joinconstraint (in module datafusion.expr)": [[4, "datafusion.expr.JoinConstraint", false]], "jointype (in module datafusion.expr)": [[4, "datafusion.expr.JoinType", false]], "json_tuple() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.json_tuple", false]], "kind (datafusion.catalog.table property)": [[0, "datafusion.catalog.Table.kind", false]], "kind (datafusion.table property)": [[7, "datafusion.Table.kind", false]], "labels() (datafusion.metric method)": [[7, "datafusion.Metric.labels", false]], "labels() (datafusion.plan.metric method)": [[15, "datafusion.plan.Metric.labels", false]], "lag() (in module datafusion.functions)": [[5, "datafusion.functions.lag", false]], "lambda (in module datafusion.expr)": [[4, "datafusion.expr.Lambda", false]], "lambda_() (in module datafusion.functions)": [[5, "datafusion.functions.lambda_", false]], "lambda_var() (in module datafusion.functions)": [[5, "datafusion.functions.lambda_var", false]], "lambdavariable (in module datafusion.expr)": [[4, "datafusion.expr.LambdaVariable", false]], "last_day() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.last_day", false]], "last_value() (in module datafusion.functions)": [[5, "datafusion.functions.last_value", false]], "lcm() (in module datafusion.functions)": [[5, "datafusion.functions.lcm", false]], "lead() (in module datafusion.functions)": [[5, "datafusion.functions.lead", false]], "least() (in module datafusion.functions)": [[5, "datafusion.functions.least", false]], "left() (in module datafusion.functions)": [[5, "datafusion.functions.left", false]], "length() (datafusion.expr method)": [[7, "datafusion.Expr.length", false]], "length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.length", false]], "length() (in module datafusion.functions)": [[5, "datafusion.functions.length", false]], "length() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.length", false]], "levenshtein() (in module datafusion.functions)": [[5, "datafusion.functions.levenshtein", false]], "like (in module datafusion.expr)": [[4, "datafusion.expr.Like", false]], "like() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.like", false]], "limit (in module datafusion.expr)": [[4, "datafusion.expr.Limit", false]], "limit() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.limit", false]], "list_any_match() (in module datafusion.functions)": [[5, "datafusion.functions.list_any_match", false]], "list_any_value() (in module datafusion.functions)": [[5, "datafusion.functions.list_any_value", false]], "list_append() (in module datafusion.functions)": [[5, "datafusion.functions.list_append", false]], "list_cat() (in module datafusion.functions)": [[5, "datafusion.functions.list_cat", false]], "list_compact() (in module datafusion.functions)": [[5, "datafusion.functions.list_compact", false]], "list_concat() (in module datafusion.functions)": [[5, "datafusion.functions.list_concat", false]], "list_contains() (in module datafusion.functions)": [[5, "datafusion.functions.list_contains", false]], "list_dims() (datafusion.expr method)": [[7, "datafusion.Expr.list_dims", false]], "list_dims() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.list_dims", false]], "list_dims() (in module datafusion.functions)": [[5, "datafusion.functions.list_dims", false]], "list_distance() (in module datafusion.functions)": [[5, "datafusion.functions.list_distance", false]], "list_distinct() (datafusion.expr method)": [[7, "datafusion.Expr.list_distinct", false]], "list_distinct() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.list_distinct", false]], "list_distinct() (in module datafusion.functions)": [[5, "datafusion.functions.list_distinct", false]], "list_element() (in module datafusion.functions)": [[5, "datafusion.functions.list_element", false]], "list_empty() (in module datafusion.functions)": [[5, "datafusion.functions.list_empty", false]], "list_except() (in module datafusion.functions)": [[5, "datafusion.functions.list_except", false]], "list_extract() (in module datafusion.functions)": [[5, "datafusion.functions.list_extract", false]], "list_filter() (in module datafusion.functions)": [[5, "datafusion.functions.list_filter", false]], "list_has() (in module datafusion.functions)": [[5, "datafusion.functions.list_has", false]], "list_has_all() (in module datafusion.functions)": [[5, "datafusion.functions.list_has_all", false]], "list_has_any() (in module datafusion.functions)": [[5, "datafusion.functions.list_has_any", false]], "list_indexof() (in module datafusion.functions)": [[5, "datafusion.functions.list_indexof", false]], "list_intersect() (in module datafusion.functions)": [[5, "datafusion.functions.list_intersect", false]], "list_join() (in module datafusion.functions)": [[5, "datafusion.functions.list_join", false]], "list_length() (datafusion.expr method)": [[7, "datafusion.Expr.list_length", false]], "list_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.list_length", false]], "list_length() (in module datafusion.functions)": [[5, "datafusion.functions.list_length", false]], "list_max() (in module datafusion.functions)": [[5, "datafusion.functions.list_max", false]], "list_min() (in module datafusion.functions)": [[5, "datafusion.functions.list_min", false]], "list_ndims() (datafusion.expr method)": [[7, "datafusion.Expr.list_ndims", false]], "list_ndims() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.list_ndims", false]], "list_ndims() (in module datafusion.functions)": [[5, "datafusion.functions.list_ndims", false]], "list_normalize() (in module datafusion.functions)": [[5, "datafusion.functions.list_normalize", false]], "list_overlap() (in module datafusion.functions)": [[5, "datafusion.functions.list_overlap", false]], "list_pop_back() (in module datafusion.functions)": [[5, "datafusion.functions.list_pop_back", false]], "list_pop_front() (in module datafusion.functions)": [[5, "datafusion.functions.list_pop_front", false]], "list_position() (in module datafusion.functions)": [[5, "datafusion.functions.list_position", false]], "list_positions() (in module datafusion.functions)": [[5, "datafusion.functions.list_positions", false]], "list_prepend() (in module datafusion.functions)": [[5, "datafusion.functions.list_prepend", false]], "list_push_back() (in module datafusion.functions)": [[5, "datafusion.functions.list_push_back", false]], "list_push_front() (in module datafusion.functions)": [[5, "datafusion.functions.list_push_front", false]], "list_remove() (in module datafusion.functions)": [[5, "datafusion.functions.list_remove", false]], "list_remove_all() (in module datafusion.functions)": [[5, "datafusion.functions.list_remove_all", false]], "list_remove_n() (in module datafusion.functions)": [[5, "datafusion.functions.list_remove_n", false]], "list_repeat() (in module datafusion.functions)": [[5, "datafusion.functions.list_repeat", false]], "list_replace() (in module datafusion.functions)": [[5, "datafusion.functions.list_replace", false]], "list_replace_all() (in module datafusion.functions)": [[5, "datafusion.functions.list_replace_all", false]], "list_replace_n() (in module datafusion.functions)": [[5, "datafusion.functions.list_replace_n", false]], "list_resize() (in module datafusion.functions)": [[5, "datafusion.functions.list_resize", false]], "list_reverse() (in module datafusion.functions)": [[5, "datafusion.functions.list_reverse", false]], "list_slice() (in module datafusion.functions)": [[5, "datafusion.functions.list_slice", false]], "list_sort() (in module datafusion.functions)": [[5, "datafusion.functions.list_sort", false]], "list_to_string() (in module datafusion.functions)": [[5, "datafusion.functions.list_to_string", false]], "list_transform() (in module datafusion.functions)": [[5, "datafusion.functions.list_transform", false]], "list_union() (in module datafusion.functions)": [[5, "datafusion.functions.list_union", false]], "list_zip() (in module datafusion.functions)": [[5, "datafusion.functions.list_zip", false]], "lit() (in module datafusion)": [[7, "datafusion.lit", false]], "literal (in module datafusion.expr)": [[4, "datafusion.expr.Literal", false]], "literal() (datafusion.expr static method)": [[7, "datafusion.Expr.literal", false]], "literal() (datafusion.expr.expr static method)": [[4, "datafusion.expr.Expr.literal", false]], "literal() (in module datafusion)": [[7, "datafusion.literal", false]], "literal_with_metadata() (datafusion.expr static method)": [[7, "datafusion.Expr.literal_with_metadata", false]], "literal_with_metadata() (datafusion.expr.expr static method)": [[4, "datafusion.expr.Expr.literal_with_metadata", false]], "ln() (datafusion.expr method)": [[7, "datafusion.Expr.ln", false]], "ln() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.ln", false]], "ln() (in module datafusion.functions)": [[5, "datafusion.functions.ln", false]], "localfilesystem (in module datafusion.object_store)": [[13, "datafusion.object_store.LocalFileSystem", false]], "locationinputplugin (class in datafusion.input)": [[9, "datafusion.input.LocationInputPlugin", false]], "locationinputplugin (class in datafusion.input.location)": [[10, "datafusion.input.location.LocationInputPlugin", false]], "log() (in module datafusion.functions)": [[5, "datafusion.functions.log", false]], "log10() (datafusion.expr method)": [[7, "datafusion.Expr.log10", false]], "log10() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.log10", false]], "log10() (in module datafusion.functions)": [[5, "datafusion.functions.log10", false]], "log2() (datafusion.expr method)": [[7, "datafusion.Expr.log2", false]], "log2() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.log2", false]], "log2() (in module datafusion.functions)": [[5, "datafusion.functions.log2", false]], "logical_plan() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.logical_plan", false]], "logicalextensioncodecexportable (class in datafusion.user_defined)": [[19, "datafusion.user_defined.LogicalExtensionCodecExportable", false]], "logicalplan (class in datafusion)": [[7, "datafusion.LogicalPlan", false]], "logicalplan (class in datafusion.plan)": [[15, "datafusion.plan.LogicalPlan", false]], "lower() (datafusion.expr method)": [[7, "datafusion.Expr.lower", false]], "lower() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.lower", false]], "lower() (in module datafusion.functions)": [[5, "datafusion.functions.lower", false]], "lpad() (in module datafusion.functions)": [[5, "datafusion.functions.lpad", false]], "ltrim() (datafusion.expr method)": [[7, "datafusion.Expr.ltrim", false]], "ltrim() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.ltrim", false]], "ltrim() (in module datafusion.functions)": [[5, "datafusion.functions.ltrim", false]], "luhn_check() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.luhn_check", false]], "lz4 (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.LZ4", false]], "lz4_raw (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.LZ4_RAW", false]], "make_array() (in module datafusion.functions)": [[5, "datafusion.functions.make_array", false]], "make_date() (in module datafusion.functions)": [[5, "datafusion.functions.make_date", false]], "make_dt_interval() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.make_dt_interval", false]], "make_interval() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.make_interval", false]], "make_list() (in module datafusion.functions)": [[5, "datafusion.functions.make_list", false]], "make_map() (in module datafusion.functions)": [[5, "datafusion.functions.make_map", false]], "make_time() (in module datafusion.functions)": [[5, "datafusion.functions.make_time", false]], "make_valid_utf8() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.make_valid_utf8", false]], "map_entries() (in module datafusion.functions)": [[5, "datafusion.functions.map_entries", false]], "map_extract() (in module datafusion.functions)": [[5, "datafusion.functions.map_extract", false]], "map_from_arrays() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.map_from_arrays", false]], "map_from_entries() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.map_from_entries", false]], "map_keys() (in module datafusion.functions)": [[5, "datafusion.functions.map_keys", false]], "map_values() (in module datafusion.functions)": [[5, "datafusion.functions.map_values", false]], "max() (in module datafusion.functions)": [[5, "datafusion.functions.max", false]], "max_cell_length (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.max_cell_length", false]], "max_height (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.max_height", false]], "max_memory_bytes (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.max_memory_bytes", false]], "max_row_group_size (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.max_row_group_size", false]], "max_row_group_size (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.max_row_group_size", false]], "max_rows (datafusion.dataframe_formatter.dataframehtmlformatter property)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.max_rows", false]], "max_width (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.max_width", false]], "maximum_buffered_record_batches_per_stream (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.maximum_buffered_record_batches_per_stream", false]], "maximum_buffered_record_batches_per_stream (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.maximum_buffered_record_batches_per_stream", false]], "maximum_parallel_row_group_writers (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.maximum_parallel_row_group_writers", false]], "maximum_parallel_row_group_writers (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.maximum_parallel_row_group_writers", false]], "md5() (datafusion.expr method)": [[7, "datafusion.Expr.md5", false]], "md5() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.md5", false]], "md5() (in module datafusion.functions)": [[5, "datafusion.functions.md5", false]], "mean() (in module datafusion.functions)": [[5, "datafusion.functions.mean", false]], "median() (in module datafusion.functions)": [[5, "datafusion.functions.median", false]], "memoize() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.memoize", false]], "memory_catalog() (datafusion.catalog static method)": [[7, "datafusion.Catalog.memory_catalog", false]], "memory_catalog() (datafusion.catalog.catalog static method)": [[0, "datafusion.catalog.Catalog.memory_catalog", false]], "memory_catalog() (datafusion.catalog.cataloglist static method)": [[0, "datafusion.catalog.CatalogList.memory_catalog", false]], "memory_schema() (datafusion.catalog.schema static method)": [[0, "datafusion.catalog.Schema.memory_schema", false]], "merge() (datafusion.accumulator method)": [[7, "datafusion.Accumulator.merge", false]], "merge() (datafusion.user_defined.accumulator method)": [[19, "datafusion.user_defined.Accumulator.merge", false]], "metric (class in datafusion)": [[7, "datafusion.Metric", false]], "metric (class in datafusion.plan)": [[15, "datafusion.plan.Metric", false]], "metrics() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.metrics", false]], "metrics() (datafusion.metricsset method)": [[7, "datafusion.MetricsSet.metrics", false]], "metrics() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.metrics", false]], "metrics() (datafusion.plan.metricsset method)": [[15, "datafusion.plan.MetricsSet.metrics", false]], "metricsset (class in datafusion)": [[7, "datafusion.MetricsSet", false]], "metricsset (class in datafusion.plan)": [[15, "datafusion.plan.MetricsSet", false]], "microsoftazure (in module datafusion.object_store)": [[13, "datafusion.object_store.MicrosoftAzure", false]], "min() (in module datafusion.functions)": [[5, "datafusion.functions.min", false]], "min_rows (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.min_rows", false]], "minute() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.minute", false]], "module": [[0, "module-datafusion.catalog", false], [1, "module-datafusion.context", false], [2, "module-datafusion.dataframe", false], [3, "module-datafusion.dataframe_formatter", false], [4, "module-datafusion.expr", false], [5, "module-datafusion.functions", false], [6, "module-datafusion.functions.spark", false], [7, "module-datafusion", false], [8, "module-datafusion.input.base", false], [9, "module-datafusion.input", false], [10, "module-datafusion.input.location", false], [11, "module-datafusion.io", false], [12, "module-datafusion.ipc", false], [13, "module-datafusion.object_store", false], [14, "module-datafusion.options", false], [15, "module-datafusion.plan", false], [16, "module-datafusion.record_batch", false], [17, "module-datafusion.substrait", false], [18, "module-datafusion.unparser", false], [19, "module-datafusion.user_defined", false]], "modulus() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.modulus", false]], "mysql() (datafusion.unparser.dialect static method)": [[18, "datafusion.unparser.Dialect.mysql", false]], "name (datafusion.aggregateudf property)": [[7, "datafusion.AggregateUDF.name", false]], "name (datafusion.metric property)": [[7, "datafusion.Metric.name", false]], "name (datafusion.plan.metric property)": [[15, "datafusion.plan.Metric.name", false]], "name (datafusion.scalarudf property)": [[7, "datafusion.ScalarUDF.name", false]], "name (datafusion.user_defined.aggregateudf property)": [[19, "datafusion.user_defined.AggregateUDF.name", false]], "name (datafusion.user_defined.scalarudf property)": [[19, "datafusion.user_defined.ScalarUDF.name", false]], "name (datafusion.user_defined.windowudf property)": [[19, "datafusion.user_defined.WindowUDF.name", false]], "name (datafusion.windowudf property)": [[7, "datafusion.WindowUDF.name", false]], "named_struct() (in module datafusion.functions)": [[5, "datafusion.functions.named_struct", false]], "names() (datafusion.catalog method)": [[7, "datafusion.Catalog.names", false]], "names() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.names", false]], "names() (datafusion.catalog.cataloglist method)": [[0, "datafusion.catalog.CatalogList.names", false]], "names() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.names", false]], "nanvl() (in module datafusion.functions)": [[5, "datafusion.functions.nanvl", false]], "negative (in module datafusion.expr)": [[4, "datafusion.expr.Negative", false]], "negative() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.negative", false]], "newlines_in_values (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.newlines_in_values", false]], "newlines_in_values (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.newlines_in_values", false]], "next() (datafusion.record_batch.recordbatchstream method)": [[16, "datafusion.record_batch.RecordBatchStream.next", false]], "next() (datafusion.recordbatchstream method)": [[7, "datafusion.RecordBatchStream.next", false]], "next_day() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.next_day", false]], "not (in module datafusion.expr)": [[4, "datafusion.expr.Not", false]], "now() (in module datafusion.functions)": [[5, "datafusion.functions.now", false]], "nth_value() (in module datafusion.functions)": [[5, "datafusion.functions.nth_value", false]], "ntile() (in module datafusion.functions)": [[5, "datafusion.functions.ntile", false]], "null_regex (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.null_regex", false]], "null_regex (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.null_regex", false]], "null_treatment() (datafusion.expr method)": [[7, "datafusion.Expr.null_treatment", false]], "null_treatment() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.null_treatment", false]], "nullif() (in module datafusion.functions)": [[5, "datafusion.functions.nullif", false]], "nulls_first() (datafusion.expr.sortexpr method)": [[4, "datafusion.expr.SortExpr.nulls_first", false]], "nvl() (in module datafusion.functions)": [[5, "datafusion.functions.nvl", false]], "nvl2() (in module datafusion.functions)": [[5, "datafusion.functions.nvl2", false]], "octet_length() (datafusion.expr method)": [[7, "datafusion.Expr.octet_length", false]], "octet_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.octet_length", false]], "octet_length() (in module datafusion.functions)": [[5, "datafusion.functions.octet_length", false]], "operatefunctionarg (in module datafusion.expr)": [[4, "datafusion.expr.OperateFunctionArg", false]], "optimized_logical_plan() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.optimized_logical_plan", false]], "options_internal (datafusion.context.sqloptions attribute)": [[1, "datafusion.context.SQLOptions.options_internal", false]], "options_internal (datafusion.sqloptions attribute)": [[7, "datafusion.SQLOptions.options_internal", false]], "order_by() (datafusion.expr method)": [[7, "datafusion.Expr.order_by", false]], "order_by() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.order_by", false]], "order_by() (in module datafusion.functions)": [[5, "datafusion.functions.order_by", false]], "otherwise() (datafusion.expr.casebuilder method)": [[4, "datafusion.expr.CaseBuilder.otherwise", false]], "output_rows (datafusion.metricsset property)": [[7, "datafusion.MetricsSet.output_rows", false]], "output_rows (datafusion.plan.metricsset property)": [[15, "datafusion.plan.MetricsSet.output_rows", false]], "over() (datafusion.expr method)": [[7, "datafusion.Expr.over", false]], "over() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.over", false]], "overlay() (in module datafusion.functions)": [[5, "datafusion.functions.overlay", false]], "overwrite (datafusion.dataframe.insertop attribute)": [[2, "datafusion.dataframe.InsertOp.OVERWRITE", false]], "overwrite (datafusion.insertop attribute)": [[7, "datafusion.InsertOp.OVERWRITE", false]], "owner_name() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.owner_name", false]], "parquetcolumnoptions (class in datafusion)": [[7, "datafusion.ParquetColumnOptions", false]], "parquetcolumnoptions (class in datafusion.dataframe)": [[2, "datafusion.dataframe.ParquetColumnOptions", false]], "parquetwriteroptions (class in datafusion)": [[7, "datafusion.ParquetWriterOptions", false]], "parquetwriteroptions (class in datafusion.dataframe)": [[2, "datafusion.dataframe.ParquetWriterOptions", false]], "parse_capacity_limit() (datafusion.context.sessioncontext static method)": [[1, "datafusion.context.SessionContext.parse_capacity_limit", false]], "parse_sql_expr() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.parse_sql_expr", false]], "parse_sql_expr() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.parse_sql_expr", false]], "parse_url() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.parse_url", false]], "partition (datafusion.metric property)": [[7, "datafusion.Metric.partition", false]], "partition (datafusion.plan.metric property)": [[15, "datafusion.plan.Metric.partition", false]], "partition_by() (datafusion.expr method)": [[7, "datafusion.Expr.partition_by", false]], "partition_by() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.partition_by", false]], "partition_count (datafusion.executionplan property)": [[7, "datafusion.ExecutionPlan.partition_count", false]], "partition_count (datafusion.plan.executionplan property)": [[15, "datafusion.plan.ExecutionPlan.partition_count", false]], "partitioning (in module datafusion.expr)": [[4, "datafusion.expr.Partitioning", false]], "percent_rank() (in module datafusion.functions)": [[5, "datafusion.functions.percent_rank", false]], "percentile_cont() (in module datafusion.functions)": [[5, "datafusion.functions.percentile_cont", false]], "pgjson (datafusion.dataframe.explainformat attribute)": [[2, "datafusion.dataframe.ExplainFormat.PGJSON", false]], "pgjson (datafusion.explainformat attribute)": [[7, "datafusion.ExplainFormat.PGJSON", false]], "physicalextensioncodecexportable (class in datafusion.user_defined)": [[19, "datafusion.user_defined.PhysicalExtensionCodecExportable", false]], "physicaloptimizerruleexportable (class in datafusion.context)": [[1, "datafusion.context.PhysicalOptimizerRuleExportable", false]], "pi() (in module datafusion.functions)": [[5, "datafusion.functions.pi", false]], "placeholder (in module datafusion.expr)": [[4, "datafusion.expr.Placeholder", false]], "plan (class in datafusion.substrait)": [[17, "datafusion.substrait.Plan", false]], "plan_internal (datafusion.substrait.plan attribute)": [[17, "datafusion.substrait.Plan.plan_internal", false]], "plan_to_sql() (datafusion.unparser.unparser method)": [[18, "datafusion.unparser.Unparser.plan_to_sql", false]], "pmod() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.pmod", false]], "position() (in module datafusion.functions)": [[5, "datafusion.functions.position", false]], "postgres() (datafusion.unparser.dialect static method)": [[18, "datafusion.unparser.Dialect.postgres", false]], "pow() (in module datafusion.functions)": [[5, "datafusion.functions.pow", false]], "power() (in module datafusion.functions)": [[5, "datafusion.functions.power", false]], "prepare (in module datafusion.expr)": [[4, "datafusion.expr.Prepare", false]], "producer (class in datafusion.substrait)": [[17, "datafusion.substrait.Producer", false]], "projection (in module datafusion.expr)": [[4, "datafusion.expr.Projection", false]], "python_value() (datafusion.expr method)": [[7, "datafusion.Expr.python_value", false]], "python_value() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.python_value", false]], "quantile_cont() (in module datafusion.functions)": [[5, "datafusion.functions.quantile_cont", false]], "quote (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.quote", false]], "quote (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.quote", false]], "radians() (datafusion.expr method)": [[7, "datafusion.Expr.radians", false]], "radians() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.radians", false]], "radians() (in module datafusion.functions)": [[5, "datafusion.functions.radians", false]], "random() (in module datafusion.functions)": [[5, "datafusion.functions.random", false]], "range() (in module datafusion.functions)": [[5, "datafusion.functions.range", false]], "rank() (in module datafusion.functions)": [[5, "datafusion.functions.rank", false]], "raw_sort (datafusion.expr.sortexpr attribute)": [[4, "datafusion.expr.SortExpr.raw_sort", false]], "rbs (datafusion.record_batch.recordbatchstream attribute)": [[16, "datafusion.record_batch.RecordBatchStream.rbs", false]], "rbs (datafusion.recordbatchstream attribute)": [[7, "datafusion.RecordBatchStream.rbs", false]], "read_arrow() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_arrow", false]], "read_avro() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_avro", false]], "read_avro() (in module datafusion)": [[7, "datafusion.read_avro", false]], "read_avro() (in module datafusion.io)": [[11, "datafusion.io.read_avro", false]], "read_batch() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_batch", false]], "read_batches() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_batches", false]], "read_csv() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_csv", false]], "read_csv() (in module datafusion)": [[7, "datafusion.read_csv", false]], "read_csv() (in module datafusion.io)": [[11, "datafusion.io.read_csv", false]], "read_empty() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_empty", false]], "read_json() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_json", false]], "read_json() (in module datafusion)": [[7, "datafusion.read_json", false]], "read_json() (in module datafusion.io)": [[11, "datafusion.io.read_json", false]], "read_parquet() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_parquet", false]], "read_parquet() (in module datafusion)": [[7, "datafusion.read_parquet", false]], "read_parquet() (in module datafusion.io)": [[11, "datafusion.io.read_parquet", false]], "read_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_table", false]], "record_batch (datafusion.record_batch.recordbatch attribute)": [[16, "datafusion.record_batch.RecordBatch.record_batch", false]], "record_batch (datafusion.recordbatch attribute)": [[7, "datafusion.RecordBatch.record_batch", false]], "recordbatch (class in datafusion)": [[7, "datafusion.RecordBatch", false]], "recordbatch (class in datafusion.record_batch)": [[16, "datafusion.record_batch.RecordBatch", false]], "recordbatchstream (class in datafusion)": [[7, "datafusion.RecordBatchStream", false]], "recordbatchstream (class in datafusion.record_batch)": [[16, "datafusion.record_batch.RecordBatchStream", false]], "recursivequery (in module datafusion.expr)": [[4, "datafusion.expr.RecursiveQuery", false]], "refresh_catalogs() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.refresh_catalogs", false]], "regexp_count() (in module datafusion.functions)": [[5, "datafusion.functions.regexp_count", false]], "regexp_instr() (in module datafusion.functions)": [[5, "datafusion.functions.regexp_instr", false]], "regexp_like() (in module datafusion.functions)": [[5, "datafusion.functions.regexp_like", false]], "regexp_match() (in module datafusion.functions)": [[5, "datafusion.functions.regexp_match", false]], "regexp_replace() (in module datafusion.functions)": [[5, "datafusion.functions.regexp_replace", false]], "register_arrow() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_arrow", false]], "register_avro() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_avro", false]], "register_batch() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_batch", false]], "register_catalog() (datafusion.catalog.cataloglist method)": [[0, "datafusion.catalog.CatalogList.register_catalog", false]], "register_catalog() (datafusion.catalog.catalogproviderlist method)": [[0, "datafusion.catalog.CatalogProviderList.register_catalog", false]], "register_catalog_provider() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_catalog_provider", false]], "register_catalog_provider_list() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_catalog_provider_list", false]], "register_csv() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_csv", false]], "register_dataset() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_dataset", false]], "register_formatter() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.register_formatter", false]], "register_json() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_json", false]], "register_listing_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_listing_table", false]], "register_object_store() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_object_store", false]], "register_parquet() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_parquet", false]], "register_record_batches() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_record_batches", false]], "register_schema() (datafusion.catalog method)": [[7, "datafusion.Catalog.register_schema", false]], "register_schema() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.register_schema", false]], "register_schema() (datafusion.catalog.catalogprovider method)": [[0, "datafusion.catalog.CatalogProvider.register_schema", false]], "register_table() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.register_table", false]], "register_table() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.register_table", false]], "register_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_table", false]], "register_table_factory() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_table_factory", false]], "register_table_provider() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_table_provider", false]], "register_udaf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_udaf", false]], "register_udf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_udf", false]], "register_udtf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_udtf", false]], "register_udwf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_udwf", false]], "register_view() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_view", false]], "regr_avgx() (in module datafusion.functions)": [[5, "datafusion.functions.regr_avgx", false]], "regr_avgy() (in module datafusion.functions)": [[5, "datafusion.functions.regr_avgy", false]], "regr_count() (in module datafusion.functions)": [[5, "datafusion.functions.regr_count", false]], "regr_intercept() (in module datafusion.functions)": [[5, "datafusion.functions.regr_intercept", false]], "regr_r2() (in module datafusion.functions)": [[5, "datafusion.functions.regr_r2", false]], "regr_slope() (in module datafusion.functions)": [[5, "datafusion.functions.regr_slope", false]], "regr_sxx() (in module datafusion.functions)": [[5, "datafusion.functions.regr_sxx", false]], "regr_sxy() (in module datafusion.functions)": [[5, "datafusion.functions.regr_sxy", false]], "regr_syy() (in module datafusion.functions)": [[5, "datafusion.functions.regr_syy", false]], "remove_optimizer_rule() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.remove_optimizer_rule", false]], "repartition (in module datafusion.expr)": [[4, "datafusion.expr.Repartition", false]], "repartition() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.repartition", false]], "repartition_by_hash() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.repartition_by_hash", false]], "repeat() (in module datafusion.functions)": [[5, "datafusion.functions.repeat", false]], "replace (datafusion.dataframe.insertop attribute)": [[2, "datafusion.dataframe.InsertOp.REPLACE", false]], "replace (datafusion.insertop attribute)": [[7, "datafusion.InsertOp.REPLACE", false]], "replace() (in module datafusion.functions)": [[5, "datafusion.functions.replace", false]], "repr_rows (datafusion.dataframe_formatter.dataframehtmlformatter property)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.repr_rows", false]], "reset_formatter() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.reset_formatter", false]], "reverse() (datafusion.expr method)": [[7, "datafusion.Expr.reverse", false]], "reverse() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.reverse", false]], "reverse() (in module datafusion.functions)": [[5, "datafusion.functions.reverse", false]], "rex_call_operands() (datafusion.expr method)": [[7, "datafusion.Expr.rex_call_operands", false]], "rex_call_operands() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.rex_call_operands", false]], "rex_call_operator() (datafusion.expr method)": [[7, "datafusion.Expr.rex_call_operator", false]], "rex_call_operator() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.rex_call_operator", false]], "rex_type() (datafusion.expr method)": [[7, "datafusion.Expr.rex_type", false]], "rex_type() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.rex_type", false]], "right() (in module datafusion.functions)": [[5, "datafusion.functions.right", false]], "rint() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.rint", false]], "rollup() (datafusion.expr.groupingset static method)": [[4, "datafusion.expr.GroupingSet.rollup", false]], "round() (in module datafusion.functions)": [[5, "datafusion.functions.round", false]], "round() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.round", false]], "row() (in module datafusion.functions)": [[5, "datafusion.functions.row", false]], "row_number() (in module datafusion.functions)": [[5, "datafusion.functions.row_number", false]], "rpad() (in module datafusion.functions)": [[5, "datafusion.functions.rpad", false]], "rtrim() (datafusion.expr method)": [[7, "datafusion.Expr.rtrim", false]], "rtrim() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.rtrim", false]], "rtrim() (in module datafusion.functions)": [[5, "datafusion.functions.rtrim", false]], "runtimeenvbuilder (class in datafusion)": [[7, "datafusion.RuntimeEnvBuilder", false]], "runtimeenvbuilder (class in datafusion.context)": [[1, "datafusion.context.RuntimeEnvBuilder", false]], "scalarsubquery (in module datafusion.expr)": [[4, "datafusion.expr.ScalarSubquery", false]], "scalarudf (class in datafusion)": [[7, "datafusion.ScalarUDF", false]], "scalarudf (class in datafusion.user_defined)": [[19, "datafusion.user_defined.ScalarUDF", false]], "scalarudfexportable (class in datafusion.user_defined)": [[19, "datafusion.user_defined.ScalarUDFExportable", false]], "scalarvariable (in module datafusion.expr)": [[4, "datafusion.expr.ScalarVariable", false]], "schema (class in datafusion.catalog)": [[0, "datafusion.catalog.Schema", false]], "schema (datafusion.catalog.table property)": [[0, "datafusion.catalog.Table.schema", false]], "schema (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.schema", false]], "schema (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.schema", false]], "schema (datafusion.table property)": [[7, "datafusion.Table.schema", false]], "schema() (datafusion.catalog method)": [[7, "datafusion.Catalog.schema", false]], "schema() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.schema", false]], "schema() (datafusion.catalog.catalogprovider method)": [[0, "datafusion.catalog.CatalogProvider.schema", false]], "schema() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.schema", false]], "schema_infer_max_records (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.schema_infer_max_records", false]], "schema_infer_max_records (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.schema_infer_max_records", false]], "schema_name() (datafusion.expr method)": [[7, "datafusion.Expr.schema_name", false]], "schema_name() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.schema_name", false]], "schema_names() (datafusion.catalog method)": [[7, "datafusion.Catalog.schema_names", false]], "schema_names() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.schema_names", false]], "schema_names() (datafusion.catalog.catalogprovider method)": [[0, "datafusion.catalog.CatalogProvider.schema_names", false]], "schemaprovider (class in datafusion.catalog)": [[0, "datafusion.catalog.SchemaProvider", false]], "sec() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.sec", false]], "second() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.second", false]], "select() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.select", false]], "select_exprs() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.select_exprs", false]], "serde (class in datafusion.substrait)": [[17, "datafusion.substrait.Serde", false]], "serialize() (datafusion.substrait.serde static method)": [[17, "datafusion.substrait.Serde.serialize", false]], "serialize_bytes() (datafusion.substrait.serde static method)": [[17, "datafusion.substrait.Serde.serialize_bytes", false]], "serialize_to_plan() (datafusion.substrait.serde static method)": [[17, "datafusion.substrait.Serde.serialize_to_plan", false]], "session_id() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.session_id", false]], "session_start_time() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.session_start_time", false]], "sessionconfig (class in datafusion)": [[7, "datafusion.SessionConfig", false]], "sessionconfig (class in datafusion.context)": [[1, "datafusion.context.SessionConfig", false]], "sessioncontext (class in datafusion.context)": [[1, "datafusion.context.SessionContext", false]], "set() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.set", false]], "set() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.set", false]], "set_custom_cell_builder() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.set_custom_cell_builder", false]], "set_custom_header_builder() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.set_custom_header_builder", false]], "set_formatter() (datafusion.dataframe_formatter.formattermanager class method)": [[3, "datafusion.dataframe_formatter.FormatterManager.set_formatter", false]], "set_formatter() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.set_formatter", false]], "set_sender_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.set_sender_ctx", false]], "set_worker_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.set_worker_ctx", false]], "setvariable (in module datafusion.expr)": [[4, "datafusion.expr.SetVariable", false]], "sha1() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.sha1", false]], "sha2() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.sha2", false]], "sha224() (datafusion.expr method)": [[7, "datafusion.Expr.sha224", false]], "sha224() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sha224", false]], "sha224() (in module datafusion.functions)": [[5, "datafusion.functions.sha224", false]], "sha256() (datafusion.expr method)": [[7, "datafusion.Expr.sha256", false]], "sha256() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sha256", false]], "sha256() (in module datafusion.functions)": [[5, "datafusion.functions.sha256", false]], "sha384() (datafusion.expr method)": [[7, "datafusion.Expr.sha384", false]], "sha384() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sha384", false]], "sha384() (in module datafusion.functions)": [[5, "datafusion.functions.sha384", false]], "sha512() (datafusion.expr method)": [[7, "datafusion.Expr.sha512", false]], "sha512() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sha512", false]], "sha512() (in module datafusion.functions)": [[5, "datafusion.functions.sha512", false]], "shiftleft() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.shiftleft", false]], "shiftright() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.shiftright", false]], "shiftrightunsigned() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.shiftrightunsigned", false]], "show() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.show", false]], "show_truncation_message (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.show_truncation_message", false]], "shuffle() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.shuffle", false]], "signum() (datafusion.expr method)": [[7, "datafusion.Expr.signum", false]], "signum() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.signum", false]], "signum() (in module datafusion.functions)": [[5, "datafusion.functions.signum", false]], "similarto (in module datafusion.expr)": [[4, "datafusion.expr.SimilarTo", false]], "sin() (datafusion.expr method)": [[7, "datafusion.Expr.sin", false]], "sin() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sin", false]], "sin() (in module datafusion.functions)": [[5, "datafusion.functions.sin", false]], "sinh() (datafusion.expr method)": [[7, "datafusion.Expr.sinh", false]], "sinh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sinh", false]], "sinh() (in module datafusion.functions)": [[5, "datafusion.functions.sinh", false]], "size() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.size", false]], "skip_arrow_metadata (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.skip_arrow_metadata", false]], "skip_arrow_metadata (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.skip_arrow_metadata", false]], "slice() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.slice", false]], "snappy (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.SNAPPY", false]], "sort (in module datafusion.expr)": [[4, "datafusion.expr.Sort", false]], "sort() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.sort", false]], "sort() (datafusion.expr method)": [[7, "datafusion.Expr.sort", false]], "sort() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sort", false]], "sort_by() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.sort_by", false]], "sortexpr (class in datafusion.expr)": [[4, "datafusion.expr.SortExpr", false]], "sortkey (in module datafusion.expr)": [[4, "datafusion.expr.SortKey", false]], "soundex() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.soundex", false]], "space() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.space", false]], "spark_cast() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.spark_cast", false]], "spill_count (datafusion.metricsset property)": [[7, "datafusion.MetricsSet.spill_count", false]], "spill_count (datafusion.plan.metricsset property)": [[15, "datafusion.plan.MetricsSet.spill_count", false]], "spilled_bytes (datafusion.metricsset property)": [[7, "datafusion.MetricsSet.spilled_bytes", false]], "spilled_bytes (datafusion.plan.metricsset property)": [[15, "datafusion.plan.MetricsSet.spilled_bytes", false]], "spilled_rows (datafusion.metricsset property)": [[7, "datafusion.MetricsSet.spilled_rows", false]], "spilled_rows (datafusion.plan.metricsset property)": [[15, "datafusion.plan.MetricsSet.spilled_rows", false]], "split_part() (in module datafusion.functions)": [[5, "datafusion.functions.split_part", false]], "sql() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.sql", false]], "sql_with_options() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.sql_with_options", false]], "sqlite() (datafusion.unparser.dialect static method)": [[18, "datafusion.unparser.Dialect.sqlite", false]], "sqloptions (class in datafusion)": [[7, "datafusion.SQLOptions", false]], "sqloptions (class in datafusion.context)": [[1, "datafusion.context.SQLOptions", false]], "sqrt() (datafusion.expr method)": [[7, "datafusion.Expr.sqrt", false]], "sqrt() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sqrt", false]], "sqrt() (in module datafusion.functions)": [[5, "datafusion.functions.sqrt", false]], "stable (datafusion.user_defined.volatility attribute)": [[19, "datafusion.user_defined.Volatility.Stable", false]], "starts_with() (in module datafusion.functions)": [[5, "datafusion.functions.starts_with", false]], "state() (datafusion.accumulator method)": [[7, "datafusion.Accumulator.state", false]], "state() (datafusion.user_defined.accumulator method)": [[19, "datafusion.user_defined.Accumulator.state", false]], "statistics_enabled (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.statistics_enabled", false]], "statistics_enabled (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.statistics_enabled", false]], "statistics_enabled (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.statistics_enabled", false]], "statistics_enabled (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.statistics_enabled", false]], "statistics_truncate_length (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.statistics_truncate_length", false]], "statistics_truncate_length (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.statistics_truncate_length", false]], "stddev() (in module datafusion.functions)": [[5, "datafusion.functions.stddev", false]], "stddev_pop() (in module datafusion.functions)": [[5, "datafusion.functions.stddev_pop", false]], "stddev_samp() (in module datafusion.functions)": [[5, "datafusion.functions.stddev_samp", false]], "str_to_map() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.str_to_map", false]], "string_agg() (in module datafusion.functions)": [[5, "datafusion.functions.string_agg", false]], "string_literal() (datafusion.expr static method)": [[7, "datafusion.Expr.string_literal", false]], "string_literal() (datafusion.expr.expr static method)": [[4, "datafusion.expr.Expr.string_literal", false]], "string_to_array() (in module datafusion.functions)": [[5, "datafusion.functions.string_to_array", false]], "string_to_list() (in module datafusion.functions)": [[5, "datafusion.functions.string_to_list", false]], "strpos() (in module datafusion.functions)": [[5, "datafusion.functions.strpos", false]], "struct() (in module datafusion.functions)": [[5, "datafusion.functions.struct", false]], "style_provider (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.style_provider", false]], "styleprovider (class in datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.StyleProvider", false]], "subquery (in module datafusion.expr)": [[4, "datafusion.expr.Subquery", false]], "subqueryalias (in module datafusion.expr)": [[4, "datafusion.expr.SubqueryAlias", false]], "substr() (in module datafusion.functions)": [[5, "datafusion.functions.substr", false]], "substr_index() (in module datafusion.functions)": [[5, "datafusion.functions.substr_index", false]], "substring() (in module datafusion.functions)": [[5, "datafusion.functions.substring", false]], "substring() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.substring", false]], "sum() (in module datafusion.functions)": [[5, "datafusion.functions.sum", false]], "sum_by_name() (datafusion.metricsset method)": [[7, "datafusion.MetricsSet.sum_by_name", false]], "sum_by_name() (datafusion.plan.metricsset method)": [[15, "datafusion.plan.MetricsSet.sum_by_name", false]], "supports_bounded_execution() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.supports_bounded_execution", false]], "table (class in datafusion)": [[7, "datafusion.Table", false]], "table (class in datafusion.catalog)": [[0, "datafusion.catalog.Table", false]], "table() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.table", false]], "table() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.table", false]], "table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.table", false]], "table_exist() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.table_exist", false]], "table_exist() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.table_exist", false]], "table_exist() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.table_exist", false]], "table_names() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.table_names", false]], "table_names() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.table_names", false]], "table_partition_cols (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.table_partition_cols", false]], "table_partition_cols (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.table_partition_cols", false]], "table_provider() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.table_provider", false]], "tablefunction (class in datafusion)": [[7, "datafusion.TableFunction", false]], "tablefunction (class in datafusion.user_defined)": [[19, "datafusion.user_defined.TableFunction", false]], "tableproviderexportable (class in datafusion.context)": [[1, "datafusion.context.TableProviderExportable", false]], "tableproviderfactory (class in datafusion)": [[7, "datafusion.TableProviderFactory", false]], "tableproviderfactoryexportable (class in datafusion)": [[7, "datafusion.TableProviderFactoryExportable", false]], "tablescan (in module datafusion.expr)": [[4, "datafusion.expr.TableScan", false]], "tail() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.tail", false]], "tan() (datafusion.expr method)": [[7, "datafusion.Expr.tan", false]], "tan() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.tan", false]], "tan() (in module datafusion.functions)": [[5, "datafusion.functions.tan", false]], "tanh() (datafusion.expr method)": [[7, "datafusion.Expr.tanh", false]], "tanh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.tanh", false]], "tanh() (in module datafusion.functions)": [[5, "datafusion.functions.tanh", false]], "terminator (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.terminator", false]], "terminator (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.terminator", false]], "time_trunc() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.time_trunc", false]], "to_arrow_table() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.to_arrow_table", false]], "to_bytes() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.to_bytes", false]], "to_bytes() (datafusion.expr method)": [[7, "datafusion.Expr.to_bytes", false]], "to_bytes() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.to_bytes", false]], "to_bytes() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.to_bytes", false]], "to_bytes() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.to_bytes", false]], "to_bytes() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.to_bytes", false]], "to_char() (in module datafusion.functions)": [[5, "datafusion.functions.to_char", false]], "to_date() (in module datafusion.functions)": [[5, "datafusion.functions.to_date", false]], "to_hex() (datafusion.expr method)": [[7, "datafusion.Expr.to_hex", false]], "to_hex() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.to_hex", false]], "to_hex() (in module datafusion.functions)": [[5, "datafusion.functions.to_hex", false]], "to_inner() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.to_inner", false]], "to_inner() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.to_inner", false]], "to_json() (datafusion.substrait.plan method)": [[17, "datafusion.substrait.Plan.to_json", false]], "to_local_time() (in module datafusion.functions)": [[5, "datafusion.functions.to_local_time", false]], "to_pandas() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.to_pandas", false]], "to_polars() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.to_polars", false]], "to_proto() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.to_proto", false]], "to_proto() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.to_proto", false]], "to_proto() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.to_proto", false]], "to_proto() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.to_proto", false]], "to_pyarrow() (datafusion.record_batch.recordbatch method)": [[16, "datafusion.record_batch.RecordBatch.to_pyarrow", false]], "to_pyarrow() (datafusion.recordbatch method)": [[7, "datafusion.RecordBatch.to_pyarrow", false]], "to_pydict() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.to_pydict", false]], "to_pylist() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.to_pylist", false]], "to_substrait_plan() (datafusion.substrait.producer static method)": [[17, "datafusion.substrait.Producer.to_substrait_plan", false]], "to_time() (in module datafusion.functions)": [[5, "datafusion.functions.to_time", false]], "to_timestamp() (in module datafusion.functions)": [[5, "datafusion.functions.to_timestamp", false]], "to_timestamp_micros() (in module datafusion.functions)": [[5, "datafusion.functions.to_timestamp_micros", false]], "to_timestamp_millis() (in module datafusion.functions)": [[5, "datafusion.functions.to_timestamp_millis", false]], "to_timestamp_nanos() (in module datafusion.functions)": [[5, "datafusion.functions.to_timestamp_nanos", false]], "to_timestamp_seconds() (in module datafusion.functions)": [[5, "datafusion.functions.to_timestamp_seconds", false]], "to_unixtime() (in module datafusion.functions)": [[5, "datafusion.functions.to_unixtime", false]], "to_utc_timestamp() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.to_utc_timestamp", false]], "to_variant() (datafusion.expr method)": [[7, "datafusion.Expr.to_variant", false]], "to_variant() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.to_variant", false]], "to_variant() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.to_variant", false]], "to_variant() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.to_variant", false]], "today (in module datafusion.functions)": [[5, "datafusion.functions.today", false]], "transactionaccessmode (in module datafusion.expr)": [[4, "datafusion.expr.TransactionAccessMode", false]], "transactionconclusion (in module datafusion.expr)": [[4, "datafusion.expr.TransactionConclusion", false]], "transactionend (in module datafusion.expr)": [[4, "datafusion.expr.TransactionEnd", false]], "transactionisolationlevel (in module datafusion.expr)": [[4, "datafusion.expr.TransactionIsolationLevel", false]], "transactionstart (in module datafusion.expr)": [[4, "datafusion.expr.TransactionStart", false]], "transform() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.transform", false]], "translate() (in module datafusion.functions)": [[5, "datafusion.functions.translate", false]], "tree (datafusion.dataframe.explainformat attribute)": [[2, "datafusion.dataframe.ExplainFormat.TREE", false]], "tree (datafusion.explainformat attribute)": [[7, "datafusion.ExplainFormat.TREE", false]], "trim() (datafusion.expr method)": [[7, "datafusion.Expr.trim", false]], "trim() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.trim", false]], "trim() (in module datafusion.functions)": [[5, "datafusion.functions.trim", false]], "trunc() (in module datafusion.functions)": [[5, "datafusion.functions.trunc", false]], "trunc() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.trunc", false]], "truncated_rows (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.truncated_rows", false]], "truncated_rows (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.truncated_rows", false]], "try_cast() (datafusion.expr method)": [[7, "datafusion.Expr.try_cast", false]], "try_cast() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.try_cast", false]], "try_cast_to_type() (in module datafusion.functions)": [[5, "datafusion.functions.try_cast_to_type", false]], "try_parse_url() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.try_parse_url", false]], "try_sum() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.try_sum", false]], "try_url_decode() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.try_url_decode", false]], "trycast (in module datafusion.expr)": [[4, "datafusion.expr.TryCast", false]], "types() (datafusion.expr method)": [[7, "datafusion.Expr.types", false]], "types() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.types", false]], "udaf (in module datafusion)": [[7, "datafusion.udaf", false]], "udaf (in module datafusion.user_defined)": [[19, "datafusion.user_defined.udaf", false]], "udaf() (datafusion.aggregateudf static method)": [[7, "datafusion.AggregateUDF.udaf", false]], "udaf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udaf", false]], "udaf() (datafusion.user_defined.aggregateudf static method)": [[19, "datafusion.user_defined.AggregateUDF.udaf", false]], "udafs() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udafs", false]], "udf (in module datafusion)": [[7, "datafusion.udf", false]], "udf (in module datafusion.user_defined)": [[19, "datafusion.user_defined.udf", false]], "udf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udf", false]], "udf() (datafusion.scalarudf static method)": [[7, "datafusion.ScalarUDF.udf", false]], "udf() (datafusion.user_defined.scalarudf static method)": [[19, "datafusion.user_defined.ScalarUDF.udf", false]], "udfs() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udfs", false]], "udtf (in module datafusion)": [[7, "datafusion.udtf", false]], "udtf (in module datafusion.user_defined)": [[19, "datafusion.user_defined.udtf", false]], "udtf() (datafusion.tablefunction static method)": [[7, "datafusion.TableFunction.udtf", false]], "udtf() (datafusion.user_defined.tablefunction static method)": [[19, "datafusion.user_defined.TableFunction.udtf", false]], "udwf (in module datafusion)": [[7, "datafusion.udwf", false]], "udwf (in module datafusion.user_defined)": [[19, "datafusion.user_defined.udwf", false]], "udwf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udwf", false]], "udwf() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF.udwf", false]], "udwf() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF.udwf", false]], "udwfs() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udwfs", false]], "unbase64() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unbase64", false]], "uncompressed (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.UNCOMPRESSED", false]], "unhex() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unhex", false]], "union (in module datafusion.expr)": [[4, "datafusion.expr.Union", false]], "union() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.union", false]], "union_by_name() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.union_by_name", false]], "union_distinct() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.union_distinct", false]], "union_extract() (in module datafusion.functions)": [[5, "datafusion.functions.union_extract", false]], "union_tag() (in module datafusion.functions)": [[5, "datafusion.functions.union_tag", false]], "unix_date() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unix_date", false]], "unix_micros() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unix_micros", false]], "unix_millis() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unix_millis", false]], "unix_seconds() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unix_seconds", false]], "unnest (in module datafusion.expr)": [[4, "datafusion.expr.Unnest", false]], "unnest_columns() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.unnest_columns", false]], "unnestexpr (in module datafusion.expr)": [[4, "datafusion.expr.UnnestExpr", false]], "unparser (class in datafusion.unparser)": [[18, "datafusion.unparser.Unparser", false]], "unparser (datafusion.unparser.unparser attribute)": [[18, "datafusion.unparser.Unparser.unparser", false]], "update() (datafusion.accumulator method)": [[7, "datafusion.Accumulator.update", false]], "update() (datafusion.user_defined.accumulator method)": [[19, "datafusion.user_defined.Accumulator.update", false]], "upper() (datafusion.expr method)": [[7, "datafusion.Expr.upper", false]], "upper() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.upper", false]], "upper() (in module datafusion.functions)": [[5, "datafusion.functions.upper", false]], "url_decode() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.url_decode", false]], "url_encode() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.url_encode", false]], "use_shared_styles (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.use_shared_styles", false]], "uses_window_frame() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.uses_window_frame", false]], "uuid() (in module datafusion.functions)": [[5, "datafusion.functions.uuid", false]], "value (datafusion.metric property)": [[7, "datafusion.Metric.value", false]], "value (datafusion.plan.metric property)": [[15, "datafusion.plan.Metric.value", false]], "value_as_datetime (datafusion.metric property)": [[7, "datafusion.Metric.value_as_datetime", false]], "value_as_datetime (datafusion.plan.metric property)": [[15, "datafusion.plan.Metric.value_as_datetime", false]], "values (in module datafusion.expr)": [[4, "datafusion.expr.Values", false]], "var() (in module datafusion.functions)": [[5, "datafusion.functions.var", false]], "var_pop() (in module datafusion.functions)": [[5, "datafusion.functions.var_pop", false]], "var_population() (in module datafusion.functions)": [[5, "datafusion.functions.var_population", false]], "var_samp() (in module datafusion.functions)": [[5, "datafusion.functions.var_samp", false]], "var_sample() (in module datafusion.functions)": [[5, "datafusion.functions.var_sample", false]], "variant_name() (datafusion.expr method)": [[7, "datafusion.Expr.variant_name", false]], "variant_name() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.variant_name", false]], "version() (in module datafusion.functions)": [[5, "datafusion.functions.version", false]], "volatile (datafusion.user_defined.volatility attribute)": [[19, "datafusion.user_defined.Volatility.Volatile", false]], "volatility (class in datafusion.user_defined)": [[19, "datafusion.user_defined.Volatility", false]], "when() (datafusion.expr.casebuilder method)": [[4, "datafusion.expr.CaseBuilder.when", false]], "when() (in module datafusion.functions)": [[5, "datafusion.functions.when", false]], "width_bucket() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.width_bucket", false]], "window (class in datafusion.expr)": [[4, "datafusion.expr.Window", false]], "window() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.window", false]], "window_frame (datafusion.expr.windowframe attribute)": [[4, "datafusion.expr.WindowFrame.window_frame", false]], "window_frame (datafusion.windowframe attribute)": [[7, "datafusion.WindowFrame.window_frame", false]], "window_frame() (datafusion.expr method)": [[7, "datafusion.Expr.window_frame", false]], "window_frame() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.window_frame", false]], "windowevaluator (class in datafusion.user_defined)": [[19, "datafusion.user_defined.WindowEvaluator", false]], "windowexpr (in module datafusion.expr)": [[4, "datafusion.expr.WindowExpr", false]], "windowframe (class in datafusion)": [[7, "datafusion.WindowFrame", false]], "windowframe (class in datafusion.expr)": [[4, "datafusion.expr.WindowFrame", false]], "windowframebound (class in datafusion.expr)": [[4, "datafusion.expr.WindowFrameBound", false]], "windowudf (class in datafusion)": [[7, "datafusion.WindowUDF", false]], "windowudf (class in datafusion.user_defined)": [[19, "datafusion.user_defined.WindowUDF", false]], "windowudfexportable (class in datafusion.user_defined)": [[19, "datafusion.user_defined.WindowUDFExportable", false]], "with_allow_ddl() (datafusion.context.sqloptions method)": [[1, "datafusion.context.SQLOptions.with_allow_ddl", false]], "with_allow_ddl() (datafusion.sqloptions method)": [[7, "datafusion.SQLOptions.with_allow_ddl", false]], "with_allow_dml() (datafusion.context.sqloptions method)": [[1, "datafusion.context.SQLOptions.with_allow_dml", false]], "with_allow_dml() (datafusion.sqloptions method)": [[7, "datafusion.SQLOptions.with_allow_dml", false]], "with_allow_statements() (datafusion.context.sqloptions method)": [[1, "datafusion.context.SQLOptions.with_allow_statements", false]], "with_allow_statements() (datafusion.sqloptions method)": [[7, "datafusion.SQLOptions.with_allow_statements", false]], "with_batch_size() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_batch_size", false]], "with_batch_size() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_batch_size", false]], "with_column() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.with_column", false]], "with_column_renamed() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.with_column_renamed", false]], "with_columns() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.with_columns", false]], "with_comment() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_comment", false]], "with_comment() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_comment", false]], "with_create_default_catalog_and_schema() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_create_default_catalog_and_schema", false]], "with_create_default_catalog_and_schema() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_create_default_catalog_and_schema", false]], "with_default_catalog_and_schema() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_default_catalog_and_schema", false]], "with_default_catalog_and_schema() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_default_catalog_and_schema", false]], "with_delimiter() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_delimiter", false]], "with_delimiter() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_delimiter", false]], "with_disk_manager_disabled() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_disk_manager_disabled", false]], "with_disk_manager_disabled() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_disk_manager_disabled", false]], "with_disk_manager_os() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_disk_manager_os", false]], "with_disk_manager_os() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_disk_manager_os", false]], "with_disk_manager_specified() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_disk_manager_specified", false]], "with_disk_manager_specified() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_disk_manager_specified", false]], "with_escape() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_escape", false]], "with_escape() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_escape", false]], "with_extension() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_extension", false]], "with_extension() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_extension", false]], "with_fair_spill_pool() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_fair_spill_pool", false]], "with_fair_spill_pool() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_fair_spill_pool", false]], "with_file_compression_type() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_file_compression_type", false]], "with_file_compression_type() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_file_compression_type", false]], "with_file_extension() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_file_extension", false]], "with_file_extension() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_file_extension", false]], "with_file_sort_order() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_file_sort_order", false]], "with_file_sort_order() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_file_sort_order", false]], "with_greedy_memory_pool() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_greedy_memory_pool", false]], "with_greedy_memory_pool() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_greedy_memory_pool", false]], "with_has_header() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_has_header", false]], "with_has_header() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_has_header", false]], "with_information_schema() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_information_schema", false]], "with_information_schema() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_information_schema", false]], "with_logical_extension_codec() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.with_logical_extension_codec", false]], "with_metadata() (in module datafusion.functions)": [[5, "datafusion.functions.with_metadata", false]], "with_newlines_in_values() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_newlines_in_values", false]], "with_newlines_in_values() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_newlines_in_values", false]], "with_null_regex() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_null_regex", false]], "with_null_regex() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_null_regex", false]], "with_parquet_pruning() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_parquet_pruning", false]], "with_parquet_pruning() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_parquet_pruning", false]], "with_physical_extension_codec() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.with_physical_extension_codec", false]], "with_pretty() (datafusion.unparser.unparser method)": [[18, "datafusion.unparser.Unparser.with_pretty", false]], "with_python_udf_inlining() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.with_python_udf_inlining", false]], "with_quote() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_quote", false]], "with_quote() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_quote", false]], "with_repartition_aggregations() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_aggregations", false]], "with_repartition_aggregations() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_aggregations", false]], "with_repartition_file_min_size() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_file_min_size", false]], "with_repartition_file_min_size() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_file_min_size", false]], "with_repartition_file_scans() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_file_scans", false]], "with_repartition_file_scans() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_file_scans", false]], "with_repartition_joins() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_joins", false]], "with_repartition_joins() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_joins", false]], "with_repartition_sorts() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_sorts", false]], "with_repartition_sorts() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_sorts", false]], "with_repartition_windows() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_windows", false]], "with_repartition_windows() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_windows", false]], "with_schema() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_schema", false]], "with_schema() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_schema", false]], "with_schema_infer_max_records() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_schema_infer_max_records", false]], "with_schema_infer_max_records() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_schema_infer_max_records", false]], "with_table_partition_cols() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_table_partition_cols", false]], "with_table_partition_cols() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_table_partition_cols", false]], "with_target_partitions() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_target_partitions", false]], "with_target_partitions() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_target_partitions", false]], "with_temp_file_path() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_temp_file_path", false]], "with_temp_file_path() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_temp_file_path", false]], "with_terminator() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_terminator", false]], "with_terminator() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_terminator", false]], "with_truncated_rows() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_truncated_rows", false]], "with_truncated_rows() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_truncated_rows", false]], "with_unbounded_memory_pool() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_unbounded_memory_pool", false]], "with_unbounded_memory_pool() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_unbounded_memory_pool", false]], "write_batch_size (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.write_batch_size", false]], "write_batch_size (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.write_batch_size", false]], "write_csv() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.write_csv", false]], "write_json() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.write_json", false]], "write_parquet() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.write_parquet", false]], "write_parquet_with_options() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.write_parquet_with_options", false]], "write_table() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.write_table", false]], "writer_version (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.writer_version", false]], "writer_version (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.writer_version", false]], "xxhash64() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.xxhash64", false]], "zstd (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.ZSTD", false]]}, "objects": {"": [[7, 0, 0, "-", "datafusion"]], "datafusion": [[7, 1, 1, "", "Accumulator"], [7, 1, 1, "", "AggregateUDF"], [7, 1, 1, "", "Catalog"], [7, 1, 1, "", "CsvReadOptions"], [7, 5, 1, "", "DFSchema"], [7, 1, 1, "", "DataFrameWriteOptions"], [7, 1, 1, "", "ExecutionPlan"], [7, 1, 1, "", "ExplainFormat"], [7, 1, 1, "", "Expr"], [7, 1, 1, "", "InsertOp"], [7, 1, 1, "", "LogicalPlan"], [7, 1, 1, "", "Metric"], [7, 1, 1, "", "MetricsSet"], [7, 1, 1, "", "ParquetColumnOptions"], [7, 1, 1, "", "ParquetWriterOptions"], [7, 1, 1, "", "RecordBatch"], [7, 1, 1, "", "RecordBatchStream"], [7, 1, 1, "", "RuntimeEnvBuilder"], [7, 1, 1, "", "SQLOptions"], [7, 1, 1, "", "ScalarUDF"], [7, 1, 1, "", "SessionConfig"], [7, 1, 1, "", "Table"], [7, 1, 1, "", "TableFunction"], [7, 1, 1, "", "TableProviderFactory"], [7, 1, 1, "", "TableProviderFactoryExportable"], [7, 1, 1, "", "WindowFrame"], [7, 1, 1, "", "WindowUDF"], [0, 0, 0, "-", "catalog"], [7, 5, 1, "", "col"], [7, 5, 1, "", "column"], [7, 6, 1, "", "configure_formatter"], [1, 0, 0, "-", "context"], [2, 0, 0, "-", "dataframe"], [3, 0, 0, "-", "dataframe_formatter"], [4, 0, 0, "-", "expr"], [5, 0, 0, "-", "functions"], [9, 0, 0, "-", "input"], [11, 0, 0, "-", "io"], [12, 0, 0, "-", "ipc"], [7, 6, 1, "", "lit"], [7, 6, 1, "", "literal"], [13, 0, 0, "-", "object_store"], [14, 0, 0, "-", "options"], [15, 0, 0, "-", "plan"], [7, 6, 1, "", "read_avro"], [7, 6, 1, "", "read_csv"], [7, 6, 1, "", "read_json"], [7, 6, 1, "", "read_parquet"], [16, 0, 0, "-", "record_batch"], [17, 0, 0, "-", "substrait"], [7, 5, 1, "", "udaf"], [7, 5, 1, "", "udf"], [7, 5, 1, "", "udtf"], [7, 5, 1, "", "udwf"], [18, 0, 0, "-", "unparser"], [19, 0, 0, "-", "user_defined"]], "datafusion.Accumulator": [[7, 2, 1, "", "evaluate"], [7, 2, 1, "", "merge"], [7, 2, 1, "", "state"], [7, 2, 1, "", "update"]], "datafusion.AggregateUDF": [[7, 2, 1, "", "__call__"], [7, 2, 1, "", "__repr__"], [7, 2, 1, "", "_from_internal"], [7, 3, 1, "", "_udaf"], [7, 2, 1, "", "from_pycapsule"], [7, 4, 1, "", "name"], [7, 2, 1, "", "udaf"]], "datafusion.Catalog": [[7, 2, 1, "", "__repr__"], [7, 3, 1, "", "catalog"], [7, 2, 1, "", "deregister_schema"], [7, 2, 1, "", "memory_catalog"], [7, 2, 1, "", "names"], [7, 2, 1, "", "register_schema"], [7, 2, 1, "", "schema"], [7, 2, 1, "", "schema_names"]], "datafusion.CsvReadOptions": [[7, 3, 1, "", "comment"], [7, 3, 1, "", "delimiter"], [7, 3, 1, "", "escape"], [7, 3, 1, "", "file_compression_type"], [7, 3, 1, "", "file_extension"], [7, 3, 1, "", "file_sort_order"], [7, 3, 1, "", "has_header"], [7, 3, 1, "", "newlines_in_values"], [7, 3, 1, "", "null_regex"], [7, 3, 1, "", "quote"], [7, 3, 1, "", "schema"], [7, 3, 1, "", "schema_infer_max_records"], [7, 3, 1, "", "table_partition_cols"], [7, 3, 1, "", "terminator"], [7, 2, 1, "", "to_inner"], [7, 3, 1, "", "truncated_rows"], [7, 2, 1, "", "with_comment"], [7, 2, 1, "", "with_delimiter"], [7, 2, 1, "", "with_escape"], [7, 2, 1, "", "with_file_compression_type"], [7, 2, 1, "", "with_file_extension"], [7, 2, 1, "", "with_file_sort_order"], [7, 2, 1, "", "with_has_header"], [7, 2, 1, "", "with_newlines_in_values"], [7, 2, 1, "", "with_null_regex"], [7, 2, 1, "", "with_quote"], [7, 2, 1, "", "with_schema"], [7, 2, 1, "", "with_schema_infer_max_records"], [7, 2, 1, "", "with_table_partition_cols"], [7, 2, 1, "", "with_terminator"], [7, 2, 1, "", "with_truncated_rows"]], "datafusion.DataFrameWriteOptions": [[7, 3, 1, "", "_raw_write_options"]], "datafusion.ExecutionPlan": [[7, 2, 1, "", "__repr__"], [7, 3, 1, "", "_raw_plan"], [7, 2, 1, "", "children"], [7, 2, 1, "", "collect_metrics"], [7, 2, 1, "", "display"], [7, 2, 1, "", "display_indent"], [7, 2, 1, "", "from_bytes"], [7, 2, 1, "", "from_proto"], [7, 2, 1, "", "metrics"], [7, 4, 1, "", "partition_count"], [7, 2, 1, "", "to_bytes"], [7, 2, 1, "", "to_proto"]], "datafusion.ExplainFormat": [[7, 3, 1, "", "GRAPHVIZ"], [7, 3, 1, "", "INDENT"], [7, 3, 1, "", "PGJSON"], [7, 3, 1, "", "TREE"]], "datafusion.Expr": [[7, 2, 1, "", "__add__"], [7, 2, 1, "", "__and__"], [7, 2, 1, "", "__eq__"], [7, 2, 1, "", "__ge__"], [7, 2, 1, "", "__getitem__"], [7, 2, 1, "", "__gt__"], [7, 2, 1, "", "__invert__"], [7, 2, 1, "", "__le__"], [7, 2, 1, "", "__lt__"], [7, 2, 1, "", "__mod__"], [7, 2, 1, "", "__mul__"], [7, 2, 1, "", "__ne__"], [7, 2, 1, "", "__or__"], [7, 3, 1, "", "__radd__"], [7, 3, 1, "", "__rand__"], [7, 2, 1, "", "__reduce__"], [7, 2, 1, "", "__repr__"], [7, 2, 1, "", "__richcmp__"], [7, 3, 1, "", "__rmod__"], [7, 3, 1, "", "__rmul__"], [7, 3, 1, "", "__ror__"], [7, 3, 1, "", "__rsub__"], [7, 3, 1, "", "__rtruediv__"], [7, 2, 1, "", "__sub__"], [7, 2, 1, "", "__truediv__"], [7, 2, 1, "", "_reconstruct"], [7, 3, 1, "", "_to_pyarrow_types"], [7, 2, 1, "", "abs"], [7, 2, 1, "", "acos"], [7, 2, 1, "", "acosh"], [7, 2, 1, "", "alias"], [7, 2, 1, "", "array_dims"], [7, 2, 1, "", "array_distinct"], [7, 2, 1, "", "array_empty"], [7, 2, 1, "", "array_length"], [7, 2, 1, "", "array_ndims"], [7, 2, 1, "", "array_pop_back"], [7, 2, 1, "", "array_pop_front"], [7, 2, 1, "", "arrow_typeof"], [7, 2, 1, "", "ascii"], [7, 2, 1, "", "asin"], [7, 2, 1, "", "asinh"], [7, 2, 1, "", "atan"], [7, 2, 1, "", "atanh"], [7, 2, 1, "", "between"], [7, 2, 1, "", "bit_length"], [7, 2, 1, "", "btrim"], [7, 2, 1, "", "canonical_name"], [7, 2, 1, "", "cardinality"], [7, 2, 1, "", "cast"], [7, 2, 1, "", "cbrt"], [7, 2, 1, "", "ceil"], [7, 2, 1, "", "char_length"], [7, 2, 1, "", "character_length"], [7, 2, 1, "", "chr"], [7, 2, 1, "", "column"], [7, 2, 1, "", "column_name"], [7, 2, 1, "", "cos"], [7, 2, 1, "", "cosh"], [7, 2, 1, "", "cot"], [7, 2, 1, "", "degrees"], [7, 2, 1, "", "distinct"], [7, 2, 1, "", "empty"], [7, 2, 1, "", "exp"], [7, 3, 1, "", "expr"], [7, 2, 1, "", "factorial"], [7, 2, 1, "", "fill_nan"], [7, 2, 1, "", "fill_null"], [7, 2, 1, "", "filter"], [7, 2, 1, "", "flatten"], [7, 2, 1, "", "floor"], [7, 2, 1, "", "from_bytes"], [7, 2, 1, "", "from_unixtime"], [7, 2, 1, "", "initcap"], [7, 2, 1, "", "is_nan"], [7, 2, 1, "", "is_not_null"], [7, 2, 1, "", "is_null"], [7, 2, 1, "", "isnan"], [7, 2, 1, "", "iszero"], [7, 2, 1, "", "length"], [7, 2, 1, "", "list_dims"], [7, 2, 1, "", "list_distinct"], [7, 2, 1, "", "list_length"], [7, 2, 1, "", "list_ndims"], [7, 2, 1, "", "literal"], [7, 2, 1, "", "literal_with_metadata"], [7, 2, 1, "", "ln"], [7, 2, 1, "", "log10"], [7, 2, 1, "", "log2"], [7, 2, 1, "", "lower"], [7, 2, 1, "", "ltrim"], [7, 2, 1, "", "md5"], [7, 2, 1, "", "null_treatment"], [7, 2, 1, "", "octet_length"], [7, 2, 1, "", "order_by"], [7, 2, 1, "", "over"], [7, 2, 1, "", "partition_by"], [7, 2, 1, "", "python_value"], [7, 2, 1, "", "radians"], [7, 2, 1, "", "reverse"], [7, 2, 1, "", "rex_call_operands"], [7, 2, 1, "", "rex_call_operator"], [7, 2, 1, "", "rex_type"], [7, 2, 1, "", "rtrim"], [7, 2, 1, "", "schema_name"], [7, 2, 1, "", "sha224"], [7, 2, 1, "", "sha256"], [7, 2, 1, "", "sha384"], [7, 2, 1, "", "sha512"], [7, 2, 1, "", "signum"], [7, 2, 1, "", "sin"], [7, 2, 1, "", "sinh"], [7, 2, 1, "", "sort"], [7, 2, 1, "", "sqrt"], [7, 2, 1, "", "string_literal"], [7, 2, 1, "", "tan"], [7, 2, 1, "", "tanh"], [7, 2, 1, "", "to_bytes"], [7, 2, 1, "", "to_hex"], [7, 2, 1, "", "to_variant"], [7, 2, 1, "", "trim"], [7, 2, 1, "", "try_cast"], [7, 2, 1, "", "types"], [7, 2, 1, "", "upper"], [7, 2, 1, "", "variant_name"], [7, 2, 1, "", "window_frame"]], "datafusion.InsertOp": [[7, 3, 1, "", "APPEND"], [7, 3, 1, "", "OVERWRITE"], [7, 3, 1, "", "REPLACE"]], "datafusion.LogicalPlan": [[7, 2, 1, "", "__eq__"], [7, 2, 1, "", "__repr__"], [7, 3, 1, "", "_raw_plan"], [7, 2, 1, "", "display"], [7, 2, 1, "", "display_graphviz"], [7, 2, 1, "", "display_indent"], [7, 2, 1, "", "display_indent_schema"], [7, 2, 1, "", "from_bytes"], [7, 2, 1, "", "from_proto"], [7, 2, 1, "", "inputs"], [7, 2, 1, "", "to_bytes"], [7, 2, 1, "", "to_proto"], [7, 2, 1, "", "to_variant"]], "datafusion.Metric": [[7, 2, 1, "", "__repr__"], [7, 3, 1, "", "_raw"], [7, 2, 1, "", "labels"], [7, 4, 1, "", "name"], [7, 4, 1, "", "partition"], [7, 4, 1, "", "value"], [7, 4, 1, "", "value_as_datetime"]], "datafusion.MetricsSet": [[7, 2, 1, "", "__repr__"], [7, 3, 1, "", "_raw"], [7, 4, 1, "", "elapsed_compute"], [7, 2, 1, "", "metrics"], [7, 4, 1, "", "output_rows"], [7, 4, 1, "", "spill_count"], [7, 4, 1, "", "spilled_bytes"], [7, 4, 1, "", "spilled_rows"], [7, 2, 1, "", "sum_by_name"]], "datafusion.ParquetColumnOptions": [[7, 3, 1, "", "bloom_filter_enabled"], [7, 3, 1, "", "bloom_filter_fpp"], [7, 3, 1, "", "bloom_filter_ndv"], [7, 3, 1, "", "compression"], [7, 3, 1, "", "dictionary_enabled"], [7, 3, 1, "", "encoding"], [7, 3, 1, "", "statistics_enabled"]], "datafusion.ParquetWriterOptions": [[7, 3, 1, "", "allow_single_file_parallelism"], [7, 3, 1, "", "bloom_filter_fpp"], [7, 3, 1, "", "bloom_filter_ndv"], [7, 3, 1, "", "bloom_filter_on_write"], [7, 3, 1, "", "column_index_truncate_length"], [7, 3, 1, "", "column_specific_options"], [7, 3, 1, "", "created_by"], [7, 3, 1, "", "data_page_row_count_limit"], [7, 3, 1, "", "data_pagesize_limit"], [7, 3, 1, "", "dictionary_enabled"], [7, 3, 1, "", "dictionary_page_size_limit"], [7, 3, 1, "", "encoding"], [7, 3, 1, "", "max_row_group_size"], [7, 3, 1, "", "maximum_buffered_record_batches_per_stream"], [7, 3, 1, "", "maximum_parallel_row_group_writers"], [7, 3, 1, "", "skip_arrow_metadata"], [7, 3, 1, "", "statistics_enabled"], [7, 3, 1, "", "statistics_truncate_length"], [7, 3, 1, "", "write_batch_size"], [7, 3, 1, "", "writer_version"]], "datafusion.RecordBatch": [[7, 2, 1, "", "__arrow_c_array__"], [7, 3, 1, "", "record_batch"], [7, 2, 1, "", "to_pyarrow"]], "datafusion.RecordBatchStream": [[7, 2, 1, "", "__aiter__"], [7, 2, 1, "", "__anext__"], [7, 2, 1, "", "__iter__"], [7, 2, 1, "", "__next__"], [7, 2, 1, "", "next"], [7, 3, 1, "", "rbs"]], "datafusion.RuntimeEnvBuilder": [[7, 3, 1, "", "config_internal"], [7, 2, 1, "", "with_disk_manager_disabled"], [7, 2, 1, "", "with_disk_manager_os"], [7, 2, 1, "", "with_disk_manager_specified"], [7, 2, 1, "", "with_fair_spill_pool"], [7, 2, 1, "", "with_greedy_memory_pool"], [7, 2, 1, "", "with_temp_file_path"], [7, 2, 1, "", "with_unbounded_memory_pool"]], "datafusion.SQLOptions": [[7, 3, 1, "", "options_internal"], [7, 2, 1, "", "with_allow_ddl"], [7, 2, 1, "", "with_allow_dml"], [7, 2, 1, "", "with_allow_statements"]], "datafusion.ScalarUDF": [[7, 2, 1, "", "__call__"], [7, 2, 1, "", "__repr__"], [7, 2, 1, "", "_from_internal"], [7, 3, 1, "", "_udf"], [7, 2, 1, "", "from_pycapsule"], [7, 4, 1, "", "name"], [7, 2, 1, "", "udf"]], "datafusion.SessionConfig": [[7, 3, 1, "", "config_internal"], [7, 2, 1, "", "set"], [7, 2, 1, "", "with_batch_size"], [7, 2, 1, "", "with_create_default_catalog_and_schema"], [7, 2, 1, "", "with_default_catalog_and_schema"], [7, 2, 1, "", "with_extension"], [7, 2, 1, "", "with_information_schema"], [7, 2, 1, "", "with_parquet_pruning"], [7, 2, 1, "", "with_repartition_aggregations"], [7, 2, 1, "", "with_repartition_file_min_size"], [7, 2, 1, "", "with_repartition_file_scans"], [7, 2, 1, "", "with_repartition_joins"], [7, 2, 1, "", "with_repartition_sorts"], [7, 2, 1, "", "with_repartition_windows"], [7, 2, 1, "", "with_target_partitions"]], "datafusion.Table": [[7, 2, 1, "", "__repr__"], [7, 3, 1, "", "__slots__"], [7, 3, 1, "", "_inner"], [7, 2, 1, "", "from_dataset"], [7, 4, 1, "", "kind"], [7, 4, 1, "", "schema"]], "datafusion.TableFunction": [[7, 2, 1, "", "__call__"], [7, 2, 1, "", "__repr__"], [7, 2, 1, "", "_create_table_udf"], [7, 2, 1, "", "_create_table_udf_decorator"], [7, 3, 1, "", "_udtf"], [7, 2, 1, "", "udtf"]], "datafusion.TableProviderFactory": [[7, 2, 1, "", "create"]], "datafusion.TableProviderFactoryExportable": [[7, 2, 1, "", "__datafusion_table_provider_factory__"]], "datafusion.WindowFrame": [[7, 2, 1, "", "__repr__"], [7, 2, 1, "", "get_frame_units"], [7, 2, 1, "", "get_lower_bound"], [7, 2, 1, "", "get_upper_bound"], [7, 3, 1, "", "window_frame"]], "datafusion.WindowUDF": [[7, 2, 1, "", "__call__"], [7, 2, 1, "", "__repr__"], [7, 2, 1, "", "_create_window_udf"], [7, 2, 1, "", "_create_window_udf_decorator"], [7, 2, 1, "", "_from_internal"], [7, 2, 1, "", "_get_default_name"], [7, 2, 1, "", "_normalize_input_types"], [7, 3, 1, "", "_udwf"], [7, 2, 1, "", "from_pycapsule"], [7, 4, 1, "", "name"], [7, 2, 1, "", "udwf"]], "datafusion.catalog": [[0, 1, 1, "", "Catalog"], [0, 1, 1, "", "CatalogList"], [0, 1, 1, "", "CatalogProvider"], [0, 1, 1, "", "CatalogProviderList"], [0, 1, 1, "", "Schema"], [0, 1, 1, "", "SchemaProvider"], [0, 1, 1, "", "Table"]], "datafusion.catalog.Catalog": [[0, 2, 1, "", "__repr__"], [0, 3, 1, "", "catalog"], [0, 2, 1, "", "deregister_schema"], [0, 2, 1, "", "memory_catalog"], [0, 2, 1, "", "names"], [0, 2, 1, "", "register_schema"], [0, 2, 1, "", "schema"], [0, 2, 1, "", "schema_names"]], "datafusion.catalog.CatalogList": [[0, 2, 1, "", "__repr__"], [0, 2, 1, "", "catalog"], [0, 3, 1, "", "catalog_list"], [0, 2, 1, "", "catalog_names"], [0, 2, 1, "", "memory_catalog"], [0, 2, 1, "", "names"], [0, 2, 1, "", "register_catalog"]], "datafusion.catalog.CatalogProvider": [[0, 2, 1, "", "deregister_schema"], [0, 2, 1, "", "register_schema"], [0, 2, 1, "", "schema"], [0, 2, 1, "", "schema_names"]], "datafusion.catalog.CatalogProviderList": [[0, 2, 1, "", "catalog"], [0, 2, 1, "", "catalog_names"], [0, 2, 1, "", "register_catalog"]], "datafusion.catalog.Schema": [[0, 2, 1, "", "__repr__"], [0, 3, 1, "", "_raw_schema"], [0, 2, 1, "", "deregister_table"], [0, 2, 1, "", "memory_schema"], [0, 2, 1, "", "names"], [0, 2, 1, "", "register_table"], [0, 2, 1, "", "table"], [0, 2, 1, "", "table_exist"], [0, 2, 1, "", "table_names"]], "datafusion.catalog.SchemaProvider": [[0, 2, 1, "", "deregister_table"], [0, 2, 1, "", "owner_name"], [0, 2, 1, "", "register_table"], [0, 2, 1, "", "table"], [0, 2, 1, "", "table_exist"], [0, 2, 1, "", "table_names"]], "datafusion.catalog.Table": [[0, 2, 1, "", "__repr__"], [0, 3, 1, "", "__slots__"], [0, 3, 1, "", "_inner"], [0, 2, 1, "", "from_dataset"], [0, 4, 1, "", "kind"], [0, 4, 1, "", "schema"]], "datafusion.context": [[1, 1, 1, "", "ArrowArrayExportable"], [1, 1, 1, "", "ArrowStreamExportable"], [1, 1, 1, "", "PhysicalOptimizerRuleExportable"], [1, 1, 1, "", "RuntimeEnvBuilder"], [1, 1, 1, "", "SQLOptions"], [1, 1, 1, "", "SessionConfig"], [1, 1, 1, "", "SessionContext"], [1, 1, 1, "", "TableProviderExportable"]], "datafusion.context.ArrowArrayExportable": [[1, 2, 1, "", "__arrow_c_array__"]], "datafusion.context.ArrowStreamExportable": [[1, 2, 1, "", "__arrow_c_stream__"]], "datafusion.context.PhysicalOptimizerRuleExportable": [[1, 2, 1, "", "__datafusion_physical_optimizer_rule__"]], "datafusion.context.RuntimeEnvBuilder": [[1, 3, 1, "", "config_internal"], [1, 2, 1, "", "with_disk_manager_disabled"], [1, 2, 1, "", "with_disk_manager_os"], [1, 2, 1, "", "with_disk_manager_specified"], [1, 2, 1, "", "with_fair_spill_pool"], [1, 2, 1, "", "with_greedy_memory_pool"], [1, 2, 1, "", "with_temp_file_path"], [1, 2, 1, "", "with_unbounded_memory_pool"]], "datafusion.context.SQLOptions": [[1, 3, 1, "", "options_internal"], [1, 2, 1, "", "with_allow_ddl"], [1, 2, 1, "", "with_allow_dml"], [1, 2, 1, "", "with_allow_statements"]], "datafusion.context.SessionConfig": [[1, 3, 1, "", "config_internal"], [1, 2, 1, "", "set"], [1, 2, 1, "", "with_batch_size"], [1, 2, 1, "", "with_create_default_catalog_and_schema"], [1, 2, 1, "", "with_default_catalog_and_schema"], [1, 2, 1, "", "with_extension"], [1, 2, 1, "", "with_information_schema"], [1, 2, 1, "", "with_parquet_pruning"], [1, 2, 1, "", "with_repartition_aggregations"], [1, 2, 1, "", "with_repartition_file_min_size"], [1, 2, 1, "", "with_repartition_file_scans"], [1, 2, 1, "", "with_repartition_joins"], [1, 2, 1, "", "with_repartition_sorts"], [1, 2, 1, "", "with_repartition_windows"], [1, 2, 1, "", "with_target_partitions"]], "datafusion.context.SessionContext": [[1, 2, 1, "", "__datafusion_logical_extension_codec__"], [1, 2, 1, "", "__datafusion_physical_extension_codec__"], [1, 2, 1, "", "__datafusion_task_context_provider__"], [1, 2, 1, "", "__repr__"], [1, 2, 1, "", "_convert_file_sort_order"], [1, 2, 1, "", "_convert_table_partition_cols"], [1, 2, 1, "", "_register_object_store_for_path"], [1, 2, 1, "", "add_physical_optimizer_rule"], [1, 2, 1, "", "catalog"], [1, 2, 1, "", "catalog_names"], [1, 2, 1, "", "copied_config"], [1, 2, 1, "", "create_dataframe"], [1, 2, 1, "", "create_dataframe_from_logical_plan"], [1, 3, 1, "", "ctx"], [1, 2, 1, "", "deregister_object_store"], [1, 2, 1, "", "deregister_table"], [1, 2, 1, "", "deregister_udaf"], [1, 2, 1, "", "deregister_udf"], [1, 2, 1, "", "deregister_udtf"], [1, 2, 1, "", "deregister_udwf"], [1, 2, 1, "", "empty_table"], [1, 2, 1, "", "enable_ident_normalization"], [1, 2, 1, "", "enable_spark_functions"], [1, 2, 1, "", "enable_url_table"], [1, 2, 1, "", "execute"], [1, 2, 1, "", "execute_logical_plan"], [1, 2, 1, "", "from_arrow"], [1, 2, 1, "", "from_pandas"], [1, 2, 1, "", "from_polars"], [1, 2, 1, "", "from_pydict"], [1, 2, 1, "", "from_pylist"], [1, 2, 1, "", "global_ctx"], [1, 2, 1, "", "parse_capacity_limit"], [1, 2, 1, "", "parse_sql_expr"], [1, 2, 1, "", "read_arrow"], [1, 2, 1, "", "read_avro"], [1, 2, 1, "", "read_batch"], [1, 2, 1, "", "read_batches"], [1, 2, 1, "", "read_csv"], [1, 2, 1, "", "read_empty"], [1, 2, 1, "", "read_json"], [1, 2, 1, "", "read_parquet"], [1, 2, 1, "", "read_table"], [1, 2, 1, "", "refresh_catalogs"], [1, 2, 1, "", "register_arrow"], [1, 2, 1, "", "register_avro"], [1, 2, 1, "", "register_batch"], [1, 2, 1, "", "register_catalog_provider"], [1, 2, 1, "", "register_catalog_provider_list"], [1, 2, 1, "", "register_csv"], [1, 2, 1, "", "register_dataset"], [1, 2, 1, "", "register_json"], [1, 2, 1, "", "register_listing_table"], [1, 2, 1, "", "register_object_store"], [1, 2, 1, "", "register_parquet"], [1, 2, 1, "", "register_record_batches"], [1, 2, 1, "", "register_table"], [1, 2, 1, "", "register_table_factory"], [1, 2, 1, "", "register_table_provider"], [1, 2, 1, "", "register_udaf"], [1, 2, 1, "", "register_udf"], [1, 2, 1, "", "register_udtf"], [1, 2, 1, "", "register_udwf"], [1, 2, 1, "", "register_view"], [1, 2, 1, "", "remove_optimizer_rule"], [1, 2, 1, "", "session_id"], [1, 2, 1, "", "session_start_time"], [1, 2, 1, "", "sql"], [1, 2, 1, "", "sql_with_options"], [1, 2, 1, "", "table"], [1, 2, 1, "", "table_exist"], [1, 2, 1, "", "table_provider"], [1, 2, 1, "", "udaf"], [1, 2, 1, "", "udafs"], [1, 2, 1, "", "udf"], [1, 2, 1, "", "udfs"], [1, 2, 1, "", "udwf"], [1, 2, 1, "", "udwfs"], [1, 2, 1, "", "with_logical_extension_codec"], [1, 2, 1, "", "with_physical_extension_codec"], [1, 2, 1, "", "with_python_udf_inlining"]], "datafusion.context.TableProviderExportable": [[1, 2, 1, "", "__datafusion_table_provider__"]], "datafusion.dataframe": [[2, 1, 1, "", "Compression"], [2, 1, 1, "", "DataFrame"], [2, 1, 1, "", "DataFrameWriteOptions"], [2, 1, 1, "", "ExplainFormat"], [2, 1, 1, "", "InsertOp"], [2, 1, 1, "", "ParquetColumnOptions"], [2, 1, 1, "", "ParquetWriterOptions"]], "datafusion.dataframe.Compression": [[2, 3, 1, "", "BROTLI"], [2, 3, 1, "", "GZIP"], [2, 3, 1, "", "LZ4"], [2, 3, 1, "", "LZ4_RAW"], [2, 3, 1, "", "SNAPPY"], [2, 3, 1, "", "UNCOMPRESSED"], [2, 3, 1, "", "ZSTD"], [2, 2, 1, "", "from_str"], [2, 2, 1, "", "get_default_level"]], "datafusion.dataframe.DataFrame": [[2, 2, 1, "", "__aiter__"], [2, 2, 1, "", "__arrow_c_stream__"], [2, 2, 1, "", "__getitem__"], [2, 2, 1, "", "__iter__"], [2, 2, 1, "", "__repr__"], [2, 2, 1, "", "_repr_html_"], [2, 2, 1, "", "aggregate"], [2, 2, 1, "", "alias"], [2, 2, 1, "", "cache"], [2, 2, 1, "", "cast"], [2, 2, 1, "", "col"], [2, 2, 1, "", "collect"], [2, 2, 1, "", "collect_column"], [2, 2, 1, "", "collect_partitioned"], [2, 2, 1, "", "column"], [2, 2, 1, "", "count"], [2, 2, 1, "", "default_str_repr"], [2, 2, 1, "", "describe"], [2, 3, 1, "", "df"], [2, 2, 1, "", "distinct"], [2, 2, 1, "", "distinct_on"], [2, 2, 1, "", "drop"], [2, 2, 1, "", "except_all"], [2, 2, 1, "", "execute_stream"], [2, 2, 1, "", "execute_stream_partitioned"], [2, 2, 1, "", "execution_plan"], [2, 2, 1, "", "explain"], [2, 2, 1, "", "fill_null"], [2, 2, 1, "", "filter"], [2, 2, 1, "", "find_qualified_columns"], [2, 2, 1, "", "head"], [2, 2, 1, "", "intersect"], [2, 2, 1, "", "into_view"], [2, 2, 1, "", "join"], [2, 2, 1, "", "join_on"], [2, 2, 1, "", "limit"], [2, 2, 1, "", "logical_plan"], [2, 2, 1, "", "optimized_logical_plan"], [2, 2, 1, "", "parse_sql_expr"], [2, 2, 1, "", "repartition"], [2, 2, 1, "", "repartition_by_hash"], [2, 2, 1, "", "schema"], [2, 2, 1, "", "select"], [2, 2, 1, "", "select_exprs"], [2, 2, 1, "", "show"], [2, 2, 1, "", "sort"], [2, 2, 1, "", "sort_by"], [2, 2, 1, "", "tail"], [2, 2, 1, "", "to_arrow_table"], [2, 2, 1, "", "to_pandas"], [2, 2, 1, "", "to_polars"], [2, 2, 1, "", "to_pydict"], [2, 2, 1, "", "to_pylist"], [2, 2, 1, "", "transform"], [2, 2, 1, "", "union"], [2, 2, 1, "", "union_by_name"], [2, 2, 1, "", "union_distinct"], [2, 2, 1, "", "unnest_columns"], [2, 2, 1, "", "window"], [2, 2, 1, "", "with_column"], [2, 2, 1, "", "with_column_renamed"], [2, 2, 1, "", "with_columns"], [2, 2, 1, "", "write_csv"], [2, 2, 1, "", "write_json"], [2, 2, 1, "", "write_parquet"], [2, 2, 1, "", "write_parquet_with_options"], [2, 2, 1, "", "write_table"]], "datafusion.dataframe.DataFrameWriteOptions": [[2, 3, 1, "", "_raw_write_options"]], "datafusion.dataframe.ExplainFormat": [[2, 3, 1, "", "GRAPHVIZ"], [2, 3, 1, "", "INDENT"], [2, 3, 1, "", "PGJSON"], [2, 3, 1, "", "TREE"]], "datafusion.dataframe.InsertOp": [[2, 3, 1, "", "APPEND"], [2, 3, 1, "", "OVERWRITE"], [2, 3, 1, "", "REPLACE"]], "datafusion.dataframe.ParquetColumnOptions": [[2, 3, 1, "", "bloom_filter_enabled"], [2, 3, 1, "", "bloom_filter_fpp"], [2, 3, 1, "", "bloom_filter_ndv"], [2, 3, 1, "", "compression"], [2, 3, 1, "", "dictionary_enabled"], [2, 3, 1, "", "encoding"], [2, 3, 1, "", "statistics_enabled"]], "datafusion.dataframe.ParquetWriterOptions": [[2, 3, 1, "", "allow_single_file_parallelism"], [2, 3, 1, "", "bloom_filter_fpp"], [2, 3, 1, "", "bloom_filter_ndv"], [2, 3, 1, "", "bloom_filter_on_write"], [2, 3, 1, "", "column_index_truncate_length"], [2, 3, 1, "", "column_specific_options"], [2, 3, 1, "", "created_by"], [2, 3, 1, "", "data_page_row_count_limit"], [2, 3, 1, "", "data_pagesize_limit"], [2, 3, 1, "", "dictionary_enabled"], [2, 3, 1, "", "dictionary_page_size_limit"], [2, 3, 1, "", "encoding"], [2, 3, 1, "", "max_row_group_size"], [2, 3, 1, "", "maximum_buffered_record_batches_per_stream"], [2, 3, 1, "", "maximum_parallel_row_group_writers"], [2, 3, 1, "", "skip_arrow_metadata"], [2, 3, 1, "", "statistics_enabled"], [2, 3, 1, "", "statistics_truncate_length"], [2, 3, 1, "", "write_batch_size"], [2, 3, 1, "", "writer_version"]], "datafusion.dataframe_formatter": [[3, 1, 1, "", "CellFormatter"], [3, 1, 1, "", "DataFrameHtmlFormatter"], [3, 1, 1, "", "DefaultStyleProvider"], [3, 1, 1, "", "FormatterManager"], [3, 1, 1, "", "StyleProvider"], [3, 6, 1, "", "_refresh_formatter_reference"], [3, 6, 1, "", "_validate_bool"], [3, 6, 1, "", "_validate_formatter_parameters"], [3, 6, 1, "", "_validate_positive_int"], [3, 6, 1, "", "configure_formatter"], [3, 6, 1, "", "get_formatter"], [3, 6, 1, "", "reset_formatter"], [3, 6, 1, "", "set_formatter"]], "datafusion.dataframe_formatter.CellFormatter": [[3, 2, 1, "", "__call__"]], "datafusion.dataframe_formatter.DataFrameHtmlFormatter": [[3, 2, 1, "", "_build_expandable_cell"], [3, 2, 1, "", "_build_html_footer"], [3, 2, 1, "", "_build_html_header"], [3, 2, 1, "", "_build_regular_cell"], [3, 2, 1, "", "_build_table_body"], [3, 2, 1, "", "_build_table_container_start"], [3, 2, 1, "", "_build_table_header"], [3, 3, 1, "", "_custom_cell_builder"], [3, 3, 1, "", "_custom_header_builder"], [3, 2, 1, "", "_format_cell_value"], [3, 2, 1, "", "_get_cell_value"], [3, 2, 1, "", "_get_default_css"], [3, 2, 1, "", "_get_javascript"], [3, 3, 1, "", "_max_rows"], [3, 3, 1, "", "_type_formatters"], [3, 3, 1, "", "custom_css"], [3, 3, 1, "", "enable_cell_expansion"], [3, 2, 1, "", "format_html"], [3, 2, 1, "", "format_str"], [3, 3, 1, "", "max_cell_length"], [3, 3, 1, "", "max_height"], [3, 3, 1, "", "max_memory_bytes"], [3, 4, 1, "", "max_rows"], [3, 3, 1, "", "max_width"], [3, 3, 1, "", "min_rows"], [3, 2, 1, "", "register_formatter"], [3, 4, 1, "", "repr_rows"], [3, 2, 1, "", "set_custom_cell_builder"], [3, 2, 1, "", "set_custom_header_builder"], [3, 3, 1, "", "show_truncation_message"], [3, 3, 1, "", "style_provider"], [3, 3, 1, "", "use_shared_styles"]], "datafusion.dataframe_formatter.DefaultStyleProvider": [[3, 2, 1, "", "get_cell_style"], [3, 2, 1, "", "get_header_style"]], "datafusion.dataframe_formatter.FormatterManager": [[3, 3, 1, "", "_default_formatter"], [3, 2, 1, "", "get_formatter"], [3, 2, 1, "", "set_formatter"]], "datafusion.dataframe_formatter.StyleProvider": [[3, 2, 1, "", "get_cell_style"], [3, 2, 1, "", "get_header_style"]], "datafusion.expr": [[4, 5, 1, "", "Aggregate"], [4, 5, 1, "", "AggregateFunction"], [4, 5, 1, "", "Alias"], [4, 5, 1, "", "Analyze"], [4, 5, 1, "", "Between"], [4, 5, 1, "", "BinaryExpr"], [4, 5, 1, "", "Case"], [4, 1, 1, "", "CaseBuilder"], [4, 5, 1, "", "Cast"], [4, 5, 1, "", "Column"], [4, 5, 1, "", "CopyTo"], [4, 5, 1, "", "CreateCatalog"], [4, 5, 1, "", "CreateCatalogSchema"], [4, 5, 1, "", "CreateExternalTable"], [4, 5, 1, "", "CreateFunction"], [4, 5, 1, "", "CreateFunctionBody"], [4, 5, 1, "", "CreateIndex"], [4, 5, 1, "", "CreateMemoryTable"], [4, 5, 1, "", "CreateView"], [4, 5, 1, "", "Deallocate"], [4, 5, 1, "", "DescribeTable"], [4, 5, 1, "", "Distinct"], [4, 5, 1, "", "DmlStatement"], [4, 5, 1, "", "DropCatalogSchema"], [4, 5, 1, "", "DropFunction"], [4, 5, 1, "", "DropTable"], [4, 5, 1, "", "DropView"], [4, 5, 1, "", "EXPR_TYPE_ERROR"], [4, 5, 1, "", "EmptyRelation"], [4, 5, 1, "", "Execute"], [4, 5, 1, "", "Exists"], [4, 5, 1, "", "Explain"], [4, 1, 1, "", "Expr"], [4, 5, 1, "", "Extension"], [4, 5, 1, "", "FileType"], [4, 5, 1, "", "Filter"], [4, 1, 1, "", "GroupingSet"], [4, 5, 1, "", "HigherOrderFunction"], [4, 5, 1, "", "ILike"], [4, 5, 1, "", "InList"], [4, 5, 1, "", "InSubquery"], [4, 5, 1, "", "IsFalse"], [4, 5, 1, "", "IsNotFalse"], [4, 5, 1, "", "IsNotNull"], [4, 5, 1, "", "IsNotTrue"], [4, 5, 1, "", "IsNotUnknown"], [4, 5, 1, "", "IsNull"], [4, 5, 1, "", "IsTrue"], [4, 5, 1, "", "IsUnknown"], [4, 5, 1, "", "Join"], [4, 5, 1, "", "JoinConstraint"], [4, 5, 1, "", "JoinType"], [4, 5, 1, "", "Lambda"], [4, 5, 1, "", "LambdaVariable"], [4, 5, 1, "", "Like"], [4, 5, 1, "", "Limit"], [4, 5, 1, "", "Literal"], [4, 5, 1, "", "Negative"], [4, 5, 1, "", "Not"], [4, 5, 1, "", "OperateFunctionArg"], [4, 5, 1, "", "Partitioning"], [4, 5, 1, "", "Placeholder"], [4, 5, 1, "", "Prepare"], [4, 5, 1, "", "Projection"], [4, 5, 1, "", "RecursiveQuery"], [4, 5, 1, "", "Repartition"], [4, 5, 1, "", "ScalarSubquery"], [4, 5, 1, "", "ScalarVariable"], [4, 5, 1, "", "SetVariable"], [4, 5, 1, "", "SimilarTo"], [4, 5, 1, "", "Sort"], [4, 1, 1, "", "SortExpr"], [4, 5, 1, "", "SortKey"], [4, 5, 1, "", "Subquery"], [4, 5, 1, "", "SubqueryAlias"], [4, 5, 1, "", "TableScan"], [4, 5, 1, "", "TransactionAccessMode"], [4, 5, 1, "", "TransactionConclusion"], [4, 5, 1, "", "TransactionEnd"], [4, 5, 1, "", "TransactionIsolationLevel"], [4, 5, 1, "", "TransactionStart"], [4, 5, 1, "", "TryCast"], [4, 5, 1, "", "Union"], [4, 5, 1, "", "Unnest"], [4, 5, 1, "", "UnnestExpr"], [4, 5, 1, "", "Values"], [4, 1, 1, "", "Window"], [4, 5, 1, "", "WindowExpr"], [4, 1, 1, "", "WindowFrame"], [4, 1, 1, "", "WindowFrameBound"], [4, 6, 1, "", "coerce_to_expr"], [4, 6, 1, "", "coerce_to_expr_list"], [4, 6, 1, "", "coerce_to_expr_or_none"], [4, 6, 1, "", "ensure_expr"], [4, 6, 1, "", "ensure_expr_list"]], "datafusion.expr.CaseBuilder": [[4, 3, 1, "", "case_builder"], [4, 2, 1, "", "end"], [4, 2, 1, "", "otherwise"], [4, 2, 1, "", "when"]], "datafusion.expr.Expr": [[4, 2, 1, "", "__add__"], [4, 2, 1, "", "__and__"], [4, 2, 1, "", "__eq__"], [4, 2, 1, "", "__ge__"], [4, 2, 1, "", "__getitem__"], [4, 2, 1, "", "__gt__"], [4, 2, 1, "", "__invert__"], [4, 2, 1, "", "__le__"], [4, 2, 1, "", "__lt__"], [4, 2, 1, "", "__mod__"], [4, 2, 1, "", "__mul__"], [4, 2, 1, "", "__ne__"], [4, 2, 1, "", "__or__"], [4, 3, 1, "", "__radd__"], [4, 3, 1, "", "__rand__"], [4, 2, 1, "", "__reduce__"], [4, 2, 1, "", "__repr__"], [4, 2, 1, "", "__richcmp__"], [4, 3, 1, "", "__rmod__"], [4, 3, 1, "", "__rmul__"], [4, 3, 1, "", "__ror__"], [4, 3, 1, "", "__rsub__"], [4, 3, 1, "", "__rtruediv__"], [4, 2, 1, "", "__sub__"], [4, 2, 1, "", "__truediv__"], [4, 2, 1, "", "_reconstruct"], [4, 3, 1, "", "_to_pyarrow_types"], [4, 2, 1, "", "abs"], [4, 2, 1, "", "acos"], [4, 2, 1, "", "acosh"], [4, 2, 1, "", "alias"], [4, 2, 1, "", "array_dims"], [4, 2, 1, "", "array_distinct"], [4, 2, 1, "", "array_empty"], [4, 2, 1, "", "array_length"], [4, 2, 1, "", "array_ndims"], [4, 2, 1, "", "array_pop_back"], [4, 2, 1, "", "array_pop_front"], [4, 2, 1, "", "arrow_typeof"], [4, 2, 1, "", "ascii"], [4, 2, 1, "", "asin"], [4, 2, 1, "", "asinh"], [4, 2, 1, "", "atan"], [4, 2, 1, "", "atanh"], [4, 2, 1, "", "between"], [4, 2, 1, "", "bit_length"], [4, 2, 1, "", "btrim"], [4, 2, 1, "", "canonical_name"], [4, 2, 1, "", "cardinality"], [4, 2, 1, "", "cast"], [4, 2, 1, "", "cbrt"], [4, 2, 1, "", "ceil"], [4, 2, 1, "", "char_length"], [4, 2, 1, "", "character_length"], [4, 2, 1, "", "chr"], [4, 2, 1, "", "column"], [4, 2, 1, "", "column_name"], [4, 2, 1, "", "cos"], [4, 2, 1, "", "cosh"], [4, 2, 1, "", "cot"], [4, 2, 1, "", "degrees"], [4, 2, 1, "", "distinct"], [4, 2, 1, "", "empty"], [4, 2, 1, "", "exp"], [4, 3, 1, "", "expr"], [4, 2, 1, "", "factorial"], [4, 2, 1, "", "fill_nan"], [4, 2, 1, "", "fill_null"], [4, 2, 1, "", "filter"], [4, 2, 1, "", "flatten"], [4, 2, 1, "", "floor"], [4, 2, 1, "", "from_bytes"], [4, 2, 1, "", "from_unixtime"], [4, 2, 1, "", "initcap"], [4, 2, 1, "", "is_nan"], [4, 2, 1, "", "is_not_null"], [4, 2, 1, "", "is_null"], [4, 2, 1, "", "isnan"], [4, 2, 1, "", "iszero"], [4, 2, 1, "", "length"], [4, 2, 1, "", "list_dims"], [4, 2, 1, "", "list_distinct"], [4, 2, 1, "", "list_length"], [4, 2, 1, "", "list_ndims"], [4, 2, 1, "", "literal"], [4, 2, 1, "", "literal_with_metadata"], [4, 2, 1, "", "ln"], [4, 2, 1, "", "log10"], [4, 2, 1, "", "log2"], [4, 2, 1, "", "lower"], [4, 2, 1, "", "ltrim"], [4, 2, 1, "", "md5"], [4, 2, 1, "", "null_treatment"], [4, 2, 1, "", "octet_length"], [4, 2, 1, "", "order_by"], [4, 2, 1, "", "over"], [4, 2, 1, "", "partition_by"], [4, 2, 1, "", "python_value"], [4, 2, 1, "", "radians"], [4, 2, 1, "", "reverse"], [4, 2, 1, "", "rex_call_operands"], [4, 2, 1, "", "rex_call_operator"], [4, 2, 1, "", "rex_type"], [4, 2, 1, "", "rtrim"], [4, 2, 1, "", "schema_name"], [4, 2, 1, "", "sha224"], [4, 2, 1, "", "sha256"], [4, 2, 1, "", "sha384"], [4, 2, 1, "", "sha512"], [4, 2, 1, "", "signum"], [4, 2, 1, "", "sin"], [4, 2, 1, "", "sinh"], [4, 2, 1, "", "sort"], [4, 2, 1, "", "sqrt"], [4, 2, 1, "", "string_literal"], [4, 2, 1, "", "tan"], [4, 2, 1, "", "tanh"], [4, 2, 1, "", "to_bytes"], [4, 2, 1, "", "to_hex"], [4, 2, 1, "", "to_variant"], [4, 2, 1, "", "trim"], [4, 2, 1, "", "try_cast"], [4, 2, 1, "", "types"], [4, 2, 1, "", "upper"], [4, 2, 1, "", "variant_name"], [4, 2, 1, "", "window_frame"]], "datafusion.expr.GroupingSet": [[4, 2, 1, "", "cube"], [4, 2, 1, "", "grouping_sets"], [4, 2, 1, "", "rollup"]], "datafusion.expr.SortExpr": [[4, 2, 1, "", "__repr__"], [4, 2, 1, "", "ascending"], [4, 2, 1, "", "expr"], [4, 2, 1, "", "nulls_first"], [4, 3, 1, "", "raw_sort"]], "datafusion.expr.Window": [[4, 3, 1, "", "_null_treatment"], [4, 3, 1, "", "_order_by"], [4, 3, 1, "", "_partition_by"], [4, 3, 1, "", "_window_frame"]], "datafusion.expr.WindowFrame": [[4, 2, 1, "", "__repr__"], [4, 2, 1, "", "get_frame_units"], [4, 2, 1, "", "get_lower_bound"], [4, 2, 1, "", "get_upper_bound"], [4, 3, 1, "", "window_frame"]], "datafusion.expr.WindowFrameBound": [[4, 3, 1, "", "frame_bound"], [4, 2, 1, "", "get_offset"], [4, 2, 1, "", "is_current_row"], [4, 2, 1, "", "is_following"], [4, 2, 1, "", "is_preceding"], [4, 2, 1, "", "is_unbounded"]], "datafusion.functions": [[5, 6, 1, "", "abs"], [5, 6, 1, "", "acos"], [5, 6, 1, "", "acosh"], [5, 6, 1, "", "alias"], [5, 6, 1, "", "any_match"], [5, 6, 1, "", "approx_distinct"], [5, 6, 1, "", "approx_median"], [5, 6, 1, "", "approx_percentile_cont"], [5, 6, 1, "", "approx_percentile_cont_with_weight"], [5, 6, 1, "", "array"], [5, 6, 1, "", "array_agg"], [5, 6, 1, "", "array_any_match"], [5, 6, 1, "", "array_any_value"], [5, 6, 1, "", "array_append"], [5, 6, 1, "", "array_cat"], [5, 6, 1, "", "array_compact"], [5, 6, 1, "", "array_concat"], [5, 6, 1, "", "array_contains"], [5, 6, 1, "", "array_dims"], [5, 6, 1, "", "array_distance"], [5, 6, 1, "", "array_distinct"], [5, 6, 1, "", "array_element"], [5, 6, 1, "", "array_empty"], [5, 6, 1, "", "array_except"], [5, 6, 1, "", "array_extract"], [5, 6, 1, "", "array_filter"], [5, 6, 1, "", "array_has"], [5, 6, 1, "", "array_has_all"], [5, 6, 1, "", "array_has_any"], [5, 6, 1, "", "array_indexof"], [5, 6, 1, "", "array_intersect"], [5, 6, 1, "", "array_join"], [5, 6, 1, "", "array_length"], [5, 6, 1, "", "array_max"], [5, 6, 1, "", "array_min"], [5, 6, 1, "", "array_ndims"], [5, 6, 1, "", "array_normalize"], [5, 6, 1, "", "array_pop_back"], [5, 6, 1, "", "array_pop_front"], [5, 6, 1, "", "array_position"], [5, 6, 1, "", "array_positions"], [5, 6, 1, "", "array_prepend"], [5, 6, 1, "", "array_push_back"], [5, 6, 1, "", "array_push_front"], [5, 6, 1, "", "array_remove"], [5, 6, 1, "", "array_remove_all"], [5, 6, 1, "", "array_remove_n"], [5, 6, 1, "", "array_repeat"], [5, 6, 1, "", "array_replace"], [5, 6, 1, "", "array_replace_all"], [5, 6, 1, "", "array_replace_n"], [5, 6, 1, "", "array_resize"], [5, 6, 1, "", "array_reverse"], [5, 6, 1, "", "array_slice"], [5, 6, 1, "", "array_sort"], [5, 6, 1, "", "array_to_string"], [5, 6, 1, "", "array_transform"], [5, 6, 1, "", "array_union"], [5, 6, 1, "", "arrays_overlap"], [5, 6, 1, "", "arrays_zip"], [5, 6, 1, "", "arrow_cast"], [5, 6, 1, "", "arrow_field"], [5, 6, 1, "", "arrow_metadata"], [5, 6, 1, "", "arrow_try_cast"], [5, 6, 1, "", "arrow_typeof"], [5, 6, 1, "", "ascii"], [5, 6, 1, "", "asin"], [5, 6, 1, "", "asinh"], [5, 6, 1, "", "atan"], [5, 6, 1, "", "atan2"], [5, 6, 1, "", "atanh"], [5, 6, 1, "", "avg"], [5, 6, 1, "", "bit_and"], [5, 6, 1, "", "bit_length"], [5, 6, 1, "", "bit_or"], [5, 6, 1, "", "bit_xor"], [5, 6, 1, "", "bool_and"], [5, 6, 1, "", "bool_or"], [5, 6, 1, "", "btrim"], [5, 6, 1, "", "cardinality"], [5, 6, 1, "", "case"], [5, 6, 1, "", "cast_to_type"], [5, 6, 1, "", "cbrt"], [5, 6, 1, "", "ceil"], [5, 6, 1, "", "char_length"], [5, 6, 1, "", "character_length"], [5, 6, 1, "", "chr"], [5, 6, 1, "", "coalesce"], [5, 6, 1, "", "col"], [5, 6, 1, "", "concat"], [5, 6, 1, "", "concat_ws"], [5, 6, 1, "", "contains"], [5, 6, 1, "", "corr"], [5, 6, 1, "", "cos"], [5, 6, 1, "", "cosh"], [5, 6, 1, "", "cosine_distance"], [5, 6, 1, "", "cot"], [5, 6, 1, "", "count"], [5, 6, 1, "", "count_star"], [5, 6, 1, "", "covar"], [5, 6, 1, "", "covar_pop"], [5, 6, 1, "", "covar_samp"], [5, 6, 1, "", "cume_dist"], [5, 6, 1, "", "current_date"], [5, 6, 1, "", "current_time"], [5, 6, 1, "", "current_timestamp"], [5, 6, 1, "", "date_bin"], [5, 6, 1, "", "date_format"], [5, 6, 1, "", "date_part"], [5, 6, 1, "", "date_trunc"], [5, 6, 1, "", "datepart"], [5, 6, 1, "", "datetrunc"], [5, 6, 1, "", "decode"], [5, 6, 1, "", "degrees"], [5, 6, 1, "", "dense_rank"], [5, 6, 1, "", "digest"], [5, 6, 1, "", "dot_product"], [5, 6, 1, "", "element_at"], [5, 6, 1, "", "empty"], [5, 6, 1, "", "encode"], [5, 6, 1, "", "ends_with"], [5, 6, 1, "", "exp"], [5, 6, 1, "", "extract"], [5, 6, 1, "", "factorial"], [5, 6, 1, "", "find_in_set"], [5, 6, 1, "", "first_value"], [5, 6, 1, "", "flatten"], [5, 6, 1, "", "floor"], [5, 6, 1, "", "from_unixtime"], [5, 6, 1, "", "gcd"], [5, 6, 1, "", "gen_series"], [5, 6, 1, "", "generate_series"], [5, 6, 1, "", "get_field"], [5, 6, 1, "", "greatest"], [5, 6, 1, "", "grouping"], [5, 6, 1, "", "ifnull"], [5, 6, 1, "", "in_list"], [5, 6, 1, "", "initcap"], [5, 6, 1, "", "inner_product"], [5, 6, 1, "", "instr"], [5, 6, 1, "", "is_nan"], [5, 6, 1, "", "isnan"], [5, 6, 1, "", "iszero"], [5, 6, 1, "", "lag"], [5, 6, 1, "", "lambda_"], [5, 6, 1, "", "lambda_var"], [5, 6, 1, "", "last_value"], [5, 6, 1, "", "lcm"], [5, 6, 1, "", "lead"], [5, 6, 1, "", "least"], [5, 6, 1, "", "left"], [5, 6, 1, "", "length"], [5, 6, 1, "", "levenshtein"], [5, 6, 1, "", "list_any_match"], [5, 6, 1, "", "list_any_value"], [5, 6, 1, "", "list_append"], [5, 6, 1, "", "list_cat"], [5, 6, 1, "", "list_compact"], [5, 6, 1, "", "list_concat"], [5, 6, 1, "", "list_contains"], [5, 6, 1, "", "list_dims"], [5, 6, 1, "", "list_distance"], [5, 6, 1, "", "list_distinct"], [5, 6, 1, "", "list_element"], [5, 6, 1, "", "list_empty"], [5, 6, 1, "", "list_except"], [5, 6, 1, "", "list_extract"], [5, 6, 1, "", "list_filter"], [5, 6, 1, "", "list_has"], [5, 6, 1, "", "list_has_all"], [5, 6, 1, "", "list_has_any"], [5, 6, 1, "", "list_indexof"], [5, 6, 1, "", "list_intersect"], [5, 6, 1, "", "list_join"], [5, 6, 1, "", "list_length"], [5, 6, 1, "", "list_max"], [5, 6, 1, "", "list_min"], [5, 6, 1, "", "list_ndims"], [5, 6, 1, "", "list_normalize"], [5, 6, 1, "", "list_overlap"], [5, 6, 1, "", "list_pop_back"], [5, 6, 1, "", "list_pop_front"], [5, 6, 1, "", "list_position"], [5, 6, 1, "", "list_positions"], [5, 6, 1, "", "list_prepend"], [5, 6, 1, "", "list_push_back"], [5, 6, 1, "", "list_push_front"], [5, 6, 1, "", "list_remove"], [5, 6, 1, "", "list_remove_all"], [5, 6, 1, "", "list_remove_n"], [5, 6, 1, "", "list_repeat"], [5, 6, 1, "", "list_replace"], [5, 6, 1, "", "list_replace_all"], [5, 6, 1, "", "list_replace_n"], [5, 6, 1, "", "list_resize"], [5, 6, 1, "", "list_reverse"], [5, 6, 1, "", "list_slice"], [5, 6, 1, "", "list_sort"], [5, 6, 1, "", "list_to_string"], [5, 6, 1, "", "list_transform"], [5, 6, 1, "", "list_union"], [5, 6, 1, "", "list_zip"], [5, 6, 1, "", "ln"], [5, 6, 1, "", "log"], [5, 6, 1, "", "log10"], [5, 6, 1, "", "log2"], [5, 6, 1, "", "lower"], [5, 6, 1, "", "lpad"], [5, 6, 1, "", "ltrim"], [5, 6, 1, "", "make_array"], [5, 6, 1, "", "make_date"], [5, 6, 1, "", "make_list"], [5, 6, 1, "", "make_map"], [5, 6, 1, "", "make_time"], [5, 6, 1, "", "map_entries"], [5, 6, 1, "", "map_extract"], [5, 6, 1, "", "map_keys"], [5, 6, 1, "", "map_values"], [5, 6, 1, "", "max"], [5, 6, 1, "", "md5"], [5, 6, 1, "", "mean"], [5, 6, 1, "", "median"], [5, 6, 1, "", "min"], [5, 6, 1, "", "named_struct"], [5, 6, 1, "", "nanvl"], [5, 6, 1, "", "now"], [5, 6, 1, "", "nth_value"], [5, 6, 1, "", "ntile"], [5, 6, 1, "", "nullif"], [5, 6, 1, "", "nvl"], [5, 6, 1, "", "nvl2"], [5, 6, 1, "", "octet_length"], [5, 6, 1, "", "order_by"], [5, 6, 1, "", "overlay"], [5, 6, 1, "", "percent_rank"], [5, 6, 1, "", "percentile_cont"], [5, 6, 1, "", "pi"], [5, 6, 1, "", "position"], [5, 6, 1, "", "pow"], [5, 6, 1, "", "power"], [5, 6, 1, "", "quantile_cont"], [5, 6, 1, "", "radians"], [5, 6, 1, "", "random"], [5, 6, 1, "", "range"], [5, 6, 1, "", "rank"], [5, 6, 1, "", "regexp_count"], [5, 6, 1, "", "regexp_instr"], [5, 6, 1, "", "regexp_like"], [5, 6, 1, "", "regexp_match"], [5, 6, 1, "", "regexp_replace"], [5, 6, 1, "", "regr_avgx"], [5, 6, 1, "", "regr_avgy"], [5, 6, 1, "", "regr_count"], [5, 6, 1, "", "regr_intercept"], [5, 6, 1, "", "regr_r2"], [5, 6, 1, "", "regr_slope"], [5, 6, 1, "", "regr_sxx"], [5, 6, 1, "", "regr_sxy"], [5, 6, 1, "", "regr_syy"], [5, 6, 1, "", "repeat"], [5, 6, 1, "", "replace"], [5, 6, 1, "", "reverse"], [5, 6, 1, "", "right"], [5, 6, 1, "", "round"], [5, 6, 1, "", "row"], [5, 6, 1, "", "row_number"], [5, 6, 1, "", "rpad"], [5, 6, 1, "", "rtrim"], [5, 6, 1, "", "sha224"], [5, 6, 1, "", "sha256"], [5, 6, 1, "", "sha384"], [5, 6, 1, "", "sha512"], [5, 6, 1, "", "signum"], [5, 6, 1, "", "sin"], [5, 6, 1, "", "sinh"], [6, 0, 0, "-", "spark"], [5, 6, 1, "", "split_part"], [5, 6, 1, "", "sqrt"], [5, 6, 1, "", "starts_with"], [5, 6, 1, "", "stddev"], [5, 6, 1, "", "stddev_pop"], [5, 6, 1, "", "stddev_samp"], [5, 6, 1, "", "string_agg"], [5, 6, 1, "", "string_to_array"], [5, 6, 1, "", "string_to_list"], [5, 6, 1, "", "strpos"], [5, 6, 1, "", "struct"], [5, 6, 1, "", "substr"], [5, 6, 1, "", "substr_index"], [5, 6, 1, "", "substring"], [5, 6, 1, "", "sum"], [5, 6, 1, "", "tan"], [5, 6, 1, "", "tanh"], [5, 6, 1, "", "to_char"], [5, 6, 1, "", "to_date"], [5, 6, 1, "", "to_hex"], [5, 6, 1, "", "to_local_time"], [5, 6, 1, "", "to_time"], [5, 6, 1, "", "to_timestamp"], [5, 6, 1, "", "to_timestamp_micros"], [5, 6, 1, "", "to_timestamp_millis"], [5, 6, 1, "", "to_timestamp_nanos"], [5, 6, 1, "", "to_timestamp_seconds"], [5, 6, 1, "", "to_unixtime"], [5, 5, 1, "", "today"], [5, 6, 1, "", "translate"], [5, 6, 1, "", "trim"], [5, 6, 1, "", "trunc"], [5, 6, 1, "", "try_cast_to_type"], [5, 6, 1, "", "union_extract"], [5, 6, 1, "", "union_tag"], [5, 6, 1, "", "upper"], [5, 6, 1, "", "uuid"], [5, 6, 1, "", "var"], [5, 6, 1, "", "var_pop"], [5, 6, 1, "", "var_population"], [5, 6, 1, "", "var_samp"], [5, 6, 1, "", "var_sample"], [5, 6, 1, "", "version"], [5, 6, 1, "", "when"], [5, 6, 1, "", "with_metadata"]], "datafusion.functions.spark": [[6, 6, 1, "", "abs"], [6, 6, 1, "", "add_months"], [6, 6, 1, "", "array"], [6, 6, 1, "", "array_contains"], [6, 6, 1, "", "array_repeat"], [6, 6, 1, "", "ascii"], [6, 6, 1, "", "avg"], [6, 6, 1, "", "base64"], [6, 6, 1, "", "bin"], [6, 6, 1, "", "bit_count"], [6, 6, 1, "", "bit_get"], [6, 6, 1, "", "bitmap_bit_position"], [6, 6, 1, "", "bitmap_bucket_number"], [6, 6, 1, "", "bitmap_count"], [6, 6, 1, "", "bitwise_not"], [6, 6, 1, "", "ceil"], [6, 6, 1, "", "char"], [6, 6, 1, "", "collect_list"], [6, 6, 1, "", "collect_set"], [6, 6, 1, "", "concat"], [6, 6, 1, "", "crc32"], [6, 6, 1, "", "csc"], [6, 6, 1, "", "date_add"], [6, 6, 1, "", "date_diff"], [6, 6, 1, "", "date_part"], [6, 6, 1, "", "date_sub"], [6, 6, 1, "", "date_trunc"], [6, 6, 1, "", "elt"], [6, 6, 1, "", "expm1"], [6, 6, 1, "", "factorial"], [6, 6, 1, "", "floor"], [6, 6, 1, "", "format_string"], [6, 6, 1, "", "from_utc_timestamp"], [6, 6, 1, "", "hex"], [6, 6, 1, "", "hour"], [6, 6, 1, "", "if_"], [6, 6, 1, "", "ilike"], [6, 6, 1, "", "is_valid_utf8"], [6, 6, 1, "", "json_tuple"], [6, 6, 1, "", "last_day"], [6, 6, 1, "", "length"], [6, 6, 1, "", "like"], [6, 6, 1, "", "luhn_check"], [6, 6, 1, "", "make_dt_interval"], [6, 6, 1, "", "make_interval"], [6, 6, 1, "", "make_valid_utf8"], [6, 6, 1, "", "map_from_arrays"], [6, 6, 1, "", "map_from_entries"], [6, 6, 1, "", "minute"], [6, 6, 1, "", "modulus"], [6, 6, 1, "", "negative"], [6, 6, 1, "", "next_day"], [6, 6, 1, "", "parse_url"], [6, 6, 1, "", "pmod"], [6, 6, 1, "", "rint"], [6, 6, 1, "", "round"], [6, 6, 1, "", "sec"], [6, 6, 1, "", "second"], [6, 6, 1, "", "sha1"], [6, 6, 1, "", "sha2"], [6, 6, 1, "", "shiftleft"], [6, 6, 1, "", "shiftright"], [6, 6, 1, "", "shiftrightunsigned"], [6, 6, 1, "", "shuffle"], [6, 6, 1, "", "size"], [6, 6, 1, "", "slice"], [6, 6, 1, "", "soundex"], [6, 6, 1, "", "space"], [6, 6, 1, "", "spark_cast"], [6, 6, 1, "", "str_to_map"], [6, 6, 1, "", "substring"], [6, 6, 1, "", "time_trunc"], [6, 6, 1, "", "to_utc_timestamp"], [6, 6, 1, "", "trunc"], [6, 6, 1, "", "try_parse_url"], [6, 6, 1, "", "try_sum"], [6, 6, 1, "", "try_url_decode"], [6, 6, 1, "", "unbase64"], [6, 6, 1, "", "unhex"], [6, 6, 1, "", "unix_date"], [6, 6, 1, "", "unix_micros"], [6, 6, 1, "", "unix_millis"], [6, 6, 1, "", "unix_seconds"], [6, 6, 1, "", "url_decode"], [6, 6, 1, "", "url_encode"], [6, 6, 1, "", "width_bucket"], [6, 6, 1, "", "xxhash64"]], "datafusion.input": [[9, 1, 1, "", "LocationInputPlugin"], [8, 0, 0, "-", "base"], [10, 0, 0, "-", "location"]], "datafusion.input.LocationInputPlugin": [[9, 2, 1, "", "build_table"], [9, 2, 1, "", "is_correct_input"]], "datafusion.input.base": [[8, 1, 1, "", "BaseInputSource"]], "datafusion.input.base.BaseInputSource": [[8, 2, 1, "", "build_table"], [8, 2, 1, "", "is_correct_input"]], "datafusion.input.location": [[10, 1, 1, "", "LocationInputPlugin"]], "datafusion.input.location.LocationInputPlugin": [[10, 2, 1, "", "build_table"], [10, 2, 1, "", "is_correct_input"]], "datafusion.io": [[11, 6, 1, "", "read_avro"], [11, 6, 1, "", "read_csv"], [11, 6, 1, "", "read_json"], [11, 6, 1, "", "read_parquet"]], "datafusion.ipc": [[12, 6, 1, "", "clear_sender_ctx"], [12, 6, 1, "", "clear_worker_ctx"], [12, 6, 1, "", "get_sender_ctx"], [12, 6, 1, "", "get_worker_ctx"], [12, 6, 1, "", "set_sender_ctx"], [12, 6, 1, "", "set_worker_ctx"]], "datafusion.object_store": [[13, 5, 1, "", "AmazonS3"], [13, 5, 1, "", "GoogleCloud"], [13, 5, 1, "", "Http"], [13, 5, 1, "", "LocalFileSystem"], [13, 5, 1, "", "MicrosoftAzure"]], "datafusion.options": [[14, 1, 1, "", "CsvReadOptions"]], "datafusion.options.CsvReadOptions": [[14, 3, 1, "", "comment"], [14, 3, 1, "", "delimiter"], [14, 3, 1, "", "escape"], [14, 3, 1, "", "file_compression_type"], [14, 3, 1, "", "file_extension"], [14, 3, 1, "", "file_sort_order"], [14, 3, 1, "", "has_header"], [14, 3, 1, "", "newlines_in_values"], [14, 3, 1, "", "null_regex"], [14, 3, 1, "", "quote"], [14, 3, 1, "", "schema"], [14, 3, 1, "", "schema_infer_max_records"], [14, 3, 1, "", "table_partition_cols"], [14, 3, 1, "", "terminator"], [14, 2, 1, "", "to_inner"], [14, 3, 1, "", "truncated_rows"], [14, 2, 1, "", "with_comment"], [14, 2, 1, "", "with_delimiter"], [14, 2, 1, "", "with_escape"], [14, 2, 1, "", "with_file_compression_type"], [14, 2, 1, "", "with_file_extension"], [14, 2, 1, "", "with_file_sort_order"], [14, 2, 1, "", "with_has_header"], [14, 2, 1, "", "with_newlines_in_values"], [14, 2, 1, "", "with_null_regex"], [14, 2, 1, "", "with_quote"], [14, 2, 1, "", "with_schema"], [14, 2, 1, "", "with_schema_infer_max_records"], [14, 2, 1, "", "with_table_partition_cols"], [14, 2, 1, "", "with_terminator"], [14, 2, 1, "", "with_truncated_rows"]], "datafusion.plan": [[15, 1, 1, "", "ExecutionPlan"], [15, 1, 1, "", "LogicalPlan"], [15, 1, 1, "", "Metric"], [15, 1, 1, "", "MetricsSet"]], "datafusion.plan.ExecutionPlan": [[15, 2, 1, "", "__repr__"], [15, 3, 1, "", "_raw_plan"], [15, 2, 1, "", "children"], [15, 2, 1, "", "collect_metrics"], [15, 2, 1, "", "display"], [15, 2, 1, "", "display_indent"], [15, 2, 1, "", "from_bytes"], [15, 2, 1, "", "from_proto"], [15, 2, 1, "", "metrics"], [15, 4, 1, "", "partition_count"], [15, 2, 1, "", "to_bytes"], [15, 2, 1, "", "to_proto"]], "datafusion.plan.LogicalPlan": [[15, 2, 1, "", "__eq__"], [15, 2, 1, "", "__repr__"], [15, 3, 1, "", "_raw_plan"], [15, 2, 1, "", "display"], [15, 2, 1, "", "display_graphviz"], [15, 2, 1, "", "display_indent"], [15, 2, 1, "", "display_indent_schema"], [15, 2, 1, "", "from_bytes"], [15, 2, 1, "", "from_proto"], [15, 2, 1, "", "inputs"], [15, 2, 1, "", "to_bytes"], [15, 2, 1, "", "to_proto"], [15, 2, 1, "", "to_variant"]], "datafusion.plan.Metric": [[15, 2, 1, "", "__repr__"], [15, 3, 1, "", "_raw"], [15, 2, 1, "", "labels"], [15, 4, 1, "", "name"], [15, 4, 1, "", "partition"], [15, 4, 1, "", "value"], [15, 4, 1, "", "value_as_datetime"]], "datafusion.plan.MetricsSet": [[15, 2, 1, "", "__repr__"], [15, 3, 1, "", "_raw"], [15, 4, 1, "", "elapsed_compute"], [15, 2, 1, "", "metrics"], [15, 4, 1, "", "output_rows"], [15, 4, 1, "", "spill_count"], [15, 4, 1, "", "spilled_bytes"], [15, 4, 1, "", "spilled_rows"], [15, 2, 1, "", "sum_by_name"]], "datafusion.record_batch": [[16, 1, 1, "", "RecordBatch"], [16, 1, 1, "", "RecordBatchStream"]], "datafusion.record_batch.RecordBatch": [[16, 2, 1, "", "__arrow_c_array__"], [16, 3, 1, "", "record_batch"], [16, 2, 1, "", "to_pyarrow"]], "datafusion.record_batch.RecordBatchStream": [[16, 2, 1, "", "__aiter__"], [16, 2, 1, "", "__anext__"], [16, 2, 1, "", "__iter__"], [16, 2, 1, "", "__next__"], [16, 2, 1, "", "next"], [16, 3, 1, "", "rbs"]], "datafusion.substrait": [[17, 1, 1, "", "Consumer"], [17, 1, 1, "", "Plan"], [17, 1, 1, "", "Producer"], [17, 1, 1, "", "Serde"]], "datafusion.substrait.Consumer": [[17, 2, 1, "", "from_substrait_plan"]], "datafusion.substrait.Plan": [[17, 2, 1, "", "encode"], [17, 2, 1, "", "from_json"], [17, 3, 1, "", "plan_internal"], [17, 2, 1, "", "to_json"]], "datafusion.substrait.Producer": [[17, 2, 1, "", "to_substrait_plan"]], "datafusion.substrait.Serde": [[17, 2, 1, "", "deserialize"], [17, 2, 1, "", "deserialize_bytes"], [17, 2, 1, "", "serialize"], [17, 2, 1, "", "serialize_bytes"], [17, 2, 1, "", "serialize_to_plan"]], "datafusion.unparser": [[18, 1, 1, "", "Dialect"], [18, 1, 1, "", "Unparser"]], "datafusion.unparser.Dialect": [[18, 2, 1, "", "default"], [18, 3, 1, "", "dialect"], [18, 2, 1, "", "duckdb"], [18, 2, 1, "", "mysql"], [18, 2, 1, "", "postgres"], [18, 2, 1, "", "sqlite"]], "datafusion.unparser.Unparser": [[18, 2, 1, "", "plan_to_sql"], [18, 3, 1, "", "unparser"], [18, 2, 1, "", "with_pretty"]], "datafusion.user_defined": [[19, 1, 1, "", "Accumulator"], [19, 1, 1, "", "AggregateUDF"], [19, 1, 1, "", "AggregateUDFExportable"], [19, 1, 1, "", "LogicalExtensionCodecExportable"], [19, 1, 1, "", "PhysicalExtensionCodecExportable"], [19, 1, 1, "", "ScalarUDF"], [19, 1, 1, "", "ScalarUDFExportable"], [19, 1, 1, "", "TableFunction"], [19, 1, 1, "", "Volatility"], [19, 1, 1, "", "WindowEvaluator"], [19, 1, 1, "", "WindowUDF"], [19, 1, 1, "", "WindowUDFExportable"], [19, 5, 1, "", "_R"], [19, 6, 1, "", "_is_pycapsule"], [19, 6, 1, "", "_wrap_session_kwarg_for_udtf"], [19, 6, 1, "", "data_type_or_field_to_field"], [19, 6, 1, "", "data_types_or_fields_to_field_list"], [19, 5, 1, "", "udaf"], [19, 5, 1, "", "udf"], [19, 5, 1, "", "udtf"], [19, 5, 1, "", "udwf"]], "datafusion.user_defined.Accumulator": [[19, 2, 1, "", "evaluate"], [19, 2, 1, "", "merge"], [19, 2, 1, "", "state"], [19, 2, 1, "", "update"]], "datafusion.user_defined.AggregateUDF": [[19, 2, 1, "", "__call__"], [19, 2, 1, "", "__repr__"], [19, 2, 1, "", "_from_internal"], [19, 3, 1, "", "_udaf"], [19, 2, 1, "", "from_pycapsule"], [19, 4, 1, "", "name"], [19, 2, 1, "", "udaf"]], "datafusion.user_defined.AggregateUDFExportable": [[19, 2, 1, "", "__datafusion_aggregate_udf__"]], "datafusion.user_defined.LogicalExtensionCodecExportable": [[19, 2, 1, "", "__datafusion_logical_extension_codec__"]], "datafusion.user_defined.PhysicalExtensionCodecExportable": [[19, 2, 1, "", "__datafusion_physical_extension_codec__"]], "datafusion.user_defined.ScalarUDF": [[19, 2, 1, "", "__call__"], [19, 2, 1, "", "__repr__"], [19, 2, 1, "", "_from_internal"], [19, 3, 1, "", "_udf"], [19, 2, 1, "", "from_pycapsule"], [19, 4, 1, "", "name"], [19, 2, 1, "", "udf"]], "datafusion.user_defined.ScalarUDFExportable": [[19, 2, 1, "", "__datafusion_scalar_udf__"]], "datafusion.user_defined.TableFunction": [[19, 2, 1, "", "__call__"], [19, 2, 1, "", "__repr__"], [19, 2, 1, "", "_create_table_udf"], [19, 2, 1, "", "_create_table_udf_decorator"], [19, 3, 1, "", "_udtf"], [19, 2, 1, "", "udtf"]], "datafusion.user_defined.Volatility": [[19, 3, 1, "", "Immutable"], [19, 3, 1, "", "Stable"], [19, 3, 1, "", "Volatile"], [19, 2, 1, "", "__str__"]], "datafusion.user_defined.WindowEvaluator": [[19, 2, 1, "", "evaluate"], [19, 2, 1, "", "evaluate_all"], [19, 2, 1, "", "evaluate_all_with_rank"], [19, 2, 1, "", "get_range"], [19, 2, 1, "", "include_rank"], [19, 2, 1, "", "is_causal"], [19, 2, 1, "", "memoize"], [19, 2, 1, "", "supports_bounded_execution"], [19, 2, 1, "", "uses_window_frame"]], "datafusion.user_defined.WindowUDF": [[19, 2, 1, "", "__call__"], [19, 2, 1, "", "__repr__"], [19, 2, 1, "", "_create_window_udf"], [19, 2, 1, "", "_create_window_udf_decorator"], [19, 2, 1, "", "_from_internal"], [19, 2, 1, "", "_get_default_name"], [19, 2, 1, "", "_normalize_input_types"], [19, 3, 1, "", "_udwf"], [19, 2, 1, "", "from_pycapsule"], [19, 4, 1, "", "name"], [19, 2, 1, "", "udwf"]], "datafusion.user_defined.WindowUDFExportable": [[19, 2, 1, "", "__datafusion_window_udf__"]]}, "objnames": {"0": ["py", "module", "Python module"], "1": ["py", "class", "Python class"], "2": ["py", "method", "Python method"], "3": ["py", "attribute", "Python attribute"], "4": ["py", "property", "Python property"], "5": ["py", "data", "Python data"], "6": ["py", "function", "Python function"]}, "objtypes": {"0": "py:module", "1": "py:class", "2": "py:method", "3": "py:attribute", "4": "py:property", "5": "py:data", "6": "py:function"}, "terms": {"": [1, 2, 3, 4, 5, 6, 7, 12, 14, 15, 19, 21, 23, 26, 30, 31, 33, 35, 36, 37, 38, 39, 40, 41, 42, 44], "0": [1, 2, 4, 5, 6, 7, 15, 19, 27, 28, 29, 30, 31, 33, 34, 35, 36, 38, 39, 40, 41, 43, 44, 45, 46, 53, 54], "00": [1, 5, 6], "0000": 6, "007bff": 43, "01": [1, 5, 6, 27, 31, 34], "01t00": [5, 31], "01t12": 1, "038": 39, "04023": 5, "05": [31, 34], "05263157894737": 28, "06": [31, 34], "07": [5, 31], "08": 31, "08695652173913": 28, "09": [27, 31], "1": [1, 2, 4, 5, 6, 7, 12, 15, 19, 20, 23, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 44, 46, 47, 54], "10": [1, 2, 3, 4, 5, 6, 7, 19, 24, 27, 30, 31, 33, 34, 36, 37, 38, 39, 40, 43, 44, 46, 54], "100": [3, 5, 24, 27, 28, 36, 38, 40, 41, 42, 46, 54], "1000": [1, 3, 7, 11, 14, 29, 43], "10000000": 39, "100m": 1, "101": 28, "102": 28, "1024": [1, 2, 3, 7, 43], "103": [24, 28, 40, 46], "104": [24, 40, 46, 54], "1048576": [1, 2, 7], "105": [24, 28, 40, 46], "107": 39, "109": [24, 40, 46, 54], "11": [2, 4, 7, 19, 24, 27, 31, 40, 44, 46], "110": 28, "111": [6, 24, 40, 46, 54], "112": 28, "115": [24, 28, 40, 46], "12": [2, 4, 5, 6, 7, 19, 23, 24, 27, 28, 31, 36, 40, 44, 46], "120": [5, 6, 24, 28, 40, 46], "121": 28, "122": [5, 24, 40, 46], "123": [24, 40, 46, 54], "123456789": 1, "12371": 5, "125": [5, 28, 31, 54], "128": [4, 5, 7], "13": [24, 28, 30, 31, 40, 44, 46], "130": [24, 28, 40, 46, 54], "134": 38, "135": [24, 40, 46], "14": [5, 6, 24, 27, 28, 31, 34, 40, 46], "140": 28, "14285714285714": 28, "145": [24, 28, 40, 46], "149": 54, "14h30m00": 5, "15": [5, 6, 24, 27, 28, 30, 31, 34, 38, 40, 46], "150": [24, 28, 36, 40, 46], "1579098645": 6, "1579098645000": 6, "1579098645000000": 6, "158": 54, "159": [24, 40, 46, 54], "15t00": 5, "15t12": 5, "15t14": 6, "16": [5, 7, 19, 27, 31, 39], "160": 54, "161": 54, "162": 54, "163": [28, 54], "165": [31, 54], "166666666666664": 28, "17": [27, 31, 38], "175": 29, "18": [27, 30, 31, 38], "180": 5, "18276": 6, "19": [31, 54], "190": 54, "1902": 5, "1921": 31, "195": [24, 40, 46], "1970": [5, 6, 31], "1m": [1, 2, 7], "1px": 43, "2": [1, 2, 3, 4, 5, 6, 7, 19, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 40, 41, 42, 43, 44, 46, 47, 54], "20": [1, 2, 4, 5, 6, 7, 19, 24, 28, 30, 31, 33, 37, 38, 40, 43, 44, 46, 54], "200": [28, 41, 54], "20000": [2, 7], "2001": 5, "201": 28, "2020": 6, "2021": [5, 27], "2023": 5, "2024": 5, "2026": [1, 31], "205": [24, 40, 46], "2097152": [3, 43], "20b": 6, "21": [7, 19, 27, 28, 30, 31, 38, 42], "21411": 5, "22": [2, 7, 19, 28, 40], "223": 54, "224": [4, 5, 6, 7], "229": 54, "23": [27, 28, 36, 38, 54], "23076923076923": 28, "2345": 5, "24": 27, "247": 5, "25": [3, 5, 24, 28, 31, 36, 38, 40, 42, 43, 46], "255": [5, 6], "256": [1, 4, 5, 6, 7, 35], "25806451612904": 28, "26": [7, 19, 38], "26t19": 31, "27": [5, 28, 30], "2743272264": 6, "28": [27, 38], "282": 29, "28571428571429": 28, "290": 7, "2cf24dba5fb0a30e26e83b2ac5b9e29e1b161e5c1fa7425e73043362938b9824": [1, 5, 6], "2f": 43, "2mb": [3, 43], "3": [1, 2, 4, 5, 6, 7, 19, 23, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 40, 41, 42, 46, 47, 54], "30": [1, 2, 4, 5, 6, 7, 19, 24, 28, 30, 33, 37, 38, 40, 44, 46], "300": [3, 28, 43], "309": [24, 31, 40, 46], "31": 6, "314": [24, 31, 40, 46], "318": [24, 31, 40, 46], "32": [5, 31], "33": 27, "333": 43, "33333333333333": 28, "333333333333332": 38, "333333333333336": 28, "3339": 1, "34": [1, 5, 31], "345": 6, "35": [6, 24, 27, 28, 34, 38, 40, 46], "36": [5, 27], "360": 5, "367": 29, "37085543660487": 29, "384": [4, 5, 6, 7], "39": [24, 40, 46, 54], "395": [24, 40, 46], "3rd": 5, "3x": 39, "4": [1, 2, 4, 5, 6, 7, 19, 24, 27, 28, 29, 30, 31, 34, 36, 37, 38, 40, 42, 43, 44, 46, 47, 54], "40": [2, 5, 23, 24, 28, 33, 37, 40, 44, 46], "400": 28, "401": 28, "405": [24, 31, 40, 46], "4096": 55, "41": 5, "4111111111111111": 6, "42": [5, 6, 28, 30, 40], "43": [24, 38, 40, 46, 53], "4367754540140381902": 6, "44": [24, 40, 46], "45": [6, 24, 31, 38, 40, 46], "4579": 31, "46511627906976": 28, "47": 28, "4732": 31, "48": [24, 28, 40, 46], "49": [24, 30, 40, 46], "495": [24, 40, 46], "4f": 6, "4mb": 43, "5": [2, 4, 5, 6, 7, 19, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 40, 42, 46, 47, 54], "50": [3, 5, 7, 24, 28, 33, 37, 38, 40, 41, 43, 46], "500": [3, 7], "500000": 6, "5000000": 39, "51": [27, 28, 33, 54], "512": [4, 5, 6, 7], "5129": 31, "512k": 1, "52": [24, 28, 36, 40, 45, 46], "525": [24, 31, 40, 46], "53": [28, 38, 45], "530": [24, 40, 46], "534": [24, 31, 40, 46], "54": [28, 30, 31, 45, 46], "55": [24, 28, 38, 40, 46], "555": 5, "56": [1, 5], "561": 29, "567": 5, "57": 5, "5708": 6, "58": [24, 28, 40, 46], "5811388300841898": 29, "59": [24, 40, 46], "5909090909091": 28, "59e1748777448c69de6b800d7a33bbfb9ff1b": 5, "5d41402abc4b2a76b9719d911017c592": 5, "5g": 1, "6": [1, 2, 5, 6, 7, 19, 24, 27, 28, 30, 31, 34, 36, 38, 40, 42, 44, 46, 47], "60": [4, 5, 24, 28, 33, 38, 40, 44, 46], "62": [24, 40, 46], "625": [24, 31, 40, 46], "63": [24, 28, 40, 46], "630": [24, 40, 46], "634": [24, 31, 40, 46], "64": [2, 6, 7, 23, 24, 38, 40, 46], "65": [5, 6, 24, 28, 30, 34, 38, 40, 46], "65030674846626": 28, "66": [27, 28], "666666666666664": 28, "666666666666668": 38, "66666666666667": 28, "666667": 5, "67": [28, 30, 38], "68": 28, "682": 29, "684358312": 31, "7": [5, 6, 24, 27, 28, 31, 34, 38, 40, 46], "70": [24, 28, 38, 40, 46], "70000000000002": 28, "71": [28, 30], "714": 5, "716": 29, "72": 28, "73": [27, 28], "732": 31, "7384": 6, "75": [5, 24, 28, 38, 40, 46, 54], "76": 28, "78": [24, 27, 40, 46, 54], "785714285714285": 28, "78571428571429": 28, "79": [24, 27, 40, 46], "8": [2, 5, 6, 24, 27, 28, 30, 31, 34, 36, 38, 39, 40, 44, 46], "80": [5, 24, 28, 38, 40, 46], "81": [27, 28], "82": [24, 40, 46, 54], "83": [24, 40, 46, 54], "833333333333336": 28, "84": [24, 38, 40, 46, 54], "85": [24, 28, 38, 40, 46], "855": 31, "86": 28, "867": 29, "87": 38, "88888888888889": 28, "8px": 43, "9": [5, 7, 19, 23, 24, 27, 28, 31, 34, 36, 38, 40, 46, 54], "90": [5, 24, 28, 38, 40, 46], "91": 28, "92": 27, "93": 28, "94": [27, 34, 38], "95": [27, 28, 38, 54], "96": [27, 28], "97": 5, "972": 31, "9795": 5, "98": [28, 54], "9b71d224bd62f3785d96d46ad3ea3d73319bfb": 5, "A": [0, 1, 2, 4, 5, 6, 7, 8, 15, 17, 19, 27, 29, 30, 33, 36, 38, 40, 41, 42, 43, 44, 49, 53, 55], "AND": [2, 4, 5, 7, 19, 36], "AS": [1, 2, 36, 41], "As": [5, 7, 19, 21, 30, 34, 36, 40], "At": [5, 21, 36], "BY": [4, 19], "Be": 2, "But": 28, "By": [2, 7, 14, 21, 23, 28, 40], "For": [1, 2, 4, 5, 6, 7, 15, 17, 18, 19, 21, 23, 26, 27, 28, 30, 31, 33, 34, 36, 39, 41, 42, 43, 44, 46, 55], "IN": 30, "INTO": [1, 7], "If": [0, 1, 2, 3, 4, 5, 7, 8, 11, 12, 14, 19, 21, 23, 28, 30, 31, 33, 36, 38, 40, 41, 44, 45, 46, 49, 53, 54], "In": [5, 7, 19, 21, 23, 27, 28, 29, 30, 31, 33, 36, 38, 40, 43, 44, 46, 54], "It": [1, 2, 3, 4, 5, 7, 19, 21, 24, 26, 27, 28, 30, 33, 36, 41, 44, 52, 55], "Its": [24, 30], "NOT": 6, "No": [2, 7], "Not": [2, 4, 7], "OR": [4, 5, 7], "On": [2, 12, 21, 40], "One": [2, 4, 5, 21, 28, 38, 40], "Or": [2, 39], "THE": 5, "That": [4, 7], "The": [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 12, 15, 17, 19, 22, 23, 24, 26, 27, 28, 29, 30, 31, 32, 33, 35, 36, 38, 39, 40, 41, 42, 43, 44, 45, 47, 54, 55], "Then": [36, 44], "There": [2, 5, 7, 31, 36, 40, 44], "These": [1, 2, 5, 6, 7, 16, 19, 28, 30, 33, 36, 39, 41, 42, 43, 54], "To": [2, 5, 21, 23, 30, 31, 34, 35, 36, 38, 39, 40, 41, 42, 44, 46, 47, 53, 54, 55], "Will": [2, 43], "With": [1, 2, 4, 5, 7, 15, 28, 42, 44, 46, 47], "_": 21, "__add__": [4, 7], "__aiter__": [2, 7, 16], "__and__": [4, 7], "__anext__": [7, 16], "__arrow_c_array__": [1, 7, 16, 47], "__arrow_c_stream__": [1, 2, 42, 47], "__call__": [3, 7, 19], "__datafusion_aggregate_udf__": 19, "__datafusion_catalog_provider__": 55, "__datafusion_logical_extension_codec__": [1, 19, 55], "__datafusion_physical_extension_codec__": [1, 19], "__datafusion_physical_optimizer_rule__": 1, "__datafusion_scalar_udf__": 19, "__datafusion_schema_provider__": 55, "__datafusion_table_function__": [7, 19, 36, 55], "__datafusion_table_provider__": [1, 21, 53, 55], "__datafusion_table_provider_factory__": 7, "__datafusion_task_context_provider__": 1, "__datafusion_window_udf__": 19, "__eq__": [4, 7, 15], "__ge__": [4, 7], "__getitem__": [2, 4, 7], "__gt__": [4, 7], "__init__": [7, 12, 19, 36], "__invert__": [4, 7], "__iter__": [2, 7, 16], "__le__": [4, 7], "__lt__": [4, 7], "__main__": 44, "__mod__": [4, 7], "__mul__": [4, 7], "__name__": 44, "__ne__": [4, 7], "__next__": [7, 16], "__or__": [4, 7], "__radd__": [4, 7], "__rand__": [4, 7], "__reduce__": [4, 7], "__repr__": [0, 1, 2, 3, 4, 7, 15, 19, 43], "__richcmp__": [4, 7], "__rmod__": [4, 7], "__rmul__": [4, 7], "__ror__": [4, 7], "__rsub__": [4, 7], "__rtruediv__": [4, 7], "__slots__": [0, 7], "__str__": 19, "__sub__": [4, 7], "__truediv__": [4, 7], "__version__": 46, "_aggreg": 5, "_build_expandable_cel": 3, "_build_html_foot": 3, "_build_html_head": 3, "_build_regular_cel": 3, "_build_table_bodi": 3, "_build_table_container_start": 3, "_build_table_head": 3, "_convert_file_sort_ord": 1, "_convert_table_partition_col": 1, "_create_table_udf": [7, 19], "_create_table_udf_decor": [7, 19], "_create_window_udf": [7, 19], "_create_window_udf_decor": [7, 19], "_ctx": 44, "_custom_cell_build": 3, "_custom_header_build": 3, "_default_formatt": 3, "_export_to_c_capsul": 2, "_format_cell_valu": 3, "_from_intern": [7, 19], "_get_cell_valu": 3, "_get_default_css": 3, "_get_default_nam": [7, 19], "_get_javascript": 3, "_inner": [0, 7], "_intern": [0, 1, 2, 4, 7, 14, 15, 16, 17, 18, 19], "_io_custom_table_provid": 36, "_is_pycapsul": 19, "_max_row": 3, "_normalize_input_typ": [7, 19], "_null_treat": 4, "_order_bi": 4, "_partition_bi": 4, "_r": [7, 19], "_raw": [7, 15], "_raw_plan": [7, 15], "_raw_schema": 0, "_raw_write_opt": [2, 7], "_reconstruct": [4, 7], "_refresh_formatter_refer": 3, "_register_object_store_for_path": 1, "_repr_html_": [2, 3, 43], "_sum": [7, 19, 36], "_to_pyarrow_typ": [4, 7], "_type_formatt": 3, "_typesh": [1, 7, 19], "_udaf": [7, 19], "_udf": [7, 19], "_udtf": [7, 19], "_udwf": [7, 19], "_validate_bool": 3, "_validate_formatter_paramet": 3, "_validate_positive_int": 3, "_window_fram": 4, "_window_funct": 5, "_wrap_session_kwarg_for_udtf": 19, "a0": 30, "a1": 5, "a_siz": 30, "aaf4c61ddcc5e8a2dabede0f3b482cd9aea9434d": 6, "ab": [1, 4, 5, 6, 7, 35, 44], "abc": [0, 1, 2, 3, 4, 5, 6, 7, 8, 19], "abcabc": 5, "abcdef": 5, "abi": 21, "abi3": 23, "abi_st": 21, "abil": [40, 54], "abl": [7, 15], "about": [17, 18, 21, 24, 38, 39, 42], "abov": [5, 21, 28, 30, 33, 38, 41, 42, 44, 54], "absent": 5, "absolut": [4, 5, 6, 7], "abstract": [0, 8, 19, 30, 36, 40, 42], "abxyef": 5, "accept": [1, 4, 5, 6, 7, 30, 33, 42, 44, 47, 55], "access": [1, 3, 7, 11, 15, 21, 30, 40, 41, 42, 43, 44, 55], "access_key_id": [1, 40], "account": 40, "accum": [7, 19], "accumul": [7, 19, 28, 36], "accur": 39, "achiev": 24, "aco": [4, 5, 7], "acosh": [4, 5, 7], "acronym": 21, "across": [3, 4, 5, 7, 12, 15, 19, 21, 28, 30, 39, 41, 43, 44, 54], "act": [7, 15], "action": [12, 42], "activ": [1, 5, 21, 23], "actor": [12, 44], "actual": [2, 39, 42], "ad": [2, 21, 40], "adapt": [19, 21], "add": [0, 1, 2, 3, 4, 5, 21, 23, 26, 42], "add_3": 2, "add_month": 6, "add_physical_optimizer_rul": 1, "addit": [2, 3, 4, 5, 7, 15, 17, 18, 19, 21, 23, 36, 39, 40, 41, 42, 49, 55], "addition": [21, 27], "adequ": 12, "adhoc": 23, "adopt": 21, "advanc": [0, 1, 2, 7, 11, 36, 40, 42], "advantag": [21, 23, 24], "advertis": 36, "affect": [1, 7, 12, 14, 19, 28, 35, 39, 43], "after": [1, 2, 3, 4, 5, 6, 7, 12, 15, 19, 33, 36, 41, 42, 43, 55], "afterward": 35, "ag": [30, 42], "against": [1, 2, 4, 5, 12, 19, 21, 24, 28, 30, 37, 43, 44], "age_col": 30, "age_in_year": 30, "agent": [7, 45], "agg": 2, "aggreg": [1, 2, 4, 5, 6, 7, 12, 15, 19, 27, 32, 35, 39, 42, 44, 45, 55], "aggregatefunct": 4, "aggregateudf": [1, 7, 19], "aggregateudfexport": [7, 19], "agk": 6, "agnost": 42, "agvsbg8": 5, "ai": [7, 45], "aim": [44, 46], "air": 30, "aiter": 2, "albert": 30, "algorithm": [2, 5], "alia": [0, 1, 2, 3, 4, 5, 6, 7, 15, 19, 27, 28, 30, 31, 34, 35, 36, 38, 42, 47], "alias": [2, 23], "alic": 33, "align": [2, 43, 44], "all": [0, 1, 2, 3, 4, 5, 6, 7, 14, 15, 19, 21, 23, 27, 28, 30, 31, 33, 34, 36, 38, 39, 40, 41, 42, 43, 47, 49, 54], "all_suppli": 28, "alloc": [2, 39], "allow": [1, 2, 3, 5, 7, 14, 16, 19, 21, 23, 24, 28, 30, 31, 36, 39, 40, 42, 43, 49, 54], "allow_single_file_parallel": [2, 7], "alon": [4, 28], "along": [26, 30], "alongsid": 4, "alpha": [36, 40], "alreadi": [1, 2, 5, 7, 19, 21, 30, 44], "also": [1, 2, 3, 4, 5, 7, 19, 21, 23, 24, 28, 30, 31, 36, 38, 41, 42, 43, 45, 46, 54], "altern": [5, 22, 34, 49, 52], "alternate_a": 2, "alwai": [4, 5, 7, 19, 41, 43, 44], "amazons3": [1, 13, 40], "ambigu": [2, 33], "amount": [2, 19, 42], "an": [0, 1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 16, 17, 19, 21, 23, 27, 28, 29, 30, 33, 34, 36, 38, 39, 40, 41, 42, 44, 45, 46, 47, 48, 49, 52, 54, 55], "analyt": 38, "analyz": [2, 4, 23, 36], "angl": 5, "ani": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 15, 19, 21, 26, 28, 30, 33, 35, 36, 38, 40, 41, 42, 43, 44, 47, 55], "annot": [23, 36], "anonym": 1, "anoth": [1, 2, 4, 5, 7, 11, 21, 30, 41, 44, 54], "anti": [2, 32], "any_match": 5, "anyth": 12, "anywher": [4, 7, 35, 43], "apach": [1, 2, 4, 5, 6, 7, 21, 23, 24, 26, 28, 31, 45, 47], "apart": [24, 28], "api": [1, 2, 4, 7, 15, 21, 23, 24, 25, 26, 31, 32, 39, 40, 42, 43, 44, 45, 54], "appar": 28, "appear": [2, 4, 5, 7, 21, 30], "append": [1, 2, 5, 7, 36, 40], "appli": [1, 2, 3, 5, 7, 12, 15, 16, 19, 28, 35, 36, 41, 43, 44], "applic": [6, 12, 21, 39], "approach": [5, 22, 28, 30, 36, 39, 40, 44, 54], "appropri": [19, 23, 36, 40, 43], "approx_distinct": [5, 28], "approx_median": [5, 28], "approx_percentile_cont": [5, 28], "approx_percentile_cont_with_weight": [5, 28], "approxim": 5, "ar": [1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 16, 19, 21, 23, 27, 28, 30, 32, 34, 36, 38, 39, 40, 42, 43, 44, 45, 46, 47, 54, 55], "arbitrari": [2, 4, 5, 7, 44], "arc": [4, 5, 7, 21, 36, 53, 55], "architectur": 39, "area": 21, "arg": [1, 2, 5, 6, 7, 17, 19, 23], "argument": [1, 2, 4, 5, 6, 7, 19, 28, 30, 36, 44, 45, 55], "arithmet": [6, 42, 44], "around": [1, 5, 23, 40, 55], "arr": [5, 7, 19, 42, 44], "arrai": [1, 2, 3, 4, 5, 6, 7, 19, 28, 32, 35, 36, 40, 42, 44, 47], "array1": 5, "array2": 5, "array_agg": [5, 28], "array_any_match": [5, 30], "array_any_valu": 5, "array_append": [5, 23], "array_cat": [5, 30], "array_compact": 5, "array_concat": [5, 30], "array_contain": [5, 6], "array_dim": [4, 5, 7], "array_dist": 5, "array_distinct": [4, 5, 7], "array_el": [4, 5, 7, 30], "array_empti": [4, 5, 7, 30], "array_except": 5, "array_extract": 5, "array_filt": [5, 30], "array_ha": 5, "array_has_al": 5, "array_has_ani": 5, "array_indexof": 5, "array_intersect": 5, "array_join": 5, "array_length": [4, 5, 7, 28], "array_max": 5, "array_min": 5, "array_ndim": [4, 5, 7], "array_norm": 5, "array_pop_back": [4, 5, 7], "array_pop_front": [4, 5, 7], "array_posit": [5, 26, 30], "array_prepend": 5, "array_push_back": 5, "array_push_front": 5, "array_remov": 5, "array_remove_al": 5, "array_remove_n": 5, "array_repeat": [5, 6, 30], "array_replac": 5, "array_replace_al": 5, "array_replace_n": 5, "array_res": 5, "array_revers": 5, "array_slic": [4, 5, 7], "array_sort": 5, "array_to_str": 5, "array_transform": [5, 30], "array_union": 5, "arrays_overlap": 5, "arrays_zip": 5, "arriv": [44, 47], "arro3": [7, 19, 36], "arrow": [1, 2, 3, 4, 5, 7, 16, 19, 22, 23, 24, 29, 30, 40, 45, 46, 50], "arrow_cast": [5, 31], "arrow_datafusion_python_root": 23, "arrow_field": 5, "arrow_ipc": 1, "arrow_metadata": 5, "arrow_schema": 1, "arrow_t": 42, "arrow_tbl": 1, "arrow_try_cast": 5, "arrow_typ": 21, "arrow_typeof": [4, 5, 7], "arrowarrai": [7, 16], "arrowarrayexport": 1, "arrowarraystream": 2, "arrowschema": [7, 16], "arrowstreamexport": 1, "articuno": 38, "arxiv": 5, "as_pi": [1, 4, 5, 6, 7, 19, 36, 44], "as_ref": [21, 55], "ascend": [2, 4, 5, 7, 28, 38, 42], "ascii": [4, 5, 6, 7, 14], "ascii_df": 5, "asin": [4, 5, 7], "asinh": [4, 5, 7], "ask": [21, 28], "assembl": 1, "assign": [2, 4, 5, 7], "assist": [23, 45], "associ": [0, 4, 5, 7, 15, 21], "assum": [5, 7, 19, 23, 40], "assumpt": 24, "async": [2, 7, 16, 42], "asynchron": [7, 16, 42], "asyncio": 42, "asynciter": 2, "atan": [4, 5, 7], "atan2": 5, "atanh": [4, 5, 7], "atk": [24, 40, 46], "attach": [4, 5, 7, 39], "attack": [24, 28, 31, 38, 40, 46, 54], "attempt": [1, 2, 7, 16, 19, 21, 23, 36], "attr_nam": 55, "attribut": [21, 30, 44], "attributed_volum": 30, "audio": 5, "author": [6, 19, 45], "auto": [6, 20], "autoapi": 20, "automat": [1, 5, 7, 15, 26, 39, 41, 42, 44], "avail": [2, 3, 4, 5, 7, 28, 32, 35, 36, 39, 40, 42, 53], "averag": [5, 19, 38], "avg": [1, 5, 6, 19, 28, 38, 55], "avoid": [1, 7, 11, 21, 44], "avro": [1, 7, 11, 40, 42, 43, 45, 50], "await": 42, "awar": [2, 34], "awkward": 30, "aws_access_key_id": 40, "aws_secret_access_kei": 40, "ax": 5, "b": [1, 2, 4, 5, 6, 7, 28, 29, 30, 35, 36, 37, 40, 42, 43, 47], "b1": 1, "b2": [1, 5], "back": [4, 7, 12, 19, 21, 24, 36, 40, 44, 47], "background": [43, 44], "backward": 3, "bag": 36, "balanc": 43, "ballista": 45, "bar": 39, "bare": [5, 6], "base": [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 14, 15, 19, 20, 26, 30, 33, 36, 39, 40, 41, 45], "base64": [5, 6], "baseinputsourc": [8, 9, 10], "basi": [2, 7, 19, 36], "basic": [7, 19, 27, 32, 34, 36, 39, 40, 45], "basic_typ": 31, "batch": [1, 2, 3, 5, 7, 15, 16, 19, 29, 36, 37, 40, 42, 44, 47], "batch_arrai": 36, "batch_siz": [1, 7, 55], "batch_tbl": 1, "becaus": [2, 4, 5, 6, 7, 19, 21, 28, 36, 40], "becca": 30, "becom": [1, 5, 6, 28, 30, 44], "beedril": [24, 38, 40, 46], "beedrillmega": [24, 40, 46], "been": [3, 4, 7, 15, 21, 36, 41, 55], "befor": [1, 2, 3, 5, 6, 7, 15, 19, 23, 30, 33, 36, 41, 43, 55], "beforehand": [1, 7], "begin": [1, 4, 5, 7, 14, 19, 43], "behav": 4, "behavior": [1, 4, 5, 7, 14], "being": [1, 2, 5], "belong": [1, 28], "below": [27, 28, 36, 40, 42, 44], "benefit": [2, 7, 39], "best": [1, 2, 7, 19, 21, 36], "beta": 40, "better": [2, 7, 43, 44], "between": [1, 4, 5, 7, 19, 21, 24, 27, 33, 36, 38, 39], "beyond": 44, "bia": [7, 19], "bias_10": [7, 19], "biased_numb": [7, 19], "biasednumb": [7, 19], "big": [5, 6], "big_onli": 30, "bigint": 6, "bin": [5, 6, 23], "binari": [4, 5, 6, 7, 15, 21, 44, 55], "binaryexpr": [4, 7], "bind": [1, 5, 6, 7, 19, 21, 23, 24, 40, 46], "bit": [4, 5, 6, 7], "bit_and": [5, 28], "bit_count": 6, "bit_df": 5, "bit_get": 6, "bit_len": 5, "bit_length": [4, 5, 7], "bit_or": [5, 28], "bit_pack": [2, 7], "bit_xor": [5, 28], "bitmap": 6, "bitmap_bit_posit": 6, "bitmap_bucket_numb": 6, "bitmap_count": 6, "bitwis": [5, 6, 26, 30], "bitwise_not": 6, "black": 43, "blake2": 5, "blake2b": 5, "blake3": 5, "blastois": [24, 40, 46], "blastoisemega": [24, 40, 46], "blob": [1, 4, 7, 12, 26, 44], "block": 44, "blog": [23, 36], "bloom": [2, 7, 36], "bloom_filter_en": [2, 7], "bloom_filter_fpp": [2, 7], "bloom_filter_ndv": [2, 7], "bloom_filter_on_writ": [2, 7], "blue": 30, "bob": 33, "bodi": [3, 5, 30], "bool": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 14, 15, 18, 19], "bool_": [1, 36], "bool_and": [5, 28], "bool_or": [5, 28], "boolean": [3, 4, 5, 7, 32, 36], "boost": [2, 7], "bootstrap": 23, "border": 43, "borrow": 21, "both": [1, 2, 4, 5, 7, 15, 19, 21, 23, 26, 28, 30, 33, 36, 42, 43, 44, 54], "bottleneck": 39, "bound": [4, 5, 7, 12, 19, 36, 38, 44, 53, 55], "boundari": [19, 21, 38, 42], "bow": 38, "box": [2, 7, 21, 36], "bracket": [5, 30], "branch": 30, "brand": 36, "brand_arr": 36, "brand_max": 36, "brand_min": 36, "brand_null_count": 36, "brand_qty_filt": 36, "break": 21, "broader": 1, "broken": 28, "bronz": 5, "brotli": [2, 7], "brown": 5, "btrim": [4, 5, 7], "bucket": [1, 6, 30, 36], "bucket_claus": 36, "bucket_nam": [1, 40], "buf": [4, 7], "bug": [21, 24, 28, 38, 40, 46], "build": [3, 4, 5, 6, 7, 21, 22, 24, 26, 27, 28, 30, 36, 42, 44, 45, 55], "build_flag": 23, "build_tabl": [8, 9, 10], "builder": [3, 4, 5, 7, 14, 26, 28, 30, 38], "built": [0, 1, 2, 4, 5, 6, 7, 12, 19, 21, 28, 30, 31, 35, 36, 41, 44, 45], "bulb": 31, "bulbafleur": 31, "bulbasaur": [24, 31, 38, 40, 46], "bulk": 21, "busi": 36, "butterfre": [24, 38, 40, 46], "button": 3, "bx": 5, "byte": [1, 2, 3, 4, 5, 6, 7, 12, 15, 17, 41, 44], "byte_stream_split": [2, 7], "bytecod": [4, 7, 12, 44], "bz2": [7, 14], "c": [1, 2, 4, 5, 7, 16, 19, 21, 23, 24, 29, 36, 40, 42, 44, 47], "c0": [5, 6], "c1": [5, 6], "c3": 5, "c_str": 55, "ca": 5, "cach": [2, 3, 7, 41], "calcul": [2, 5, 19, 30, 36], "call": [0, 1, 2, 3, 4, 5, 6, 7, 12, 15, 16, 17, 18, 19, 21, 27, 28, 30, 35, 40, 41, 42, 43, 44], "call0": 55, "callabl": [2, 3, 4, 5, 7, 12, 19, 43, 44], "callback": [7, 19, 36], "caller": [1, 5, 7, 19, 36], "can": [1, 2, 3, 4, 5, 7, 8, 9, 10, 11, 15, 19, 21, 23, 26, 27, 28, 30, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 46, 47, 49, 53, 54, 55], "can_retir": 30, "candid": 4, "cannot": [1, 4, 5, 7, 11, 30, 36, 44, 54], "canon": 21, "canonical_nam": [4, 7], "cap": 5, "cap_df": 5, "capabl": [39, 54], "capit": [4, 5, 7, 34], "capsul": [2, 4, 7, 12, 19, 21, 44, 55], "capsule_t": 53, "capsuletyp": [1, 7, 19], "captur": [4, 5, 7, 12, 28, 38, 44], "cardin": [4, 5, 7, 30], "carefulli": 21, "cargo": 23, "carlo": 30, "carri": [1, 4, 5, 7, 36, 41, 44], "cascad": [0, 7], "case": [1, 2, 4, 5, 6, 7, 19, 21, 26, 28, 30, 31, 34, 35, 36, 38, 39, 40, 44, 54], "case_build": 4, "casebuild": [4, 5], "cast": [2, 4, 5, 6, 7, 21, 32, 36, 54, 55], "cast_to_typ": 5, "castabl": [4, 7], "cat": 5, "catalog": [1, 2, 5, 7, 18, 20, 28, 36, 45, 55], "catalog_list": 0, "catalog_nam": [0, 1], "cataloglist": [0, 1], "catalogprovid": [0, 1, 40, 54, 55], "catalogproviderexport": [0, 1], "catalogproviderlist": [0, 1], "catalogproviderlistexport": 1, "categor": [5, 26], "categori": 31, "caterpi": [24, 38, 40, 46], "caus": [1, 7, 23, 38], "caveat": [4, 7, 28, 38], "cbrt": [4, 5, 7], "cbrt_df": 5, "cd": [5, 23], "cdatainterfac": [1, 2], "ceil": [4, 5, 6, 7, 35], "ceil_df": 5, "cell": [3, 4, 7, 12, 44], "cellformatt": 3, "certain": 19, "certainli": 23, "chain": [2, 7, 14], "chainabl": 2, "challeng": 21, "chang": [1, 3, 5, 7, 19, 23, 30, 36, 55], "chansei": 28, "char": [6, 31], "char_len": 5, "char_len_df": 5, "char_length": [4, 5, 7, 31], "charact": [2, 3, 4, 5, 6, 7, 14, 43, 49], "character_length": [4, 5, 7], "characterist": 39, "charizard": [24, 31, 38, 40, 46, 54], "charizardmega": [24, 31, 38, 40, 46, 54], "charli": 33, "charmand": [24, 31, 38, 40, 46], "charmeleon": [24, 31, 38, 40, 46], "check": [5, 6, 30, 31, 36], "checker": 55, "checkout": 26, "checksum": [4, 5, 7], "child": [6, 44], "children": [5, 7, 15, 41], "choos": 35, "chosen": 1, "chr": [4, 5, 7], "chrono": 5, "chunk": [2, 7], "chunkedarrai": 2, "ci": [21, 23], "citi": 28, "citycab": 33, "class": [22, 23, 28, 36, 38, 40, 43, 44, 45, 55], "classmethod": [1, 2, 3, 4, 7, 19], "classvar": [4, 7], "claud": 26, "claus": [1, 19, 36, 38], "clean": 23, "clear": [12, 44], "clear_": 44, "clear_sender_ctx": 12, "clear_worker_ctx": 12, "clefabl": 38, "clefairi": 38, "cli": 26, "click": 3, "clickhous": 30, "cline": 26, "clock": 41, "clone": [7, 19, 21, 23, 36, 53, 55], "close": [38, 44], "closur": [4, 7, 12, 19, 44], "cloud": 39, "cloudpickl": [1, 4, 7, 12, 28, 38, 44], "cluster": 44, "cmd": 7, "cn": 5, "cnt": 5, "co": [4, 5, 7], "coalesc": [2, 5, 31, 33, 41], "coalesce_duplicate_kei": [2, 33], "code": [1, 3, 4, 5, 6, 7, 21, 22, 25, 31, 40, 44, 45, 55], "codebas": 23, "codec": [1, 2, 4, 7, 12, 15, 21, 44, 55], "codex": 26, "coeffici": 5, "coerc": [4, 5], "coerce_to_expr": 4, "coerce_to_expr_list": 4, "coerce_to_expr_or_non": 4, "coercion": 2, "coexist": 44, "col": [1, 2, 3, 4, 5, 6, 7, 12, 19, 27, 28, 30, 31, 32, 34, 35, 36, 37, 38, 39, 42, 43, 44, 47, 54], "col1": [6, 19, 42], "col2": [6, 42], "col_attack": 28, "col_diff": 36, "col_idx": 3, "col_spe": 28, "col_type_1": 28, "col_type_2": 28, "collaps": 3, "collect": [1, 2, 3, 4, 5, 6, 7, 15, 19, 24, 27, 28, 29, 37, 39, 41, 42, 44, 54], "collect_column": [1, 2, 4, 5, 6, 7, 19, 42], "collect_list": [6, 28], "collect_metr": [7, 15, 41], "collect_partit": [2, 41], "collect_set": [6, 28], "collid": [2, 7], "collis": 5, "color": [30, 43], "column": [1, 2, 3, 4, 5, 6, 7, 11, 14, 16, 19, 27, 28, 29, 31, 32, 36, 38, 39, 45, 49, 54, 55], "column1": [7, 15, 41], "column_index_truncate_length": [2, 7], "column_nam": [2, 4, 7, 14], "column_specific_opt": [2, 7], "com": [6, 23, 26], "combin": [1, 2, 4, 5, 7, 11, 28, 30, 33, 34, 36, 39], "come": [1, 5, 28, 40, 51], "command": [1, 7, 23, 26, 40], "comment": [7, 14, 21], "commit": [22, 28], "common": [1, 2, 4, 5, 6, 7, 8, 9, 10, 21, 26, 28, 30, 31, 33, 35, 38, 40, 45, 47], "commun": [21, 23], "compact": 28, "compar": [5, 30, 36, 38], "comparison": [4, 5, 7, 28, 42, 44, 54], "compat": [1, 2, 3, 6, 7, 21, 28, 30, 31, 32, 42, 44, 45], "compel": 21, "compet": 39, "compil": [1, 21, 30, 41], "complement": 4, "complet": [4, 5, 7, 8, 21, 23, 36, 40, 42, 43, 53, 55], "complex": [2, 5, 24, 31, 36, 39], "complic": 2, "compon": [1, 5, 6], "compos": 5, "composit": 3, "compound": 30, "comprehens": 43, "compress": [1, 2, 7, 11, 14], "compression_level": [2, 7], "comput": [2, 4, 5, 7, 19, 21, 30, 36, 41, 42], "concat": [1, 5, 6, 35], "concat_w": 5, "concaten": [5, 6, 28, 30], "concatenated_arrai": 30, "concept": [1, 2, 4, 7, 30, 39, 45, 54], "concis": [5, 23], "concret": 5, "concurr": [1, 7, 39, 42], "condit": [6, 28, 32], "conduct": 25, "config": [1, 7, 19, 23, 36, 39, 55], "config_intern": [1, 7], "config_nam": 1, "config_opt": [1, 7], "configopt": 55, "configur": [1, 3, 7, 12, 14, 19, 23, 26, 36, 44, 45, 54], "configure_formatt": [3, 7, 43], "conflict": [1, 7, 11], "conjunct": 2, "connect": [1, 27, 55], "consecut": 5, "consequ": 54, "consid": [5, 54], "consider": 43, "consist": [4, 5, 43], "consol": [2, 42], "constraint": 3, "construct": [1, 2, 4, 7, 19, 30, 36, 42, 53], "constructor": [0, 2, 4, 7, 15, 16, 17, 18, 19], "consult": [4, 7, 36], "consum": [7, 8, 15, 17, 41, 42, 44, 47], "contain": [1, 2, 3, 4, 5, 6, 7, 12, 14, 15, 19, 20, 21, 23, 28, 30, 33, 36, 43, 44, 49], "content": [23, 32, 43], "context": [0, 3, 4, 7, 11, 12, 15, 17, 20, 21, 35, 36, 37, 39, 41, 45, 47, 54], "continu": [5, 12, 21], "contrast": 33, "contribut": [23, 28, 30, 55], "contributor": 21, "control": [1, 2, 4, 5, 7, 12, 28, 30, 36, 38, 39, 42, 49], "conveni": [1, 2, 4, 5, 7, 15, 19, 40, 41], "convent": [4, 5, 7, 21, 26], "convention": 5, "convers": [7, 19, 21, 23, 27, 42, 54], "convert": [0, 1, 2, 4, 5, 6, 7, 14, 15, 16, 17, 18, 19, 21, 27, 29, 30, 31, 36, 37, 42, 43, 54], "copi": [1, 4, 7, 16, 21, 23, 24, 36, 44, 45, 47], "copied_config": 1, "copilot": 26, "copyabl": 26, "copyto": 4, "core": [2, 4, 21, 39, 40, 45, 55], "corr": [5, 28], "correctli": [2, 19, 21], "correl": [5, 26], "correspond": [5, 7, 15, 33], "cos_df": 5, "cosec": 6, "cosh": [4, 5, 7], "cosh_df": 5, "cosin": [4, 5, 7], "cosine_dist": 5, "cosine_similar": 5, "cost": [24, 36], "costli": 19, "cot": [4, 5, 7], "cotang": [4, 5, 7], "could": [2, 4, 7, 21, 55], "count": [1, 2, 5, 6, 7, 15, 28, 29, 35, 36, 39, 41, 42], "count_star": 5, "counter": [7, 15], "counterpart": [5, 6, 21], "coupl": [21, 38], "covar": 5, "covar_pop": [5, 28], "covar_samp": [5, 28], "covari": 5, "cover": [27, 31, 39, 44, 45], "cpu": [7, 15, 41, 45], "cpython": [19, 23], "cr": [36, 53, 55], "crate": [1, 21, 35, 55], "crc32": 6, "creat": [0, 1, 2, 3, 4, 5, 7, 8, 9, 10, 11, 14, 15, 17, 18, 19, 20, 21, 23, 27, 28, 30, 33, 35, 36, 37, 39, 41, 43, 45, 47, 54], "create_datafram": [1, 5, 36, 40], "create_dataframe_from_logical_plan": 1, "create_namespace_if_not_exist": 40, "create_t": 40, "createcatalog": 4, "createcatalogschema": 4, "created_bi": [2, 7], "createexternalt": [4, 7], "createfunct": 4, "createfunctionbodi": 4, "createindex": 4, "creatememoryt": 4, "createview": 4, "creation": 42, "credenti": [1, 40], "criteria": [5, 38], "crlf": [7, 14], "cross": [1, 4, 28, 44], "csc": 6, "css": [3, 43], "cstream": 21, "cstring": 21, "csv": [0, 1, 2, 7, 11, 14, 21, 24, 28, 31, 38, 39, 40, 42, 43, 45, 46, 50, 54], "csvreadopt": [1, 7, 11, 14, 49], "ctx": [0, 1, 2, 4, 5, 6, 7, 12, 15, 17, 19, 21, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 44, 46, 47, 48, 49, 51, 52, 53, 54, 55], "cube": [2, 4, 5, 7], "cume_dist": [5, 19, 38], "cumul": 5, "curr_valu": 36, "current": [0, 1, 2, 3, 4, 5, 6, 7, 15, 19, 21, 31, 36, 38, 43], "current_d": 5, "current_tim": 5, "current_timestamp": 5, "cursor": 26, "custom": [1, 3, 5, 7, 8, 15, 21, 28, 33, 36, 38, 39, 42, 45, 50, 54], "custom_css": [3, 43], "custom_formatt": [3, 43], "customer_id": 33, "cut": 44, "cx": 5, "cyclic": 6, "d": [2, 5, 6, 19, 35, 36, 43, 47], "dai": [5, 6, 31], "dant": 30, "dark": 28, "data": [0, 1, 2, 3, 4, 5, 7, 11, 14, 15, 16, 18, 19, 21, 23, 24, 26, 27, 28, 29, 30, 31, 34, 36, 37, 38, 39, 41, 42, 43, 44, 45, 46, 47, 48, 49, 51, 53, 54, 55], "data_page_row_count_limit": [2, 7], "data_pagesize_limit": [2, 7], "data_typ": [5, 7, 14, 21], "data_type_or_field_to_field": 19, "data_types_or_fields_to_field_list": 19, "databas": [0, 7, 30, 39], "databrick": 30, "dataflow": [7, 15], "datafram": [0, 1, 3, 4, 5, 6, 7, 11, 15, 16, 19, 20, 24, 26, 28, 29, 30, 31, 32, 34, 36, 37, 38, 39, 41, 44, 45, 46, 47, 54], "dataframe_formatt": [7, 20, 43], "dataframehtmlformatt": [3, 43], "dataframewriteopt": [2, 7], "datafus": [20, 21, 22, 23, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 45, 46, 48, 49, 50, 51, 52, 53, 54], "datafusion_catalog": 55, "datafusion_catalog_provid": 55, "datafusion_df": 40, "datafusion_logical_extension_codec": 55, "datafusion_python": 26, "datafusion_sql": 18, "datafusion_table_funct": 36, "datafusion_table_provid": [21, 53], "dataset": [0, 1, 3, 7, 31, 36, 38, 39, 40, 43, 46], "datasourc": 8, "datasourceexec": [7, 15, 36, 41], "datastructur": [4, 7], "datatyp": [1, 2, 4, 5, 7, 11, 14, 19, 36], "datatypemap": [4, 7, 21], "date": [5, 6, 28, 31, 35, 42, 43], "date32": [5, 6], "date_add": 6, "date_bin": 5, "date_diff": 6, "date_format": 5, "date_part": [5, 6, 31], "date_sub": 6, "date_trunc": [5, 6], "datepart": 5, "datetim": [5, 6, 7, 15, 35, 43], "datetrunc": 5, "day_of_week": 6, "daylight": 5, "dayofweek": 6, "dd": 5, "ddd": 43, "ddl": [1, 7], "dealloc": 4, "debug": 21, "dec": 5, "decid": [19, 21, 36, 44], "decim": [5, 6, 35, 43], "decimal_plac": 5, "decod": [1, 4, 5, 6, 7, 15, 44], "decor": [7, 19], "decorator_double_udf": [7, 19], "dedupl": 2, "deepcopi": [4, 7], "deepli": 2, "def": [2, 4, 7, 12, 19, 24, 36, 40, 42, 43, 44, 46, 54], "default": [0, 1, 2, 3, 4, 5, 6, 7, 10, 11, 12, 14, 15, 18, 19, 21, 23, 28, 30, 33, 35, 36, 38, 39, 40, 43, 54], "default_max_infer_schema": [1, 7, 14], "default_str_repr": 2, "default_valu": 5, "defaultstyleprovid": 3, "defens": [24, 31, 40, 46, 54], "defin": [0, 1, 2, 4, 7, 19, 21, 23, 31, 32, 44, 45], "definit": [1, 4, 7, 19, 21, 27, 36], "deg": 5, "deg_df": 5, "degre": [4, 5, 7], "deleg": 19, "delet": [1, 7], "delimit": [1, 5, 6, 7, 11, 14, 49], "delta": [21, 45], "delta_binary_pack": [2, 7], "delta_byte_arrai": [2, 7], "delta_length_byte_arrai": [2, 7], "delta_t": 40, "deltalak": 40, "deltat": 40, "demand": [42, 47], "demonstr": [1, 36, 38, 39, 46, 47], "dens": [5, 7, 26], "dense_rank": [5, 19, 38], "depend": [5, 7, 21, 22, 28, 36, 38, 55], "deploy": 44, "deprec": [1, 2, 3, 7, 15], "deprecationwarn": 3, "depth": 2, "deregist": [0, 1, 7], "deregister_object_stor": 1, "deregister_schema": [0, 7], "deregister_t": [0, 1], "deregister_udaf": 1, "deregister_udf": 1, "deregister_udtf": 1, "deregister_udwf": 1, "deriv": 21, "descend": [2, 5], "describ": [2, 5, 21, 28, 29, 36, 40], "describet": 4, "descript": [1, 5, 7, 15, 19, 41, 44], "deseri": [1, 17], "deserialize_byt": 17, "design": [21, 32], "desir": 5, "detail": [2, 4, 5, 7, 19, 22, 23, 27, 28, 29, 42, 44, 49], "detect": 41, "determin": [0, 2, 4, 5, 7, 19, 36], "dev": 23, "develop": [21, 22, 40, 44], "deviat": 5, "df": [1, 2, 4, 5, 6, 7, 19, 24, 27, 28, 29, 30, 31, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 46, 47, 48, 49, 51, 52, 54], "df1": [2, 42], "df2": [1, 2, 42], "df_filter": 37, "df_null": 5, "df_orth": 5, "df_view": 37, "df_zero": 5, "dfn": [1, 2, 4, 5, 6, 7, 19], "dfschema": [1, 7], "dialect": [1, 18, 30, 54], "dict": [1, 2, 3, 4, 5, 7, 15, 41], "dictionari": [1, 2, 5, 7, 30, 36, 37, 40, 42, 54], "dictionary_en": [2, 7], "dictionary_page_size_limit": [2, 7], "differ": [1, 2, 4, 5, 7, 12, 14, 15, 19, 21, 28, 30, 31, 35, 36, 39, 40, 42, 44], "difficult": 21, "digest": 5, "digit": 6, "dimens": [4, 5, 7], "dimension": 2, "direct": [2, 5, 43], "directli": [1, 2, 3, 4, 5, 6, 7, 17, 19, 21, 36, 40, 41, 42, 44, 47, 55], "directori": [1, 7, 23], "disabl": [1, 4, 7, 33, 43], "disambigu": [2, 32], "discov": 26, "discover": 1, "discoveri": 1, "discuss": [21, 40], "disjunct": 36, "disk": [1, 7, 9, 10, 15, 41], "dispatch": 1, "displai": [3, 7, 15, 27, 29, 37, 41, 42, 46], "display_graphviz": [7, 15], "display_ind": [7, 15, 36], "display_indent_schema": [7, 15], "distanc": 5, "distil": 26, "distinct": [2, 4, 5, 6, 7, 40, 55], "distinct_on": 2, "distinctli": 21, "distinguish": [21, 28, 41], "distribut": [4, 5, 7, 12, 39, 45], "diverg": 35, "divid": [5, 39], "dividend": 6, "divis": [4, 5, 6, 7], "divisor": [5, 6], "dml": [1, 7], "dmlstatement": 4, "do": [0, 1, 2, 5, 7, 12, 19, 21, 23, 27, 28, 36, 38, 40, 44, 53, 54], "doc": [1, 2, 5, 7, 18, 25, 44], "docstr": [23, 35], "document": [1, 2, 4, 5, 7, 19, 20, 21, 23, 27, 39, 42, 44, 46, 49], "doe": [1, 2, 3, 4, 5, 7, 12, 14, 19, 21, 23, 28, 35, 38, 40, 41, 44], "doesn": 19, "dominant_typ": 31, "done": [2, 28, 36, 40], "dot": [2, 5, 7, 15], "dot_product": 5, "doubl": [2, 4, 5, 6, 7, 19, 30, 34, 44, 47], "double_fn": [5, 30], "double_func": [7, 19], "double_it": [7, 19], "double_udf": [7, 19], "down": [7, 15, 21, 28, 38, 40], "downcast": 55, "download": [27, 34, 46], "downstream": [2, 47], "dr": 5, "dragon": [24, 28, 31, 38, 40, 46], "dragonair": 38, "dragonit": 38, "dratini": [28, 38], "draw": [2, 7], "drill": 28, "drive": 1, "driven": 1, "driver": [4, 7, 12, 44], "driver_ctx": 12, "drop": [1, 2, 7, 28, 30, 42, 44], "dropcatalogschema": 4, "dropfunct": 4, "droptabl": 4, "dropview": 4, "dt": [5, 6], "dtype": 2, "duckdb": [18, 30], "due": [1, 5, 7, 11, 15, 23, 55], "dump": [1, 4, 7, 12, 44], "dup": 6, "duplic": [2, 4, 5, 7, 32, 43], "durat": 5, "dure": [5, 7, 19, 23, 41], "dyn": 55, "dynam": 5, "dynamic_lookup": 23, "e": [1, 4, 5, 6, 7, 12, 15, 19, 36, 41, 44], "ea09ae9cc6768c50fcee903ed054556e5bfc8347907f12598aa24193": 5, "each": [1, 2, 4, 5, 6, 7, 12, 15, 19, 21, 23, 26, 28, 31, 33, 36, 38, 41, 42, 43, 44], "eagerli": [7, 15, 41, 42], "earli": 21, "easi": [21, 26, 51], "easier": [21, 31, 36, 46], "easili": [4, 7, 21], "east": [1, 40], "edg": [35, 44], "effect": [4, 7, 12, 34, 46, 55], "effici": 39, "effort": [2, 7, 21], "either": [1, 2, 4, 5, 7, 19, 21, 28, 40, 42, 44, 54], "elapsed_comput": [7, 15, 41], "electr": [28, 38], "element": [2, 3, 4, 5, 6, 7, 15, 30], "element_at": 5, "ellipsi": [2, 5, 7, 19], "els": [6, 36, 43, 55], "else_expr": 4, "elt": 6, "emb": [4, 7], "embarrassingli": 44, "embed": [1, 2, 4, 5, 7], "emit": 41, "employe": 30, "empti": [1, 2, 4, 5, 7, 14, 15, 28, 30, 41, 42, 44], "empty_t": [1, 5], "emptyrel": 4, "enabl": [1, 2, 7, 12, 21, 35, 39, 42, 43, 44], "enable_cell_expans": [3, 7, 43], "enable_ident_norm": 1, "enable_spark_funct": [1, 6, 35], "enable_url_t": 1, "enc": 5, "encod": [2, 4, 5, 6, 7, 12, 15, 17, 44], "encount": 21, "encourag": 23, "end": [0, 2, 4, 5, 6, 7, 15, 16, 18, 19, 35, 36, 38, 39, 44], "end_bound": [4, 7], "end_dat": 6, "end_timestamp": [7, 15], "ends_with": 5, "ends_with_df": 5, "engin": [1, 7, 24, 27, 28, 36, 38], "enough": 19, "ensur": [3, 7, 8, 14, 21, 39], "ensure_expr": 4, "ensure_expr_list": 4, "entir": [2, 5, 7, 19, 28, 36, 38, 42, 44], "entri": [1, 2, 4, 5, 6, 7, 15, 26, 28, 38, 42, 44], "entry_typ": 6, "enum": [2, 4, 7, 19], "enumer": [19, 26], "environ": [1, 4, 7, 23, 24, 39, 42, 43, 44], "epoch": [5, 6], "equal": [2, 4, 5, 7, 15, 30, 44], "equi": 6, "equival": [2, 4, 5, 19, 21, 28, 30, 38, 42, 44], "error": [1, 3, 4, 5, 6, 7, 14, 23, 44], "escap": [7, 14, 49], "escapechar": 6, "especi": [1, 2, 23, 33], "essenti": [7, 16, 29], "etc": [1, 3, 4, 5, 6, 7, 9, 10, 15, 19, 31, 41, 42, 44], "euclidean": 5, "eval_rang": 19, "evalu": [2, 4, 5, 7, 19, 27, 28, 30, 36, 38, 39, 42, 44], "evaluate_al": [7, 19, 36], "evaluate_all_with_rank": [19, 36], "even": [1, 3, 7, 15, 21, 33, 36, 41], "evenli": 39, "event": [7, 15, 41, 42], "ever": 44, "everi": [1, 5, 7, 12, 19, 28, 30, 35, 36, 41, 44], "everyth": [9, 10], "ex": [4, 7, 34], "exact": [5, 21], "exactli": [2, 5, 6, 28, 38], "examin": [4, 7], "exampl": [1, 2, 3, 4, 5, 6, 7, 12, 15, 19, 21, 25, 26, 27, 28, 30, 31, 33, 36, 37, 38, 40, 42, 46, 53, 54, 55], "exce": 3, "excel": 21, "except": [1, 2, 4, 5, 7, 30, 54], "except_al": 2, "exclud": [2, 28, 33, 41], "execut": [1, 2, 4, 5, 7, 14, 15, 19, 21, 23, 24, 27, 39, 44, 45, 47, 55], "execute_logical_plan": 1, "execute_stream": [2, 7, 15, 16, 41, 42], "execute_stream_partit": [2, 41, 42], "execution_plan": [2, 36, 41], "executionplan": [1, 2, 7, 15, 41], "executor": 44, "exeggcut": 28, "exist": [0, 1, 2, 3, 4, 5, 7, 21, 36, 42], "exit": 12, "exp": [4, 5, 6, 7], "exp_smooth": 36, "expand": [2, 3, 43], "expans": [3, 43], "expect": [4, 5, 7, 14, 19, 21, 30, 36, 38, 42, 54], "expens": [2, 41], "experi": 23, "explain": [2, 4, 7], "explainformat": [2, 7], "explan": [2, 21, 27, 42], "explicit": [1, 2, 4, 5, 12, 30, 39, 42, 43, 44], "explicitli": [1, 2, 7, 19, 28, 42, 44], "expm1": 6, "expon": 5, "exponenti": [4, 5, 7], "exponentialsmooth": 36, "export": [1, 2, 4, 7, 16, 19, 21, 23, 40, 50], "expos": [1, 2, 6, 7, 15, 19, 21, 35, 36, 40, 42, 53], "expr": [1, 2, 5, 6, 7, 11, 12, 14, 19, 20, 28, 36, 38, 42, 44], "expr1": 5, "expr2": 5, "expr_list": 4, "expr_type_error": 4, "express": [1, 2, 4, 5, 6, 7, 12, 14, 19, 26, 28, 31, 32, 33, 35, 36, 38, 45, 55], "exprfuncbuild": [4, 7], "extend": [5, 8, 21], "extens": [1, 3, 4, 7, 11, 14, 22, 49, 55], "extern": [0, 7, 25, 36, 44], "extra": 28, "extract": [3, 4, 5, 6, 7, 31, 55], "extraenv": 23, "f": [2, 5, 6, 7, 27, 28, 30, 31, 36, 38, 40, 41, 42, 43, 54, 55], "face": 21, "fact": [21, 36], "factor": [4, 7, 39], "factori": [1, 4, 5, 6, 7, 19], "fail": [2, 4, 5, 7, 23, 28, 31, 44], "failed_suppli": 28, "failur": [4, 5, 7, 28], "fair": [1, 7], "fairi": [28, 38], "fall": [4, 7, 12], "fallback": [5, 44], "fals": [1, 2, 3, 4, 5, 7, 12, 14, 19, 21, 23, 24, 28, 30, 31, 33, 34, 36, 39, 40, 42, 43, 44, 46, 53], "famili": 6, "familiar": 23, "fan": 44, "far": [2, 41], "fast": 44, "faster": [2, 5, 7, 19, 39], "featur": [2, 5, 7, 21, 23, 33, 40, 47], "fed": 44, "feel": 36, "fetch": [23, 41], "few": [21, 23, 27, 28], "fewer": 3, "ff": [5, 6], "fffd": 6, "ffi": [0, 1, 4, 7, 12, 15, 19, 22, 40, 44, 55], "ffi_": 21, "ffi_catalogprovid": 55, "ffi_logical_codec_from_pycapsul": 55, "ffi_logicalextensioncodec": [1, 55], "ffi_physicalextensioncodec": 1, "ffi_physicaloptimizerrul": 1, "ffi_provid": 21, "ffi_tablefunct": 36, "ffi_tableprovid": [21, 53], "ffi_taskcontextprovid": 1, "field": [2, 3, 5, 6, 7, 14, 19, 21, 31, 36, 43], "field_nam": 5, "fight": [28, 38], "file": [1, 2, 6, 7, 9, 10, 11, 14, 17, 21, 23, 24, 26, 27, 34, 36, 39, 42, 43, 44, 45, 46, 48, 49, 51, 52], "file_compression_typ": [1, 7, 11, 14], "file_extens": [1, 7, 11, 14], "file_group": 36, "file_partition_col": [1, 7, 11], "file_sort_ord": [1, 7, 11, 14], "file_typ": 36, "filenam": 23, "filetyp": 4, "fill": [2, 4, 5, 7, 14, 31, 38, 44], "fill_nan": [4, 7], "fill_nul": [2, 4, 7, 32], "filter": [2, 4, 5, 6, 7, 14, 15, 27, 30, 35, 36, 37, 38, 40, 41, 42, 55], "filterexec": [7, 15, 36, 41], "final": [7, 12, 15, 27, 36, 41, 44], "find": [2, 5, 21, 23, 27, 28, 38], "find_in_set": 5, "find_qualified_column": 2, "fine": [30, 44], "finer": 42, "finish": [4, 28], "fire": [24, 28, 31, 40, 46], "first": [1, 2, 4, 5, 6, 7, 15, 21, 23, 26, 27, 28, 30, 36, 38, 40, 42, 46], "first_1": 28, "first_2": 28, "first_arrai": 5, "first_nam": 42, "first_valu": [5, 19, 28], "fix": [0, 19], "flag": [3, 5, 18, 19, 23, 28, 36, 55], "flat": 4, "flatten": [4, 5, 7], "fleur": 31, "flexibl": 42, "float": [2, 4, 5, 6, 7, 19, 36, 43, 54], "float64": [4, 5, 7, 19, 31, 36], "floor": [4, 5, 6, 7, 35], "floor_df": 5, "flow": [7, 15], "flower": 31, "fly": [24, 28, 38, 40, 46], "fmt": 6, "fn": [1, 36, 53, 55], "focus": 21, "folder": [21, 36, 40, 53], "follow": [0, 1, 2, 4, 5, 6, 7, 15, 19, 21, 23, 26, 27, 28, 30, 31, 33, 35, 36, 38, 40, 41, 46, 54], "foo": [4, 7, 39], "footer": [3, 36], "fora": [4, 7], "foreign": [21, 55], "foreign_provid": 21, "foreigntableprovid": 21, "fork": 44, "forkserv": 44, "form": [2, 4, 5, 6, 7, 15, 28, 30, 36, 40], "format": [1, 2, 3, 4, 5, 6, 7, 14, 15, 27, 39, 40, 42, 43, 44, 48, 51, 54], "format_argu": 5, "format_html": 3, "format_str": [3, 6], "formatt": [2, 3, 5, 7], "formatted_valu": 3, "formattermanag": 3, "forth": 47, "forward": [19, 30], "found": [1, 2, 5, 23, 38, 49, 53, 55], "four": [36, 44], "fox": 5, "frame": [2, 4, 5, 7, 19, 29, 36], "frame_bound": 4, "framework": 23, "free": [1, 7], "frequent": [21, 23], "fresh": [1, 35, 36, 41, 43, 44], "friendli": 1, "from": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 17, 19, 22, 23, 24, 26, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 46, 48, 49, 50, 51, 52, 53, 54, 55], "from_arrai": [5, 36, 40, 42], "from_arrow": [1, 6, 40, 42, 47], "from_byt": [1, 4, 7, 15, 44], "from_dataset": [0, 7], "from_dens": 5, "from_json": 17, "from_panda": [1, 42], "from_polar": [1, 40], "from_proto": [7, 15], "from_py_object": 21, "from_pycapsul": [7, 19], "from_pydict": [1, 2, 4, 5, 6, 7, 19, 28, 29, 30, 33, 35, 36, 37, 40, 44, 47], "from_pylist": [1, 33, 40], "from_str": 2, "from_stream": 42, "from_substrait_plan": 17, "from_unixtim": [4, 5, 7], "from_utc_timestamp": 6, "from_val": 5, "front": [5, 44], "frozen": [21, 23], "fulfil": 28, "full": [2, 5, 7, 28, 30, 32, 35, 38, 42, 43, 44, 54], "full_nam": 42, "fulli": [2, 23, 33, 39, 41, 43, 44], "func": [1, 2, 7, 19, 36], "function": [1, 2, 13, 16, 20, 21, 26, 27, 29, 32, 39, 40, 43, 44, 45, 52, 55], "function_to_impl": [19, 36], "functool": 36, "further": [1, 5, 21], "futur": [19, 21, 38], "g": [1, 4, 5, 6, 7, 12, 15, 19, 36, 41, 44], "gamma": 40, "gastli": [28, 38], "gate": 30, "gather": 42, "gaug": [7, 15], "gcd": 5, "gemini": 26, "gen_seri": 5, "gener": [1, 4, 7, 15, 16, 17, 19, 20, 21, 23, 24, 40, 42, 46, 54], "generate_seri": 5, "gengar": 38, "gengarmega": 38, "genuin": [28, 36], "geodud": 38, "get": [2, 3, 5, 7, 15, 17, 19, 21, 23, 28, 30, 33, 40, 42, 43, 54, 55], "get_cell_styl": [3, 43], "get_context": 44, "get_default_level": 2, "get_field": 5, "get_formatt": [3, 43], "get_frame_unit": [4, 7], "get_header_styl": [3, 43], "get_lower_bound": [4, 7], "get_offset": 4, "get_rang": 19, "get_sender_ctx": 12, "get_upper_bound": [4, 7], "get_worker_ctx": 12, "getattr": 55, "getenv": 40, "ghost": [28, 38], "gil": 24, "git": 23, "github": [23, 25, 26], "give": [5, 7, 15, 28, 34, 41, 46], "given": [0, 1, 2, 3, 4, 5, 6, 7, 15, 19, 36], "glanc": 21, "global": [1, 2, 3, 4, 7, 11, 12, 15, 41, 42, 43, 44], "global_ctx": [1, 44], "go": [4, 7, 21, 29, 31, 35], "goe": 21, "gold": 5, "good": [21, 23], "googlecloud": [1, 13, 40], "grand": [4, 5, 28], "grand_tot": 7, "graph": [2, 7, 15], "graphic": [7, 15], "graphviz": [2, 7, 15], "grass": [24, 28, 31, 38, 40, 46], "great": 23, "greater": [4, 5, 7], "greatest": 5, "greatli": [36, 39], "greedi": [1, 7], "green": 30, "grimer": 38, "ground": 28, "group": [1, 2, 4, 5, 7, 11, 19, 27, 29, 30, 32, 36, 38, 42], "group_bi": [2, 28], "grouping_set": [2, 4, 5, 28], "groupingset": [2, 4, 5, 28], "grow": 30, "guarante": [2, 7, 21], "guess": 26, "guid": [1, 2, 7, 26, 32, 39, 42, 43, 46], "guidanc": [26, 42], "guidelin": 22, "gz": 49, "gzip": [2, 7, 14, 49], "h": [1, 5, 6, 30, 35], "ha": [1, 2, 3, 4, 5, 7, 14, 15, 19, 21, 26, 28, 30, 34, 36, 40, 41, 44, 54, 55], "had": 44, "hahaha": 5, "half_up": [1, 6, 31, 35], "hand": [1, 26, 36], "handl": [3, 5, 7, 16, 19, 28, 32, 35, 38, 39, 44, 45, 54], "handshak": 26, "happen": 23, "hardwar": 39, "has_big": 30, "has_head": [1, 7, 11, 14], "has_mor": [2, 3], "hasattr": 55, "hash": [2, 4, 5, 6, 7, 35, 39], "hashaggregateexec": 41, "haskel": 29, "hat": 5, "haunter": 38, "have": [1, 2, 5, 7, 11, 14, 17, 19, 21, 23, 24, 28, 30, 33, 36, 38, 39, 40, 41, 44, 49, 53, 54], "head": 2, "header": [1, 2, 3, 7, 11, 14, 49], "healthi": 23, "heavy_red_unit": 30, "height": [3, 43], "hel": 6, "held": 44, "hello": [1, 5, 6, 35], "hello123": 5, "hello_from_datafus": 5, "helo": 5, "help": [1, 3, 7, 11, 21, 23, 30, 31, 39, 43], "helper": [1, 2, 4, 7, 19, 44, 55], "henc": 19, "here": [1, 2, 4, 5, 7, 21, 31, 34, 36, 38, 39, 44, 46, 47, 54], "hex": [5, 6], "hexadecim": [4, 5, 6, 7], "hh": 5, "hi": [5, 6], "hierarch": [28, 40], "hierarchi": 28, "high": [2, 4, 7, 30], "higher": [2, 4, 5, 7, 30, 39], "higherorderfunct": 4, "highli": 36, "highlight": 46, "hint": [1, 7, 19, 23], "histogram": 6, "hive": 54, "hold": [1, 7, 12, 19, 36], "homebrew": 23, "honor": [4, 7, 44], "hood": [40, 44], "hook": [4, 7, 22, 55], "host": [1, 6], "hour": [5, 6], "how": [1, 2, 4, 5, 7, 12, 15, 19, 21, 22, 26, 28, 29, 30, 32, 33, 36, 38, 39, 40, 42, 43, 44, 46, 49, 54], "howev": [19, 36, 41], "hp": [24, 40, 46], "html": [1, 2, 3, 5, 7, 18, 43, 45], "http": [1, 2, 5, 6, 7, 13, 15, 17, 18, 26, 40], "human": 1, "hundr": 44, "hyperbol": [4, 5, 7], "i": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 18, 19, 21, 23, 24, 27, 28, 30, 31, 33, 35, 36, 38, 39, 40, 41, 42, 43, 44, 45, 46, 48, 49, 51, 52, 54, 55], "ic": [28, 38], "iceberg": 45, "iceberg_t": 40, "id": [1, 2, 3, 23, 33, 36, 42], "ideal": 21, "idempot": 12, "ident": [1, 2, 4, 5, 33, 40], "identifi": [1, 4, 7, 15, 21, 28, 34, 39, 40, 41], "identity_demo": 1, "idiom": 36, "idiomat": [26, 30], "idl": [2, 7], "idx": [19, 36], "if_": 6, "if_fals": 6, "if_tru": 6, "ifnul": 5, "ignor": [5, 7, 14, 19, 23, 28, 38, 44], "ignore_nul": [5, 28, 38], "ilik": [4, 6], "illustr": 21, "imag": 5, "immut": [1, 4, 7, 19, 21, 26, 36, 44], "impact": [2, 39], "impl": [36, 53, 55], "implement": [0, 1, 2, 3, 7, 19, 22, 23, 30, 35, 36, 40, 42, 43, 47, 53, 54, 55], "implicit": 44, "import": [1, 2, 3, 4, 5, 6, 7, 12, 19, 21, 24, 26, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 40, 41, 42, 43, 44, 46, 48, 49, 50, 51, 52, 53, 54, 55], "impos": 44, "improv": [1, 3, 7, 19, 22, 36, 39, 40, 43, 55], "in_list": [5, 26, 30, 31, 36], "inbound": 44, "includ": [1, 2, 3, 4, 5, 7, 15, 19, 21, 27, 28, 31, 33, 36, 39, 41, 42, 43, 55], "include_rank": [19, 36], "inclus": [1, 4, 5, 7], "incom": 44, "incomplet": 49, "incorpor": 36, "increas": [1, 2, 3, 7, 28, 39], "increment": [2, 19, 21, 36, 47], "incur": 36, "indent": [2, 7, 15], "independ": [1, 5, 7, 12, 15, 30, 38], "index": [1, 2, 3, 4, 5, 6, 7, 15, 18, 19, 30, 31, 35, 41], "indic": [3, 4, 5, 7, 30], "individu": [2, 7, 15, 28, 30, 38, 41, 43], "infer": [1, 7, 11, 14], "info": 5, "inform": [1, 2, 4, 5, 7, 8, 17, 18, 19, 21, 36, 39, 42], "information_schema": [1, 7], "infrastructur": 39, "inherit": [40, 44], "init": [23, 44], "init_work": [12, 44], "initcap": [4, 5, 7], "initi": [2, 3, 4, 5, 7, 12, 14, 15, 44], "inject": [7, 19, 36], "inlin": [1, 4, 7, 12, 19, 21, 28, 38], "inlist": 4, "inner": [2, 5, 21, 32, 42, 55], "inner_product": 5, "input": [1, 2, 4, 5, 6, 7, 11, 14, 15, 19, 20, 30, 36, 44], "input_column": 2, "input_field": [7, 19], "input_item": [8, 9, 10], "input_partit": 36, "input_typ": [7, 19], "inputsourc": 8, "ins": [1, 4, 6, 7, 12, 28, 35, 44], "insensit": [5, 6], "insert": [1, 2, 7, 55], "insert_oper": [2, 7], "insertop": [2, 7], "insid": [4, 5, 7, 12, 15, 19, 28, 35, 36, 38, 41, 44], "insight": 39, "inspect": [1, 41], "inspir": 22, "instal": [4, 7, 12, 15, 22, 44, 45], "instanc": [1, 2, 3, 4, 5, 7, 12, 19, 21, 27, 43], "instanti": [2, 7, 19], "instead": [1, 2, 3, 4, 5, 7, 21, 26, 36, 39, 40, 42, 44, 49, 55], "instr": 5, "insubqueri": 4, "insuffici": 40, "int": [1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 19, 36, 43, 54], "int32": [5, 6, 31], "int64": [1, 4, 5, 6, 7, 19, 29, 31, 36, 44], "int64arrai": 1, "int8": 5, "integ": [3, 4, 5, 6, 7, 19, 30, 36], "integr": [2, 21, 26, 40, 42, 44, 46, 53], "intend": [7, 14, 21], "intens": 39, "interact": [3, 19, 21, 30, 40], "intercept": 5, "interchang": [7, 16, 51], "interest": 30, "interfac": [0, 1, 2, 7, 16, 21, 24, 27, 28, 36, 38, 40, 42, 47, 53, 55], "interior": 21, "intermedi": [7, 19, 41], "intern": [0, 4, 7, 14, 19, 21, 36, 41], "interpol": 5, "interpret": [4, 5, 6, 7], "intersect": [2, 5], "interv": [5, 6], "into_view": 2, "intro": 23, "introduc": [23, 27, 39, 54], "introduct": [22, 45], "intuit": 21, "invalid": [3, 6, 7], "invers": [4, 5, 7], "invis": [36, 44], "invoc": [7, 19, 36], "invok": [1, 4, 7, 19, 47], "io": [1, 2, 7, 17, 20, 43, 45], "io_avro": 42, "io_csv": 42, "io_json": 42, "io_parquet": 42, "ipc": [1, 2, 4, 7, 20, 28, 38, 44], "is_caus": 19, "is_correct_input": [8, 9, 10], "is_current_row": 4, "is_empti": 30, "is_follow": 4, "is_high_prior": 30, "is_nan": [4, 5, 7], "is_not_nul": [4, 7, 28, 30], "is_nul": [1, 4, 7, 30, 36], "is_null_arr": 36, "is_preced": 4, "is_unbound": 4, "is_valid_utf8": 6, "isfals": 4, "isinst": [1, 4, 7, 12, 43], "isnan": [4, 5, 7], "isnotfals": 4, "isnotnul": [4, 7], "isnottru": 4, "isnotunknown": 4, "isnul": 4, "isoformat": 6, "issu": [3, 5, 6, 22, 23, 25, 43], "istru": 4, "isunknown": 4, "iszero": [4, 5, 7], "item": [4, 28, 36], "iter": [1, 2, 4, 7, 16, 41, 42], "its": [1, 2, 5, 7, 12, 15, 19, 21, 24, 26, 28, 30, 36, 38, 41, 43, 44], "itself": [7, 12, 19, 30, 36], "ivi": 31, "ivyfleur": 31, "ivysaur": [24, 31, 38, 40, 46], "iz": 5, "java": [29, 44], "javascript": [3, 43, 51], "jigglypuff": 38, "join": [1, 2, 4, 7, 15, 30, 32, 36, 39, 42, 45], "join_kei": [2, 33], "join_on": [2, 33, 42], "joinconstraint": 4, "jointyp": 4, "json": [1, 2, 6, 7, 11, 17, 40, 42, 43, 45, 50], "json_tupl": 6, "jupyt": [3, 42, 43, 46], "jupyterlab": 46, "just": [2, 36, 44], "justif": 21, "jynx": [28, 38], "k": 5, "k1": 5, "k2": 5, "kabuto": 38, "kakuna": [24, 38, 40, 46], "keep": [2, 5, 21, 23, 26, 30, 36, 37, 40, 43], "kei": [1, 2, 3, 4, 5, 6, 7, 15, 21, 27, 28, 30, 32, 39, 41, 42], "kept": 2, "keyerror": 1, "keyvaluedelim": 6, "keyword": [1, 6, 7, 19, 30, 36, 55], "kind": [0, 7, 21, 23], "kitten": 5, "know": [1, 7], "known": [5, 30], "kv_meta": [2, 7], "kwarg": [3, 7, 8, 9, 10], "l": 2, "l2": 5, "lab": 46, "label": [2, 4, 7, 15], "lack": 24, "lag": [5, 19, 38], "lake": 45, "lambda": [1, 4, 5, 7, 19, 32, 43, 44], "lambda_": [5, 30], "lambda_var": [5, 30], "lambdavari": 4, "land": 44, "languag": [1, 7, 15, 21, 44], "larg": [2, 3, 7, 31, 39, 43, 44], "large_trip_dist": 34, "larger": [2, 7], "largest": 6, "last": [2, 4, 5, 6, 7, 38], "last_dai": 6, "last_nam": 42, "last_valu": [5, 28, 38], "last_with_nul": 38, "last_wo_nul": 38, "late": 1, "latenc": 39, "later": [40, 46, 53], "latest": [5, 7, 18, 21], "latter": 1, "lazi": [2, 7, 26, 27, 42, 44], "lazili": [2, 42, 47], "lcm": 5, "lead": [5, 19, 21, 36, 38, 40], "leaf": [7, 15], "leak": 24, "learn": [21, 29, 38], "least": [5, 7, 15, 19, 28, 33, 36, 43], "leav": [7, 15, 21], "left": [2, 5, 6, 30, 31, 32, 43], "left_df": 5, "left_on": [2, 33], "leftmost": 5, "legendari": [24, 40, 46], "len": [5, 6, 19, 31], "length": [2, 3, 4, 5, 6, 7, 14, 19, 44], "less": [4, 5, 7, 14], "lesson": 21, "let": [4, 7, 21, 28, 36, 39, 47, 53, 55], "letter": [4, 5, 7, 34], "level": [2, 4, 5, 6, 7, 21, 28, 40, 45], "levenshtein": 5, "leverag": [2, 7, 21], "lib": [1, 23], "lib_dir": 23, "lib_nam": 23, "librari": [1, 7, 8, 16, 21, 24, 44, 45, 46, 47, 53, 55], "lieu": [7, 19], "lifetim": [12, 35, 44], "lightweight": 51, "like": [1, 2, 3, 4, 5, 6, 7, 8, 21, 23, 24, 28, 31, 35, 36, 40, 42, 54, 55], "limit": [1, 2, 3, 4, 5, 23, 27, 29, 31, 39, 41, 42, 43, 54], "line": [1, 2, 7, 11, 14, 15, 21, 26, 28, 36, 49], "linear": [5, 28], "link": [23, 26], "lint": 23, "linter": 23, "linux": 44, "list": [0, 1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 19, 28, 32, 35, 36, 37, 38, 40, 41, 42, 55], "list_": [6, 36], "list_any_match": 5, "list_any_valu": 5, "list_append": [5, 23], "list_cat": 5, "list_compact": 5, "list_concat": 5, "list_contain": 5, "list_dim": [4, 5, 7], "list_dist": 5, "list_distinct": [4, 5, 7], "list_el": 5, "list_empti": 5, "list_except": 5, "list_extract": 5, "list_filt": 5, "list_ha": 5, "list_has_al": 5, "list_has_ani": 5, "list_indexof": 5, "list_intersect": 5, "list_join": 5, "list_length": [4, 5, 7], "list_max": 5, "list_min": 5, "list_ndim": [4, 5, 7], "list_norm": 5, "list_overlap": 5, "list_pop_back": 5, "list_pop_front": 5, "list_posit": 5, "list_prepend": 5, "list_push_back": 5, "list_push_front": 5, "list_remov": 5, "list_remove_al": 5, "list_remove_n": 5, "list_repeat": 5, "list_replac": 5, "list_replace_al": 5, "list_replace_n": 5, "list_res": 5, "list_revers": 5, "list_slic": 5, "list_sort": 5, "list_tabl": 36, "list_to_str": 5, "list_transform": 5, "list_union": 5, "list_zip": 5, "lit": [2, 4, 5, 6, 7, 12, 23, 27, 28, 30, 34, 35, 36, 38, 42, 47], "liter": [2, 4, 5, 6, 7, 31, 32, 34, 36, 37, 42], "literal_with_metadata": [4, 7], "littl": 36, "live": [6, 26, 28, 35, 36, 44], "ll": [31, 33, 38], "llm": 26, "llmstxt": 26, "llo": 5, "ln": [4, 5, 7], "load": [1, 3, 4, 7, 12, 26, 39, 40, 44], "load_catalog": 40, "local": [1, 4, 7, 12, 21, 23, 39, 44, 45], "localfilesystem": [13, 40], "locat": [1, 9, 20], "locationinputplugin": [9, 10], "lock": 24, "log": [5, 31], "log10": [4, 5, 7], "log2": [4, 5, 7], "logarithm": [4, 5, 7], "logic": [1, 2, 4, 6, 7, 15, 17, 18, 27, 28, 34, 36, 41, 42, 44, 55], "logical_plan": [1, 2, 17], "logicalextensioncodec": [4, 7, 15, 55], "logicalextensioncodecexport": [1, 19], "logicalplan": [1, 2, 4, 7, 15, 17, 18], "lonely_trip": 34, "long": [3, 6, 12, 21, 44], "long_tim": 30, "longer": [5, 43, 55], "look": [1, 2, 4, 7, 19, 21, 23, 36, 39], "lookup": [1, 5, 36], "loop": [7, 15, 36, 41, 42], "lose": 36, "loss": 54, "low": [4, 7, 28, 30], "low_passenger_count": 34, "lower": [2, 4, 5, 7, 19, 31, 34], "lower_df": 5, "lowercas": [1, 2, 4, 5, 7], "lowest": [21, 28], "lpad": 5, "lpad_df": 5, "ltrim": [4, 5, 7], "luhn": 6, "luhn_check": 6, "lval": 2, "lz4": [2, 7], "lz4_raw": [2, 7], "lzo": [2, 7], "m": [4, 5, 23, 36, 41], "mac": 23, "machin": [23, 26], "machineri": 44, "machop": 38, "maco": 44, "made": [34, 36], "magikarp": 28, "magnemit": 38, "magnitud": 5, "mai": [1, 2, 4, 5, 6, 7, 11, 12, 14, 15, 19, 21, 36, 39, 40, 41, 43, 44, 46, 54], "mail": 30, "main": [1, 26, 27, 42, 44], "maintain": [1, 2, 21, 27, 54], "major": [4, 7, 12, 23, 24, 44, 55], "make": [5, 21, 23, 24, 31, 44, 55], "make_arrai": [5, 30], "make_d": 5, "make_dt_interv": 6, "make_interv": 6, "make_list": 5, "make_map": 5, "make_tim": 5, "make_valid_utf8": 6, "manag": [1, 3, 7, 23, 39, 43], "mani": [3, 7, 15, 21, 28, 36, 39, 42, 43, 44], "manipul": [1, 7, 31, 42], "mankei": [28, 38], "manner": 21, "manual": [23, 26, 39, 44], "map": [2, 5, 6, 7, 26, 30, 44, 54], "map_entri": 5, "map_extract": 5, "map_from_arrai": 6, "map_from_entri": 6, "map_kei": 5, "map_valu": 5, "market": 30, "match": [1, 2, 4, 5, 6, 7, 14, 30, 31, 33, 36, 39, 44, 55], "materi": [1, 2, 36, 42, 47], "math": [5, 28, 35], "mathemat": [6, 32, 34, 42], "maturin": 23, "max": [5, 6, 28, 29, 36], "max_cell_length": [3, 7, 43], "max_cpu_usag": 39, "max_height": [3, 7, 43], "max_memory_byt": [3, 43], "max_row": [3, 43], "max_row_group_s": [2, 7], "max_siz": 36, "max_width": [3, 7, 43], "maxim": 45, "maximum": [1, 2, 3, 5, 7, 11, 14, 43], "maximum_buffered_record_batches_per_stream": [2, 7], "maximum_parallel_row_group_writ": [2, 7], "md": 26, "md5": [4, 5, 7], "mean": [3, 5, 6, 21, 23, 28, 29], "meaning": [5, 7, 15, 34, 41], "meant": [7, 15], "meantim": 44, "measur": [5, 30, 39, 41], "mechan": 36, "med": 36, "medal": 5, "median": [5, 28, 29], "medium": 30, "meet": 28, "member": [23, 28], "membership": [26, 28, 32], "memoiz": 19, "memori": [0, 1, 2, 3, 7, 15, 19, 24, 39, 41, 44, 45, 47], "memory_catalog": [0, 7, 40], "memory_limit": 1, "memory_schema": [0, 40], "memtabl": 55, "mention": [2, 30], "merg": [7, 19, 33, 36], "messag": [1, 3, 12, 43], "met": 28, "meta": 5, "meta_v": 5, "metadata": [1, 2, 4, 5, 7, 11, 19, 36], "metapod": [24, 38, 40, 46], "method": [0, 1, 2, 3, 4, 5, 7, 11, 14, 19, 27, 29, 31, 33, 36, 37, 42, 44, 55], "metric": [2, 5, 7, 15, 45], "metrics_set": 41, "metricsset": [7, 15, 41], "metrorid": 33, "microsecond": [5, 6], "microsoftazur": [1, 13, 40], "might": [3, 19, 28, 43], "millisecond": [5, 6], "min": [5, 6, 28, 29, 36], "min_qti": 36, "min_row": [3, 43], "minimum": [1, 2, 3, 5, 7, 43], "minor": [4, 7, 12, 44], "minu": 6, "minut": [5, 6], "mirror": [6, 28, 41], "misbehav": 44, "mismatch": [4, 7, 44], "miss": [1, 7, 14, 23, 26, 32, 45], "mix": 2, "mkdtemp": 36, "mm": 5, "mod": [6, 35], "mode": [1, 2, 5, 7, 35], "model": [1, 2, 12, 26, 28, 38, 44], "modifi": [2, 7, 27, 43], "modul": [5, 7, 21, 35, 38, 42, 43, 44], "modulo": [4, 7], "modulu": 6, "moment": [2, 21], "mon": 6, "monitor": 39, "month": [5, 6, 31], "more": [1, 2, 3, 4, 5, 7, 15, 17, 19, 21, 23, 27, 28, 30, 31, 36, 39, 41, 42, 44], "most": [1, 5, 12, 19, 21, 26, 28, 30, 35, 36, 38, 41, 44, 46], "mostli": 23, "mp": 44, "mp_ctx": 44, "much": [5, 7, 15, 19, 23, 43], "multi": [1, 5, 24], "multipl": [1, 2, 3, 4, 5, 7, 19, 28, 31, 33, 36, 38, 39, 40, 41, 42, 43], "multipli": [7, 19], "multiprocess": [12, 44], "multiprocessing_pickle_expr": 44, "must": [1, 2, 3, 4, 5, 6, 7, 12, 14, 19, 21, 28, 30, 34, 36, 38, 41, 44, 47, 53, 54, 55], "mutabl": [22, 23, 44], "mutat": [1, 7, 19, 21, 36], "my": 1, "my_capsul": 21, "my_catalog": 40, "my_catalog_nam": 40, "my_cell_build": 43, "my_delta_t": 40, "my_extens": 1, "my_ffi_aggreg": [12, 44], "my_filt": 55, "my_header_build": 43, "my_provid": 21, "my_schema": 40, "my_schema_nam": 40, "my_tabl": [1, 37], "my_udaf": 36, "myaccumul": 36, "mycatalogprovid": 55, "mylib": [4, 7, 44], "myphysicaloptimizerrul": 1, "mysql": [18, 54], "mystyleprovid": 43, "mytablefunct": 36, "mytableprovid": [21, 53], "myusernam": 23, "n": [1, 2, 4, 5, 6, 7, 41, 49], "n_column": [2, 7], "n_file": [2, 7], "n_row_group": [2, 7], "name": [0, 1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 19, 21, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 38, 40, 41, 43, 44, 45, 46, 53, 54, 55], "name_pair": 5, "named_expr": 2, "named_param": 1, "named_struct": [5, 23], "namespac": [6, 28, 32], "nan": [4, 5, 7], "nanoarrow": [7, 19, 36], "nanosecond": [5, 7, 15, 41], "nanvl": 5, "nanvl_df": 5, "narrow": [1, 44], "narrowli": 21, "nativ": [4, 6, 21, 36, 40], "native_filt": 36, "natur": [4, 5, 7, 28, 36], "nearest": [4, 5, 6, 7], "nearli": [39, 40], "necessari": [21, 40, 55], "need": [0, 1, 2, 3, 4, 7, 11, 12, 14, 19, 21, 23, 28, 30, 36, 38, 39, 40, 42, 43, 44, 46, 54, 55], "neg": [4, 5, 6, 35], "negat": [4, 5, 7, 31], "neither": 28, "nest": [1, 2, 4, 5, 28, 39], "network": 39, "never": [2, 12, 44], "new": [1, 2, 3, 4, 5, 7, 18, 19, 21, 23, 30, 32, 36, 53, 54, 55], "new_bound": [21, 53], "new_fil": 1, "new_nam": 2, "new_with_ffi_codec": 55, "newlin": [7, 14], "newlines_in_valu": [7, 14], "next": [5, 7, 16], "next_dai": 6, "nnnnnnnnn": 5, "node": [7, 15, 41, 44], "non": [1, 2, 4, 5, 6, 7, 15, 28, 33, 38, 42, 44], "none": [0, 1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 16, 17, 19, 21, 28, 30, 36, 38, 40, 41, 43, 44, 53, 54, 55], "nonexistent_rul": 1, "nonnul": [21, 55], "norm": 5, "normal": [1, 5, 28], "not_in": 5, "not_red_unit": 30, "notat": [30, 51], "note": [1, 2, 4, 7, 27, 30, 40, 42], "notebook": [3, 41, 42, 43, 46], "noth": 44, "notic": [28, 36], "notimplementederror": 6, "now": [5, 19, 21, 31, 33, 36, 37, 55], "np": 5, "npx": 26, "nr": 29, "nt": 5, "nth": 5, "nth_valu": [5, 19, 28], "ntile": [5, 38], "null": [1, 2, 4, 5, 6, 7, 14, 29, 30, 31, 33, 35, 36, 47, 49], "null_check": 1, "null_count": 29, "null_first": 5, "null_regex": [7, 14], "null_str": 5, "null_treat": [4, 5, 6, 7, 28, 38], "nullabl": [2, 5, 7, 14, 19, 36], "nullcheck": 1, "nullif": [5, 31], "nulls_first": [4, 5, 7, 28], "nulltreat": [4, 5, 6, 7, 28, 38], "num": [2, 5, 39, 54], "num_centroid": 5, "num_el": 30, "num_row": [7, 19, 36], "number": [1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 19, 23, 30, 31, 36, 38, 39, 41, 43, 54], "numbit": 6, "numbucket": 6, "numer": [2, 3, 4, 5, 6, 7, 35, 36, 39], "nvl": 5, "nvl2": 5, "nvl_df": 5, "o": [1, 5, 36, 39, 40, 41, 42, 43], "obj": 55, "object": [1, 2, 3, 4, 5, 7, 13, 14, 15, 16, 17, 19, 21, 30, 36, 39, 41, 42, 44, 45, 47, 51, 54, 55], "object_stor": [1, 7, 20, 40], "objectstor": 1, "observ": 44, "obtain": [2, 8, 24, 42], "obviou": 21, "occasion": 21, "occupi": 44, "occur": [7, 19, 42], "occurr": 5, "octet_length": [4, 5, 7], "oddish": 38, "offend": 23, "offer": [30, 31, 42, 54], "offici": 21, "offset": [2, 4, 5], "often": [30, 36, 38, 39], "ok": 55, "old": 2, "old_nam": 2, "older": 40, "olleh": 5, "olymp": 5, "omanyt": 28, "omit": [6, 33], "on_expr": 2, "onc": [2, 3, 5, 8, 12, 19, 28, 30, 36, 41, 43, 44, 47, 53], "one": [2, 4, 5, 6, 7, 15, 19, 21, 28, 30, 33, 36, 38, 40, 41, 42, 44], "onli": [1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 16, 19, 21, 28, 30, 31, 33, 36, 38, 41, 42, 43, 44], "onlin": [1, 2, 4, 5, 7, 19, 21, 39], "oop": [4, 5, 7], "op": [2, 4, 5, 7], "opaqu": 36, "open": [3, 23, 26], "oper": [1, 2, 4, 5, 7, 15, 16, 19, 21, 24, 26, 28, 30, 34, 36, 38, 39, 40, 41, 45], "operand": [4, 7], "operatefunctionarg": 4, "operator_nam": 41, "opposit": [4, 5], "opt": [21, 23, 28, 36], "optim": [1, 2, 19, 21, 36, 39], "optimized_logical_plan": 2, "option": [0, 1, 2, 4, 5, 6, 7, 11, 19, 20, 23, 26, 27, 28, 30, 31, 39, 40, 42, 46, 49, 54], "options_intern": [1, 7], "or_": 36, "order": [1, 2, 4, 5, 7, 8, 11, 14, 15, 19, 21, 30, 44], "order_bi": [2, 4, 5, 6, 7, 28, 38], "order_id": 28, "orders_df": 28, "org": [1, 2, 5, 7, 15, 26], "organ": 40, "orient": [7, 26], "origin": [1, 2, 4, 5, 7, 36, 40, 54], "orthogon": 5, "other": [1, 2, 3, 4, 5, 7, 11, 15, 19, 21, 23, 24, 26, 27, 28, 30, 32, 35, 36, 39, 41, 42, 45, 49, 55], "otherwis": [4, 5, 7, 12, 30], "our": [21, 23, 28, 40, 46], "out": [2, 5, 7, 21, 28, 44], "outbound": [12, 44], "outer": 5, "outermost": [7, 15], "output": [2, 3, 4, 5, 7, 15, 19, 23, 28, 30, 36, 37, 41, 43], "output_column": 2, "output_row": [7, 15, 41], "output_typ": [7, 15, 41], "over": [2, 3, 4, 5, 7, 16, 19, 21, 24, 28, 30, 36, 38, 40, 41, 42, 43, 44, 49], "overal": [5, 28], "overflow": 6, "overhead": [19, 44], "overlai": 5, "overlap": 5, "overrid": [1, 2, 6, 7, 35, 36], "overridden": 28, "overview": [2, 45], "overwrit": [2, 5, 7, 12], "own": [5, 7, 8, 12, 19, 36, 43, 44, 55], "owner": 0, "owner_nam": 0, "p": 35, "pa": [1, 4, 5, 6, 7, 16, 19, 36, 40, 42, 44, 47], "packag": [4, 21, 23], "pad": [5, 43], "page": [2, 7, 20, 21, 36, 44], "pair": [1, 5, 6, 12, 28, 41, 44], "pairdelim": 6, "panda": [1, 2, 5, 7, 27, 29, 40, 42, 54], "pandas_df": [40, 42], "para": 38, "parallel": [1, 2, 6, 7, 14, 39, 41, 44], "param": 5, "param_attack": 54, "param_nam": 3, "param_valu": [1, 54], "paramet": [0, 1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 16, 17, 19, 23, 30, 32, 33, 43, 54, 55], "parameter": [1, 45], "parametr": 44, "parasect": 38, "parent": 44, "pariti": 6, "parquet": [0, 1, 2, 7, 11, 21, 24, 27, 34, 36, 39, 40, 42, 43, 45, 50], "parquet_path": 36, "parquet_prun": [1, 7, 11], "parquetcolumnopt": [2, 7], "parquetwriteropt": [2, 7], "pars": [1, 2, 5, 7, 14, 17, 30], "parse_capacity_limit": 1, "parse_sql_expr": [1, 2], "parse_url": 6, "parser": 54, "part": [2, 5, 6, 7, 28, 31], "partial": 28, "particular": [5, 28, 39], "partit": [1, 2, 4, 5, 7, 11, 14, 15, 19, 28, 36, 39, 42, 44], "partition_bi": [2, 4, 5, 7, 38], "partition_count": [7, 15], "parttoextract": 6, "pass": [1, 2, 4, 5, 6, 7, 12, 19, 21, 23, 28, 29, 30, 36, 39, 40, 42, 44, 54, 55], "passenger_count": 34, "past": [26, 30], "path": [1, 2, 4, 5, 6, 7, 11, 15, 17, 19, 23, 36, 40, 42, 44], "path_to_t": 40, "pathlib": [1, 2, 7, 11, 17], "pattern": [1, 2, 5, 6, 7, 14, 21, 26, 30, 39, 44], "payload": [4, 7, 12, 44], "pc": [7, 19], "pcre": 5, "pd": [40, 42], "peopl": 5, "per": [2, 3, 5, 7, 12, 14, 15, 19, 28, 30, 35, 36, 38, 42, 43, 44], "percent": 5, "percent_rank": [5, 19, 38], "percentag": 5, "percentil": [5, 28], "percentile_cont": [5, 28], "perform": [1, 2, 3, 4, 5, 7, 14, 19, 21, 23, 27, 28, 31, 36, 38, 39, 40], "period": 21, "permut": 6, "persist": [44, 54], "person": 23, "pgjson": [2, 7], "phonet": 6, "physic": [1, 2, 7, 15, 27, 44], "physicalextensioncodec": [7, 15], "physicalextensioncodecexport": [1, 19], "physicaloptimizerruleexport": 1, "pi": 5, "pick": [1, 4, 5, 7, 26], "pickl": [1, 4, 7, 12, 28, 30, 38, 44], "pinsir": 38, "pip": [24, 46], "pipelin": [7, 15, 41], "pitfal": [7, 26], "pivot": 28, "pixel": [3, 43], "pl": 40, "place": [5, 6, 21, 23, 43, 46, 54], "placehold": [4, 54], "plain": [2, 4, 6, 7, 36, 42, 43], "plain_dictionari": [2, 7], "plan": [1, 2, 4, 5, 7, 17, 18, 19, 20, 24, 27, 36, 42, 44], "plan_intern": 17, "plan_to_sql": 18, "planner": [7, 15], "pleas": [23, 34], "plu": [4, 5, 7, 28, 44], "plugin": [1, 8, 9, 10], "pmod": 6, "po": [5, 6], "point": [1, 3, 4, 5, 6, 7, 23, 26, 42, 54], "pointer": 26, "pointer_check": [21, 55], "pointer_width": 23, "poison": [24, 28, 38, 40, 46], "pokemon": [24, 28, 31, 38, 40, 46, 54], "polar": [1, 2, 7, 40, 42], "polars_df": [40, 42], "poll": 42, "pool": [1, 7, 12], "popul": [5, 41, 42], "popular": [31, 40], "portabl": [1, 4, 7, 12], "portion": 21, "posit": [2, 3, 4, 5, 6, 7, 19, 28, 35, 36], "position": 55, "possibl": [2, 4, 7, 19, 21, 28, 31, 36, 38, 44], "possibli": [4, 5], "post": 23, "postgr": 18, "postgresql": [2, 7, 18], "potenti": [2, 7, 15, 54, 55], "pow": [5, 31], "power": [5, 31, 36, 38], "pq": 36, "pr": [5, 23], "practic": [2, 21, 36, 39], "pre": [1, 4, 7, 12, 22, 28, 38, 44], "preced": [3, 4, 5, 7, 19, 38, 54], "precis": [5, 39], "pred_udf": 36, "predic": [1, 2, 5, 7, 11, 30, 33, 36], "prefer": [5, 21, 23, 26, 30, 44], "prefix": [4, 5, 21], "prepar": [4, 54], "prepend": 5, "presenc": 31, "present": [2, 21, 30, 33], "preserv": [1, 2, 5, 6], "preserve_nul": 2, "pressur": [7, 15, 41], "pretti": 18, "prevent": [3, 23, 43], "preview": 41, "previou": [5, 12, 36, 38], "previous": 1, "price": 5, "primari": [2, 7, 9, 22, 30, 42], "primit": [7, 19, 21, 36], "principl": 39, "print": [0, 1, 2, 4, 7, 15, 19, 36, 37, 39, 41, 42, 43, 44], "printabl": [7, 15, 19], "printf": 6, "prior": [2, 40], "prioriti": 30, "probabl": [2, 7, 28], "problem": 33, "process": [2, 4, 7, 12, 19, 28, 38, 39, 41, 42, 44, 47], "processor": 39, "produc": [1, 2, 4, 5, 7, 15, 17, 19, 21, 26, 28, 36, 38, 41, 42, 44], "product": [5, 39, 42], "program": [1, 21, 44], "programmat": [7, 15], "progress": 44, "project": [2, 4, 7, 15, 16, 21, 22, 23, 25, 26, 36, 41, 42, 44, 47, 55], "projectionexec": 41, "promot": 6, "prompt": 26, "propag": [1, 4, 5, 6, 7, 12, 19, 31, 35, 36], "proper": 39, "properti": [0, 2, 3, 4, 7, 15, 19, 41], "proto_byt": [4, 7, 17], "protobuf": [7, 15], "protocol": [1, 3, 4, 6, 7, 12, 19, 42, 43, 44], "provid": [0, 1, 2, 3, 4, 5, 7, 8, 9, 14, 15, 16, 17, 18, 19, 21, 27, 28, 30, 31, 36, 38, 39, 41, 42, 44, 45, 46, 50, 54, 55], "prune": [1, 7, 11, 36], "pruning_pred": 36, "psychic": 28, "pub": [21, 55], "public": [0, 7, 19, 40], "publish": 45, "pull": [23, 47], "pure": [1, 7, 19, 23, 36], "purpos": [36, 44], "push": [23, 36, 40], "pushdown": 36, "pushdown_filt": 39, "put": [34, 35], "py": [1, 7, 17, 21, 36, 39, 44, 53, 55], "py_dict": 42, "py_list": 42, "pyani": 55, "pyarrow": [0, 1, 2, 4, 5, 6, 7, 11, 14, 16, 19, 21, 29, 36, 40, 44, 45, 47, 54], "pycapsul": [0, 1, 2, 7, 16, 19, 21, 36, 40, 47, 53, 55], "pycapsuleinterfac": [1, 2], "pyclass": [21, 23], "pydatatyp": 21, "pyiceberg": 40, "pymethod": [36, 53, 55], "pyo3": [19, 22, 23, 36, 40, 55], "pyo3_build_config": 23, "pyo3_config_fil": 23, "pyo3_print_config": 23, "pypi": 46, "pyproject": 23, "pyresult": [36, 53, 55], "pysessioncontext": 21, "pyspark": [6, 24], "pytabl": 21, "pytest": 23, "python": [0, 1, 2, 4, 5, 6, 7, 12, 19, 22, 25, 26, 28, 29, 30, 33, 35, 36, 38, 39, 40, 43, 45, 46, 47, 53, 54, 55], "python3": 23, "python_typ": 21, "python_valu": [4, 7], "pythontyp": [4, 7, 21], "q": [6, 36], "q08": 30, "qty": 36, "qty_arr": 36, "qty_max": 36, "qty_null_count": 36, "qualifi": [2, 33], "quantile_cont": [5, 28], "quantiti": 36, "queri": [1, 2, 4, 5, 6, 7, 15, 17, 19, 21, 24, 27, 28, 31, 35, 37, 39, 40, 41, 42, 45, 47], "quick": [5, 29], "quit": 52, "quot": [2, 7, 14, 34], "r": [2, 5, 6, 7, 18, 21, 23, 49], "r163": 6, "rad": 5, "radian": [4, 5, 7], "rai": [12, 44], "rail": 30, "rais": [1, 2, 3, 4, 5, 6, 7, 12, 19, 30, 44], "ram": 39, "random": [5, 6, 19, 29, 30], "rang": [1, 2, 4, 5, 7, 19, 29, 30, 31, 36, 38, 39, 42], "rank": [1, 5, 19, 36, 38], "ranks_in_partit": 19, "rare": 21, "rather": [1, 5, 6, 12, 17, 26, 30, 42, 44, 47], "ratio": 5, "raw": [1, 3, 4, 5, 7, 15, 19, 41], "raw_sort": 4, "rawcatalog": [0, 7], "rawcataloglist": 0, "rawexpr": [4, 7], "rawschema": 0, "ray_pickle_expr": 44, "rb": [7, 16], "re": [1, 2, 4, 7, 19, 21, 44], "reach": [3, 5, 30, 36], "read": [0, 1, 2, 4, 5, 7, 9, 10, 11, 14, 17, 21, 36, 40, 42, 43, 45, 46, 48, 49, 51, 52, 54], "read_": 44, "read_arrow": 1, "read_avro": [1, 7, 11, 42, 44, 48], "read_batch": 1, "read_csv": [1, 2, 7, 11, 24, 27, 28, 38, 40, 42, 44, 46, 49], "read_empti": 1, "read_json": [1, 7, 11, 42, 44, 51], "read_parquet": [1, 2, 7, 11, 27, 34, 36, 39, 42, 44, 52], "read_tabl": 1, "readabl": [5, 26, 28, 30], "reader": [1, 7, 11, 14, 42, 47], "real": 28, "realiti": 28, "reason": [2, 21, 23], "reassembli": 44, "rebuild": [1, 23], "rebuilt": 1, "receiv": [1, 4, 5, 7, 12, 19, 21, 28, 36, 38, 43, 44], "recent": [38, 40, 41], "recommend": [2, 21, 23, 36, 39, 43, 54], "reconstruct": [4, 7, 12, 44], "record": [1, 2, 3, 7, 14, 15, 16, 27, 28, 34, 36, 40, 41, 47, 48], "record_batch": [1, 2, 6, 7, 20], "record_batch_stream": [7, 16], "recordbatch": [1, 2, 3, 5, 7, 16, 36, 40, 42], "recordbatchread": 42, "recordbatchstream": [1, 2, 7, 16, 42], "recurs": 2, "recursivequeri": 4, "red": [30, 43], "red_or_green_unit": 30, "red_unit": 30, "reduc": [7, 14, 23, 33, 36, 43, 55], "redund": 6, "ref": [5, 6, 36, 42], "refer": [1, 2, 3, 4, 5, 7, 12, 21, 26, 27, 28, 30, 31, 32, 33, 36, 38, 42, 43, 54, 55], "referenc": [1, 27], "reflect": [3, 41], "refresh": [1, 3], "refresh_catalog": 1, "refus": [1, 44], "regardless": [1, 19, 30, 41, 44], "regener": 23, "regex": [5, 7, 14], "regexp_count": 5, "regexp_instr": 5, "regexp_lik": 5, "regexp_match": [5, 31], "regexp_replac": [5, 31], "region": [1, 28, 40], "regist": [0, 1, 2, 3, 4, 6, 7, 8, 11, 12, 15, 19, 21, 27, 28, 32, 35, 36, 38, 40, 42, 43, 45, 53, 54], "register_arrow": 1, "register_avro": 1, "register_batch": [1, 36], "register_catalog": 0, "register_catalog_provid": [1, 40], "register_catalog_provider_list": 1, "register_csv": [1, 31, 49, 54], "register_dataset": [1, 40], "register_formatt": [3, 43], "register_json": 1, "register_listing_t": 1, "register_object_stor": [1, 40], "register_parquet": [1, 40, 52], "register_record_batch": 1, "register_schema": [0, 7, 40], "register_t": [0, 1, 2, 40, 53], "register_table_factori": 1, "register_table_provid": [1, 40], "register_udaf": [1, 12, 44], "register_udf": 1, "register_udtf": [1, 36], "register_udwf": 1, "register_view": [1, 37], "registr": [4, 7, 12, 44, 54], "registri": [1, 7, 19, 26, 36, 44], "regr_avgi": [5, 28], "regr_avgx": [5, 28], "regr_count": [5, 28], "regr_intercept": [5, 28], "regr_r2": [5, 28], "regr_slop": [5, 28], "regr_sxi": 5, "regr_sxx": [5, 28], "regr_syi": [5, 28], "regress": [5, 28], "regular": [3, 5, 31], "reject": 4, "rel": [5, 38], "relat": [2, 7, 15, 26, 33], "releas": [21, 26, 38], "relev": 23, "reli": [23, 40, 44, 54], "remain": [1, 4, 5, 6, 7, 21, 31, 44], "remaind": 6, "remot": [9, 10, 39, 44], "remov": [0, 1, 2, 4, 5, 7, 12, 28, 55], "remove_optimizer_rul": 1, "renam": [2, 5], "renamed_ag": 30, "render": [2, 3, 7, 45], "reorder": [2, 7, 16], "repartit": [1, 2, 4, 7, 39], "repartition_by_hash": [2, 39], "repartitionexec": 36, "repeat": [5, 6, 30], "repeated_arrai": 30, "replac": [2, 5, 6, 7, 26, 31, 54], "repo": [23, 26], "report": [2, 7, 19, 23, 28], "repositori": [21, 36, 39, 40], "repr": [3, 41], "repr_row": 3, "repres": [1, 2, 4, 7, 11, 14, 15, 16, 17, 27, 30, 36, 39, 42], "represent": [0, 1, 2, 3, 4, 5, 6, 7, 11, 15, 17, 19, 43, 54], "request": [3, 21, 23], "requested_schema": [1, 2, 7, 16], "requir": [1, 2, 4, 5, 7, 19, 21, 26, 31, 39, 40, 49, 55], "required_guarante": 36, "reserv": [1, 7], "reset": [3, 43], "reset_formatt": [3, 43], "reshap": 2, "resolut": 44, "resolv": [1, 2, 3, 4, 7, 12, 23, 26, 28, 38, 44], "resourc": [21, 25, 39], "respect": [5, 28, 36, 40], "respect_nul": [5, 28, 38], "rest": [7, 19], "restrict": [28, 44], "result": [1, 2, 4, 5, 7, 15, 16, 19, 24, 27, 28, 30, 33, 34, 36, 37, 38, 39, 41, 42, 44], "result_batch": 42, "result_dict": 37, "retain": 12, "retriev": [0, 1, 4, 7, 33, 41], "return": [0, 1, 2, 3, 5, 6, 8, 9, 10, 11, 12, 14, 15, 16, 17, 19, 21, 28, 30, 33, 35, 36, 40, 41, 42, 43, 44, 47], "return_field": [7, 19], "return_typ": [7, 19, 36], "reus": 21, "reusabl": 4, "revers": [4, 5, 7], "review": [21, 23], "rewrit": 36, "rex": [4, 7], "rex_call_oper": [4, 7], "rex_call_operand": [4, 7], "rex_typ": [4, 7], "rextyp": [4, 7], "rfc": 1, "rfc3339": [4, 5, 7], "rh": [4, 7], "rhyhorn": 38, "rich": 3, "rid": 2, "ride": 44, "right": [2, 5, 6, 33, 36], "right2": 2, "right_on": [2, 33], "rint": 6, "ritchi": 38, "rle": [2, 7], "rle_dictionari": [2, 7], "rn": [1, 2, 5], "rnk": 5, "roadmap": 44, "robert": 6, "robin": 2, "rock": [28, 38], "roll": 38, "rollup": [2, 4, 5], "root": [4, 5, 7, 15, 23, 41], "roption": 21, "round": [1, 2, 5, 6, 27, 31, 35], "roundrobinbatch": 36, "rout": [4, 7, 15, 21], "row": [1, 2, 3, 4, 5, 7, 11, 14, 15, 19, 27, 28, 29, 30, 33, 36, 37, 38, 39, 41, 42, 43, 49, 54], "row_count": [3, 36], "row_idx": 3, "row_numb": [1, 2, 5, 19, 38], "rpad": 5, "rresult": 21, "rstring": 21, "rtrim": [4, 5, 7], "rubi": 29, "rule": [1, 36, 44], "run": [1, 2, 4, 7, 11, 12, 14, 15, 19, 22, 24, 26, 28, 30, 37, 39, 41, 44, 46], "runnabl": [23, 44], "runtim": [1, 2, 7, 15, 19, 39, 41, 42, 44], "runtimeenvbuild": [1, 7, 39], "rust": [1, 2, 5, 6, 7, 14, 19, 21, 22, 24, 25, 36, 39, 40, 44, 53], "rustc": 21, "rustflag": 23, "rustonomicon": 21, "rval": 2, "rvec": 21, "rwlock": 21, "s3": [1, 40], "safe": [1, 21, 44], "safer": 1, "safeti": 24, "sale": 41, "same": [1, 2, 4, 5, 7, 15, 19, 21, 27, 28, 33, 35, 36, 41, 42, 44], "sampl": [5, 29, 37, 40], "satisfi": [5, 28, 30], "saur": 31, "save": [5, 19, 44], "scalar": [1, 4, 5, 6, 7, 12, 19, 30, 32, 44, 54], "scalarsubqueri": 4, "scalarudf": [1, 7, 19], "scalarudfexport": [7, 19], "scalarvalu": 19, "scalarvari": 4, "scale": [5, 6, 30, 36, 44], "scan": [1, 7, 14, 15, 36, 41], "schedul": 44, "schema": [0, 1, 2, 3, 4, 5, 7, 11, 14, 15, 16, 29, 36, 43, 45], "schema_infer_max_record": [1, 7, 11, 14], "schema_nam": [0, 4, 7], "schemaprovid": [0, 7, 54, 55], "schemaproviderexport": [0, 7], "scheme": [1, 2], "scienc": 31, "scope": 12, "score": [2, 5], "script": [3, 39], "search": [5, 30], "search_str": 5, "sec": 6, "secant": 6, "second": [5, 6, 27, 28, 30, 40], "second_arrai": 5, "second_two_el": 30, "secret_access_kei": [1, 40], "section": [21, 27, 29, 32, 33, 36, 38, 40, 42, 44], "secur": [1, 4, 7, 28, 38], "see": [1, 2, 4, 5, 7, 12, 15, 16, 17, 18, 19, 21, 23, 26, 27, 28, 30, 31, 36, 38, 39, 41, 42, 43, 45], "seed": 6, "seen": [19, 28], "select": [1, 2, 4, 5, 6, 7, 11, 14, 16, 19, 27, 28, 30, 31, 32, 33, 35, 36, 37, 38, 40, 41, 42, 44, 45, 47, 54], "select_expr": 2, "self": [2, 4, 7, 14, 16, 19, 36, 43, 44, 53, 55], "semant": [1, 6, 28, 30, 35], "semi": [2, 32], "send": [4, 7, 55], "sender": [1, 4, 7, 12, 44], "sensit": [2, 5, 6, 7], "sent": [4, 7], "separ": [1, 5, 6, 22, 28, 32, 41, 42], "sequenc": [1, 2, 7, 19], "serd": 17, "seri": 30, "serial": [1, 2, 4, 7, 12, 15, 17, 28, 30, 38, 44, 48], "serialize_byt": 17, "serialize_to_plan": 17, "serv": 21, "server": 7, "session": [1, 2, 3, 4, 7, 12, 15, 19, 35, 39, 43, 45, 46, 54, 55], "session_id": 1, "session_start_tim": 1, "sessionconfig": [1, 7, 39, 55], "sessioncontext": [0, 1, 2, 4, 5, 6, 7, 8, 12, 15, 17, 19, 21, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 44, 46, 47, 48, 49, 51, 52, 53, 54, 55], "sessioncontextintern": 1, "sessionst": 1, "set": [0, 1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 18, 19, 21, 23, 27, 30, 32, 33, 35, 36, 39, 41, 43, 44, 49, 54, 55], "set_custom_cell_build": [3, 43], "set_custom_header_build": [3, 43], "set_formatt": [3, 43], "set_sender_ctx": [1, 4, 7, 12, 44], "set_worker_ctx": [1, 4, 7, 12, 44], "setter": 21, "setup": 12, "setvari": 4, "sever": [5, 28, 30, 34, 35, 36, 39, 41, 42], "sha": [4, 5, 6, 7, 35], "sha1": 6, "sha2": [1, 6, 35], "sha224": [4, 5, 7], "sha256": [4, 5, 7], "sha384": [4, 5, 7], "sha512": [4, 5, 7], "shape": 30, "sharabl": 21, "share": [1, 2, 3, 5, 7, 19, 21, 23, 27, 30, 35, 36, 47], "sharp": 44, "shift": 6, "shift_offet": 5, "shift_offset": 5, "shiftleft": 6, "shiftright": 6, "shiftrightunsign": 6, "ship": [4, 7, 12, 26, 28, 30, 35, 38, 44], "shipmod": 30, "short": [26, 42, 44], "shorter": 2, "shorthand": 5, "shot": 19, "should": [1, 2, 4, 5, 7, 8, 11, 15, 17, 21, 23, 28, 33, 36, 38, 55], "show": [2, 3, 21, 24, 27, 29, 30, 33, 35, 36, 38, 39, 40, 42, 43, 46, 53, 54], "show_attack": 54, "show_column": 54, "show_truncation_messag": [3, 43], "showcas": 39, "shown": [3, 7, 15, 30, 55], "shuffl": [6, 44], "side": [2, 4, 5, 7, 12, 21, 28, 30, 36, 44], "sign": [4, 5, 6, 7], "signatur": [35, 44, 55], "signific": 40, "significantli": [5, 39], "signum": [4, 5, 7], "silent": 44, "silver": 5, "similar": [4, 5, 7, 21, 27, 30, 38, 44, 54], "similarto": 4, "simpl": [2, 5, 23, 30, 34, 36, 39, 51, 52, 54], "simpler": 30, "simplest": [19, 30, 36], "simpli": [2, 7, 19, 21, 23, 40, 54], "simplic": [7, 19], "simplifi": 38, "simultan": [39, 44], "sin": [4, 5, 7], "sinc": [2, 3, 5, 6, 28, 36, 40, 44, 54], "sine": [4, 5, 7], "singl": [1, 2, 3, 4, 5, 6, 7, 14, 15, 19, 26, 28, 30, 36, 38, 39, 40, 41, 42, 44, 54], "single_file_output": [2, 7], "singleton": 44, "sinh": [4, 5, 7], "sit": 5, "site": [19, 49], "situat": 2, "size": [1, 2, 5, 6, 7, 30, 36, 39, 43, 44, 55], "skew": [39, 41], "skill": [7, 45], "skip": [1, 2, 5, 7, 11, 19, 36, 49], "skip_arrow_metadata": [2, 7], "skip_metadata": [1, 7, 11], "slice": [4, 5, 6, 7, 30, 44], "slightli": 36, "slope": 5, "slot": [12, 41], "slow": 2, "slower": [2, 39], "slowest": 36, "slowpok": 38, "sm": 36, "small": [5, 6, 30, 36, 39, 40, 44], "smallest": [2, 6, 19, 28], "smooth_a": 36, "snappi": [2, 7], "snorlax": 38, "snowflak": 30, "so": [1, 2, 4, 5, 6, 7, 12, 15, 19, 21, 23, 26, 28, 30, 34, 35, 36, 38, 41, 42, 44, 47, 53, 55], "softwar": [7, 15, 21], "solid": 43, "solv": 28, "some": [2, 5, 6, 7, 15, 19, 21, 23, 28, 30, 31, 36, 38, 40, 41, 42, 46, 53, 55], "sometim": [1, 7, 21, 28, 30, 40], "sort": [1, 2, 4, 5, 6, 7, 11, 14, 28, 36, 38, 42], "sort_bi": [2, 7], "sort_expr": [2, 5], "sort_express": 5, "sort_list_to_raw_sort_list": 1, "sortexpr": [1, 2, 4, 5, 7, 14], "sortkei": [1, 2, 4, 5, 6], "sound": 21, "soundex": 6, "sourc": [1, 2, 4, 5, 6, 7, 8, 9, 10, 11, 15, 21, 23, 27, 36, 39, 42, 43, 44, 45, 46, 47, 53], "sp": [24, 40, 46], "space": [4, 5, 6, 7], "span": 5, "sparingli": 36, "spark": [1, 5, 20, 28, 31, 32, 45], "spark_cast": 6, "spawn": 44, "spec": 36, "special": [3, 19, 54], "specif": [0, 2, 3, 4, 7, 15, 26, 29, 30, 31, 36, 38, 39, 41, 42, 43, 44, 54, 55], "specifi": [1, 2, 4, 5, 7, 14, 28, 30, 31, 33, 36, 38, 39, 54], "speed": [2, 7, 22, 24, 28, 38, 40, 46], "spent": [7, 15, 41], "sphinx": 20, "spill": [1, 7, 15, 41], "spill_count": [7, 15, 41], "spillabl": [1, 7], "spilled_byt": [7, 15, 41], "spilled_row": [7, 15, 41], "split": [5, 6, 36, 44], "split_part": 5, "sql": [1, 2, 4, 5, 6, 7, 15, 17, 18, 19, 24, 26, 27, 30, 32, 34, 36, 37, 40, 41, 42, 44, 45], "sql_parser": 30, "sql_type": 21, "sql_with_opt": 1, "sqlite": 18, "sqloption": [1, 7], "sqltabl": [8, 9, 10], "sqltype": [4, 7, 21], "sqrt": [4, 5, 7], "squar": [4, 5, 7], "squi": 31, "squirtl": [24, 31, 38, 40, 46], "src": [21, 23], "ss": 5, "ssd": 39, "stabl": [4, 7, 19, 21, 26, 36, 44], "stack": 2, "stage": 44, "stai": 21, "stamp": [4, 7, 12, 44], "standalon": [30, 55], "standard": [5, 7, 19, 21, 26, 44], "starmap": 44, "start": [1, 4, 5, 6, 14, 19, 30, 33, 34, 38, 43, 44, 46, 49], "start_ag": 30, "start_bound": [4, 7], "start_dat": 6, "start_timestamp": [7, 15], "started_young": 30, "starts_with": 5, "stat": 28, "state": [1, 7, 19, 21, 27, 36, 44], "state_typ": [7, 19, 36], "statement": [1, 4, 5, 7, 27, 54], "static": [0, 1, 2, 4, 5, 7, 15, 17, 18, 19], "statist": [2, 7, 15, 28, 29, 36, 41, 42], "statistics_en": [2, 7], "statistics_truncate_length": [2, 7], "statu": [5, 22], "std": 29, "stddev": [5, 28], "stddev_pop": [5, 28], "stddev_samp": 5, "stem": 21, "step": [5, 7, 15, 21], "still": [7, 12, 14, 21, 36, 40], "stop": 5, "storag": [39, 40], "store": [1, 4, 7, 12, 13, 21, 45], "str": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 14, 15, 17, 18, 19, 54], "str_to_map": 6, "straightforward": [7, 16, 48, 49], "strategi": 39, "stream": [1, 2, 7, 16, 21, 41, 45, 47], "strftime": [5, 43], "strict": [1, 44], "stricter": 44, "strictli": 2, "stride": 5, "string": [0, 1, 2, 3, 4, 5, 6, 7, 14, 15, 17, 18, 19, 21, 23, 28, 29, 30, 32, 35, 36, 41, 42, 43, 54], "string1": 5, "string2": 5, "string_agg": [5, 28], "string_list": 5, "string_liter": [4, 7], "string_to_arrai": 5, "string_to_list": 5, "string_view": [4, 7, 47], "strong": [12, 24], "strongli": 39, "strpo": 5, "struct": [1, 4, 5, 6, 7, 21, 32, 47], "structarrai": 47, "structur": [7, 14, 15, 21], "style": [1, 2, 3, 6, 7, 21, 28, 30, 42, 54], "style_provid": [3, 43], "styleprovid": [3, 43], "sub": [4, 7], "sub_expr": 5, "subclass": [21, 28, 38], "subfield": [4, 5, 7], "subject": 44, "submit": 23, "submodul": 23, "subqueri": [4, 26], "subqueryalia": 4, "subsequ": 44, "subset": [2, 4, 5, 6, 31, 34], "substitut": [1, 6], "substr": [1, 5, 6, 31, 35], "substr_index": 5, "substrait": [7, 20], "subtl": 21, "subtot": [2, 4, 28], "subtract": [4, 7], "subtyp": 28, "successfulli": [7, 14], "suffici": [1, 4, 7, 39], "suffix": 5, "suggest": 40, "suit": 44, "suitabl": 5, "sum": [1, 2, 4, 5, 6, 7, 15, 19, 28, 36, 39, 41, 42, 55], "sum_bias_10": [7, 19], "sum_by_nam": [7, 15, 41], "sum_fn": 1, "summar": [2, 7, 19, 28], "summari": [2, 28, 29], "suppli": [4, 7, 12, 15, 30, 44], "supplier": 28, "supplier_id": [28, 30], "support": [0, 1, 2, 3, 5, 6, 7, 14, 15, 16, 17, 18, 19, 21, 26, 28, 30, 33, 35, 36, 40, 42, 44, 54], "supports_bounded_execut": [19, 36], "suppos": [5, 21, 28], "suppress_build_script_link_lin": 23, "sure": 23, "surfac": [7, 19, 44], "surpris": 44, "surround": 44, "sw": 5, "switch": [30, 44, 54], "symbol": [1, 2], "sync": 23, "synchron": 21, "syntax": [5, 26, 30], "synthet": 39, "system": [1, 2, 7, 21, 23, 39], "t": [4, 5, 6, 7, 19, 34], "t1": [19, 36], "tabl": [0, 1, 2, 3, 7, 8, 9, 10, 11, 14, 15, 19, 21, 27, 28, 29, 31, 32, 33, 39, 41, 42, 43, 45, 46, 47, 49, 50, 52, 54], "table_exist": [0, 1], "table_id": [3, 43], "table_nam": [0, 2, 8, 9, 10], "table_partition_col": [1, 7, 11, 14], "table_provid": 1, "table_uuid": [2, 3], "tablefunct": [1, 7, 19, 55], "tableprovid": [21, 53, 55], "tableproviderexport": [0, 1, 7, 36], "tableproviderfactori": [1, 7], "tableproviderfactoryexport": [1, 7], "tablescan": 4, "tabul": [4, 28], "tabular": 42, "tag": [3, 5, 41], "tail": 2, "take": [2, 3, 4, 7, 12, 19, 21, 23, 28, 30, 36, 38, 40, 43, 44], "takeawai": 36, "taken": 39, "tan": [4, 5, 7], "tangent": [4, 5, 7], "tanh": [4, 5, 7], "target": [1, 2, 5, 7, 39], "target_partit": [1, 7], "task": [31, 42], "taskcontextprovid": 55, "taxi": 27, "tbl": 1, "td": 43, "team": 2, "technic": 24, "techniqu": [39, 40], "tediou": 28, "tell": [4, 28], "tempfil": [1, 36], "templat": [6, 7, 19], "tempor": 32, "temporari": [1, 2, 7, 54], "temporary_column": 42, "temporarydirectori": 1, "tempt": 36, "ten": 44, "ten_a": 4, "term": 38, "termin": [2, 7, 14, 41, 43, 45], "terminologi": 21, "test": [5, 7, 15, 23, 26, 32, 36, 39, 40], "text": [1, 2, 5, 6, 7, 15, 43], "textual": 31, "th": [5, 6, 43], "than": [1, 2, 4, 5, 6, 7, 12, 14, 26, 28, 30, 36, 39, 41, 42, 44, 47, 49], "thei": [1, 4, 6, 7, 8, 15, 19, 21, 26, 28, 30, 36, 44, 54], "them": [1, 2, 4, 5, 7, 21, 23, 26, 27, 28, 29, 30, 36, 44], "then_expr": 4, "therefor": 2, "thi": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 19, 20, 21, 23, 24, 26, 27, 28, 29, 30, 31, 32, 33, 35, 36, 37, 38, 39, 40, 41, 43, 44, 46, 47, 53, 54, 55], "think": 26, "third": 27, "thoroughli": 21, "those": [1, 2, 4, 7, 12, 24, 28, 36, 40, 44, 54], "though": [21, 36], "thread": [1, 12, 24, 44], "threat": 44, "three": [5, 28, 30, 36, 38, 40], "threshold": 54, "through": [1, 2, 3, 4, 6, 7, 12, 15, 19, 21, 24, 28, 32, 35, 36, 40, 42, 44, 45, 46], "thu": 19, "thusli": 21, "ti": 41, "ticket": 23, "tie": 5, "tight": 21, "tile": 5, "time": [1, 5, 6, 7, 15, 19, 21, 23, 26, 28, 30, 31, 36, 39, 41, 42, 44, 55], "time64": [5, 6], "time_trunc": 6, "timedelta": 6, "timestamp": [4, 5, 6, 7, 15, 31, 36], "timezon": 5, "tip_amount": [27, 34], "tip_perc": 27, "tips_plus_tol": 34, "tlc": [27, 34], "tmp": [1, 7, 36], "tmpdir": [1, 36], "tmphwqgxmgq": 36, "to_": 7, "to_arrow_t": [2, 42], "to_batch": 40, "to_byt": [1, 4, 7, 12, 15, 28, 30, 38, 44], "to_char": 5, "to_dat": 5, "to_hex": [4, 5, 7], "to_inn": [7, 14], "to_json": 17, "to_local_tim": 5, "to_panda": [2, 29, 31, 42, 54], "to_polar": [2, 42], "to_proto": [7, 15], "to_pyarrow": [7, 16, 42], "to_pyarrow_dataset": 40, "to_pydict": [1, 2, 4, 5, 7, 19, 37, 42, 44], "to_pylist": [2, 4, 5, 42], "to_substrait_plan": 17, "to_tim": 5, "to_timestamp": [5, 31], "to_timestamp_micro": 5, "to_timestamp_milli": 5, "to_timestamp_nano": 5, "to_timestamp_second": 5, "to_unixtim": 5, "to_utc_timestamp": 6, "to_val": 5, "to_vari": [4, 7, 15], "todai": 5, "todo": 21, "togeth": [2, 5, 7, 19, 28], "toggl": [1, 12, 44], "toler": [2, 7], "tolls_amount": 34, "toml": 23, "too": [1, 4, 7, 28], "tool": [2, 7, 26, 36], "top": [4, 6, 7, 15, 29, 44], "topic": 40, "total": [1, 2, 4, 5, 7, 15, 19, 24, 27, 28, 30, 31, 40, 41, 46], "total_amount": [27, 42], "total_as_float": 31, "total_as_int": 31, "touch": 23, "toward": 5, "tpc": 30, "track": 21, "tracker": [5, 25], "tradit": 23, "train": 26, "trait": [7, 19, 21], "transact": [1, 7], "transactionaccessmod": 4, "transactionconclus": 4, "transactionend": 4, "transactionisolationlevel": 4, "transactionstart": 4, "transfer": 21, "transform": [2, 4, 5, 7, 15, 27, 42, 44], "translat": [5, 21], "transpar": 44, "travel": [4, 7, 12, 28, 38], "travers": 5, "treat": [2, 4, 5, 6, 7, 38, 44, 49], "treatment": [4, 7], "tree": [2, 7, 15, 30, 36], "trick": 30, "trigger": [2, 41, 43, 47], "trim": [4, 5, 7], "trim_df": 5, "trip": [27, 34, 40, 44], "trip_dist": [27, 34], "trivial": 23, "truck": 30, "true": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 19, 23, 28, 30, 31, 34, 36, 38, 39, 43, 49], "trunc": [5, 6], "truncat": [2, 3, 5, 6, 7, 14, 28, 31, 34, 38, 43], "truncated_row": [7, 14], "trust": [4, 7, 44], "try": [1, 7, 11, 12, 14, 21], "try_cast": [4, 7], "try_cast_to_typ": 5, "try_parse_url": 6, "try_sum": [6, 28], "try_url_decod": 6, "trycast": 4, "tune": [2, 7, 39, 45], "tupl": [1, 2, 4, 5, 7, 11, 14, 15, 16, 19], "turn": [0, 2, 4, 7, 21, 54], "tutori": 46, "two": [1, 2, 4, 5, 6, 7, 15, 16, 21, 26, 28, 30, 33, 36, 38, 39, 40, 44], "txt": 26, "type": [0, 1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 19, 21, 23, 24, 28, 30, 31, 34, 36, 38, 39, 40, 43, 44, 46, 54, 55], "type_class": 3, "type_ref": 5, "type_str": 6, "typeerror": [3, 4, 7, 19], "typeguard": 19, "typic": [0, 1, 2, 4, 7, 12, 16, 18, 19, 27, 40, 41], "tz": 6, "u": [1, 5, 6, 21, 28, 30, 40], "udaf": [1, 7, 19, 24, 28, 35, 36, 44], "udaf1": [7, 19], "udaf2": [7, 19], "udaf3": [7, 19], "udaf4": [7, 19], "udf": [1, 4, 6, 7, 12, 19, 24, 28, 35, 38], "udf_filt": 36, "udtf": [1, 7, 19, 36], "udwf": [1, 7, 19, 35, 38, 44], "udwf1": [7, 19], "udwf2": [7, 19], "udwf3": [7, 19], "ultim": 23, "unabl": 54, "unambigu": 2, "unari": [6, 7, 15], "unbase64": 6, "unbound": [1, 4, 7, 19, 38], "unchang": [1, 2, 4, 5, 31, 36], "uncompress": [2, 7, 14], "undefin": [5, 23], "under": [1, 2, 21, 35, 40, 44], "underli": [1, 2, 4, 7, 14, 19, 21, 36, 47], "understand": [21, 39, 42], "unfortun": 21, "unfrozen": 21, "unhex": 6, "unicod": [4, 5, 7], "uniniti": 44, "unintend": 54, "union": [2, 4, 5], "union_by_nam": 2, "union_distinct": 2, "union_expr": 5, "union_extract": 5, "union_tag": 5, "unionarrai": 5, "uniqu": [1, 2, 3, 5, 7, 19, 28], "unit": [4, 5, 6, 7, 38, 40], "unitless": 41, "unix": 5, "unix_d": 6, "unix_micro": 6, "unix_milli": 6, "unix_second": 6, "unixtim": 5, "unless": [2, 21, 44], "unlik": [1, 2, 4, 5, 7, 38], "unmatch": 33, "unnest": [2, 4], "unnest_column": 2, "unnestexpr": 4, "unoptim": 2, "unpars": [7, 20], "unpickl": [4, 7], "unqualifi": 2, "unresolv": 5, "unsaf": [1, 21, 44, 55], "unsign": 6, "unspecifi": 2, "unspil": [1, 7], "until": [1, 2, 12, 27, 44], "untrust": [1, 44], "unus": 55, "up": [1, 2, 4, 5, 7, 15, 19, 26, 27, 30, 35, 36, 38, 39, 43, 44], "updat": [1, 2, 7, 19, 21, 22, 36, 55], "upgrad": 45, "upon": [5, 21, 36], "upper": [2, 4, 5, 7], "uppercas": [4, 5, 7], "upstream": [5, 21, 35, 44], "urbango": 33, "urgent": 30, "url": [1, 6, 26], "url_decod": 6, "url_encod": 6, "urlencod": 6, "us": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 14, 15, 16, 17, 19, 21, 23, 24, 27, 28, 29, 30, 31, 32, 33, 34, 35, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 49, 51, 52, 53, 54, 55], "usabl": 44, "usag": [1, 2, 5, 7, 19, 28, 38, 45], "use_shared_styl": [3, 7, 43], "user": [0, 1, 2, 4, 7, 8, 15, 16, 17, 18, 19, 21, 23, 26, 27, 30, 31, 32, 43, 44, 46, 55], "user_defin": [1, 7, 20, 28, 36, 38], "user_id": 42, "userinfo": 6, "uses_window_fram": [19, 36], "usual": 2, "utc": [5, 6, 7, 15], "utf": 6, "utf8": [4, 5, 7, 36], "utf8view": [4, 7], "util": [3, 21, 38, 39, 40], "uuid": 5, "uv": 23, "v": [4, 5, 6, 7, 12, 19, 23, 30, 39, 43, 44], "v1": 5, "v2": [5, 30], "v4": 5, "val": [2, 5, 6, 33, 54], "valid": [1, 2, 3, 4, 6, 7, 8, 9, 10], "validate_pycapsul": 55, "valu": [1, 2, 3, 4, 5, 6, 7, 12, 14, 15, 19, 28, 30, 32, 33, 34, 35, 36, 38, 41, 42, 43, 44, 45, 54], "value1": 5, "value2": 5, "value_as_datetim": [7, 15], "value_i": 5, "value_x": 5, "valueerror": [1, 2, 3, 4, 5, 7, 12], "values_a": 36, "values_b": 36, "values_view": 2, "var": 5, "var_pop": [5, 28], "var_popul": [5, 28], "var_samp": [5, 28], "var_sampl": 5, "vari": 39, "variabl": [1, 4, 5, 7, 23, 30, 44, 54], "varianc": 5, "variant": [4, 5, 7, 15, 33, 41], "variant_nam": [4, 7], "varieti": [30, 36, 40, 49], "variou": [14, 42, 43, 46], "vastli": [23, 39], "vec": 21, "vector": 5, "vendorid": 34, "venomoth": 38, "venonat": 38, "venu": 31, "venufleur": 31, "venufleurmega": 31, "venusaur": [24, 31, 38, 40, 46, 54], "venusaurmega": [24, 31, 38, 40, 46, 54], "venv": 23, "verbos": [2, 36], "veri": [48, 49], "verifi": 46, "version": [1, 2, 3, 4, 5, 7, 12, 21, 23, 26, 31, 33, 35, 40, 44, 55], "versu": 39, "via": [1, 2, 4, 5, 7, 12, 15, 16, 17, 19, 21, 23, 24, 28, 30, 33, 35, 36, 38, 40, 41, 42, 43, 45, 46, 53, 54, 55], "view": [0, 1, 2, 7, 29, 31, 32, 45, 46, 54], "view1": 37, "vink": 38, "violat": 3, "virtual": [1, 7, 23], "visibl": [36, 44], "visual": [2, 7, 15, 27], "volatil": [1, 4, 7, 19, 36, 44], "voltorb": 38, "volum": [30, 39, 41], "vulpix": 28, "w": 5, "wa": [1, 7, 15, 28, 44, 55], "wai": [21, 23, 28, 30, 36, 40, 42, 43, 44, 46, 55], "wait": [21, 41], "walk": [5, 41, 45], "wall": 41, "want": [1, 5, 21, 23, 28, 30, 31, 36, 38, 43, 53], "warn": 44, "wartortl": [24, 40, 46], "water": [24, 28, 31, 40, 46], "we": [0, 2, 7, 19, 21, 23, 27, 28, 30, 31, 33, 34, 36, 38, 39, 40, 46, 47, 54], "weedl": [24, 38, 40, 46], "week": 6, "weight": [5, 30], "welcom": [23, 46], "well": [1, 7, 21, 23, 36, 42, 54], "were": [21, 30], "what": [4, 7, 12, 21, 27, 45], "whatev": [19, 44], "when": [1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 19, 21, 23, 24, 26, 28, 30, 33, 38, 39, 40, 42, 43, 44, 51, 54], "when_expr": 4, "whenev": [1, 21, 23, 30, 42], "where": [1, 2, 4, 5, 7, 15, 28, 30, 31, 36, 37, 38, 40, 41, 44, 54], "wherea": [30, 35], "wherev": 21, "whether": [1, 2, 3, 4, 5, 7, 11, 14, 19, 28, 30, 36], "which": [0, 1, 2, 4, 5, 6, 7, 12, 14, 15, 19, 21, 23, 24, 28, 30, 33, 34, 35, 36, 38, 40, 41, 42, 44, 55], "while": [7, 19, 21, 26, 33, 36, 39, 41], "white": 43, "who": [21, 55], "whole": [2, 7, 15, 28, 36, 41, 44], "whose": [2, 6, 7, 15, 36], "why": [6, 21, 32], "wide": [30, 35, 39, 40, 42], "width": [3, 6, 43], "width_bucket": 6, "win": 44, "window": [1, 2, 4, 5, 7, 12, 19, 26, 28, 32, 39, 44, 45], "window_fram": [4, 7, 38], "windowevalu": [7, 19, 36, 38], "windowexpr": 4, "windowfram": [4, 7, 38], "windowframebound": [4, 7], "windowudf": [1, 7, 19], "windowudfexport": [7, 19], "windsurf": 26, "wire": [4, 6, 7, 44], "wise": 5, "wish": [21, 33, 36], "with_": [7, 14], "with_allow_ddl": [1, 7], "with_allow_dml": [1, 7], "with_allow_stat": [1, 7], "with_batch_s": [1, 7], "with_column": [2, 5, 7, 35, 42, 44], "with_column_renam": [2, 5], "with_com": [7, 14, 49], "with_create_default_catalog_and_schema": [1, 7, 39], "with_default_catalog_and_schema": [1, 7, 39], "with_delimit": [7, 14, 49], "with_disk_manager_dis": [1, 7], "with_disk_manager_o": [1, 7, 39], "with_disk_manager_specifi": [1, 7], "with_escap": [7, 14, 49], "with_extens": [1, 7], "with_fair_spill_pool": [1, 7, 39], "with_file_compression_typ": [7, 14, 49], "with_file_extens": [7, 14, 49], "with_file_sort_ord": [7, 14], "with_greedy_memory_pool": [1, 7], "with_has_head": [7, 14, 49], "with_head": 2, "with_information_schema": [1, 7, 39], "with_logical_extension_codec": [1, 7, 15], "with_metadata": 5, "with_newlines_in_valu": [7, 14], "with_null_regex": [7, 14, 49], "with_parquet_prun": [1, 7, 39], "with_physical_extension_codec": 1, "with_pretti": 18, "with_python_udf_inlin": [1, 4, 7, 12, 44], "with_quot": [7, 14], "with_repartition_aggreg": [1, 7, 39], "with_repartition_file_min_s": [1, 7], "with_repartition_file_scan": [1, 7], "with_repartition_join": [1, 7, 39], "with_repartition_sort": [1, 7], "with_repartition_window": [1, 7, 39], "with_schema": [7, 14], "with_schema_infer_max_record": [7, 14], "with_sess": [7, 19, 36], "with_table_partition_col": [7, 14], "with_target_partit": [1, 7, 39], "with_temp_file_path": [1, 7], "with_termin": [7, 14], "with_truncated_row": [7, 14, 49], "with_unbounded_memory_pool": [1, 7], "within": [0, 2, 5, 7, 9, 12, 19, 30], "within_limit": 2, "without": [2, 4, 5, 7, 12, 19, 21, 23, 26, 28, 31, 33, 34, 36, 42, 44, 54], "won": 34, "word": [4, 5, 7], "work": [1, 2, 4, 5, 7, 22, 27, 28, 30, 31, 34, 36, 38, 39, 42, 45, 46, 54], "worker": [4, 7, 12, 28, 38], "workflow": [23, 44], "workload": [39, 44], "world": [5, 35], "worthwhil": [2, 7], "would": [5, 8, 12, 19, 21, 28, 41, 54], "wrap": [1, 2, 4, 7, 19, 21, 36, 44], "wrapper": [1, 7, 16, 19, 21, 23, 36, 40, 55], "write": [2, 7, 8, 17, 21, 26, 28, 36, 40, 42, 44, 45, 55], "write_": 2, "write_batch_s": [2, 7], "write_csv": 2, "write_json": 2, "write_opt": 2, "write_parquet": 2, "write_parquet_with_opt": 2, "write_t": [1, 2, 36], "writer": [1, 2, 7], "writer_vers": [2, 7], "written": [2, 7, 21, 24, 36, 40, 41, 42], "wrong": 36, "www": 6, "x": [1, 2, 4, 5, 6, 7, 19, 24, 30, 31, 36, 38, 40, 46, 54], "x_val": 5, "xff": 6, "xor": 5, "xx": 5, "xxhash": 6, "xxhash64": 6, "xy": 5, "xz": [7, 14], "y": [2, 4, 5, 19, 24, 31, 38, 40, 43, 46, 54], "year": [5, 6], "years_in_posit": 30, "yellow": [27, 40], "yellow_tripdata_2021": [27, 34], "yet": [2, 6, 30, 40, 44], "yield": [2, 5, 42, 47], "you": [0, 1, 2, 4, 5, 7, 19, 21, 23, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 49, 53, 54, 55], "your": [0, 2, 7, 19, 21, 23, 26, 28, 29, 34, 36, 39, 40, 42, 43, 54, 55], "your_tabl": 42, "yourself": [4, 7, 21], "yyyi": 5, "z": [1, 5, 7, 19], "zero": [2, 5, 6, 7, 16, 24, 30, 45, 47], "zip": 36, "zstandard": [2, 7], "zstd": [2, 7, 14], "zubat": 28, "\u03c0": 5}, "titles": ["datafusion.catalog", "datafusion.context", "datafusion.dataframe", "datafusion.dataframe_formatter", "datafusion.expr", "datafusion.functions", "datafusion.functions.spark", "datafusion", "datafusion.input.base", "datafusion.input", "datafusion.input.location", "datafusion.io", "datafusion.ipc", "datafusion.object_store", "datafusion.options", "datafusion.plan", "datafusion.record_batch", "datafusion.substrait", "datafusion.unparser", "datafusion.user_defined", "API Reference", "Python Extensions", "Contributor Guide", "Introduction", "DataFusion in Python", "Links", "Using AI Coding Assistants", "Concepts", "Aggregation", "Basic Operations", "Expressions", "Functions", "Common Operations", "Joins", "Column Selections", "Spark-Compatible Functions", "User-Defined Functions", "Registering Views", "Window Functions", "Configuration", "Data Sources", "Execution Metrics", "DataFrames", "DataFrame Rendering", "Distributing work", "User Guide", "Introduction", "Arrow", "Avro", "CSV", "IO", "JSON", "Parquet", "Custom Table Provider", "SQL", "Upgrade Guides"], "titleterms": {"0": 55, "14": 44, "3": 44, "52": 55, "53": 55, "54": 55, "If": 26, "The": 21, "abstract": 7, "access": 36, "addit": 43, "agent": 26, "aggreg": [28, 36, 38, 41], "ai": 26, "also": 44, "altern": 21, "an": 26, "anti": 33, "apach": [40, 44], "api": [20, 35, 41], "approach": 21, "ar": [26, 41], "argument": 42, "arrai": 30, "arrow": [21, 42, 47], "assist": 26, "attribut": [4, 5, 7, 13, 19], "author": 26, "avail": [38, 41], "avro": 48, "ballista": 44, "base": [8, 42], "basic": [29, 43, 44], "benchmark": 39, "best": 43, "boolean": 30, "build": 23, "builder": 43, "built": 42, "call": 36, "cast": 31, "catalog": [0, 40], "cell": 43, "chang": 44, "class": [0, 1, 2, 3, 4, 7, 8, 9, 10, 14, 15, 16, 17, 18, 19, 21, 42], "code": [23, 26], "col": 33, "column": [30, 33, 34, 42], "commit": 23, "common": [32, 42], "compar": 28, "compat": 35, "concept": 27, "condit": [30, 31], "configur": [39, 43], "consider": [39, 44], "content": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19], "context": [1, 27, 44], "contributor": 22, "control": 43, "copi": 42, "core": [7, 42], "cover": 26, "cpu": 39, "creat": [40, 42], "csv": 49, "cube": 28, "custom": [40, 43, 53], "data": 40, "datafram": [2, 27, 33, 35, 40, 42, 43], "dataframe_formatt": 3, "datafus": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 24, 44, 47, 55], "default": 44, "defin": [28, 36, 38, 40], "delta": 40, "depend": 23, "detail": 21, "develop": 23, "directli": 43, "disabl": 44, "disambigu": 33, "displai": 43, "distinct": 28, "distribut": 44, "duplic": 33, "end": 41, "exampl": [24, 39, 41, 44], "execut": [41, 42], "explicit": 28, "export": 47, "expr": 4, "express": [27, 30, 42, 44], "extens": 21, "faq": 36, "ffi": 21, "file": 40, "fill_nul": 31, "filter": 28, "formatt": 43, "frame": 38, "from": [21, 47], "full": 33, "function": [3, 4, 5, 6, 7, 11, 12, 19, 28, 30, 31, 35, 36, 38, 42], "group": 28, "guid": [22, 45, 55], "guidelin": [21, 23], "handl": 31, "header": 43, "hook": 23, "how": 23, "html": 42, "i": 26, "iceberg": 40, "implement": 21, "import": [39, 47], "improv": 23, "inlin": 44, "inner": 33, "input": [8, 9, 10], "inspir": 21, "instal": [23, 24, 26, 46], "introduct": [23, 46], "io": [11, 50], "ipc": 12, "issu": 21, "join": 33, "json": 51, "kei": 33, "label": 41, "lake": 40, "lambda": 30, "left": 33, "level": 44, "librari": [40, 42], "link": 25, "list": 30, "liter": 30, "local": 40, "locat": 10, "mathemat": 31, "maxim": 39, "membership": 30, "memori": [40, 43], "metric": [41, 42], "miss": 31, "modul": [0, 1, 2, 3, 4, 6, 8, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19], "mutabl": 21, "name": 42, "namespac": 35, "null": [28, 38], "object": 40, "object_stor": 13, "oper": [29, 32, 42], "optim": 43, "option": [14, 36], "order": [28, 38], "other": [31, 40], "overview": [41, 42], "packag": [5, 7, 9], "paramet": [28, 38], "parameter": 54, "parquet": 52, "partit": [38, 41], "per": 41, "perform": 43, "physic": 41, "plan": [15, 41], "pool": 44, "portabl": 44, "practic": [43, 44], "pre": 23, "primari": 21, "provid": [40, 43, 53], "publish": 26, "pyarrow": 42, "pyo3": 21, "python": [21, 23, 24, 42, 44], "queri": [44, 54], "quick": 7, "read": 41, "record_batch": 16, "refer": [20, 35, 41, 44], "regist": [37, 44], "render": [42, 43], "requir": 44, "resourc": 43, "return": [4, 7], "rollup": 28, "run": 23, "rust": 23, "scalar": 36, "schema": 40, "secur": 44, "see": 44, "select": 34, "semi": 33, "separ": [23, 35], "session": [27, 36, 44], "set": [28, 38], "share": [43, 44], "skill": 26, "slot": 44, "sourc": 40, "spark": [6, 35], "speed": 23, "sql": [35, 54], "start": 7, "statu": 21, "store": 40, "stream": 42, "string": 31, "struct": 30, "style": 43, "submodul": [5, 7, 9], "subset": 28, "substrait": 17, "tabl": [36, 40, 53], "tempor": 31, "termin": 42, "test": 30, "travel": 44, "treatment": [28, 38], "tree": 41, "udf": [36, 44], "udwf": 36, "unpars": 18, "updat": 23, "upgrad": 55, "us": [26, 36], "usag": 39, "user": [28, 36, 38, 40, 45], "user_defin": 19, "v": 41, "valu": 31, "via": 44, "view": 37, "what": [26, 44], "when": [36, 41], "why": 35, "window": [36, 38], "within": 28, "work": [21, 43, 44], "worker": 44, "you": 26, "zero": 42}}) \ No newline at end of file +Search.setIndex({"alltitles": {"A codec decodes against the session that is running the query": [[21, "a-codec-decodes-against-the-session-that-is-running-the-query"]], "API Reference": [[20, null], [41, "api-reference"]], "Accessing the Calling Session": [[36, "accessing-the-calling-session"]], "Additional Resources": [[43, "additional-resources"]], "Aggregate Functions": [[28, "aggregate-functions"], [36, "aggregate-functions"], [38, "aggregate-functions"]], "Aggregated vs Per-Partition Metrics": [[41, "aggregated-vs-per-partition-metrics"]], "Aggregation": [[28, null]], "Alternative Approach": [[21, "alternative-approach"]], "Apache Iceberg": [[40, "apache-iceberg"]], "Arrays": [[30, "arrays"]], "Arrow": [[47, null]], "Attributes": [[4, "attributes"], [5, "attributes"], [7, "attributes"], [13, "attributes"], [19, "attributes"]], "Available Functions": [[38, "available-functions"]], "Available Metrics": [[41, "available-metrics"]], "Avro": [[48, null]], "Basic Operations": [[29, null]], "Basic Rendering": [[43, "basic-rendering"]], "Basic worker-pool example": [[44, "basic-worker-pool-example"]], "Benchmark Example": [[39, "benchmark-example"]], "Best Practices": [[43, "best-practices"]], "Boolean": [[30, "boolean"]], "Built-in Functions": [[42, "built-in-functions"]], "CSV": [[49, null]], "Capsule getters receive the session they are installed on": [[21, "capsule-getters-receive-the-session-they-are-installed-on"]], "Casting": [[31, "casting"]], "Catalog": [[40, "catalog"]], "Changes to the datafusion-python-util crate": [[55, "changes-to-the-datafusion-python-util-crate"]], "Classes": [[0, "classes"], [1, "classes"], [2, "classes"], [3, "classes"], [4, "classes"], [7, "classes"], [8, "classes"], [9, "classes"], [10, "classes"], [14, "classes"], [15, "classes"], [16, "classes"], [17, "classes"], [18, "classes"], [19, "classes"]], "Column": [[30, "column"]], "Column Names as Function Arguments": [[42, "column-names-as-function-arguments"]], "Column Selections": [[34, null]], "Common DataFrame Operations": [[42, "common-dataframe-operations"]], "Common Operations": [[32, null]], "Comparing subsets within a group": [[28, "comparing-subsets-within-a-group"]], "Concepts": [[27, null]], "Conditional": [[31, "conditional"]], "Conditional expressions": [[30, "conditional-expressions"]], "Configuration": [[39, null]], "Configuring the Formatter": [[43, "configuring-the-formatter"]], "Contributor Guide": [[22, null]], "Core Classes": [[42, "core-classes"]], "Core abstractions": [[7, "core-abstractions"]], "Create in-memory": [[40, "create-in-memory"]], "Creating DataFrames": [[42, "creating-dataframes"]], "Cube": [[28, "cube"]], "Custom Cell Formatters": [[43, "custom-cell-formatters"]], "Custom Cell and Header Builders": [[43, "custom-cell-and-header-builders"]], "Custom Style Providers": [[43, "custom-style-providers"]], "Custom Table Provider": [[40, "custom-table-provider"], [53, null]], "Data Sources": [[40, null]], "DataFrame": [[27, "dataframe"]], "DataFrame API": [[35, "dataframe-api"]], "DataFrame Rendering": [[43, null]], "DataFrames": [[42, null]], "DataFusion 52.0.0": [[55, "datafusion-52-0-0"]], "DataFusion 53.0.0": [[55, "datafusion-53-0-0"]], "DataFusion 54.0.0": [[55, "datafusion-54-0-0"]], "DataFusion 55.0.0": [[55, "datafusion-55-0-0"]], "DataFusion in Python": [[24, null]], "Delta Lake": [[40, "delta-lake"]], "Disabling Python UDF inlining": [[44, "disabling-python-udf-inlining"]], "Disambiguating Columns with DataFrame.col()": [[33, "disambiguating-columns-with-dataframe-col"]], "Distinct": [[28, "distinct"]], "Distributing work": [[44, null]], "Duplicate Keys": [[33, "duplicate-keys"]], "End-to-End Example": [[41, "end-to-end-example"]], "Example": [[24, "example"]], "Execute as Stream": [[42, "execute-as-stream"]], "Execution Metrics": [[41, null], [42, "execution-metrics"]], "Explicit Grouping Sets": [[28, "explicit-grouping-sets"]], "Exporting from DataFusion": [[47, "exporting-from-datafusion"]], "Expression Classes": [[42, "expression-classes"]], "Expression-level distribution": [[44, "expression-level-distribution"]], "Expressions": [[27, "expressions"], [30, null]], "FAQ": [[36, "faq"]], "Filter": [[28, "filter"]], "Full Join": [[33, "full-join"]], "Function Reference": [[35, "function-reference"]], "Functions": [[3, "functions"], [4, "functions"], [5, "functions"], [6, "functions"], [7, "functions"], [11, "functions"], [12, "functions"], [19, "functions"], [30, "functions"], [31, null]], "Grouping Sets": [[28, "grouping-sets"]], "Guidelines for Separating Python and Rust Code": [[23, "guidelines-for-separating-python-and-rust-code"]], "HTML Rendering": [[42, "html-rendering"]], "Handling Missing Values": [[31, "handling-missing-values"]], "How to develop": [[23, "how-to-develop"]], "IO": [[50, null]], "If you are an agent author": [[26, "if-you-are-an-agent-author"]], "Implementation Details": [[21, "implementation-details"]], "Important Considerations": [[39, "important-considerations"]], "Importing to DataFusion": [[47, "importing-to-datafusion"]], "Improving Build Speed": [[23, "improving-build-speed"]], "Inner Join": [[33, "inner-join"]], "Inspiration from Arrow": [[21, "inspiration-from-arrow"]], "Install": [[24, "install"]], "Installation": [[46, "installation"]], "Installing the skill": [[26, "installing-the-skill"]], "Introduction": [[23, null], [46, null]], "JSON": [[51, null]], "Joins": [[33, null]], "Labels": [[41, "labels"]], "Lambda functions": [[30, "lambda-functions"]], "Left Anti Join": [[33, "left-anti-join"]], "Left Join": [[33, "left-join"]], "Left Semi Join": [[33, "left-semi-join"]], "Links": [[25, null]], "Literal": [[30, "literal"]], "Local file": [[40, "local-file"]], "Mathematical": [[31, "mathematical"]], "Maximizing CPU Usage": [[39, "maximizing-cpu-usage"]], "Memory and Display Controls": [[43, "memory-and-display-controls"]], "Mismatched extension libraries now fail loudly": [[55, "mismatched-extension-libraries-now-fail-loudly"]], "Module Contents": [[0, "module-contents"], [1, "module-contents"], [2, "module-contents"], [3, "module-contents"], [4, "module-contents"], [6, "module-contents"], [8, "module-contents"], [10, "module-contents"], [11, "module-contents"], [12, "module-contents"], [13, "module-contents"], [14, "module-contents"], [15, "module-contents"], [16, "module-contents"], [17, "module-contents"], [18, "module-contents"], [19, "module-contents"]], "Null Treatment": [[28, "null-treatment"], [38, "null-treatment"]], "Object Store": [[40, "object-store"]], "One session, one Arc<SessionContext>": [[21, "one-session-one-arc-sessioncontext"]], "Ordering": [[28, "ordering"], [38, "ordering"]], "Other": [[31, "other"]], "Other DataFrame Libraries": [[40, "other-dataframe-libraries"]], "Overview": [[41, "overview"], [42, "overview"]], "Package Contents": [[5, "package-contents"], [7, "package-contents"], [9, "package-contents"]], "Parameterized queries": [[54, "parameterized-queries"]], "Parquet": [[52, null]], "Partitions": [[38, "partitions"]], "Performance Optimization with Shared Styles": [[43, "performance-optimization-with-shared-styles"]], "Portability requirements for inline Python UDFs": [[44, "portability-requirements-for-inline-python-udfs"]], "Practical considerations": [[44, "practical-considerations"]], "PyArrow": [[42, "pyarrow"]], "PyO3 class mutability guidelines": [[21, "pyo3-class-mutability-guidelines"]], "Python 3.14 default change": [[44, "python-3-14-default-change"]], "Python Extensions": [[21, null]], "Query Planners Across Multiple Libraries": [[21, "query-planners-across-multiple-libraries"]], "Query-level distribution via Apache Ballista": [[44, "query-level-distribution-via-apache-ballista"]], "Query-level distribution via datafusion-distributed": [[44, "query-level-distribution-via-datafusion-distributed"]], "Quick start": [[7, "quick-start"]], "Reading the Physical Plan Tree": [[41, "reading-the-physical-plan-tree"]], "Rebinding a planner\u2019s codecs is one level deep": [[21, "rebinding-a-planner-s-codecs-is-one-level-deep"]], "Reference: session context slots": [[44, "reference-session-context-slots"]], "Registering Views": [[37, null]], "Registering shared UDFs on workers": [[44, "registering-shared-udfs-on-workers"]], "Returns:": [[4, "returns"], [4, "id1"], [7, "returns"], [7, "id1"]], "Rollup": [[28, "rollup"]], "Running & Installing pre-commit hooks": [[23, "running-installing-pre-commit-hooks"]], "SQL": [[35, "sql"], [54, null]], "Scalar Functions": [[36, "scalar-functions"]], "Security": [[44, "security"]], "See also": [[44, "see-also"]], "Session Context": [[27, "session-context"]], "Setting Parameters": [[28, "setting-parameters"], [38, "setting-parameters"]], "Spark-Compatible Functions": [[35, null]], "Status of Work": [[21, "status-of-work"]], "String": [[31, "string"]], "Structs": [[30, "structs"]], "Submodules": [[5, "submodules"], [7, "submodules"], [9, "submodules"]], "Table Functions": [[36, "table-functions"]], "Temporal": [[31, "temporal"]], "Terminal Operations": [[42, "terminal-operations"]], "Testing membership in a list": [[30, "testing-membership-in-a-list"]], "The FFI Approach": [[21, "the-ffi-approach"]], "The Primary Issue": [[21, "the-primary-issue"]], "UDWF options": [[36, "udwf-options"]], "Update Dependencies": [[23, "update-dependencies"]], "Upgrade Guides": [[55, null]], "User Defined Catalog and Schema": [[40, "user-defined-catalog-and-schema"]], "User Guide": [[45, null]], "User-Defined Aggregate Functions": [[28, "user-defined-aggregate-functions"]], "User-Defined Functions": [[36, null]], "User-Defined Window Functions": [[38, "user-defined-window-functions"]], "Using AI Coding Assistants": [[26, null]], "What a derived context shares": [[21, "what-a-derived-context-shares"]], "What is published": [[26, "what-is-published"]], "What the skill covers": [[26, "what-the-skill-covers"]], "What travels with the expression": [[44, "what-travels-with-the-expression"]], "When Are Metrics Available?": [[41, "when-are-metrics-available"]], "When not to use a UDF": [[36, "when-not-to-use-a-udf"]], "Why a Separate Namespace?": [[35, "why-a-separate-namespace"]], "Window Frame": [[38, "window-frame"]], "Window Functions": [[36, "window-functions"], [38, null]], "Working with the Formatter Directly": [[43, "working-with-the-formatter-directly"]], "Zero-copy streaming to Arrow-based Python libraries": [[42, "zero-copy-streaming-to-arrow-based-python-libraries"]], "datafusion": [[7, null]], "datafusion.catalog": [[0, null]], "datafusion.context": [[1, null]], "datafusion.dataframe": [[2, null]], "datafusion.dataframe_formatter": [[3, null]], "datafusion.expr": [[4, null]], "datafusion.functions": [[5, null]], "datafusion.functions.spark": [[6, null]], "datafusion.input": [[9, null]], "datafusion.input.base": [[8, null]], "datafusion.input.location": [[10, null]], "datafusion.io": [[11, null]], "datafusion.ipc": [[12, null]], "datafusion.object_store": [[13, null]], "datafusion.options": [[14, null]], "datafusion.plan": [[15, null]], "datafusion.record_batch": [[16, null]], "datafusion.substrait": [[17, null]], "datafusion.unparser": [[18, null]], "datafusion.user_defined": [[19, null]], "fill_null": [[31, "fill-null"]]}, "docnames": ["autoapi/datafusion/catalog/index", "autoapi/datafusion/context/index", "autoapi/datafusion/dataframe/index", "autoapi/datafusion/dataframe_formatter/index", "autoapi/datafusion/expr/index", "autoapi/datafusion/functions/index", "autoapi/datafusion/functions/spark/index", "autoapi/datafusion/index", "autoapi/datafusion/input/base/index", "autoapi/datafusion/input/index", "autoapi/datafusion/input/location/index", "autoapi/datafusion/io/index", "autoapi/datafusion/ipc/index", "autoapi/datafusion/object_store/index", "autoapi/datafusion/options/index", "autoapi/datafusion/plan/index", "autoapi/datafusion/record_batch/index", "autoapi/datafusion/substrait/index", "autoapi/datafusion/unparser/index", "autoapi/datafusion/user_defined/index", "autoapi/index", "contributor-guide/ffi", "contributor-guide/index", "contributor-guide/introduction", "index", "links", "user-guide/ai-coding-assistants", "user-guide/basics", "user-guide/common-operations/aggregations", "user-guide/common-operations/basic-info", "user-guide/common-operations/expressions", "user-guide/common-operations/functions", "user-guide/common-operations/index", "user-guide/common-operations/joins", "user-guide/common-operations/select-and-filter", "user-guide/common-operations/spark-functions", "user-guide/common-operations/udf-and-udfa", "user-guide/common-operations/views", "user-guide/common-operations/windows", "user-guide/configuration", "user-guide/data-sources", "user-guide/dataframe/execution-metrics", "user-guide/dataframe/index", "user-guide/dataframe/rendering", "user-guide/distributing-work", "user-guide/index", "user-guide/introduction", "user-guide/io/arrow", "user-guide/io/avro", "user-guide/io/csv", "user-guide/io/index", "user-guide/io/json", "user-guide/io/parquet", "user-guide/io/table_provider", "user-guide/sql", "user-guide/upgrade-guides"], "envversion": {"sphinx": 64, "sphinx.domains.c": 3, "sphinx.domains.changeset": 1, "sphinx.domains.citation": 1, "sphinx.domains.cpp": 9, "sphinx.domains.index": 1, "sphinx.domains.javascript": 3, "sphinx.domains.math": 2, "sphinx.domains.python": 4, "sphinx.domains.rst": 2, "sphinx.domains.std": 2}, "filenames": ["autoapi/datafusion/catalog/index.rst", "autoapi/datafusion/context/index.rst", "autoapi/datafusion/dataframe/index.rst", "autoapi/datafusion/dataframe_formatter/index.rst", "autoapi/datafusion/expr/index.rst", "autoapi/datafusion/functions/index.rst", "autoapi/datafusion/functions/spark/index.rst", "autoapi/datafusion/index.rst", "autoapi/datafusion/input/base/index.rst", "autoapi/datafusion/input/index.rst", "autoapi/datafusion/input/location/index.rst", "autoapi/datafusion/io/index.rst", "autoapi/datafusion/ipc/index.rst", "autoapi/datafusion/object_store/index.rst", "autoapi/datafusion/options/index.rst", "autoapi/datafusion/plan/index.rst", "autoapi/datafusion/record_batch/index.rst", "autoapi/datafusion/substrait/index.rst", "autoapi/datafusion/unparser/index.rst", "autoapi/datafusion/user_defined/index.rst", "autoapi/index.rst", "contributor-guide/ffi.md", "contributor-guide/index.md", "contributor-guide/introduction.md", "index.md", "links.md", "user-guide/ai-coding-assistants.md", "user-guide/basics.md", "user-guide/common-operations/aggregations.md", "user-guide/common-operations/basic-info.md", "user-guide/common-operations/expressions.md", "user-guide/common-operations/functions.md", "user-guide/common-operations/index.md", "user-guide/common-operations/joins.md", "user-guide/common-operations/select-and-filter.md", "user-guide/common-operations/spark-functions.md", "user-guide/common-operations/udf-and-udfa.md", "user-guide/common-operations/views.md", "user-guide/common-operations/windows.md", "user-guide/configuration.md", "user-guide/data-sources.md", "user-guide/dataframe/execution-metrics.md", "user-guide/dataframe/index.md", "user-guide/dataframe/rendering.md", "user-guide/distributing-work.md", "user-guide/index.md", "user-guide/introduction.md", "user-guide/io/arrow.md", "user-guide/io/avro.md", "user-guide/io/csv.md", "user-guide/io/index.md", "user-guide/io/json.md", "user-guide/io/parquet.md", "user-guide/io/table_provider.md", "user-guide/sql.md", "user-guide/upgrade-guides.md"], "indexentries": {"__add__() (datafusion.expr method)": [[7, "datafusion.Expr.__add__", false]], "__add__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__add__", false]], "__aiter__() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.__aiter__", false]], "__aiter__() (datafusion.record_batch.recordbatchstream method)": [[16, "datafusion.record_batch.RecordBatchStream.__aiter__", false]], "__aiter__() (datafusion.recordbatchstream method)": [[7, "datafusion.RecordBatchStream.__aiter__", false]], "__and__() (datafusion.expr method)": [[7, "datafusion.Expr.__and__", false]], "__and__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__and__", false]], "__anext__() (datafusion.record_batch.recordbatchstream method)": [[16, "datafusion.record_batch.RecordBatchStream.__anext__", false]], "__anext__() (datafusion.recordbatchstream method)": [[7, "datafusion.RecordBatchStream.__anext__", false]], "__arrow_c_array__() (datafusion.context.arrowarrayexportable method)": [[1, "datafusion.context.ArrowArrayExportable.__arrow_c_array__", false]], "__arrow_c_array__() (datafusion.record_batch.recordbatch method)": [[16, "datafusion.record_batch.RecordBatch.__arrow_c_array__", false]], "__arrow_c_array__() (datafusion.recordbatch method)": [[7, "datafusion.RecordBatch.__arrow_c_array__", false]], "__arrow_c_stream__() (datafusion.context.arrowstreamexportable method)": [[1, "datafusion.context.ArrowStreamExportable.__arrow_c_stream__", false]], "__arrow_c_stream__() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.__arrow_c_stream__", false]], "__call__() (datafusion.aggregateudf method)": [[7, "datafusion.AggregateUDF.__call__", false]], "__call__() (datafusion.dataframe_formatter.cellformatter method)": [[3, "datafusion.dataframe_formatter.CellFormatter.__call__", false]], "__call__() (datafusion.scalarudf method)": [[7, "datafusion.ScalarUDF.__call__", false]], "__call__() (datafusion.tablefunction method)": [[7, "datafusion.TableFunction.__call__", false]], "__call__() (datafusion.user_defined.aggregateudf method)": [[19, "datafusion.user_defined.AggregateUDF.__call__", false]], "__call__() (datafusion.user_defined.scalarudf method)": [[19, "datafusion.user_defined.ScalarUDF.__call__", false]], "__call__() (datafusion.user_defined.tablefunction method)": [[19, "datafusion.user_defined.TableFunction.__call__", false]], "__call__() (datafusion.user_defined.windowudf method)": [[19, "datafusion.user_defined.WindowUDF.__call__", false]], "__call__() (datafusion.windowudf method)": [[7, "datafusion.WindowUDF.__call__", false]], "__datafusion_aggregate_udf__() (datafusion.user_defined.aggregateudfexportable method)": [[19, "datafusion.user_defined.AggregateUDFExportable.__datafusion_aggregate_udf__", false]], "__datafusion_logical_extension_codec__() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.__datafusion_logical_extension_codec__", false]], "__datafusion_logical_extension_codec__() (datafusion.user_defined.logicalextensioncodecexportable method)": [[19, "datafusion.user_defined.LogicalExtensionCodecExportable.__datafusion_logical_extension_codec__", false]], "__datafusion_physical_extension_codec__() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.__datafusion_physical_extension_codec__", false]], "__datafusion_physical_extension_codec__() (datafusion.user_defined.physicalextensioncodecexportable method)": [[19, "datafusion.user_defined.PhysicalExtensionCodecExportable.__datafusion_physical_extension_codec__", false]], "__datafusion_physical_optimizer_rule__() (datafusion.context.physicaloptimizerruleexportable method)": [[1, "datafusion.context.PhysicalOptimizerRuleExportable.__datafusion_physical_optimizer_rule__", false]], "__datafusion_query_planner__() (datafusion.context.queryplannerexportable method)": [[1, "datafusion.context.QueryPlannerExportable.__datafusion_query_planner__", false]], "__datafusion_query_planner__() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.__datafusion_query_planner__", false]], "__datafusion_scalar_udf__() (datafusion.user_defined.scalarudfexportable method)": [[19, "datafusion.user_defined.ScalarUDFExportable.__datafusion_scalar_udf__", false]], "__datafusion_table_provider__() (datafusion.context.tableproviderexportable method)": [[1, "datafusion.context.TableProviderExportable.__datafusion_table_provider__", false]], "__datafusion_table_provider_factory__() (datafusion.tableproviderfactoryexportable method)": [[7, "datafusion.TableProviderFactoryExportable.__datafusion_table_provider_factory__", false]], "__datafusion_task_context_provider__() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.__datafusion_task_context_provider__", false]], "__datafusion_window_udf__() (datafusion.user_defined.windowudfexportable method)": [[19, "datafusion.user_defined.WindowUDFExportable.__datafusion_window_udf__", false]], "__eq__() (datafusion.expr method)": [[7, "datafusion.Expr.__eq__", false]], "__eq__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__eq__", false]], "__eq__() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.__eq__", false]], "__eq__() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.__eq__", false]], "__ge__() (datafusion.expr method)": [[7, "datafusion.Expr.__ge__", false]], "__ge__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__ge__", false]], "__getitem__() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.__getitem__", false]], "__getitem__() (datafusion.expr method)": [[7, "datafusion.Expr.__getitem__", false]], "__getitem__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__getitem__", false]], "__gt__() (datafusion.expr method)": [[7, "datafusion.Expr.__gt__", false]], "__gt__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__gt__", false]], "__invert__() (datafusion.expr method)": [[7, "datafusion.Expr.__invert__", false]], "__invert__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__invert__", false]], "__iter__() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.__iter__", false]], "__iter__() (datafusion.record_batch.recordbatchstream method)": [[16, "datafusion.record_batch.RecordBatchStream.__iter__", false]], "__iter__() (datafusion.recordbatchstream method)": [[7, "datafusion.RecordBatchStream.__iter__", false]], "__le__() (datafusion.expr method)": [[7, "datafusion.Expr.__le__", false]], "__le__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__le__", false]], "__lt__() (datafusion.expr method)": [[7, "datafusion.Expr.__lt__", false]], "__lt__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__lt__", false]], "__mod__() (datafusion.expr method)": [[7, "datafusion.Expr.__mod__", false]], "__mod__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__mod__", false]], "__mul__() (datafusion.expr method)": [[7, "datafusion.Expr.__mul__", false]], "__mul__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__mul__", false]], "__ne__() (datafusion.expr method)": [[7, "datafusion.Expr.__ne__", false]], "__ne__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__ne__", false]], "__next__() (datafusion.record_batch.recordbatchstream method)": [[16, "datafusion.record_batch.RecordBatchStream.__next__", false]], "__next__() (datafusion.recordbatchstream method)": [[7, "datafusion.RecordBatchStream.__next__", false]], "__or__() (datafusion.expr method)": [[7, "datafusion.Expr.__or__", false]], "__or__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__or__", false]], "__radd__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__radd__", false]], "__radd__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__radd__", false]], "__rand__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__rand__", false]], "__rand__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__rand__", false]], "__reduce__() (datafusion.expr method)": [[7, "datafusion.Expr.__reduce__", false]], "__reduce__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__reduce__", false]], "__repr__() (datafusion.aggregateudf method)": [[7, "datafusion.AggregateUDF.__repr__", false]], "__repr__() (datafusion.catalog method)": [[7, "datafusion.Catalog.__repr__", false]], "__repr__() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.__repr__", false]], "__repr__() (datafusion.catalog.cataloglist method)": [[0, "datafusion.catalog.CatalogList.__repr__", false]], "__repr__() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.__repr__", false]], "__repr__() (datafusion.catalog.table method)": [[0, "datafusion.catalog.Table.__repr__", false]], "__repr__() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.__repr__", false]], "__repr__() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.__repr__", false]], "__repr__() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.__repr__", false]], "__repr__() (datafusion.expr method)": [[7, "datafusion.Expr.__repr__", false]], "__repr__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__repr__", false]], "__repr__() (datafusion.expr.sortexpr method)": [[4, "datafusion.expr.SortExpr.__repr__", false]], "__repr__() (datafusion.expr.windowframe method)": [[4, "datafusion.expr.WindowFrame.__repr__", false]], "__repr__() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.__repr__", false]], "__repr__() (datafusion.metric method)": [[7, "datafusion.Metric.__repr__", false]], "__repr__() (datafusion.metricsset method)": [[7, "datafusion.MetricsSet.__repr__", false]], "__repr__() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.__repr__", false]], "__repr__() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.__repr__", false]], "__repr__() (datafusion.plan.metric method)": [[15, "datafusion.plan.Metric.__repr__", false]], "__repr__() (datafusion.plan.metricsset method)": [[15, "datafusion.plan.MetricsSet.__repr__", false]], "__repr__() (datafusion.scalarudf method)": [[7, "datafusion.ScalarUDF.__repr__", false]], "__repr__() (datafusion.table method)": [[7, "datafusion.Table.__repr__", false]], "__repr__() (datafusion.tablefunction method)": [[7, "datafusion.TableFunction.__repr__", false]], "__repr__() (datafusion.user_defined.aggregateudf method)": [[19, "datafusion.user_defined.AggregateUDF.__repr__", false]], "__repr__() (datafusion.user_defined.scalarudf method)": [[19, "datafusion.user_defined.ScalarUDF.__repr__", false]], "__repr__() (datafusion.user_defined.tablefunction method)": [[19, "datafusion.user_defined.TableFunction.__repr__", false]], "__repr__() (datafusion.user_defined.windowudf method)": [[19, "datafusion.user_defined.WindowUDF.__repr__", false]], "__repr__() (datafusion.windowframe method)": [[7, "datafusion.WindowFrame.__repr__", false]], "__repr__() (datafusion.windowudf method)": [[7, "datafusion.WindowUDF.__repr__", false]], "__richcmp__() (datafusion.expr method)": [[7, "datafusion.Expr.__richcmp__", false]], "__richcmp__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__richcmp__", false]], "__rmod__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__rmod__", false]], "__rmod__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__rmod__", false]], "__rmul__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__rmul__", false]], "__rmul__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__rmul__", false]], "__ror__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__ror__", false]], "__ror__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__ror__", false]], "__rsub__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__rsub__", false]], "__rsub__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__rsub__", false]], "__rtruediv__ (datafusion.expr attribute)": [[7, "datafusion.Expr.__rtruediv__", false]], "__rtruediv__ (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.__rtruediv__", false]], "__slots__ (datafusion.catalog.table attribute)": [[0, "datafusion.catalog.Table.__slots__", false]], "__slots__ (datafusion.table attribute)": [[7, "datafusion.Table.__slots__", false]], "__str__() (datafusion.user_defined.volatility method)": [[19, "datafusion.user_defined.Volatility.__str__", false]], "__sub__() (datafusion.expr method)": [[7, "datafusion.Expr.__sub__", false]], "__sub__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__sub__", false]], "__truediv__() (datafusion.expr method)": [[7, "datafusion.Expr.__truediv__", false]], "__truediv__() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.__truediv__", false]], "_build_expandable_cell() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_expandable_cell", false]], "_build_html_footer() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_html_footer", false]], "_build_html_header() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_html_header", false]], "_build_regular_cell() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_regular_cell", false]], "_build_table_body() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_table_body", false]], "_build_table_container_start() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_table_container_start", false]], "_build_table_header() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._build_table_header", false]], "_convert_file_sort_order() (datafusion.context.sessioncontext static method)": [[1, "datafusion.context.SessionContext._convert_file_sort_order", false]], "_convert_table_partition_cols() (datafusion.context.sessioncontext static method)": [[1, "datafusion.context.SessionContext._convert_table_partition_cols", false]], "_create_table_udf() (datafusion.tablefunction static method)": [[7, "datafusion.TableFunction._create_table_udf", false]], "_create_table_udf() (datafusion.user_defined.tablefunction static method)": [[19, "datafusion.user_defined.TableFunction._create_table_udf", false]], "_create_table_udf_decorator() (datafusion.tablefunction static method)": [[7, "datafusion.TableFunction._create_table_udf_decorator", false]], "_create_table_udf_decorator() (datafusion.user_defined.tablefunction static method)": [[19, "datafusion.user_defined.TableFunction._create_table_udf_decorator", false]], "_create_window_udf() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF._create_window_udf", false]], "_create_window_udf() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF._create_window_udf", false]], "_create_window_udf_decorator() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF._create_window_udf_decorator", false]], "_create_window_udf_decorator() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF._create_window_udf_decorator", false]], "_custom_cell_builder (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._custom_cell_builder", false]], "_custom_header_builder (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._custom_header_builder", false]], "_default_formatter (datafusion.dataframe_formatter.formattermanager attribute)": [[3, "datafusion.dataframe_formatter.FormatterManager._default_formatter", false]], "_format_cell_value() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._format_cell_value", false]], "_from_internal() (datafusion.aggregateudf class method)": [[7, "datafusion.AggregateUDF._from_internal", false]], "_from_internal() (datafusion.scalarudf class method)": [[7, "datafusion.ScalarUDF._from_internal", false]], "_from_internal() (datafusion.user_defined.aggregateudf class method)": [[19, "datafusion.user_defined.AggregateUDF._from_internal", false]], "_from_internal() (datafusion.user_defined.scalarudf class method)": [[19, "datafusion.user_defined.ScalarUDF._from_internal", false]], "_from_internal() (datafusion.user_defined.windowudf class method)": [[19, "datafusion.user_defined.WindowUDF._from_internal", false]], "_from_internal() (datafusion.windowudf class method)": [[7, "datafusion.WindowUDF._from_internal", false]], "_get_cell_value() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._get_cell_value", false]], "_get_default_css() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._get_default_css", false]], "_get_default_name() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF._get_default_name", false]], "_get_default_name() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF._get_default_name", false]], "_get_javascript() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._get_javascript", false]], "_inner (datafusion.catalog.table attribute)": [[0, "datafusion.catalog.Table._inner", false]], "_inner (datafusion.table attribute)": [[7, "datafusion.Table._inner", false]], "_is_pycapsule() (in module datafusion.user_defined)": [[19, "datafusion.user_defined._is_pycapsule", false]], "_max_rows (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._max_rows", false]], "_normalize_input_types() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF._normalize_input_types", false]], "_normalize_input_types() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF._normalize_input_types", false]], "_null_treatment (datafusion.expr.window attribute)": [[4, "datafusion.expr.Window._null_treatment", false]], "_order_by (datafusion.expr.window attribute)": [[4, "datafusion.expr.Window._order_by", false]], "_partition_by (datafusion.expr.window attribute)": [[4, "datafusion.expr.Window._partition_by", false]], "_r (in module datafusion.user_defined)": [[19, "datafusion.user_defined._R", false]], "_raw (datafusion.metric attribute)": [[7, "datafusion.Metric._raw", false]], "_raw (datafusion.metricsset attribute)": [[7, "datafusion.MetricsSet._raw", false]], "_raw (datafusion.plan.metric attribute)": [[15, "datafusion.plan.Metric._raw", false]], "_raw (datafusion.plan.metricsset attribute)": [[15, "datafusion.plan.MetricsSet._raw", false]], "_raw_plan (datafusion.executionplan attribute)": [[7, "datafusion.ExecutionPlan._raw_plan", false]], "_raw_plan (datafusion.logicalplan attribute)": [[7, "datafusion.LogicalPlan._raw_plan", false]], "_raw_plan (datafusion.plan.executionplan attribute)": [[15, "datafusion.plan.ExecutionPlan._raw_plan", false]], "_raw_plan (datafusion.plan.logicalplan attribute)": [[15, "datafusion.plan.LogicalPlan._raw_plan", false]], "_raw_schema (datafusion.catalog.schema attribute)": [[0, "datafusion.catalog.Schema._raw_schema", false]], "_raw_write_options (datafusion.dataframe.dataframewriteoptions attribute)": [[2, "datafusion.dataframe.DataFrameWriteOptions._raw_write_options", false]], "_raw_write_options (datafusion.dataframewriteoptions attribute)": [[7, "datafusion.DataFrameWriteOptions._raw_write_options", false]], "_reconstruct() (datafusion.expr class method)": [[7, "datafusion.Expr._reconstruct", false]], "_reconstruct() (datafusion.expr.expr class method)": [[4, "datafusion.expr.Expr._reconstruct", false]], "_refresh_formatter_reference() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter._refresh_formatter_reference", false]], "_register_object_store_for_path() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext._register_object_store_for_path", false]], "_repr_html_() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame._repr_html_", false]], "_to_pyarrow_types (datafusion.expr attribute)": [[7, "datafusion.Expr._to_pyarrow_types", false]], "_to_pyarrow_types (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr._to_pyarrow_types", false]], "_type_formatters (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter._type_formatters", false]], "_udaf (datafusion.aggregateudf attribute)": [[7, "datafusion.AggregateUDF._udaf", false]], "_udaf (datafusion.user_defined.aggregateudf attribute)": [[19, "datafusion.user_defined.AggregateUDF._udaf", false]], "_udf (datafusion.scalarudf attribute)": [[7, "datafusion.ScalarUDF._udf", false]], "_udf (datafusion.user_defined.scalarudf attribute)": [[19, "datafusion.user_defined.ScalarUDF._udf", false]], "_udtf (datafusion.tablefunction attribute)": [[7, "datafusion.TableFunction._udtf", false]], "_udtf (datafusion.user_defined.tablefunction attribute)": [[19, "datafusion.user_defined.TableFunction._udtf", false]], "_udwf (datafusion.user_defined.windowudf attribute)": [[19, "datafusion.user_defined.WindowUDF._udwf", false]], "_udwf (datafusion.windowudf attribute)": [[7, "datafusion.WindowUDF._udwf", false]], "_validate_bool() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter._validate_bool", false]], "_validate_formatter_parameters() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter._validate_formatter_parameters", false]], "_validate_positive_int() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter._validate_positive_int", false]], "_window_frame (datafusion.expr.window attribute)": [[4, "datafusion.expr.Window._window_frame", false]], "_wrap_session_kwarg_for_udtf() (in module datafusion.user_defined)": [[19, "datafusion.user_defined._wrap_session_kwarg_for_udtf", false]], "abs() (datafusion.expr method)": [[7, "datafusion.Expr.abs", false]], "abs() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.abs", false]], "abs() (in module datafusion.functions)": [[5, "datafusion.functions.abs", false]], "abs() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.abs", false]], "accumulator (class in datafusion)": [[7, "datafusion.Accumulator", false]], "accumulator (class in datafusion.user_defined)": [[19, "datafusion.user_defined.Accumulator", false]], "acos() (datafusion.expr method)": [[7, "datafusion.Expr.acos", false]], "acos() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.acos", false]], "acos() (in module datafusion.functions)": [[5, "datafusion.functions.acos", false]], "acosh() (datafusion.expr method)": [[7, "datafusion.Expr.acosh", false]], "acosh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.acosh", false]], "acosh() (in module datafusion.functions)": [[5, "datafusion.functions.acosh", false]], "add_months() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.add_months", false]], "add_physical_optimizer_rule() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.add_physical_optimizer_rule", false]], "aggregate (in module datafusion.expr)": [[4, "datafusion.expr.Aggregate", false]], "aggregate() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.aggregate", false]], "aggregatefunction (in module datafusion.expr)": [[4, "datafusion.expr.AggregateFunction", false]], "aggregateudf (class in datafusion)": [[7, "datafusion.AggregateUDF", false]], "aggregateudf (class in datafusion.user_defined)": [[19, "datafusion.user_defined.AggregateUDF", false]], "aggregateudfexportable (class in datafusion.user_defined)": [[19, "datafusion.user_defined.AggregateUDFExportable", false]], "alias (in module datafusion.expr)": [[4, "datafusion.expr.Alias", false]], "alias() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.alias", false]], "alias() (datafusion.expr method)": [[7, "datafusion.Expr.alias", false]], "alias() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.alias", false]], "alias() (in module datafusion.functions)": [[5, "datafusion.functions.alias", false]], "allow_single_file_parallelism (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.allow_single_file_parallelism", false]], "allow_single_file_parallelism (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.allow_single_file_parallelism", false]], "amazons3 (in module datafusion.object_store)": [[13, "datafusion.object_store.AmazonS3", false]], "analyze (in module datafusion.expr)": [[4, "datafusion.expr.Analyze", false]], "any_match() (in module datafusion.functions)": [[5, "datafusion.functions.any_match", false]], "append (datafusion.dataframe.insertop attribute)": [[2, "datafusion.dataframe.InsertOp.APPEND", false]], "append (datafusion.insertop attribute)": [[7, "datafusion.InsertOp.APPEND", false]], "approx_distinct() (in module datafusion.functions)": [[5, "datafusion.functions.approx_distinct", false]], "approx_median() (in module datafusion.functions)": [[5, "datafusion.functions.approx_median", false]], "approx_percentile_cont() (in module datafusion.functions)": [[5, "datafusion.functions.approx_percentile_cont", false]], "approx_percentile_cont_with_weight() (in module datafusion.functions)": [[5, "datafusion.functions.approx_percentile_cont_with_weight", false]], "array() (in module datafusion.functions)": [[5, "datafusion.functions.array", false]], "array() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.array", false]], "array_agg() (in module datafusion.functions)": [[5, "datafusion.functions.array_agg", false]], "array_any_match() (in module datafusion.functions)": [[5, "datafusion.functions.array_any_match", false]], "array_any_value() (in module datafusion.functions)": [[5, "datafusion.functions.array_any_value", false]], "array_append() (in module datafusion.functions)": [[5, "datafusion.functions.array_append", false]], "array_cat() (in module datafusion.functions)": [[5, "datafusion.functions.array_cat", false]], "array_compact() (in module datafusion.functions)": [[5, "datafusion.functions.array_compact", false]], "array_concat() (in module datafusion.functions)": [[5, "datafusion.functions.array_concat", false]], "array_contains() (in module datafusion.functions)": [[5, "datafusion.functions.array_contains", false]], "array_contains() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.array_contains", false]], "array_dims() (datafusion.expr method)": [[7, "datafusion.Expr.array_dims", false]], "array_dims() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_dims", false]], "array_dims() (in module datafusion.functions)": [[5, "datafusion.functions.array_dims", false]], "array_distance() (in module datafusion.functions)": [[5, "datafusion.functions.array_distance", false]], "array_distinct() (datafusion.expr method)": [[7, "datafusion.Expr.array_distinct", false]], "array_distinct() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_distinct", false]], "array_distinct() (in module datafusion.functions)": [[5, "datafusion.functions.array_distinct", false]], "array_element() (in module datafusion.functions)": [[5, "datafusion.functions.array_element", false]], "array_empty() (datafusion.expr method)": [[7, "datafusion.Expr.array_empty", false]], "array_empty() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_empty", false]], "array_empty() (in module datafusion.functions)": [[5, "datafusion.functions.array_empty", false]], "array_except() (in module datafusion.functions)": [[5, "datafusion.functions.array_except", false]], "array_extract() (in module datafusion.functions)": [[5, "datafusion.functions.array_extract", false]], "array_filter() (in module datafusion.functions)": [[5, "datafusion.functions.array_filter", false]], "array_has() (in module datafusion.functions)": [[5, "datafusion.functions.array_has", false]], "array_has_all() (in module datafusion.functions)": [[5, "datafusion.functions.array_has_all", false]], "array_has_any() (in module datafusion.functions)": [[5, "datafusion.functions.array_has_any", false]], "array_indexof() (in module datafusion.functions)": [[5, "datafusion.functions.array_indexof", false]], "array_intersect() (in module datafusion.functions)": [[5, "datafusion.functions.array_intersect", false]], "array_join() (in module datafusion.functions)": [[5, "datafusion.functions.array_join", false]], "array_length() (datafusion.expr method)": [[7, "datafusion.Expr.array_length", false]], "array_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_length", false]], "array_length() (in module datafusion.functions)": [[5, "datafusion.functions.array_length", false]], "array_max() (in module datafusion.functions)": [[5, "datafusion.functions.array_max", false]], "array_min() (in module datafusion.functions)": [[5, "datafusion.functions.array_min", false]], "array_ndims() (datafusion.expr method)": [[7, "datafusion.Expr.array_ndims", false]], "array_ndims() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_ndims", false]], "array_ndims() (in module datafusion.functions)": [[5, "datafusion.functions.array_ndims", false]], "array_normalize() (in module datafusion.functions)": [[5, "datafusion.functions.array_normalize", false]], "array_pop_back() (datafusion.expr method)": [[7, "datafusion.Expr.array_pop_back", false]], "array_pop_back() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_pop_back", false]], "array_pop_back() (in module datafusion.functions)": [[5, "datafusion.functions.array_pop_back", false]], "array_pop_front() (datafusion.expr method)": [[7, "datafusion.Expr.array_pop_front", false]], "array_pop_front() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.array_pop_front", false]], "array_pop_front() (in module datafusion.functions)": [[5, "datafusion.functions.array_pop_front", false]], "array_position() (in module datafusion.functions)": [[5, "datafusion.functions.array_position", false]], "array_positions() (in module datafusion.functions)": [[5, "datafusion.functions.array_positions", false]], "array_prepend() (in module datafusion.functions)": [[5, "datafusion.functions.array_prepend", false]], "array_push_back() (in module datafusion.functions)": [[5, "datafusion.functions.array_push_back", false]], "array_push_front() (in module datafusion.functions)": [[5, "datafusion.functions.array_push_front", false]], "array_remove() (in module datafusion.functions)": [[5, "datafusion.functions.array_remove", false]], "array_remove_all() (in module datafusion.functions)": [[5, "datafusion.functions.array_remove_all", false]], "array_remove_n() (in module datafusion.functions)": [[5, "datafusion.functions.array_remove_n", false]], "array_repeat() (in module datafusion.functions)": [[5, "datafusion.functions.array_repeat", false]], "array_repeat() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.array_repeat", false]], "array_replace() (in module datafusion.functions)": [[5, "datafusion.functions.array_replace", false]], "array_replace_all() (in module datafusion.functions)": [[5, "datafusion.functions.array_replace_all", false]], "array_replace_n() (in module datafusion.functions)": [[5, "datafusion.functions.array_replace_n", false]], "array_resize() (in module datafusion.functions)": [[5, "datafusion.functions.array_resize", false]], "array_reverse() (in module datafusion.functions)": [[5, "datafusion.functions.array_reverse", false]], "array_slice() (in module datafusion.functions)": [[5, "datafusion.functions.array_slice", false]], "array_sort() (in module datafusion.functions)": [[5, "datafusion.functions.array_sort", false]], "array_to_string() (in module datafusion.functions)": [[5, "datafusion.functions.array_to_string", false]], "array_transform() (in module datafusion.functions)": [[5, "datafusion.functions.array_transform", false]], "array_union() (in module datafusion.functions)": [[5, "datafusion.functions.array_union", false]], "arrays_overlap() (in module datafusion.functions)": [[5, "datafusion.functions.arrays_overlap", false]], "arrays_zip() (in module datafusion.functions)": [[5, "datafusion.functions.arrays_zip", false]], "arrow_cast() (in module datafusion.functions)": [[5, "datafusion.functions.arrow_cast", false]], "arrow_field() (in module datafusion.functions)": [[5, "datafusion.functions.arrow_field", false]], "arrow_metadata() (in module datafusion.functions)": [[5, "datafusion.functions.arrow_metadata", false]], "arrow_try_cast() (in module datafusion.functions)": [[5, "datafusion.functions.arrow_try_cast", false]], "arrow_typeof() (datafusion.expr method)": [[7, "datafusion.Expr.arrow_typeof", false]], "arrow_typeof() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.arrow_typeof", false]], "arrow_typeof() (in module datafusion.functions)": [[5, "datafusion.functions.arrow_typeof", false]], "arrowarrayexportable (class in datafusion.context)": [[1, "datafusion.context.ArrowArrayExportable", false]], "arrowstreamexportable (class in datafusion.context)": [[1, "datafusion.context.ArrowStreamExportable", false]], "ascending() (datafusion.expr.sortexpr method)": [[4, "datafusion.expr.SortExpr.ascending", false]], "ascii() (datafusion.expr method)": [[7, "datafusion.Expr.ascii", false]], "ascii() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.ascii", false]], "ascii() (in module datafusion.functions)": [[5, "datafusion.functions.ascii", false]], "ascii() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.ascii", false]], "asin() (datafusion.expr method)": [[7, "datafusion.Expr.asin", false]], "asin() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.asin", false]], "asin() (in module datafusion.functions)": [[5, "datafusion.functions.asin", false]], "asinh() (datafusion.expr method)": [[7, "datafusion.Expr.asinh", false]], "asinh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.asinh", false]], "asinh() (in module datafusion.functions)": [[5, "datafusion.functions.asinh", false]], "atan() (datafusion.expr method)": [[7, "datafusion.Expr.atan", false]], "atan() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.atan", false]], "atan() (in module datafusion.functions)": [[5, "datafusion.functions.atan", false]], "atan2() (in module datafusion.functions)": [[5, "datafusion.functions.atan2", false]], "atanh() (datafusion.expr method)": [[7, "datafusion.Expr.atanh", false]], "atanh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.atanh", false]], "atanh() (in module datafusion.functions)": [[5, "datafusion.functions.atanh", false]], "avg() (in module datafusion.functions)": [[5, "datafusion.functions.avg", false]], "avg() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.avg", false]], "base64() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.base64", false]], "baseinputsource (class in datafusion.input.base)": [[8, "datafusion.input.base.BaseInputSource", false]], "between (in module datafusion.expr)": [[4, "datafusion.expr.Between", false]], "between() (datafusion.expr method)": [[7, "datafusion.Expr.between", false]], "between() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.between", false]], "bin() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bin", false]], "binaryexpr (in module datafusion.expr)": [[4, "datafusion.expr.BinaryExpr", false]], "bit_and() (in module datafusion.functions)": [[5, "datafusion.functions.bit_and", false]], "bit_count() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bit_count", false]], "bit_get() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bit_get", false]], "bit_length() (datafusion.expr method)": [[7, "datafusion.Expr.bit_length", false]], "bit_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.bit_length", false]], "bit_length() (in module datafusion.functions)": [[5, "datafusion.functions.bit_length", false]], "bit_or() (in module datafusion.functions)": [[5, "datafusion.functions.bit_or", false]], "bit_xor() (in module datafusion.functions)": [[5, "datafusion.functions.bit_xor", false]], "bitmap_bit_position() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bitmap_bit_position", false]], "bitmap_bucket_number() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bitmap_bucket_number", false]], "bitmap_count() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bitmap_count", false]], "bitwise_not() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.bitwise_not", false]], "bloom_filter_enabled (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.bloom_filter_enabled", false]], "bloom_filter_enabled (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.bloom_filter_enabled", false]], "bloom_filter_fpp (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.bloom_filter_fpp", false]], "bloom_filter_fpp (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.bloom_filter_fpp", false]], "bloom_filter_fpp (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.bloom_filter_fpp", false]], "bloom_filter_fpp (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.bloom_filter_fpp", false]], "bloom_filter_ndv (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.bloom_filter_ndv", false]], "bloom_filter_ndv (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.bloom_filter_ndv", false]], "bloom_filter_ndv (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.bloom_filter_ndv", false]], "bloom_filter_ndv (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.bloom_filter_ndv", false]], "bloom_filter_on_write (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.bloom_filter_on_write", false]], "bloom_filter_on_write (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.bloom_filter_on_write", false]], "bool_and() (in module datafusion.functions)": [[5, "datafusion.functions.bool_and", false]], "bool_or() (in module datafusion.functions)": [[5, "datafusion.functions.bool_or", false]], "brotli (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.BROTLI", false]], "btrim() (datafusion.expr method)": [[7, "datafusion.Expr.btrim", false]], "btrim() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.btrim", false]], "btrim() (in module datafusion.functions)": [[5, "datafusion.functions.btrim", false]], "build_table() (datafusion.input.base.baseinputsource method)": [[8, "datafusion.input.base.BaseInputSource.build_table", false]], "build_table() (datafusion.input.location.locationinputplugin method)": [[10, "datafusion.input.location.LocationInputPlugin.build_table", false]], "build_table() (datafusion.input.locationinputplugin method)": [[9, "datafusion.input.LocationInputPlugin.build_table", false]], "cache() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.cache", false]], "canonical_name() (datafusion.expr method)": [[7, "datafusion.Expr.canonical_name", false]], "canonical_name() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.canonical_name", false]], "cardinality() (datafusion.expr method)": [[7, "datafusion.Expr.cardinality", false]], "cardinality() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cardinality", false]], "cardinality() (in module datafusion.functions)": [[5, "datafusion.functions.cardinality", false]], "case (in module datafusion.expr)": [[4, "datafusion.expr.Case", false]], "case() (in module datafusion.functions)": [[5, "datafusion.functions.case", false]], "case_builder (datafusion.expr.casebuilder attribute)": [[4, "datafusion.expr.CaseBuilder.case_builder", false]], "casebuilder (class in datafusion.expr)": [[4, "datafusion.expr.CaseBuilder", false]], "cast (in module datafusion.expr)": [[4, "datafusion.expr.Cast", false]], "cast() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.cast", false]], "cast() (datafusion.expr method)": [[7, "datafusion.Expr.cast", false]], "cast() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cast", false]], "cast_to_type() (in module datafusion.functions)": [[5, "datafusion.functions.cast_to_type", false]], "catalog (class in datafusion)": [[7, "datafusion.Catalog", false]], "catalog (class in datafusion.catalog)": [[0, "datafusion.catalog.Catalog", false]], "catalog (datafusion.catalog attribute)": [[7, "datafusion.Catalog.catalog", false]], "catalog (datafusion.catalog.catalog attribute)": [[0, "datafusion.catalog.Catalog.catalog", false]], "catalog() (datafusion.catalog.cataloglist method)": [[0, "datafusion.catalog.CatalogList.catalog", false]], "catalog() (datafusion.catalog.catalogproviderlist method)": [[0, "datafusion.catalog.CatalogProviderList.catalog", false]], "catalog() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.catalog", false]], "catalog_list (datafusion.catalog.cataloglist attribute)": [[0, "datafusion.catalog.CatalogList.catalog_list", false]], "catalog_names() (datafusion.catalog.cataloglist method)": [[0, "datafusion.catalog.CatalogList.catalog_names", false]], "catalog_names() (datafusion.catalog.catalogproviderlist method)": [[0, "datafusion.catalog.CatalogProviderList.catalog_names", false]], "catalog_names() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.catalog_names", false]], "cataloglist (class in datafusion.catalog)": [[0, "datafusion.catalog.CatalogList", false]], "catalogprovider (class in datafusion.catalog)": [[0, "datafusion.catalog.CatalogProvider", false]], "catalogproviderlist (class in datafusion.catalog)": [[0, "datafusion.catalog.CatalogProviderList", false]], "cbrt() (datafusion.expr method)": [[7, "datafusion.Expr.cbrt", false]], "cbrt() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cbrt", false]], "cbrt() (in module datafusion.functions)": [[5, "datafusion.functions.cbrt", false]], "ceil() (datafusion.expr method)": [[7, "datafusion.Expr.ceil", false]], "ceil() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.ceil", false]], "ceil() (in module datafusion.functions)": [[5, "datafusion.functions.ceil", false]], "ceil() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.ceil", false]], "cellformatter (class in datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.CellFormatter", false]], "char() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.char", false]], "char_length() (datafusion.expr method)": [[7, "datafusion.Expr.char_length", false]], "char_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.char_length", false]], "char_length() (in module datafusion.functions)": [[5, "datafusion.functions.char_length", false]], "character_length() (datafusion.expr method)": [[7, "datafusion.Expr.character_length", false]], "character_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.character_length", false]], "character_length() (in module datafusion.functions)": [[5, "datafusion.functions.character_length", false]], "children() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.children", false]], "children() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.children", false]], "chr() (datafusion.expr method)": [[7, "datafusion.Expr.chr", false]], "chr() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.chr", false]], "chr() (in module datafusion.functions)": [[5, "datafusion.functions.chr", false]], "clear_sender_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.clear_sender_ctx", false]], "clear_worker_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.clear_worker_ctx", false]], "coalesce() (in module datafusion.functions)": [[5, "datafusion.functions.coalesce", false]], "coerce_to_expr() (in module datafusion.expr)": [[4, "datafusion.expr.coerce_to_expr", false]], "coerce_to_expr_list() (in module datafusion.expr)": [[4, "datafusion.expr.coerce_to_expr_list", false]], "coerce_to_expr_or_none() (in module datafusion.expr)": [[4, "datafusion.expr.coerce_to_expr_or_none", false]], "col (in module datafusion)": [[7, "datafusion.col", false]], "col() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.col", false]], "col() (in module datafusion.functions)": [[5, "datafusion.functions.col", false]], "collect() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.collect", false]], "collect_column() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.collect_column", false]], "collect_list() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.collect_list", false]], "collect_metrics() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.collect_metrics", false]], "collect_metrics() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.collect_metrics", false]], "collect_partitioned() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.collect_partitioned", false]], "collect_set() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.collect_set", false]], "column (in module datafusion)": [[7, "datafusion.column", false]], "column (in module datafusion.expr)": [[4, "datafusion.expr.Column", false]], "column() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.column", false]], "column() (datafusion.expr static method)": [[7, "datafusion.Expr.column", false]], "column() (datafusion.expr.expr static method)": [[4, "datafusion.expr.Expr.column", false]], "column_index_truncate_length (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.column_index_truncate_length", false]], "column_index_truncate_length (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.column_index_truncate_length", false]], "column_name() (datafusion.expr method)": [[7, "datafusion.Expr.column_name", false]], "column_name() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.column_name", false]], "column_specific_options (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.column_specific_options", false]], "column_specific_options (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.column_specific_options", false]], "comment (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.comment", false]], "comment (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.comment", false]], "compression (class in datafusion.dataframe)": [[2, "datafusion.dataframe.Compression", false]], "compression (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.compression", false]], "compression (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.compression", false]], "concat() (in module datafusion.functions)": [[5, "datafusion.functions.concat", false]], "concat() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.concat", false]], "concat_ws() (in module datafusion.functions)": [[5, "datafusion.functions.concat_ws", false]], "config_internal (datafusion.context.runtimeenvbuilder attribute)": [[1, "datafusion.context.RuntimeEnvBuilder.config_internal", false]], "config_internal (datafusion.context.sessionconfig attribute)": [[1, "datafusion.context.SessionConfig.config_internal", false]], "config_internal (datafusion.runtimeenvbuilder attribute)": [[7, "datafusion.RuntimeEnvBuilder.config_internal", false]], "config_internal (datafusion.sessionconfig attribute)": [[7, "datafusion.SessionConfig.config_internal", false]], "configure_formatter() (in module datafusion)": [[7, "datafusion.configure_formatter", false]], "configure_formatter() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.configure_formatter", false]], "consumer (class in datafusion.substrait)": [[17, "datafusion.substrait.Consumer", false]], "contains() (in module datafusion.functions)": [[5, "datafusion.functions.contains", false]], "copied_config() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.copied_config", false]], "copyto (in module datafusion.expr)": [[4, "datafusion.expr.CopyTo", false]], "corr() (in module datafusion.functions)": [[5, "datafusion.functions.corr", false]], "cos() (datafusion.expr method)": [[7, "datafusion.Expr.cos", false]], "cos() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cos", false]], "cos() (in module datafusion.functions)": [[5, "datafusion.functions.cos", false]], "cosh() (datafusion.expr method)": [[7, "datafusion.Expr.cosh", false]], "cosh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cosh", false]], "cosh() (in module datafusion.functions)": [[5, "datafusion.functions.cosh", false]], "cosine_distance() (in module datafusion.functions)": [[5, "datafusion.functions.cosine_distance", false]], "cot() (datafusion.expr method)": [[7, "datafusion.Expr.cot", false]], "cot() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.cot", false]], "cot() (in module datafusion.functions)": [[5, "datafusion.functions.cot", false]], "count() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.count", false]], "count() (in module datafusion.functions)": [[5, "datafusion.functions.count", false]], "count_star() (in module datafusion.functions)": [[5, "datafusion.functions.count_star", false]], "covar() (in module datafusion.functions)": [[5, "datafusion.functions.covar", false]], "covar_pop() (in module datafusion.functions)": [[5, "datafusion.functions.covar_pop", false]], "covar_samp() (in module datafusion.functions)": [[5, "datafusion.functions.covar_samp", false]], "crc32() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.crc32", false]], "create() (datafusion.tableproviderfactory method)": [[7, "datafusion.TableProviderFactory.create", false]], "create_dataframe() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.create_dataframe", false]], "create_dataframe_from_logical_plan() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.create_dataframe_from_logical_plan", false]], "createcatalog (in module datafusion.expr)": [[4, "datafusion.expr.CreateCatalog", false]], "createcatalogschema (in module datafusion.expr)": [[4, "datafusion.expr.CreateCatalogSchema", false]], "created_by (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.created_by", false]], "created_by (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.created_by", false]], "createexternaltable (in module datafusion.expr)": [[4, "datafusion.expr.CreateExternalTable", false]], "createfunction (in module datafusion.expr)": [[4, "datafusion.expr.CreateFunction", false]], "createfunctionbody (in module datafusion.expr)": [[4, "datafusion.expr.CreateFunctionBody", false]], "createindex (in module datafusion.expr)": [[4, "datafusion.expr.CreateIndex", false]], "creatememorytable (in module datafusion.expr)": [[4, "datafusion.expr.CreateMemoryTable", false]], "createview (in module datafusion.expr)": [[4, "datafusion.expr.CreateView", false]], "csc() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.csc", false]], "csvreadoptions (class in datafusion)": [[7, "datafusion.CsvReadOptions", false]], "csvreadoptions (class in datafusion.options)": [[14, "datafusion.options.CsvReadOptions", false]], "ctx (datafusion.context.sessioncontext attribute)": [[1, "datafusion.context.SessionContext.ctx", false]], "cube() (datafusion.expr.groupingset static method)": [[4, "datafusion.expr.GroupingSet.cube", false]], "cume_dist() (in module datafusion.functions)": [[5, "datafusion.functions.cume_dist", false]], "current_date() (in module datafusion.functions)": [[5, "datafusion.functions.current_date", false]], "current_time() (in module datafusion.functions)": [[5, "datafusion.functions.current_time", false]], "current_timestamp() (in module datafusion.functions)": [[5, "datafusion.functions.current_timestamp", false]], "custom_css (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.custom_css", false]], "data_page_row_count_limit (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.data_page_row_count_limit", false]], "data_page_row_count_limit (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.data_page_row_count_limit", false]], "data_pagesize_limit (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.data_pagesize_limit", false]], "data_pagesize_limit (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.data_pagesize_limit", false]], "data_type_or_field_to_field() (in module datafusion.user_defined)": [[19, "datafusion.user_defined.data_type_or_field_to_field", false]], "data_types_or_fields_to_field_list() (in module datafusion.user_defined)": [[19, "datafusion.user_defined.data_types_or_fields_to_field_list", false]], "dataframe (class in datafusion.dataframe)": [[2, "datafusion.dataframe.DataFrame", false]], "dataframehtmlformatter (class in datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter", false]], "dataframewriteoptions (class in datafusion)": [[7, "datafusion.DataFrameWriteOptions", false]], "dataframewriteoptions (class in datafusion.dataframe)": [[2, "datafusion.dataframe.DataFrameWriteOptions", false]], "datafusion": [[7, "module-datafusion", false]], "datafusion.catalog": [[0, "module-datafusion.catalog", false]], "datafusion.context": [[1, "module-datafusion.context", false]], "datafusion.dataframe": [[2, "module-datafusion.dataframe", false]], "datafusion.dataframe_formatter": [[3, "module-datafusion.dataframe_formatter", false]], "datafusion.expr": [[4, "module-datafusion.expr", false]], "datafusion.functions": [[5, "module-datafusion.functions", false]], "datafusion.functions.spark": [[6, "module-datafusion.functions.spark", false]], "datafusion.input": [[9, "module-datafusion.input", false]], "datafusion.input.base": [[8, "module-datafusion.input.base", false]], "datafusion.input.location": [[10, "module-datafusion.input.location", false]], "datafusion.io": [[11, "module-datafusion.io", false]], "datafusion.ipc": [[12, "module-datafusion.ipc", false]], "datafusion.object_store": [[13, "module-datafusion.object_store", false]], "datafusion.options": [[14, "module-datafusion.options", false]], "datafusion.plan": [[15, "module-datafusion.plan", false]], "datafusion.record_batch": [[16, "module-datafusion.record_batch", false]], "datafusion.substrait": [[17, "module-datafusion.substrait", false]], "datafusion.unparser": [[18, "module-datafusion.unparser", false]], "datafusion.user_defined": [[19, "module-datafusion.user_defined", false]], "date_add() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.date_add", false]], "date_bin() (in module datafusion.functions)": [[5, "datafusion.functions.date_bin", false]], "date_diff() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.date_diff", false]], "date_format() (in module datafusion.functions)": [[5, "datafusion.functions.date_format", false]], "date_part() (in module datafusion.functions)": [[5, "datafusion.functions.date_part", false]], "date_part() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.date_part", false]], "date_sub() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.date_sub", false]], "date_trunc() (in module datafusion.functions)": [[5, "datafusion.functions.date_trunc", false]], "date_trunc() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.date_trunc", false]], "datepart() (in module datafusion.functions)": [[5, "datafusion.functions.datepart", false]], "datetrunc() (in module datafusion.functions)": [[5, "datafusion.functions.datetrunc", false]], "deallocate (in module datafusion.expr)": [[4, "datafusion.expr.Deallocate", false]], "decode() (in module datafusion.functions)": [[5, "datafusion.functions.decode", false]], "default() (datafusion.unparser.dialect static method)": [[18, "datafusion.unparser.Dialect.default", false]], "default_str_repr() (datafusion.dataframe.dataframe static method)": [[2, "datafusion.dataframe.DataFrame.default_str_repr", false]], "defaultstyleprovider (class in datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.DefaultStyleProvider", false]], "degrees() (datafusion.expr method)": [[7, "datafusion.Expr.degrees", false]], "degrees() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.degrees", false]], "degrees() (in module datafusion.functions)": [[5, "datafusion.functions.degrees", false]], "delimiter (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.delimiter", false]], "delimiter (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.delimiter", false]], "dense_rank() (in module datafusion.functions)": [[5, "datafusion.functions.dense_rank", false]], "deregister_object_store() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_object_store", false]], "deregister_schema() (datafusion.catalog method)": [[7, "datafusion.Catalog.deregister_schema", false]], "deregister_schema() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.deregister_schema", false]], "deregister_schema() (datafusion.catalog.catalogprovider method)": [[0, "datafusion.catalog.CatalogProvider.deregister_schema", false]], "deregister_table() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.deregister_table", false]], "deregister_table() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.deregister_table", false]], "deregister_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_table", false]], "deregister_udaf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_udaf", false]], "deregister_udf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_udf", false]], "deregister_udtf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_udtf", false]], "deregister_udwf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.deregister_udwf", false]], "describe() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.describe", false]], "describetable (in module datafusion.expr)": [[4, "datafusion.expr.DescribeTable", false]], "deserialize() (datafusion.substrait.serde static method)": [[17, "datafusion.substrait.Serde.deserialize", false]], "deserialize_bytes() (datafusion.substrait.serde static method)": [[17, "datafusion.substrait.Serde.deserialize_bytes", false]], "df (datafusion.dataframe.dataframe attribute)": [[2, "datafusion.dataframe.DataFrame.df", false]], "dfschema (in module datafusion)": [[7, "datafusion.DFSchema", false]], "dialect (class in datafusion.unparser)": [[18, "datafusion.unparser.Dialect", false]], "dialect (datafusion.unparser.dialect attribute)": [[18, "datafusion.unparser.Dialect.dialect", false]], "dictionary_enabled (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.dictionary_enabled", false]], "dictionary_enabled (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.dictionary_enabled", false]], "dictionary_enabled (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.dictionary_enabled", false]], "dictionary_enabled (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.dictionary_enabled", false]], "dictionary_page_size_limit (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.dictionary_page_size_limit", false]], "dictionary_page_size_limit (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.dictionary_page_size_limit", false]], "digest() (in module datafusion.functions)": [[5, "datafusion.functions.digest", false]], "display() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.display", false]], "display() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.display", false]], "display() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.display", false]], "display() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.display", false]], "display_graphviz() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.display_graphviz", false]], "display_graphviz() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.display_graphviz", false]], "display_indent() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.display_indent", false]], "display_indent() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.display_indent", false]], "display_indent() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.display_indent", false]], "display_indent() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.display_indent", false]], "display_indent_schema() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.display_indent_schema", false]], "display_indent_schema() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.display_indent_schema", false]], "distinct (in module datafusion.expr)": [[4, "datafusion.expr.Distinct", false]], "distinct() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.distinct", false]], "distinct() (datafusion.expr method)": [[7, "datafusion.Expr.distinct", false]], "distinct() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.distinct", false]], "distinct_on() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.distinct_on", false]], "dmlstatement (in module datafusion.expr)": [[4, "datafusion.expr.DmlStatement", false]], "dot_product() (in module datafusion.functions)": [[5, "datafusion.functions.dot_product", false]], "drop() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.drop", false]], "dropcatalogschema (in module datafusion.expr)": [[4, "datafusion.expr.DropCatalogSchema", false]], "dropfunction (in module datafusion.expr)": [[4, "datafusion.expr.DropFunction", false]], "droptable (in module datafusion.expr)": [[4, "datafusion.expr.DropTable", false]], "dropview (in module datafusion.expr)": [[4, "datafusion.expr.DropView", false]], "duckdb() (datafusion.unparser.dialect static method)": [[18, "datafusion.unparser.Dialect.duckdb", false]], "elapsed_compute (datafusion.metricsset property)": [[7, "datafusion.MetricsSet.elapsed_compute", false]], "elapsed_compute (datafusion.plan.metricsset property)": [[15, "datafusion.plan.MetricsSet.elapsed_compute", false]], "element_at() (in module datafusion.functions)": [[5, "datafusion.functions.element_at", false]], "elt() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.elt", false]], "empty() (datafusion.expr method)": [[7, "datafusion.Expr.empty", false]], "empty() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.empty", false]], "empty() (in module datafusion.functions)": [[5, "datafusion.functions.empty", false]], "empty_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.empty_table", false]], "emptyrelation (in module datafusion.expr)": [[4, "datafusion.expr.EmptyRelation", false]], "enable_cell_expansion (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.enable_cell_expansion", false]], "enable_ident_normalization() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.enable_ident_normalization", false]], "enable_spark_functions() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.enable_spark_functions", false]], "enable_url_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.enable_url_table", false]], "encode() (datafusion.substrait.plan method)": [[17, "datafusion.substrait.Plan.encode", false]], "encode() (in module datafusion.functions)": [[5, "datafusion.functions.encode", false]], "encoding (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.encoding", false]], "encoding (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.encoding", false]], "encoding (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.encoding", false]], "encoding (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.encoding", false]], "end() (datafusion.expr.casebuilder method)": [[4, "datafusion.expr.CaseBuilder.end", false]], "ends_with() (in module datafusion.functions)": [[5, "datafusion.functions.ends_with", false]], "ensure_expr() (in module datafusion.expr)": [[4, "datafusion.expr.ensure_expr", false]], "ensure_expr_list() (in module datafusion.expr)": [[4, "datafusion.expr.ensure_expr_list", false]], "escape (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.escape", false]], "escape (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.escape", false]], "evaluate() (datafusion.accumulator method)": [[7, "datafusion.Accumulator.evaluate", false]], "evaluate() (datafusion.user_defined.accumulator method)": [[19, "datafusion.user_defined.Accumulator.evaluate", false]], "evaluate() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.evaluate", false]], "evaluate_all() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.evaluate_all", false]], "evaluate_all_with_rank() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.evaluate_all_with_rank", false]], "except_all() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.except_all", false]], "execute (in module datafusion.expr)": [[4, "datafusion.expr.Execute", false]], "execute() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.execute", false]], "execute_logical_plan() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.execute_logical_plan", false]], "execute_stream() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.execute_stream", false]], "execute_stream_partitioned() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.execute_stream_partitioned", false]], "execution_plan() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.execution_plan", false]], "executionplan (class in datafusion)": [[7, "datafusion.ExecutionPlan", false]], "executionplan (class in datafusion.plan)": [[15, "datafusion.plan.ExecutionPlan", false]], "exists (in module datafusion.expr)": [[4, "datafusion.expr.Exists", false]], "exp() (datafusion.expr method)": [[7, "datafusion.Expr.exp", false]], "exp() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.exp", false]], "exp() (in module datafusion.functions)": [[5, "datafusion.functions.exp", false]], "explain (in module datafusion.expr)": [[4, "datafusion.expr.Explain", false]], "explain() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.explain", false]], "explainformat (class in datafusion)": [[7, "datafusion.ExplainFormat", false]], "explainformat (class in datafusion.dataframe)": [[2, "datafusion.dataframe.ExplainFormat", false]], "expm1() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.expm1", false]], "expr (class in datafusion)": [[7, "datafusion.Expr", false]], "expr (class in datafusion.expr)": [[4, "datafusion.expr.Expr", false]], "expr (datafusion.expr attribute)": [[7, "datafusion.Expr.expr", false]], "expr (datafusion.expr.expr attribute)": [[4, "datafusion.expr.Expr.expr", false]], "expr() (datafusion.expr.sortexpr method)": [[4, "datafusion.expr.SortExpr.expr", false]], "expr_type_error (in module datafusion.expr)": [[4, "datafusion.expr.EXPR_TYPE_ERROR", false]], "extension (in module datafusion.expr)": [[4, "datafusion.expr.Extension", false]], "extract() (in module datafusion.functions)": [[5, "datafusion.functions.extract", false]], "factorial() (datafusion.expr method)": [[7, "datafusion.Expr.factorial", false]], "factorial() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.factorial", false]], "factorial() (in module datafusion.functions)": [[5, "datafusion.functions.factorial", false]], "factorial() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.factorial", false]], "file_compression_type (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.file_compression_type", false]], "file_compression_type (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.file_compression_type", false]], "file_extension (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.file_extension", false]], "file_extension (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.file_extension", false]], "file_sort_order (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.file_sort_order", false]], "file_sort_order (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.file_sort_order", false]], "filetype (in module datafusion.expr)": [[4, "datafusion.expr.FileType", false]], "fill_nan() (datafusion.expr method)": [[7, "datafusion.Expr.fill_nan", false]], "fill_nan() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.fill_nan", false]], "fill_null() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.fill_null", false]], "fill_null() (datafusion.expr method)": [[7, "datafusion.Expr.fill_null", false]], "fill_null() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.fill_null", false]], "filter (in module datafusion.expr)": [[4, "datafusion.expr.Filter", false]], "filter() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.filter", false]], "filter() (datafusion.expr method)": [[7, "datafusion.Expr.filter", false]], "filter() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.filter", false]], "find_in_set() (in module datafusion.functions)": [[5, "datafusion.functions.find_in_set", false]], "find_qualified_columns() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.find_qualified_columns", false]], "first_value() (in module datafusion.functions)": [[5, "datafusion.functions.first_value", false]], "flatten() (datafusion.expr method)": [[7, "datafusion.Expr.flatten", false]], "flatten() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.flatten", false]], "flatten() (in module datafusion.functions)": [[5, "datafusion.functions.flatten", false]], "floor() (datafusion.expr method)": [[7, "datafusion.Expr.floor", false]], "floor() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.floor", false]], "floor() (in module datafusion.functions)": [[5, "datafusion.functions.floor", false]], "floor() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.floor", false]], "format_html() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.format_html", false]], "format_str() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.format_str", false]], "format_string() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.format_string", false]], "formattermanager (class in datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.FormatterManager", false]], "frame_bound (datafusion.expr.windowframebound attribute)": [[4, "datafusion.expr.WindowFrameBound.frame_bound", false]], "from_arrow() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.from_arrow", false]], "from_bytes() (datafusion.executionplan static method)": [[7, "datafusion.ExecutionPlan.from_bytes", false]], "from_bytes() (datafusion.expr class method)": [[7, "datafusion.Expr.from_bytes", false]], "from_bytes() (datafusion.expr.expr class method)": [[4, "datafusion.expr.Expr.from_bytes", false]], "from_bytes() (datafusion.logicalplan static method)": [[7, "datafusion.LogicalPlan.from_bytes", false]], "from_bytes() (datafusion.plan.executionplan static method)": [[15, "datafusion.plan.ExecutionPlan.from_bytes", false]], "from_bytes() (datafusion.plan.logicalplan static method)": [[15, "datafusion.plan.LogicalPlan.from_bytes", false]], "from_dataset() (datafusion.catalog.table static method)": [[0, "datafusion.catalog.Table.from_dataset", false]], "from_dataset() (datafusion.table static method)": [[7, "datafusion.Table.from_dataset", false]], "from_json() (datafusion.substrait.plan static method)": [[17, "datafusion.substrait.Plan.from_json", false]], "from_pandas() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.from_pandas", false]], "from_polars() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.from_polars", false]], "from_proto() (datafusion.executionplan static method)": [[7, "datafusion.ExecutionPlan.from_proto", false]], "from_proto() (datafusion.logicalplan static method)": [[7, "datafusion.LogicalPlan.from_proto", false]], "from_proto() (datafusion.plan.executionplan static method)": [[15, "datafusion.plan.ExecutionPlan.from_proto", false]], "from_proto() (datafusion.plan.logicalplan static method)": [[15, "datafusion.plan.LogicalPlan.from_proto", false]], "from_pycapsule() (datafusion.aggregateudf static method)": [[7, "datafusion.AggregateUDF.from_pycapsule", false]], "from_pycapsule() (datafusion.scalarudf static method)": [[7, "datafusion.ScalarUDF.from_pycapsule", false]], "from_pycapsule() (datafusion.user_defined.aggregateudf static method)": [[19, "datafusion.user_defined.AggregateUDF.from_pycapsule", false]], "from_pycapsule() (datafusion.user_defined.scalarudf static method)": [[19, "datafusion.user_defined.ScalarUDF.from_pycapsule", false]], "from_pycapsule() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF.from_pycapsule", false]], "from_pycapsule() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF.from_pycapsule", false]], "from_pydict() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.from_pydict", false]], "from_pylist() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.from_pylist", false]], "from_str() (datafusion.dataframe.compression class method)": [[2, "datafusion.dataframe.Compression.from_str", false]], "from_substrait_plan() (datafusion.substrait.consumer static method)": [[17, "datafusion.substrait.Consumer.from_substrait_plan", false]], "from_unixtime() (datafusion.expr method)": [[7, "datafusion.Expr.from_unixtime", false]], "from_unixtime() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.from_unixtime", false]], "from_unixtime() (in module datafusion.functions)": [[5, "datafusion.functions.from_unixtime", false]], "from_utc_timestamp() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.from_utc_timestamp", false]], "gcd() (in module datafusion.functions)": [[5, "datafusion.functions.gcd", false]], "gen_series() (in module datafusion.functions)": [[5, "datafusion.functions.gen_series", false]], "generate_series() (in module datafusion.functions)": [[5, "datafusion.functions.generate_series", false]], "get_cell_style() (datafusion.dataframe_formatter.defaultstyleprovider method)": [[3, "datafusion.dataframe_formatter.DefaultStyleProvider.get_cell_style", false]], "get_cell_style() (datafusion.dataframe_formatter.styleprovider method)": [[3, "datafusion.dataframe_formatter.StyleProvider.get_cell_style", false]], "get_default_level() (datafusion.dataframe.compression method)": [[2, "datafusion.dataframe.Compression.get_default_level", false]], "get_field() (in module datafusion.functions)": [[5, "datafusion.functions.get_field", false]], "get_formatter() (datafusion.dataframe_formatter.formattermanager class method)": [[3, "datafusion.dataframe_formatter.FormatterManager.get_formatter", false]], "get_formatter() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.get_formatter", false]], "get_frame_units() (datafusion.expr.windowframe method)": [[4, "datafusion.expr.WindowFrame.get_frame_units", false]], "get_frame_units() (datafusion.windowframe method)": [[7, "datafusion.WindowFrame.get_frame_units", false]], "get_header_style() (datafusion.dataframe_formatter.defaultstyleprovider method)": [[3, "datafusion.dataframe_formatter.DefaultStyleProvider.get_header_style", false]], "get_header_style() (datafusion.dataframe_formatter.styleprovider method)": [[3, "datafusion.dataframe_formatter.StyleProvider.get_header_style", false]], "get_lower_bound() (datafusion.expr.windowframe method)": [[4, "datafusion.expr.WindowFrame.get_lower_bound", false]], "get_lower_bound() (datafusion.windowframe method)": [[7, "datafusion.WindowFrame.get_lower_bound", false]], "get_offset() (datafusion.expr.windowframebound method)": [[4, "datafusion.expr.WindowFrameBound.get_offset", false]], "get_range() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.get_range", false]], "get_sender_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.get_sender_ctx", false]], "get_upper_bound() (datafusion.expr.windowframe method)": [[4, "datafusion.expr.WindowFrame.get_upper_bound", false]], "get_upper_bound() (datafusion.windowframe method)": [[7, "datafusion.WindowFrame.get_upper_bound", false]], "get_worker_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.get_worker_ctx", false]], "global_ctx() (datafusion.context.sessioncontext class method)": [[1, "datafusion.context.SessionContext.global_ctx", false]], "googlecloud (in module datafusion.object_store)": [[13, "datafusion.object_store.GoogleCloud", false]], "graphviz (datafusion.dataframe.explainformat attribute)": [[2, "datafusion.dataframe.ExplainFormat.GRAPHVIZ", false]], "graphviz (datafusion.explainformat attribute)": [[7, "datafusion.ExplainFormat.GRAPHVIZ", false]], "greatest() (in module datafusion.functions)": [[5, "datafusion.functions.greatest", false]], "grouping() (in module datafusion.functions)": [[5, "datafusion.functions.grouping", false]], "grouping_sets() (datafusion.expr.groupingset static method)": [[4, "datafusion.expr.GroupingSet.grouping_sets", false]], "groupingset (class in datafusion.expr)": [[4, "datafusion.expr.GroupingSet", false]], "gzip (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.GZIP", false]], "has_header (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.has_header", false]], "has_header (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.has_header", false]], "head() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.head", false]], "hex() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.hex", false]], "higherorderfunction (in module datafusion.expr)": [[4, "datafusion.expr.HigherOrderFunction", false]], "hour() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.hour", false]], "http (in module datafusion.object_store)": [[13, "datafusion.object_store.Http", false]], "if_() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.if_", false]], "ifnull() (in module datafusion.functions)": [[5, "datafusion.functions.ifnull", false]], "ilike (in module datafusion.expr)": [[4, "datafusion.expr.ILike", false]], "ilike() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.ilike", false]], "immutable (datafusion.user_defined.volatility attribute)": [[19, "datafusion.user_defined.Volatility.Immutable", false]], "in_list() (in module datafusion.functions)": [[5, "datafusion.functions.in_list", false]], "include_rank() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.include_rank", false]], "indent (datafusion.dataframe.explainformat attribute)": [[2, "datafusion.dataframe.ExplainFormat.INDENT", false]], "indent (datafusion.explainformat attribute)": [[7, "datafusion.ExplainFormat.INDENT", false]], "initcap() (datafusion.expr method)": [[7, "datafusion.Expr.initcap", false]], "initcap() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.initcap", false]], "initcap() (in module datafusion.functions)": [[5, "datafusion.functions.initcap", false]], "inlist (in module datafusion.expr)": [[4, "datafusion.expr.InList", false]], "inner_product() (in module datafusion.functions)": [[5, "datafusion.functions.inner_product", false]], "inputs() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.inputs", false]], "inputs() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.inputs", false]], "insertop (class in datafusion)": [[7, "datafusion.InsertOp", false]], "insertop (class in datafusion.dataframe)": [[2, "datafusion.dataframe.InsertOp", false]], "instr() (in module datafusion.functions)": [[5, "datafusion.functions.instr", false]], "insubquery (in module datafusion.expr)": [[4, "datafusion.expr.InSubquery", false]], "intersect() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.intersect", false]], "into_view() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.into_view", false]], "is_causal() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.is_causal", false]], "is_correct_input() (datafusion.input.base.baseinputsource method)": [[8, "datafusion.input.base.BaseInputSource.is_correct_input", false]], "is_correct_input() (datafusion.input.location.locationinputplugin method)": [[10, "datafusion.input.location.LocationInputPlugin.is_correct_input", false]], "is_correct_input() (datafusion.input.locationinputplugin method)": [[9, "datafusion.input.LocationInputPlugin.is_correct_input", false]], "is_current_row() (datafusion.expr.windowframebound method)": [[4, "datafusion.expr.WindowFrameBound.is_current_row", false]], "is_following() (datafusion.expr.windowframebound method)": [[4, "datafusion.expr.WindowFrameBound.is_following", false]], "is_nan() (datafusion.expr method)": [[7, "datafusion.Expr.is_nan", false]], "is_nan() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.is_nan", false]], "is_nan() (in module datafusion.functions)": [[5, "datafusion.functions.is_nan", false]], "is_not_null() (datafusion.expr method)": [[7, "datafusion.Expr.is_not_null", false]], "is_not_null() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.is_not_null", false]], "is_null() (datafusion.expr method)": [[7, "datafusion.Expr.is_null", false]], "is_null() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.is_null", false]], "is_preceding() (datafusion.expr.windowframebound method)": [[4, "datafusion.expr.WindowFrameBound.is_preceding", false]], "is_unbounded() (datafusion.expr.windowframebound method)": [[4, "datafusion.expr.WindowFrameBound.is_unbounded", false]], "is_valid_utf8() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.is_valid_utf8", false]], "isfalse (in module datafusion.expr)": [[4, "datafusion.expr.IsFalse", false]], "isnan() (datafusion.expr method)": [[7, "datafusion.Expr.isnan", false]], "isnan() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.isnan", false]], "isnan() (in module datafusion.functions)": [[5, "datafusion.functions.isnan", false]], "isnotfalse (in module datafusion.expr)": [[4, "datafusion.expr.IsNotFalse", false]], "isnotnull (in module datafusion.expr)": [[4, "datafusion.expr.IsNotNull", false]], "isnottrue (in module datafusion.expr)": [[4, "datafusion.expr.IsNotTrue", false]], "isnotunknown (in module datafusion.expr)": [[4, "datafusion.expr.IsNotUnknown", false]], "isnull (in module datafusion.expr)": [[4, "datafusion.expr.IsNull", false]], "istrue (in module datafusion.expr)": [[4, "datafusion.expr.IsTrue", false]], "isunknown (in module datafusion.expr)": [[4, "datafusion.expr.IsUnknown", false]], "iszero() (datafusion.expr method)": [[7, "datafusion.Expr.iszero", false]], "iszero() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.iszero", false]], "iszero() (in module datafusion.functions)": [[5, "datafusion.functions.iszero", false]], "join (in module datafusion.expr)": [[4, "datafusion.expr.Join", false]], "join() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.join", false]], "join_on() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.join_on", false]], "joinconstraint (in module datafusion.expr)": [[4, "datafusion.expr.JoinConstraint", false]], "jointype (in module datafusion.expr)": [[4, "datafusion.expr.JoinType", false]], "json_tuple() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.json_tuple", false]], "kind (datafusion.catalog.table property)": [[0, "datafusion.catalog.Table.kind", false]], "kind (datafusion.table property)": [[7, "datafusion.Table.kind", false]], "labels() (datafusion.metric method)": [[7, "datafusion.Metric.labels", false]], "labels() (datafusion.plan.metric method)": [[15, "datafusion.plan.Metric.labels", false]], "lag() (in module datafusion.functions)": [[5, "datafusion.functions.lag", false]], "lambda (in module datafusion.expr)": [[4, "datafusion.expr.Lambda", false]], "lambda_() (in module datafusion.functions)": [[5, "datafusion.functions.lambda_", false]], "lambda_var() (in module datafusion.functions)": [[5, "datafusion.functions.lambda_var", false]], "lambdavariable (in module datafusion.expr)": [[4, "datafusion.expr.LambdaVariable", false]], "last_day() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.last_day", false]], "last_value() (in module datafusion.functions)": [[5, "datafusion.functions.last_value", false]], "lcm() (in module datafusion.functions)": [[5, "datafusion.functions.lcm", false]], "lead() (in module datafusion.functions)": [[5, "datafusion.functions.lead", false]], "least() (in module datafusion.functions)": [[5, "datafusion.functions.least", false]], "left() (in module datafusion.functions)": [[5, "datafusion.functions.left", false]], "length() (datafusion.expr method)": [[7, "datafusion.Expr.length", false]], "length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.length", false]], "length() (in module datafusion.functions)": [[5, "datafusion.functions.length", false]], "length() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.length", false]], "levenshtein() (in module datafusion.functions)": [[5, "datafusion.functions.levenshtein", false]], "like (in module datafusion.expr)": [[4, "datafusion.expr.Like", false]], "like() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.like", false]], "limit (in module datafusion.expr)": [[4, "datafusion.expr.Limit", false]], "limit() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.limit", false]], "list_any_match() (in module datafusion.functions)": [[5, "datafusion.functions.list_any_match", false]], "list_any_value() (in module datafusion.functions)": [[5, "datafusion.functions.list_any_value", false]], "list_append() (in module datafusion.functions)": [[5, "datafusion.functions.list_append", false]], "list_cat() (in module datafusion.functions)": [[5, "datafusion.functions.list_cat", false]], "list_compact() (in module datafusion.functions)": [[5, "datafusion.functions.list_compact", false]], "list_concat() (in module datafusion.functions)": [[5, "datafusion.functions.list_concat", false]], "list_contains() (in module datafusion.functions)": [[5, "datafusion.functions.list_contains", false]], "list_dims() (datafusion.expr method)": [[7, "datafusion.Expr.list_dims", false]], "list_dims() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.list_dims", false]], "list_dims() (in module datafusion.functions)": [[5, "datafusion.functions.list_dims", false]], "list_distance() (in module datafusion.functions)": [[5, "datafusion.functions.list_distance", false]], "list_distinct() (datafusion.expr method)": [[7, "datafusion.Expr.list_distinct", false]], "list_distinct() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.list_distinct", false]], "list_distinct() (in module datafusion.functions)": [[5, "datafusion.functions.list_distinct", false]], "list_element() (in module datafusion.functions)": [[5, "datafusion.functions.list_element", false]], "list_empty() (in module datafusion.functions)": [[5, "datafusion.functions.list_empty", false]], "list_except() (in module datafusion.functions)": [[5, "datafusion.functions.list_except", false]], "list_extract() (in module datafusion.functions)": [[5, "datafusion.functions.list_extract", false]], "list_filter() (in module datafusion.functions)": [[5, "datafusion.functions.list_filter", false]], "list_has() (in module datafusion.functions)": [[5, "datafusion.functions.list_has", false]], "list_has_all() (in module datafusion.functions)": [[5, "datafusion.functions.list_has_all", false]], "list_has_any() (in module datafusion.functions)": [[5, "datafusion.functions.list_has_any", false]], "list_indexof() (in module datafusion.functions)": [[5, "datafusion.functions.list_indexof", false]], "list_intersect() (in module datafusion.functions)": [[5, "datafusion.functions.list_intersect", false]], "list_join() (in module datafusion.functions)": [[5, "datafusion.functions.list_join", false]], "list_length() (datafusion.expr method)": [[7, "datafusion.Expr.list_length", false]], "list_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.list_length", false]], "list_length() (in module datafusion.functions)": [[5, "datafusion.functions.list_length", false]], "list_max() (in module datafusion.functions)": [[5, "datafusion.functions.list_max", false]], "list_min() (in module datafusion.functions)": [[5, "datafusion.functions.list_min", false]], "list_ndims() (datafusion.expr method)": [[7, "datafusion.Expr.list_ndims", false]], "list_ndims() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.list_ndims", false]], "list_ndims() (in module datafusion.functions)": [[5, "datafusion.functions.list_ndims", false]], "list_normalize() (in module datafusion.functions)": [[5, "datafusion.functions.list_normalize", false]], "list_overlap() (in module datafusion.functions)": [[5, "datafusion.functions.list_overlap", false]], "list_pop_back() (in module datafusion.functions)": [[5, "datafusion.functions.list_pop_back", false]], "list_pop_front() (in module datafusion.functions)": [[5, "datafusion.functions.list_pop_front", false]], "list_position() (in module datafusion.functions)": [[5, "datafusion.functions.list_position", false]], "list_positions() (in module datafusion.functions)": [[5, "datafusion.functions.list_positions", false]], "list_prepend() (in module datafusion.functions)": [[5, "datafusion.functions.list_prepend", false]], "list_push_back() (in module datafusion.functions)": [[5, "datafusion.functions.list_push_back", false]], "list_push_front() (in module datafusion.functions)": [[5, "datafusion.functions.list_push_front", false]], "list_remove() (in module datafusion.functions)": [[5, "datafusion.functions.list_remove", false]], "list_remove_all() (in module datafusion.functions)": [[5, "datafusion.functions.list_remove_all", false]], "list_remove_n() (in module datafusion.functions)": [[5, "datafusion.functions.list_remove_n", false]], "list_repeat() (in module datafusion.functions)": [[5, "datafusion.functions.list_repeat", false]], "list_replace() (in module datafusion.functions)": [[5, "datafusion.functions.list_replace", false]], "list_replace_all() (in module datafusion.functions)": [[5, "datafusion.functions.list_replace_all", false]], "list_replace_n() (in module datafusion.functions)": [[5, "datafusion.functions.list_replace_n", false]], "list_resize() (in module datafusion.functions)": [[5, "datafusion.functions.list_resize", false]], "list_reverse() (in module datafusion.functions)": [[5, "datafusion.functions.list_reverse", false]], "list_slice() (in module datafusion.functions)": [[5, "datafusion.functions.list_slice", false]], "list_sort() (in module datafusion.functions)": [[5, "datafusion.functions.list_sort", false]], "list_to_string() (in module datafusion.functions)": [[5, "datafusion.functions.list_to_string", false]], "list_transform() (in module datafusion.functions)": [[5, "datafusion.functions.list_transform", false]], "list_union() (in module datafusion.functions)": [[5, "datafusion.functions.list_union", false]], "list_zip() (in module datafusion.functions)": [[5, "datafusion.functions.list_zip", false]], "lit() (in module datafusion)": [[7, "datafusion.lit", false]], "literal (in module datafusion.expr)": [[4, "datafusion.expr.Literal", false]], "literal() (datafusion.expr static method)": [[7, "datafusion.Expr.literal", false]], "literal() (datafusion.expr.expr static method)": [[4, "datafusion.expr.Expr.literal", false]], "literal() (in module datafusion)": [[7, "datafusion.literal", false]], "literal_with_metadata() (datafusion.expr static method)": [[7, "datafusion.Expr.literal_with_metadata", false]], "literal_with_metadata() (datafusion.expr.expr static method)": [[4, "datafusion.expr.Expr.literal_with_metadata", false]], "ln() (datafusion.expr method)": [[7, "datafusion.Expr.ln", false]], "ln() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.ln", false]], "ln() (in module datafusion.functions)": [[5, "datafusion.functions.ln", false]], "localfilesystem (in module datafusion.object_store)": [[13, "datafusion.object_store.LocalFileSystem", false]], "locationinputplugin (class in datafusion.input)": [[9, "datafusion.input.LocationInputPlugin", false]], "locationinputplugin (class in datafusion.input.location)": [[10, "datafusion.input.location.LocationInputPlugin", false]], "log() (in module datafusion.functions)": [[5, "datafusion.functions.log", false]], "log10() (datafusion.expr method)": [[7, "datafusion.Expr.log10", false]], "log10() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.log10", false]], "log10() (in module datafusion.functions)": [[5, "datafusion.functions.log10", false]], "log2() (datafusion.expr method)": [[7, "datafusion.Expr.log2", false]], "log2() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.log2", false]], "log2() (in module datafusion.functions)": [[5, "datafusion.functions.log2", false]], "logical_plan() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.logical_plan", false]], "logicalextensioncodecexportable (class in datafusion.user_defined)": [[19, "datafusion.user_defined.LogicalExtensionCodecExportable", false]], "logicalplan (class in datafusion)": [[7, "datafusion.LogicalPlan", false]], "logicalplan (class in datafusion.plan)": [[15, "datafusion.plan.LogicalPlan", false]], "lower() (datafusion.expr method)": [[7, "datafusion.Expr.lower", false]], "lower() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.lower", false]], "lower() (in module datafusion.functions)": [[5, "datafusion.functions.lower", false]], "lpad() (in module datafusion.functions)": [[5, "datafusion.functions.lpad", false]], "ltrim() (datafusion.expr method)": [[7, "datafusion.Expr.ltrim", false]], "ltrim() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.ltrim", false]], "ltrim() (in module datafusion.functions)": [[5, "datafusion.functions.ltrim", false]], "luhn_check() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.luhn_check", false]], "lz4 (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.LZ4", false]], "lz4_raw (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.LZ4_RAW", false]], "make_array() (in module datafusion.functions)": [[5, "datafusion.functions.make_array", false]], "make_date() (in module datafusion.functions)": [[5, "datafusion.functions.make_date", false]], "make_dt_interval() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.make_dt_interval", false]], "make_interval() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.make_interval", false]], "make_list() (in module datafusion.functions)": [[5, "datafusion.functions.make_list", false]], "make_map() (in module datafusion.functions)": [[5, "datafusion.functions.make_map", false]], "make_time() (in module datafusion.functions)": [[5, "datafusion.functions.make_time", false]], "make_valid_utf8() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.make_valid_utf8", false]], "map_entries() (in module datafusion.functions)": [[5, "datafusion.functions.map_entries", false]], "map_extract() (in module datafusion.functions)": [[5, "datafusion.functions.map_extract", false]], "map_from_arrays() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.map_from_arrays", false]], "map_from_entries() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.map_from_entries", false]], "map_keys() (in module datafusion.functions)": [[5, "datafusion.functions.map_keys", false]], "map_values() (in module datafusion.functions)": [[5, "datafusion.functions.map_values", false]], "max() (in module datafusion.functions)": [[5, "datafusion.functions.max", false]], "max_cell_length (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.max_cell_length", false]], "max_height (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.max_height", false]], "max_memory_bytes (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.max_memory_bytes", false]], "max_row_group_size (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.max_row_group_size", false]], "max_row_group_size (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.max_row_group_size", false]], "max_rows (datafusion.dataframe_formatter.dataframehtmlformatter property)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.max_rows", false]], "max_width (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.max_width", false]], "maximum_buffered_record_batches_per_stream (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.maximum_buffered_record_batches_per_stream", false]], "maximum_buffered_record_batches_per_stream (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.maximum_buffered_record_batches_per_stream", false]], "maximum_parallel_row_group_writers (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.maximum_parallel_row_group_writers", false]], "maximum_parallel_row_group_writers (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.maximum_parallel_row_group_writers", false]], "md5() (datafusion.expr method)": [[7, "datafusion.Expr.md5", false]], "md5() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.md5", false]], "md5() (in module datafusion.functions)": [[5, "datafusion.functions.md5", false]], "mean() (in module datafusion.functions)": [[5, "datafusion.functions.mean", false]], "median() (in module datafusion.functions)": [[5, "datafusion.functions.median", false]], "memoize() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.memoize", false]], "memory_catalog() (datafusion.catalog static method)": [[7, "datafusion.Catalog.memory_catalog", false]], "memory_catalog() (datafusion.catalog.catalog static method)": [[0, "datafusion.catalog.Catalog.memory_catalog", false]], "memory_catalog() (datafusion.catalog.cataloglist static method)": [[0, "datafusion.catalog.CatalogList.memory_catalog", false]], "memory_schema() (datafusion.catalog.schema static method)": [[0, "datafusion.catalog.Schema.memory_schema", false]], "merge() (datafusion.accumulator method)": [[7, "datafusion.Accumulator.merge", false]], "merge() (datafusion.user_defined.accumulator method)": [[19, "datafusion.user_defined.Accumulator.merge", false]], "metric (class in datafusion)": [[7, "datafusion.Metric", false]], "metric (class in datafusion.plan)": [[15, "datafusion.plan.Metric", false]], "metrics() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.metrics", false]], "metrics() (datafusion.metricsset method)": [[7, "datafusion.MetricsSet.metrics", false]], "metrics() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.metrics", false]], "metrics() (datafusion.plan.metricsset method)": [[15, "datafusion.plan.MetricsSet.metrics", false]], "metricsset (class in datafusion)": [[7, "datafusion.MetricsSet", false]], "metricsset (class in datafusion.plan)": [[15, "datafusion.plan.MetricsSet", false]], "microsoftazure (in module datafusion.object_store)": [[13, "datafusion.object_store.MicrosoftAzure", false]], "min() (in module datafusion.functions)": [[5, "datafusion.functions.min", false]], "min_rows (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.min_rows", false]], "minute() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.minute", false]], "module": [[0, "module-datafusion.catalog", false], [1, "module-datafusion.context", false], [2, "module-datafusion.dataframe", false], [3, "module-datafusion.dataframe_formatter", false], [4, "module-datafusion.expr", false], [5, "module-datafusion.functions", false], [6, "module-datafusion.functions.spark", false], [7, "module-datafusion", false], [8, "module-datafusion.input.base", false], [9, "module-datafusion.input", false], [10, "module-datafusion.input.location", false], [11, "module-datafusion.io", false], [12, "module-datafusion.ipc", false], [13, "module-datafusion.object_store", false], [14, "module-datafusion.options", false], [15, "module-datafusion.plan", false], [16, "module-datafusion.record_batch", false], [17, "module-datafusion.substrait", false], [18, "module-datafusion.unparser", false], [19, "module-datafusion.user_defined", false]], "modulus() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.modulus", false]], "mysql() (datafusion.unparser.dialect static method)": [[18, "datafusion.unparser.Dialect.mysql", false]], "name (datafusion.aggregateudf property)": [[7, "datafusion.AggregateUDF.name", false]], "name (datafusion.metric property)": [[7, "datafusion.Metric.name", false]], "name (datafusion.plan.metric property)": [[15, "datafusion.plan.Metric.name", false]], "name (datafusion.scalarudf property)": [[7, "datafusion.ScalarUDF.name", false]], "name (datafusion.user_defined.aggregateudf property)": [[19, "datafusion.user_defined.AggregateUDF.name", false]], "name (datafusion.user_defined.scalarudf property)": [[19, "datafusion.user_defined.ScalarUDF.name", false]], "name (datafusion.user_defined.windowudf property)": [[19, "datafusion.user_defined.WindowUDF.name", false]], "name (datafusion.windowudf property)": [[7, "datafusion.WindowUDF.name", false]], "named_struct() (in module datafusion.functions)": [[5, "datafusion.functions.named_struct", false]], "names() (datafusion.catalog method)": [[7, "datafusion.Catalog.names", false]], "names() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.names", false]], "names() (datafusion.catalog.cataloglist method)": [[0, "datafusion.catalog.CatalogList.names", false]], "names() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.names", false]], "nanvl() (in module datafusion.functions)": [[5, "datafusion.functions.nanvl", false]], "negative (in module datafusion.expr)": [[4, "datafusion.expr.Negative", false]], "negative() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.negative", false]], "newlines_in_values (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.newlines_in_values", false]], "newlines_in_values (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.newlines_in_values", false]], "next() (datafusion.record_batch.recordbatchstream method)": [[16, "datafusion.record_batch.RecordBatchStream.next", false]], "next() (datafusion.recordbatchstream method)": [[7, "datafusion.RecordBatchStream.next", false]], "next_day() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.next_day", false]], "not (in module datafusion.expr)": [[4, "datafusion.expr.Not", false]], "now() (in module datafusion.functions)": [[5, "datafusion.functions.now", false]], "nth_value() (in module datafusion.functions)": [[5, "datafusion.functions.nth_value", false]], "ntile() (in module datafusion.functions)": [[5, "datafusion.functions.ntile", false]], "null_regex (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.null_regex", false]], "null_regex (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.null_regex", false]], "null_treatment() (datafusion.expr method)": [[7, "datafusion.Expr.null_treatment", false]], "null_treatment() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.null_treatment", false]], "nullif() (in module datafusion.functions)": [[5, "datafusion.functions.nullif", false]], "nulls_first() (datafusion.expr.sortexpr method)": [[4, "datafusion.expr.SortExpr.nulls_first", false]], "nvl() (in module datafusion.functions)": [[5, "datafusion.functions.nvl", false]], "nvl2() (in module datafusion.functions)": [[5, "datafusion.functions.nvl2", false]], "octet_length() (datafusion.expr method)": [[7, "datafusion.Expr.octet_length", false]], "octet_length() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.octet_length", false]], "octet_length() (in module datafusion.functions)": [[5, "datafusion.functions.octet_length", false]], "operatefunctionarg (in module datafusion.expr)": [[4, "datafusion.expr.OperateFunctionArg", false]], "optimized_logical_plan() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.optimized_logical_plan", false]], "options_internal (datafusion.context.sqloptions attribute)": [[1, "datafusion.context.SQLOptions.options_internal", false]], "options_internal (datafusion.sqloptions attribute)": [[7, "datafusion.SQLOptions.options_internal", false]], "order_by() (datafusion.expr method)": [[7, "datafusion.Expr.order_by", false]], "order_by() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.order_by", false]], "order_by() (in module datafusion.functions)": [[5, "datafusion.functions.order_by", false]], "otherwise() (datafusion.expr.casebuilder method)": [[4, "datafusion.expr.CaseBuilder.otherwise", false]], "output_rows (datafusion.metricsset property)": [[7, "datafusion.MetricsSet.output_rows", false]], "output_rows (datafusion.plan.metricsset property)": [[15, "datafusion.plan.MetricsSet.output_rows", false]], "over() (datafusion.expr method)": [[7, "datafusion.Expr.over", false]], "over() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.over", false]], "overlay() (in module datafusion.functions)": [[5, "datafusion.functions.overlay", false]], "overwrite (datafusion.dataframe.insertop attribute)": [[2, "datafusion.dataframe.InsertOp.OVERWRITE", false]], "overwrite (datafusion.insertop attribute)": [[7, "datafusion.InsertOp.OVERWRITE", false]], "owner_name() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.owner_name", false]], "parquetcolumnoptions (class in datafusion)": [[7, "datafusion.ParquetColumnOptions", false]], "parquetcolumnoptions (class in datafusion.dataframe)": [[2, "datafusion.dataframe.ParquetColumnOptions", false]], "parquetwriteroptions (class in datafusion)": [[7, "datafusion.ParquetWriterOptions", false]], "parquetwriteroptions (class in datafusion.dataframe)": [[2, "datafusion.dataframe.ParquetWriterOptions", false]], "parse_capacity_limit() (datafusion.context.sessioncontext static method)": [[1, "datafusion.context.SessionContext.parse_capacity_limit", false]], "parse_sql_expr() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.parse_sql_expr", false]], "parse_sql_expr() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.parse_sql_expr", false]], "parse_url() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.parse_url", false]], "partition (datafusion.metric property)": [[7, "datafusion.Metric.partition", false]], "partition (datafusion.plan.metric property)": [[15, "datafusion.plan.Metric.partition", false]], "partition_by() (datafusion.expr method)": [[7, "datafusion.Expr.partition_by", false]], "partition_by() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.partition_by", false]], "partition_count (datafusion.executionplan property)": [[7, "datafusion.ExecutionPlan.partition_count", false]], "partition_count (datafusion.plan.executionplan property)": [[15, "datafusion.plan.ExecutionPlan.partition_count", false]], "partitioning (in module datafusion.expr)": [[4, "datafusion.expr.Partitioning", false]], "percent_rank() (in module datafusion.functions)": [[5, "datafusion.functions.percent_rank", false]], "percentile_cont() (in module datafusion.functions)": [[5, "datafusion.functions.percentile_cont", false]], "pgjson (datafusion.dataframe.explainformat attribute)": [[2, "datafusion.dataframe.ExplainFormat.PGJSON", false]], "pgjson (datafusion.explainformat attribute)": [[7, "datafusion.ExplainFormat.PGJSON", false]], "physicalextensioncodecexportable (class in datafusion.user_defined)": [[19, "datafusion.user_defined.PhysicalExtensionCodecExportable", false]], "physicaloptimizerruleexportable (class in datafusion.context)": [[1, "datafusion.context.PhysicalOptimizerRuleExportable", false]], "pi() (in module datafusion.functions)": [[5, "datafusion.functions.pi", false]], "placeholder (in module datafusion.expr)": [[4, "datafusion.expr.Placeholder", false]], "plan (class in datafusion.substrait)": [[17, "datafusion.substrait.Plan", false]], "plan_internal (datafusion.substrait.plan attribute)": [[17, "datafusion.substrait.Plan.plan_internal", false]], "plan_to_sql() (datafusion.unparser.unparser method)": [[18, "datafusion.unparser.Unparser.plan_to_sql", false]], "pmod() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.pmod", false]], "position() (in module datafusion.functions)": [[5, "datafusion.functions.position", false]], "postgres() (datafusion.unparser.dialect static method)": [[18, "datafusion.unparser.Dialect.postgres", false]], "pow() (in module datafusion.functions)": [[5, "datafusion.functions.pow", false]], "power() (in module datafusion.functions)": [[5, "datafusion.functions.power", false]], "prepare (in module datafusion.expr)": [[4, "datafusion.expr.Prepare", false]], "producer (class in datafusion.substrait)": [[17, "datafusion.substrait.Producer", false]], "projection (in module datafusion.expr)": [[4, "datafusion.expr.Projection", false]], "python_value() (datafusion.expr method)": [[7, "datafusion.Expr.python_value", false]], "python_value() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.python_value", false]], "quantile_cont() (in module datafusion.functions)": [[5, "datafusion.functions.quantile_cont", false]], "queryplannerexportable (class in datafusion.context)": [[1, "datafusion.context.QueryPlannerExportable", false]], "quote (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.quote", false]], "quote (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.quote", false]], "radians() (datafusion.expr method)": [[7, "datafusion.Expr.radians", false]], "radians() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.radians", false]], "radians() (in module datafusion.functions)": [[5, "datafusion.functions.radians", false]], "random() (in module datafusion.functions)": [[5, "datafusion.functions.random", false]], "range() (in module datafusion.functions)": [[5, "datafusion.functions.range", false]], "rank() (in module datafusion.functions)": [[5, "datafusion.functions.rank", false]], "raw_sort (datafusion.expr.sortexpr attribute)": [[4, "datafusion.expr.SortExpr.raw_sort", false]], "rbs (datafusion.record_batch.recordbatchstream attribute)": [[16, "datafusion.record_batch.RecordBatchStream.rbs", false]], "rbs (datafusion.recordbatchstream attribute)": [[7, "datafusion.RecordBatchStream.rbs", false]], "read_arrow() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_arrow", false]], "read_avro() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_avro", false]], "read_avro() (in module datafusion)": [[7, "datafusion.read_avro", false]], "read_avro() (in module datafusion.io)": [[11, "datafusion.io.read_avro", false]], "read_batch() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_batch", false]], "read_batches() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_batches", false]], "read_csv() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_csv", false]], "read_csv() (in module datafusion)": [[7, "datafusion.read_csv", false]], "read_csv() (in module datafusion.io)": [[11, "datafusion.io.read_csv", false]], "read_empty() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_empty", false]], "read_json() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_json", false]], "read_json() (in module datafusion)": [[7, "datafusion.read_json", false]], "read_json() (in module datafusion.io)": [[11, "datafusion.io.read_json", false]], "read_parquet() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_parquet", false]], "read_parquet() (in module datafusion)": [[7, "datafusion.read_parquet", false]], "read_parquet() (in module datafusion.io)": [[11, "datafusion.io.read_parquet", false]], "read_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.read_table", false]], "record_batch (datafusion.record_batch.recordbatch attribute)": [[16, "datafusion.record_batch.RecordBatch.record_batch", false]], "record_batch (datafusion.recordbatch attribute)": [[7, "datafusion.RecordBatch.record_batch", false]], "recordbatch (class in datafusion)": [[7, "datafusion.RecordBatch", false]], "recordbatch (class in datafusion.record_batch)": [[16, "datafusion.record_batch.RecordBatch", false]], "recordbatchstream (class in datafusion)": [[7, "datafusion.RecordBatchStream", false]], "recordbatchstream (class in datafusion.record_batch)": [[16, "datafusion.record_batch.RecordBatchStream", false]], "recursivequery (in module datafusion.expr)": [[4, "datafusion.expr.RecursiveQuery", false]], "refresh_catalogs() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.refresh_catalogs", false]], "regexp_count() (in module datafusion.functions)": [[5, "datafusion.functions.regexp_count", false]], "regexp_instr() (in module datafusion.functions)": [[5, "datafusion.functions.regexp_instr", false]], "regexp_like() (in module datafusion.functions)": [[5, "datafusion.functions.regexp_like", false]], "regexp_match() (in module datafusion.functions)": [[5, "datafusion.functions.regexp_match", false]], "regexp_replace() (in module datafusion.functions)": [[5, "datafusion.functions.regexp_replace", false]], "register_arrow() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_arrow", false]], "register_avro() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_avro", false]], "register_batch() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_batch", false]], "register_catalog() (datafusion.catalog.cataloglist method)": [[0, "datafusion.catalog.CatalogList.register_catalog", false]], "register_catalog() (datafusion.catalog.catalogproviderlist method)": [[0, "datafusion.catalog.CatalogProviderList.register_catalog", false]], "register_catalog_provider() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_catalog_provider", false]], "register_catalog_provider_list() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_catalog_provider_list", false]], "register_csv() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_csv", false]], "register_dataset() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_dataset", false]], "register_formatter() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.register_formatter", false]], "register_json() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_json", false]], "register_listing_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_listing_table", false]], "register_object_store() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_object_store", false]], "register_parquet() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_parquet", false]], "register_record_batches() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_record_batches", false]], "register_schema() (datafusion.catalog method)": [[7, "datafusion.Catalog.register_schema", false]], "register_schema() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.register_schema", false]], "register_schema() (datafusion.catalog.catalogprovider method)": [[0, "datafusion.catalog.CatalogProvider.register_schema", false]], "register_table() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.register_table", false]], "register_table() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.register_table", false]], "register_table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_table", false]], "register_table_factory() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_table_factory", false]], "register_table_provider() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_table_provider", false]], "register_udaf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_udaf", false]], "register_udf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_udf", false]], "register_udtf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_udtf", false]], "register_udwf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_udwf", false]], "register_view() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.register_view", false]], "regr_avgx() (in module datafusion.functions)": [[5, "datafusion.functions.regr_avgx", false]], "regr_avgy() (in module datafusion.functions)": [[5, "datafusion.functions.regr_avgy", false]], "regr_count() (in module datafusion.functions)": [[5, "datafusion.functions.regr_count", false]], "regr_intercept() (in module datafusion.functions)": [[5, "datafusion.functions.regr_intercept", false]], "regr_r2() (in module datafusion.functions)": [[5, "datafusion.functions.regr_r2", false]], "regr_slope() (in module datafusion.functions)": [[5, "datafusion.functions.regr_slope", false]], "regr_sxx() (in module datafusion.functions)": [[5, "datafusion.functions.regr_sxx", false]], "regr_sxy() (in module datafusion.functions)": [[5, "datafusion.functions.regr_sxy", false]], "regr_syy() (in module datafusion.functions)": [[5, "datafusion.functions.regr_syy", false]], "remove_optimizer_rule() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.remove_optimizer_rule", false]], "repartition (in module datafusion.expr)": [[4, "datafusion.expr.Repartition", false]], "repartition() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.repartition", false]], "repartition_by_hash() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.repartition_by_hash", false]], "repeat() (in module datafusion.functions)": [[5, "datafusion.functions.repeat", false]], "replace (datafusion.dataframe.insertop attribute)": [[2, "datafusion.dataframe.InsertOp.REPLACE", false]], "replace (datafusion.insertop attribute)": [[7, "datafusion.InsertOp.REPLACE", false]], "replace() (in module datafusion.functions)": [[5, "datafusion.functions.replace", false]], "repr_rows (datafusion.dataframe_formatter.dataframehtmlformatter property)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.repr_rows", false]], "reset_formatter() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.reset_formatter", false]], "reverse() (datafusion.expr method)": [[7, "datafusion.Expr.reverse", false]], "reverse() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.reverse", false]], "reverse() (in module datafusion.functions)": [[5, "datafusion.functions.reverse", false]], "rex_call_operands() (datafusion.expr method)": [[7, "datafusion.Expr.rex_call_operands", false]], "rex_call_operands() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.rex_call_operands", false]], "rex_call_operator() (datafusion.expr method)": [[7, "datafusion.Expr.rex_call_operator", false]], "rex_call_operator() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.rex_call_operator", false]], "rex_type() (datafusion.expr method)": [[7, "datafusion.Expr.rex_type", false]], "rex_type() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.rex_type", false]], "right() (in module datafusion.functions)": [[5, "datafusion.functions.right", false]], "rint() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.rint", false]], "rollup() (datafusion.expr.groupingset static method)": [[4, "datafusion.expr.GroupingSet.rollup", false]], "round() (in module datafusion.functions)": [[5, "datafusion.functions.round", false]], "round() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.round", false]], "row() (in module datafusion.functions)": [[5, "datafusion.functions.row", false]], "row_number() (in module datafusion.functions)": [[5, "datafusion.functions.row_number", false]], "rpad() (in module datafusion.functions)": [[5, "datafusion.functions.rpad", false]], "rtrim() (datafusion.expr method)": [[7, "datafusion.Expr.rtrim", false]], "rtrim() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.rtrim", false]], "rtrim() (in module datafusion.functions)": [[5, "datafusion.functions.rtrim", false]], "runtimeenvbuilder (class in datafusion)": [[7, "datafusion.RuntimeEnvBuilder", false]], "runtimeenvbuilder (class in datafusion.context)": [[1, "datafusion.context.RuntimeEnvBuilder", false]], "scalarsubquery (in module datafusion.expr)": [[4, "datafusion.expr.ScalarSubquery", false]], "scalarudf (class in datafusion)": [[7, "datafusion.ScalarUDF", false]], "scalarudf (class in datafusion.user_defined)": [[19, "datafusion.user_defined.ScalarUDF", false]], "scalarudfexportable (class in datafusion.user_defined)": [[19, "datafusion.user_defined.ScalarUDFExportable", false]], "scalarvariable (in module datafusion.expr)": [[4, "datafusion.expr.ScalarVariable", false]], "schema (class in datafusion.catalog)": [[0, "datafusion.catalog.Schema", false]], "schema (datafusion.catalog.table property)": [[0, "datafusion.catalog.Table.schema", false]], "schema (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.schema", false]], "schema (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.schema", false]], "schema (datafusion.table property)": [[7, "datafusion.Table.schema", false]], "schema() (datafusion.catalog method)": [[7, "datafusion.Catalog.schema", false]], "schema() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.schema", false]], "schema() (datafusion.catalog.catalogprovider method)": [[0, "datafusion.catalog.CatalogProvider.schema", false]], "schema() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.schema", false]], "schema_infer_max_records (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.schema_infer_max_records", false]], "schema_infer_max_records (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.schema_infer_max_records", false]], "schema_name() (datafusion.expr method)": [[7, "datafusion.Expr.schema_name", false]], "schema_name() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.schema_name", false]], "schema_names() (datafusion.catalog method)": [[7, "datafusion.Catalog.schema_names", false]], "schema_names() (datafusion.catalog.catalog method)": [[0, "datafusion.catalog.Catalog.schema_names", false]], "schema_names() (datafusion.catalog.catalogprovider method)": [[0, "datafusion.catalog.CatalogProvider.schema_names", false]], "schemaprovider (class in datafusion.catalog)": [[0, "datafusion.catalog.SchemaProvider", false]], "sec() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.sec", false]], "second() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.second", false]], "select() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.select", false]], "select_exprs() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.select_exprs", false]], "serde (class in datafusion.substrait)": [[17, "datafusion.substrait.Serde", false]], "serialize() (datafusion.substrait.serde static method)": [[17, "datafusion.substrait.Serde.serialize", false]], "serialize_bytes() (datafusion.substrait.serde static method)": [[17, "datafusion.substrait.Serde.serialize_bytes", false]], "serialize_to_plan() (datafusion.substrait.serde static method)": [[17, "datafusion.substrait.Serde.serialize_to_plan", false]], "session_id() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.session_id", false]], "session_start_time() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.session_start_time", false]], "sessionconfig (class in datafusion)": [[7, "datafusion.SessionConfig", false]], "sessionconfig (class in datafusion.context)": [[1, "datafusion.context.SessionConfig", false]], "sessioncontext (class in datafusion.context)": [[1, "datafusion.context.SessionContext", false]], "set() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.set", false]], "set() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.set", false]], "set_custom_cell_builder() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.set_custom_cell_builder", false]], "set_custom_header_builder() (datafusion.dataframe_formatter.dataframehtmlformatter method)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.set_custom_header_builder", false]], "set_formatter() (datafusion.dataframe_formatter.formattermanager class method)": [[3, "datafusion.dataframe_formatter.FormatterManager.set_formatter", false]], "set_formatter() (in module datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.set_formatter", false]], "set_query_planner() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.set_query_planner", false]], "set_sender_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.set_sender_ctx", false]], "set_worker_ctx() (in module datafusion.ipc)": [[12, "datafusion.ipc.set_worker_ctx", false]], "setvariable (in module datafusion.expr)": [[4, "datafusion.expr.SetVariable", false]], "sha1() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.sha1", false]], "sha2() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.sha2", false]], "sha224() (datafusion.expr method)": [[7, "datafusion.Expr.sha224", false]], "sha224() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sha224", false]], "sha224() (in module datafusion.functions)": [[5, "datafusion.functions.sha224", false]], "sha256() (datafusion.expr method)": [[7, "datafusion.Expr.sha256", false]], "sha256() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sha256", false]], "sha256() (in module datafusion.functions)": [[5, "datafusion.functions.sha256", false]], "sha384() (datafusion.expr method)": [[7, "datafusion.Expr.sha384", false]], "sha384() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sha384", false]], "sha384() (in module datafusion.functions)": [[5, "datafusion.functions.sha384", false]], "sha512() (datafusion.expr method)": [[7, "datafusion.Expr.sha512", false]], "sha512() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sha512", false]], "sha512() (in module datafusion.functions)": [[5, "datafusion.functions.sha512", false]], "shiftleft() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.shiftleft", false]], "shiftright() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.shiftright", false]], "shiftrightunsigned() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.shiftrightunsigned", false]], "show() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.show", false]], "show_truncation_message (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.show_truncation_message", false]], "shuffle() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.shuffle", false]], "signum() (datafusion.expr method)": [[7, "datafusion.Expr.signum", false]], "signum() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.signum", false]], "signum() (in module datafusion.functions)": [[5, "datafusion.functions.signum", false]], "similarto (in module datafusion.expr)": [[4, "datafusion.expr.SimilarTo", false]], "sin() (datafusion.expr method)": [[7, "datafusion.Expr.sin", false]], "sin() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sin", false]], "sin() (in module datafusion.functions)": [[5, "datafusion.functions.sin", false]], "sinh() (datafusion.expr method)": [[7, "datafusion.Expr.sinh", false]], "sinh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sinh", false]], "sinh() (in module datafusion.functions)": [[5, "datafusion.functions.sinh", false]], "size() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.size", false]], "skip_arrow_metadata (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.skip_arrow_metadata", false]], "skip_arrow_metadata (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.skip_arrow_metadata", false]], "slice() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.slice", false]], "snappy (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.SNAPPY", false]], "sort (in module datafusion.expr)": [[4, "datafusion.expr.Sort", false]], "sort() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.sort", false]], "sort() (datafusion.expr method)": [[7, "datafusion.Expr.sort", false]], "sort() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sort", false]], "sort_by() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.sort_by", false]], "sortexpr (class in datafusion.expr)": [[4, "datafusion.expr.SortExpr", false]], "sortkey (in module datafusion.expr)": [[4, "datafusion.expr.SortKey", false]], "soundex() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.soundex", false]], "space() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.space", false]], "spark_cast() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.spark_cast", false]], "spill_count (datafusion.metricsset property)": [[7, "datafusion.MetricsSet.spill_count", false]], "spill_count (datafusion.plan.metricsset property)": [[15, "datafusion.plan.MetricsSet.spill_count", false]], "spilled_bytes (datafusion.metricsset property)": [[7, "datafusion.MetricsSet.spilled_bytes", false]], "spilled_bytes (datafusion.plan.metricsset property)": [[15, "datafusion.plan.MetricsSet.spilled_bytes", false]], "spilled_rows (datafusion.metricsset property)": [[7, "datafusion.MetricsSet.spilled_rows", false]], "spilled_rows (datafusion.plan.metricsset property)": [[15, "datafusion.plan.MetricsSet.spilled_rows", false]], "split_part() (in module datafusion.functions)": [[5, "datafusion.functions.split_part", false]], "sql() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.sql", false]], "sql_with_options() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.sql_with_options", false]], "sqlite() (datafusion.unparser.dialect static method)": [[18, "datafusion.unparser.Dialect.sqlite", false]], "sqloptions (class in datafusion)": [[7, "datafusion.SQLOptions", false]], "sqloptions (class in datafusion.context)": [[1, "datafusion.context.SQLOptions", false]], "sqrt() (datafusion.expr method)": [[7, "datafusion.Expr.sqrt", false]], "sqrt() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.sqrt", false]], "sqrt() (in module datafusion.functions)": [[5, "datafusion.functions.sqrt", false]], "stable (datafusion.user_defined.volatility attribute)": [[19, "datafusion.user_defined.Volatility.Stable", false]], "starts_with() (in module datafusion.functions)": [[5, "datafusion.functions.starts_with", false]], "state() (datafusion.accumulator method)": [[7, "datafusion.Accumulator.state", false]], "state() (datafusion.user_defined.accumulator method)": [[19, "datafusion.user_defined.Accumulator.state", false]], "statistics_enabled (datafusion.dataframe.parquetcolumnoptions attribute)": [[2, "datafusion.dataframe.ParquetColumnOptions.statistics_enabled", false]], "statistics_enabled (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.statistics_enabled", false]], "statistics_enabled (datafusion.parquetcolumnoptions attribute)": [[7, "datafusion.ParquetColumnOptions.statistics_enabled", false]], "statistics_enabled (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.statistics_enabled", false]], "statistics_truncate_length (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.statistics_truncate_length", false]], "statistics_truncate_length (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.statistics_truncate_length", false]], "stddev() (in module datafusion.functions)": [[5, "datafusion.functions.stddev", false]], "stddev_pop() (in module datafusion.functions)": [[5, "datafusion.functions.stddev_pop", false]], "stddev_samp() (in module datafusion.functions)": [[5, "datafusion.functions.stddev_samp", false]], "str_to_map() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.str_to_map", false]], "string_agg() (in module datafusion.functions)": [[5, "datafusion.functions.string_agg", false]], "string_literal() (datafusion.expr static method)": [[7, "datafusion.Expr.string_literal", false]], "string_literal() (datafusion.expr.expr static method)": [[4, "datafusion.expr.Expr.string_literal", false]], "string_to_array() (in module datafusion.functions)": [[5, "datafusion.functions.string_to_array", false]], "string_to_list() (in module datafusion.functions)": [[5, "datafusion.functions.string_to_list", false]], "strpos() (in module datafusion.functions)": [[5, "datafusion.functions.strpos", false]], "struct() (in module datafusion.functions)": [[5, "datafusion.functions.struct", false]], "style_provider (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.style_provider", false]], "styleprovider (class in datafusion.dataframe_formatter)": [[3, "datafusion.dataframe_formatter.StyleProvider", false]], "subquery (in module datafusion.expr)": [[4, "datafusion.expr.Subquery", false]], "subqueryalias (in module datafusion.expr)": [[4, "datafusion.expr.SubqueryAlias", false]], "substr() (in module datafusion.functions)": [[5, "datafusion.functions.substr", false]], "substr_index() (in module datafusion.functions)": [[5, "datafusion.functions.substr_index", false]], "substring() (in module datafusion.functions)": [[5, "datafusion.functions.substring", false]], "substring() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.substring", false]], "sum() (in module datafusion.functions)": [[5, "datafusion.functions.sum", false]], "sum_by_name() (datafusion.metricsset method)": [[7, "datafusion.MetricsSet.sum_by_name", false]], "sum_by_name() (datafusion.plan.metricsset method)": [[15, "datafusion.plan.MetricsSet.sum_by_name", false]], "supports_bounded_execution() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.supports_bounded_execution", false]], "table (class in datafusion)": [[7, "datafusion.Table", false]], "table (class in datafusion.catalog)": [[0, "datafusion.catalog.Table", false]], "table() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.table", false]], "table() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.table", false]], "table() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.table", false]], "table_exist() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.table_exist", false]], "table_exist() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.table_exist", false]], "table_exist() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.table_exist", false]], "table_names() (datafusion.catalog.schema method)": [[0, "datafusion.catalog.Schema.table_names", false]], "table_names() (datafusion.catalog.schemaprovider method)": [[0, "datafusion.catalog.SchemaProvider.table_names", false]], "table_partition_cols (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.table_partition_cols", false]], "table_partition_cols (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.table_partition_cols", false]], "table_provider() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.table_provider", false]], "tablefunction (class in datafusion)": [[7, "datafusion.TableFunction", false]], "tablefunction (class in datafusion.user_defined)": [[19, "datafusion.user_defined.TableFunction", false]], "tableproviderexportable (class in datafusion.context)": [[1, "datafusion.context.TableProviderExportable", false]], "tableproviderfactory (class in datafusion)": [[7, "datafusion.TableProviderFactory", false]], "tableproviderfactoryexportable (class in datafusion)": [[7, "datafusion.TableProviderFactoryExportable", false]], "tablescan (in module datafusion.expr)": [[4, "datafusion.expr.TableScan", false]], "tail() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.tail", false]], "tan() (datafusion.expr method)": [[7, "datafusion.Expr.tan", false]], "tan() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.tan", false]], "tan() (in module datafusion.functions)": [[5, "datafusion.functions.tan", false]], "tanh() (datafusion.expr method)": [[7, "datafusion.Expr.tanh", false]], "tanh() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.tanh", false]], "tanh() (in module datafusion.functions)": [[5, "datafusion.functions.tanh", false]], "terminator (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.terminator", false]], "terminator (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.terminator", false]], "time_trunc() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.time_trunc", false]], "to_arrow_table() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.to_arrow_table", false]], "to_bytes() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.to_bytes", false]], "to_bytes() (datafusion.expr method)": [[7, "datafusion.Expr.to_bytes", false]], "to_bytes() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.to_bytes", false]], "to_bytes() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.to_bytes", false]], "to_bytes() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.to_bytes", false]], "to_bytes() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.to_bytes", false]], "to_char() (in module datafusion.functions)": [[5, "datafusion.functions.to_char", false]], "to_date() (in module datafusion.functions)": [[5, "datafusion.functions.to_date", false]], "to_hex() (datafusion.expr method)": [[7, "datafusion.Expr.to_hex", false]], "to_hex() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.to_hex", false]], "to_hex() (in module datafusion.functions)": [[5, "datafusion.functions.to_hex", false]], "to_inner() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.to_inner", false]], "to_inner() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.to_inner", false]], "to_json() (datafusion.substrait.plan method)": [[17, "datafusion.substrait.Plan.to_json", false]], "to_local_time() (in module datafusion.functions)": [[5, "datafusion.functions.to_local_time", false]], "to_pandas() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.to_pandas", false]], "to_polars() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.to_polars", false]], "to_proto() (datafusion.executionplan method)": [[7, "datafusion.ExecutionPlan.to_proto", false]], "to_proto() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.to_proto", false]], "to_proto() (datafusion.plan.executionplan method)": [[15, "datafusion.plan.ExecutionPlan.to_proto", false]], "to_proto() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.to_proto", false]], "to_pyarrow() (datafusion.record_batch.recordbatch method)": [[16, "datafusion.record_batch.RecordBatch.to_pyarrow", false]], "to_pyarrow() (datafusion.recordbatch method)": [[7, "datafusion.RecordBatch.to_pyarrow", false]], "to_pydict() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.to_pydict", false]], "to_pylist() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.to_pylist", false]], "to_substrait_plan() (datafusion.substrait.producer static method)": [[17, "datafusion.substrait.Producer.to_substrait_plan", false]], "to_time() (in module datafusion.functions)": [[5, "datafusion.functions.to_time", false]], "to_timestamp() (in module datafusion.functions)": [[5, "datafusion.functions.to_timestamp", false]], "to_timestamp_micros() (in module datafusion.functions)": [[5, "datafusion.functions.to_timestamp_micros", false]], "to_timestamp_millis() (in module datafusion.functions)": [[5, "datafusion.functions.to_timestamp_millis", false]], "to_timestamp_nanos() (in module datafusion.functions)": [[5, "datafusion.functions.to_timestamp_nanos", false]], "to_timestamp_seconds() (in module datafusion.functions)": [[5, "datafusion.functions.to_timestamp_seconds", false]], "to_unixtime() (in module datafusion.functions)": [[5, "datafusion.functions.to_unixtime", false]], "to_utc_timestamp() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.to_utc_timestamp", false]], "to_variant() (datafusion.expr method)": [[7, "datafusion.Expr.to_variant", false]], "to_variant() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.to_variant", false]], "to_variant() (datafusion.logicalplan method)": [[7, "datafusion.LogicalPlan.to_variant", false]], "to_variant() (datafusion.plan.logicalplan method)": [[15, "datafusion.plan.LogicalPlan.to_variant", false]], "today (in module datafusion.functions)": [[5, "datafusion.functions.today", false]], "transactionaccessmode (in module datafusion.expr)": [[4, "datafusion.expr.TransactionAccessMode", false]], "transactionconclusion (in module datafusion.expr)": [[4, "datafusion.expr.TransactionConclusion", false]], "transactionend (in module datafusion.expr)": [[4, "datafusion.expr.TransactionEnd", false]], "transactionisolationlevel (in module datafusion.expr)": [[4, "datafusion.expr.TransactionIsolationLevel", false]], "transactionstart (in module datafusion.expr)": [[4, "datafusion.expr.TransactionStart", false]], "transform() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.transform", false]], "translate() (in module datafusion.functions)": [[5, "datafusion.functions.translate", false]], "tree (datafusion.dataframe.explainformat attribute)": [[2, "datafusion.dataframe.ExplainFormat.TREE", false]], "tree (datafusion.explainformat attribute)": [[7, "datafusion.ExplainFormat.TREE", false]], "trim() (datafusion.expr method)": [[7, "datafusion.Expr.trim", false]], "trim() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.trim", false]], "trim() (in module datafusion.functions)": [[5, "datafusion.functions.trim", false]], "trunc() (in module datafusion.functions)": [[5, "datafusion.functions.trunc", false]], "trunc() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.trunc", false]], "truncated_rows (datafusion.csvreadoptions attribute)": [[7, "datafusion.CsvReadOptions.truncated_rows", false]], "truncated_rows (datafusion.options.csvreadoptions attribute)": [[14, "datafusion.options.CsvReadOptions.truncated_rows", false]], "try_cast() (datafusion.expr method)": [[7, "datafusion.Expr.try_cast", false]], "try_cast() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.try_cast", false]], "try_cast_to_type() (in module datafusion.functions)": [[5, "datafusion.functions.try_cast_to_type", false]], "try_parse_url() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.try_parse_url", false]], "try_sum() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.try_sum", false]], "try_url_decode() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.try_url_decode", false]], "trycast (in module datafusion.expr)": [[4, "datafusion.expr.TryCast", false]], "types() (datafusion.expr method)": [[7, "datafusion.Expr.types", false]], "types() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.types", false]], "udaf (in module datafusion)": [[7, "datafusion.udaf", false]], "udaf (in module datafusion.user_defined)": [[19, "datafusion.user_defined.udaf", false]], "udaf() (datafusion.aggregateudf static method)": [[7, "datafusion.AggregateUDF.udaf", false]], "udaf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udaf", false]], "udaf() (datafusion.user_defined.aggregateudf static method)": [[19, "datafusion.user_defined.AggregateUDF.udaf", false]], "udafs() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udafs", false]], "udf (in module datafusion)": [[7, "datafusion.udf", false]], "udf (in module datafusion.user_defined)": [[19, "datafusion.user_defined.udf", false]], "udf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udf", false]], "udf() (datafusion.scalarudf static method)": [[7, "datafusion.ScalarUDF.udf", false]], "udf() (datafusion.user_defined.scalarudf static method)": [[19, "datafusion.user_defined.ScalarUDF.udf", false]], "udfs() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udfs", false]], "udtf (in module datafusion)": [[7, "datafusion.udtf", false]], "udtf (in module datafusion.user_defined)": [[19, "datafusion.user_defined.udtf", false]], "udtf() (datafusion.tablefunction static method)": [[7, "datafusion.TableFunction.udtf", false]], "udtf() (datafusion.user_defined.tablefunction static method)": [[19, "datafusion.user_defined.TableFunction.udtf", false]], "udwf (in module datafusion)": [[7, "datafusion.udwf", false]], "udwf (in module datafusion.user_defined)": [[19, "datafusion.user_defined.udwf", false]], "udwf() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udwf", false]], "udwf() (datafusion.user_defined.windowudf static method)": [[19, "datafusion.user_defined.WindowUDF.udwf", false]], "udwf() (datafusion.windowudf static method)": [[7, "datafusion.WindowUDF.udwf", false]], "udwfs() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.udwfs", false]], "unbase64() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unbase64", false]], "uncompressed (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.UNCOMPRESSED", false]], "unhex() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unhex", false]], "union (in module datafusion.expr)": [[4, "datafusion.expr.Union", false]], "union() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.union", false]], "union_by_name() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.union_by_name", false]], "union_distinct() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.union_distinct", false]], "union_extract() (in module datafusion.functions)": [[5, "datafusion.functions.union_extract", false]], "union_tag() (in module datafusion.functions)": [[5, "datafusion.functions.union_tag", false]], "unix_date() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unix_date", false]], "unix_micros() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unix_micros", false]], "unix_millis() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unix_millis", false]], "unix_seconds() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.unix_seconds", false]], "unnest (in module datafusion.expr)": [[4, "datafusion.expr.Unnest", false]], "unnest_columns() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.unnest_columns", false]], "unnestexpr (in module datafusion.expr)": [[4, "datafusion.expr.UnnestExpr", false]], "unparser (class in datafusion.unparser)": [[18, "datafusion.unparser.Unparser", false]], "unparser (datafusion.unparser.unparser attribute)": [[18, "datafusion.unparser.Unparser.unparser", false]], "update() (datafusion.accumulator method)": [[7, "datafusion.Accumulator.update", false]], "update() (datafusion.user_defined.accumulator method)": [[19, "datafusion.user_defined.Accumulator.update", false]], "upper() (datafusion.expr method)": [[7, "datafusion.Expr.upper", false]], "upper() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.upper", false]], "upper() (in module datafusion.functions)": [[5, "datafusion.functions.upper", false]], "url_decode() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.url_decode", false]], "url_encode() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.url_encode", false]], "use_shared_styles (datafusion.dataframe_formatter.dataframehtmlformatter attribute)": [[3, "datafusion.dataframe_formatter.DataFrameHtmlFormatter.use_shared_styles", false]], "uses_window_frame() (datafusion.user_defined.windowevaluator method)": [[19, "datafusion.user_defined.WindowEvaluator.uses_window_frame", false]], "uuid() (in module datafusion.functions)": [[5, "datafusion.functions.uuid", false]], "value (datafusion.metric property)": [[7, "datafusion.Metric.value", false]], "value (datafusion.plan.metric property)": [[15, "datafusion.plan.Metric.value", false]], "value_as_datetime (datafusion.metric property)": [[7, "datafusion.Metric.value_as_datetime", false]], "value_as_datetime (datafusion.plan.metric property)": [[15, "datafusion.plan.Metric.value_as_datetime", false]], "values (in module datafusion.expr)": [[4, "datafusion.expr.Values", false]], "var() (in module datafusion.functions)": [[5, "datafusion.functions.var", false]], "var_pop() (in module datafusion.functions)": [[5, "datafusion.functions.var_pop", false]], "var_population() (in module datafusion.functions)": [[5, "datafusion.functions.var_population", false]], "var_samp() (in module datafusion.functions)": [[5, "datafusion.functions.var_samp", false]], "var_sample() (in module datafusion.functions)": [[5, "datafusion.functions.var_sample", false]], "variant_name() (datafusion.expr method)": [[7, "datafusion.Expr.variant_name", false]], "variant_name() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.variant_name", false]], "version() (in module datafusion.functions)": [[5, "datafusion.functions.version", false]], "volatile (datafusion.user_defined.volatility attribute)": [[19, "datafusion.user_defined.Volatility.Volatile", false]], "volatility (class in datafusion.user_defined)": [[19, "datafusion.user_defined.Volatility", false]], "when() (datafusion.expr.casebuilder method)": [[4, "datafusion.expr.CaseBuilder.when", false]], "when() (in module datafusion.functions)": [[5, "datafusion.functions.when", false]], "width_bucket() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.width_bucket", false]], "window (class in datafusion.expr)": [[4, "datafusion.expr.Window", false]], "window() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.window", false]], "window_frame (datafusion.expr.windowframe attribute)": [[4, "datafusion.expr.WindowFrame.window_frame", false]], "window_frame (datafusion.windowframe attribute)": [[7, "datafusion.WindowFrame.window_frame", false]], "window_frame() (datafusion.expr method)": [[7, "datafusion.Expr.window_frame", false]], "window_frame() (datafusion.expr.expr method)": [[4, "datafusion.expr.Expr.window_frame", false]], "windowevaluator (class in datafusion.user_defined)": [[19, "datafusion.user_defined.WindowEvaluator", false]], "windowexpr (in module datafusion.expr)": [[4, "datafusion.expr.WindowExpr", false]], "windowframe (class in datafusion)": [[7, "datafusion.WindowFrame", false]], "windowframe (class in datafusion.expr)": [[4, "datafusion.expr.WindowFrame", false]], "windowframebound (class in datafusion.expr)": [[4, "datafusion.expr.WindowFrameBound", false]], "windowudf (class in datafusion)": [[7, "datafusion.WindowUDF", false]], "windowudf (class in datafusion.user_defined)": [[19, "datafusion.user_defined.WindowUDF", false]], "windowudfexportable (class in datafusion.user_defined)": [[19, "datafusion.user_defined.WindowUDFExportable", false]], "with_allow_ddl() (datafusion.context.sqloptions method)": [[1, "datafusion.context.SQLOptions.with_allow_ddl", false]], "with_allow_ddl() (datafusion.sqloptions method)": [[7, "datafusion.SQLOptions.with_allow_ddl", false]], "with_allow_dml() (datafusion.context.sqloptions method)": [[1, "datafusion.context.SQLOptions.with_allow_dml", false]], "with_allow_dml() (datafusion.sqloptions method)": [[7, "datafusion.SQLOptions.with_allow_dml", false]], "with_allow_statements() (datafusion.context.sqloptions method)": [[1, "datafusion.context.SQLOptions.with_allow_statements", false]], "with_allow_statements() (datafusion.sqloptions method)": [[7, "datafusion.SQLOptions.with_allow_statements", false]], "with_batch_size() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_batch_size", false]], "with_batch_size() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_batch_size", false]], "with_column() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.with_column", false]], "with_column_renamed() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.with_column_renamed", false]], "with_columns() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.with_columns", false]], "with_comment() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_comment", false]], "with_comment() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_comment", false]], "with_create_default_catalog_and_schema() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_create_default_catalog_and_schema", false]], "with_create_default_catalog_and_schema() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_create_default_catalog_and_schema", false]], "with_default_catalog_and_schema() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_default_catalog_and_schema", false]], "with_default_catalog_and_schema() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_default_catalog_and_schema", false]], "with_delimiter() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_delimiter", false]], "with_delimiter() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_delimiter", false]], "with_disk_manager_disabled() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_disk_manager_disabled", false]], "with_disk_manager_disabled() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_disk_manager_disabled", false]], "with_disk_manager_os() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_disk_manager_os", false]], "with_disk_manager_os() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_disk_manager_os", false]], "with_disk_manager_specified() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_disk_manager_specified", false]], "with_disk_manager_specified() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_disk_manager_specified", false]], "with_escape() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_escape", false]], "with_escape() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_escape", false]], "with_extension() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_extension", false]], "with_extension() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_extension", false]], "with_fair_spill_pool() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_fair_spill_pool", false]], "with_fair_spill_pool() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_fair_spill_pool", false]], "with_file_compression_type() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_file_compression_type", false]], "with_file_compression_type() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_file_compression_type", false]], "with_file_extension() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_file_extension", false]], "with_file_extension() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_file_extension", false]], "with_file_sort_order() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_file_sort_order", false]], "with_file_sort_order() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_file_sort_order", false]], "with_greedy_memory_pool() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_greedy_memory_pool", false]], "with_greedy_memory_pool() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_greedy_memory_pool", false]], "with_has_header() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_has_header", false]], "with_has_header() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_has_header", false]], "with_information_schema() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_information_schema", false]], "with_information_schema() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_information_schema", false]], "with_logical_extension_codec() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.with_logical_extension_codec", false]], "with_metadata() (in module datafusion.functions)": [[5, "datafusion.functions.with_metadata", false]], "with_newlines_in_values() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_newlines_in_values", false]], "with_newlines_in_values() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_newlines_in_values", false]], "with_null_regex() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_null_regex", false]], "with_null_regex() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_null_regex", false]], "with_parquet_pruning() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_parquet_pruning", false]], "with_parquet_pruning() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_parquet_pruning", false]], "with_physical_extension_codec() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.with_physical_extension_codec", false]], "with_pretty() (datafusion.unparser.unparser method)": [[18, "datafusion.unparser.Unparser.with_pretty", false]], "with_python_udf_inlining() (datafusion.context.sessioncontext method)": [[1, "datafusion.context.SessionContext.with_python_udf_inlining", false]], "with_quote() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_quote", false]], "with_quote() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_quote", false]], "with_repartition_aggregations() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_aggregations", false]], "with_repartition_aggregations() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_aggregations", false]], "with_repartition_file_min_size() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_file_min_size", false]], "with_repartition_file_min_size() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_file_min_size", false]], "with_repartition_file_scans() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_file_scans", false]], "with_repartition_file_scans() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_file_scans", false]], "with_repartition_joins() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_joins", false]], "with_repartition_joins() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_joins", false]], "with_repartition_sorts() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_sorts", false]], "with_repartition_sorts() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_sorts", false]], "with_repartition_windows() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_repartition_windows", false]], "with_repartition_windows() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_repartition_windows", false]], "with_schema() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_schema", false]], "with_schema() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_schema", false]], "with_schema_infer_max_records() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_schema_infer_max_records", false]], "with_schema_infer_max_records() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_schema_infer_max_records", false]], "with_table_partition_cols() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_table_partition_cols", false]], "with_table_partition_cols() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_table_partition_cols", false]], "with_target_partitions() (datafusion.context.sessionconfig method)": [[1, "datafusion.context.SessionConfig.with_target_partitions", false]], "with_target_partitions() (datafusion.sessionconfig method)": [[7, "datafusion.SessionConfig.with_target_partitions", false]], "with_temp_file_path() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_temp_file_path", false]], "with_temp_file_path() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_temp_file_path", false]], "with_terminator() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_terminator", false]], "with_terminator() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_terminator", false]], "with_truncated_rows() (datafusion.csvreadoptions method)": [[7, "datafusion.CsvReadOptions.with_truncated_rows", false]], "with_truncated_rows() (datafusion.options.csvreadoptions method)": [[14, "datafusion.options.CsvReadOptions.with_truncated_rows", false]], "with_unbounded_memory_pool() (datafusion.context.runtimeenvbuilder method)": [[1, "datafusion.context.RuntimeEnvBuilder.with_unbounded_memory_pool", false]], "with_unbounded_memory_pool() (datafusion.runtimeenvbuilder method)": [[7, "datafusion.RuntimeEnvBuilder.with_unbounded_memory_pool", false]], "write_batch_size (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.write_batch_size", false]], "write_batch_size (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.write_batch_size", false]], "write_csv() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.write_csv", false]], "write_json() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.write_json", false]], "write_parquet() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.write_parquet", false]], "write_parquet_with_options() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.write_parquet_with_options", false]], "write_table() (datafusion.dataframe.dataframe method)": [[2, "datafusion.dataframe.DataFrame.write_table", false]], "writer_version (datafusion.dataframe.parquetwriteroptions attribute)": [[2, "datafusion.dataframe.ParquetWriterOptions.writer_version", false]], "writer_version (datafusion.parquetwriteroptions attribute)": [[7, "datafusion.ParquetWriterOptions.writer_version", false]], "xxhash64() (in module datafusion.functions.spark)": [[6, "datafusion.functions.spark.xxhash64", false]], "zstd (datafusion.dataframe.compression attribute)": [[2, "datafusion.dataframe.Compression.ZSTD", false]]}, "objects": {"": [[7, 0, 0, "-", "datafusion"]], "datafusion": [[7, 1, 1, "", "Accumulator"], [7, 1, 1, "", "AggregateUDF"], [7, 1, 1, "", "Catalog"], [7, 1, 1, "", "CsvReadOptions"], [7, 5, 1, "", "DFSchema"], [7, 1, 1, "", "DataFrameWriteOptions"], [7, 1, 1, "", "ExecutionPlan"], [7, 1, 1, "", "ExplainFormat"], [7, 1, 1, "", "Expr"], [7, 1, 1, "", "InsertOp"], [7, 1, 1, "", "LogicalPlan"], [7, 1, 1, "", "Metric"], [7, 1, 1, "", "MetricsSet"], [7, 1, 1, "", "ParquetColumnOptions"], [7, 1, 1, "", "ParquetWriterOptions"], [7, 1, 1, "", "RecordBatch"], [7, 1, 1, "", "RecordBatchStream"], [7, 1, 1, "", "RuntimeEnvBuilder"], [7, 1, 1, "", "SQLOptions"], [7, 1, 1, "", "ScalarUDF"], [7, 1, 1, "", "SessionConfig"], [7, 1, 1, "", "Table"], [7, 1, 1, "", "TableFunction"], [7, 1, 1, "", "TableProviderFactory"], [7, 1, 1, "", "TableProviderFactoryExportable"], [7, 1, 1, "", "WindowFrame"], [7, 1, 1, "", "WindowUDF"], [0, 0, 0, "-", "catalog"], [7, 5, 1, "", "col"], [7, 5, 1, "", "column"], [7, 6, 1, "", "configure_formatter"], [1, 0, 0, "-", "context"], [2, 0, 0, "-", "dataframe"], [3, 0, 0, "-", "dataframe_formatter"], [4, 0, 0, "-", "expr"], [5, 0, 0, "-", "functions"], [9, 0, 0, "-", "input"], [11, 0, 0, "-", "io"], [12, 0, 0, "-", "ipc"], [7, 6, 1, "", "lit"], [7, 6, 1, "", "literal"], [13, 0, 0, "-", "object_store"], [14, 0, 0, "-", "options"], [15, 0, 0, "-", "plan"], [7, 6, 1, "", "read_avro"], [7, 6, 1, "", "read_csv"], [7, 6, 1, "", "read_json"], [7, 6, 1, "", "read_parquet"], [16, 0, 0, "-", "record_batch"], [17, 0, 0, "-", "substrait"], [7, 5, 1, "", "udaf"], [7, 5, 1, "", "udf"], [7, 5, 1, "", "udtf"], [7, 5, 1, "", "udwf"], [18, 0, 0, "-", "unparser"], [19, 0, 0, "-", "user_defined"]], "datafusion.Accumulator": [[7, 2, 1, "", "evaluate"], [7, 2, 1, "", "merge"], [7, 2, 1, "", "state"], [7, 2, 1, "", "update"]], "datafusion.AggregateUDF": [[7, 2, 1, "", "__call__"], [7, 2, 1, "", "__repr__"], [7, 2, 1, "", "_from_internal"], [7, 3, 1, "", "_udaf"], [7, 2, 1, "", "from_pycapsule"], [7, 4, 1, "", "name"], [7, 2, 1, "", "udaf"]], "datafusion.Catalog": [[7, 2, 1, "", "__repr__"], [7, 3, 1, "", "catalog"], [7, 2, 1, "", "deregister_schema"], [7, 2, 1, "", "memory_catalog"], [7, 2, 1, "", "names"], [7, 2, 1, "", "register_schema"], [7, 2, 1, "", "schema"], [7, 2, 1, "", "schema_names"]], "datafusion.CsvReadOptions": [[7, 3, 1, "", "comment"], [7, 3, 1, "", "delimiter"], [7, 3, 1, "", "escape"], [7, 3, 1, "", "file_compression_type"], [7, 3, 1, "", "file_extension"], [7, 3, 1, "", "file_sort_order"], [7, 3, 1, "", "has_header"], [7, 3, 1, "", "newlines_in_values"], [7, 3, 1, "", "null_regex"], [7, 3, 1, "", "quote"], [7, 3, 1, "", "schema"], [7, 3, 1, "", "schema_infer_max_records"], [7, 3, 1, "", "table_partition_cols"], [7, 3, 1, "", "terminator"], [7, 2, 1, "", "to_inner"], [7, 3, 1, "", "truncated_rows"], [7, 2, 1, "", "with_comment"], [7, 2, 1, "", "with_delimiter"], [7, 2, 1, "", "with_escape"], [7, 2, 1, "", "with_file_compression_type"], [7, 2, 1, "", "with_file_extension"], [7, 2, 1, "", "with_file_sort_order"], [7, 2, 1, "", "with_has_header"], [7, 2, 1, "", "with_newlines_in_values"], [7, 2, 1, "", "with_null_regex"], [7, 2, 1, "", "with_quote"], [7, 2, 1, "", "with_schema"], [7, 2, 1, "", "with_schema_infer_max_records"], [7, 2, 1, "", "with_table_partition_cols"], [7, 2, 1, "", "with_terminator"], [7, 2, 1, "", "with_truncated_rows"]], "datafusion.DataFrameWriteOptions": [[7, 3, 1, "", "_raw_write_options"]], "datafusion.ExecutionPlan": [[7, 2, 1, "", "__repr__"], [7, 3, 1, "", "_raw_plan"], [7, 2, 1, "", "children"], [7, 2, 1, "", "collect_metrics"], [7, 2, 1, "", "display"], [7, 2, 1, "", "display_indent"], [7, 2, 1, "", "from_bytes"], [7, 2, 1, "", "from_proto"], [7, 2, 1, "", "metrics"], [7, 4, 1, "", "partition_count"], [7, 2, 1, "", "to_bytes"], [7, 2, 1, "", "to_proto"]], "datafusion.ExplainFormat": [[7, 3, 1, "", "GRAPHVIZ"], [7, 3, 1, "", "INDENT"], [7, 3, 1, "", "PGJSON"], [7, 3, 1, "", "TREE"]], "datafusion.Expr": [[7, 2, 1, "", "__add__"], [7, 2, 1, "", "__and__"], [7, 2, 1, "", "__eq__"], [7, 2, 1, "", "__ge__"], [7, 2, 1, "", "__getitem__"], [7, 2, 1, "", "__gt__"], [7, 2, 1, "", "__invert__"], [7, 2, 1, "", "__le__"], [7, 2, 1, "", "__lt__"], [7, 2, 1, "", "__mod__"], [7, 2, 1, "", "__mul__"], [7, 2, 1, "", "__ne__"], [7, 2, 1, "", "__or__"], [7, 3, 1, "", "__radd__"], [7, 3, 1, "", "__rand__"], [7, 2, 1, "", "__reduce__"], [7, 2, 1, "", "__repr__"], [7, 2, 1, "", "__richcmp__"], [7, 3, 1, "", "__rmod__"], [7, 3, 1, "", "__rmul__"], [7, 3, 1, "", "__ror__"], [7, 3, 1, "", "__rsub__"], [7, 3, 1, "", "__rtruediv__"], [7, 2, 1, "", "__sub__"], [7, 2, 1, "", "__truediv__"], [7, 2, 1, "", "_reconstruct"], [7, 3, 1, "", "_to_pyarrow_types"], [7, 2, 1, "", "abs"], [7, 2, 1, "", "acos"], [7, 2, 1, "", "acosh"], [7, 2, 1, "", "alias"], [7, 2, 1, "", "array_dims"], [7, 2, 1, "", "array_distinct"], [7, 2, 1, "", "array_empty"], [7, 2, 1, "", "array_length"], [7, 2, 1, "", "array_ndims"], [7, 2, 1, "", "array_pop_back"], [7, 2, 1, "", "array_pop_front"], [7, 2, 1, "", "arrow_typeof"], [7, 2, 1, "", "ascii"], [7, 2, 1, "", "asin"], [7, 2, 1, "", "asinh"], [7, 2, 1, "", "atan"], [7, 2, 1, "", "atanh"], [7, 2, 1, "", "between"], [7, 2, 1, "", "bit_length"], [7, 2, 1, "", "btrim"], [7, 2, 1, "", "canonical_name"], [7, 2, 1, "", "cardinality"], [7, 2, 1, "", "cast"], [7, 2, 1, "", "cbrt"], [7, 2, 1, "", "ceil"], [7, 2, 1, "", "char_length"], [7, 2, 1, "", "character_length"], [7, 2, 1, "", "chr"], [7, 2, 1, "", "column"], [7, 2, 1, "", "column_name"], [7, 2, 1, "", "cos"], [7, 2, 1, "", "cosh"], [7, 2, 1, "", "cot"], [7, 2, 1, "", "degrees"], [7, 2, 1, "", "distinct"], [7, 2, 1, "", "empty"], [7, 2, 1, "", "exp"], [7, 3, 1, "", "expr"], [7, 2, 1, "", "factorial"], [7, 2, 1, "", "fill_nan"], [7, 2, 1, "", "fill_null"], [7, 2, 1, "", "filter"], [7, 2, 1, "", "flatten"], [7, 2, 1, "", "floor"], [7, 2, 1, "", "from_bytes"], [7, 2, 1, "", "from_unixtime"], [7, 2, 1, "", "initcap"], [7, 2, 1, "", "is_nan"], [7, 2, 1, "", "is_not_null"], [7, 2, 1, "", "is_null"], [7, 2, 1, "", "isnan"], [7, 2, 1, "", "iszero"], [7, 2, 1, "", "length"], [7, 2, 1, "", "list_dims"], [7, 2, 1, "", "list_distinct"], [7, 2, 1, "", "list_length"], [7, 2, 1, "", "list_ndims"], [7, 2, 1, "", "literal"], [7, 2, 1, "", "literal_with_metadata"], [7, 2, 1, "", "ln"], [7, 2, 1, "", "log10"], [7, 2, 1, "", "log2"], [7, 2, 1, "", "lower"], [7, 2, 1, "", "ltrim"], [7, 2, 1, "", "md5"], [7, 2, 1, "", "null_treatment"], [7, 2, 1, "", "octet_length"], [7, 2, 1, "", "order_by"], [7, 2, 1, "", "over"], [7, 2, 1, "", "partition_by"], [7, 2, 1, "", "python_value"], [7, 2, 1, "", "radians"], [7, 2, 1, "", "reverse"], [7, 2, 1, "", "rex_call_operands"], [7, 2, 1, "", "rex_call_operator"], [7, 2, 1, "", "rex_type"], [7, 2, 1, "", "rtrim"], [7, 2, 1, "", "schema_name"], [7, 2, 1, "", "sha224"], [7, 2, 1, "", "sha256"], [7, 2, 1, "", "sha384"], [7, 2, 1, "", "sha512"], [7, 2, 1, "", "signum"], [7, 2, 1, "", "sin"], [7, 2, 1, "", "sinh"], [7, 2, 1, "", "sort"], [7, 2, 1, "", "sqrt"], [7, 2, 1, "", "string_literal"], [7, 2, 1, "", "tan"], [7, 2, 1, "", "tanh"], [7, 2, 1, "", "to_bytes"], [7, 2, 1, "", "to_hex"], [7, 2, 1, "", "to_variant"], [7, 2, 1, "", "trim"], [7, 2, 1, "", "try_cast"], [7, 2, 1, "", "types"], [7, 2, 1, "", "upper"], [7, 2, 1, "", "variant_name"], [7, 2, 1, "", "window_frame"]], "datafusion.InsertOp": [[7, 3, 1, "", "APPEND"], [7, 3, 1, "", "OVERWRITE"], [7, 3, 1, "", "REPLACE"]], "datafusion.LogicalPlan": [[7, 2, 1, "", "__eq__"], [7, 2, 1, "", "__repr__"], [7, 3, 1, "", "_raw_plan"], [7, 2, 1, "", "display"], [7, 2, 1, "", "display_graphviz"], [7, 2, 1, "", "display_indent"], [7, 2, 1, "", "display_indent_schema"], [7, 2, 1, "", "from_bytes"], [7, 2, 1, "", "from_proto"], [7, 2, 1, "", "inputs"], [7, 2, 1, "", "to_bytes"], [7, 2, 1, "", "to_proto"], [7, 2, 1, "", "to_variant"]], "datafusion.Metric": [[7, 2, 1, "", "__repr__"], [7, 3, 1, "", "_raw"], [7, 2, 1, "", "labels"], [7, 4, 1, "", "name"], [7, 4, 1, "", "partition"], [7, 4, 1, "", "value"], [7, 4, 1, "", "value_as_datetime"]], "datafusion.MetricsSet": [[7, 2, 1, "", "__repr__"], [7, 3, 1, "", "_raw"], [7, 4, 1, "", "elapsed_compute"], [7, 2, 1, "", "metrics"], [7, 4, 1, "", "output_rows"], [7, 4, 1, "", "spill_count"], [7, 4, 1, "", "spilled_bytes"], [7, 4, 1, "", "spilled_rows"], [7, 2, 1, "", "sum_by_name"]], "datafusion.ParquetColumnOptions": [[7, 3, 1, "", "bloom_filter_enabled"], [7, 3, 1, "", "bloom_filter_fpp"], [7, 3, 1, "", "bloom_filter_ndv"], [7, 3, 1, "", "compression"], [7, 3, 1, "", "dictionary_enabled"], [7, 3, 1, "", "encoding"], [7, 3, 1, "", "statistics_enabled"]], "datafusion.ParquetWriterOptions": [[7, 3, 1, "", "allow_single_file_parallelism"], [7, 3, 1, "", "bloom_filter_fpp"], [7, 3, 1, "", "bloom_filter_ndv"], [7, 3, 1, "", "bloom_filter_on_write"], [7, 3, 1, "", "column_index_truncate_length"], [7, 3, 1, "", "column_specific_options"], [7, 3, 1, "", "created_by"], [7, 3, 1, "", "data_page_row_count_limit"], [7, 3, 1, "", "data_pagesize_limit"], [7, 3, 1, "", "dictionary_enabled"], [7, 3, 1, "", "dictionary_page_size_limit"], [7, 3, 1, "", "encoding"], [7, 3, 1, "", "max_row_group_size"], [7, 3, 1, "", "maximum_buffered_record_batches_per_stream"], [7, 3, 1, "", "maximum_parallel_row_group_writers"], [7, 3, 1, "", "skip_arrow_metadata"], [7, 3, 1, "", "statistics_enabled"], [7, 3, 1, "", "statistics_truncate_length"], [7, 3, 1, "", "write_batch_size"], [7, 3, 1, "", "writer_version"]], "datafusion.RecordBatch": [[7, 2, 1, "", "__arrow_c_array__"], [7, 3, 1, "", "record_batch"], [7, 2, 1, "", "to_pyarrow"]], "datafusion.RecordBatchStream": [[7, 2, 1, "", "__aiter__"], [7, 2, 1, "", "__anext__"], [7, 2, 1, "", "__iter__"], [7, 2, 1, "", "__next__"], [7, 2, 1, "", "next"], [7, 3, 1, "", "rbs"]], "datafusion.RuntimeEnvBuilder": [[7, 3, 1, "", "config_internal"], [7, 2, 1, "", "with_disk_manager_disabled"], [7, 2, 1, "", "with_disk_manager_os"], [7, 2, 1, "", "with_disk_manager_specified"], [7, 2, 1, "", "with_fair_spill_pool"], [7, 2, 1, "", "with_greedy_memory_pool"], [7, 2, 1, "", "with_temp_file_path"], [7, 2, 1, "", "with_unbounded_memory_pool"]], "datafusion.SQLOptions": [[7, 3, 1, "", "options_internal"], [7, 2, 1, "", "with_allow_ddl"], [7, 2, 1, "", "with_allow_dml"], [7, 2, 1, "", "with_allow_statements"]], "datafusion.ScalarUDF": [[7, 2, 1, "", "__call__"], [7, 2, 1, "", "__repr__"], [7, 2, 1, "", "_from_internal"], [7, 3, 1, "", "_udf"], [7, 2, 1, "", "from_pycapsule"], [7, 4, 1, "", "name"], [7, 2, 1, "", "udf"]], "datafusion.SessionConfig": [[7, 3, 1, "", "config_internal"], [7, 2, 1, "", "set"], [7, 2, 1, "", "with_batch_size"], [7, 2, 1, "", "with_create_default_catalog_and_schema"], [7, 2, 1, "", "with_default_catalog_and_schema"], [7, 2, 1, "", "with_extension"], [7, 2, 1, "", "with_information_schema"], [7, 2, 1, "", "with_parquet_pruning"], [7, 2, 1, "", "with_repartition_aggregations"], [7, 2, 1, "", "with_repartition_file_min_size"], [7, 2, 1, "", "with_repartition_file_scans"], [7, 2, 1, "", "with_repartition_joins"], [7, 2, 1, "", "with_repartition_sorts"], [7, 2, 1, "", "with_repartition_windows"], [7, 2, 1, "", "with_target_partitions"]], "datafusion.Table": [[7, 2, 1, "", "__repr__"], [7, 3, 1, "", "__slots__"], [7, 3, 1, "", "_inner"], [7, 2, 1, "", "from_dataset"], [7, 4, 1, "", "kind"], [7, 4, 1, "", "schema"]], "datafusion.TableFunction": [[7, 2, 1, "", "__call__"], [7, 2, 1, "", "__repr__"], [7, 2, 1, "", "_create_table_udf"], [7, 2, 1, "", "_create_table_udf_decorator"], [7, 3, 1, "", "_udtf"], [7, 2, 1, "", "udtf"]], "datafusion.TableProviderFactory": [[7, 2, 1, "", "create"]], "datafusion.TableProviderFactoryExportable": [[7, 2, 1, "", "__datafusion_table_provider_factory__"]], "datafusion.WindowFrame": [[7, 2, 1, "", "__repr__"], [7, 2, 1, "", "get_frame_units"], [7, 2, 1, "", "get_lower_bound"], [7, 2, 1, "", "get_upper_bound"], [7, 3, 1, "", "window_frame"]], "datafusion.WindowUDF": [[7, 2, 1, "", "__call__"], [7, 2, 1, "", "__repr__"], [7, 2, 1, "", "_create_window_udf"], [7, 2, 1, "", "_create_window_udf_decorator"], [7, 2, 1, "", "_from_internal"], [7, 2, 1, "", "_get_default_name"], [7, 2, 1, "", "_normalize_input_types"], [7, 3, 1, "", "_udwf"], [7, 2, 1, "", "from_pycapsule"], [7, 4, 1, "", "name"], [7, 2, 1, "", "udwf"]], "datafusion.catalog": [[0, 1, 1, "", "Catalog"], [0, 1, 1, "", "CatalogList"], [0, 1, 1, "", "CatalogProvider"], [0, 1, 1, "", "CatalogProviderList"], [0, 1, 1, "", "Schema"], [0, 1, 1, "", "SchemaProvider"], [0, 1, 1, "", "Table"]], "datafusion.catalog.Catalog": [[0, 2, 1, "", "__repr__"], [0, 3, 1, "", "catalog"], [0, 2, 1, "", "deregister_schema"], [0, 2, 1, "", "memory_catalog"], [0, 2, 1, "", "names"], [0, 2, 1, "", "register_schema"], [0, 2, 1, "", "schema"], [0, 2, 1, "", "schema_names"]], "datafusion.catalog.CatalogList": [[0, 2, 1, "", "__repr__"], [0, 2, 1, "", "catalog"], [0, 3, 1, "", "catalog_list"], [0, 2, 1, "", "catalog_names"], [0, 2, 1, "", "memory_catalog"], [0, 2, 1, "", "names"], [0, 2, 1, "", "register_catalog"]], "datafusion.catalog.CatalogProvider": [[0, 2, 1, "", "deregister_schema"], [0, 2, 1, "", "register_schema"], [0, 2, 1, "", "schema"], [0, 2, 1, "", "schema_names"]], "datafusion.catalog.CatalogProviderList": [[0, 2, 1, "", "catalog"], [0, 2, 1, "", "catalog_names"], [0, 2, 1, "", "register_catalog"]], "datafusion.catalog.Schema": [[0, 2, 1, "", "__repr__"], [0, 3, 1, "", "_raw_schema"], [0, 2, 1, "", "deregister_table"], [0, 2, 1, "", "memory_schema"], [0, 2, 1, "", "names"], [0, 2, 1, "", "register_table"], [0, 2, 1, "", "table"], [0, 2, 1, "", "table_exist"], [0, 2, 1, "", "table_names"]], "datafusion.catalog.SchemaProvider": [[0, 2, 1, "", "deregister_table"], [0, 2, 1, "", "owner_name"], [0, 2, 1, "", "register_table"], [0, 2, 1, "", "table"], [0, 2, 1, "", "table_exist"], [0, 2, 1, "", "table_names"]], "datafusion.catalog.Table": [[0, 2, 1, "", "__repr__"], [0, 3, 1, "", "__slots__"], [0, 3, 1, "", "_inner"], [0, 2, 1, "", "from_dataset"], [0, 4, 1, "", "kind"], [0, 4, 1, "", "schema"]], "datafusion.context": [[1, 1, 1, "", "ArrowArrayExportable"], [1, 1, 1, "", "ArrowStreamExportable"], [1, 1, 1, "", "PhysicalOptimizerRuleExportable"], [1, 1, 1, "", "QueryPlannerExportable"], [1, 1, 1, "", "RuntimeEnvBuilder"], [1, 1, 1, "", "SQLOptions"], [1, 1, 1, "", "SessionConfig"], [1, 1, 1, "", "SessionContext"], [1, 1, 1, "", "TableProviderExportable"]], "datafusion.context.ArrowArrayExportable": [[1, 2, 1, "", "__arrow_c_array__"]], "datafusion.context.ArrowStreamExportable": [[1, 2, 1, "", "__arrow_c_stream__"]], "datafusion.context.PhysicalOptimizerRuleExportable": [[1, 2, 1, "", "__datafusion_physical_optimizer_rule__"]], "datafusion.context.QueryPlannerExportable": [[1, 2, 1, "", "__datafusion_query_planner__"]], "datafusion.context.RuntimeEnvBuilder": [[1, 3, 1, "", "config_internal"], [1, 2, 1, "", "with_disk_manager_disabled"], [1, 2, 1, "", "with_disk_manager_os"], [1, 2, 1, "", "with_disk_manager_specified"], [1, 2, 1, "", "with_fair_spill_pool"], [1, 2, 1, "", "with_greedy_memory_pool"], [1, 2, 1, "", "with_temp_file_path"], [1, 2, 1, "", "with_unbounded_memory_pool"]], "datafusion.context.SQLOptions": [[1, 3, 1, "", "options_internal"], [1, 2, 1, "", "with_allow_ddl"], [1, 2, 1, "", "with_allow_dml"], [1, 2, 1, "", "with_allow_statements"]], "datafusion.context.SessionConfig": [[1, 3, 1, "", "config_internal"], [1, 2, 1, "", "set"], [1, 2, 1, "", "with_batch_size"], [1, 2, 1, "", "with_create_default_catalog_and_schema"], [1, 2, 1, "", "with_default_catalog_and_schema"], [1, 2, 1, "", "with_extension"], [1, 2, 1, "", "with_information_schema"], [1, 2, 1, "", "with_parquet_pruning"], [1, 2, 1, "", "with_repartition_aggregations"], [1, 2, 1, "", "with_repartition_file_min_size"], [1, 2, 1, "", "with_repartition_file_scans"], [1, 2, 1, "", "with_repartition_joins"], [1, 2, 1, "", "with_repartition_sorts"], [1, 2, 1, "", "with_repartition_windows"], [1, 2, 1, "", "with_target_partitions"]], "datafusion.context.SessionContext": [[1, 2, 1, "", "__datafusion_logical_extension_codec__"], [1, 2, 1, "", "__datafusion_physical_extension_codec__"], [1, 2, 1, "", "__datafusion_query_planner__"], [1, 2, 1, "", "__datafusion_task_context_provider__"], [1, 2, 1, "", "__repr__"], [1, 2, 1, "", "_convert_file_sort_order"], [1, 2, 1, "", "_convert_table_partition_cols"], [1, 2, 1, "", "_register_object_store_for_path"], [1, 2, 1, "", "add_physical_optimizer_rule"], [1, 2, 1, "", "catalog"], [1, 2, 1, "", "catalog_names"], [1, 2, 1, "", "copied_config"], [1, 2, 1, "", "create_dataframe"], [1, 2, 1, "", "create_dataframe_from_logical_plan"], [1, 3, 1, "", "ctx"], [1, 2, 1, "", "deregister_object_store"], [1, 2, 1, "", "deregister_table"], [1, 2, 1, "", "deregister_udaf"], [1, 2, 1, "", "deregister_udf"], [1, 2, 1, "", "deregister_udtf"], [1, 2, 1, "", "deregister_udwf"], [1, 2, 1, "", "empty_table"], [1, 2, 1, "", "enable_ident_normalization"], [1, 2, 1, "", "enable_spark_functions"], [1, 2, 1, "", "enable_url_table"], [1, 2, 1, "", "execute"], [1, 2, 1, "", "execute_logical_plan"], [1, 2, 1, "", "from_arrow"], [1, 2, 1, "", "from_pandas"], [1, 2, 1, "", "from_polars"], [1, 2, 1, "", "from_pydict"], [1, 2, 1, "", "from_pylist"], [1, 2, 1, "", "global_ctx"], [1, 2, 1, "", "parse_capacity_limit"], [1, 2, 1, "", "parse_sql_expr"], [1, 2, 1, "", "read_arrow"], [1, 2, 1, "", "read_avro"], [1, 2, 1, "", "read_batch"], [1, 2, 1, "", "read_batches"], [1, 2, 1, "", "read_csv"], [1, 2, 1, "", "read_empty"], [1, 2, 1, "", "read_json"], [1, 2, 1, "", "read_parquet"], [1, 2, 1, "", "read_table"], [1, 2, 1, "", "refresh_catalogs"], [1, 2, 1, "", "register_arrow"], [1, 2, 1, "", "register_avro"], [1, 2, 1, "", "register_batch"], [1, 2, 1, "", "register_catalog_provider"], [1, 2, 1, "", "register_catalog_provider_list"], [1, 2, 1, "", "register_csv"], [1, 2, 1, "", "register_dataset"], [1, 2, 1, "", "register_json"], [1, 2, 1, "", "register_listing_table"], [1, 2, 1, "", "register_object_store"], [1, 2, 1, "", "register_parquet"], [1, 2, 1, "", "register_record_batches"], [1, 2, 1, "", "register_table"], [1, 2, 1, "", "register_table_factory"], [1, 2, 1, "", "register_table_provider"], [1, 2, 1, "", "register_udaf"], [1, 2, 1, "", "register_udf"], [1, 2, 1, "", "register_udtf"], [1, 2, 1, "", "register_udwf"], [1, 2, 1, "", "register_view"], [1, 2, 1, "", "remove_optimizer_rule"], [1, 2, 1, "", "session_id"], [1, 2, 1, "", "session_start_time"], [1, 2, 1, "", "set_query_planner"], [1, 2, 1, "", "sql"], [1, 2, 1, "", "sql_with_options"], [1, 2, 1, "", "table"], [1, 2, 1, "", "table_exist"], [1, 2, 1, "", "table_provider"], [1, 2, 1, "", "udaf"], [1, 2, 1, "", "udafs"], [1, 2, 1, "", "udf"], [1, 2, 1, "", "udfs"], [1, 2, 1, "", "udwf"], [1, 2, 1, "", "udwfs"], [1, 2, 1, "", "with_logical_extension_codec"], [1, 2, 1, "", "with_physical_extension_codec"], [1, 2, 1, "", "with_python_udf_inlining"]], "datafusion.context.TableProviderExportable": [[1, 2, 1, "", "__datafusion_table_provider__"]], "datafusion.dataframe": [[2, 1, 1, "", "Compression"], [2, 1, 1, "", "DataFrame"], [2, 1, 1, "", "DataFrameWriteOptions"], [2, 1, 1, "", "ExplainFormat"], [2, 1, 1, "", "InsertOp"], [2, 1, 1, "", "ParquetColumnOptions"], [2, 1, 1, "", "ParquetWriterOptions"]], "datafusion.dataframe.Compression": [[2, 3, 1, "", "BROTLI"], [2, 3, 1, "", "GZIP"], [2, 3, 1, "", "LZ4"], [2, 3, 1, "", "LZ4_RAW"], [2, 3, 1, "", "SNAPPY"], [2, 3, 1, "", "UNCOMPRESSED"], [2, 3, 1, "", "ZSTD"], [2, 2, 1, "", "from_str"], [2, 2, 1, "", "get_default_level"]], "datafusion.dataframe.DataFrame": [[2, 2, 1, "", "__aiter__"], [2, 2, 1, "", "__arrow_c_stream__"], [2, 2, 1, "", "__getitem__"], [2, 2, 1, "", "__iter__"], [2, 2, 1, "", "__repr__"], [2, 2, 1, "", "_repr_html_"], [2, 2, 1, "", "aggregate"], [2, 2, 1, "", "alias"], [2, 2, 1, "", "cache"], [2, 2, 1, "", "cast"], [2, 2, 1, "", "col"], [2, 2, 1, "", "collect"], [2, 2, 1, "", "collect_column"], [2, 2, 1, "", "collect_partitioned"], [2, 2, 1, "", "column"], [2, 2, 1, "", "count"], [2, 2, 1, "", "default_str_repr"], [2, 2, 1, "", "describe"], [2, 3, 1, "", "df"], [2, 2, 1, "", "distinct"], [2, 2, 1, "", "distinct_on"], [2, 2, 1, "", "drop"], [2, 2, 1, "", "except_all"], [2, 2, 1, "", "execute_stream"], [2, 2, 1, "", "execute_stream_partitioned"], [2, 2, 1, "", "execution_plan"], [2, 2, 1, "", "explain"], [2, 2, 1, "", "fill_null"], [2, 2, 1, "", "filter"], [2, 2, 1, "", "find_qualified_columns"], [2, 2, 1, "", "head"], [2, 2, 1, "", "intersect"], [2, 2, 1, "", "into_view"], [2, 2, 1, "", "join"], [2, 2, 1, "", "join_on"], [2, 2, 1, "", "limit"], [2, 2, 1, "", "logical_plan"], [2, 2, 1, "", "optimized_logical_plan"], [2, 2, 1, "", "parse_sql_expr"], [2, 2, 1, "", "repartition"], [2, 2, 1, "", "repartition_by_hash"], [2, 2, 1, "", "schema"], [2, 2, 1, "", "select"], [2, 2, 1, "", "select_exprs"], [2, 2, 1, "", "show"], [2, 2, 1, "", "sort"], [2, 2, 1, "", "sort_by"], [2, 2, 1, "", "tail"], [2, 2, 1, "", "to_arrow_table"], [2, 2, 1, "", "to_pandas"], [2, 2, 1, "", "to_polars"], [2, 2, 1, "", "to_pydict"], [2, 2, 1, "", "to_pylist"], [2, 2, 1, "", "transform"], [2, 2, 1, "", "union"], [2, 2, 1, "", "union_by_name"], [2, 2, 1, "", "union_distinct"], [2, 2, 1, "", "unnest_columns"], [2, 2, 1, "", "window"], [2, 2, 1, "", "with_column"], [2, 2, 1, "", "with_column_renamed"], [2, 2, 1, "", "with_columns"], [2, 2, 1, "", "write_csv"], [2, 2, 1, "", "write_json"], [2, 2, 1, "", "write_parquet"], [2, 2, 1, "", "write_parquet_with_options"], [2, 2, 1, "", "write_table"]], "datafusion.dataframe.DataFrameWriteOptions": [[2, 3, 1, "", "_raw_write_options"]], "datafusion.dataframe.ExplainFormat": [[2, 3, 1, "", "GRAPHVIZ"], [2, 3, 1, "", "INDENT"], [2, 3, 1, "", "PGJSON"], [2, 3, 1, "", "TREE"]], "datafusion.dataframe.InsertOp": [[2, 3, 1, "", "APPEND"], [2, 3, 1, "", "OVERWRITE"], [2, 3, 1, "", "REPLACE"]], "datafusion.dataframe.ParquetColumnOptions": [[2, 3, 1, "", "bloom_filter_enabled"], [2, 3, 1, "", "bloom_filter_fpp"], [2, 3, 1, "", "bloom_filter_ndv"], [2, 3, 1, "", "compression"], [2, 3, 1, "", "dictionary_enabled"], [2, 3, 1, "", "encoding"], [2, 3, 1, "", "statistics_enabled"]], "datafusion.dataframe.ParquetWriterOptions": [[2, 3, 1, "", "allow_single_file_parallelism"], [2, 3, 1, "", "bloom_filter_fpp"], [2, 3, 1, "", "bloom_filter_ndv"], [2, 3, 1, "", "bloom_filter_on_write"], [2, 3, 1, "", "column_index_truncate_length"], [2, 3, 1, "", "column_specific_options"], [2, 3, 1, "", "created_by"], [2, 3, 1, "", "data_page_row_count_limit"], [2, 3, 1, "", "data_pagesize_limit"], [2, 3, 1, "", "dictionary_enabled"], [2, 3, 1, "", "dictionary_page_size_limit"], [2, 3, 1, "", "encoding"], [2, 3, 1, "", "max_row_group_size"], [2, 3, 1, "", "maximum_buffered_record_batches_per_stream"], [2, 3, 1, "", "maximum_parallel_row_group_writers"], [2, 3, 1, "", "skip_arrow_metadata"], [2, 3, 1, "", "statistics_enabled"], [2, 3, 1, "", "statistics_truncate_length"], [2, 3, 1, "", "write_batch_size"], [2, 3, 1, "", "writer_version"]], "datafusion.dataframe_formatter": [[3, 1, 1, "", "CellFormatter"], [3, 1, 1, "", "DataFrameHtmlFormatter"], [3, 1, 1, "", "DefaultStyleProvider"], [3, 1, 1, "", "FormatterManager"], [3, 1, 1, "", "StyleProvider"], [3, 6, 1, "", "_refresh_formatter_reference"], [3, 6, 1, "", "_validate_bool"], [3, 6, 1, "", "_validate_formatter_parameters"], [3, 6, 1, "", "_validate_positive_int"], [3, 6, 1, "", "configure_formatter"], [3, 6, 1, "", "get_formatter"], [3, 6, 1, "", "reset_formatter"], [3, 6, 1, "", "set_formatter"]], "datafusion.dataframe_formatter.CellFormatter": [[3, 2, 1, "", "__call__"]], "datafusion.dataframe_formatter.DataFrameHtmlFormatter": [[3, 2, 1, "", "_build_expandable_cell"], [3, 2, 1, "", "_build_html_footer"], [3, 2, 1, "", "_build_html_header"], [3, 2, 1, "", "_build_regular_cell"], [3, 2, 1, "", "_build_table_body"], [3, 2, 1, "", "_build_table_container_start"], [3, 2, 1, "", "_build_table_header"], [3, 3, 1, "", "_custom_cell_builder"], [3, 3, 1, "", "_custom_header_builder"], [3, 2, 1, "", "_format_cell_value"], [3, 2, 1, "", "_get_cell_value"], [3, 2, 1, "", "_get_default_css"], [3, 2, 1, "", "_get_javascript"], [3, 3, 1, "", "_max_rows"], [3, 3, 1, "", "_type_formatters"], [3, 3, 1, "", "custom_css"], [3, 3, 1, "", "enable_cell_expansion"], [3, 2, 1, "", "format_html"], [3, 2, 1, "", "format_str"], [3, 3, 1, "", "max_cell_length"], [3, 3, 1, "", "max_height"], [3, 3, 1, "", "max_memory_bytes"], [3, 4, 1, "", "max_rows"], [3, 3, 1, "", "max_width"], [3, 3, 1, "", "min_rows"], [3, 2, 1, "", "register_formatter"], [3, 4, 1, "", "repr_rows"], [3, 2, 1, "", "set_custom_cell_builder"], [3, 2, 1, "", "set_custom_header_builder"], [3, 3, 1, "", "show_truncation_message"], [3, 3, 1, "", "style_provider"], [3, 3, 1, "", "use_shared_styles"]], "datafusion.dataframe_formatter.DefaultStyleProvider": [[3, 2, 1, "", "get_cell_style"], [3, 2, 1, "", "get_header_style"]], "datafusion.dataframe_formatter.FormatterManager": [[3, 3, 1, "", "_default_formatter"], [3, 2, 1, "", "get_formatter"], [3, 2, 1, "", "set_formatter"]], "datafusion.dataframe_formatter.StyleProvider": [[3, 2, 1, "", "get_cell_style"], [3, 2, 1, "", "get_header_style"]], "datafusion.expr": [[4, 5, 1, "", "Aggregate"], [4, 5, 1, "", "AggregateFunction"], [4, 5, 1, "", "Alias"], [4, 5, 1, "", "Analyze"], [4, 5, 1, "", "Between"], [4, 5, 1, "", "BinaryExpr"], [4, 5, 1, "", "Case"], [4, 1, 1, "", "CaseBuilder"], [4, 5, 1, "", "Cast"], [4, 5, 1, "", "Column"], [4, 5, 1, "", "CopyTo"], [4, 5, 1, "", "CreateCatalog"], [4, 5, 1, "", "CreateCatalogSchema"], [4, 5, 1, "", "CreateExternalTable"], [4, 5, 1, "", "CreateFunction"], [4, 5, 1, "", "CreateFunctionBody"], [4, 5, 1, "", "CreateIndex"], [4, 5, 1, "", "CreateMemoryTable"], [4, 5, 1, "", "CreateView"], [4, 5, 1, "", "Deallocate"], [4, 5, 1, "", "DescribeTable"], [4, 5, 1, "", "Distinct"], [4, 5, 1, "", "DmlStatement"], [4, 5, 1, "", "DropCatalogSchema"], [4, 5, 1, "", "DropFunction"], [4, 5, 1, "", "DropTable"], [4, 5, 1, "", "DropView"], [4, 5, 1, "", "EXPR_TYPE_ERROR"], [4, 5, 1, "", "EmptyRelation"], [4, 5, 1, "", "Execute"], [4, 5, 1, "", "Exists"], [4, 5, 1, "", "Explain"], [4, 1, 1, "", "Expr"], [4, 5, 1, "", "Extension"], [4, 5, 1, "", "FileType"], [4, 5, 1, "", "Filter"], [4, 1, 1, "", "GroupingSet"], [4, 5, 1, "", "HigherOrderFunction"], [4, 5, 1, "", "ILike"], [4, 5, 1, "", "InList"], [4, 5, 1, "", "InSubquery"], [4, 5, 1, "", "IsFalse"], [4, 5, 1, "", "IsNotFalse"], [4, 5, 1, "", "IsNotNull"], [4, 5, 1, "", "IsNotTrue"], [4, 5, 1, "", "IsNotUnknown"], [4, 5, 1, "", "IsNull"], [4, 5, 1, "", "IsTrue"], [4, 5, 1, "", "IsUnknown"], [4, 5, 1, "", "Join"], [4, 5, 1, "", "JoinConstraint"], [4, 5, 1, "", "JoinType"], [4, 5, 1, "", "Lambda"], [4, 5, 1, "", "LambdaVariable"], [4, 5, 1, "", "Like"], [4, 5, 1, "", "Limit"], [4, 5, 1, "", "Literal"], [4, 5, 1, "", "Negative"], [4, 5, 1, "", "Not"], [4, 5, 1, "", "OperateFunctionArg"], [4, 5, 1, "", "Partitioning"], [4, 5, 1, "", "Placeholder"], [4, 5, 1, "", "Prepare"], [4, 5, 1, "", "Projection"], [4, 5, 1, "", "RecursiveQuery"], [4, 5, 1, "", "Repartition"], [4, 5, 1, "", "ScalarSubquery"], [4, 5, 1, "", "ScalarVariable"], [4, 5, 1, "", "SetVariable"], [4, 5, 1, "", "SimilarTo"], [4, 5, 1, "", "Sort"], [4, 1, 1, "", "SortExpr"], [4, 5, 1, "", "SortKey"], [4, 5, 1, "", "Subquery"], [4, 5, 1, "", "SubqueryAlias"], [4, 5, 1, "", "TableScan"], [4, 5, 1, "", "TransactionAccessMode"], [4, 5, 1, "", "TransactionConclusion"], [4, 5, 1, "", "TransactionEnd"], [4, 5, 1, "", "TransactionIsolationLevel"], [4, 5, 1, "", "TransactionStart"], [4, 5, 1, "", "TryCast"], [4, 5, 1, "", "Union"], [4, 5, 1, "", "Unnest"], [4, 5, 1, "", "UnnestExpr"], [4, 5, 1, "", "Values"], [4, 1, 1, "", "Window"], [4, 5, 1, "", "WindowExpr"], [4, 1, 1, "", "WindowFrame"], [4, 1, 1, "", "WindowFrameBound"], [4, 6, 1, "", "coerce_to_expr"], [4, 6, 1, "", "coerce_to_expr_list"], [4, 6, 1, "", "coerce_to_expr_or_none"], [4, 6, 1, "", "ensure_expr"], [4, 6, 1, "", "ensure_expr_list"]], "datafusion.expr.CaseBuilder": [[4, 3, 1, "", "case_builder"], [4, 2, 1, "", "end"], [4, 2, 1, "", "otherwise"], [4, 2, 1, "", "when"]], "datafusion.expr.Expr": [[4, 2, 1, "", "__add__"], [4, 2, 1, "", "__and__"], [4, 2, 1, "", "__eq__"], [4, 2, 1, "", "__ge__"], [4, 2, 1, "", "__getitem__"], [4, 2, 1, "", "__gt__"], [4, 2, 1, "", "__invert__"], [4, 2, 1, "", "__le__"], [4, 2, 1, "", "__lt__"], [4, 2, 1, "", "__mod__"], [4, 2, 1, "", "__mul__"], [4, 2, 1, "", "__ne__"], [4, 2, 1, "", "__or__"], [4, 3, 1, "", "__radd__"], [4, 3, 1, "", "__rand__"], [4, 2, 1, "", "__reduce__"], [4, 2, 1, "", "__repr__"], [4, 2, 1, "", "__richcmp__"], [4, 3, 1, "", "__rmod__"], [4, 3, 1, "", "__rmul__"], [4, 3, 1, "", "__ror__"], [4, 3, 1, "", "__rsub__"], [4, 3, 1, "", "__rtruediv__"], [4, 2, 1, "", "__sub__"], [4, 2, 1, "", "__truediv__"], [4, 2, 1, "", "_reconstruct"], [4, 3, 1, "", "_to_pyarrow_types"], [4, 2, 1, "", "abs"], [4, 2, 1, "", "acos"], [4, 2, 1, "", "acosh"], [4, 2, 1, "", "alias"], [4, 2, 1, "", "array_dims"], [4, 2, 1, "", "array_distinct"], [4, 2, 1, "", "array_empty"], [4, 2, 1, "", "array_length"], [4, 2, 1, "", "array_ndims"], [4, 2, 1, "", "array_pop_back"], [4, 2, 1, "", "array_pop_front"], [4, 2, 1, "", "arrow_typeof"], [4, 2, 1, "", "ascii"], [4, 2, 1, "", "asin"], [4, 2, 1, "", "asinh"], [4, 2, 1, "", "atan"], [4, 2, 1, "", "atanh"], [4, 2, 1, "", "between"], [4, 2, 1, "", "bit_length"], [4, 2, 1, "", "btrim"], [4, 2, 1, "", "canonical_name"], [4, 2, 1, "", "cardinality"], [4, 2, 1, "", "cast"], [4, 2, 1, "", "cbrt"], [4, 2, 1, "", "ceil"], [4, 2, 1, "", "char_length"], [4, 2, 1, "", "character_length"], [4, 2, 1, "", "chr"], [4, 2, 1, "", "column"], [4, 2, 1, "", "column_name"], [4, 2, 1, "", "cos"], [4, 2, 1, "", "cosh"], [4, 2, 1, "", "cot"], [4, 2, 1, "", "degrees"], [4, 2, 1, "", "distinct"], [4, 2, 1, "", "empty"], [4, 2, 1, "", "exp"], [4, 3, 1, "", "expr"], [4, 2, 1, "", "factorial"], [4, 2, 1, "", "fill_nan"], [4, 2, 1, "", "fill_null"], [4, 2, 1, "", "filter"], [4, 2, 1, "", "flatten"], [4, 2, 1, "", "floor"], [4, 2, 1, "", "from_bytes"], [4, 2, 1, "", "from_unixtime"], [4, 2, 1, "", "initcap"], [4, 2, 1, "", "is_nan"], [4, 2, 1, "", "is_not_null"], [4, 2, 1, "", "is_null"], [4, 2, 1, "", "isnan"], [4, 2, 1, "", "iszero"], [4, 2, 1, "", "length"], [4, 2, 1, "", "list_dims"], [4, 2, 1, "", "list_distinct"], [4, 2, 1, "", "list_length"], [4, 2, 1, "", "list_ndims"], [4, 2, 1, "", "literal"], [4, 2, 1, "", "literal_with_metadata"], [4, 2, 1, "", "ln"], [4, 2, 1, "", "log10"], [4, 2, 1, "", "log2"], [4, 2, 1, "", "lower"], [4, 2, 1, "", "ltrim"], [4, 2, 1, "", "md5"], [4, 2, 1, "", "null_treatment"], [4, 2, 1, "", "octet_length"], [4, 2, 1, "", "order_by"], [4, 2, 1, "", "over"], [4, 2, 1, "", "partition_by"], [4, 2, 1, "", "python_value"], [4, 2, 1, "", "radians"], [4, 2, 1, "", "reverse"], [4, 2, 1, "", "rex_call_operands"], [4, 2, 1, "", "rex_call_operator"], [4, 2, 1, "", "rex_type"], [4, 2, 1, "", "rtrim"], [4, 2, 1, "", "schema_name"], [4, 2, 1, "", "sha224"], [4, 2, 1, "", "sha256"], [4, 2, 1, "", "sha384"], [4, 2, 1, "", "sha512"], [4, 2, 1, "", "signum"], [4, 2, 1, "", "sin"], [4, 2, 1, "", "sinh"], [4, 2, 1, "", "sort"], [4, 2, 1, "", "sqrt"], [4, 2, 1, "", "string_literal"], [4, 2, 1, "", "tan"], [4, 2, 1, "", "tanh"], [4, 2, 1, "", "to_bytes"], [4, 2, 1, "", "to_hex"], [4, 2, 1, "", "to_variant"], [4, 2, 1, "", "trim"], [4, 2, 1, "", "try_cast"], [4, 2, 1, "", "types"], [4, 2, 1, "", "upper"], [4, 2, 1, "", "variant_name"], [4, 2, 1, "", "window_frame"]], "datafusion.expr.GroupingSet": [[4, 2, 1, "", "cube"], [4, 2, 1, "", "grouping_sets"], [4, 2, 1, "", "rollup"]], "datafusion.expr.SortExpr": [[4, 2, 1, "", "__repr__"], [4, 2, 1, "", "ascending"], [4, 2, 1, "", "expr"], [4, 2, 1, "", "nulls_first"], [4, 3, 1, "", "raw_sort"]], "datafusion.expr.Window": [[4, 3, 1, "", "_null_treatment"], [4, 3, 1, "", "_order_by"], [4, 3, 1, "", "_partition_by"], [4, 3, 1, "", "_window_frame"]], "datafusion.expr.WindowFrame": [[4, 2, 1, "", "__repr__"], [4, 2, 1, "", "get_frame_units"], [4, 2, 1, "", "get_lower_bound"], [4, 2, 1, "", "get_upper_bound"], [4, 3, 1, "", "window_frame"]], "datafusion.expr.WindowFrameBound": [[4, 3, 1, "", "frame_bound"], [4, 2, 1, "", "get_offset"], [4, 2, 1, "", "is_current_row"], [4, 2, 1, "", "is_following"], [4, 2, 1, "", "is_preceding"], [4, 2, 1, "", "is_unbounded"]], "datafusion.functions": [[5, 6, 1, "", "abs"], [5, 6, 1, "", "acos"], [5, 6, 1, "", "acosh"], [5, 6, 1, "", "alias"], [5, 6, 1, "", "any_match"], [5, 6, 1, "", "approx_distinct"], [5, 6, 1, "", "approx_median"], [5, 6, 1, "", "approx_percentile_cont"], [5, 6, 1, "", "approx_percentile_cont_with_weight"], [5, 6, 1, "", "array"], [5, 6, 1, "", "array_agg"], [5, 6, 1, "", "array_any_match"], [5, 6, 1, "", "array_any_value"], [5, 6, 1, "", "array_append"], [5, 6, 1, "", "array_cat"], [5, 6, 1, "", "array_compact"], [5, 6, 1, "", "array_concat"], [5, 6, 1, "", "array_contains"], [5, 6, 1, "", "array_dims"], [5, 6, 1, "", "array_distance"], [5, 6, 1, "", "array_distinct"], [5, 6, 1, "", "array_element"], [5, 6, 1, "", "array_empty"], [5, 6, 1, "", "array_except"], [5, 6, 1, "", "array_extract"], [5, 6, 1, "", "array_filter"], [5, 6, 1, "", "array_has"], [5, 6, 1, "", "array_has_all"], [5, 6, 1, "", "array_has_any"], [5, 6, 1, "", "array_indexof"], [5, 6, 1, "", "array_intersect"], [5, 6, 1, "", "array_join"], [5, 6, 1, "", "array_length"], [5, 6, 1, "", "array_max"], [5, 6, 1, "", "array_min"], [5, 6, 1, "", "array_ndims"], [5, 6, 1, "", "array_normalize"], [5, 6, 1, "", "array_pop_back"], [5, 6, 1, "", "array_pop_front"], [5, 6, 1, "", "array_position"], [5, 6, 1, "", "array_positions"], [5, 6, 1, "", "array_prepend"], [5, 6, 1, "", "array_push_back"], [5, 6, 1, "", "array_push_front"], [5, 6, 1, "", "array_remove"], [5, 6, 1, "", "array_remove_all"], [5, 6, 1, "", "array_remove_n"], [5, 6, 1, "", "array_repeat"], [5, 6, 1, "", "array_replace"], [5, 6, 1, "", "array_replace_all"], [5, 6, 1, "", "array_replace_n"], [5, 6, 1, "", "array_resize"], [5, 6, 1, "", "array_reverse"], [5, 6, 1, "", "array_slice"], [5, 6, 1, "", "array_sort"], [5, 6, 1, "", "array_to_string"], [5, 6, 1, "", "array_transform"], [5, 6, 1, "", "array_union"], [5, 6, 1, "", "arrays_overlap"], [5, 6, 1, "", "arrays_zip"], [5, 6, 1, "", "arrow_cast"], [5, 6, 1, "", "arrow_field"], [5, 6, 1, "", "arrow_metadata"], [5, 6, 1, "", "arrow_try_cast"], [5, 6, 1, "", "arrow_typeof"], [5, 6, 1, "", "ascii"], [5, 6, 1, "", "asin"], [5, 6, 1, "", "asinh"], [5, 6, 1, "", "atan"], [5, 6, 1, "", "atan2"], [5, 6, 1, "", "atanh"], [5, 6, 1, "", "avg"], [5, 6, 1, "", "bit_and"], [5, 6, 1, "", "bit_length"], [5, 6, 1, "", "bit_or"], [5, 6, 1, "", "bit_xor"], [5, 6, 1, "", "bool_and"], [5, 6, 1, "", "bool_or"], [5, 6, 1, "", "btrim"], [5, 6, 1, "", "cardinality"], [5, 6, 1, "", "case"], [5, 6, 1, "", "cast_to_type"], [5, 6, 1, "", "cbrt"], [5, 6, 1, "", "ceil"], [5, 6, 1, "", "char_length"], [5, 6, 1, "", "character_length"], [5, 6, 1, "", "chr"], [5, 6, 1, "", "coalesce"], [5, 6, 1, "", "col"], [5, 6, 1, "", "concat"], [5, 6, 1, "", "concat_ws"], [5, 6, 1, "", "contains"], [5, 6, 1, "", "corr"], [5, 6, 1, "", "cos"], [5, 6, 1, "", "cosh"], [5, 6, 1, "", "cosine_distance"], [5, 6, 1, "", "cot"], [5, 6, 1, "", "count"], [5, 6, 1, "", "count_star"], [5, 6, 1, "", "covar"], [5, 6, 1, "", "covar_pop"], [5, 6, 1, "", "covar_samp"], [5, 6, 1, "", "cume_dist"], [5, 6, 1, "", "current_date"], [5, 6, 1, "", "current_time"], [5, 6, 1, "", "current_timestamp"], [5, 6, 1, "", "date_bin"], [5, 6, 1, "", "date_format"], [5, 6, 1, "", "date_part"], [5, 6, 1, "", "date_trunc"], [5, 6, 1, "", "datepart"], [5, 6, 1, "", "datetrunc"], [5, 6, 1, "", "decode"], [5, 6, 1, "", "degrees"], [5, 6, 1, "", "dense_rank"], [5, 6, 1, "", "digest"], [5, 6, 1, "", "dot_product"], [5, 6, 1, "", "element_at"], [5, 6, 1, "", "empty"], [5, 6, 1, "", "encode"], [5, 6, 1, "", "ends_with"], [5, 6, 1, "", "exp"], [5, 6, 1, "", "extract"], [5, 6, 1, "", "factorial"], [5, 6, 1, "", "find_in_set"], [5, 6, 1, "", "first_value"], [5, 6, 1, "", "flatten"], [5, 6, 1, "", "floor"], [5, 6, 1, "", "from_unixtime"], [5, 6, 1, "", "gcd"], [5, 6, 1, "", "gen_series"], [5, 6, 1, "", "generate_series"], [5, 6, 1, "", "get_field"], [5, 6, 1, "", "greatest"], [5, 6, 1, "", "grouping"], [5, 6, 1, "", "ifnull"], [5, 6, 1, "", "in_list"], [5, 6, 1, "", "initcap"], [5, 6, 1, "", "inner_product"], [5, 6, 1, "", "instr"], [5, 6, 1, "", "is_nan"], [5, 6, 1, "", "isnan"], [5, 6, 1, "", "iszero"], [5, 6, 1, "", "lag"], [5, 6, 1, "", "lambda_"], [5, 6, 1, "", "lambda_var"], [5, 6, 1, "", "last_value"], [5, 6, 1, "", "lcm"], [5, 6, 1, "", "lead"], [5, 6, 1, "", "least"], [5, 6, 1, "", "left"], [5, 6, 1, "", "length"], [5, 6, 1, "", "levenshtein"], [5, 6, 1, "", "list_any_match"], [5, 6, 1, "", "list_any_value"], [5, 6, 1, "", "list_append"], [5, 6, 1, "", "list_cat"], [5, 6, 1, "", "list_compact"], [5, 6, 1, "", "list_concat"], [5, 6, 1, "", "list_contains"], [5, 6, 1, "", "list_dims"], [5, 6, 1, "", "list_distance"], [5, 6, 1, "", "list_distinct"], [5, 6, 1, "", "list_element"], [5, 6, 1, "", "list_empty"], [5, 6, 1, "", "list_except"], [5, 6, 1, "", "list_extract"], [5, 6, 1, "", "list_filter"], [5, 6, 1, "", "list_has"], [5, 6, 1, "", "list_has_all"], [5, 6, 1, "", "list_has_any"], [5, 6, 1, "", "list_indexof"], [5, 6, 1, "", "list_intersect"], [5, 6, 1, "", "list_join"], [5, 6, 1, "", "list_length"], [5, 6, 1, "", "list_max"], [5, 6, 1, "", "list_min"], [5, 6, 1, "", "list_ndims"], [5, 6, 1, "", "list_normalize"], [5, 6, 1, "", "list_overlap"], [5, 6, 1, "", "list_pop_back"], [5, 6, 1, "", "list_pop_front"], [5, 6, 1, "", "list_position"], [5, 6, 1, "", "list_positions"], [5, 6, 1, "", "list_prepend"], [5, 6, 1, "", "list_push_back"], [5, 6, 1, "", "list_push_front"], [5, 6, 1, "", "list_remove"], [5, 6, 1, "", "list_remove_all"], [5, 6, 1, "", "list_remove_n"], [5, 6, 1, "", "list_repeat"], [5, 6, 1, "", "list_replace"], [5, 6, 1, "", "list_replace_all"], [5, 6, 1, "", "list_replace_n"], [5, 6, 1, "", "list_resize"], [5, 6, 1, "", "list_reverse"], [5, 6, 1, "", "list_slice"], [5, 6, 1, "", "list_sort"], [5, 6, 1, "", "list_to_string"], [5, 6, 1, "", "list_transform"], [5, 6, 1, "", "list_union"], [5, 6, 1, "", "list_zip"], [5, 6, 1, "", "ln"], [5, 6, 1, "", "log"], [5, 6, 1, "", "log10"], [5, 6, 1, "", "log2"], [5, 6, 1, "", "lower"], [5, 6, 1, "", "lpad"], [5, 6, 1, "", "ltrim"], [5, 6, 1, "", "make_array"], [5, 6, 1, "", "make_date"], [5, 6, 1, "", "make_list"], [5, 6, 1, "", "make_map"], [5, 6, 1, "", "make_time"], [5, 6, 1, "", "map_entries"], [5, 6, 1, "", "map_extract"], [5, 6, 1, "", "map_keys"], [5, 6, 1, "", "map_values"], [5, 6, 1, "", "max"], [5, 6, 1, "", "md5"], [5, 6, 1, "", "mean"], [5, 6, 1, "", "median"], [5, 6, 1, "", "min"], [5, 6, 1, "", "named_struct"], [5, 6, 1, "", "nanvl"], [5, 6, 1, "", "now"], [5, 6, 1, "", "nth_value"], [5, 6, 1, "", "ntile"], [5, 6, 1, "", "nullif"], [5, 6, 1, "", "nvl"], [5, 6, 1, "", "nvl2"], [5, 6, 1, "", "octet_length"], [5, 6, 1, "", "order_by"], [5, 6, 1, "", "overlay"], [5, 6, 1, "", "percent_rank"], [5, 6, 1, "", "percentile_cont"], [5, 6, 1, "", "pi"], [5, 6, 1, "", "position"], [5, 6, 1, "", "pow"], [5, 6, 1, "", "power"], [5, 6, 1, "", "quantile_cont"], [5, 6, 1, "", "radians"], [5, 6, 1, "", "random"], [5, 6, 1, "", "range"], [5, 6, 1, "", "rank"], [5, 6, 1, "", "regexp_count"], [5, 6, 1, "", "regexp_instr"], [5, 6, 1, "", "regexp_like"], [5, 6, 1, "", "regexp_match"], [5, 6, 1, "", "regexp_replace"], [5, 6, 1, "", "regr_avgx"], [5, 6, 1, "", "regr_avgy"], [5, 6, 1, "", "regr_count"], [5, 6, 1, "", "regr_intercept"], [5, 6, 1, "", "regr_r2"], [5, 6, 1, "", "regr_slope"], [5, 6, 1, "", "regr_sxx"], [5, 6, 1, "", "regr_sxy"], [5, 6, 1, "", "regr_syy"], [5, 6, 1, "", "repeat"], [5, 6, 1, "", "replace"], [5, 6, 1, "", "reverse"], [5, 6, 1, "", "right"], [5, 6, 1, "", "round"], [5, 6, 1, "", "row"], [5, 6, 1, "", "row_number"], [5, 6, 1, "", "rpad"], [5, 6, 1, "", "rtrim"], [5, 6, 1, "", "sha224"], [5, 6, 1, "", "sha256"], [5, 6, 1, "", "sha384"], [5, 6, 1, "", "sha512"], [5, 6, 1, "", "signum"], [5, 6, 1, "", "sin"], [5, 6, 1, "", "sinh"], [6, 0, 0, "-", "spark"], [5, 6, 1, "", "split_part"], [5, 6, 1, "", "sqrt"], [5, 6, 1, "", "starts_with"], [5, 6, 1, "", "stddev"], [5, 6, 1, "", "stddev_pop"], [5, 6, 1, "", "stddev_samp"], [5, 6, 1, "", "string_agg"], [5, 6, 1, "", "string_to_array"], [5, 6, 1, "", "string_to_list"], [5, 6, 1, "", "strpos"], [5, 6, 1, "", "struct"], [5, 6, 1, "", "substr"], [5, 6, 1, "", "substr_index"], [5, 6, 1, "", "substring"], [5, 6, 1, "", "sum"], [5, 6, 1, "", "tan"], [5, 6, 1, "", "tanh"], [5, 6, 1, "", "to_char"], [5, 6, 1, "", "to_date"], [5, 6, 1, "", "to_hex"], [5, 6, 1, "", "to_local_time"], [5, 6, 1, "", "to_time"], [5, 6, 1, "", "to_timestamp"], [5, 6, 1, "", "to_timestamp_micros"], [5, 6, 1, "", "to_timestamp_millis"], [5, 6, 1, "", "to_timestamp_nanos"], [5, 6, 1, "", "to_timestamp_seconds"], [5, 6, 1, "", "to_unixtime"], [5, 5, 1, "", "today"], [5, 6, 1, "", "translate"], [5, 6, 1, "", "trim"], [5, 6, 1, "", "trunc"], [5, 6, 1, "", "try_cast_to_type"], [5, 6, 1, "", "union_extract"], [5, 6, 1, "", "union_tag"], [5, 6, 1, "", "upper"], [5, 6, 1, "", "uuid"], [5, 6, 1, "", "var"], [5, 6, 1, "", "var_pop"], [5, 6, 1, "", "var_population"], [5, 6, 1, "", "var_samp"], [5, 6, 1, "", "var_sample"], [5, 6, 1, "", "version"], [5, 6, 1, "", "when"], [5, 6, 1, "", "with_metadata"]], "datafusion.functions.spark": [[6, 6, 1, "", "abs"], [6, 6, 1, "", "add_months"], [6, 6, 1, "", "array"], [6, 6, 1, "", "array_contains"], [6, 6, 1, "", "array_repeat"], [6, 6, 1, "", "ascii"], [6, 6, 1, "", "avg"], [6, 6, 1, "", "base64"], [6, 6, 1, "", "bin"], [6, 6, 1, "", "bit_count"], [6, 6, 1, "", "bit_get"], [6, 6, 1, "", "bitmap_bit_position"], [6, 6, 1, "", "bitmap_bucket_number"], [6, 6, 1, "", "bitmap_count"], [6, 6, 1, "", "bitwise_not"], [6, 6, 1, "", "ceil"], [6, 6, 1, "", "char"], [6, 6, 1, "", "collect_list"], [6, 6, 1, "", "collect_set"], [6, 6, 1, "", "concat"], [6, 6, 1, "", "crc32"], [6, 6, 1, "", "csc"], [6, 6, 1, "", "date_add"], [6, 6, 1, "", "date_diff"], [6, 6, 1, "", "date_part"], [6, 6, 1, "", "date_sub"], [6, 6, 1, "", "date_trunc"], [6, 6, 1, "", "elt"], [6, 6, 1, "", "expm1"], [6, 6, 1, "", "factorial"], [6, 6, 1, "", "floor"], [6, 6, 1, "", "format_string"], [6, 6, 1, "", "from_utc_timestamp"], [6, 6, 1, "", "hex"], [6, 6, 1, "", "hour"], [6, 6, 1, "", "if_"], [6, 6, 1, "", "ilike"], [6, 6, 1, "", "is_valid_utf8"], [6, 6, 1, "", "json_tuple"], [6, 6, 1, "", "last_day"], [6, 6, 1, "", "length"], [6, 6, 1, "", "like"], [6, 6, 1, "", "luhn_check"], [6, 6, 1, "", "make_dt_interval"], [6, 6, 1, "", "make_interval"], [6, 6, 1, "", "make_valid_utf8"], [6, 6, 1, "", "map_from_arrays"], [6, 6, 1, "", "map_from_entries"], [6, 6, 1, "", "minute"], [6, 6, 1, "", "modulus"], [6, 6, 1, "", "negative"], [6, 6, 1, "", "next_day"], [6, 6, 1, "", "parse_url"], [6, 6, 1, "", "pmod"], [6, 6, 1, "", "rint"], [6, 6, 1, "", "round"], [6, 6, 1, "", "sec"], [6, 6, 1, "", "second"], [6, 6, 1, "", "sha1"], [6, 6, 1, "", "sha2"], [6, 6, 1, "", "shiftleft"], [6, 6, 1, "", "shiftright"], [6, 6, 1, "", "shiftrightunsigned"], [6, 6, 1, "", "shuffle"], [6, 6, 1, "", "size"], [6, 6, 1, "", "slice"], [6, 6, 1, "", "soundex"], [6, 6, 1, "", "space"], [6, 6, 1, "", "spark_cast"], [6, 6, 1, "", "str_to_map"], [6, 6, 1, "", "substring"], [6, 6, 1, "", "time_trunc"], [6, 6, 1, "", "to_utc_timestamp"], [6, 6, 1, "", "trunc"], [6, 6, 1, "", "try_parse_url"], [6, 6, 1, "", "try_sum"], [6, 6, 1, "", "try_url_decode"], [6, 6, 1, "", "unbase64"], [6, 6, 1, "", "unhex"], [6, 6, 1, "", "unix_date"], [6, 6, 1, "", "unix_micros"], [6, 6, 1, "", "unix_millis"], [6, 6, 1, "", "unix_seconds"], [6, 6, 1, "", "url_decode"], [6, 6, 1, "", "url_encode"], [6, 6, 1, "", "width_bucket"], [6, 6, 1, "", "xxhash64"]], "datafusion.input": [[9, 1, 1, "", "LocationInputPlugin"], [8, 0, 0, "-", "base"], [10, 0, 0, "-", "location"]], "datafusion.input.LocationInputPlugin": [[9, 2, 1, "", "build_table"], [9, 2, 1, "", "is_correct_input"]], "datafusion.input.base": [[8, 1, 1, "", "BaseInputSource"]], "datafusion.input.base.BaseInputSource": [[8, 2, 1, "", "build_table"], [8, 2, 1, "", "is_correct_input"]], "datafusion.input.location": [[10, 1, 1, "", "LocationInputPlugin"]], "datafusion.input.location.LocationInputPlugin": [[10, 2, 1, "", "build_table"], [10, 2, 1, "", "is_correct_input"]], "datafusion.io": [[11, 6, 1, "", "read_avro"], [11, 6, 1, "", "read_csv"], [11, 6, 1, "", "read_json"], [11, 6, 1, "", "read_parquet"]], "datafusion.ipc": [[12, 6, 1, "", "clear_sender_ctx"], [12, 6, 1, "", "clear_worker_ctx"], [12, 6, 1, "", "get_sender_ctx"], [12, 6, 1, "", "get_worker_ctx"], [12, 6, 1, "", "set_sender_ctx"], [12, 6, 1, "", "set_worker_ctx"]], "datafusion.object_store": [[13, 5, 1, "", "AmazonS3"], [13, 5, 1, "", "GoogleCloud"], [13, 5, 1, "", "Http"], [13, 5, 1, "", "LocalFileSystem"], [13, 5, 1, "", "MicrosoftAzure"]], "datafusion.options": [[14, 1, 1, "", "CsvReadOptions"]], "datafusion.options.CsvReadOptions": [[14, 3, 1, "", "comment"], [14, 3, 1, "", "delimiter"], [14, 3, 1, "", "escape"], [14, 3, 1, "", "file_compression_type"], [14, 3, 1, "", "file_extension"], [14, 3, 1, "", "file_sort_order"], [14, 3, 1, "", "has_header"], [14, 3, 1, "", "newlines_in_values"], [14, 3, 1, "", "null_regex"], [14, 3, 1, "", "quote"], [14, 3, 1, "", "schema"], [14, 3, 1, "", "schema_infer_max_records"], [14, 3, 1, "", "table_partition_cols"], [14, 3, 1, "", "terminator"], [14, 2, 1, "", "to_inner"], [14, 3, 1, "", "truncated_rows"], [14, 2, 1, "", "with_comment"], [14, 2, 1, "", "with_delimiter"], [14, 2, 1, "", "with_escape"], [14, 2, 1, "", "with_file_compression_type"], [14, 2, 1, "", "with_file_extension"], [14, 2, 1, "", "with_file_sort_order"], [14, 2, 1, "", "with_has_header"], [14, 2, 1, "", "with_newlines_in_values"], [14, 2, 1, "", "with_null_regex"], [14, 2, 1, "", "with_quote"], [14, 2, 1, "", "with_schema"], [14, 2, 1, "", "with_schema_infer_max_records"], [14, 2, 1, "", "with_table_partition_cols"], [14, 2, 1, "", "with_terminator"], [14, 2, 1, "", "with_truncated_rows"]], "datafusion.plan": [[15, 1, 1, "", "ExecutionPlan"], [15, 1, 1, "", "LogicalPlan"], [15, 1, 1, "", "Metric"], [15, 1, 1, "", "MetricsSet"]], "datafusion.plan.ExecutionPlan": [[15, 2, 1, "", "__repr__"], [15, 3, 1, "", "_raw_plan"], [15, 2, 1, "", "children"], [15, 2, 1, "", "collect_metrics"], [15, 2, 1, "", "display"], [15, 2, 1, "", "display_indent"], [15, 2, 1, "", "from_bytes"], [15, 2, 1, "", "from_proto"], [15, 2, 1, "", "metrics"], [15, 4, 1, "", "partition_count"], [15, 2, 1, "", "to_bytes"], [15, 2, 1, "", "to_proto"]], "datafusion.plan.LogicalPlan": [[15, 2, 1, "", "__eq__"], [15, 2, 1, "", "__repr__"], [15, 3, 1, "", "_raw_plan"], [15, 2, 1, "", "display"], [15, 2, 1, "", "display_graphviz"], [15, 2, 1, "", "display_indent"], [15, 2, 1, "", "display_indent_schema"], [15, 2, 1, "", "from_bytes"], [15, 2, 1, "", "from_proto"], [15, 2, 1, "", "inputs"], [15, 2, 1, "", "to_bytes"], [15, 2, 1, "", "to_proto"], [15, 2, 1, "", "to_variant"]], "datafusion.plan.Metric": [[15, 2, 1, "", "__repr__"], [15, 3, 1, "", "_raw"], [15, 2, 1, "", "labels"], [15, 4, 1, "", "name"], [15, 4, 1, "", "partition"], [15, 4, 1, "", "value"], [15, 4, 1, "", "value_as_datetime"]], "datafusion.plan.MetricsSet": [[15, 2, 1, "", "__repr__"], [15, 3, 1, "", "_raw"], [15, 4, 1, "", "elapsed_compute"], [15, 2, 1, "", "metrics"], [15, 4, 1, "", "output_rows"], [15, 4, 1, "", "spill_count"], [15, 4, 1, "", "spilled_bytes"], [15, 4, 1, "", "spilled_rows"], [15, 2, 1, "", "sum_by_name"]], "datafusion.record_batch": [[16, 1, 1, "", "RecordBatch"], [16, 1, 1, "", "RecordBatchStream"]], "datafusion.record_batch.RecordBatch": [[16, 2, 1, "", "__arrow_c_array__"], [16, 3, 1, "", "record_batch"], [16, 2, 1, "", "to_pyarrow"]], "datafusion.record_batch.RecordBatchStream": [[16, 2, 1, "", "__aiter__"], [16, 2, 1, "", "__anext__"], [16, 2, 1, "", "__iter__"], [16, 2, 1, "", "__next__"], [16, 2, 1, "", "next"], [16, 3, 1, "", "rbs"]], "datafusion.substrait": [[17, 1, 1, "", "Consumer"], [17, 1, 1, "", "Plan"], [17, 1, 1, "", "Producer"], [17, 1, 1, "", "Serde"]], "datafusion.substrait.Consumer": [[17, 2, 1, "", "from_substrait_plan"]], "datafusion.substrait.Plan": [[17, 2, 1, "", "encode"], [17, 2, 1, "", "from_json"], [17, 3, 1, "", "plan_internal"], [17, 2, 1, "", "to_json"]], "datafusion.substrait.Producer": [[17, 2, 1, "", "to_substrait_plan"]], "datafusion.substrait.Serde": [[17, 2, 1, "", "deserialize"], [17, 2, 1, "", "deserialize_bytes"], [17, 2, 1, "", "serialize"], [17, 2, 1, "", "serialize_bytes"], [17, 2, 1, "", "serialize_to_plan"]], "datafusion.unparser": [[18, 1, 1, "", "Dialect"], [18, 1, 1, "", "Unparser"]], "datafusion.unparser.Dialect": [[18, 2, 1, "", "default"], [18, 3, 1, "", "dialect"], [18, 2, 1, "", "duckdb"], [18, 2, 1, "", "mysql"], [18, 2, 1, "", "postgres"], [18, 2, 1, "", "sqlite"]], "datafusion.unparser.Unparser": [[18, 2, 1, "", "plan_to_sql"], [18, 3, 1, "", "unparser"], [18, 2, 1, "", "with_pretty"]], "datafusion.user_defined": [[19, 1, 1, "", "Accumulator"], [19, 1, 1, "", "AggregateUDF"], [19, 1, 1, "", "AggregateUDFExportable"], [19, 1, 1, "", "LogicalExtensionCodecExportable"], [19, 1, 1, "", "PhysicalExtensionCodecExportable"], [19, 1, 1, "", "ScalarUDF"], [19, 1, 1, "", "ScalarUDFExportable"], [19, 1, 1, "", "TableFunction"], [19, 1, 1, "", "Volatility"], [19, 1, 1, "", "WindowEvaluator"], [19, 1, 1, "", "WindowUDF"], [19, 1, 1, "", "WindowUDFExportable"], [19, 5, 1, "", "_R"], [19, 6, 1, "", "_is_pycapsule"], [19, 6, 1, "", "_wrap_session_kwarg_for_udtf"], [19, 6, 1, "", "data_type_or_field_to_field"], [19, 6, 1, "", "data_types_or_fields_to_field_list"], [19, 5, 1, "", "udaf"], [19, 5, 1, "", "udf"], [19, 5, 1, "", "udtf"], [19, 5, 1, "", "udwf"]], "datafusion.user_defined.Accumulator": [[19, 2, 1, "", "evaluate"], [19, 2, 1, "", "merge"], [19, 2, 1, "", "state"], [19, 2, 1, "", "update"]], "datafusion.user_defined.AggregateUDF": [[19, 2, 1, "", "__call__"], [19, 2, 1, "", "__repr__"], [19, 2, 1, "", "_from_internal"], [19, 3, 1, "", "_udaf"], [19, 2, 1, "", "from_pycapsule"], [19, 4, 1, "", "name"], [19, 2, 1, "", "udaf"]], "datafusion.user_defined.AggregateUDFExportable": [[19, 2, 1, "", "__datafusion_aggregate_udf__"]], "datafusion.user_defined.LogicalExtensionCodecExportable": [[19, 2, 1, "", "__datafusion_logical_extension_codec__"]], "datafusion.user_defined.PhysicalExtensionCodecExportable": [[19, 2, 1, "", "__datafusion_physical_extension_codec__"]], "datafusion.user_defined.ScalarUDF": [[19, 2, 1, "", "__call__"], [19, 2, 1, "", "__repr__"], [19, 2, 1, "", "_from_internal"], [19, 3, 1, "", "_udf"], [19, 2, 1, "", "from_pycapsule"], [19, 4, 1, "", "name"], [19, 2, 1, "", "udf"]], "datafusion.user_defined.ScalarUDFExportable": [[19, 2, 1, "", "__datafusion_scalar_udf__"]], "datafusion.user_defined.TableFunction": [[19, 2, 1, "", "__call__"], [19, 2, 1, "", "__repr__"], [19, 2, 1, "", "_create_table_udf"], [19, 2, 1, "", "_create_table_udf_decorator"], [19, 3, 1, "", "_udtf"], [19, 2, 1, "", "udtf"]], "datafusion.user_defined.Volatility": [[19, 3, 1, "", "Immutable"], [19, 3, 1, "", "Stable"], [19, 3, 1, "", "Volatile"], [19, 2, 1, "", "__str__"]], "datafusion.user_defined.WindowEvaluator": [[19, 2, 1, "", "evaluate"], [19, 2, 1, "", "evaluate_all"], [19, 2, 1, "", "evaluate_all_with_rank"], [19, 2, 1, "", "get_range"], [19, 2, 1, "", "include_rank"], [19, 2, 1, "", "is_causal"], [19, 2, 1, "", "memoize"], [19, 2, 1, "", "supports_bounded_execution"], [19, 2, 1, "", "uses_window_frame"]], "datafusion.user_defined.WindowUDF": [[19, 2, 1, "", "__call__"], [19, 2, 1, "", "__repr__"], [19, 2, 1, "", "_create_window_udf"], [19, 2, 1, "", "_create_window_udf_decorator"], [19, 2, 1, "", "_from_internal"], [19, 2, 1, "", "_get_default_name"], [19, 2, 1, "", "_normalize_input_types"], [19, 3, 1, "", "_udwf"], [19, 2, 1, "", "from_pycapsule"], [19, 4, 1, "", "name"], [19, 2, 1, "", "udwf"]], "datafusion.user_defined.WindowUDFExportable": [[19, 2, 1, "", "__datafusion_window_udf__"]]}, "objnames": {"0": ["py", "module", "Python module"], "1": ["py", "class", "Python class"], "2": ["py", "method", "Python method"], "3": ["py", "attribute", "Python attribute"], "4": ["py", "property", "Python property"], "5": ["py", "data", "Python data"], "6": ["py", "function", "Python function"]}, "objtypes": {"0": "py:module", "1": "py:class", "2": "py:method", "3": "py:attribute", "4": "py:property", "5": "py:data", "6": "py:function"}, "terms": {"": [1, 2, 3, 4, 5, 6, 7, 12, 14, 15, 19, 23, 26, 30, 31, 33, 35, 36, 37, 38, 39, 40, 41, 42, 44], "0": [1, 2, 4, 5, 6, 7, 15, 19, 27, 28, 29, 30, 31, 33, 34, 35, 36, 38, 39, 40, 41, 43, 44, 45, 46, 53, 54], "00": [1, 5, 6], "0000": 6, "007bff": 43, "01": [1, 5, 6, 27, 31, 34], "01t00": [5, 31], "01t12": 1, "038": 39, "04023": 5, "05": [31, 34], "05263157894737": 28, "06": [31, 34], "07": 5, "08": 31, "08695652173913": 28, "09": [27, 31], "1": [1, 2, 4, 5, 6, 7, 12, 15, 19, 20, 23, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 44, 46, 47, 54], "10": [1, 2, 3, 4, 5, 6, 7, 19, 24, 27, 30, 31, 33, 34, 36, 37, 38, 39, 40, 43, 44, 46, 54], "100": [3, 5, 24, 27, 28, 36, 38, 40, 41, 42, 46, 54], "1000": [1, 3, 7, 11, 14, 29, 43], "10000000": 39, "100m": 1, "101": 28, "102": 28, "1024": [1, 2, 3, 7, 43], "103": [24, 28, 40, 46], "104": [24, 40, 46, 54], "1048576": [1, 2, 7], "105": [24, 28, 40, 46], "107": 39, "109": [24, 40, 46, 54], "11": [2, 4, 7, 19, 24, 27, 31, 40, 44, 46], "110": 28, "111": [6, 24, 40, 46, 54], "112": 28, "115": [24, 28, 40, 46], "12": [2, 4, 5, 6, 7, 19, 23, 24, 27, 28, 31, 36, 40, 44, 46], "120": [5, 6, 24, 28, 40, 46], "121": 28, "122": [5, 24, 40, 46], "123": [24, 40, 46, 54], "123456789": 1, "12371": 5, "125": [5, 28, 31, 54], "128": [4, 5, 7], "13": [24, 28, 30, 31, 40, 44, 46], "130": [24, 28, 40, 46, 54], "134": 38, "135": [24, 40, 46], "14": [5, 6, 24, 27, 28, 31, 34, 40, 46], "140": 28, "14285714285714": 28, "145": [24, 28, 40, 46], "149": 54, "14h30m00": 5, "15": [5, 6, 24, 27, 28, 30, 31, 34, 38, 40, 46], "150": [24, 28, 36, 40, 46], "1579098645": 6, "1579098645000": 6, "1579098645000000": 6, "158": 54, "159": [24, 40, 46, 54], "15t00": 5, "15t12": 5, "15t14": 6, "16": [5, 7, 19, 27, 31, 39], "160": 54, "161": 54, "162": 54, "163": [28, 54], "165": [31, 54], "166666666666664": 28, "17": [27, 31, 38], "18": [27, 30, 31, 38], "180": 5, "18276": 6, "19": [31, 54], "190": 54, "1902": 5, "1921": 31, "195": [24, 40, 46], "1957120628132": 29, "1970": [5, 6, 31], "1m": [1, 2, 7], "1px": 43, "2": [1, 2, 3, 4, 5, 6, 7, 19, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 40, 41, 42, 43, 44, 46, 47, 54], "20": [1, 2, 4, 5, 6, 7, 19, 24, 28, 30, 31, 33, 37, 38, 40, 43, 44, 46, 54], "200": [28, 41, 54], "20000": [2, 7], "2001": 5, "201": 28, "2020": 6, "2021": [5, 27], "2023": 5, "2024": 5, "2026": [1, 31], "205": [24, 40, 46], "2097152": [3, 43], "20b": 6, "21": [7, 19, 27, 28, 30, 31, 38, 42], "21411": 5, "219": 29, "22": [2, 7, 19, 28, 40], "223": 54, "224": [4, 5, 6, 7], "229": 54, "23": [27, 28, 36, 38, 54], "23076923076923": 28, "2345": 5, "24": 27, "247": 5, "24762": 21, "25": [3, 5, 24, 28, 31, 36, 38, 40, 42, 43, 46], "255": [5, 6], "256": [1, 4, 5, 6, 7, 35], "25806451612904": 28, "26": [7, 19, 38], "261": 29, "27": [5, 28, 30], "2743272264": 6, "28": [27, 38], "28571428571429": 28, "28t21": 31, "290": 7, "2cf24dba5fb0a30e26e83b2ac5b9e29e1b161e5c1fa7425e73043362938b9824": [1, 5, 6], "2f": 43, "2mb": [3, 43], "3": [1, 2, 4, 5, 6, 7, 19, 23, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 40, 41, 42, 46, 47, 54], "30": [1, 2, 4, 5, 6, 7, 19, 24, 28, 30, 33, 37, 38, 40, 44, 46], "300": [3, 28, 43], "309": [24, 31, 40, 46], "31": 6, "314": [24, 31, 40, 46], "318": [24, 31, 40, 46], "32": 5, "33": 27, "333": 43, "33333333333333": 28, "333333333333332": 38, "333333333333336": 28, "3339": 1, "34": [1, 5, 31], "345": 6, "35": [6, 24, 27, 28, 34, 38, 40, 46], "36": [5, 27], "360": 5, "384": [4, 5, 6, 7], "39": [24, 40, 46, 54], "395": [24, 40, 46], "3rd": 5, "3x": 39, "4": [1, 2, 4, 5, 6, 7, 19, 24, 27, 28, 29, 30, 31, 34, 36, 37, 38, 40, 42, 43, 44, 46, 47, 54], "40": [2, 5, 23, 24, 28, 33, 37, 40, 44, 46], "400": 28, "401": 28, "405": [24, 31, 40, 46], "4096": 55, "41": 5, "4111111111111111": 6, "42": [5, 6, 28, 30, 40], "43": [24, 38, 40, 46, 53], "4367754540140381902": 6, "44": [24, 40, 46], "447868236": 31, "45": [6, 24, 31, 38, 40, 46], "4579": 31, "46511627906976": 28, "47": 28, "4732": 31, "48": [24, 28, 40, 46], "49": [24, 30, 40, 46], "495": [24, 40, 46], "4f": 6, "4mb": 43, "5": [2, 4, 5, 6, 7, 19, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 40, 42, 46, 47, 54], "50": [3, 5, 7, 24, 28, 33, 37, 38, 40, 41, 43, 46], "500": [3, 7], "500000": 6, "5000000": 39, "51": [27, 28, 33, 54], "512": [4, 5, 6, 7], "5129": 31, "512k": 1, "52": [24, 28, 36, 40, 45, 46], "521": 29, "523": 29, "525": [24, 31, 40, 46], "53": [28, 38, 45], "530": [24, 40, 46], "534": [24, 31, 40, 46], "54": [28, 30, 31, 45, 46], "55": [24, 28, 38, 40, 45, 46], "555": 5, "56": [1, 5], "567": 5, "57": 5, "5708": 6, "58": [24, 28, 40, 46], "5811388300841898": 29, "586": 29, "59": [24, 40, 46], "5909090909091": 28, "59e1748777448c69de6b800d7a33bbfb9ff1b": 5, "5d41402abc4b2a76b9719d911017c592": 5, "5g": 1, "6": [1, 2, 5, 6, 7, 19, 21, 24, 27, 28, 30, 31, 34, 36, 38, 40, 42, 44, 46, 47], "60": [4, 5, 24, 28, 33, 38, 40, 44, 46], "62": [24, 40, 46], "625": [24, 31, 40, 46], "63": [24, 28, 40, 46], "630": [24, 40, 46], "634": [24, 31, 40, 46], "64": [2, 6, 7, 23, 24, 38, 40, 46], "65": [5, 6, 24, 28, 30, 34, 38, 40, 46], "65030674846626": 28, "66": [27, 28], "666666666666664": 28, "666666666666668": 38, "66666666666667": 28, "666667": 5, "67": [28, 30, 38], "68": 28, "7": [5, 6, 24, 27, 28, 31, 34, 38, 40, 46], "70": [24, 28, 38, 40, 46], "70000000000002": 28, "71": [28, 30], "714": 5, "72": 28, "73": [27, 28], "732": 31, "7384": 6, "75": [5, 24, 28, 38, 40, 46, 54], "76": 28, "78": [24, 27, 40, 46, 54], "783": 29, "785714285714285": 28, "78571428571429": 28, "79": [24, 27, 40, 46], "8": [2, 5, 6, 24, 27, 28, 29, 30, 31, 34, 36, 38, 39, 40, 44, 46], "80": [5, 24, 28, 38, 40, 46], "81": [27, 28], "82": [24, 40, 46, 54], "83": [24, 40, 46, 54], "833333333333336": 28, "84": [24, 38, 40, 46, 54], "85": [24, 28, 38, 40, 46], "855": 31, "86": 28, "87": 38, "888": 29, "88888888888889": 28, "8px": 43, "9": [5, 7, 19, 23, 24, 27, 28, 31, 34, 36, 38, 40, 46, 54], "90": [5, 24, 28, 38, 40, 46], "91": 28, "92": 27, "93": 28, "94": [27, 34, 38], "95": [27, 28, 38, 54], "96": [27, 28], "97": 5, "972": 31, "9795": 5, "98": [28, 54], "9b71d224bd62f3785d96d46ad3ea3d73319bfb": 5, "A": [0, 1, 2, 4, 5, 6, 7, 8, 15, 17, 19, 27, 29, 30, 33, 36, 38, 40, 41, 42, 43, 44, 49, 53, 55], "AND": [2, 4, 5, 7, 19, 36], "AS": [1, 2, 36, 41], "As": [5, 7, 19, 21, 30, 34, 36, 40], "At": [5, 21, 36], "BY": [4, 19], "Be": 2, "But": 28, "By": [2, 7, 14, 21, 23, 28, 40], "For": [1, 2, 4, 5, 6, 7, 15, 17, 18, 19, 21, 23, 26, 27, 28, 30, 31, 33, 34, 36, 39, 41, 42, 43, 44, 46, 55], "IN": 30, "INTO": [1, 7], "If": [0, 1, 2, 3, 4, 5, 7, 8, 11, 12, 14, 19, 21, 23, 28, 30, 31, 33, 36, 38, 40, 41, 44, 45, 46, 49, 53, 54], "In": [5, 7, 19, 21, 23, 27, 28, 29, 30, 31, 33, 36, 38, 40, 43, 44, 46, 54], "Into": 55, "It": [1, 2, 3, 4, 5, 7, 19, 21, 24, 26, 27, 28, 30, 33, 36, 41, 44, 52, 55], "Its": [24, 30], "NOT": 6, "No": [2, 7], "Not": [2, 4, 7], "OR": [4, 5, 7], "On": [2, 12, 21, 40], "One": [2, 4, 5, 28, 38, 40], "Or": [2, 39], "THE": 5, "That": [4, 7, 21, 55], "The": [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 12, 15, 17, 19, 22, 23, 24, 26, 27, 28, 29, 30, 31, 32, 33, 35, 36, 38, 39, 40, 41, 42, 43, 44, 45, 47, 53, 54, 55], "Their": 55, "Then": [36, 44], "There": [2, 5, 7, 21, 31, 36, 40, 44], "These": [1, 2, 5, 6, 7, 16, 19, 28, 30, 33, 36, 39, 41, 42, 43, 54], "To": [1, 2, 5, 21, 23, 30, 31, 34, 35, 36, 38, 39, 40, 41, 42, 44, 46, 47, 53, 54, 55], "Will": [2, 43], "With": [1, 2, 4, 5, 7, 15, 28, 42, 44, 46, 47], "_": 21, "__add__": [4, 7], "__aiter__": [2, 7, 16], "__and__": [4, 7], "__anext__": [7, 16], "__arrow_c_array__": [1, 7, 16, 47], "__arrow_c_stream__": [1, 2, 42, 47], "__call__": [3, 7, 19], "__cause__": 55, "__datafusion_aggregate_udf__": 19, "__datafusion_catalog_provider__": 55, "__datafusion_logical_extension_codec__": [1, 19, 21, 55], "__datafusion_physical_extension_codec__": [1, 19, 21, 55], "__datafusion_physical_optimizer_rule__": 1, "__datafusion_query_planner__": [1, 21, 55], "__datafusion_scalar_udf__": 19, "__datafusion_schema_provider__": 55, "__datafusion_table_function__": [7, 19, 36, 55], "__datafusion_table_provider__": [1, 21, 53, 55], "__datafusion_table_provider_factory__": 7, "__datafusion_task_context_provider__": 1, "__datafusion_window_udf__": 19, "__eq__": [4, 7, 15], "__ge__": [4, 7], "__getitem__": [2, 4, 7], "__gt__": [4, 7], "__init__": [7, 12, 19, 36], "__invert__": [4, 7], "__iter__": [2, 7, 16], "__le__": [4, 7], "__lt__": [4, 7], "__main__": 44, "__mod__": [4, 7], "__mul__": [4, 7], "__name__": 44, "__ne__": [4, 7], "__next__": [7, 16], "__or__": [4, 7], "__radd__": [4, 7], "__rand__": [4, 7], "__reduce__": [4, 7], "__repr__": [0, 1, 2, 3, 4, 7, 15, 19, 43], "__richcmp__": [4, 7], "__rmod__": [4, 7], "__rmul__": [4, 7], "__ror__": [4, 7], "__rsub__": [4, 7], "__rtruediv__": [4, 7], "__slots__": [0, 7], "__str__": 19, "__sub__": [4, 7], "__truediv__": [4, 7], "__version__": 46, "_aggreg": 5, "_build_expandable_cel": 3, "_build_html_foot": 3, "_build_html_head": 3, "_build_regular_cel": 3, "_build_table_bodi": 3, "_build_table_container_start": 3, "_build_table_head": 3, "_convert_file_sort_ord": 1, "_convert_table_partition_col": 1, "_create_table_udf": [7, 19], "_create_table_udf_decor": [7, 19], "_create_window_udf": [7, 19], "_create_window_udf_decor": [7, 19], "_ctx": 44, "_custom_cell_build": 3, "_custom_header_build": 3, "_default_formatt": 3, "_export_to_c_capsul": 2, "_format_cell_valu": 3, "_from_intern": [7, 19], "_get_cell_valu": 3, "_get_default_css": 3, "_get_default_nam": [7, 19], "_get_javascript": 3, "_inner": [0, 7], "_intern": [0, 1, 2, 4, 7, 14, 15, 16, 17, 18, 19], "_io_custom_table_provid": 36, "_is_pycapsul": 19, "_max_row": 3, "_normalize_input_typ": [7, 19], "_null_treat": 4, "_order_bi": 4, "_partition_bi": 4, "_r": [7, 19], "_raw": [7, 15], "_raw_plan": [7, 15], "_raw_schema": 0, "_raw_write_opt": [2, 7], "_reconstruct": [4, 7], "_refresh_formatter_refer": 3, "_register_object_store_for_path": 1, "_repr_html_": [2, 3, 43], "_sum": [7, 19, 36], "_test_three_library_query_plann": 21, "_to_pyarrow_typ": [4, 7], "_type_formatt": 3, "_typesh": [1, 7, 19], "_udaf": [7, 19], "_udf": [7, 19], "_udtf": [7, 19], "_udwf": [7, 19], "_validate_bool": 3, "_validate_formatter_paramet": 3, "_validate_positive_int": 3, "_window_fram": 4, "_window_funct": 5, "_wrap_session_kwarg_for_udtf": 19, "a0": 30, "a1": 5, "a_siz": 30, "aaf4c61ddcc5e8a2dabede0f3b482cd9aea9434d": 6, "ab": [1, 4, 5, 6, 7, 35, 44], "abc": [0, 1, 2, 3, 4, 5, 6, 7, 8, 19], "abcabc": 5, "abcdef": 5, "abi": 21, "abi3": 23, "abi_st": 21, "abil": [40, 54], "abl": [7, 15], "about": [17, 18, 21, 24, 38, 39, 42], "abov": [5, 21, 28, 30, 33, 38, 41, 42, 44, 54], "absent": 5, "absolut": [4, 5, 6, 7], "abstract": [0, 8, 19, 30, 36, 40, 42], "abxyef": 5, "accept": [1, 4, 5, 6, 7, 21, 30, 33, 42, 44, 47, 55], "access": [1, 3, 7, 11, 15, 21, 30, 40, 41, 42, 43, 44, 55], "access_key_id": [1, 40], "accessor": 21, "account": 40, "accum": [7, 19], "accumul": [7, 19, 28, 36], "accur": 39, "achiev": 24, "aco": [4, 5, 7], "acosh": [4, 5, 7], "acronym": 21, "across": [3, 4, 5, 7, 12, 15, 19, 22, 28, 30, 39, 41, 43, 44, 54], "act": [7, 15], "action": [12, 42], "activ": [1, 5, 21, 23], "actor": [12, 44], "actual": [2, 39, 42], "ad": [2, 21, 40], "adapt": [19, 21], "add": [0, 1, 2, 3, 4, 5, 21, 23, 26, 42], "add_3": 2, "add_month": 6, "add_physical_optimizer_rul": [1, 21, 55], "addit": [2, 3, 4, 5, 7, 15, 17, 18, 19, 21, 23, 36, 39, 40, 41, 42, 49, 55], "addition": [21, 27], "adequ": 12, "adhoc": 23, "adopt": 21, "advanc": [0, 1, 2, 7, 11, 36, 40, 42], "advantag": [21, 23, 24], "advertis": 36, "affect": [1, 7, 12, 14, 19, 28, 35, 39, 43], "after": [1, 2, 3, 4, 5, 6, 7, 12, 15, 19, 21, 33, 36, 41, 42, 43, 55], "afterward": [1, 21, 35], "ag": [30, 42], "again": [1, 21], "against": [1, 2, 4, 5, 12, 19, 24, 28, 30, 37, 43, 44, 55], "age_col": 30, "age_in_year": 30, "agent": [7, 45], "agg": 2, "aggreg": [1, 2, 4, 5, 6, 7, 12, 15, 19, 27, 32, 35, 39, 42, 44, 45, 55], "aggregatefunct": 4, "aggregateudf": [1, 7, 19], "aggregateudfexport": [7, 19], "agk": 6, "agnost": 42, "agre": 21, "agvsbg8": 5, "ai": [7, 45], "aim": [44, 46], "air": 30, "aiter": 2, "albert": 30, "algorithm": [2, 5], "alia": [0, 1, 2, 3, 4, 5, 6, 7, 15, 19, 27, 28, 30, 31, 34, 35, 36, 38, 42, 47], "alias": [2, 23], "alic": 33, "align": [2, 43, 44], "aliv": 21, "all": [0, 1, 2, 3, 4, 5, 6, 7, 14, 15, 19, 21, 23, 27, 28, 30, 31, 33, 34, 36, 38, 39, 40, 41, 42, 43, 47, 49, 54, 55], "all_suppli": 28, "alloc": [2, 21, 39], "allow": [1, 2, 3, 5, 7, 14, 16, 19, 21, 23, 24, 28, 30, 31, 36, 39, 40, 42, 43, 49, 54], "allow_single_file_parallel": [2, 7], "alon": [4, 28], "along": [26, 30], "alongsid": 4, "alpha": [36, 40], "alreadi": [1, 2, 5, 7, 19, 21, 30, 44, 55], "also": [1, 2, 3, 4, 5, 7, 19, 21, 23, 24, 28, 30, 31, 36, 38, 41, 42, 43, 45, 46, 54, 55], "altern": [5, 22, 34, 49, 52], "alternate_a": 2, "alwai": [4, 5, 7, 19, 41, 43, 44], "amazons3": [1, 13, 40], "ambigu": [2, 33], "amount": [2, 19, 42], "an": [0, 1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 16, 17, 19, 21, 23, 27, 28, 29, 30, 33, 34, 36, 38, 39, 40, 41, 42, 44, 45, 46, 47, 48, 49, 52, 54, 55], "analyt": 38, "analyz": [2, 4, 23, 36], "angl": 5, "ani": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 15, 19, 21, 26, 28, 30, 33, 35, 36, 38, 40, 41, 42, 43, 44, 47, 55], "annot": [23, 36], "anonym": 1, "anoth": [1, 2, 4, 5, 7, 11, 21, 30, 41, 44, 54, 55], "anti": [2, 32], "any_match": 5, "anyth": [12, 21], "anywai": 21, "anywher": [4, 7, 35, 43], "apach": [1, 2, 4, 5, 6, 7, 21, 23, 24, 26, 28, 31, 45, 47], "apart": [24, 28], "api": [1, 2, 4, 7, 15, 21, 23, 24, 25, 26, 31, 32, 39, 40, 42, 43, 44, 45, 54], "appar": 28, "appear": [2, 4, 5, 7, 21, 30], "append": [1, 2, 5, 7, 36, 40], "appli": [1, 2, 3, 5, 7, 12, 15, 16, 19, 28, 35, 36, 41, 43, 44], "applic": [6, 12, 21, 39], "approach": [5, 22, 28, 30, 36, 39, 40, 44, 54], "appropri": [19, 23, 36, 40, 43], "approx_distinct": [5, 28], "approx_median": [5, 28], "approx_percentile_cont": [5, 28], "approx_percentile_cont_with_weight": [5, 28], "approxim": 5, "ar": [1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 16, 19, 23, 27, 28, 30, 32, 34, 36, 38, 39, 40, 42, 43, 44, 45, 46, 47, 54, 55], "arbitrari": [2, 4, 5, 7, 21, 44], "arc": [4, 5, 7, 36, 53, 55], "architectur": 39, "area": 21, "arg": [1, 2, 5, 6, 7, 17, 19, 23], "argument": [1, 2, 4, 5, 6, 7, 19, 21, 28, 30, 36, 44, 45, 55], "arithmet": [6, 42, 44], "around": [1, 5, 23, 40, 55], "arr": [5, 7, 19, 42, 44], "arrai": [1, 2, 3, 4, 5, 6, 7, 19, 28, 32, 35, 36, 40, 42, 44, 47], "array1": 5, "array2": 5, "array_agg": [5, 28], "array_any_match": [5, 30], "array_any_valu": 5, "array_append": [5, 23], "array_cat": [5, 30], "array_compact": 5, "array_concat": [5, 30], "array_contain": [5, 6], "array_dim": [4, 5, 7], "array_dist": 5, "array_distinct": [4, 5, 7], "array_el": [4, 5, 7, 30], "array_empti": [4, 5, 7, 30], "array_except": 5, "array_extract": 5, "array_filt": [5, 30], "array_ha": 5, "array_has_al": 5, "array_has_ani": 5, "array_indexof": 5, "array_intersect": 5, "array_join": 5, "array_length": [4, 5, 7, 28], "array_max": 5, "array_min": 5, "array_ndim": [4, 5, 7], "array_norm": 5, "array_pop_back": [4, 5, 7], "array_pop_front": [4, 5, 7], "array_posit": [5, 26, 30], "array_prepend": 5, "array_push_back": 5, "array_push_front": 5, "array_remov": 5, "array_remove_al": 5, "array_remove_n": 5, "array_repeat": [5, 6, 30], "array_replac": 5, "array_replace_al": 5, "array_replace_n": 5, "array_res": 5, "array_revers": 5, "array_slic": [4, 5, 7], "array_sort": 5, "array_to_str": 5, "array_transform": [5, 30], "array_union": 5, "arrays_overlap": 5, "arrays_zip": 5, "arriv": [44, 47], "arro3": [7, 19, 36], "arrow": [1, 2, 3, 4, 5, 7, 16, 19, 22, 23, 24, 29, 30, 40, 45, 46, 50], "arrow_cast": [5, 31], "arrow_datafusion_python_root": 23, "arrow_field": 5, "arrow_ipc": 1, "arrow_metadata": 5, "arrow_schema": 1, "arrow_t": 42, "arrow_tbl": 1, "arrow_try_cast": 5, "arrow_typ": 21, "arrow_typeof": [4, 5, 7], "arrowarrai": [7, 16], "arrowarrayexport": 1, "arrowarraystream": 2, "arrowschema": [7, 16], "arrowstreamexport": 1, "articuno": 38, "arxiv": 5, "as_pi": [1, 4, 5, 6, 7, 19, 36, 44], "as_ref": [21, 55], "ascend": [2, 4, 5, 7, 28, 38, 42], "ascii": [4, 5, 6, 7, 14], "ascii_df": 5, "asin": [4, 5, 7], "asinh": [4, 5, 7], "ask": [21, 28, 55], "assembl": 1, "assign": [2, 4, 5, 7], "assist": [23, 45], "associ": [0, 4, 5, 7, 15, 21], "assum": [5, 7, 19, 23, 40, 55], "assumpt": 24, "async": [2, 7, 16, 42], "asynchron": [7, 16, 42], "asyncio": 42, "asynciter": 2, "atan": [4, 5, 7], "atan2": 5, "atanh": [4, 5, 7], "atk": [24, 40, 46], "attach": [4, 5, 7, 39], "attack": [24, 28, 31, 38, 40, 46, 54], "attempt": [1, 2, 7, 16, 19, 21, 23, 36], "attr_nam": 55, "attribut": [21, 30, 44], "attributed_volum": 30, "audio": 5, "author": [6, 19, 45], "auto": [6, 20], "autoapi": 20, "automat": [1, 5, 7, 15, 26, 39, 41, 42, 44], "avail": [2, 3, 4, 5, 7, 28, 32, 35, 36, 39, 40, 42, 53], "averag": [5, 19, 38], "avg": [1, 5, 6, 19, 28, 38, 55], "avoid": [1, 7, 11, 21, 44], "avro": [1, 7, 11, 40, 42, 43, 45, 50], "awai": 21, "await": 42, "awar": [2, 34], "awkward": 30, "aws_access_key_id": 40, "aws_secret_access_kei": 40, "ax": 5, "b": [1, 2, 4, 5, 6, 7, 28, 29, 30, 35, 36, 37, 40, 42, 43, 47], "b1": 1, "b2": [1, 5], "back": [4, 7, 12, 19, 21, 24, 36, 40, 44, 47, 55], "background": [43, 44], "backward": 3, "bag": 36, "balanc": 43, "ballista": 45, "bar": 39, "bare": [5, 6, 55], "base": [0, 1, 2, 3, 4, 5, 7, 9, 10, 11, 14, 15, 19, 20, 26, 30, 33, 36, 39, 40, 41, 45], "base64": [5, 6], "baseinputsourc": [8, 9, 10], "basi": [2, 7, 19, 36], "basic": [7, 19, 27, 32, 34, 36, 39, 40, 45], "basic_typ": 31, "batch": [1, 2, 3, 5, 7, 15, 16, 19, 29, 36, 37, 40, 42, 44, 47], "batch_arrai": 36, "batch_siz": [1, 7, 55], "batch_tbl": 1, "becaus": [2, 4, 5, 6, 7, 19, 21, 28, 36, 40, 55], "becca": 30, "becom": [1, 5, 6, 28, 30, 44], "beedril": [24, 38, 40, 46], "beedrillmega": [24, 40, 46], "been": [3, 4, 7, 15, 21, 36, 41, 55], "befor": [1, 2, 3, 5, 6, 7, 15, 19, 21, 23, 30, 33, 36, 41, 43, 55], "beforehand": [1, 7], "begin": [1, 4, 5, 7, 14, 19, 43], "behav": 4, "behavior": [1, 4, 5, 7, 14], "behaviour": 55, "behind": 21, "being": [1, 2, 5, 19, 21, 53, 55], "belong": [1, 28, 55], "below": [21, 27, 28, 36, 40, 42, 44], "benefit": [2, 7, 39], "best": [1, 2, 7, 19, 21, 36], "beta": 40, "better": [2, 7, 43, 44], "between": [1, 4, 5, 7, 19, 21, 24, 27, 33, 36, 38, 39], "beyond": 44, "bia": [7, 19], "bias_10": [7, 19], "biased_numb": [7, 19], "biasednumb": [7, 19], "big": [5, 6], "big_onli": 30, "bigint": 6, "bin": [5, 6, 23], "binari": [4, 5, 6, 7, 15, 21, 44, 55], "binaryexpr": [4, 7], "bind": [1, 5, 6, 7, 19, 21, 23, 24, 40, 46], "bit": [4, 5, 6, 7], "bit_and": [5, 28], "bit_count": 6, "bit_df": 5, "bit_get": 6, "bit_len": 5, "bit_length": [4, 5, 7], "bit_or": [5, 28], "bit_pack": [2, 7], "bit_xor": [5, 28], "bitmap": 6, "bitmap_bit_posit": 6, "bitmap_bucket_numb": 6, "bitmap_count": 6, "bitwis": [5, 6, 26, 30], "bitwise_not": 6, "black": 43, "blake2": 5, "blake2b": 5, "blake3": 5, "blastois": [24, 40, 46], "blastoisemega": [24, 40, 46], "blob": [1, 4, 7, 12, 26, 44], "block": 44, "blog": [23, 36], "bloom": [2, 7, 36], "bloom_filter_en": [2, 7], "bloom_filter_fpp": [2, 7], "bloom_filter_ndv": [2, 7], "bloom_filter_on_writ": [2, 7], "blue": 30, "bob": 33, "bodi": [3, 5, 30], "bool": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 14, 15, 18, 19], "bool_": [1, 36], "bool_and": [5, 28], "bool_or": [5, 28], "boolean": [3, 4, 5, 7, 32, 36], "boost": [2, 7], "bootstrap": 23, "border": 43, "borrow": 21, "both": [1, 2, 4, 5, 7, 15, 19, 21, 23, 26, 28, 30, 33, 36, 42, 43, 44, 54, 55], "bottleneck": 39, "bound": [4, 5, 7, 12, 19, 21, 36, 38, 44, 53, 55], "boundari": [19, 21, 38, 42], "bow": 38, "box": [2, 7, 21, 36], "bracket": [5, 30], "branch": 30, "brand": 36, "brand_arr": 36, "brand_max": 36, "brand_min": 36, "brand_null_count": 36, "brand_qty_filt": 36, "break": 21, "broader": 1, "broken": 28, "bronz": 5, "brotli": [2, 7], "brown": 5, "btrim": [4, 5, 7], "bucket": [1, 6, 30, 36], "bucket_claus": 36, "bucket_nam": [1, 40], "buf": [4, 7], "bug": [21, 24, 28, 38, 40, 46], "build": [1, 3, 4, 5, 6, 7, 19, 21, 22, 24, 26, 27, 28, 30, 36, 42, 44, 45, 53, 55], "build_flag": 23, "build_tabl": [8, 9, 10], "builder": [3, 4, 5, 7, 14, 26, 28, 30, 38], "built": [0, 1, 2, 4, 5, 6, 7, 12, 19, 21, 28, 30, 31, 35, 36, 41, 44, 45, 55], "bulb": 31, "bulbafleur": 31, "bulbasaur": [24, 31, 38, 40, 46], "bulk": 21, "busi": 36, "butterfre": [24, 38, 40, 46], "button": 3, "bx": 5, "byte": [1, 2, 3, 4, 5, 6, 7, 12, 15, 17, 41, 44], "byte_stream_split": [2, 7], "bytecod": [4, 7, 12, 44], "bz2": [7, 14], "c": [1, 2, 4, 5, 7, 16, 19, 21, 23, 24, 29, 36, 40, 42, 44, 47], "c0": [5, 6], "c1": [5, 6], "c3": 5, "c_str": 55, "ca": 5, "cach": [2, 3, 7, 41], "calcul": [2, 5, 19, 30, 36], "call": [0, 1, 2, 3, 4, 5, 6, 7, 12, 15, 16, 17, 18, 19, 21, 27, 28, 30, 35, 40, 41, 42, 43, 44, 55], "call0": 55, "callabl": [2, 3, 4, 5, 7, 12, 19, 43, 44], "callback": [7, 19, 21, 36, 55], "caller": [1, 5, 7, 19, 36], "can": [1, 2, 3, 4, 5, 7, 8, 9, 10, 11, 15, 19, 21, 23, 26, 27, 28, 30, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 46, 47, 49, 53, 54, 55], "can_retir": 30, "candid": 4, "cannot": [1, 4, 5, 7, 11, 21, 30, 36, 44, 54, 55], "canon": 21, "canonical_nam": [4, 7], "cap": 5, "cap_df": 5, "capabl": [39, 54], "capit": [4, 5, 7, 34], "capsul": [1, 2, 4, 7, 12, 19, 44, 53, 55], "capsule_t": 53, "capsuletyp": [1, 7, 19], "captur": [1, 4, 5, 7, 12, 21, 28, 38, 44], "cardin": [4, 5, 7, 30], "carefulli": 21, "cargo": 23, "carlo": 30, "carri": [1, 4, 5, 7, 21, 36, 41, 44, 55], "cascad": [0, 7], "case": [1, 2, 4, 5, 6, 7, 19, 21, 26, 28, 30, 31, 34, 35, 36, 38, 39, 40, 44, 54], "case_build": 4, "casebuild": [4, 5], "cast": [2, 4, 5, 6, 7, 21, 32, 36, 54, 55], "cast_to_typ": 5, "castabl": [4, 7], "cat": 5, "catalog": [1, 2, 5, 7, 18, 20, 21, 28, 36, 45, 55], "catalog_list": 0, "catalog_nam": [0, 1], "cataloglist": [0, 1], "catalogprovid": [0, 1, 40, 54, 55], "catalogproviderexport": [0, 1], "catalogproviderlist": [0, 1], "catalogproviderlistexport": 1, "categor": [5, 26], "categori": 31, "caterpi": [24, 38, 40, 46], "caus": [1, 7, 23, 38], "caveat": [4, 7, 28, 38], "cbrt": [4, 5, 7], "cbrt_df": 5, "cd": [5, 23], "cdatainterfac": [1, 2], "cdylib": 21, "ceil": [4, 5, 6, 7, 35], "ceil_df": 5, "cell": [3, 4, 7, 12, 44], "cellformatt": 3, "certain": 19, "certainli": 23, "chain": [1, 2, 7, 14, 21], "chainabl": 2, "challeng": 21, "chang": [1, 3, 5, 7, 19, 21, 23, 30, 36], "chansei": 28, "char": [6, 31], "char_len": 5, "char_len_df": 5, "char_length": [4, 5, 7, 31], "charact": [2, 3, 4, 5, 6, 7, 14, 43, 49], "character_length": [4, 5, 7], "characterist": 39, "charizard": [24, 31, 38, 40, 46, 54], "charizardmega": [24, 31, 38, 40, 46, 54], "charli": 33, "charmand": [24, 31, 38, 40, 46], "charmeleon": [24, 31, 38, 40, 46], "check": [5, 6, 30, 31, 36, 55], "checker": 55, "checkout": 26, "checksum": [4, 5, 7], "child": [6, 44], "children": [5, 7, 15, 41], "choos": 35, "chosen": 1, "chr": [4, 5, 7], "chrono": 5, "chunk": [2, 7], "chunkedarrai": 2, "ci": [21, 23], "circuit": 21, "citi": 28, "citycab": 33, "class": [22, 23, 28, 36, 38, 40, 43, 44, 45, 55], "classmethod": [1, 2, 3, 4, 7, 19], "classvar": [4, 7], "claud": 26, "claus": [1, 19, 36, 38], "clean": 23, "clear": [12, 44, 55], "clear_": 44, "clear_sender_ctx": 12, "clear_worker_ctx": 12, "clefabl": 38, "clefairi": 38, "cli": 26, "click": 3, "clickhous": 30, "cline": 26, "clock": 41, "clone": [7, 19, 21, 23, 36, 53, 55], "close": [21, 38, 44], "closur": [4, 7, 12, 19, 44], "cloud": 39, "cloudpickl": [1, 4, 7, 12, 28, 38, 44], "cluster": 44, "cmd": 7, "cn": 5, "cnt": 5, "co": [4, 5, 7], "coalesc": [2, 5, 31, 33, 41], "coalesce_duplicate_kei": [2, 33], "code": [1, 3, 4, 5, 6, 7, 21, 22, 25, 31, 40, 44, 45, 55], "codebas": 23, "codec": [1, 2, 4, 7, 12, 15, 19, 44, 53, 55], "codec_a": 21, "codec_b": 21, "codex": 26, "coeffici": 5, "coerc": [4, 5], "coerce_to_expr": 4, "coerce_to_expr_list": 4, "coerce_to_expr_or_non": 4, "coercion": 2, "coexist": 44, "col": [1, 2, 3, 4, 5, 6, 7, 12, 19, 27, 28, 30, 31, 32, 34, 35, 36, 37, 38, 39, 42, 43, 44, 47, 54], "col1": [6, 19, 42], "col2": [6, 42], "col_attack": 28, "col_diff": 36, "col_idx": 3, "col_spe": 28, "col_type_1": 28, "col_type_2": 28, "collaps": 3, "collect": [1, 2, 3, 4, 5, 6, 7, 15, 19, 21, 24, 27, 28, 29, 37, 39, 41, 42, 44, 54], "collect_column": [1, 2, 4, 5, 6, 7, 19, 42], "collect_list": [6, 28], "collect_metr": [7, 15, 41], "collect_partit": [2, 41], "collect_set": [6, 28], "collid": [2, 7], "collis": 5, "color": [30, 43], "column": [1, 2, 3, 4, 5, 6, 7, 11, 14, 16, 19, 27, 28, 29, 31, 32, 36, 38, 39, 45, 49, 54, 55], "column1": [7, 15, 41], "column_index_truncate_length": [2, 7], "column_nam": [2, 4, 7, 14], "column_specific_opt": [2, 7], "com": [6, 23, 26], "combin": [1, 2, 4, 5, 7, 11, 28, 30, 33, 34, 36, 39], "come": [1, 5, 21, 28, 40, 51, 55], "command": [1, 7, 21, 23, 26, 40], "comment": [7, 14, 21], "commit": [22, 28], "common": [1, 2, 4, 5, 6, 7, 8, 9, 10, 21, 26, 28, 30, 31, 33, 35, 38, 40, 45, 47, 55], "commun": [21, 23], "compact": 28, "compar": [5, 30, 36, 38], "comparison": [4, 5, 7, 28, 42, 44, 54], "compat": [1, 2, 3, 6, 7, 21, 28, 30, 31, 32, 42, 44, 45], "compel": 21, "compet": 39, "compil": [1, 21, 30, 41, 55], "complement": 4, "complet": [4, 5, 7, 8, 21, 23, 36, 40, 42, 43, 53, 55], "complex": [2, 5, 24, 31, 36, 39], "complic": 2, "compon": [1, 5, 6], "compos": [5, 21], "composit": 3, "compound": 30, "comprehens": 43, "compress": [1, 2, 7, 11, 14], "compression_level": [2, 7], "comput": [2, 4, 5, 7, 19, 21, 30, 36, 41, 42], "concat": [1, 5, 6, 35], "concat_w": 5, "concaten": [5, 6, 28, 30], "concatenated_arrai": 30, "concept": [1, 2, 4, 7, 30, 39, 45, 54], "concis": [5, 23], "concret": 5, "concurr": [1, 7, 39, 42], "condit": [6, 28, 32], "conduct": 25, "config": [1, 7, 19, 21, 23, 36, 39, 55], "config_intern": [1, 7], "config_nam": 1, "config_opt": [1, 7], "configopt": 55, "configur": [1, 3, 7, 12, 14, 19, 21, 23, 26, 36, 44, 45, 54], "configure_formatt": [3, 7, 43], "conflict": [1, 7, 11], "conjunct": 2, "connect": [1, 27, 55], "consecut": 5, "consequ": 54, "consid": [5, 54], "consider": 43, "consist": [4, 5, 43], "consol": [2, 42], "constraint": 3, "construct": [1, 2, 4, 7, 19, 21, 30, 36, 42, 53, 55], "constructor": [0, 2, 4, 7, 15, 16, 17, 18, 19, 21, 53], "consult": [4, 7, 36], "consum": [7, 8, 15, 17, 41, 42, 44, 47], "contain": [1, 2, 3, 4, 5, 6, 7, 12, 14, 15, 19, 20, 21, 23, 28, 30, 33, 36, 43, 44, 49], "content": [23, 32, 43], "context": [0, 3, 4, 7, 11, 12, 15, 17, 19, 20, 35, 36, 37, 39, 41, 45, 47, 54, 55], "continu": [5, 12, 21, 55], "contrast": 33, "contribut": [23, 28, 30, 55], "contributor": 21, "control": [1, 2, 4, 5, 7, 12, 28, 30, 36, 38, 39, 42, 49], "conveni": [1, 2, 4, 5, 7, 15, 19, 40, 41], "convent": [4, 5, 7, 21, 26], "convention": 5, "convers": [7, 19, 21, 23, 27, 42, 54], "convert": [0, 1, 2, 4, 5, 6, 7, 14, 15, 16, 17, 18, 19, 21, 27, 29, 30, 31, 36, 37, 42, 43, 54], "copi": [1, 4, 7, 16, 21, 23, 24, 36, 44, 45, 47], "copied_config": 1, "copilot": 26, "copyabl": 26, "copyto": 4, "core": [2, 4, 21, 39, 40, 45, 55], "corr": [5, 28], "correctli": [2, 19, 21], "correl": [5, 26], "correspond": [5, 7, 15, 33], "cos_df": 5, "cosec": 6, "cosh": [4, 5, 7], "cosh_df": 5, "cosin": [4, 5, 7], "cosine_dist": 5, "cosine_similar": 5, "cost": [24, 36], "costli": 19, "cot": [4, 5, 7], "cotang": [4, 5, 7], "could": [2, 4, 7, 21, 55], "count": [1, 2, 5, 6, 7, 15, 28, 29, 35, 36, 39, 41, 42], "count_star": 5, "counter": [7, 15], "counterpart": [5, 6, 21], "coupl": [21, 38], "covar": 5, "covar_pop": [5, 28], "covar_samp": [5, 28], "covari": 5, "cover": [21, 27, 31, 39, 44, 45], "cpu": [7, 15, 41, 45], "cpython": [19, 23], "cr": [21, 36, 53, 55], "crate": [1, 21, 35], "crc32": 6, "creat": [0, 1, 2, 3, 4, 5, 7, 8, 9, 10, 11, 14, 15, 17, 18, 19, 20, 21, 23, 27, 28, 30, 33, 35, 36, 37, 39, 41, 43, 45, 47, 54], "create_datafram": [1, 5, 36, 40], "create_dataframe_from_logical_plan": 1, "create_namespace_if_not_exist": 40, "create_physical_plan": 21, "create_t": 40, "createcatalog": 4, "createcatalogschema": 4, "created_bi": [2, 7], "createexternalt": [4, 7], "createfunct": 4, "createfunctionbodi": 4, "createindex": 4, "creatememoryt": 4, "createview": 4, "creation": 42, "credenti": [1, 40], "criteria": [5, 38], "crlf": [7, 14], "cross": [1, 4, 28, 44], "csc": 6, "css": [3, 43], "cstream": 21, "cstring": 21, "csv": [0, 1, 2, 7, 11, 14, 21, 24, 28, 31, 38, 39, 40, 42, 43, 45, 46, 50, 54], "csvreadopt": [1, 7, 11, 14, 49], "ctx": [0, 1, 2, 4, 5, 6, 7, 12, 15, 17, 19, 21, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 44, 46, 47, 48, 49, 51, 52, 53, 54, 55], "ctx_provid": [21, 55], "cube": [2, 4, 5, 7], "cume_dist": [5, 19, 38], "cumul": 5, "curr_valu": 36, "current": [0, 1, 2, 3, 4, 5, 6, 7, 15, 19, 21, 31, 36, 38, 43], "current_d": 5, "current_tim": 5, "current_timestamp": 5, "cursor": 26, "custom": [1, 3, 5, 7, 8, 15, 21, 28, 33, 36, 38, 39, 42, 45, 50, 54], "custom_css": [3, 43], "custom_formatt": [3, 43], "customer_id": 33, "cut": 44, "cx": 5, "cycl": 21, "cyclic": 6, "d": [2, 5, 6, 19, 35, 36, 43, 47], "dai": [5, 6, 31], "damag": 21, "dangl": 21, "dant": 30, "dark": 28, "data": [0, 1, 2, 3, 4, 5, 7, 11, 14, 15, 16, 18, 19, 21, 23, 24, 26, 27, 28, 29, 30, 31, 34, 36, 37, 38, 39, 41, 42, 43, 44, 45, 46, 47, 48, 49, 51, 53, 54, 55], "data_page_row_count_limit": [2, 7], "data_pagesize_limit": [2, 7], "data_typ": [5, 7, 14, 21], "data_type_or_field_to_field": 19, "data_types_or_fields_to_field_list": 19, "databas": [0, 7, 30, 39], "databrick": 30, "dataflow": [7, 15], "datafram": [0, 1, 3, 4, 5, 6, 7, 11, 15, 16, 19, 20, 24, 26, 28, 29, 30, 31, 32, 34, 36, 37, 38, 39, 41, 44, 45, 46, 47, 54], "dataframe_formatt": [7, 20, 43], "dataframehtmlformatt": [3, 43], "dataframewriteopt": [2, 7], "datafus": [20, 21, 22, 23, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 45, 46, 48, 49, 50, 51, 52, 53, 54], "datafusion_catalog": 55, "datafusion_catalog_provid": 55, "datafusion_df": 40, "datafusion_logical_extension_codec": 55, "datafusion_physical_extension_codec": [21, 55], "datafusion_python": 26, "datafusion_query_plann": 1, "datafusion_sql": 18, "datafusion_table_funct": 36, "datafusion_table_provid": [21, 53], "dataset": [0, 1, 3, 7, 31, 36, 38, 39, 40, 43, 46], "datasourc": 8, "datasourceexec": [7, 15, 36, 41], "datastructur": [4, 7], "datatyp": [1, 2, 4, 5, 7, 11, 14, 19, 36], "datatypemap": [4, 7, 21], "date": [5, 6, 28, 31, 35, 42, 43], "date32": [5, 6], "date_add": 6, "date_bin": 5, "date_diff": 6, "date_format": 5, "date_part": [5, 6, 31], "date_sub": 6, "date_trunc": [5, 6], "datepart": 5, "datetim": [5, 6, 7, 15, 35, 43], "datetrunc": 5, "day_of_week": 6, "daylight": 5, "dayofweek": 6, "dd": 5, "ddd": 43, "ddl": [1, 7], "dealloc": 4, "debug": 21, "dec": 5, "decid": [19, 21, 36, 44], "decim": [5, 6, 35, 43], "decimal_plac": 5, "decod": [1, 4, 5, 6, 7, 15, 19, 44, 55], "decor": [7, 19], "decorator_double_udf": [7, 19], "dedupl": 2, "deepcopi": [4, 7], "deeper": 21, "deepli": 2, "def": [2, 4, 7, 12, 19, 24, 36, 40, 42, 43, 44, 46, 54], "default": [0, 1, 2, 3, 4, 5, 6, 7, 10, 11, 12, 14, 15, 18, 19, 21, 23, 28, 30, 33, 35, 36, 38, 39, 40, 43, 54], "default_max_infer_schema": [1, 7, 14], "default_str_repr": 2, "default_valu": 5, "defaultstyleprovid": 3, "defens": [24, 31, 40, 46, 54], "defin": [0, 1, 2, 4, 7, 19, 21, 23, 31, 32, 44, 45], "definit": [1, 4, 7, 19, 21, 27, 36], "deg": 5, "deg_df": 5, "degre": [4, 5, 7], "deleg": [19, 21], "delet": [1, 7], "delimit": [1, 5, 6, 7, 11, 14, 49], "delta": [21, 45], "delta_binary_pack": [2, 7], "delta_byte_arrai": [2, 7], "delta_length_byte_arrai": [2, 7], "delta_t": 40, "deltalak": 40, "deltat": 40, "demand": [42, 47], "demonstr": [1, 21, 36, 38, 39, 46, 47], "dens": [5, 7, 26], "dense_rank": [5, 19, 38], "depend": [5, 7, 21, 22, 28, 36, 38, 55], "deploy": 44, "deprec": [1, 2, 3, 7, 15], "deprecationwarn": 3, "depth": 2, "deregist": [0, 1, 7], "deregister_object_stor": 1, "deregister_schema": [0, 7], "deregister_t": [0, 1], "deregister_udaf": 1, "deregister_udf": 1, "deregister_udtf": 1, "deregister_udwf": 1, "descend": [2, 5], "describ": [2, 5, 21, 28, 29, 36, 40], "describet": 4, "descript": [1, 5, 7, 15, 19, 41, 44], "deseri": [1, 17], "deserialize_byt": 17, "design": [21, 32], "desir": 5, "detail": [2, 4, 5, 7, 19, 22, 23, 27, 28, 29, 42, 44, 49], "detect": 41, "determin": [0, 2, 4, 5, 7, 19, 36], "dev": 23, "develop": [21, 22, 40, 44], "deviat": 5, "df": [1, 2, 4, 5, 6, 7, 19, 24, 27, 28, 29, 30, 31, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 46, 47, 48, 49, 51, 52, 54], "df1": [2, 42], "df2": [1, 2, 42], "df_filter": 37, "df_null": 5, "df_orth": 5, "df_view": 37, "df_zero": 5, "dfn": [1, 2, 4, 5, 6, 7, 19], "dfschema": [1, 7], "diagnost": 55, "dialect": [1, 18, 30, 54], "dict": [1, 2, 3, 4, 5, 7, 15, 41], "dictionari": [1, 2, 5, 7, 30, 36, 37, 40, 42, 54], "dictionary_en": [2, 7], "dictionary_page_size_limit": [2, 7], "differ": [1, 2, 4, 5, 7, 12, 14, 15, 19, 21, 28, 30, 31, 35, 36, 39, 40, 42, 44, 55], "difficult": 21, "digest": 5, "digit": 6, "dimens": [4, 5, 7], "dimension": 2, "direct": [2, 5, 43], "directli": [1, 2, 3, 4, 5, 6, 7, 17, 19, 21, 36, 40, 41, 42, 44, 47, 55], "directori": [1, 7, 23], "disabl": [1, 4, 7, 33, 43], "disambigu": [2, 32], "discard": [1, 21], "discov": 26, "discover": 1, "discoveri": 1, "discuss": [21, 40], "disjunct": 36, "disk": [1, 7, 9, 10, 15, 41], "dispatch": 1, "displai": [3, 7, 15, 27, 29, 37, 41, 42, 46], "display_graphviz": [7, 15], "display_ind": [7, 15, 36], "display_indent_schema": [7, 15], "distanc": 5, "distil": 26, "distinct": [2, 4, 5, 6, 7, 21, 40, 55], "distinct_on": 2, "distinctli": 21, "distinguish": [21, 28, 41], "distribut": [4, 5, 7, 12, 39, 45], "distributedqueryplann": 1, "diverg": [21, 35], "divid": [5, 39], "dividend": 6, "divis": [4, 5, 6, 7], "divisor": [5, 6], "dml": [1, 7], "dmlstatement": 4, "do": [0, 1, 2, 5, 7, 12, 19, 21, 23, 27, 28, 36, 38, 40, 44, 53, 54], "doc": [1, 2, 5, 7, 18, 25, 44], "docstr": [23, 35], "document": [1, 2, 4, 5, 7, 19, 20, 21, 23, 27, 39, 42, 44, 46, 49], "doe": [1, 2, 3, 4, 5, 7, 12, 14, 19, 21, 23, 28, 35, 38, 40, 41, 44, 55], "doesn": 19, "dominant_typ": 31, "done": [2, 28, 36, 40], "dot": [2, 5, 7, 15], "dot_product": 5, "doubl": [2, 4, 5, 6, 7, 19, 30, 34, 44, 47], "double_fn": [5, 30], "double_func": [7, 19], "double_it": [7, 19], "double_udf": [7, 19], "down": [7, 15, 21, 28, 38, 40], "downcast": 55, "download": [27, 34, 46], "downstream": [2, 47], "dr": 5, "dragon": [24, 28, 31, 38, 40, 46], "dragonair": 38, "dragonit": 38, "dratini": [28, 38], "draw": [2, 7], "drill": 28, "drive": 1, "driven": 1, "driver": [4, 7, 12, 44], "driver_ctx": 12, "drop": [1, 2, 7, 21, 28, 30, 42, 44, 55], "dropcatalogschema": 4, "dropfunct": 4, "droptabl": 4, "dropview": 4, "dt": [5, 6], "dtype": 2, "duckdb": [18, 30], "due": [1, 5, 7, 11, 15, 23, 55], "dump": [1, 4, 7, 12, 44], "dup": 6, "duplic": [2, 4, 5, 7, 32, 43], "durabl": 21, "durat": 5, "dure": [5, 7, 19, 23, 41], "dyn": 55, "dynam": 5, "dynamic_lookup": 23, "e": [1, 4, 5, 6, 7, 12, 15, 19, 36, 41, 44], "ea09ae9cc6768c50fcee903ed054556e5bfc8347907f12598aa24193": 5, "each": [1, 2, 4, 5, 6, 7, 12, 15, 19, 21, 23, 26, 28, 31, 33, 36, 38, 41, 42, 43, 44], "eager": 21, "eagerli": [7, 15, 41, 42], "earli": 21, "earlier": 21, "easi": [21, 26, 51], "easier": [21, 31, 36, 46], "easili": [4, 7, 21], "east": [1, 40], "edg": [35, 44], "effect": [1, 4, 7, 12, 21, 34, 46, 55], "effici": 39, "effort": [2, 7, 21], "either": [1, 2, 4, 5, 7, 19, 21, 28, 40, 42, 44, 54, 55], "elapsed_comput": [7, 15, 41], "electr": [28, 38], "element": [2, 3, 4, 5, 6, 7, 15, 30], "element_at": 5, "ellipsi": [2, 5, 7, 19], "els": [6, 36, 43, 55], "else_expr": 4, "elt": 6, "emb": [4, 7], "embarrassingli": 44, "embed": [1, 2, 4, 5, 7, 21], "emit": 41, "employe": 30, "empti": [1, 2, 4, 5, 7, 14, 15, 21, 28, 30, 41, 42, 44, 55], "empty_t": [1, 5], "emptyrel": 4, "enabl": [1, 2, 7, 12, 21, 35, 39, 42, 43, 44], "enable_cell_expans": [3, 7, 43], "enable_ident_norm": 1, "enable_spark_funct": [1, 6, 35], "enable_url_t": [1, 21], "enc": 5, "encod": [2, 4, 5, 6, 7, 12, 15, 17, 21, 44], "encount": 21, "encourag": 23, "end": [0, 2, 4, 5, 6, 7, 15, 16, 18, 19, 35, 36, 38, 39, 44], "end_bound": [4, 7], "end_dat": 6, "end_timestamp": [7, 15], "ends_with": 5, "ends_with_df": 5, "engin": [1, 7, 24, 27, 28, 36, 38], "enough": 19, "ensur": [3, 7, 8, 14, 21, 39], "ensure_expr": 4, "ensure_expr_list": 4, "entir": [2, 5, 7, 19, 28, 36, 38, 42, 44], "entri": [1, 2, 4, 5, 6, 7, 15, 26, 28, 38, 42, 44], "entry_typ": 6, "enum": [2, 4, 7, 19], "enumer": [19, 26], "environ": [1, 4, 7, 23, 24, 39, 42, 43, 44], "epoch": [5, 6], "equal": [2, 4, 5, 7, 15, 30, 44], "equi": 6, "equival": [2, 4, 5, 19, 21, 28, 30, 38, 42, 44], "error": [1, 3, 4, 5, 6, 7, 14, 23, 44], "escap": [7, 14, 49], "escapechar": 6, "especi": [1, 2, 23, 33], "essenti": [7, 16, 29], "etc": [1, 3, 4, 5, 6, 7, 9, 10, 15, 19, 31, 41, 42, 44], "euclidean": 5, "eval_rang": 19, "evalu": [2, 4, 5, 7, 19, 27, 28, 30, 36, 38, 39, 42, 44], "evaluate_al": [7, 19, 36], "evaluate_all_with_rank": [19, 36], "even": [1, 3, 7, 15, 21, 33, 36, 41], "evenli": 39, "event": [7, 15, 41, 42], "ever": 44, "everi": [1, 5, 7, 12, 19, 21, 28, 30, 35, 36, 41, 44], "everyth": [9, 10], "ex": [4, 7, 34], "exact": [5, 21], "exactli": [1, 2, 5, 6, 21, 28, 38], "examin": [4, 7], "exampl": [1, 2, 3, 4, 5, 6, 7, 12, 15, 19, 21, 25, 26, 27, 28, 30, 31, 33, 36, 37, 38, 40, 42, 46, 53, 54, 55], "exce": 3, "excel": 21, "except": [1, 2, 4, 5, 7, 21, 30, 54], "except_al": 2, "exchang": 21, "exclud": [2, 28, 33, 41], "execut": [1, 2, 4, 5, 7, 14, 15, 19, 21, 23, 24, 27, 39, 44, 45, 47, 55], "execute_logical_plan": 1, "execute_stream": [2, 7, 15, 16, 41, 42], "execute_stream_partit": [2, 41, 42], "execution_plan": [2, 36, 41], "executionplan": [1, 2, 7, 15, 21, 41], "executor": 44, "exeggcut": 28, "exempt": 21, "exist": [0, 1, 2, 3, 4, 5, 7, 21, 36, 42, 55], "exit": 12, "exp": [4, 5, 6, 7], "exp_smooth": 36, "expand": [2, 3, 43], "expans": [3, 43], "expect": [4, 5, 7, 14, 19, 21, 30, 36, 38, 42, 54, 55], "expens": [2, 41], "experi": 23, "explain": [2, 4, 7], "explainformat": [2, 7], "explan": [2, 21, 27, 42], "explicit": [1, 2, 4, 5, 12, 30, 39, 42, 43, 44], "explicitli": [1, 2, 7, 19, 21, 28, 42, 44], "expm1": 6, "expon": 5, "exponenti": [4, 5, 7], "exponentialsmooth": 36, "export": [1, 2, 4, 7, 16, 19, 21, 23, 40, 50], "expos": [1, 2, 6, 7, 15, 19, 21, 35, 36, 40, 42, 53], "expr": [1, 2, 5, 6, 7, 11, 12, 14, 19, 20, 21, 28, 36, 38, 42, 44], "expr1": 5, "expr2": 5, "expr_list": 4, "expr_type_error": 4, "express": [1, 2, 4, 5, 6, 7, 12, 14, 19, 26, 28, 31, 32, 33, 35, 36, 38, 45, 55], "exprfuncbuild": [4, 7], "extend": [5, 8, 21, 55], "extens": [1, 3, 4, 7, 11, 14, 22, 49, 53], "extensioncodec": 21, "extern": [0, 7, 21, 25, 36, 44], "extra": 28, "extract": [3, 4, 5, 6, 7, 31, 55], "extraenv": 23, "f": [2, 5, 6, 7, 27, 28, 30, 31, 36, 38, 40, 41, 42, 43, 54, 55], "face": 21, "fact": [21, 36], "factor": [4, 7, 39], "factori": [1, 4, 5, 6, 7, 19], "fail": [2, 4, 5, 7, 21, 23, 28, 31, 44], "failed_suppli": 28, "failur": [4, 5, 7, 21, 28], "fair": [1, 7], "fairi": [28, 38], "fall": [4, 7, 12, 21], "fallback": [1, 5, 21, 44], "fals": [1, 2, 3, 4, 5, 7, 12, 14, 19, 21, 23, 24, 28, 30, 31, 33, 34, 36, 39, 40, 42, 43, 44, 46, 53], "famili": 6, "familiar": 23, "fan": 44, "far": [2, 41], "fast": 44, "faster": [2, 5, 7, 19, 39], "featur": [2, 5, 7, 21, 23, 33, 40, 47], "fed": 44, "feel": 36, "fetch": [23, 41], "few": [21, 23, 27, 28], "fewer": 3, "ff": [5, 6], "fffd": 6, "ffi": [0, 1, 4, 7, 12, 15, 19, 22, 40, 44, 53, 55], "ffi_": 21, "ffi_catalogprovid": [21, 55], "ffi_extensionopt": 55, "ffi_logical_codec_from_pycapsul": [53, 55], "ffi_logicalextensioncodec": [1, 55], "ffi_physical_codec_from_pycapsul": 55, "ffi_physicalextensioncodec": [1, 21, 55], "ffi_physicaloptimizerrul": 1, "ffi_provid": 21, "ffi_queryplann": [1, 21], "ffi_schemaprovid": 21, "ffi_tablefunct": 36, "ffi_tableprovid": [21, 53], "ffi_tableproviderfactori": 55, "ffi_task_context_provider_from_pycapsul": [21, 55], "ffi_taskcontextprovid": [1, 21, 55], "field": [2, 3, 5, 6, 7, 14, 19, 21, 31, 36, 43, 55], "field_nam": 5, "fight": [28, 38], "file": [1, 2, 6, 7, 9, 10, 11, 14, 17, 21, 23, 24, 26, 27, 34, 36, 39, 42, 43, 44, 45, 46, 48, 49, 51, 52], "file_compression_typ": [1, 7, 11, 14], "file_extens": [1, 7, 11, 14], "file_group": 36, "file_partition_col": [1, 7, 11], "file_sort_ord": [1, 7, 11, 14], "file_typ": 36, "filenam": 23, "filetyp": 4, "fill": [2, 4, 5, 7, 14, 31, 38, 44], "fill_nan": [4, 7], "fill_nul": [2, 4, 7, 32], "filter": [2, 4, 5, 6, 7, 14, 15, 27, 30, 35, 36, 37, 38, 40, 41, 42, 55], "filterexec": [7, 15, 36, 41], "final": [7, 12, 15, 27, 36, 41, 44], "find": [2, 5, 21, 23, 27, 28, 38], "find_in_set": 5, "find_qualified_column": 2, "fine": [21, 30, 44], "finer": 42, "finish": [4, 28], "fire": [24, 28, 31, 40, 46], "first": [1, 2, 4, 5, 6, 7, 15, 21, 23, 26, 27, 28, 30, 36, 38, 40, 42, 46, 55], "first_1": 28, "first_2": 28, "first_arrai": 5, "first_nam": 42, "first_valu": [5, 19, 28], "fix": [0, 19, 21], "flag": [3, 5, 18, 19, 23, 28, 36, 55], "flat": 4, "flatten": [4, 5, 7], "fleur": 31, "flexibl": 42, "float": [2, 4, 5, 6, 7, 19, 36, 43, 54], "float64": [4, 5, 7, 19, 31, 36], "floor": [4, 5, 6, 7, 35], "floor_df": 5, "flow": [7, 15, 21], "flower": 31, "fly": [24, 28, 38, 40, 46], "fmt": 6, "fn": [1, 21, 36, 53, 55], "focus": 21, "folder": [21, 36, 40, 53], "follow": [0, 1, 2, 4, 5, 6, 7, 15, 19, 21, 23, 26, 27, 28, 30, 31, 33, 35, 36, 38, 40, 41, 46, 54, 55], "foo": [4, 7, 39], "footer": [3, 36], "fora": [4, 7], "forc": 21, "foreign": [21, 55], "foreign_provid": 21, "foreignqueryplann": 21, "foreigntableprovid": 21, "fork": 44, "forkserv": 44, "form": [2, 4, 5, 6, 7, 15, 28, 30, 36, 40, 55], "format": [1, 2, 3, 4, 5, 6, 7, 14, 15, 27, 39, 40, 42, 43, 44, 48, 51, 54], "format_argu": 5, "format_html": 3, "format_str": [3, 6], "formatt": [2, 3, 5, 7], "formatted_valu": 3, "formattermanag": 3, "forth": 47, "forward": [19, 30], "found": [1, 2, 5, 23, 38, 49, 53, 55], "four": [36, 44], "fox": 5, "frame": [2, 4, 5, 7, 19, 29, 36], "frame_bound": 4, "framework": 23, "free": [1, 7], "frequent": [21, 23], "fresh": [1, 21, 35, 36, 41, 43, 44], "friend": 1, "friendli": 1, "from": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 17, 19, 22, 23, 24, 26, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 46, 48, 49, 50, 51, 52, 53, 54, 55], "from_arrai": [5, 36, 40, 42], "from_arrow": [1, 6, 40, 42, 47], "from_byt": [1, 4, 7, 15, 44], "from_dataset": [0, 7], "from_dens": 5, "from_json": 17, "from_panda": [1, 42], "from_polar": [1, 40], "from_proto": [7, 15], "from_py_object": 21, "from_pycapsul": [7, 19], "from_pydict": [1, 2, 4, 5, 6, 7, 19, 28, 29, 30, 33, 35, 36, 37, 40, 44, 47], "from_pylist": [1, 33, 40], "from_str": 2, "from_stream": 42, "from_substrait_plan": 17, "from_unixtim": [4, 5, 7], "from_utc_timestamp": 6, "from_val": 5, "front": [5, 44], "frozen": [21, 23], "fulfil": 28, "full": [2, 5, 7, 28, 30, 32, 35, 38, 42, 43, 44, 53, 54, 55], "full_nam": 42, "fulli": [2, 23, 33, 39, 41, 43, 44], "func": [1, 2, 7, 19, 36], "function": [1, 2, 13, 16, 20, 21, 26, 27, 29, 32, 39, 40, 43, 44, 45, 52, 55], "function_to_impl": [19, 36], "functool": 36, "further": [1, 5, 21], "futur": [19, 21, 38], "g": [1, 4, 5, 6, 7, 12, 15, 19, 36, 41, 44], "gamma": 40, "gastli": [28, 38], "gate": 30, "gather": 42, "gaug": [7, 15], "gcd": 5, "gemini": 26, "gen_seri": 5, "gener": [1, 4, 7, 15, 16, 17, 19, 20, 21, 23, 24, 40, 42, 46, 54], "generate_seri": 5, "gengar": 38, "gengarmega": 38, "genuin": [28, 36], "geodud": 38, "get": [2, 3, 5, 7, 15, 17, 19, 21, 23, 28, 30, 33, 40, 42, 43, 54, 55], "get_cell_styl": [3, 43], "get_context": 44, "get_default_level": 2, "get_field": 5, "get_formatt": [3, 43], "get_frame_unit": [4, 7], "get_header_styl": [3, 43], "get_lower_bound": [4, 7], "get_offset": 4, "get_rang": 19, "get_sender_ctx": 12, "get_tokio_runtim": 21, "get_upper_bound": [4, 7], "get_worker_ctx": 12, "getattr": 55, "getenv": 40, "getter": 55, "ghost": [28, 38], "gil": 24, "git": 23, "github": [23, 25, 26], "give": [5, 7, 15, 28, 34, 41, 46], "given": [0, 1, 2, 3, 4, 5, 6, 7, 15, 19, 36], "glanc": 21, "global": [1, 2, 3, 4, 7, 11, 12, 15, 41, 42, 43, 44], "global_ctx": [1, 44], "go": [4, 7, 21, 29, 31, 35], "goe": 21, "gold": 5, "good": [21, 23], "googlecloud": [1, 13, 40], "grand": [4, 5, 28], "grand_tot": 7, "graph": [2, 7, 15], "graphic": [7, 15], "graphviz": [2, 7, 15], "grass": [24, 28, 31, 38, 40, 46], "great": 23, "greater": [4, 5, 7], "greatest": 5, "greatli": [36, 39], "greedi": [1, 7], "green": 30, "grimer": 38, "ground": 28, "group": [1, 2, 4, 5, 7, 11, 19, 27, 29, 30, 32, 36, 38, 42], "group_bi": [2, 28], "grouping_set": [2, 4, 5, 28], "groupingset": [2, 4, 5, 28], "grow": 30, "guarante": [2, 7, 21, 55], "guess": 26, "guid": [1, 2, 7, 26, 32, 39, 42, 43, 46, 53], "guidanc": [26, 42], "guidelin": 22, "gz": 49, "gzip": [2, 7, 14, 49], "h": [1, 5, 6, 30, 35], "ha": [1, 2, 3, 4, 5, 7, 14, 15, 19, 21, 26, 28, 30, 34, 36, 40, 41, 44, 54, 55], "had": 44, "hahaha": 5, "half_up": [1, 6, 31, 35], "hand": [1, 21, 26, 36, 55], "handl": [1, 3, 5, 7, 16, 19, 21, 28, 32, 35, 38, 39, 44, 45, 54, 55], "handshak": 26, "happen": [1, 21, 23], "hardwar": 39, "has_big": 30, "has_head": [1, 7, 11, 14], "has_mor": [2, 3], "hasattr": 55, "hash": [2, 4, 5, 6, 7, 35, 39], "hashaggregateexec": 41, "haskel": 29, "hat": 5, "haunter": 38, "have": [1, 2, 5, 7, 11, 14, 17, 19, 21, 23, 24, 28, 30, 33, 36, 38, 39, 40, 41, 44, 49, 53, 54], "hazard": 55, "head": 2, "header": [1, 2, 3, 7, 11, 14, 49], "healthi": 23, "heavy_red_unit": 30, "height": [3, 43], "hel": 6, "held": 44, "hello": [1, 5, 6, 35], "hello123": 5, "hello_from_datafus": 5, "helo": 5, "help": [1, 3, 7, 11, 21, 23, 30, 31, 39, 43], "helper": [1, 2, 4, 7, 19, 44, 55], "henc": 19, "here": [1, 2, 4, 5, 7, 21, 31, 34, 36, 38, 39, 44, 46, 47, 53, 54], "hex": [5, 6], "hexadecim": [4, 5, 6, 7], "hh": 5, "hi": [5, 6], "hierarch": [28, 40], "hierarchi": 28, "high": [2, 4, 7, 30], "higher": [2, 4, 5, 7, 30, 39], "higherorderfunct": 4, "highli": 36, "highlight": 46, "hint": [1, 7, 19, 23], "histogram": 6, "hive": 54, "hold": [1, 7, 12, 19, 21, 36, 55], "homebrew": 23, "honor": [4, 7, 44], "hood": [40, 44], "hook": [4, 7, 22, 55], "hop": 21, "host": [1, 6, 21], "hour": [5, 6], "how": [1, 2, 4, 5, 7, 12, 15, 19, 21, 22, 26, 28, 29, 30, 32, 33, 36, 38, 39, 40, 42, 43, 44, 46, 49, 54], "howev": [19, 36, 41], "hp": [24, 40, 46], "html": [1, 2, 3, 5, 7, 18, 43, 45], "http": [1, 2, 5, 6, 7, 13, 15, 17, 18, 26, 40], "human": 1, "hundr": 44, "hyperbol": [4, 5, 7], "i": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 18, 19, 23, 24, 27, 28, 30, 31, 33, 35, 36, 38, 39, 40, 41, 42, 43, 44, 45, 46, 48, 49, 51, 52, 53, 54, 55], "ic": [28, 38], "iceberg": 45, "iceberg_t": 40, "id": [1, 2, 3, 21, 23, 33, 36, 42], "ideal": 21, "idempot": 12, "ident": [1, 2, 4, 5, 21, 33, 40], "identifi": [1, 4, 7, 15, 21, 28, 34, 39, 40, 41], "identity_demo": 1, "idiom": 36, "idiomat": [26, 30], "idl": [2, 7], "idx": [19, 36], "if_": 6, "if_fals": 6, "if_tru": 6, "ifnul": 5, "ignor": [1, 5, 7, 14, 19, 21, 23, 28, 38, 44, 55], "ignore_nul": [5, 28, 38], "ilik": [4, 6], "illustr": 21, "imag": 5, "immut": [1, 4, 7, 19, 21, 26, 36, 44], "impact": [2, 39], "impl": [36, 53, 55], "implement": [0, 1, 2, 3, 7, 19, 22, 23, 30, 35, 36, 40, 42, 43, 47, 53, 54, 55], "implicit": 44, "import": [1, 2, 3, 4, 5, 6, 7, 12, 19, 21, 24, 26, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 40, 41, 42, 43, 44, 46, 48, 49, 50, 51, 52, 53, 54, 55], "importerror": 55, "impos": 44, "improv": [1, 3, 7, 19, 22, 36, 39, 40, 43, 55], "in_list": [5, 26, 30, 31, 36], "inbound": 44, "includ": [1, 2, 3, 4, 5, 7, 15, 19, 21, 27, 28, 31, 33, 36, 39, 41, 42, 43, 55], "include_rank": [19, 36], "inclus": [1, 4, 5, 7], "incom": 44, "incomplet": 49, "incorpor": 36, "increas": [1, 2, 3, 7, 28, 39], "increment": [2, 19, 21, 36, 47], "incur": 36, "indent": [2, 7, 15], "independ": [1, 5, 7, 12, 15, 21, 30, 38], "index": [1, 2, 3, 4, 5, 6, 7, 15, 18, 19, 30, 31, 35, 41], "indic": [3, 4, 5, 7, 30], "individu": [2, 7, 15, 28, 30, 38, 41, 43], "infer": [1, 7, 11, 14], "info": 5, "inform": [1, 2, 4, 5, 7, 8, 17, 18, 19, 21, 36, 39, 42], "information_schema": [1, 7], "infrastructur": 39, "inherit": [40, 44], "init": [23, 44], "init_work": [12, 44], "initcap": [4, 5, 7], "initi": [2, 3, 4, 5, 7, 12, 14, 15, 44], "inject": [7, 19, 36], "inlin": [1, 4, 7, 12, 19, 21, 28, 38], "inlist": 4, "inner": [2, 5, 21, 32, 42, 55], "inner_product": 5, "input": [1, 2, 4, 5, 6, 7, 11, 14, 15, 19, 20, 30, 36, 44], "input_column": 2, "input_field": [7, 19], "input_item": [8, 9, 10], "input_partit": 36, "input_typ": [7, 19], "inputsourc": 8, "ins": [1, 4, 6, 7, 12, 28, 35, 44], "insensit": [5, 6], "insert": [1, 2, 7, 55], "insert_oper": [2, 7], "insertop": [2, 7], "insid": [1, 4, 5, 7, 12, 15, 19, 21, 28, 35, 36, 38, 41, 44, 53, 55], "insight": 39, "inspect": [1, 41], "inspir": 22, "instal": [1, 4, 7, 12, 15, 19, 22, 44, 45, 55], "instanc": [1, 2, 3, 4, 5, 7, 12, 19, 21, 27, 43], "instanti": [2, 7, 19], "instead": [1, 2, 3, 4, 5, 7, 21, 26, 36, 39, 40, 42, 44, 49, 55], "instr": 5, "insubqueri": 4, "insuffici": 40, "int": [1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 19, 36, 43, 54], "int32": [5, 6, 31], "int64": [1, 4, 5, 6, 7, 19, 29, 31, 36, 44], "int64arrai": 1, "int8": 5, "integ": [3, 4, 5, 6, 7, 19, 30, 36], "integr": [2, 21, 26, 40, 42, 44, 46, 53], "intend": [7, 14, 21], "intens": 39, "interact": [3, 19, 21, 30, 40], "intercept": 5, "interchang": [7, 16, 51], "interest": 30, "interfac": [0, 1, 2, 7, 16, 21, 24, 27, 28, 36, 38, 40, 42, 47, 53, 55], "interior": 21, "intermedi": [7, 19, 41], "intern": [0, 4, 7, 14, 19, 21, 36, 41], "interpol": 5, "interpret": [4, 5, 6, 7], "intersect": [2, 5], "interv": [5, 6], "into_view": 2, "intro": 23, "introduc": [23, 27, 39, 54], "introduct": [22, 45], "intuit": 21, "invalid": [3, 6, 7], "invers": [4, 5, 7], "invis": [21, 36, 44], "invoc": [7, 19, 36], "invok": [1, 4, 7, 19, 47], "involv": 21, "io": [1, 2, 7, 17, 20, 43, 45], "io_avro": 42, "io_csv": 42, "io_json": 42, "io_parquet": 42, "ipc": [1, 2, 4, 7, 20, 28, 38, 44], "is_caus": 19, "is_correct_input": [8, 9, 10], "is_current_row": 4, "is_empti": 30, "is_follow": 4, "is_high_prior": 30, "is_nan": [4, 5, 7], "is_not_nul": [4, 7, 28, 30], "is_nul": [1, 4, 7, 30, 36], "is_null_arr": 36, "is_preced": 4, "is_unbound": 4, "is_valid_utf8": 6, "isfals": 4, "isinst": [1, 4, 7, 12, 43], "isnan": [4, 5, 7], "isnotfals": 4, "isnotnul": [4, 7], "isnottru": 4, "isnotunknown": 4, "isnul": 4, "isoformat": 6, "issu": [3, 5, 6, 22, 23, 25, 43], "istru": 4, "isunknown": 4, "iszero": [4, 5, 7], "item": [4, 28, 36], "iter": [1, 2, 4, 7, 16, 41, 42], "its": [1, 2, 5, 7, 12, 15, 19, 21, 24, 26, 28, 30, 36, 38, 41, 43, 44, 55], "itself": [7, 12, 19, 30, 36], "ivi": 31, "ivyfleur": 31, "ivysaur": [24, 31, 38, 40, 46], "iz": 5, "java": [29, 44], "javascript": [3, 43, 51], "jigglypuff": 38, "join": [1, 2, 4, 7, 15, 30, 32, 36, 39, 42, 45], "join_kei": [2, 33], "join_on": [2, 33, 42], "joinconstraint": 4, "jointyp": 4, "json": [1, 2, 6, 7, 11, 17, 40, 42, 43, 45, 50], "json_tupl": 6, "jupyt": [3, 42, 43, 46], "jupyterlab": 46, "just": [2, 36, 44], "justif": 21, "jynx": [28, 38], "k": 5, "k1": 5, "k2": 5, "kabuto": 38, "kakuna": [24, 38, 40, 46], "keep": [1, 2, 5, 21, 23, 26, 30, 36, 37, 40, 43, 55], "kei": [1, 2, 3, 4, 5, 6, 7, 15, 21, 27, 28, 30, 32, 39, 41, 42], "kept": 2, "keyerror": 1, "keyvaluedelim": 6, "keyword": [1, 6, 7, 19, 30, 36, 55], "kind": [0, 7, 21, 23], "kitten": 5, "know": [1, 7], "known": [5, 30], "kv_meta": [2, 7], "kwarg": [3, 7, 8, 9, 10], "l": 2, "l2": 5, "lab": 46, "label": [2, 4, 7, 15], "lack": 24, "lag": [5, 19, 38], "lake": 45, "lambda": [1, 4, 5, 7, 19, 32, 43, 44], "lambda_": [5, 30], "lambda_var": [5, 30], "lambdavari": 4, "land": 44, "languag": [1, 7, 15, 21, 44], "larg": [2, 3, 7, 31, 39, 43, 44], "large_trip_dist": 34, "larger": [2, 7], "largest": 6, "last": [2, 4, 5, 6, 7, 38, 55], "last_dai": 6, "last_nam": 42, "last_valu": [5, 28, 38], "last_with_nul": 38, "last_wo_nul": 38, "late": 1, "latenc": 39, "later": [1, 40, 46, 53], "latest": [5, 7, 18, 21], "latter": 1, "layer": [1, 21], "layout": 55, "lazi": [2, 7, 26, 27, 42, 44], "lazili": [2, 42, 47], "lcm": 5, "lead": [5, 19, 21, 36, 38, 40], "leaf": [7, 15], "leak": [21, 24], "learn": [21, 29, 38], "least": [5, 7, 15, 19, 28, 33, 36, 43], "leav": [7, 15, 21], "left": [2, 5, 6, 30, 31, 32, 43], "left_df": 5, "left_on": [2, 33], "leftmost": 5, "legendari": [24, 40, 46], "len": [5, 6, 19, 31], "length": [2, 3, 4, 5, 6, 7, 14, 19, 44], "less": [4, 5, 7, 14], "lesson": 21, "let": [4, 7, 21, 28, 36, 39, 47, 53, 55], "letter": [4, 5, 7, 34], "level": [2, 4, 5, 6, 7, 28, 40, 45], "levenshtein": 5, "leverag": [2, 7, 21], "lib": [1, 23], "lib_dir": 23, "lib_nam": 23, "librari": [1, 7, 8, 16, 22, 24, 44, 45, 46, 47, 53], "lieu": [7, 19], "life": 21, "lifetim": [12, 35, 44, 55], "lightweight": 51, "like": [1, 2, 3, 4, 5, 6, 7, 8, 21, 23, 24, 28, 31, 35, 36, 40, 42, 54, 55], "limit": [1, 2, 3, 4, 5, 23, 27, 29, 31, 39, 41, 42, 43, 54], "line": [1, 2, 7, 11, 14, 15, 21, 26, 28, 36, 49], "linear": [5, 28], "link": [23, 26], "lint": 23, "linter": 23, "linux": 44, "list": [0, 1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 19, 28, 32, 35, 36, 37, 38, 40, 41, 42, 55], "list_": [6, 36], "list_any_match": 5, "list_any_valu": 5, "list_append": [5, 23], "list_cat": 5, "list_compact": 5, "list_concat": 5, "list_contain": 5, "list_dim": [4, 5, 7], "list_dist": 5, "list_distinct": [4, 5, 7], "list_el": 5, "list_empti": 5, "list_except": 5, "list_extract": 5, "list_filt": 5, "list_ha": 5, "list_has_al": 5, "list_has_ani": 5, "list_indexof": 5, "list_intersect": 5, "list_join": 5, "list_length": [4, 5, 7], "list_max": 5, "list_min": 5, "list_ndim": [4, 5, 7], "list_norm": 5, "list_overlap": 5, "list_pop_back": 5, "list_pop_front": 5, "list_posit": 5, "list_prepend": 5, "list_push_back": 5, "list_push_front": 5, "list_remov": 5, "list_remove_al": 5, "list_remove_n": 5, "list_repeat": 5, "list_replac": 5, "list_replace_al": 5, "list_replace_n": 5, "list_res": 5, "list_revers": 5, "list_slic": 5, "list_sort": 5, "list_tabl": 36, "list_to_str": 5, "list_transform": 5, "list_union": 5, "list_zip": 5, "lit": [2, 4, 5, 6, 7, 12, 23, 27, 28, 30, 34, 35, 36, 38, 42, 47], "liter": [2, 4, 5, 6, 7, 31, 32, 34, 36, 37, 42], "literal_with_metadata": [4, 7], "littl": 36, "live": [6, 21, 26, 28, 35, 36, 44, 55], "ll": [31, 33, 38], "llm": 26, "llmstxt": 26, "llo": 5, "ln": [4, 5, 7], "load": [1, 3, 4, 7, 12, 26, 39, 40, 44], "load_catalog": 40, "local": [1, 4, 7, 12, 21, 23, 39, 44, 45, 55], "localfilesystem": [13, 40], "locat": [1, 9, 20], "locationinputplugin": [9, 10], "lock": 24, "log": [5, 31], "log10": [4, 5, 7], "log2": [4, 5, 7], "logarithm": [4, 5, 7], "logic": [1, 2, 4, 6, 7, 15, 17, 18, 21, 27, 28, 34, 36, 41, 42, 44, 53, 55], "logical_plan": [1, 2, 17], "logicalextensioncodec": [4, 7, 15, 55], "logicalextensioncodecexport": [1, 19], "logicalplan": [1, 2, 4, 7, 15, 17, 18, 21], "lonely_trip": 34, "long": [3, 6, 12, 21, 44], "long_tim": 30, "longer": [5, 43, 55], "look": [1, 2, 4, 7, 19, 21, 23, 36, 39], "lookup": [1, 5, 36], "loop": [7, 15, 36, 41, 42], "lose": 36, "loss": 54, "low": [4, 7, 28, 30], "low_passenger_count": 34, "lower": [2, 4, 5, 7, 19, 31, 34], "lower_df": 5, "lowercas": [1, 2, 4, 5, 7], "lowest": [21, 28], "lpad": 5, "lpad_df": 5, "ltrim": [4, 5, 7], "luhn": 6, "luhn_check": 6, "lval": 2, "lz4": [2, 7], "lz4_raw": [2, 7], "lzo": [2, 7], "m": [4, 5, 23, 36, 41], "mac": 23, "machin": [23, 26], "machineri": 44, "machop": 38, "maco": 44, "made": [21, 34, 36, 55], "magikarp": 28, "magnemit": 38, "magnitud": 5, "mai": [1, 2, 4, 5, 6, 7, 11, 12, 14, 15, 19, 21, 36, 39, 40, 41, 43, 44, 46, 54], "mail": 30, "main": [1, 26, 27, 42, 44], "maintain": [1, 2, 21, 27, 54], "major": [4, 7, 12, 23, 24, 44, 55], "make": [5, 21, 23, 24, 31, 44, 55], "make_arrai": [5, 30], "make_d": 5, "make_dt_interv": 6, "make_interv": 6, "make_list": 5, "make_map": 5, "make_tim": 5, "make_valid_utf8": 6, "manag": [1, 3, 7, 23, 39, 43], "mani": [3, 7, 15, 21, 28, 36, 39, 42, 43, 44], "manipul": [1, 7, 31, 42], "mankei": [28, 38], "manner": 21, "manual": [23, 26, 39, 44], "map": [2, 5, 6, 7, 26, 30, 44, 54], "map_entri": 5, "map_extract": 5, "map_from_arrai": 6, "map_from_entri": 6, "map_kei": 5, "map_valu": 5, "market": 30, "match": [1, 2, 4, 5, 6, 7, 14, 21, 30, 31, 33, 36, 39, 44, 55], "materi": [1, 2, 36, 42, 47], "math": [5, 28, 35], "mathemat": [6, 32, 34, 42], "maturin": 23, "max": [5, 6, 28, 29, 36], "max_cell_length": [3, 7, 43], "max_cpu_usag": 39, "max_height": [3, 7, 43], "max_memory_byt": [3, 43], "max_row": [3, 43], "max_row_group_s": [2, 7], "max_siz": 36, "max_width": [3, 7, 43], "maxim": 45, "maximum": [1, 2, 3, 5, 7, 11, 14, 43], "maximum_buffered_record_batches_per_stream": [2, 7], "maximum_parallel_row_group_writ": [2, 7], "md": 26, "md5": [4, 5, 7], "mean": [3, 5, 6, 21, 23, 28, 29], "meaning": [5, 7, 15, 34, 41], "meant": [7, 15], "meantim": 44, "measur": [5, 30, 39, 41], "mechan": 36, "med": 36, "medal": 5, "median": [5, 28, 29], "medium": 30, "meet": 28, "member": [23, 28], "membership": [26, 28, 32], "memoiz": 19, "memori": [0, 1, 2, 3, 7, 15, 19, 24, 39, 41, 44, 45, 47], "memory_catalog": [0, 7, 40], "memory_limit": 1, "memory_schema": [0, 40], "memtabl": 55, "mention": [2, 30], "merg": [7, 19, 33, 36], "messag": [1, 3, 12, 43, 55], "met": 28, "meta": 5, "meta_v": 5, "metadata": [1, 2, 4, 5, 7, 11, 19, 21, 36], "metapod": [24, 38, 40, 46], "method": [0, 1, 2, 3, 4, 5, 7, 11, 14, 19, 27, 29, 31, 33, 36, 37, 42, 44, 53, 55], "metric": [2, 5, 7, 15, 45], "metrics_set": 41, "metricsset": [7, 15, 41], "metrorid": 33, "microsecond": [5, 6], "microsoftazur": [1, 13, 40], "might": [3, 19, 28, 43], "millisecond": [5, 6], "min": [5, 6, 28, 29, 36], "min_qti": 36, "min_row": [3, 43], "minimum": [1, 2, 3, 5, 7, 43], "minor": [4, 7, 12, 44], "mint": 21, "minu": 6, "minut": [5, 6], "mirror": [6, 28, 41], "misbehav": 44, "mismatch": [4, 7, 44], "miss": [1, 7, 14, 23, 26, 32, 45], "mistak": 55, "mix": 2, "mkdtemp": 36, "mm": 5, "mod": [6, 35], "mode": [1, 2, 5, 7, 35], "model": [1, 2, 12, 26, 28, 38, 44], "modifi": [2, 7, 27, 43], "modul": [5, 7, 21, 35, 38, 42, 43, 44], "modulo": [4, 7], "modulu": 6, "moment": [2, 21], "mon": 6, "monitor": 39, "month": [5, 6, 31], "more": [1, 2, 3, 4, 5, 7, 15, 17, 19, 21, 23, 27, 28, 30, 31, 36, 39, 41, 42, 44], "most": [1, 5, 12, 19, 21, 26, 28, 30, 35, 36, 38, 41, 44, 46], "mostli": 23, "mp": 44, "mp_ctx": 44, "much": [5, 7, 15, 19, 23, 43], "multi": [1, 5, 24], "multipl": [1, 2, 3, 4, 5, 7, 19, 22, 28, 31, 33, 36, 38, 39, 40, 41, 42, 43], "multipli": [7, 19], "multiprocess": [12, 44], "multiprocessing_pickle_expr": 44, "must": [1, 2, 3, 4, 5, 6, 7, 12, 14, 19, 21, 28, 30, 34, 36, 38, 41, 44, 47, 53, 54, 55], "mutabl": [22, 23, 44], "mutat": [1, 7, 19, 21, 36, 55], "my": 1, "my_capsul": 21, "my_catalog": 40, "my_catalog_nam": 40, "my_cell_build": 43, "my_delta_t": 40, "my_extens": 1, "my_ffi_aggreg": [12, 44], "my_filt": 55, "my_header_build": 43, "my_provid": 21, "my_schema": 40, "my_schema_nam": 40, "my_tabl": [1, 37], "my_udaf": 36, "my_udf": 21, "myaccumul": 36, "mycatalogprovid": 55, "mylib": [4, 7, 44], "myphysicaloptimizerrul": 1, "mysql": [18, 54], "mystyleprovid": 43, "mytablefunct": 36, "mytableprovid": [21, 53], "myusernam": 23, "n": [1, 2, 4, 5, 6, 7, 41, 49], "n_column": [2, 7], "n_file": [2, 7], "n_row_group": [2, 7], "name": [0, 1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 19, 21, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 38, 40, 41, 43, 44, 45, 46, 54, 55], "name_pair": 5, "named_expr": 2, "named_param": 1, "named_struct": [5, 23], "namespac": [6, 28, 32], "nan": [4, 5, 7], "nanoarrow": [7, 19, 36], "nanosecond": [5, 7, 15, 41], "nanvl": 5, "nanvl_df": 5, "narrow": [1, 44], "narrowli": 21, "nativ": [4, 6, 21, 36, 40], "native_filt": 36, "natur": [4, 5, 7, 28, 36], "nearest": [4, 5, 6, 7], "nearli": [39, 40], "necessari": [21, 40, 55], "need": [0, 1, 2, 3, 4, 7, 11, 12, 14, 19, 21, 23, 28, 30, 36, 38, 39, 40, 42, 43, 44, 46, 53, 54, 55], "neg": [4, 5, 6, 35], "negat": [4, 5, 7, 31], "neither": [21, 28], "nest": [1, 2, 4, 5, 28, 39], "network": 39, "never": [2, 12, 21, 44, 55], "new": [1, 2, 3, 4, 5, 7, 18, 19, 21, 23, 30, 32, 36, 53, 54, 55], "new_bound": 21, "new_fil": 1, "new_nam": 2, "new_with_ffi_codec": [21, 53, 55], "new_with_valu": [21, 53, 55], "newlin": [7, 14], "newlines_in_valu": [7, 14], "next": [5, 7, 16, 21], "next_dai": 6, "nnnnnnnnn": 5, "node": [7, 15, 21, 41, 44], "non": [1, 2, 4, 5, 6, 7, 15, 28, 33, 38, 42, 44], "none": [0, 1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 16, 17, 19, 21, 28, 30, 36, 38, 40, 41, 43, 44, 53, 54, 55], "nonexistent_rul": 1, "nonnul": [21, 55], "nor": 21, "norm": 5, "normal": [1, 5, 28], "not_in": 5, "not_red_unit": 30, "notat": [30, 51], "note": [1, 2, 4, 7, 27, 30, 40, 42], "notebook": [3, 41, 42, 43, 46], "noth": [21, 44, 55], "notic": [28, 36], "notimplementederror": 6, "now": [5, 19, 21, 31, 33, 36, 37], "np": 5, "npx": 26, "nr": 29, "nt": 5, "nth": 5, "nth_valu": [5, 19, 28], "ntile": [5, 38], "null": [1, 2, 4, 5, 6, 7, 14, 29, 30, 31, 33, 35, 36, 47, 49], "null_check": 1, "null_count": 29, "null_first": 5, "null_regex": [7, 14], "null_str": 5, "null_treat": [4, 5, 6, 7, 28, 38], "nullabl": [2, 5, 7, 14, 19, 36], "nullcheck": 1, "nullif": [5, 31], "nulls_first": [4, 5, 7, 28], "nulltreat": [4, 5, 6, 7, 28, 38], "num": [2, 5, 39, 54], "num_centroid": 5, "num_el": 30, "num_row": [7, 19, 36], "number": [1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 19, 23, 30, 31, 36, 38, 39, 41, 43, 54], "numbit": 6, "numbucket": 6, "numer": [2, 3, 4, 5, 6, 7, 35, 36, 39], "nvl": 5, "nvl2": 5, "nvl_df": 5, "o": [1, 5, 36, 39, 40, 41, 42, 43], "obj": 55, "object": [1, 2, 3, 4, 5, 7, 13, 14, 15, 16, 17, 19, 21, 30, 36, 39, 41, 42, 44, 45, 47, 51, 54, 55], "object_stor": [1, 7, 20, 40], "objectstor": 1, "observ": 44, "obtain": [2, 8, 24, 42], "obviou": 21, "occasion": 21, "occupi": 44, "occur": [7, 19, 42], "occurr": 5, "octet_length": [4, 5, 7], "oddish": 38, "off": 21, "offend": 23, "offer": [30, 31, 42, 54], "offici": 21, "offset": [2, 4, 5], "often": [30, 36, 38, 39], "ok": 55, "old": [2, 55], "old_nam": 2, "older": [21, 40], "olleh": 5, "olymp": 5, "omanyt": 28, "omit": [6, 33], "on_expr": 2, "onc": [2, 3, 5, 8, 12, 19, 21, 28, 30, 36, 41, 43, 44, 47, 53], "one": [1, 2, 4, 5, 6, 7, 15, 19, 28, 30, 33, 36, 38, 40, 41, 42, 44, 53, 55], "ones": [1, 21], "onli": [1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 16, 19, 21, 28, 30, 31, 33, 36, 38, 41, 42, 43, 44], "onlin": [1, 2, 4, 5, 7, 19, 21, 39], "oop": [4, 5, 7], "op": [2, 4, 5, 7], "opaqu": 36, "open": [3, 23, 26], "oper": [1, 2, 4, 5, 7, 15, 16, 19, 21, 24, 26, 28, 30, 34, 36, 38, 39, 40, 41, 45], "operand": [4, 7], "operatefunctionarg": 4, "operator_nam": 41, "opposit": [4, 5], "opt": [21, 23, 28, 36], "optim": [1, 2, 19, 21, 36, 39], "optimized_logical_plan": 2, "option": [0, 1, 2, 4, 5, 6, 7, 11, 19, 20, 23, 26, 27, 28, 30, 31, 39, 40, 42, 46, 49, 54], "options_intern": [1, 7], "or_": 36, "order": [1, 2, 4, 5, 7, 8, 11, 14, 15, 19, 21, 30, 44], "order_bi": [2, 4, 5, 6, 7, 28, 38], "order_id": 28, "orders_df": 28, "org": [1, 2, 5, 7, 15, 26], "organ": 40, "orient": [7, 26], "origin": [1, 2, 4, 5, 7, 21, 36, 40, 54, 55], "orphan": 21, "orthogon": 5, "other": [1, 2, 3, 4, 5, 7, 11, 15, 19, 21, 23, 24, 26, 27, 28, 30, 32, 35, 36, 39, 41, 42, 45, 49, 55], "otherwis": [4, 5, 7, 12, 21, 30], "our": [21, 23, 28, 40, 46], "out": [2, 5, 7, 21, 28, 44, 55], "outbound": [12, 44], "outdat": 55, "outer": [5, 21], "outermost": [7, 15], "outliv": 21, "output": [2, 3, 4, 5, 7, 15, 19, 23, 28, 30, 36, 37, 41, 43], "output_column": 2, "output_row": [7, 15, 41], "output_typ": [7, 15, 41], "over": [2, 3, 4, 5, 7, 16, 19, 21, 24, 28, 30, 36, 38, 40, 41, 42, 43, 44, 49], "overal": [5, 28], "overflow": 6, "overhead": [19, 44], "overlai": 5, "overlap": 5, "overrid": [1, 2, 6, 7, 35, 36], "overridden": 28, "overview": [2, 45], "overwrit": [2, 5, 7, 12], "own": [1, 5, 7, 8, 12, 19, 21, 36, 43, 44, 55], "owner": [0, 21], "owner_nam": 0, "ownership": 21, "p": 35, "pa": [1, 4, 5, 6, 7, 16, 19, 36, 40, 42, 44, 47], "packag": [4, 21, 23, 55], "pad": [5, 43], "page": [2, 7, 20, 21, 36, 44], "pair": [1, 5, 6, 12, 28, 41, 44], "pairdelim": 6, "panda": [1, 2, 5, 7, 27, 29, 40, 42, 54], "pandas_df": [40, 42], "para": 38, "parallel": [1, 2, 6, 7, 14, 39, 41, 44], "param": 5, "param_attack": 54, "param_nam": 3, "param_valu": [1, 54], "paramet": [0, 1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 16, 17, 19, 21, 23, 30, 32, 33, 43, 54, 55], "parameter": [1, 45], "parametr": 44, "parasect": 38, "parent": 44, "pariti": 6, "parquet": [0, 1, 2, 7, 11, 21, 24, 27, 34, 36, 39, 40, 42, 43, 45, 50], "parquet_path": 36, "parquet_prun": [1, 7, 11], "parquetcolumnopt": [2, 7], "parquetwriteropt": [2, 7], "pars": [1, 2, 5, 7, 14, 17, 30], "parse_capacity_limit": 1, "parse_sql_expr": [1, 2], "parse_url": 6, "parser": 54, "part": [1, 2, 5, 6, 7, 28, 31], "partial": 28, "particular": [5, 21, 28, 39, 55], "partit": [1, 2, 4, 5, 7, 11, 14, 15, 19, 28, 36, 39, 42, 44], "partition_bi": [2, 4, 5, 7, 38], "partition_count": [7, 15], "parttoextract": 6, "pass": [1, 2, 4, 5, 6, 7, 12, 19, 21, 23, 28, 29, 30, 36, 39, 40, 42, 44, 54, 55], "passenger_count": 34, "past": [26, 30], "path": [1, 2, 4, 5, 6, 7, 11, 15, 17, 19, 21, 23, 36, 40, 42, 44], "path_to_t": 40, "pathlib": [1, 2, 7, 11, 17], "pattern": [1, 2, 5, 6, 7, 14, 21, 26, 30, 39, 44], "payload": [4, 7, 12, 44], "pc": [7, 19], "pcre": 5, "pd": [40, 42], "peopl": [5, 21], "per": [2, 3, 5, 7, 12, 14, 15, 19, 28, 30, 35, 36, 38, 42, 43, 44], "percent": 5, "percent_rank": [5, 19, 38], "percentag": 5, "percentil": [5, 28], "percentile_cont": [5, 28], "perform": [1, 2, 3, 4, 5, 7, 14, 19, 21, 23, 27, 28, 31, 36, 38, 39, 40, 55], "period": 21, "permut": 6, "persist": [44, 54], "person": 23, "pgjson": [2, 7], "phonet": 6, "physic": [1, 2, 7, 15, 21, 27, 44], "physical_codec_from_pycapsul": 55, "physical_optimizer_rule_from_pycapsul": 55, "physicalextensioncodec": [7, 15, 55], "physicalextensioncodecexport": [1, 19], "physicaloptimizerruleexport": 1, "pi": 5, "pick": [1, 4, 5, 7, 21, 26], "pickl": [1, 4, 7, 12, 28, 30, 38, 44], "pin": 21, "pinsir": 38, "pip": [24, 46], "pipelin": [7, 15, 41], "pitfal": [7, 26], "pivot": 28, "pixel": [3, 43], "pl": 40, "place": [5, 6, 21, 23, 43, 46, 54], "placehold": [4, 54], "plain": [2, 4, 6, 7, 36, 42, 43], "plain_dictionari": [2, 7], "plan": [1, 2, 4, 5, 7, 17, 18, 19, 20, 21, 24, 27, 36, 42, 44], "plan_intern": 17, "plan_to_sql": 18, "planner": [1, 7, 15, 22, 55], "pleas": [23, 34], "plu": [4, 5, 7, 28, 44], "plugin": [1, 8, 9, 10], "pmod": 6, "po": [5, 6], "point": [1, 3, 4, 5, 6, 7, 23, 26, 42, 54], "pointer": [21, 26], "pointer_check": [21, 55], "pointer_width": 23, "poison": [24, 28, 38, 40, 46], "pokemon": [24, 28, 31, 38, 40, 46, 54], "polar": [1, 2, 7, 40, 42], "polars_df": [40, 42], "poll": 42, "pool": [1, 7, 12], "popul": [5, 41, 42], "popular": [31, 40], "portabl": [1, 4, 7, 12], "portion": 21, "posit": [2, 3, 4, 5, 6, 7, 19, 28, 35, 36], "position": 55, "possibl": [2, 4, 7, 19, 21, 28, 31, 36, 38, 44], "possibli": [4, 5], "post": 23, "postgr": 18, "postgresql": [2, 7, 18], "potenti": [2, 7, 15, 54, 55], "pow": [5, 31], "power": [5, 31, 36, 38], "pq": 36, "pr": [5, 23], "practic": [2, 21, 36, 39], "pre": [1, 4, 7, 12, 22, 28, 38, 44], "preced": [3, 4, 5, 7, 19, 38, 54], "precis": [5, 39], "pred_udf": 36, "predic": [1, 2, 5, 7, 11, 30, 33, 36], "prefer": [5, 21, 23, 26, 30, 44], "prefix": [4, 5, 21], "prepar": [4, 54], "prepend": 5, "presenc": 31, "present": [2, 21, 30, 33], "preserv": [1, 2, 5, 6], "preserve_nul": 2, "pressur": [7, 15, 41], "pretti": 18, "prevent": [3, 23, 43], "preview": 41, "previou": [1, 5, 12, 36, 38], "previous": [1, 55], "price": 5, "primari": [2, 7, 9, 22, 30, 42], "primit": [7, 19, 21, 36], "principl": 39, "print": [0, 1, 2, 4, 7, 15, 19, 36, 37, 39, 41, 42, 43, 44], "printabl": [7, 15, 19], "printf": 6, "prior": [2, 21, 40], "prioriti": 30, "privat": 21, "probabl": [2, 7, 28], "problem": 33, "process": [2, 4, 7, 12, 19, 21, 28, 38, 39, 41, 42, 44, 47], "processor": 39, "produc": [1, 2, 4, 5, 7, 15, 17, 19, 21, 26, 28, 36, 38, 41, 42, 44, 55], "product": [5, 21, 39, 42], "program": [1, 21, 44], "programmat": [7, 15], "progress": 44, "project": [2, 4, 7, 15, 16, 21, 22, 23, 25, 26, 36, 41, 42, 44, 47, 55], "projectionexec": 41, "promot": 6, "prompt": 26, "propag": [1, 4, 5, 6, 7, 12, 19, 31, 35, 36], "proper": 39, "properti": [0, 2, 3, 4, 7, 15, 19, 21, 41], "proto_byt": [4, 7, 17], "protobuf": [7, 15], "protocol": [1, 3, 4, 6, 7, 12, 19, 21, 42, 43, 44, 53, 55], "provid": [0, 1, 2, 3, 4, 5, 7, 8, 9, 14, 15, 16, 17, 18, 19, 21, 27, 28, 30, 31, 36, 38, 39, 41, 42, 44, 45, 46, 50, 54, 55], "provider_logical_codec": 21, "provider_physical_codec": 21, "prune": [1, 7, 11, 36], "pruning_pred": 36, "psychic": 28, "pub": [21, 55], "public": [0, 7, 19, 40], "publish": 45, "pull": [23, 47], "pure": [1, 7, 19, 21, 23, 36], "purpos": [36, 44], "push": [23, 36, 40], "pushdown": 36, "pushdown_filt": 39, "put": [34, 35], "py": [1, 7, 17, 21, 36, 39, 44, 53, 55], "py_dict": 42, "py_list": 42, "pyani": [21, 53, 55], "pyarrow": [0, 1, 2, 4, 5, 6, 7, 11, 14, 16, 19, 21, 29, 36, 40, 44, 45, 47, 54], "pycapsul": [0, 1, 2, 7, 16, 19, 21, 36, 40, 47, 53, 55], "pycapsuleinterfac": [1, 2], "pyclass": [21, 23], "pydatatyp": 21, "pyiceberg": 40, "pymethod": [36, 53, 55], "pyo3": [19, 22, 23, 36, 40, 55], "pyo3_build_config": 23, "pyo3_config_fil": 23, "pyo3_print_config": 23, "pypi": 46, "pyproject": 23, "pyresult": [21, 36, 53, 55], "pysessioncontext": 21, "pyspark": [6, 24], "pytabl": 21, "pytest": 23, "python": [0, 1, 2, 4, 5, 6, 7, 12, 19, 22, 25, 26, 28, 29, 30, 33, 35, 36, 38, 39, 40, 43, 45, 46, 47, 53, 54], "python3": 23, "python_typ": 21, "python_valu": [4, 7], "pythontyp": [4, 7, 21], "q": [6, 36], "q08": 30, "qty": 36, "qty_arr": 36, "qty_max": 36, "qty_null_count": 36, "qualifi": [2, 33], "quantile_cont": [5, 28], "quantiti": 36, "queri": [1, 2, 4, 5, 6, 7, 15, 17, 19, 22, 24, 27, 28, 31, 35, 37, 39, 40, 41, 42, 45, 47, 55], "queryplannerexport": 1, "quick": [5, 29], "quit": 52, "quot": [2, 7, 14, 34], "r": [2, 5, 6, 7, 18, 21, 23, 49], "r163": 6, "rad": 5, "radian": [4, 5, 7], "rai": [12, 44], "rail": 30, "rais": [1, 2, 3, 4, 5, 6, 7, 12, 19, 30, 44, 55], "ram": 39, "random": [5, 6, 19, 29, 30], "rang": [1, 2, 4, 5, 7, 19, 29, 30, 31, 36, 38, 39, 42], "rank": [1, 5, 19, 36, 38], "ranks_in_partit": 19, "rare": 21, "rather": [1, 5, 6, 12, 17, 19, 21, 26, 30, 42, 44, 47, 53, 55], "ratio": 5, "raw": [1, 3, 4, 5, 7, 15, 19, 41], "raw_sort": 4, "rawcatalog": [0, 7], "rawcataloglist": 0, "rawexpr": [4, 7], "rawschema": 0, "ray_pickle_expr": 44, "rb": [7, 16], "re": [1, 2, 4, 7, 19, 21, 44], "reach": [1, 3, 5, 21, 30, 36], "reachabl": 21, "read": [0, 1, 2, 4, 5, 7, 9, 10, 11, 14, 17, 21, 36, 40, 42, 43, 45, 46, 48, 49, 51, 52, 54, 55], "read_": 44, "read_arrow": 1, "read_avro": [1, 7, 11, 42, 44, 48], "read_batch": 1, "read_csv": [1, 2, 7, 11, 24, 27, 28, 38, 40, 42, 44, 46, 49], "read_empti": 1, "read_json": [1, 7, 11, 42, 44, 51], "read_parquet": [1, 2, 7, 11, 27, 34, 36, 39, 42, 44, 52], "read_tabl": 1, "readabl": [5, 21, 26, 28, 30], "reader": [1, 7, 11, 14, 42, 47], "readm": 21, "real": 28, "realiti": 28, "reason": [2, 21, 23], "reassembli": 44, "rebind": 1, "rebuild": [1, 21, 23], "rebuilt": 1, "receiv": [1, 4, 5, 7, 12, 19, 28, 36, 38, 43, 44, 55], "recent": [21, 38, 40, 41], "recommend": [2, 21, 23, 36, 39, 43, 54], "reconstruct": [4, 7, 12, 44], "record": [1, 2, 3, 7, 14, 15, 16, 27, 28, 34, 36, 40, 41, 47, 48], "record_batch": [1, 2, 6, 7, 20], "record_batch_stream": [7, 16], "recordbatch": [1, 2, 3, 5, 7, 16, 36, 40, 42], "recordbatchread": 42, "recordbatchstream": [1, 2, 7, 16, 42], "recurs": 2, "recursivequeri": 4, "red": [30, 43], "red_or_green_unit": 30, "red_unit": 30, "reduc": [7, 14, 23, 33, 36, 43, 55], "redund": 6, "ref": [5, 6, 36, 42], "refer": [1, 2, 3, 4, 5, 7, 12, 21, 26, 27, 28, 30, 31, 32, 33, 36, 38, 42, 43, 54, 55], "referenc": [1, 27], "reflect": [3, 41], "refresh": [1, 3], "refresh_catalog": 1, "refus": [1, 44], "regardless": [1, 19, 30, 41, 44], "regener": 23, "regex": [5, 7, 14], "regexp_count": 5, "regexp_instr": 5, "regexp_lik": 5, "regexp_match": [5, 31], "regexp_replac": [5, 31], "region": [1, 28, 40], "regist": [0, 1, 2, 3, 4, 6, 7, 8, 11, 12, 15, 19, 21, 27, 28, 32, 35, 36, 38, 40, 42, 43, 45, 53, 54, 55], "register_arrow": 1, "register_avro": 1, "register_batch": [1, 36], "register_catalog": 0, "register_catalog_provid": [1, 40], "register_catalog_provider_list": 1, "register_csv": [1, 31, 49, 54], "register_dataset": [1, 40], "register_formatt": [3, 43], "register_json": 1, "register_listing_t": 1, "register_object_stor": [1, 40], "register_parquet": [1, 40, 52], "register_record_batch": 1, "register_schema": [0, 7, 40], "register_t": [0, 1, 2, 40, 53], "register_table_factori": 1, "register_table_provid": [1, 40], "register_udaf": [1, 12, 44], "register_udf": [1, 21, 55], "register_udtf": [1, 36], "register_udwf": 1, "register_view": [1, 37], "registr": [1, 4, 7, 12, 21, 44, 54], "registri": [1, 7, 19, 21, 26, 36, 44], "regr_avgi": [5, 28], "regr_avgx": [5, 28], "regr_count": [5, 28], "regr_intercept": [5, 28], "regr_r2": [5, 28], "regr_slop": [5, 28], "regr_sxi": 5, "regr_sxx": [5, 28], "regr_syi": [5, 28], "regress": [5, 28], "regular": [3, 5, 31], "reject": 4, "rel": [5, 38], "relat": [2, 7, 15, 26, 33], "releas": [21, 26, 38, 55], "relev": 23, "reli": [23, 40, 44, 54], "remain": [1, 4, 5, 6, 7, 21, 31, 44, 55], "remaind": 6, "remot": [9, 10, 39, 44], "remote_t": 1, "remov": [0, 1, 2, 4, 5, 7, 12, 28, 55], "remove_optimizer_rul": 1, "renam": [2, 5], "renamed_ag": 30, "render": [2, 3, 7, 45], "reorder": [2, 7, 16], "repair": 21, "repartit": [1, 2, 4, 7, 39], "repartition_by_hash": [2, 39], "repartitionexec": 36, "repeat": [5, 6, 30], "repeated_arrai": 30, "replac": [1, 2, 5, 6, 7, 21, 26, 31, 54], "repo": [23, 26], "report": [2, 7, 19, 23, 28], "repositori": [21, 36, 39, 40], "repr": [3, 41], "repr_row": 3, "repres": [1, 2, 4, 7, 11, 14, 15, 16, 17, 27, 30, 36, 39, 42], "represent": [0, 1, 2, 3, 4, 5, 6, 7, 11, 15, 17, 19, 43, 54], "request": [3, 21, 23], "requested_schema": [1, 2, 7, 16], "requir": [1, 2, 4, 5, 7, 19, 21, 26, 31, 39, 40, 49, 55], "require_udf_on_decod": 21, "required_guarante": 36, "reserv": [1, 7], "reset": [3, 43], "reset_formatt": [3, 43], "reshap": 2, "resolut": 44, "resolv": [1, 2, 3, 4, 7, 12, 19, 21, 23, 26, 28, 38, 44, 55], "resourc": [21, 25, 39], "respect": [5, 28, 36, 40], "respect_nul": [5, 28, 38], "rest": [7, 19], "restrict": [28, 44], "result": [1, 2, 4, 5, 7, 15, 16, 19, 21, 24, 27, 28, 30, 33, 34, 36, 37, 38, 39, 41, 42, 44], "result_batch": 42, "result_dict": 37, "retain": [12, 21, 55], "retriev": [0, 1, 4, 7, 33, 41], "return": [0, 1, 2, 3, 5, 6, 8, 9, 10, 11, 12, 14, 15, 16, 17, 19, 21, 28, 30, 33, 35, 36, 40, 41, 42, 43, 44, 47, 55], "return_field": [7, 19], "return_typ": [7, 19, 36], "reus": 21, "reusabl": 4, "revers": [4, 5, 7], "review": [21, 23], "rewrit": [21, 36], "rex": [4, 7], "rex_call_oper": [4, 7], "rex_call_operand": [4, 7], "rex_typ": [4, 7], "rextyp": [4, 7], "rfc": 1, "rfc3339": [4, 5, 7], "rh": [4, 7], "rhyhorn": 38, "rich": 3, "rid": 2, "ride": 44, "right": [2, 5, 6, 33, 36], "right2": 2, "right_on": [2, 33], "rint": 6, "ritchi": 38, "rle": [2, 7], "rle_dictionari": [2, 7], "rn": [1, 2, 5], "rnk": 5, "roadmap": 44, "robert": 6, "robin": 2, "rock": [28, 38], "role": 21, "roll": 38, "rollup": [2, 4, 5], "root": [4, 5, 7, 15, 23, 41], "roption": 21, "round": [1, 2, 5, 6, 27, 31, 35], "roundrobinbatch": 36, "rout": [4, 7, 15, 21], "routin": 21, "row": [1, 2, 3, 4, 5, 7, 11, 14, 15, 19, 27, 28, 29, 30, 33, 36, 37, 38, 39, 41, 42, 43, 49, 54], "row_count": [3, 36], "row_idx": 3, "row_numb": [1, 2, 5, 19, 38], "rpad": 5, "rresult": 21, "rstring": 21, "rtrim": [4, 5, 7], "rubi": 29, "rule": [1, 21, 36, 44], "run": [1, 2, 4, 7, 11, 12, 14, 15, 19, 22, 24, 26, 28, 30, 37, 39, 41, 44, 46, 55], "runnabl": [23, 44], "runtim": [1, 2, 7, 15, 19, 21, 39, 41, 42, 44, 55], "runtimeenvbuild": [1, 7, 39], "rust": [1, 2, 5, 6, 7, 14, 19, 21, 22, 24, 25, 36, 39, 40, 44, 53, 55], "rustc": 21, "rustflag": 23, "rustonomicon": 21, "rval": 2, "rvec": 21, "rwlock": 21, "s3": [1, 40], "safe": [1, 21, 44], "safer": 1, "safeti": 24, "sale": 41, "same": [1, 2, 4, 5, 7, 15, 19, 21, 27, 28, 33, 35, 36, 41, 42, 44, 55], "sampl": [5, 29, 37, 40], "satisfi": [1, 5, 21, 28, 30], "saur": 31, "save": [5, 19, 44], "scalar": [1, 4, 5, 6, 7, 12, 19, 30, 32, 44, 54], "scalarsubqueri": 4, "scalarudf": [1, 7, 19], "scalarudfexport": [7, 19], "scalarvalu": 19, "scalarvari": 4, "scale": [5, 6, 30, 36, 44], "scan": [1, 7, 14, 15, 21, 36, 41], "schedul": 44, "schema": [0, 1, 2, 3, 4, 5, 7, 11, 14, 15, 16, 29, 36, 43, 45], "schema_infer_max_record": [1, 7, 11, 14], "schema_nam": [0, 4, 7], "schemaprovid": [0, 7, 54, 55], "schemaproviderexport": [0, 7], "scheme": [1, 2], "scienc": 31, "scope": [12, 21], "score": [2, 5], "script": [3, 39], "search": [5, 30], "search_str": 5, "sec": 6, "secant": 6, "second": [5, 6, 27, 28, 30, 40, 55], "second_arrai": 5, "second_two_el": 30, "secret_access_kei": [1, 40], "section": [21, 27, 29, 32, 33, 36, 38, 40, 42, 44], "secur": [1, 4, 7, 28, 38], "see": [1, 2, 4, 5, 7, 12, 15, 16, 17, 18, 19, 21, 23, 26, 27, 28, 30, 31, 36, 38, 39, 41, 42, 43, 45, 53, 55], "seed": 6, "seen": [19, 28], "select": [1, 2, 4, 5, 6, 7, 11, 14, 16, 19, 27, 28, 30, 31, 32, 33, 35, 36, 37, 38, 40, 41, 42, 44, 45, 47, 54], "select_expr": 2, "self": [2, 4, 7, 14, 16, 19, 21, 36, 43, 44, 53, 55], "semant": [1, 6, 28, 30, 35], "semi": [2, 32], "send": [4, 7, 55], "sender": [1, 4, 7, 12, 44], "sensit": [2, 5, 6, 7], "sent": [4, 7], "separ": [1, 5, 6, 21, 22, 28, 32, 41, 42], "sequenc": [1, 2, 7, 19], "serd": 17, "seri": 30, "serial": [1, 2, 4, 7, 12, 15, 17, 21, 28, 30, 38, 44, 48], "serialize_byt": 17, "serialize_to_plan": 17, "serv": 21, "server": 7, "session": [1, 2, 3, 4, 7, 12, 15, 19, 35, 39, 43, 45, 46, 53, 54, 55], "session_id": [1, 21], "session_start_tim": 1, "sessionconfig": [1, 7, 39, 55], "sessioncontext": [0, 1, 2, 4, 5, 6, 7, 8, 12, 15, 17, 19, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 44, 46, 47, 48, 49, 51, 52, 53, 54, 55], "sessioncontextintern": 1, "sessionst": [1, 21, 55], "sessionstatebuild": 21, "set": [0, 1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 18, 19, 21, 23, 27, 30, 32, 33, 35, 36, 39, 41, 43, 44, 49, 54, 55], "set_custom_cell_build": [3, 43], "set_custom_header_build": [3, 43], "set_formatt": [3, 43], "set_query_plann": [1, 21, 55], "set_sender_ctx": [1, 4, 7, 12, 44], "set_worker_ctx": [1, 4, 7, 12, 44], "setter": 21, "setup": 12, "setvari": 4, "sever": [5, 28, 30, 34, 35, 36, 39, 41, 42], "sha": [4, 5, 6, 7, 35], "sha1": 6, "sha2": [1, 6, 35], "sha224": [4, 5, 7], "sha256": [4, 5, 7], "sha384": [4, 5, 7], "sha512": [4, 5, 7], "shape": 30, "sharabl": 21, "share": [1, 2, 3, 5, 7, 19, 23, 27, 30, 35, 36, 47], "sharp": 44, "shift": 6, "shift_offet": 5, "shift_offset": 5, "shiftleft": 6, "shiftright": 6, "shiftrightunsign": 6, "ship": [4, 7, 12, 26, 28, 30, 35, 38, 44], "shipmod": 30, "short": [21, 26, 42, 44], "shorter": 2, "shorthand": 5, "shot": 19, "should": [1, 2, 4, 5, 7, 8, 11, 15, 17, 21, 23, 28, 33, 36, 38, 55], "show": [2, 3, 21, 24, 27, 29, 30, 33, 35, 36, 38, 39, 40, 42, 43, 46, 53, 54], "show_attack": 54, "show_column": 54, "show_truncation_messag": [3, 43], "showcas": 39, "shown": [3, 7, 15, 30, 55], "shuffl": [6, 44], "side": [2, 4, 5, 7, 12, 21, 28, 30, 36, 44], "sign": [4, 5, 6, 7], "signatur": [35, 44, 55], "signific": 40, "significantli": [5, 39], "signum": [4, 5, 7], "silent": [44, 55], "silver": 5, "similar": [4, 5, 7, 21, 27, 30, 38, 44, 54], "similarto": 4, "simpl": [2, 5, 23, 30, 34, 36, 39, 51, 52, 54], "simpler": 30, "simplest": [19, 30, 36], "simpli": [2, 7, 19, 21, 23, 40, 54], "simplic": [7, 19], "simplifi": 38, "simultan": [39, 44], "sin": [4, 5, 7], "sinc": [2, 3, 5, 6, 28, 36, 40, 44, 54], "sine": [4, 5, 7], "singl": [1, 2, 3, 4, 5, 6, 7, 14, 15, 19, 26, 28, 30, 36, 38, 39, 40, 41, 42, 44, 54], "single_file_output": [2, 7], "singleton": 44, "sinh": [4, 5, 7], "sit": 5, "site": [19, 49], "situat": [2, 21], "size": [1, 2, 5, 6, 7, 30, 36, 39, 43, 44, 55], "skew": [39, 41], "skill": [7, 45], "skip": [1, 2, 5, 7, 11, 19, 36, 49], "skip_arrow_metadata": [2, 7], "skip_metadata": [1, 7, 11], "slice": [4, 5, 6, 7, 30, 44], "slightli": 36, "slope": 5, "slot": [12, 41], "slow": 2, "slower": [2, 39], "slowest": 36, "slowpok": 38, "sm": 36, "small": [5, 6, 30, 36, 39, 40, 44], "smallest": [2, 6, 19, 28], "smooth_a": 36, "snappi": [2, 7], "snapshot": 21, "snorlax": 38, "snowflak": 30, "so": [1, 2, 4, 5, 6, 7, 12, 15, 19, 21, 23, 26, 28, 30, 34, 35, 36, 38, 41, 42, 44, 47, 53, 55], "softwar": [7, 15, 21], "solid": 43, "solv": 28, "some": [2, 5, 6, 7, 15, 19, 21, 23, 28, 30, 31, 36, 38, 40, 41, 42, 46, 55], "sometim": [1, 7, 21, 28, 30, 40], "sort": [1, 2, 4, 5, 6, 7, 11, 14, 28, 36, 38, 42], "sort_bi": [2, 7], "sort_expr": [2, 5], "sort_express": 5, "sort_list_to_raw_sort_list": 1, "sortexpr": [1, 2, 4, 5, 7, 14], "sortkei": [1, 2, 4, 5, 6], "sound": [21, 55], "soundex": 6, "sourc": [1, 2, 4, 5, 6, 7, 8, 9, 10, 11, 15, 21, 23, 27, 36, 39, 42, 43, 44, 45, 46, 47, 53], "sp": [24, 40, 46], "space": [4, 5, 6, 7], "span": 5, "sparingli": 36, "spark": [1, 5, 20, 28, 31, 32, 45], "spark_cast": 6, "spawn": 44, "spec": 36, "special": [3, 19, 54], "specif": [0, 2, 3, 4, 7, 15, 26, 29, 30, 31, 36, 38, 39, 41, 42, 43, 44, 54, 55], "specifi": [1, 2, 4, 5, 7, 14, 28, 30, 31, 33, 36, 38, 39, 54], "speed": [2, 7, 22, 24, 28, 38, 40, 46], "spent": [7, 15, 41], "sphinx": 20, "spill": [1, 7, 15, 41], "spill_count": [7, 15, 41], "spillabl": [1, 7], "spilled_byt": [7, 15, 41], "spilled_row": [7, 15, 41], "split": [5, 6, 36, 44], "split_part": 5, "sql": [1, 2, 4, 5, 6, 7, 15, 17, 18, 19, 21, 24, 26, 27, 30, 32, 34, 36, 37, 40, 41, 42, 44, 45], "sql_parser": 30, "sql_type": 21, "sql_with_opt": 1, "sqlite": 18, "sqloption": [1, 7], "sqltabl": [8, 9, 10], "sqltype": [4, 7, 21], "sqrt": [4, 5, 7], "squar": [4, 5, 7], "squi": 31, "squirtl": [24, 31, 38, 40, 46], "src": [21, 23], "ss": 5, "ssd": 39, "stabl": [4, 7, 19, 21, 26, 36, 44], "stack": 2, "stage": 44, "stai": 21, "stale": 21, "stamp": [4, 7, 12, 44], "standalon": [30, 55], "standard": [5, 7, 19, 21, 26, 44], "starmap": 44, "start": [1, 4, 5, 6, 14, 19, 30, 33, 34, 38, 43, 44, 46, 49], "start_ag": 30, "start_bound": [4, 7], "start_dat": 6, "start_timestamp": [7, 15], "started_young": 30, "starts_with": 5, "stat": 28, "state": [1, 7, 19, 21, 27, 36, 44], "state_ref": 21, "state_typ": [7, 19, 36], "statement": [1, 4, 5, 7, 27, 54], "static": [0, 1, 2, 4, 5, 7, 15, 17, 18, 19], "statist": [2, 7, 15, 28, 29, 36, 41, 42], "statistics_en": [2, 7], "statistics_truncate_length": [2, 7], "statu": [5, 22], "std": 29, "stddev": [5, 28], "stddev_pop": [5, 28], "stddev_samp": 5, "stem": 21, "step": [5, 7, 15, 21], "still": [7, 12, 14, 21, 36, 40, 55], "stop": 5, "storag": [39, 40], "store": [1, 4, 7, 12, 13, 21, 45], "str": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 14, 15, 17, 18, 19, 54], "str_to_map": 6, "straight": 21, "straightforward": [7, 16, 48, 49], "strategi": 39, "stream": [1, 2, 7, 16, 21, 41, 45, 47], "strftime": [5, 43], "strict": [1, 44], "stricter": 44, "strictli": 2, "stride": 5, "string": [0, 1, 2, 3, 4, 5, 6, 7, 14, 15, 17, 18, 19, 21, 23, 28, 29, 30, 32, 35, 36, 41, 42, 43, 54], "string1": 5, "string2": 5, "string_agg": [5, 28], "string_list": 5, "string_liter": [4, 7], "string_to_arrai": 5, "string_to_list": 5, "string_view": [4, 7, 47], "strong": [12, 24], "strongli": 39, "strpo": 5, "struct": [1, 4, 5, 6, 7, 21, 32, 47, 55], "structarrai": 47, "structur": [7, 14, 15, 21], "style": [1, 2, 3, 6, 7, 21, 28, 30, 42, 54], "style_provid": [3, 43], "styleprovid": [3, 43], "sub": [4, 7], "sub_expr": 5, "subclass": [21, 28, 38], "subfield": [4, 5, 7], "subject": 44, "submit": 23, "submodul": 23, "subqueri": [4, 26], "subqueryalia": 4, "subsequ": 44, "subset": [2, 4, 5, 6, 31, 34], "substitut": [1, 6], "substr": [1, 5, 6, 31, 35], "substr_index": 5, "substrait": [7, 20], "subtl": 21, "subtot": [2, 4, 28], "subtract": [4, 7], "subtyp": 28, "successfulli": [7, 14], "suffici": [1, 4, 7, 39], "suffix": 5, "suggest": 40, "suit": 44, "suitabl": 5, "sum": [1, 2, 4, 5, 6, 7, 15, 19, 28, 36, 39, 41, 42, 55], "sum_bias_10": [7, 19], "sum_by_nam": [7, 15, 41], "sum_fn": 1, "summar": [2, 7, 19, 28], "summari": [2, 28, 29], "suppli": [4, 7, 12, 15, 21, 30, 44], "supplier": 28, "supplier_id": [28, 30], "support": [0, 1, 2, 3, 5, 6, 7, 14, 15, 16, 17, 18, 19, 21, 26, 28, 30, 33, 35, 36, 40, 42, 44, 54], "supports_bounded_execut": [19, 36], "supports_filters_pushdown": 21, "suppos": [5, 21, 28], "suppress_build_script_link_lin": 23, "sure": 23, "surfac": [7, 19, 44], "surpris": [21, 44], "surround": 44, "sw": 5, "swap": 21, "switch": [30, 44, 54], "symbol": [1, 2], "sync": 23, "synchron": 21, "syntax": [5, 26, 30], "synthet": 39, "system": [1, 2, 7, 21, 23, 39], "t": [4, 5, 6, 7, 19, 34], "t1": [19, 36], "tabl": [0, 1, 2, 3, 7, 8, 9, 10, 11, 14, 15, 19, 21, 27, 28, 29, 31, 32, 33, 39, 41, 42, 43, 45, 46, 47, 49, 50, 52, 54, 55], "table_exist": [0, 1], "table_id": [3, 43], "table_nam": [0, 2, 8, 9, 10], "table_partition_col": [1, 7, 11, 14], "table_provid": 1, "table_uuid": [2, 3], "tablefunct": [1, 7, 19, 55], "tableprovid": [21, 53, 55], "tableproviderexport": [0, 1, 7, 36], "tableproviderfactori": [1, 7], "tableproviderfactoryexport": [1, 7], "tablescan": 4, "tabul": [4, 28], "tabular": 42, "tag": [3, 5, 41], "tail": 2, "take": [1, 2, 3, 4, 7, 12, 19, 21, 23, 28, 30, 36, 38, 40, 43, 44, 53, 55], "takeawai": 36, "taken": 39, "tan": [4, 5, 7], "tangent": [4, 5, 7], "tanh": [4, 5, 7], "target": [1, 2, 5, 7, 39], "target_partit": [1, 7], "task": [19, 21, 31, 42], "task_context_from_pycapsul": 55, "taskcontext": 21, "taskcontextprovid": [21, 55], "taxi": 27, "tbl": 1, "td": 43, "team": 2, "technic": 24, "techniqu": [39, 40], "tediou": 28, "tell": [4, 28], "tempfil": [1, 36], "templat": [6, 7, 19], "tempor": 32, "temporari": [1, 2, 7, 54], "temporary_column": 42, "temporarydirectori": 1, "tempt": 36, "ten": 44, "ten_a": 4, "term": 38, "termin": [2, 7, 14, 41, 43, 45], "terminologi": 21, "test": [5, 7, 15, 21, 23, 26, 32, 36, 39, 40], "test_reinstalling_a_planner_rebinds_the_session_to_that_handles_codec": 21, "test_the_planner_and_the_handle_can_hold_different_codec": 21, "text": [1, 2, 5, 6, 7, 15, 43], "textual": 31, "th": [5, 6, 43], "than": [1, 2, 4, 5, 6, 7, 12, 14, 19, 21, 26, 28, 30, 36, 39, 41, 42, 44, 47, 49, 53, 55], "thei": [1, 4, 6, 7, 8, 15, 19, 26, 28, 30, 36, 44, 54, 55], "them": [1, 2, 4, 5, 7, 21, 23, 26, 27, 28, 29, 30, 36, 44], "then_expr": 4, "therefor": [2, 21], "thi": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18, 19, 20, 21, 23, 24, 26, 27, 28, 29, 30, 31, 32, 33, 35, 36, 37, 38, 39, 40, 41, 43, 44, 46, 47, 53, 54, 55], "thing": 21, "think": 26, "third": 27, "thoroughli": 21, "those": [1, 2, 4, 7, 12, 21, 24, 28, 36, 40, 44, 54, 55], "though": [21, 36], "thread": [1, 12, 24, 44], "threat": 44, "three": [5, 21, 28, 30, 36, 38, 40], "threshold": 54, "through": [1, 2, 3, 4, 6, 7, 12, 15, 19, 21, 24, 28, 32, 35, 36, 40, 42, 44, 45, 46, 55], "thrown": 21, "thu": 19, "thusli": 21, "ti": 41, "ticket": 23, "tie": 5, "tight": 21, "tile": 5, "time": [1, 5, 6, 7, 15, 19, 21, 23, 26, 28, 30, 31, 36, 39, 41, 42, 44, 55], "time64": [5, 6], "time_trunc": 6, "timedelta": 6, "timestamp": [4, 5, 6, 7, 15, 31, 36], "timezon": 5, "tip_amount": [27, 34], "tip_perc": 27, "tips_plus_tol": 34, "tlc": [27, 34], "tmp": [1, 7, 36], "tmpdir": [1, 36], "tmpe5kz64xa": 36, "to_": 7, "to_arrow_t": [2, 42], "to_batch": 40, "to_byt": [1, 4, 7, 12, 15, 21, 28, 30, 38, 44], "to_char": 5, "to_dat": 5, "to_hex": [4, 5, 7], "to_inn": [7, 14], "to_json": 17, "to_local_tim": 5, "to_panda": [2, 29, 31, 42, 54], "to_polar": [2, 42], "to_proto": [7, 15], "to_pyarrow": [7, 16, 42], "to_pyarrow_dataset": 40, "to_pydict": [1, 2, 4, 5, 7, 19, 37, 42, 44], "to_pylist": [2, 4, 5, 42], "to_substrait_plan": 17, "to_tim": 5, "to_timestamp": [5, 31], "to_timestamp_micro": 5, "to_timestamp_milli": 5, "to_timestamp_nano": 5, "to_timestamp_second": 5, "to_unixtim": 5, "to_utc_timestamp": 6, "to_val": 5, "to_vari": [4, 7, 15], "todai": 5, "todo": 21, "togeth": [2, 5, 7, 19, 28], "toggl": [1, 12, 44], "token": 21, "toler": [2, 7], "tolls_amount": 34, "toml": 23, "too": [1, 4, 7, 21, 28], "tool": [2, 7, 26, 36], "top": [1, 4, 6, 7, 15, 21, 29, 44], "topic": 40, "total": [1, 2, 4, 5, 7, 15, 19, 24, 27, 28, 30, 31, 40, 41, 46], "total_amount": [27, 42], "total_as_float": 31, "total_as_int": 31, "touch": [21, 23], "toward": 5, "tpc": 30, "track": 21, "tracker": [5, 25], "tradit": 23, "train": 26, "trait": [7, 19, 21], "transact": [1, 7], "transactionaccessmod": 4, "transactionconclus": 4, "transactionend": 4, "transactionisolationlevel": 4, "transactionstart": 4, "transfer": 21, "transform": [2, 4, 5, 7, 15, 27, 42, 44], "translat": [5, 21], "transpar": 44, "trap": 21, "travel": [4, 7, 12, 28, 38], "travers": 5, "treat": [2, 4, 5, 6, 7, 38, 44, 49], "treatment": [4, 7], "tree": [2, 7, 15, 30, 36], "trick": 30, "trigger": [2, 41, 43, 47], "trim": [4, 5, 7], "trim_df": 5, "trip": [27, 34, 40, 44], "trip_dist": [27, 34], "trivial": 23, "truck": 30, "true": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 19, 23, 28, 30, 31, 34, 36, 38, 39, 43, 49], "trunc": [5, 6], "truncat": [2, 3, 5, 6, 7, 14, 28, 31, 34, 38, 43], "truncated_row": [7, 14], "trust": [4, 7, 44], "try": [1, 7, 11, 12, 14, 21], "try_cast": [4, 7], "try_cast_to_typ": 5, "try_parse_url": 6, "try_sum": [6, 28], "try_url_decod": 6, "trycast": 4, "tune": [2, 7, 39, 45], "tupl": [1, 2, 4, 5, 7, 11, 14, 15, 16, 19], "turn": [0, 2, 4, 7, 21, 54, 55], "tutori": 46, "two": [1, 2, 4, 5, 6, 7, 15, 16, 21, 26, 28, 30, 33, 36, 38, 39, 40, 44, 55], "txt": 26, "type": [0, 1, 2, 3, 4, 5, 6, 7, 11, 14, 15, 19, 21, 23, 24, 28, 30, 31, 34, 36, 38, 39, 40, 43, 44, 46, 54, 55], "type_class": 3, "type_ref": 5, "type_str": 6, "typeerror": [3, 4, 7, 19, 55], "typeguard": 19, "typic": [0, 1, 2, 4, 7, 12, 16, 18, 19, 27, 40, 41], "typo": 55, "tz": 6, "u": [1, 5, 6, 21, 28, 30, 40], "udaf": [1, 7, 19, 24, 28, 35, 36, 44], "udaf1": [7, 19], "udaf2": [7, 19], "udaf3": [7, 19], "udaf4": [7, 19], "udf": [1, 4, 6, 7, 12, 19, 21, 24, 28, 35, 38], "udf_filt": 36, "udtf": [1, 7, 19, 36], "udwf": [1, 7, 19, 35, 38, 44], "udwf1": [7, 19], "udwf2": [7, 19], "udwf3": [7, 19], "ultim": 23, "unabl": 54, "unambigu": 2, "unari": [6, 7, 15], "unbase64": 6, "unbound": [1, 4, 7, 19, 38], "unchang": [1, 2, 4, 5, 31, 36, 55], "uncompress": [2, 7, 14], "undefin": [5, 23, 55], "under": [1, 2, 21, 35, 40, 44], "underli": [1, 2, 4, 7, 14, 19, 21, 36, 47], "understand": [21, 39, 42], "unfortun": 21, "unfrozen": 21, "unhex": 6, "unicod": [4, 5, 7], "uniniti": 44, "unintend": 54, "union": [2, 4, 5], "union_by_nam": 2, "union_distinct": 2, "union_expr": 5, "union_extract": 5, "union_tag": 5, "unionarrai": 5, "uniqu": [1, 2, 3, 5, 7, 19, 28], "unit": [4, 5, 6, 7, 38, 40], "unitless": 41, "unix": 5, "unix_d": 6, "unix_micro": 6, "unix_milli": 6, "unix_second": 6, "unixtim": 5, "unless": [2, 21, 44], "unlik": [1, 2, 4, 5, 7, 38], "unmatch": 33, "unnest": [2, 4], "unnest_column": 2, "unnestexpr": 4, "unoptim": 2, "unpars": [7, 20], "unpickl": [4, 7], "unqualifi": 2, "unresolv": 5, "unsaf": [1, 21, 44, 55], "unsign": 6, "unspecifi": 2, "unspil": [1, 7], "until": [1, 2, 12, 27, 44], "untrust": [1, 44], "unus": 55, "unwrap": 21, "up": [1, 2, 4, 5, 7, 15, 19, 21, 26, 27, 30, 35, 36, 38, 39, 43, 44], "updat": [1, 2, 7, 19, 21, 22, 36, 55], "upgrad": [21, 45], "upon": [5, 21, 36], "upper": [2, 4, 5, 7], "uppercas": [4, 5, 7], "upstream": [5, 21, 35, 44], "urbango": 33, "urgent": 30, "url": [1, 6, 26], "url_decod": 6, "url_encod": 6, "urlencod": 6, "us": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 14, 15, 16, 17, 19, 21, 23, 24, 27, 28, 29, 30, 31, 32, 33, 34, 35, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 49, 51, 52, 53, 54, 55], "usabl": [21, 44], "usag": [1, 2, 5, 7, 19, 28, 38, 45], "use_shared_styl": [3, 7, 43], "user": [0, 1, 2, 4, 7, 8, 15, 16, 17, 18, 19, 21, 23, 26, 27, 30, 31, 32, 43, 44, 46, 55], "user_defin": [1, 7, 20, 28, 36, 38], "user_id": 42, "userinfo": 6, "uses_window_fram": [19, 36], "usual": [2, 55], "utc": [5, 6, 7, 15], "utf": 6, "utf8": [4, 5, 7, 36], "utf8view": [4, 7], "util": [3, 21, 38, 39, 40], "uuid": 5, "uv": 23, "v": [4, 5, 6, 7, 12, 19, 23, 30, 39, 43, 44], "v1": 5, "v2": [5, 30], "v4": 5, "val": [2, 5, 6, 33, 54], "valid": [1, 2, 3, 4, 6, 7, 8, 9, 10], "validate_pycapsul": 55, "valu": [1, 2, 3, 4, 5, 6, 7, 12, 14, 15, 19, 21, 28, 30, 32, 33, 34, 35, 36, 38, 41, 42, 43, 44, 45, 54], "value1": 5, "value2": 5, "value_as_datetim": [7, 15], "value_i": 5, "value_x": 5, "valueerror": [1, 2, 3, 4, 5, 7, 12], "values_a": 36, "values_b": 36, "values_view": 2, "var": 5, "var_pop": [5, 28], "var_popul": [5, 28], "var_samp": [5, 28], "var_sampl": 5, "vari": 39, "variabl": [1, 4, 5, 7, 23, 30, 44, 54], "varianc": 5, "variant": [4, 5, 7, 15, 33, 41], "variant_nam": [4, 7], "varieti": [30, 36, 40, 49], "variou": [14, 42, 43, 46], "vastli": [23, 39], "vec": 21, "vector": 5, "vendorid": 34, "venomoth": 38, "venonat": 38, "venu": 31, "venufleur": 31, "venufleurmega": 31, "venusaur": [24, 31, 38, 40, 46, 54], "venusaurmega": [24, 31, 38, 40, 46, 54], "venv": 23, "verbos": [2, 36], "veri": [48, 49], "verifi": 46, "version": [1, 2, 3, 4, 5, 7, 12, 21, 23, 26, 31, 33, 35, 40, 44, 55], "versu": 39, "via": [1, 2, 4, 5, 7, 12, 15, 16, 17, 19, 21, 23, 24, 28, 30, 33, 35, 36, 38, 40, 41, 42, 43, 45, 46, 53, 54, 55], "view": [0, 1, 2, 7, 29, 31, 32, 45, 46, 54], "view1": 37, "vink": 38, "violat": 3, "virtual": [1, 7, 23], "visibl": [1, 21, 36, 44, 55], "visual": [2, 7, 15, 27], "volatil": [1, 4, 7, 19, 36, 44], "voltorb": 38, "volum": [30, 39, 41], "vulpix": 28, "w": 5, "wa": [1, 7, 15, 21, 28, 44, 55], "wai": [1, 21, 23, 28, 30, 36, 40, 42, 43, 44, 46, 55], "wait": [21, 41], "walk": [5, 41, 45], "wall": 41, "want": [1, 5, 21, 23, 28, 30, 31, 36, 38, 43, 53], "warn": 44, "wartortl": [24, 40, 46], "water": [24, 28, 31, 40, 46], "we": [0, 2, 7, 19, 21, 23, 27, 28, 30, 31, 33, 34, 36, 38, 39, 40, 46, 47, 54], "weak": 21, "weakli": [21, 55], "weedl": [24, 38, 40, 46], "week": 6, "weight": [5, 30], "welcom": [23, 46], "well": [1, 7, 21, 23, 36, 42, 54], "went": 21, "were": [21, 30], "what": [4, 7, 12, 27, 45, 55], "whatev": [19, 44, 53], "when": [1, 2, 3, 4, 5, 6, 7, 11, 12, 14, 15, 19, 21, 23, 24, 26, 28, 30, 33, 38, 39, 40, 42, 43, 44, 51, 54, 55], "when_expr": 4, "whenev": [1, 21, 23, 30, 42], "where": [1, 2, 4, 5, 7, 15, 21, 28, 30, 31, 36, 37, 38, 40, 41, 44, 54], "wherea": [30, 35], "wherev": 21, "whether": [1, 2, 3, 4, 5, 7, 11, 14, 19, 28, 30, 36], "which": [0, 1, 2, 4, 5, 6, 7, 12, 14, 15, 19, 21, 23, 24, 28, 30, 33, 34, 35, 36, 38, 40, 41, 42, 44, 55], "whichev": 21, "while": [7, 19, 21, 26, 33, 36, 39, 41], "white": 43, "who": [21, 55], "whole": [2, 7, 15, 21, 28, 36, 41, 44], "whose": [2, 6, 7, 15, 21, 36], "why": [6, 21, 32], "wide": [30, 35, 39, 40, 42], "width": [3, 6, 43], "width_bucket": 6, "win": 44, "window": [1, 2, 4, 5, 7, 12, 19, 26, 28, 32, 39, 44, 45], "window_fram": [4, 7, 38], "windowevalu": [7, 19, 36, 38], "windowexpr": 4, "windowfram": [4, 7, 38], "windowframebound": [4, 7], "windowudf": [1, 7, 19], "windowudfexport": [7, 19], "windsurf": 26, "wire": [4, 6, 7, 44], "wise": 5, "wish": [21, 33, 36], "with_": [7, 14, 21], "with_allow_ddl": [1, 7], "with_allow_dml": [1, 7], "with_allow_stat": [1, 7], "with_batch_s": [1, 7], "with_column": [2, 5, 7, 35, 42, 44], "with_column_renam": [2, 5], "with_com": [7, 14, 49], "with_create_default_catalog_and_schema": [1, 7, 39], "with_default_catalog_and_schema": [1, 7, 39], "with_delimit": [7, 14, 49], "with_disk_manager_dis": [1, 7], "with_disk_manager_o": [1, 7, 39], "with_disk_manager_specifi": [1, 7], "with_escap": [7, 14, 49], "with_extens": [1, 7], "with_fair_spill_pool": [1, 7, 39], "with_file_compression_typ": [7, 14, 49], "with_file_extens": [7, 14, 49], "with_file_sort_ord": [7, 14], "with_greedy_memory_pool": [1, 7], "with_has_head": [7, 14, 49], "with_head": 2, "with_information_schema": [1, 7, 39], "with_logical_extension_codec": [1, 7, 15, 21], "with_metadata": 5, "with_newlines_in_valu": [7, 14], "with_null_regex": [7, 14, 49], "with_parquet_prun": [1, 7, 39], "with_physical_extension_codec": [1, 21], "with_pretti": 18, "with_python_udf_inlin": [1, 4, 7, 12, 21, 44], "with_quot": [7, 14], "with_repartition_aggreg": [1, 7, 39], "with_repartition_file_min_s": [1, 7], "with_repartition_file_scan": [1, 7], "with_repartition_join": [1, 7, 39], "with_repartition_sort": [1, 7], "with_repartition_window": [1, 7, 39], "with_schema": [7, 14], "with_schema_infer_max_record": [7, 14], "with_sess": [7, 19, 36], "with_table_partition_col": [7, 14], "with_target_partit": [1, 7, 39], "with_temp_file_path": [1, 7], "with_termin": [7, 14], "with_truncated_row": [7, 14, 49], "with_unbounded_memory_pool": [1, 7], "within": [0, 2, 5, 7, 9, 12, 19, 30], "within_limit": 2, "without": [2, 4, 5, 7, 12, 19, 21, 23, 26, 28, 31, 33, 34, 36, 42, 44, 54], "won": 34, "word": [4, 5, 7], "work": [1, 2, 4, 5, 7, 22, 27, 28, 30, 31, 34, 36, 38, 39, 42, 45, 46, 54, 55], "worker": [4, 7, 12, 28, 38], "workflow": [23, 44], "workload": [39, 44], "world": [5, 35], "worth": 21, "worthwhil": [2, 7], "would": [5, 8, 12, 19, 21, 28, 41, 54], "wrap": [1, 2, 4, 7, 19, 21, 36, 44], "wrapper": [1, 7, 16, 19, 21, 23, 36, 40, 55], "write": [2, 7, 8, 17, 21, 26, 28, 36, 40, 42, 44, 45, 55], "write_": 2, "write_batch_s": [2, 7], "write_csv": 2, "write_json": 2, "write_opt": 2, "write_parquet": 2, "write_parquet_with_opt": 2, "write_t": [1, 2, 36], "writer": [1, 2, 7], "writer_vers": [2, 7], "written": [2, 7, 21, 24, 36, 40, 41, 42, 55], "wrong": [36, 55], "www": 6, "x": [1, 2, 4, 5, 6, 7, 19, 24, 30, 31, 36, 38, 40, 46, 54], "x_val": 5, "xff": 6, "xor": 5, "xx": 5, "xxhash": 6, "xxhash64": 6, "xy": 5, "xz": [7, 14], "y": [2, 4, 5, 19, 24, 31, 38, 40, 43, 46, 54], "year": [5, 6], "years_in_posit": 30, "yellow": [27, 40], "yellow_tripdata_2021": [27, 34], "yet": [2, 6, 30, 40, 44], "yield": [2, 5, 42, 47], "you": [0, 1, 2, 4, 5, 7, 19, 21, 23, 24, 27, 28, 29, 30, 31, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 49, 53, 54, 55], "your": [0, 1, 2, 7, 19, 21, 23, 26, 28, 29, 34, 36, 39, 40, 42, 43, 53, 54, 55], "your_tabl": 42, "yourself": [4, 7, 21], "yyyi": 5, "z": [1, 5, 7, 19], "zero": [2, 5, 6, 7, 16, 24, 30, 45, 47], "zip": 36, "zstandard": [2, 7], "zstd": [2, 7, 14], "zubat": 28, "\u03c0": 5}, "titles": ["datafusion.catalog", "datafusion.context", "datafusion.dataframe", "datafusion.dataframe_formatter", "datafusion.expr", "datafusion.functions", "datafusion.functions.spark", "datafusion", "datafusion.input.base", "datafusion.input", "datafusion.input.location", "datafusion.io", "datafusion.ipc", "datafusion.object_store", "datafusion.options", "datafusion.plan", "datafusion.record_batch", "datafusion.substrait", "datafusion.unparser", "datafusion.user_defined", "API Reference", "Python Extensions", "Contributor Guide", "Introduction", "DataFusion in Python", "Links", "Using AI Coding Assistants", "Concepts", "Aggregation", "Basic Operations", "Expressions", "Functions", "Common Operations", "Joins", "Column Selections", "Spark-Compatible Functions", "User-Defined Functions", "Registering Views", "Window Functions", "Configuration", "Data Sources", "Execution Metrics", "DataFrames", "DataFrame Rendering", "Distributing work", "User Guide", "Introduction", "Arrow", "Avro", "CSV", "IO", "JSON", "Parquet", "Custom Table Provider", "SQL", "Upgrade Guides"], "titleterms": {"": 21, "0": 55, "14": 44, "3": 44, "52": 55, "53": 55, "54": 55, "55": 55, "A": 21, "If": 26, "One": 21, "The": 21, "abstract": 7, "access": 36, "across": 21, "addit": 43, "against": 21, "agent": 26, "aggreg": [28, 36, 38, 41], "ai": 26, "also": 44, "altern": 21, "an": 26, "anti": 33, "apach": [40, 44], "api": [20, 35, 41], "approach": 21, "ar": [21, 26, 41], "arc": 21, "argument": 42, "arrai": 30, "arrow": [21, 42, 47], "assist": 26, "attribut": [4, 5, 7, 13, 19], "author": 26, "avail": [38, 41], "avro": 48, "ballista": 44, "base": [8, 42], "basic": [29, 43, 44], "benchmark": 39, "best": 43, "boolean": 30, "build": 23, "builder": 43, "built": 42, "call": 36, "capsul": 21, "cast": 31, "catalog": [0, 40], "cell": 43, "chang": [44, 55], "class": [0, 1, 2, 3, 4, 7, 8, 9, 10, 14, 15, 16, 17, 18, 19, 21, 42], "code": [23, 26], "codec": 21, "col": 33, "column": [30, 33, 34, 42], "commit": 23, "common": [32, 42], "compar": 28, "compat": 35, "concept": 27, "condit": [30, 31], "configur": [39, 43], "consider": [39, 44], "content": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19], "context": [1, 21, 27, 44], "contributor": 22, "control": 43, "copi": 42, "core": [7, 42], "cover": 26, "cpu": 39, "crate": 55, "creat": [40, 42], "csv": 49, "cube": 28, "custom": [40, 43, 53], "data": 40, "datafram": [2, 27, 33, 35, 40, 42, 43], "dataframe_formatt": 3, "datafus": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 24, 44, 47, 55], "decod": 21, "deep": 21, "default": 44, "defin": [28, 36, 38, 40], "delta": 40, "depend": 23, "deriv": 21, "detail": 21, "develop": 23, "directli": 43, "disabl": 44, "disambigu": 33, "displai": 43, "distinct": 28, "distribut": 44, "duplic": 33, "end": 41, "exampl": [24, 39, 41, 44], "execut": [41, 42], "explicit": 28, "export": 47, "expr": 4, "express": [27, 30, 42, 44], "extens": [21, 55], "fail": 55, "faq": 36, "ffi": 21, "file": 40, "fill_nul": 31, "filter": 28, "formatt": 43, "frame": 38, "from": [21, 47], "full": 33, "function": [3, 4, 5, 6, 7, 11, 12, 19, 28, 30, 31, 35, 36, 38, 42], "getter": 21, "group": 28, "guid": [22, 45, 55], "guidelin": [21, 23], "handl": 31, "header": 43, "hook": 23, "how": 23, "html": 42, "i": [21, 26], "iceberg": 40, "implement": 21, "import": [39, 47], "improv": 23, "inlin": 44, "inner": 33, "input": [8, 9, 10], "inspir": 21, "instal": [21, 23, 24, 26, 46], "introduct": [23, 46], "io": [11, 50], "ipc": 12, "issu": 21, "join": 33, "json": 51, "kei": 33, "label": 41, "lake": 40, "lambda": 30, "left": 33, "level": [21, 44], "librari": [21, 40, 42, 55], "link": 25, "list": 30, "liter": 30, "local": 40, "locat": 10, "loudli": 55, "mathemat": 31, "maxim": 39, "membership": 30, "memori": [40, 43], "metric": [41, 42], "mismatch": 55, "miss": 31, "modul": [0, 1, 2, 3, 4, 6, 8, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19], "multipl": 21, "mutabl": 21, "name": 42, "namespac": 35, "now": 55, "null": [28, 38], "object": 40, "object_stor": 13, "one": 21, "oper": [29, 32, 42], "optim": 43, "option": [14, 36], "order": [28, 38], "other": [31, 40], "overview": [41, 42], "packag": [5, 7, 9], "paramet": [28, 38], "parameter": 54, "parquet": 52, "partit": [38, 41], "per": 41, "perform": 43, "physic": 41, "plan": [15, 41], "planner": 21, "pool": 44, "portabl": 44, "practic": [43, 44], "pre": 23, "primari": 21, "provid": [40, 43, 53], "publish": 26, "pyarrow": 42, "pyo3": 21, "python": [21, 23, 24, 42, 44, 55], "queri": [21, 44, 54], "quick": 7, "read": 41, "rebind": 21, "receiv": 21, "record_batch": 16, "refer": [20, 35, 41, 44], "regist": [37, 44], "render": [42, 43], "requir": 44, "resourc": 43, "return": [4, 7], "rollup": 28, "run": [21, 23], "rust": 23, "scalar": 36, "schema": 40, "secur": 44, "see": 44, "select": 34, "semi": 33, "separ": [23, 35], "session": [21, 27, 36, 44], "sessioncontext": 21, "set": [28, 38], "share": [21, 43, 44], "skill": 26, "slot": 44, "sourc": 40, "spark": [6, 35], "speed": 23, "sql": [35, 54], "start": 7, "statu": 21, "store": 40, "stream": 42, "string": 31, "struct": 30, "style": 43, "submodul": [5, 7, 9], "subset": 28, "substrait": 17, "tabl": [36, 40, 53], "tempor": 31, "termin": 42, "test": 30, "thei": 21, "travel": 44, "treatment": [28, 38], "tree": 41, "udf": [36, 44], "udwf": 36, "unpars": 18, "updat": 23, "upgrad": 55, "us": [26, 36], "usag": 39, "user": [28, 36, 38, 40, 45], "user_defin": 19, "util": 55, "v": 41, "valu": 31, "via": 44, "view": 37, "what": [21, 26, 44], "when": [36, 41], "why": 35, "window": [36, 38], "within": 28, "work": [21, 43, 44], "worker": 44, "you": 26, "zero": 42}}) \ No newline at end of file
diff --git a/user-guide/common-operations/basic-info.html b/user-guide/common-operations/basic-info.html index 98d7be0..7bb226b 100644 --- a/user-guide/common-operations/basic-info.html +++ b/user-guide/common-operations/basic-info.html
@@ -528,11 +528,11 @@ +-----+---------+--------+--------+ | nrs | names | random | groups | +-----+---------+--------+--------+ -| 1 | python | 682 | A | -| 2 | ruby | 175 | A | -| 3 | java | 367 | B | -| 4 | haskell | 867 | C | -| 5 | go | 716 | B | +| 1 | python | 219 | A | +| 2 | ruby | 523 | A | +| 3 | java | 783 | B | +| 4 | haskell | 521 | C | +| 5 | go | 888 | B | +-----+---------+--------+--------+ </pre></div> </div> @@ -550,8 +550,8 @@ +-----+--------+--------+--------+ | nrs | names | random | groups | +-----+--------+--------+--------+ -| 1 | python | 682 | A | -| 2 | ruby | 175 | A | +| 1 | python | 219 | A | +| 2 | ruby | 523 | A | +-----+--------+--------+--------+ </pre></div> </div> @@ -583,11 +583,11 @@ </div> <div class="cell_output docutils container"> <div class="output text_plain highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span> nrs names random groups -0 1 python 682 A -1 2 ruby 175 A -2 3 java 367 B -3 4 haskell 867 C -4 5 go 716 B +0 1 python 219 A +1 2 ruby 523 A +2 3 java 783 B +3 4 haskell 521 C +4 5 go 888 B </pre></div> </div> </div> @@ -601,17 +601,17 @@ </div> <div class="cell_output docutils container"> <div class="output text_plain highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>DataFrame() -+------------+--------------------+-------+--------------------+--------+ -| describe | nrs | names | random | groups | -+------------+--------------------+-------+--------------------+--------+ -| count | 5.0 | 5 | 5.0 | 5 | -| null_count | 0.0 | 0 | 0.0 | 0 | -| mean | 3.0 | null | 561.4 | null | -| std | 1.5811388300841898 | null | 282.37085543660487 | null | -| min | 1.0 | go | 175.0 | A | -| max | 5.0 | ruby | 867.0 | C | -| median | 3.0 | null | 682.0 | null | -+------------+--------------------+-------+--------------------+--------+ ++------------+--------------------+-------+-------------------+--------+ +| describe | nrs | names | random | groups | ++------------+--------------------+-------+-------------------+--------+ +| count | 5.0 | 5 | 5.0 | 5 | +| null_count | 0.0 | 0 | 0.0 | 0 | +| mean | 3.0 | null | 586.8 | null | +| std | 1.5811388300841898 | null | 261.1957120628132 | null | +| min | 1.0 | go | 219.0 | A | +| max | 5.0 | ruby | 888.0 | C | +| median | 3.0 | null | 523.0 | null | ++------------+--------------------+-------+-------------------+--------+ </pre></div> </div> </div>
diff --git a/user-guide/common-operations/functions.html b/user-guide/common-operations/functions.html index c4bae58..ebe2b42 100644 --- a/user-guide/common-operations/functions.html +++ b/user-guide/common-operations/functions.html
@@ -611,16 +611,16 @@ +-------------------------------+ | now() | +-------------------------------+ -| 2026-08-26T19:32:07.684358312 | -| 2026-08-26T19:32:07.684358312 | -| 2026-08-26T19:32:07.684358312 | -| 2026-08-26T19:32:07.684358312 | -| 2026-08-26T19:32:07.684358312 | -| 2026-08-26T19:32:07.684358312 | -| 2026-08-26T19:32:07.684358312 | -| 2026-08-26T19:32:07.684358312 | -| 2026-08-26T19:32:07.684358312 | -| 2026-08-26T19:32:07.684358312 | +| 2026-08-28T21:18:34.447868236 | +| 2026-08-28T21:18:34.447868236 | +| 2026-08-28T21:18:34.447868236 | +| 2026-08-28T21:18:34.447868236 | +| 2026-08-28T21:18:34.447868236 | +| 2026-08-28T21:18:34.447868236 | +| 2026-08-28T21:18:34.447868236 | +| 2026-08-28T21:18:34.447868236 | +| 2026-08-28T21:18:34.447868236 | +| 2026-08-28T21:18:34.447868236 | +-------------------------------+ Data truncated. </pre></div>
diff --git a/user-guide/common-operations/udf-and-udfa.html b/user-guide/common-operations/udf-and-udfa.html index 736a1ac..8e568a6 100644 --- a/user-guide/common-operations/udf-and-udfa.html +++ b/user-guide/common-operations/udf-and-udfa.html
@@ -675,7 +675,7 @@ <div class="cell_output docutils container"> <div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>FilterExec: brand@1 = A AND qty@2 >= 150 RepartitionExec: partitioning=RoundRobinBatch(4), input_partitions=1 - DataSourceExec: file_groups={1 group: [[tmp/tmphwqgxmgq/items.parquet]]}, projection=[id, brand, qty], file_type=parquet, predicate=brand@1 = A AND qty@2 >= 150, pruning_predicate=brand_null_count@2 != row_count@3 AND brand_min@0 <= A AND A <= brand_max@1 AND qty_null_count@5 != row_count@3 AND qty_max@4 >= 150, required_guarantees=[brand in (A)] + DataSourceExec: file_groups={1 group: [[tmp/tmpe5kz64xa/items.parquet]]}, projection=[id, brand, qty], file_type=parquet, predicate=brand@1 = A AND qty@2 >= 150, pruning_predicate=brand_null_count@2 != row_count@3 AND brand_min@0 <= A AND A <= brand_max@1 AND qty_null_count@5 != row_count@3 AND qty_max@4 >= 150, required_guarantees=[brand in (A)] </pre></div> </div> </div> @@ -711,7 +711,7 @@ <div class="cell_output docutils container"> <div class="output stream highlight-myst-ansi notranslate"><div class="highlight"><pre><span></span>FilterExec: brand_qty_filter(CAST(brand@1 AS Utf8), qty@2) RepartitionExec: partitioning=RoundRobinBatch(4), input_partitions=1 - DataSourceExec: file_groups={1 group: [[tmp/tmphwqgxmgq/items.parquet]]}, projection=[id, brand, qty], file_type=parquet, predicate=brand_qty_filter(CAST(brand@1 AS Utf8), qty@2) + DataSourceExec: file_groups={1 group: [[tmp/tmpe5kz64xa/items.parquet]]}, projection=[id, brand, qty], file_type=parquet, predicate=brand_qty_filter(CAST(brand@1 AS Utf8), qty@2) </pre></div> </div> </div>
diff --git a/user-guide/index.html b/user-guide/index.html index 57d5a76..036482c 100644 --- a/user-guide/index.html +++ b/user-guide/index.html
@@ -582,6 +582,7 @@ </ul> </li> <li class="toctree-l1"><a class="reference internal" href="upgrade-guides.html">Upgrade Guides</a><ul> +<li class="toctree-l2"><a class="reference internal" href="upgrade-guides.html#datafusion-55-0-0">DataFusion 55.0.0</a></li> <li class="toctree-l2"><a class="reference internal" href="upgrade-guides.html#datafusion-54-0-0">DataFusion 54.0.0</a></li> <li class="toctree-l2"><a class="reference internal" href="upgrade-guides.html#datafusion-53-0-0">DataFusion 53.0.0</a></li> <li class="toctree-l2"><a class="reference internal" href="upgrade-guides.html#datafusion-52-0-0">DataFusion 52.0.0</a></li>
diff --git a/user-guide/io/table_provider.html b/user-guide/io/table_provider.html index 6d06dd0..81e5afe 100644 --- a/user-guide/io/table_provider.html +++ b/user-guide/io/table_provider.html
@@ -512,19 +512,23 @@ you must use DataFusion 43.0.0 or later and expose a <a class="reference external" href="https://crates.io/crates/datafusion-ffi">FFI_TableProvider</a> via <a class="reference external" href="https://pyo3.rs/main/doc/pyo3/types/struct.pycapsule">PyCapsule</a>.</p> <p>A complete example can be found in the <a class="reference external" href="https://github.com/apache/datafusion-python/tree/main/examples">examples folder</a>.</p> +<p>The method takes the <code class="docutils literal notranslate"><span class="pre">SessionContext</span></code> it is being registered on. Take whatever +the FFI constructor needs from that session — here the logical extension codec — +rather than building one inside your library. See the <a class="reference internal" href="../../contributor-guide/ffi.html#ffi"><span class="std std-ref">Python Extensions</span></a> guide for the +full capsule protocol.</p> <div class="highlight-rust notranslate"><div class="highlight"><pre><span></span><span class="cp">#[pymethods]</span> <span class="k">impl</span><span class="w"> </span><span class="n">MyTableProvider</span><span class="w"> </span><span class="p">{</span> <span class="w"> </span><span class="k">fn</span><span class="w"> </span><span class="nf">__datafusion_table_provider__</span><span class="o"><'</span><span class="na">py</span><span class="o">></span><span class="p">(</span> <span class="w"> </span><span class="o">&</span><span class="bp">self</span><span class="p">,</span> <span class="w"> </span><span class="n">py</span><span class="p">:</span><span class="w"> </span><span class="nc">Python</span><span class="o"><'</span><span class="na">py</span><span class="o">></span><span class="p">,</span> +<span class="w"> </span><span class="n">session</span><span class="p">:</span><span class="w"> </span><span class="nc">Bound</span><span class="o"><'</span><span class="na">py</span><span class="p">,</span><span class="w"> </span><span class="n">PyAny</span><span class="o">></span><span class="p">,</span> <span class="w"> </span><span class="p">)</span><span class="w"> </span><span class="p">-></span><span class="w"> </span><span class="nc">PyResult</span><span class="o"><</span><span class="n">Bound</span><span class="o"><'</span><span class="na">py</span><span class="p">,</span><span class="w"> </span><span class="n">PyCapsule</span><span class="o">>></span><span class="w"> </span><span class="p">{</span> -<span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">name</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">cr</span><span class="s">"datafusion_table_provider"</span><span class="p">.</span><span class="n">into</span><span class="p">();</span> - <span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">provider</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">Arc</span><span class="p">::</span><span class="n">new</span><span class="p">(</span><span class="bp">self</span><span class="p">.</span><span class="n">clone</span><span class="p">());</span> -<span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">provider</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">FFI_TableProvider</span><span class="p">::</span><span class="n">new</span><span class="p">(</span><span class="n">provider</span><span class="p">,</span><span class="w"> </span><span class="kc">false</span><span class="p">,</span><span class="w"> </span><span class="nb">None</span><span class="p">);</span> +<span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">codec</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">ffi_logical_codec_from_pycapsule</span><span class="p">(</span><span class="n">session</span><span class="p">,</span><span class="w"> </span><span class="nb">None</span><span class="p">)</span><span class="o">?</span><span class="p">;</span> +<span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">provider</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">FFI_TableProvider</span><span class="p">::</span><span class="n">new_with_ffi_codec</span><span class="p">(</span><span class="n">provider</span><span class="p">,</span><span class="w"> </span><span class="kc">false</span><span class="p">,</span><span class="w"> </span><span class="nb">None</span><span class="p">,</span><span class="w"> </span><span class="n">codec</span><span class="p">);</span> -<span class="w"> </span><span class="n">PyCapsule</span><span class="p">::</span><span class="n">new_bound</span><span class="p">(</span><span class="n">py</span><span class="p">,</span><span class="w"> </span><span class="n">provider</span><span class="p">,</span><span class="w"> </span><span class="nb">Some</span><span class="p">(</span><span class="n">name</span><span class="p">.</span><span class="n">clone</span><span class="p">()))</span> +<span class="w"> </span><span class="n">PyCapsule</span><span class="p">::</span><span class="n">new_with_value</span><span class="p">(</span><span class="n">py</span><span class="p">,</span><span class="w"> </span><span class="n">provider</span><span class="p">,</span><span class="w"> </span><span class="n">cr</span><span class="s">"datafusion_table_provider"</span><span class="p">)</span> <span class="w"> </span><span class="p">}</span> <span class="p">}</span> </pre></div>
diff --git a/user-guide/upgrade-guides.html b/user-guide/upgrade-guides.html index 8f2b6d2..2f79fc4 100644 --- a/user-guide/upgrade-guides.html +++ b/user-guide/upgrade-guides.html
@@ -507,6 +507,112 @@ --> <section id="upgrade-guides"> <h1>Upgrade Guides<a class="headerlink" href="#upgrade-guides" title="Link to this heading">#</a></h1> +<section id="datafusion-55-0-0"> +<h2>DataFusion 55.0.0<a class="headerlink" href="#datafusion-55-0-0" title="Link to this heading">#</a></h2> +<p>This release extends the change made in 52.0.0 to the remaining <a class="reference internal" href="../contributor-guide/ffi.html#ffi"><span class="std std-ref">Python Extensions</span></a> hook +methods. Users who contribute their own <code class="docutils literal notranslate"><span class="pre">LogicalExtensionCodec</span></code> or +<code class="docutils literal notranslate"><span class="pre">PhysicalExtensionCodec</span></code> via FFI must update +<code class="docutils literal notranslate"><span class="pre">__datafusion_logical_extension_codec__</span></code> and +<code class="docutils literal notranslate"><span class="pre">__datafusion_physical_extension_codec__</span></code> to accept an additional +<code class="docutils literal notranslate"><span class="pre">session:</span> <span class="pre">Bound<PyAny></span></code> parameter, and take the <code class="docutils literal notranslate"><span class="pre">TaskContextProvider</span></code> from that +session rather than constructing a <code class="docutils literal notranslate"><span class="pre">SessionContext</span></code> of their own.</p> +<p>Before:</p> +<div class="highlight-rust notranslate"><div class="highlight"><pre><span></span><span class="k">fn</span><span class="w"> </span><span class="nf">__datafusion_physical_extension_codec__</span><span class="o"><'</span><span class="na">py</span><span class="o">></span><span class="p">(</span> +<span class="w"> </span><span class="o">&</span><span class="bp">self</span><span class="p">,</span> +<span class="w"> </span><span class="n">py</span><span class="p">:</span><span class="w"> </span><span class="nc">Python</span><span class="o"><'</span><span class="na">py</span><span class="o">></span><span class="p">,</span> +<span class="p">)</span><span class="w"> </span><span class="p">-></span><span class="w"> </span><span class="nc">PyResult</span><span class="o"><</span><span class="n">Bound</span><span class="o"><'</span><span class="na">py</span><span class="p">,</span><span class="w"> </span><span class="n">PyCapsule</span><span class="o">>></span><span class="w"> </span><span class="p">{</span> +<span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">ctx_provider</span><span class="p">:</span><span class="w"> </span><span class="nc">Arc</span><span class="o"><</span><span class="k">dyn</span><span class="w"> </span><span class="n">TaskContextProvider</span><span class="o">></span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">Arc</span><span class="p">::</span><span class="n">clone</span><span class="p">(</span><span class="o">&</span><span class="bp">self</span><span class="p">.</span><span class="n">ctx_provider</span><span class="p">);</span> +<span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">ffi</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">FFI_PhysicalExtensionCodec</span><span class="p">::</span><span class="n">new</span><span class="p">(</span><span class="n">inner</span><span class="p">,</span><span class="w"> </span><span class="nb">Some</span><span class="p">(</span><span class="n">runtime</span><span class="p">),</span><span class="w"> </span><span class="o">&</span><span class="n">ctx_provider</span><span class="p">);</span> +<span class="w"> </span><span class="n">PyCapsule</span><span class="p">::</span><span class="n">new_with_value</span><span class="p">(</span><span class="n">py</span><span class="p">,</span><span class="w"> </span><span class="n">ffi</span><span class="p">,</span><span class="w"> </span><span class="n">cr</span><span class="s">"datafusion_physical_extension_codec"</span><span class="p">)</span> +<span class="p">}</span> +</pre></div> +</div> +<p>After:</p> +<div class="highlight-rust notranslate"><div class="highlight"><pre><span></span><span class="k">fn</span><span class="w"> </span><span class="nf">__datafusion_physical_extension_codec__</span><span class="o"><'</span><span class="na">py</span><span class="o">></span><span class="p">(</span> +<span class="w"> </span><span class="o">&</span><span class="bp">self</span><span class="p">,</span> +<span class="w"> </span><span class="n">py</span><span class="p">:</span><span class="w"> </span><span class="nc">Python</span><span class="o"><'</span><span class="na">py</span><span class="o">></span><span class="p">,</span> +<span class="w"> </span><span class="n">session</span><span class="p">:</span><span class="w"> </span><span class="nc">Bound</span><span class="o"><'</span><span class="na">py</span><span class="p">,</span><span class="w"> </span><span class="n">PyAny</span><span class="o">></span><span class="p">,</span> +<span class="p">)</span><span class="w"> </span><span class="p">-></span><span class="w"> </span><span class="nc">PyResult</span><span class="o"><</span><span class="n">Bound</span><span class="o"><'</span><span class="na">py</span><span class="p">,</span><span class="w"> </span><span class="n">PyCapsule</span><span class="o">>></span><span class="w"> </span><span class="p">{</span> +<span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">ctx_provider</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">ffi_task_context_provider_from_pycapsule</span><span class="p">(</span><span class="o">&</span><span class="n">session</span><span class="p">)</span><span class="o">?</span><span class="p">;</span> +<span class="w"> </span><span class="kd">let</span><span class="w"> </span><span class="n">ffi</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">FFI_PhysicalExtensionCodec</span><span class="p">::</span><span class="n">new</span><span class="p">(</span><span class="n">inner</span><span class="p">,</span><span class="w"> </span><span class="nb">Some</span><span class="p">(</span><span class="n">runtime</span><span class="p">),</span><span class="w"> </span><span class="n">ctx_provider</span><span class="p">);</span> +<span class="w"> </span><span class="n">PyCapsule</span><span class="p">::</span><span class="n">new_with_value</span><span class="p">(</span><span class="n">py</span><span class="p">,</span><span class="w"> </span><span class="n">ffi</span><span class="p">,</span><span class="w"> </span><span class="n">cr</span><span class="s">"datafusion_physical_extension_codec"</span><span class="p">)</span> +<span class="p">}</span> +</pre></div> +</div> +<p>The dropped <code class="docutils literal notranslate"><span class="pre">&</span></code> on the last argument is not a typo. That parameter is +<code class="docutils literal notranslate"><span class="pre">impl</span> <span class="pre">Into<FFI_TaskContextProvider></span></code>, so it accepts either an +<code class="docutils literal notranslate"><span class="pre">&Arc<dyn</span> <span class="pre">TaskContextProvider></span></code>, as before, or an <code class="docutils literal notranslate"><span class="pre">FFI_TaskContextProvider</span></code>, +which is what <code class="docutils literal notranslate"><span class="pre">ffi_task_context_provider_from_pycapsule</span></code> hands back. Both forms +compile; the argument changes because the provider now comes from the session +rather than from a field.</p> +<p>A codec that keeps its own <code class="docutils literal notranslate"><span class="pre">SessionContext</span></code> still compiles, but its decode +callbacks resolve names against that empty session instead of the one running +the query, so a function registered with <code class="docutils literal notranslate"><span class="pre">SessionContext.register_udf</span></code> is not +visible to it. Taking the provider from <code class="docutils literal notranslate"><span class="pre">session</span></code> also removes a lifetime +hazard: <code class="docutils literal notranslate"><span class="pre">FFI_TaskContextProvider</span></code> holds its provider weakly, so a context +constructed inside the getter is already dropped by the time the capsule is +used.</p> +<p><code class="docutils literal notranslate"><span class="pre">SessionContext</span></code> accepts the argument on its own capsule getters and ignores +it, so existing calls such as <code class="docutils literal notranslate"><span class="pre">ctx.__datafusion_logical_extension_codec__()</span></code> +continue to work unchanged.</p> +<p>New in this release, <code class="docutils literal notranslate"><span class="pre">__datafusion_query_planner__</span></code> follows the same protocol. +It receives the session and takes both extension codecs from it, so a planner +library never builds a <code class="docutils literal notranslate"><span class="pre">TaskContextProvider</span></code> at all. Install one with +<code class="docutils literal notranslate"><span class="pre">SessionContext.set_query_planner(planner)</span></code>, which mutates the session the same +way <code class="docutils literal notranslate"><span class="pre">add_physical_optimizer_rule</span></code> does and returns nothing — the query planner +lives in <code class="docutils literal notranslate"><span class="pre">SessionState</span></code>, so it belongs to the session rather than to a +particular handle on it. See the <a class="reference internal" href="../contributor-guide/ffi.html#ffi"><span class="std std-ref">Python Extensions</span></a> guide for the full protocol.</p> +<section id="mismatched-extension-libraries-now-fail-loudly"> +<h3>Mismatched extension libraries now fail loudly<a class="headerlink" href="#mismatched-extension-libraries-now-fail-loudly" title="Link to this heading">#</a></h3> +<p>Objects imported through the capsule protocol are checked against the major +version of <code class="docutils literal notranslate"><span class="pre">datafusion-ffi</span></code> this package was built with. A table provider, +extension codec, or query planner produced by a library built against a +different DataFusion major version now raises an <code class="docutils literal notranslate"><span class="pre">ImportError</span></code> naming the +version found and the one expected, instead of being used as-is. Table +providers previously performed no such check.</p> +<p>This is a diagnostic rather than a soundness guarantee — reading the version +out of the struct already assumes the local field layout — but it turns the +common “extension library built against the wrong DataFusion” mistake into a +clear message rather than undefined behaviour on first use.</p> +<p><code class="docutils literal notranslate"><span class="pre">FFI_TaskContextProvider</span></code>, <code class="docutils literal notranslate"><span class="pre">FFI_TableProviderFactory</span></code>, and <code class="docutils literal notranslate"><span class="pre">FFI_ExtensionOptions</span></code> +carry no version field, so objects of those types cannot be checked.</p> +</section> +<section id="changes-to-the-datafusion-python-util-crate"> +<h3>Changes to the <code class="docutils literal notranslate"><span class="pre">datafusion-python-util</span></code> crate<a class="headerlink" href="#changes-to-the-datafusion-python-util-crate" title="Link to this heading">#</a></h3> +<p>Extension libraries written in Rust usually depend on the +<code class="docutils literal notranslate"><span class="pre">datafusion-python-util</span></code> crate for the helpers that read these capsules. Two of +those helpers changed, because the getter they call now takes the session.</p> +<p><code class="docutils literal notranslate"><span class="pre">ffi_logical_codec_from_pycapsule</span></code> takes a second argument. Pass <code class="docutils literal notranslate"><span class="pre">Some(session)</span></code> +when importing an object from another library, so its getter receives the +session it is being installed on. Pass <code class="docutils literal notranslate"><span class="pre">None</span></code> when the object <em>is</em> a session and +you are asking it for what it holds:</p> +<div class="highlight-rust notranslate"><div class="highlight"><pre><span></span><span class="c1">// Before</span> +<span class="kd">let</span><span class="w"> </span><span class="n">codec</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">ffi_logical_codec_from_pycapsule</span><span class="p">(</span><span class="n">obj</span><span class="p">)</span><span class="o">?</span><span class="p">;</span> + +<span class="c1">// After</span> +<span class="kd">let</span><span class="w"> </span><span class="n">codec</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">ffi_logical_codec_from_pycapsule</span><span class="p">(</span><span class="n">obj</span><span class="p">,</span><span class="w"> </span><span class="nb">Some</span><span class="p">(</span><span class="n">session</span><span class="p">))</span><span class="o">?</span><span class="p">;</span> +</pre></div> +</div> +<p><code class="docutils literal notranslate"><span class="pre">physical_codec_from_pycapsule</span></code> has been <strong>removed</strong>. It called +<code class="docutils literal notranslate"><span class="pre">__datafusion_physical_extension_codec__</span></code> with no arguments, which no longer +matches the protocol, so against an updated codec it raised a bare <code class="docutils literal notranslate"><span class="pre">TypeError</span></code> +and against an outdated one it silently produced a codec bound to the wrong +session. Use <code class="docutils literal notranslate"><span class="pre">ffi_physical_codec_from_pycapsule</span></code>, which passes the session:</p> +<div class="highlight-rust notranslate"><div class="highlight"><pre><span></span><span class="c1">// Before</span> +<span class="kd">let</span><span class="w"> </span><span class="n">codec</span><span class="p">:</span><span class="w"> </span><span class="nc">Arc</span><span class="o"><</span><span class="k">dyn</span><span class="w"> </span><span class="n">PhysicalExtensionCodec</span><span class="o">></span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">physical_codec_from_pycapsule</span><span class="p">(</span><span class="o">&</span><span class="n">obj</span><span class="p">)</span><span class="o">?</span><span class="p">;</span> + +<span class="c1">// After</span> +<span class="kd">let</span><span class="w"> </span><span class="n">ffi</span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="n">ffi_physical_codec_from_pycapsule</span><span class="p">(</span><span class="n">obj</span><span class="p">,</span><span class="w"> </span><span class="nb">Some</span><span class="p">(</span><span class="n">session</span><span class="p">))</span><span class="o">?</span><span class="p">;</span> +<span class="kd">let</span><span class="w"> </span><span class="n">codec</span><span class="p">:</span><span class="w"> </span><span class="nc">Arc</span><span class="o"><</span><span class="k">dyn</span><span class="w"> </span><span class="n">PhysicalExtensionCodec</span><span class="o">></span><span class="w"> </span><span class="o">=</span><span class="w"> </span><span class="p">(</span><span class="o">&</span><span class="n">ffi</span><span class="p">).</span><span class="n">into</span><span class="p">();</span> +</pre></div> +</div> +<p><code class="docutils literal notranslate"><span class="pre">physical_optimizer_rule_from_pycapsule</span></code> and <code class="docutils literal notranslate"><span class="pre">task_context_from_pycapsule</span></code> are +unchanged. Their hooks take no session.</p> +<p>Calling a getter that still has the old signature now raises an <code class="docutils literal notranslate"><span class="pre">ImportError</span></code> +naming the method, with the original <code class="docutils literal notranslate"><span class="pre">TypeError</span></code> retained as its <code class="docutils literal notranslate"><span class="pre">__cause__</span></code>, +rather than a bare <code class="docutils literal notranslate"><span class="pre">TypeError</span></code>.</p> +</section> +</section> <section id="datafusion-54-0-0"> <h2>DataFusion 54.0.0<a class="headerlink" href="#datafusion-54-0-0" title="Link to this heading">#</a></h2> <p>The <code class="docutils literal notranslate"><span class="pre">Config</span></code> class has been removed. It was a standalone wrapper around @@ -677,6 +783,11 @@ </div> <nav class="bd-toc-nav page-toc" aria-labelledby="pst-page-navigation-heading-2"> <ul class="visible nav section-nav flex-column"> +<li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion-55-0-0">DataFusion 55.0.0</a><ul class="visible nav section-nav flex-column"> +<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#mismatched-extension-libraries-now-fail-loudly">Mismatched extension libraries now fail loudly</a></li> +<li class="toc-h3 nav-item toc-entry"><a class="reference internal nav-link" href="#changes-to-the-datafusion-python-util-crate">Changes to the <code class="docutils literal notranslate"><span class="pre">datafusion-python-util</span></code> crate</a></li> +</ul> +</li> <li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion-54-0-0">DataFusion 54.0.0</a></li> <li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion-53-0-0">DataFusion 53.0.0</a></li> <li class="toc-h2 nav-item toc-entry"><a class="reference internal nav-link" href="#datafusion-52-0-0">DataFusion 52.0.0</a></li>