Audit notes for expressions in this category that have been audited. Absence of an entry means the expression has not been audited yet, not that it is unsupported. See the user guide Spark Expression Support for current support status.
&BitwiseAnd(left, right) extends BinaryArithmetic over IntegralType. Comet routes via CometBitwiseAnd to the proto's bitwise_and binary expression.NullIntolerant trait replaced by nullIntolerant: Boolean.<<shiftleft(...) exists; the << operator alias is added in Spark 4.0.<< parses to ShiftLeft (the same case class as shiftleft) via a parser alias. ShiftLeft now extends a shared BitShiftOperation trait; eval semantics unchanged. Comet CometShiftLeft casts the right operand to LongType when left.dataType == LongType because DataFusion's bitwise shift requires matching operand types.>><< history — only the function form exists pre-4.0.>> parses to ShiftRight. Comet CometShiftRight mirrors the same operand-cast logic as CometShiftLeft.^BitwiseXor(left, right) extends BinaryArithmetic over IntegralType. Comet routes via CometBitwiseXor to the proto's bitwise_xor binary expression.nullIntolerant field refactor.BitwiseCount(child) extends UnaryExpression; accepts IntegralType or BooleanType and returns the population count as IntegerType. Wired as CometScalarFunction("bit_count").BitwiseGet(left, right) extends BinaryExpression; inputTypes = (IntegralType, IntegerType) -> ByteType. The position is bounds-checked at runtime via BitwiseGetUtil.checkPosition. Comet routes via CometBitwiseGet to the native bit_get scalar.BitwiseGet. Same support as bit_get.ShiftRight. Same support as the >> operator alias added in 4.0.>> operator is the only addition).ShiftRightUnsigned(left, right) extends BinaryExpression; uses Java's >>> (zero-fill) semantics. Comet wires as CometScalarFunction("shiftrightunsigned") (added in #4375).BitShiftOperation trait; eval semantics unchanged. The >>> operator alias is added at the parser level.|BitwiseOr(left, right) extends BinaryArithmetic over IntegralType. Comet routes via CometBitwiseOr to the proto's bitwise_or binary expression.nullIntolerant field refactor.~BitwiseNot(child) extends UnaryExpression; accepts IntegralType and returns the bitwise complement of the same type. Comet routes via CometBitwiseNot to the native bitwise_not scalar.nullIntolerant field refactor.