Support Spark 4.3

[pan3793]

Why are the changes needed?

Spark 4.3.0 is currently in the RC voting phase. This prepares Kyuubi for Spark 4.3 and validates it against the RC artifacts.

What changes are proposed?

• Adds the spark-4.3 profile and kyuubi-extension-spark-4-3 module.
• Adapts the Spark extension, Hive connector tests, and Arrow runtime for Spark 4.3 API changes.
• Adds Spark 4.3 CI, release, distribution, codecov, formatting, and documentation coverage.
• Lakehouse engines still fall back to Spark 4.1 artifacts until native Spark 4.3 support is available.
• The temporary Spark staging repository and binary archive reference v4.3.0-rc1; they must be updated if the RC changes or after the final release is published.

How was this patch tested?

• build/mvn test -pl extensions/spark/kyuubi-extension-spark-4-3 -am -Pspark-4.3 -Pscala-2.13
• build/mvn test -pl extensions/spark/kyuubi-spark-connector-hive -am -Pspark-4.3 -Pscala-2.13
• build/mvn test -pl extensions/spark/kyuubi-spark-authz,extensions/spark/kyuubi-spark-lineage -am -Pspark-4.3 -Pscala-2.13
• build/mvn test -pl externals/kyuubi-spark-sql-engine -Pspark-4.3 -Pscala-2.13
• ./dev/reformat

Was this patch authored or co-authored using generative AI tooling?

Assisted-by: Codex