feat(query): Inverted index support search Variant inner fields

[b41sh]

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

This PR improves inverted index support for VARIANT data:

1. Tantivy Upgrade: Upgraded the underlying Tantivy search engine to its latest version, bringing performance improvements and new features.
2. Tantivy Search Integration: Replaced custom search functions with Tantivy's search capabilities. This change delivers better query performance, though it may result in a slightly larger index file size, we can improve performance by caching index data locally.
3. Advanced VARIANT Field Search: Introduced the ability to perform complex searches within VARIANT internal fields, including AND, OR, IN, and Range queries. This allows for precise and flexible filtering of semi-structured data.

for example

CREATE OR REPLACE TABLE test ( id INT NULL, data VARIANT NULL, INVERTED INDEX idx1 (data) ); INSERT INTO test VALUES (1, '{"user":{"name":"Alice","age":20,"hobbies":["football","swimming"]}}'), (2, '{"user":{"name":"Bob","age":25,"hobbies":["shopping","piano"]}}'), (3, '{"user":{"name":"Tom","age":30,"hobbies":["travel","running"]}}'); SELECT * FROM test WHERE query('data.user.name:Bob AND data.user.age:25'); ╭───────────────────────────────────────────────────────────────────────────────────╮ │ id │ data │ │ Nullable(Int32) │ Nullable(Variant) │ ├─────────────────┼─────────────────────────────────────────────────────────────────┤ │ 2 │ {"user":{"age":25,"hobbies":["shopping","piano"],"name":"Bob"}} │ ╰───────────────────────────────────────────────────────────────────────────────────╯ SELECT * FROM test WHERE query('data.user.name:Bob OR data.user.age:30'); ╭───────────────────────────────────────────────────────────────────────────────────╮ │ id │ data │ │ Nullable(Int32) │ Nullable(Variant) │ ├─────────────────┼─────────────────────────────────────────────────────────────────┤ │ 2 │ {"user":{"age":25,"hobbies":["shopping","piano"],"name":"Bob"}} │ │ 3 │ {"user":{"age":30,"hobbies":["travel","running"],"name":"Tom"}} │ ╰───────────────────────────────────────────────────────────────────────────────────╯ SELECT * FROM test WHERE query('data.user.hobbies: IN [football shopping]'); ╭────────────────────────────────────────────────────────────────────────────────────────╮ │ id │ data │ │ Nullable(Int32) │ Nullable(Variant) │ ├─────────────────┼──────────────────────────────────────────────────────────────────────┤ │ 1 │ {"user":{"age":20,"hobbies":["football","swimming"],"name":"Alice"}} │ │ 2 │ {"user":{"age":25,"hobbies":["shopping","piano"],"name":"Bob"}} │ ╰────────────────────────────────────────────────────────────────────────────────────────╯ SELECT * FROM test WHERE query('data.user.age: [25 TO 30]'); ╭───────────────────────────────────────────────────────────────────────────────────╮ │ id │ data │ │ Nullable(Int32) │ Nullable(Variant) │ ├─────────────────┼─────────────────────────────────────────────────────────────────┤ │ 2 │ {"user":{"age":25,"hobbies":["shopping","piano"],"name":"Bob"}} │ │ 3 │ {"user":{"age":30,"hobbies":["travel","running"],"name":"Tom"}} │ ╰───────────────────────────────────────────────────────────────────────────────────╯

• part of: Feature: Enhanced Inverted Index Support for Nested Fields within Variant Type #18850

Tests

• Unit Test
• Logic Test
• Benchmark Test
• No Test - Explain why

Type of change

• Bug Fix (non-breaking change which fixes an issue)
• New Feature (non-breaking change which adds functionality)
• Breaking Change (fix or feature that could cause existing functionality not to work as expected)
• Documentation Update
• Refactoring
• Performance Improvement
• Other (please describe):

---

This change is 

[github-actions]

Docker Image for PR

• tag: pr-18861-c5331ec-1760855997

note: this image tag is only available for internal use.