Skip to content

[VL] Adding configurations for Velox hash join bloom filter feature #11383

@zhouyuan

Description

@zhouyuan

Description

Velox recently add the bloom filter when doing hash probe:
facebookincubator/velox#15752

  /// Whether hash probe can generate any dynamic filter (including Bloom
  /// filter) and push down to upstream operators.
  static constexpr const char* kHashProbeDynamicFilterPushdownEnabled =
      "hash_probe_dynamic_filter_pushdown_enabled";

  /// The maximum byte size of Bloom filter that can be generated from hash
  /// probe.  When set to 0, no Bloom filter will be generated.  To achieve
  /// optimal performance, this should not be too larger than the CPU cache size
  /// on the host.
  static constexpr const char* kHashProbeBloomFilterPushdownMaxSize =
      "hash_probe_bloom_filter_pushdown_max_size";

Gluten should add these two necessary configurations for Velox backend

Gluten version

None

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions