feat(batch): introduce batch AsOf join #19790
Conversation
| stream_error: 'Invalid input syntax: AsOf join requires exactly 1 ineuquality condition' | ||
| - sql: CREATE TABLE t1(v1 varchar, v2 int, v3 int); CREATE TABLE t2(v1 varchar, v2 int, v3 int); SELECT t1.v1 t1_v1, t1.v2 t1_v2, t2.v1 t2_v1, t2.v2 t2_v2 FROM t1 ASOF JOIN t2 ON t1.v1 = t2.v1 || 'a' and t1.v2 > t2.v2; | ||
| batch_plan: |- | ||
| BatchExchange { order: [], dist: Single } | ||
| └─BatchGroupTopN { order: [t2.v2 DESC], limit: 1, offset: 0, group_key: [t1.v1, t1.v2] } |
There was a problem hiding this comment.
This plan seems incorrect because it will make the rows less then expected
There was a problem hiding this comment.
I changed the implementation and this should be resolved now.
|
This pull request has been modified. If you want me to regenerate unit test for any of the files related, please find the file in "Files Changed" tab and add a comment |
yuhao-su
added
the
user-facing-changes
|
Hi, there. 📝 Telemetry Reminder:
|
…hao/batch-asof-join
I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.
What's changed and what's your intention?
add batch ASOF join functionality to batch HashJoinExecutor.
This implementation changed the matched row iter process to return only 1 matched row that fit the asof requirement.
Checklist
Documentation
Usage is the same same as #18683
Ties in the asof column in the right table.
The query result is non-deterministic when there are ties in the inequality condition column in the right table. ASOF JOIN aims to find and join the nearest record from the right table and only matches 1 row for each record from the left table. Therefore when there are ties in the right table, the right table row matched in the returned query result could be different in multiple runs.
Release note