Core: Detect and merge duplicate DVs for a data file and merge them before committing#15006

Open

amogh-jahagirdar wants to merge 28 commits intoapache:mainfrom

amogh-jahagirdar:always-merge-duplicates-on-driver

Commits on Jan 11, 2026

Commits on Jan 12, 2026

Commits on Jan 15, 2026

Make dv refs a multimap, group by partition to write single puffin for merged duplicates, add tests for multiple specs
amogh-jahagirdar
committed
Filter files with duplicates before sifting through them and merging
amogh-jahagirdar
committed
update old comment
amogh-jahagirdar
committed

Commits on Jan 26, 2026

Commits on Jan 27, 2026

Commits on Feb 5, 2026