feat(connect): add df.{intersection,union}

[andrewgazelka]

No description provided.

[andrewgazelka]

• feat(connect): add df.{intersection,union} #3373 : 3 dependent PRs (#3375 , #3379 , #3384 ) 👈 (View in Graphite)
• [CHORE] connect, test: df.withColumn #3359
• [FEAT] connect: add modulus operator and withColumns support #3351
• [FEAT] connect: add binary operators #3350 : 3 other dependent PRs (#3346 , #3376 , #3387 )
• [FEAT] connect: support basic column operations #3362 : 1 other dependent PR (#3363 )
• [FEAT] connect: to_daft_* use ref instead of value #3355 : 2 other dependent PRs (#3357 , #3360 )
• [FEAT] connect: add alias support #3342 : 6 other dependent PRs (#3344 , #3345 , #3348 and 3 others)
• [FEAT] consolidate Spark session fixture into conftest.py #3341 : 3 other dependent PRs (#3309 , #3326 , #3343 )
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[graphite-app]

Graphite Automations

"Warn authors when publishing large PRs" took an action on this PR • (11/21/24)

1 teammate was notified to this PR based on Andrew Gazelka's automation.

[codspeed-hq]

CodSpeed Performance Report

Merging #3373 will degrade performances by 44.81%

_{Comparing andrew/connect-intersect-union (4ed9161) with main (07752b8)}

Summary

❌ 2 regressions
✅ 25 untouched benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

	Benchmark	main	andrew/connect-intersect-union	Change
❌	test_iter_rows_first_row[100 Small Files]	159.5 ms	289 ms	-44.81%
❌	test_show[100 Small Files]	16.1 ms	23.2 ms	-30.52%

[codecov]

Codecov Report

Attention: Patch coverage is 82.60870% with 8 lines in your changes missing coverage. Please review.

Project coverage is 77.90%. Comparing base (07752b8) to head (4ed9161).

Files with missing lines	Patch %	Lines
...aft-connect/src/translation/logical_plan/set_op.rs	83.72%	7 Missing ⚠️
src/daft-connect/src/translation/logical_plan.rs	66.66%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3373      +/-   ##
==========================================
+ Coverage   77.86%   77.90%   +0.04%     
==========================================
  Files         719      720       +1     
  Lines       88459    88505      +46     
==========================================
+ Hits        68877    68949      +72     
+ Misses      19582    19556      -26     

Files with missing lines	Coverage Δ
src/daft-connect/src/translation/logical_plan.rs	68.85% <66.66%> (-0.12%)	⬇️
...aft-connect/src/translation/logical_plan/set_op.rs	83.72% <83.72%> (ø)

... and 5 files with indirect coverage changes