Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: check builds for the-epic-split after rebase #8178

Closed
wants to merge 157 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
157 commits
Select commit Hold shift + click to select a range
3fc0b39
test(ir): reorganize ibis/tests/expr to enable running the tests with…
kszucs Dec 13, 2023
6863d50
test(sql): move sql tests requiring a functional backend from `ibis/t…
cpcloud Dec 5, 2023
116b882
test(backends): move backends dependent benchmarks to ibis/backends/t…
kszucs Dec 13, 2023
ef510bd
test(ir): ensure that no backends are required to run the core tests
kszucs Dec 13, 2023
2dedf4c
chore(ci): skip running backend tests on the-epic-split branch
kszucs Dec 13, 2023
58b4d11
chore(ci): change the core testing command since the core marker is c…
kszucs Dec 13, 2023
29227de
chore(ci): temporarily disable test_doctests job
kszucs Dec 13, 2023
894571d
chore(ci): add todo note about restoring the previous ci-check command
kszucs Dec 14, 2023
0a87bed
test(ir): ensure that no backends are required to run the core tests
kszucs Dec 13, 2023
8530c65
refactor(ir): split the relational operations
kszucs Nov 8, 2023
036d209
refactor(ir): wrap `JoinChain.first` in `ops.SelfReference` similar t…
kszucs Dec 21, 2023
79a02e5
test(ir): cover constructing reductions in the core test suite
kszucs Dec 21, 2023
9d8235d
refactor(ir): add `JoinTable` operation unique to `JoinChain` instead…
kszucs Dec 22, 2023
657b2af
fix(decompile): ensure that `SelfReference` is decompiled with a call…
cpcloud Dec 23, 2023
9349458
refactor(ir): support join of joins while avoiding nesting
kszucs Dec 23, 2023
d8e309f
feat(sql): lower expressions to SQL-like relational operations
kszucs Dec 24, 2023
473a7d2
refactor(duckdb): initial cut of sqlglot DuckDB compiler
gforsyth Jul 10, 2023
ea8339b
refactor(duckdb/clickhouse): implement sqlglot backends and re-enable ci
cpcloud Dec 22, 2023
cfc73f7
feat(datafusion): port to new sqlglot backend
cpcloud Dec 24, 2023
5c93301
refactor(compilers): conslidate StringJoin impl
cpcloud Dec 26, 2023
c608f7f
feat(common): add `Dispatched` base class for convenient visitor patt…
kszucs Dec 28, 2023
8573504
refactor(duckdb): remove the need for a specialized `_to_geodataframe…
cpcloud Dec 29, 2023
7102cfe
fix(duckdb): ensure that create_schema and create_database are actual…
cpcloud Dec 29, 2023
f51ac48
refactor(ir): stricter scalar subquery integrity checks
kszucs Dec 29, 2023
4e72f78
feat(common): add a memory efficient `Node.map()` implementation
kszucs Dec 29, 2023
fc316ec
fix(common): intermediate result removal fails if there are duplicate…
kszucs Dec 29, 2023
3da2366
refactor(api): revamp `asof` join predicates
kszucs Dec 29, 2023
5fc26c1
fix(ir): self reference fields were incorrectly dereferenced to the p…
kszucs Jan 2, 2024
92c36b0
fix(rewrites): add missing filter arguments for `node.replace()` calls
kszucs Jan 2, 2024
35fe3c8
refactor(snowflake): use sqlglot for the snowflake backend
cpcloud Dec 26, 2023
39d97be
refactor(common): support union types as well as forward references i…
kszucs Jan 2, 2024
557a5c6
ci(snowflake): enable for `the-epic-split` branch
cpcloud Jan 3, 2024
14f7024
fir(ir): `asof` join `tolerance` parameter should post-filter and pos…
kszucs Jan 2, 2024
89050c4
feat(duckdb): support `asof` joins including `tolerance` parameter
kszucs Jan 3, 2024
ae1c2bf
ci: remove `merge_group` (#7899)
kszucs Jan 4, 2024
c2f1dc0
refactor(pandas): port the pandas backend with an improved execution …
kszucs Jan 4, 2024
9836501
chore(deps): relock
cpcloud Jan 4, 2024
0a5b229
ci: comment out sys-deps step
cpcloud Jan 4, 2024
2bada35
chore: remove duplicate `distinct` decompile rule
cpcloud Jan 4, 2024
0059c99
ci: install decompiler as extra not as its own dependency (#7901)
cpcloud Jan 4, 2024
1f01dd7
fix(conversion): convert decimals to the exact precision and scale re…
cpcloud Jan 4, 2024
a32bad8
test(snowflake): fix expected decimal results
cpcloud Jan 4, 2024
0a099f5
test(duckdb): relax exact type check in decimal literal assertion
cpcloud Jan 4, 2024
6f62d19
refactor(sqlglot): various sqlglot compiler and backend clean ups (#7…
cpcloud Jan 4, 2024
1548a79
refactor(polars): update the polars backend to use the new relational…
kszucs Jan 4, 2024
c0d871d
feat(trino): port to sqlglot
cpcloud Dec 29, 2023
d877655
fix(polars): force null sorting to match the rest of ibis
cpcloud Jan 5, 2024
b0d26b7
test(pandas): ignore array size warning
cpcloud Jan 5, 2024
036ad27
refactor(postgres): port to sqlglot (#7877)
cpcloud Jan 6, 2024
824dc94
refactor(mysql): port to sqlglot (#7926)
cpcloud Jan 6, 2024
5b32a67
refactor(sqlglot): remove duplicated simple compilation rules and sort
cpcloud Jan 9, 2024
b5c6d28
chore(deps): bump sqlglot and regen sql
cpcloud Jan 12, 2024
ffb8ce4
fix(duckdb): add `flip_coordinates` translation to sqlglot duckdb bac…
cpcloud Jan 12, 2024
7835116
fix(snowflake): use `_safe_raw_sql` for `insert` implementation
cpcloud Jan 12, 2024
3cb160c
fix(mysql): remove not-allowed frame clause from rank window function
cpcloud Jan 12, 2024
67f88c3
test(postgres): use DBAPI instead of sqlalchemy apis in timezone test
cpcloud Jan 12, 2024
256ef9d
test(postgres): remove test that no longer works
cpcloud Jan 12, 2024
d8e321e
test(pandas): use the correct error type when xfailing for compound-s…
cpcloud Jan 12, 2024
aba4df7
refactor(ir): give unbound tables namespaces
cpcloud Jan 12, 2024
4627c25
chore(duckdb/mysql): remove dead code and comment
cpcloud Jan 12, 2024
349788f
refactor(sqlglot): remove duplicate `StringAscii` definitions
cpcloud Jan 12, 2024
26040cb
chore(sqlglot): deduplicate pad functions
cpcloud Jan 12, 2024
d744479
refactor(sqlglot): make anonymous functions easier to use and remove …
cpcloud Jan 12, 2024
523709c
test(backends): make null results try_cast test agnostic to nan vs None
cpcloud Jan 12, 2024
1728d68
refactor(sqlglot): use a more backend-agnostic expression for non-fin…
cpcloud Jan 13, 2024
5a372cf
refactor(sqlglot): clean up `explode` usage
cpcloud Jan 13, 2024
d8775f5
refactor(pyspark): reimplement the backend using the new relational o…
kszucs Jan 8, 2024
6191ef7
feat(pyspark): add support for PySpark 3.5
kszucs Jan 15, 2024
0ebd680
refactor(pyspark): remove sqlalchemy dependency from pyspark
cpcloud Jan 16, 2024
a800cc4
chore(deps): bump pyspark to 3.5 in poetry lock file
cpcloud Jan 16, 2024
ffb2163
fix(ir): only dereference comparisons not generic binary operations
cpcloud Jan 15, 2024
cbba352
chore: rename to `dereference_comparison`
cpcloud Jan 16, 2024
8952a28
chore(deps): relock
cpcloud Jan 17, 2024
d921062
test(generic): clean up try_cast to null test
cpcloud Jan 17, 2024
48d2c67
fix(polars): user newer `drop` API to avoid deprecation warning
cpcloud Jan 17, 2024
8c75b63
fix(polars): user newer `drop` API in asof join implementation
cpcloud Jan 17, 2024
8775455
refactor(druid): port to sqlglot
cpcloud Jan 16, 2024
6389cbb
refactor(impala): port to sqlglot
cpcloud Jan 14, 2024
30f30ae
refactor(pandas): simplify pandas helpers
kszucs Jan 18, 2024
6f278bb
chore(impala): remove unused imports
cpcloud Jan 18, 2024
b27d878
refactor(bigquery): port to sqlglot
cpcloud Jan 9, 2024
faa9457
chore: add docstring for null ordering transform
cpcloud Jan 18, 2024
9e3a48e
chore(bigquery-datatypes): fix type annotations and raise uniform err…
cpcloud Jan 18, 2024
46fa864
ci(bigquery): install geospatial extra
cpcloud Jan 19, 2024
4f46709
test: remove unused `spread_type` function
cpcloud Jan 19, 2024
0314e23
test: account for new error type
cpcloud Jan 19, 2024
99b0b0f
test(bigquery): skip geospatial execution test when geopandas not ins…
cpcloud Jan 19, 2024
0170435
fix(snowflake): handle udf function naming
cpcloud Jan 19, 2024
6e8f6d2
refactor(exasol): port to sqlglot (#8032)
cpcloud Jan 19, 2024
07b8777
ci(exasol): run ci serially (#8042)
cpcloud Jan 19, 2024
11ef046
feat(sql): extract common table expressions
kszucs Jan 19, 2024
80b9423
chore(sql): regenerate snapshots for clickhouse, duckdb and postgres
kszucs Jan 19, 2024
405e8a6
chore(sql): regenerate snapshots for snowflake
kszucs Jan 19, 2024
2048d86
chore(sql): regenerate snapshots for bigquery
kszucs Jan 19, 2024
4312287
chore(sql): regenerate snapshots for pyspark
kszucs Jan 19, 2024
131e1ec
chore(sql): regenerate snapshots for trino
kszucs Jan 19, 2024
d179786
chore(impala): regen snapshots
cpcloud Jan 20, 2024
399fe00
fix(trino): compile property literal values directly instead of going…
cpcloud Jan 20, 2024
9d6fb5a
ci(impala): run tests in series
cpcloud Jan 20, 2024
28adc50
chore(exasol): avoid complex websocket callback for inserting memtables
cpcloud Jan 20, 2024
2e0cfcc
test(exasol): account for unordered results in window function tests
cpcloud Jan 20, 2024
c6d4469
test(duckdb): test that column name case is preserved when inserting
cpcloud Jan 20, 2024
3947559
refactor(oracle): port to sqlglot (#8020)
gforsyth Jan 22, 2024
554027b
chore(deps): remove sqlalchemy dependencies from oracle extra
cpcloud Jan 23, 2024
f95bccd
refactor(mssql): port to sqlglot
cpcloud Jan 6, 2024
6926204
fix(sql): don't generate table aliases for `ops.JoinLink`
kszucs Jan 22, 2024
6970c50
chore(impala): regen snapshots
cpcloud Jan 22, 2024
374511d
test(markers): add tests for custom markers
gforsyth Jan 23, 2024
2df76b0
fix(duckdb): allow passing both overwrite and temp to create_table
gforsyth Jan 24, 2024
dfc5394
refactor(polars): allow passing temp=False to polars create_table
gforsyth Jan 24, 2024
a1a9295
refactor(exasol): add temp kwarg to create_table for api consistency
gforsyth Jan 24, 2024
4e47948
test(backends): add test for overwrite and temp intersection in creat…
gforsyth Jan 24, 2024
c313657
fix(oracle): enable dropping temporary tables
gforsyth Jan 24, 2024
c065998
fix(oracle): clean up memtables at exit
gforsyth Jan 24, 2024
94533d5
fix(oracle): allow passing both overwrite and temp to create_table
gforsyth Jan 24, 2024
c96bcff
refactor(oracle): simplify oracle timestamp overrides
gforsyth Jan 23, 2024
951b05e
fix(api): forbid using `asc`/`desc` in selections
jcrist Jan 25, 2024
39885c8
fix(api): support passing literal booleans to `filter`
jcrist Jan 26, 2024
0aea6ac
test(api): add union aliasing test
cpcloud Jan 27, 2024
4133090
fix(polars): reference the correct field in the `ops.SelfReference` rule
cpcloud Jan 27, 2024
dccd5ba
test(polars): enable xpassing test
cpcloud Jan 27, 2024
a48d60f
test(duckdb): move tests to specific backend test suites
cpcloud Jan 29, 2024
1dd0ed2
test(duckdb): run test in subprocess to avoid setting the default bac…
cpcloud Jan 29, 2024
406c85a
refactor(sqlite): port to SQLGlot (#8154)
jcrist Jan 31, 2024
12267dc
refactor(sql): remove temporary table creation when using inline sql …
cpcloud Jan 31, 2024
8f63775
refactor(sql): reorganize sqlglot rewrites
kszucs Jan 28, 2024
350b3d5
chore(deps): relock
kszucs Feb 1, 2024
c252f14
chore(oracle): fix ops.ArrayColum reference to be ops.Array
kszucs Feb 1, 2024
ef82d8e
chore(polars): enable xpassing .sql test
kszucs Feb 1, 2024
7ad20bc
chore(sqlite): fix expected errors for array test cases
kszucs Feb 1, 2024
a2e34c9
chore(duckdb): generate snapshots for geospatial tests
kszucs Feb 1, 2024
b78c4b8
chore(pandas): xfail test_unnest_range()
kszucs Feb 1, 2024
abcf70f
chore(impala): rename ops.ArrayColumn to ops.Array
kszucs Feb 1, 2024
f015588
chore(mssql): rename ops.ArrayColumn to ops.Array
kszucs Feb 1, 2024
4c995a9
chore(pyspark): enable xpassing tests
kszucs Feb 1, 2024
c9f08af
chore(mssql): disable test cases for unsupported ops.Array, ops.HexDi…
kszucs Feb 1, 2024
b7a5936
chore(exasol): enable xpassing tests
kszucs Feb 1, 2024
eca685c
style(tests): reformat the pytest marker blocks
kszucs Feb 1, 2024
82fbd37
chore(impala): add early failure in the type system for complex datat…
cpcloud Feb 1, 2024
a6c2408
chore(impala): disable array position
cpcloud Feb 1, 2024
f599207
test: fix array, string and uuid tests
cpcloud Feb 1, 2024
4c59ecf
test: fix more array tests
cpcloud Feb 1, 2024
726c4ed
fix(common): don't match an `Object` pattern with more positional arg…
kszucs Jan 28, 2024
954c7d2
refactor(risingwave): port to sqlglot (#8171)
gforsyth Feb 1, 2024
80fb608
refactor(dask): port the dask backend to the new execution model (#8005)
kszucs Feb 1, 2024
dcd6c03
fix(polars): remove deprecated `pl.count()` and `with_time_unit`
kszucs Feb 2, 2024
72e044e
test(snowflake): enable xpassing `test_dot_sql::test_order_by_no_proj…
kszucs Feb 2, 2024
3e244f9
style: remove extra newline from docstrings
kszucs Feb 2, 2024
6684548
test(pandas): skip tests for older pandas
kszucs Feb 2, 2024
1a0ae67
test(dask): skip tests for older pandas
kszucs Feb 2, 2024
b042b5b
fix(mssql): don't use the removed `sge.TRUE` and `sge.FALSE` literals
kszucs Feb 2, 2024
80514ea
fix(pyspark): don't use the removed `sge.NULL`, `sge.TRUE` and `sge.F…
kszucs Feb 2, 2024
b3f83d7
fix(sqlite): don't use the removed `sge.NULL` literal
kszucs Feb 2, 2024
7a84dec
test(ir): remove outdated old-style pytest hookwrapper causing warnings
kszucs Feb 2, 2024
f47b89e
chore(deps): remove `sqlalchemy-views` and `sqlalchemy-risingwave`
kszucs Feb 2, 2024
ad1554d
test(backends): restore deleted `test_benchmarks.py`
kszucs Feb 2, 2024
0c5ec67
test(duckdb): account for other errors when running in the nix sandbox
cpcloud Feb 2, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
7 changes: 2 additions & 5 deletions .github/renovate.json
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,7 @@
"addLabels": ["bigquery"]
},
{
"matchPackagePatterns": ["duckdb", "duckdb-engine"],
"matchPackagePatterns": ["duckdb"],
"addLabels": ["duckdb"]
},
{
Expand Down Expand Up @@ -82,10 +82,7 @@
"addLabels": ["pyspark"]
},
{
"matchPackagePatterns": [
"snowflake-connector-python",
"snowflake-sqlalchemy"
],
"matchPackagePatterns": ["snowflake-connector-python"],
"addLabels": ["snowflake"]
},
{
Expand Down
1 change: 0 additions & 1 deletion .github/workflows/check-generated-files.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,6 @@ on:
- poetry.lock
- pyproject.toml
- requirements-dev.txt
merge_group:

concurrency:
group: ${{ github.repository }}-${{ github.head_ref || github.sha }}-${{ github.workflow }}
Expand Down
21 changes: 18 additions & 3 deletions .github/workflows/ibis-backends-cloud.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ on:
- ".envrc"
branches:
- main
- the-epic-split

permissions:
# this allows extractions/setup-just to list releases for `just` at a higher
Expand Down Expand Up @@ -42,10 +43,24 @@ jobs:
- "3.9"
- "3.11"
backend:
- name: bigquery
title: BigQuery
- name: snowflake
title: Snowflake
extras:
- snowflake
include:
- python-version: "3.9"
backend:
name: bigquery
title: BigQuery
extras:
- bigquery
- python-version: "3.11"
backend:
name: bigquery
title: BigQuery
extras:
- bigquery
- geospatial
steps:
- name: checkout
uses: actions/checkout@v4
Expand All @@ -61,7 +76,7 @@ jobs:
cache: poetry

- name: install ibis
run: poetry install --without dev --without docs --extras ${{ matrix.backend.name }}
run: poetry install --without dev --without docs --extras "${{ join(matrix.backend.extras, ' ') }}"

- uses: extractions/setup-just@v1
env:
Expand Down
2 changes: 2 additions & 0 deletions .github/workflows/ibis-backends-skip-helper.yml
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ on:
branches:
- main
- "*.x.x"
- the-epic-split
pull_request:
paths:
- "docs/**"
Expand All @@ -23,6 +24,7 @@ on:
branches:
- main
- "*.x.x"
- the-epic-split
merge_group:
jobs:
test_backends:
Expand Down
Loading
Loading