Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

perf: update df.corr, df.cov to be used with more than 30 columns case. #1161

Merged
merged 17 commits into from
Dec 9, 2024

Conversation

Genesis929
Copy link
Collaborator

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

  • Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
  • Ensure the tests and linter pass
  • Code coverage does not decrease (if any source code was changed)
  • Appropriate docs were updated (if necessary)

Fixes #<issue_number_goes_here> 🦕

@product-auto-label product-auto-label bot added size: l Pull request size is large. api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. labels Nov 20, 2024
@Genesis929 Genesis929 added kokoro:force-run Add this label to force Kokoro to re-run the tests. owlbot:run Add this label to trigger the Owlbot post processor. labels Nov 20, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Nov 20, 2024
@bigframes-bot bigframes-bot removed the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Nov 20, 2024
@Genesis929 Genesis929 added the owlbot:run Add this label to trigger the Owlbot post processor. label Nov 22, 2024
@gcf-owl-bot gcf-owl-bot bot removed the owlbot:run Add this label to trigger the Owlbot post processor. label Nov 22, 2024
@Genesis929 Genesis929 marked this pull request as ready for review November 22, 2024 22:47
@Genesis929 Genesis929 requested review from a team as code owners November 22, 2024 22:47
@Genesis929 Genesis929 requested a review from tswast November 22, 2024 22:47
@Genesis929 Genesis929 requested review from sycai and removed request for chelsea-lin December 2, 2024 22:36
sort=False,
)

frame = DataFrame(block)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: collapse this line with the line below?

map_data,
session=self._get_block().expr.session,
).set_index("_bigframes_keys")
result = result.join(map_df)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: collapse with the line below?

@Genesis929 Genesis929 merged commit 9dcf1aa into main Dec 9, 2024
21 of 23 checks passed
@Genesis929 Genesis929 deleted the corr_update_huanc branch December 9, 2024 18:36
sycai pushed a commit that referenced this pull request Dec 9, 2024
…e. (#1161)

* perf: update df.corr, df.cov to be used with more than 30 columns case.

* add large test

* remove print

* fix_index

* fix index

* test fix

* fix test

* fix test

* slightly improve multi_apply_unary_op to avoid RecursionError

* update recursion limit for nox session

* skip the test in e2e/python 3.12

* simplify code

* simplify code
sycai added a commit that referenced this pull request Dec 10, 2024
…#1189)

* feat: Add support for temporal types in dataframe's describe() method

* add type hint to make mypy happy

* directly use output_type to check agg op support for input type

* format code

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* perf: update df.corr, df.cov to be used with more than 30 columns case. (#1161)

* perf: update df.corr, df.cov to be used with more than 30 columns case.

* add large test

* remove print

* fix_index

* fix index

* test fix

* fix test

* fix test

* lint code

* fix import path
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. size: l Pull request size is large.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants