Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Try something #83

Closed
wants to merge 22 commits into from
Closed

Try something #83

wants to merge 22 commits into from

Conversation

abhishekagarwal87
Copy link
Owner

Fixes #XXXX.

Description

Fixed the bug ...

Renamed the class ...

Added a forbidden-apis entry ...

Release note

Key changed/added classes in this PR
  • MyFoo
  • OurBar
  • TheirBaz

This PR has:

  • been self-reviewed.
  • added documentation for new or modified features or behaviors.
  • a release note entry in the PR description.
  • added Javadocs for most classes and all non-trivial methods. Linked related entities via Javadoc links.
  • added or updated version, license, or notice information in licenses.yaml
  • added comments explaining the "why" and the intent of the code wherever would not be obvious for an unfamiliar reader.
  • added unit tests or modified existing tests to cover new code paths, ensuring the threshold for code coverage is met.
  • added integration tests.
  • been tested in a test Druid cluster.

georgew5656 and others added 22 commits February 20, 2024 11:13
@georgew5656
Fix pod template reading logic (apache#15915)
2c0d112 
* Fix pod template reading

* PR changes

* Fix unit tests
@LakshSingla
Numeric array support for columnar frames (apache#15917)
a1b2c73 
Columnar frames used in subquery materialization and window functions now support numeric arrays.
@gianm
Remove helm chart. (apache#15904)
e20004c 
The helm chart was originally moved here in apache#11163 from
https://github.com/helm/charts/tree/master/incubator/druid after the
helm/charts repository was deprecated. However, it has been excluded
from releases since then, due to uncertainty around whether we need
IP clearance. We have not had volunteers willing to sort this out,
so this patch removes the code.

It can be re-added if a volunteer is available to sort out the
IP clearance process.

See thread at: https://lists.apache.org/thread/ygyzt23m06vc775nq5dsm349rf0j47dg
@suneet-s
Update k8sTaskRunner log message (apache#15871)
cbc53d5
@asdf2014
Update the link of Helm Chart to avoid 404 error (apache#15905)
0f38a98
@kgyrtkirk
add check to build docker image (apache#15894)
170d37f
@kgyrtkirk
Support Union in decoupled mode (apache#15870)
bcce080
@georgew5656
Fix parsing of env variables when properties have underscores (apache…
59bb72a 
…#15919)

* Fix parsing of env variables when properties have underscores

* Add documentation

* Use a % sign instead
@jamiechapmanbrn
Feature: add support for ingesting from rabbitmq super streams (apach…
80942d5 
…e#14137)

* Add support for ingesting from Rabbit MQ Super Streams
@clintropolis
fix NestedCommonFormatColumnHandler to use nullable comparator when c…
cc5964f 
…astToType is set (apache#15921)

Fixes a bug when the undocumented castToType parameter is set on 'auto' column schema, which should have been using the 'nullable' comparator to allow null values to be present when merging columns, but wasn't which would lead to null pointer exceptions. Also fixes an issue I noticed while adding tests that if 'FLOAT' type was specified for the castToType parameter it would be an exception because that type is not expected to be present, since 'auto' uses the native expressions to determine the input types and expressions don't have direct support for floats, only doubles.

In the future I should probably split this functionality out of the 'auto' schema (maybe even have a simpler version of the auto indexer dedicated to handling non-nested data) but still have the same results of writing out the newer 'nested common format' columns used by 'auto', but I haven't taken that on in this PR.
@ektravel
Fix redirects for streaming ingestion (apache#15943)
f37d019
@zachjsh
Move INSERT & REPLACE validation to the Calcite validator (apache#15908)
8ebf237 
This PR contains a portion of the changes from the inactive draft PR for integrating the catalog with the Calcite planner apache#13686 from @paul-rogers, Refactoring the IngestHandler and subclasses to produce a validated SqlInsert instance node instead of the previous Insert source node. The SqlInsert node is then validated in the calcite validator. The validation that is implemented as part of this pr, is only that for the source node, and some of the validation that was previously done in the ingest handlers. As part of this change, the partitionedBy clause can be supplied by the table catalog metadata if it exists, and can be omitted from the ingest time query in this case.
@vogievetsky
make flattenSpec location adaptive (apache#15946)
c52ddd0
@dependabot @FrankChen021
Bump org.postgresql:postgresql from 42.6.0 to 42.7.2 (apache#15931)
936ba25 
* Bump org.postgresql:postgresql from 42.6.0 to 42.7.2

Bumps [org.postgresql:postgresql](https://github.com/pgjdbc/pgjdbc) from 42.6.0 to 42.7.2.
- [Release notes](https://github.com/pgjdbc/pgjdbc/releases)
- [Changelog](https://github.com/pgjdbc/pgjdbc/blob/master/CHANGELOG.md)
- [Commits](https://github.com/pgjdbc/pgjdbc/commits)

---
updated-dependencies:
- dependency-name: org.postgresql:postgresql
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update License

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: frank chen <[email protected]>
@dependabot @FrankChen021
Bump log4j.version from 2.18.0 to 2.22.1 (apache#15934)
3011829 
* Bump log4j.version from 2.18.0 to 2.22.1

Bumps `log4j.version` from 2.18.0 to 2.22.1.

Updates `org.apache.logging.log4j:log4j-api` from 2.18.0 to 2.22.1

Updates `org.apache.logging.log4j:log4j-core` from 2.18.0 to 2.22.1

Updates `org.apache.logging.log4j:log4j-slf4j-impl` from 2.18.0 to 2.22.1

Updates `org.apache.logging.log4j:log4j-1.2-api` from 2.18.0 to 2.22.1

Updates `org.apache.logging.log4j:log4j-jul` from 2.18.0 to 2.22.1

---
updated-dependencies:
- dependency-name: org.apache.logging.log4j:log4j-api
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.apache.logging.log4j:log4j-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.apache.logging.log4j:log4j-slf4j-impl
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.apache.logging.log4j:log4j-1.2-api
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.apache.logging.log4j:log4j-jul
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update License

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: frank chen <[email protected]>
@adithyachakilam
Enable partition stats on streaming task completion report (apache#15930
1f443d2 
)

Changes:
- Add visibility into number of records processed by each streaming task per partition
- Add field `recordsProcessed` to `IngestionStatsAndErrorsTaskReportData`
- Populate number of records processed per partition in `SeekableStreamIndexTaskRunner`
@gianm
Clarify where to set druid.monitoring.monitors. (apache#15729)
b69f89d
@clintropolis
fix bug with expression virtual column indexes on missing columns for…
6145c8d 
… expressions that turn null values into not null values (apache#15959)
@kgyrtkirk
ScanAndSort query fails with NPE for simple queries (apache#15914)
06deda9 
* some stuff

* add dummy fields

* draft-fix

* rename test

* cleanup

* add null

* cleanup

* cleanup

* add test

* updates

* move check tp constructore

* cleanup

* updates/etc

* fix some more

* add rowSignatureMode

* checkstyle/etc

* override

* missing msqIncompat

* fix test

* fixes

* undo

* updates

* remove param
@benhopp
Docs: Change single-dim to hashed in example for index task (apache#1…
ebb7190 
…5529)
@AmatyaAvadhanula
Try to fetch the task status for an active from memory (apache#15724)
e2b7289 
* Reduce metadata calls to fetch the status for an active task
@abhishekagarwal87
Reduce the size of docker image
6a3d74f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
Area - Batch Ingestion Area - Dependencies Area - Documentation Area - Ingestion Area - MSQ Area - Querying Area - Segment Format and Ser/De Area - Streaming Ingestion Area - Web Console Kubernetes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.