Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

V3.38.0 proposal #3709

Merged
merged 34 commits into from
Oct 17, 2023
Merged

V3.38.0 proposal #3709

merged 34 commits into from
Oct 17, 2023

Conversation

szegedi
Copy link
Contributor

@szegedi szegedi commented Oct 12, 2023

Bug Fixes

Improvements

Features

Will be omitted from release notes:

Stephen Belanger and others added 30 commits October 12, 2023 14:22
This allows wall profiles to be visualized in timelines.
… request payloads [APPSEC-9476] (#3635)

* Register and send extra services found in spans
- only sends `memcached.command` when `DD_TRACE_MEMCACHED_COMMAND_ENABLED=true` is set
- existing behavior is incorrect
  - `memcached.query` is supposed to be the full query (command + args)
  - `memcached.command` is only supposed to be the command
  - allowing the existing incorrect behavior to continue working if the flag is set
- disable by default in case someone stores sensitive data in their memcached key
…erimental ones (#3659)

* Deprecate EXPERIMENTAL_ env vars for code hostpots; introduce non-experimental variants
* make sure code hotspots being enabled is consistent with endpoint profiling being enabled
* Instrumentate nextjs and call to waf

* Feature implementation, pending to fix the tests

* Add appsec nextjs pipeline

* execute less tests

* Execute tests again

* try other approach to instrumentate next app request

* Fix lints

* Extract body and query in diagnostics channel publish not in subscribe

* Fix tests

* Fix query monitoring nextjs

* small fixes

* Remove unnecessary files

* Restore next test

* fixes

* Fix from PR comments

* Small changes from PR comments

* Replace some exec by fs functions
* Fix SQLi location when using knex

* Remove onProgress wrapping from knex then

* Rename asyncResource

* Add spacing in code to improve readability

* Avoid using shimmer to wrap then from knex raw result

* Detect dialect for SQLi with knex

* Instrument knex catch and asCallback
* Prevent sending query address twice to the waf

* Small changes + test

* Fix invalid query type test and behaviour

* Comment in the PR
* Enable appsec telemetry before waf init

* test reportWafInit is called when enabling appsec
@szegedi szegedi requested a review from a team as a code owner October 12, 2023 13:06
@github-actions
Copy link

github-actions bot commented Oct 12, 2023

Overall package size

Self size: 5.38 MB
Deduped: 58.44 MB
No deduping: 58.61 MB

Dependency sizes

name version self size total size
@datadog/native-iast-taint-tracking 1.6.1 14.96 MB 14.97 MB
@datadog/native-appsec 4.0.0 14.83 MB 14.83 MB
@datadog/pprof 4.0.0 8.25 MB 9.1 MB
protobufjs 7.2.4 2.74 MB 6.52 MB
@datadog/native-iast-rewriter 2.1.3 2.23 MB 2.32 MB
@opentelemetry/core 1.14.0 872.87 kB 1.47 MB
@datadog/native-metrics 2.0.0 898.77 kB 1.3 MB
@opentelemetry/api 1.4.1 780.32 kB 780.32 kB
import-in-the-middle 1.4.2 41.4 kB 704.79 kB
msgpack-lite 0.1.26 201.16 kB 281.59 kB
opentracing 0.14.7 194.81 kB 194.81 kB
semver 7.5.4 93.4 kB 123.8 kB
@datadog/sketches-js 2.1.0 109.9 kB 109.9 kB
lodash.sortby 4.7.0 75.76 kB 75.76 kB
lru-cache 7.14.0 74.95 kB 74.95 kB
ipaddr.js 2.1.0 60.23 kB 60.23 kB
ignore 5.2.4 51.22 kB 51.22 kB
int64-buffer 0.1.10 49.18 kB 49.18 kB
istanbul-lib-coverage 3.2.0 29.34 kB 29.34 kB
lodash.uniq 4.5.0 25.01 kB 25.01 kB
limiter 1.1.5 23.17 kB 23.17 kB
retry 0.13.1 18.85 kB 18.85 kB
lodash.kebabcase 4.1.1 17.75 kB 17.75 kB
node-abort-controller 3.1.1 16.89 kB 16.89 kB
lodash.pick 4.4.0 16.33 kB 16.33 kB
jest-docblock 29.7.0 8.99 kB 12.76 kB
crypto-randomuuid 1.0.0 11.18 kB 11.18 kB
diagnostics_channel 1.1.0 7.07 kB 7.07 kB
path-to-regexp 0.1.7 6.78 kB 6.78 kB
koalas 1.0.2 6.47 kB 6.47 kB
methods 1.1.2 5.29 kB 5.29 kB
module-details-from-path 1.0.3 4.47 kB 4.47 kB

🤖 This report was automatically generated by heaviest-objects-in-the-universe

@codecov
Copy link

codecov bot commented Oct 12, 2023

Codecov Report

❗ No coverage uploaded for pull request base (v3.x@337ace8). Click here to learn what that means.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             v3.x    #3709   +/-   ##
=======================================
  Coverage        ?   85.07%           
=======================================
  Files           ?      225           
  Lines           ?     9238           
  Branches        ?       33           
=======================================
  Hits            ?     7859           
  Misses          ?     1379           
  Partials        ?        0           

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@juan-fernandez
Copy link
Collaborator

if you include 6546c53 the CI Vis tests should start passing

@juan-fernandez
Copy link
Collaborator

juan-fernandez commented Oct 13, 2023

additionally, could we include the following items in the release notes:

ci-visibility: Unskippable tests by ITR: #3684, #3681, #3661 and #3649
ci-visibility: Add support for AWS Codepipeline #3692

Edit: added it myself

@pr-commenter
Copy link

pr-commenter bot commented Oct 13, 2023

Benchmarks

Benchmark execution time: 2023-10-16 11:10:06

Comparing candidate commit b7bc2eb in PR branch v3.38.0-proposal with baseline commit 337ace8 in branch v3.x.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 575 metrics, 12 unstable metrics.

scenario:appsec-iast-no-vulnerability-control-14

  • 🟥 execution_time [+29.734ms; +46.710ms] or [+5.377%; +8.447%]

CarlesDD and others added 2 commits October 16, 2023 12:58
* Fix supported MongoDB versions in NoSQL injection test

* Simplify version range for mongodb
Copy link
Collaborator

@juan-fernandez juan-fernandez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good from ci visibility's perspective

@szegedi szegedi merged commit 9308f5d into v3.x Oct 17, 2023
117 of 119 checks passed
@szegedi szegedi deleted the v3.38.0-proposal branch December 19, 2023 09:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants