Code

Use concurrency for path scanning#405

Code

Merged

egibs merged 24 commits intochainguard-dev:mainchainguard-dev/malcontent:mainfrom egibs:performance-improvementsegibs/malcontent:performance-improvementsCopy head branch name to clipboardAug 16, 2024

+219-184

Commits

Commits on Aug 15, 2024

• Use file descriptors

  Show description for d8fb97b
  egibs

  committed
  d8fb97b

• Relocate file descriptor code; implement working concurrency for discovered paths

  Show description for 567f530
  egibs

  committed
  567f530

• Move to ordered map; relocate File rendering

  Show description for 83bdce2
  egibs

  committed
  83bdce2

• Limit concurrency to runtime.NumCPU()

  Show description for ad58188
  egibs

  committed
  ad58188

• Rename map variables

  Show description for 1d9e1a1
  egibs

  committed
  1d9e1a1

• Directly initialize diff maps

  Show description for 7d6a70c
  egibs

  committed
  7d6a70c

• Appease the linter

  Show description for e62d12f
  egibs

  committed
  e62d12f

• Configurable concurrency

  Show description for 57396b4
  egibs

  committed
  57396b4

• Update samples_test.go

  Show description for 6ebbf4c
  egibs

  committed
  6ebbf4c

• More consolidation

  Show description for 42d2cda
  egibs

  committed
  42d2cda

• Add exists check

  Show description for 9182f88
  egibs

  committed
  9182f88

• Use -j instead of -c for concurrency

  Show description for d18239d
  egibs

  committed
  d18239d

• Use an errgroup instead of a waitgroup + semaphore

  Show description for 26a57dc
  egibs

  committed
  26a57dc

Commits on Aug 16, 2024

• Use SetLimit; add concurrency config to all tests; linting fixes

  Show description for bf0fb13
  egibs

  committed
  bf0fb13

• Move sorting code into scan.go; move rendering inside of map construction loop

  Show description for 8b05ed4
  egibs

  committed
  8b05ed4

• Use 8-core runner for tests

  Show description for 28d23e4
  egibs

  committed
  28d23e4

• Go back to ubuntu-latest

  Show description for 580052b
  egibs

  committed
  580052b

• Run core tests in parallel

  Show description for 8b97499
  egibs

  committed
  8b97499

• Better alias naming, consolidate structs

  Show description for c42f418
  egibs

  committed
  c42f418

• Merge branch 'main' into performance-improvements

  Show description for a84cc1a
  egibs

  authored
  a84cc1a

• Run make fix

  Show description for c7bdc4f
  egibs

  committed
  c7bdc4f

• Replace mutexes with sync.Map

  Show description for 81fca83
  egibs

  committed
  81fca83

• Remove struct/type

  Show description for c03d232
  egibs

  committed
  c03d232

• Appease the linter

  Show description for c4888b3
  egibs

  committed
  c4888b3