Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

backend runs on 5001 #495

Merged
merged 6 commits into from
Apr 16, 2024
Merged

backend runs on 5001 #495

merged 6 commits into from
Apr 16, 2024

Conversation

northdpole
Copy link
Collaborator

No description provided.

@northdpole northdpole merged commit e5929f5 into main Apr 16, 2024
7 checks passed
@northdpole northdpole deleted the make-port-5001 branch April 16, 2024 19:59
northdpole added a commit that referenced this pull request Apr 16, 2024
northdpole added a commit that referenced this pull request Apr 16, 2024
northdpole added a commit that referenced this pull request May 31, 2024
* backend runs on 5002

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

---------

Signed-off-by: Spyros <[email protected]>
northdpole added a commit that referenced this pull request May 31, 2024
northdpole added a commit that referenced this pull request Jun 9, 2024
* backend runs on 5002

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

---------

Signed-off-by: Spyros <[email protected]>
northdpole added a commit that referenced this pull request Jun 9, 2024
northdpole added a commit that referenced this pull request Jun 9, 2024
* backend runs on 5002

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

---------

Signed-off-by: Spyros <[email protected]>
northdpole added a commit that referenced this pull request Jun 9, 2024
northdpole added a commit that referenced this pull request Jun 9, 2024
* backend runs on 5002

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

---------

Signed-off-by: Spyros <[email protected]>
northdpole added a commit that referenced this pull request Jun 9, 2024
northdpole added a commit that referenced this pull request Jun 27, 2024
* backend runs on 5002

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

---------

Signed-off-by: Spyros <[email protected]>
northdpole added a commit that referenced this pull request Jun 27, 2024
northdpole added a commit that referenced this pull request Jul 6, 2024
* logging improvement

* add design doc

* spreadsheet parser refactored

* parallelize main

* parallelise importing of standards from a spreadsheet and generation of related data

* add progress bars

* return list of imported resources

* initial base parser implementation

* move parsers to own dir and migrate cwe, dsomm and iso27k to the new parser interface

* migrate parsers

* make main call parser

* add embeddings in the document object allow prasers to generate and fill embeddings of each document, decouple parsers from main methods to avoid circular imports, mode embeddings database storage to register_node

* add default value for embeddings object in dataclass

* sort out imports

* cwe parser test

* dsomm parser tests

* secure headers + tests

* cloud native security controls parser +tests

* ccmv4

* rename method

* juiceshop + tests

* mega lint

* rm commented code

* fix docs equality test

* change external project parsers to return dict of 'resourcename':<resource entries>

* fix web main test related to CSV returning inconsistency

* fix nit on gap analysis enqueue job

* operational changes to make mass importing easier

* fix spreadsheet importing bugs, add validation to dataclasses

* makefile improvements

* add validation and fix tests

* drop support for OSIB

* fix more tests

* pin black to same version as superlinter and lint everything

* change array hash to array key so that its legible, introduce ids for nodes which is a combination of their values, partially fix gap analysis

* add tests for bug where standards would only link to one cre

* change neo4j standards for regular postgres standards

* adjust main to not require redis when getting standards

* cache key to str

* add ability to import only the projects

* delete all traces of node and gap analysis of node, used when reimporting standards after either structural or informational changes

* nit: rearrange argument handling on main

* fix previously introduced cre hierarchy bug

* move commands for regenerating DB to a new 'import-all' script

* fix embedding gen

* disable iso, set port to 5001

* add 'automatically linked to' linktype and use it for low confidence mappings

* fix scripts, make import-projects use scripts

* rm cres, too large to keep around

* add migration

* since we removed cres dir, also remove export functionality

* fix importing script

* add new link status to db

* add import-only for external parsers and remove export and review functionality

* fix cwe typo

* generate embeddings for guaranteed non-none name

* add message on waiting jobs

* improve gap analysis logging

* add ability to skip reimporting if something already exists

* logging nit

* make the base parser not load the in-memory graph by default and fix the
linking of DSOMM link type to 'AutomaticlalyLinkedTo'

* make loading the graph in memory optional

make cre importing ONLY have an in memory graph to find cycles

* improve logging for gap analysis jobs

* fix endless loop when importing and gap analysis exists

* add gap analysis relationship 'automaticallyt linked to' and throw exception when cycle detection gets called with no in memory graph

* paginate graph retrieval init (#491)

* paginate graph retrieval init

* progress

* paginate explorer success

* backend tests

* Macos support (#496)

* fixes to make install run on macs

* activate venv and run on the same line

* update trest workflow

* update trest workflow

* backend runs on 5001 (#495)

* backend runs on 5002

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

* switch port to 5k2 as most docker registries and apple airplay run on 5k

---------

Signed-off-by: Spyros <[email protected]>

* Revert "backend runs on 5001 (#495)" (#498)

This reverts commit e5929f5.

* rm version from cwe and make ccm and iso disabled parsers commented out so it does not affect coverage

* add dev environment variables that do only graph importing to be used for debugging

* import external projects individually

* print less when calculating ga

* [ticket-508] Ensure autolinks appear on the CRE page (#509)

ensure autolinks show on the CRE page

* fix broken rebase

* add ability to run cre as a container and sync local cre with upstream

* cleanup unused spreadsheet parser methods

* fix e2e tests

* pin black to same version as superlinter

* pin node version in github e2e

* upgrade actions node

* ga query test

* add ability to external project parsers to skip gap analysis and embedding calculation

* nit: logging

* fix gap analysis bug where we wouldn't remove calculated ga from waiting list

* move ga preloading into script

* fix error where standards would get preloaded twice

* add explorer to header in staging

* in pyyaml, try to fix incompatibility with cython

* init fix e2e tests

---------

Signed-off-by: Spyros <[email protected]>
Co-authored-by: Diana <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant