Revert "backend runs on 5001 (#495)" #498
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This reverts commit e5929f5.
northdpole
added a commit
that referenced
this pull request
May 31, 2024
northdpole
added a commit
that referenced
this pull request
Jun 9, 2024
northdpole
added a commit
that referenced
this pull request
Jun 9, 2024
northdpole
added a commit
that referenced
this pull request
Jun 9, 2024
northdpole
added a commit
that referenced
this pull request
Jun 27, 2024
northdpole
added a commit
that referenced
this pull request
Jul 6, 2024
* logging improvement * add design doc * spreadsheet parser refactored * parallelize main * parallelise importing of standards from a spreadsheet and generation of related data * add progress bars * return list of imported resources * initial base parser implementation * move parsers to own dir and migrate cwe, dsomm and iso27k to the new parser interface * migrate parsers * make main call parser * add embeddings in the document object allow prasers to generate and fill embeddings of each document, decouple parsers from main methods to avoid circular imports, mode embeddings database storage to register_node * add default value for embeddings object in dataclass * sort out imports * cwe parser test * dsomm parser tests * secure headers + tests * cloud native security controls parser +tests * ccmv4 * rename method * juiceshop + tests * mega lint * rm commented code * fix docs equality test * change external project parsers to return dict of 'resourcename':<resource entries> * fix web main test related to CSV returning inconsistency * fix nit on gap analysis enqueue job * operational changes to make mass importing easier * fix spreadsheet importing bugs, add validation to dataclasses * makefile improvements * add validation and fix tests * drop support for OSIB * fix more tests * pin black to same version as superlinter and lint everything * change array hash to array key so that its legible, introduce ids for nodes which is a combination of their values, partially fix gap analysis * add tests for bug where standards would only link to one cre * change neo4j standards for regular postgres standards * adjust main to not require redis when getting standards * cache key to str * add ability to import only the projects * delete all traces of node and gap analysis of node, used when reimporting standards after either structural or informational changes * nit: rearrange argument handling on main * fix previously introduced cre hierarchy bug * move commands for regenerating DB to a new 'import-all' script * fix embedding gen * disable iso, set port to 5001 * add 'automatically linked to' linktype and use it for low confidence mappings * fix scripts, make import-projects use scripts * rm cres, too large to keep around * add migration * since we removed cres dir, also remove export functionality * fix importing script * add new link status to db * add import-only for external parsers and remove export and review functionality * fix cwe typo * generate embeddings for guaranteed non-none name * add message on waiting jobs * improve gap analysis logging * add ability to skip reimporting if something already exists * logging nit * make the base parser not load the in-memory graph by default and fix the linking of DSOMM link type to 'AutomaticlalyLinkedTo' * make loading the graph in memory optional make cre importing ONLY have an in memory graph to find cycles * improve logging for gap analysis jobs * fix endless loop when importing and gap analysis exists * add gap analysis relationship 'automaticallyt linked to' and throw exception when cycle detection gets called with no in memory graph * paginate graph retrieval init (#491) * paginate graph retrieval init * progress * paginate explorer success * backend tests * Macos support (#496) * fixes to make install run on macs * activate venv and run on the same line * update trest workflow * update trest workflow * backend runs on 5001 (#495) * backend runs on 5002 * switch port to 5k2 as most docker registries and apple airplay run on 5k * switch port to 5k2 as most docker registries and apple airplay run on 5k * switch port to 5k2 as most docker registries and apple airplay run on 5k * switch port to 5k2 as most docker registries and apple airplay run on 5k --------- Signed-off-by: Spyros <[email protected]> * Revert "backend runs on 5001 (#495)" (#498) This reverts commit e5929f5. * rm version from cwe and make ccm and iso disabled parsers commented out so it does not affect coverage * add dev environment variables that do only graph importing to be used for debugging * import external projects individually * print less when calculating ga * [ticket-508] Ensure autolinks appear on the CRE page (#509) ensure autolinks show on the CRE page * fix broken rebase * add ability to run cre as a container and sync local cre with upstream * cleanup unused spreadsheet parser methods * fix e2e tests * pin black to same version as superlinter * pin node version in github e2e * upgrade actions node * ga query test * add ability to external project parsers to skip gap analysis and embedding calculation * nit: logging * fix gap analysis bug where we wouldn't remove calculated ga from waiting list * move ga preloading into script * fix error where standards would get preloaded twice * add explorer to header in staging * in pyyaml, try to fix incompatibility with cython * init fix e2e tests --------- Signed-off-by: Spyros <[email protected]> Co-authored-by: Diana <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This reverts commit e5929f5.