Release/2.2.0 (#4008)

* Added github actions for gitflow

* Minor changes

* Fix plot look when using eval and add query to choices (#3881) (#3898)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

Co-authored-by: montezdesousa <[email protected]>

* Testing Gitflow (#3899)

* testing gitflow

* Name changes

* Testing python changes

* Added Checkout to Base test

* Feature/gitflow (#3900)

* Fix plot look when using eval and add query to choices (#3881) (#3901)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

Co-authored-by: montezdesousa <[email protected]>

* Gitflow Implementations (#3902)

* testing gitflow

* Name changes

* Testing python changes

* Added Checkout to Base test

* More minor fixes for merge

* Minor fix

* Added nightly build

* Gitflow Implementations (#3904)

* testing gitflow

* Name changes

* Testing python changes

* Added Checkout to Base test

* More minor fixes for merge

* Minor fix

* Added nightly build

* Testing Merge

* Main --> develop (#3906)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>

* GItflow Implementations (#3909)

* testing gitflow

* Name changes

* Testing python changes

* Added Checkout to Base test

* More minor fixes for merge

* Minor fix

* Added nightly build

* Testing Merge

* Merge error fix

* Feature/gitflow (#3911)

* testing gitflow

* Name changes

* Testing python changes

* Added Checkout to Base test

* More minor fixes for merge

* Minor fix

* Added nightly build

* Testing Merge

* Merge error fix

* Merge fix

* merge fix

* Merge fix

* Merge fix

* Merge fix

* merge fix

* Update develop (#3913)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>

* Feature/gitflow (#3914)

* testing gitflow

* Name changes

* Testing python changes

* Added Checkout to Base test

* More minor fixes for merge

* Minor fix

* Added nightly build

* Testing Merge

* Merge error fix

* Merge fix

* merge fix

* Merge fix

* Merge fix

* Merge fix

* merge fix

* [Gitflow] - Minor fix

* Feature/gitflow (#3921)

* testing gitflow

* Name changes

* Testing python changes

* Added Checkout to Base test

* More minor fixes for merge

* Minor fix

* Added nightly build

* Testing Merge

* Merge error fix

* Merge fix

* merge fix

* Merge fix

* Merge fix

* Merge fix

* merge fix

* [Gitflow] - Minor fix

* Feature/gitflow (#3914) (#3915)

* testing gitflow

* Name changes

* Testing python changes

* Added Checkout to Base test

* More minor fixes for merge

* Minor fix

* Added nightly build

* Testing Merge

* Merge error fix

* Merge fix

* merge fix

* Merge fix

* Merge fix

* Merge fix

* merge fix

* [Gitflow] - Minor fix

* Nightly build feature

* Added branch name docs

* poetry add ccxt@latest (#3920)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

* poetry add ccxt@latest

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>

* Add crypto dd functions to sdk (#3888)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Add crypto dd functions to sdk

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

* Fixes currency and trailmap

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>

* Integration tests refactor (#3781)

* generate integration tests report

* new console report

* simple run_scripts

* move tests script to folder

* add skipping

* always display skips

* func name

* allow running from relative path

* rename some vars and time

* typo

* change portfolio supress and warning

* uncomment economy test

* rename test controller

* multiprocessing

* display test progress and available

* rename func

* mypy

* should not be here

* small changes

* type hinting and docstrings

* new subprocesses default

* forget context and chunksize

* clean len skipt

* small comment

* fix subproc default with v

* minor change

* fix path

* better this way

* make output visible

* allow only sequential run with verbose mode

* change message

* detail

* include andrew idea

* limit multiprocessing to clone version

* fix for package application

* must be up here

* allow verbose with multiprocessing but warn

* update readme

* move tests to core

* Update README.md

* Update README.md

* move readme outside

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* parse subproc arg

* Update README.md

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

* Delete glossary base command

* move scripts

* ruff

* update pyproject.toml

* update yfinance

* fix futures and economy test, rewrite

* rewrite stocks test yfinance dependent

* refactor sia to yfinance 0.2...

* fix last failing sia tests

* black

* update reqs

Co-authored-by: James Maslek <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>
Co-authored-by: Chavithra PARANA <[email protected]>

* Gitflow - Autodoc (#3922)

* Hotfix/dots sources (#3928)

* fix: wordwrap

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

* fix: str

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>

* Update dependency: grpcio (#3937)

* Update grpcio

* Revert "Update grpcio"

This reverts commit 676c50a.

* Update dependencies

* Rebase develop? (#3935)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>

* Update installation guides with videos (#3903)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Update installation guides with videos

* Add fix for Ruff crashing

* Me no longer do what James said

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Jeroen Bouma <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>
Co-authored-by: James Maslek <[email protected]>

* broken link  (#3889)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* broken link

due to quandl.com redirecting to nasdaq.com, for the link to work and get the appropiate API key you need to remove the period at the end of this link...

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: james <[email protected]>

* Issue #3882 Fixed (#3885)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Issue #3882 Fixed

* 2 files reformatted by black

* tests added

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

* fixed mypy errors

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>
Co-authored-by: James Maslek <[email protected]>

* GitFlow - improve check for changes (#3948)

Gitflow Implementation

* Rewrite and skip yfinance tests (#3953)

* economy

* fix futures

* fix stocks tests

* skip unfixable tests

* fix ark

* Fixed failing badge not used anymore (#3932)

Co-authored-by: James Maslek <[email protected]>

* Fix portfolio returns (#3931)

* fix inception bug and clean some useless attributes

* reorder attributes

* add returns and cumulative returns

* fix cumulative returns

* fix cumulative returns

* remove cumulative ret

* add some doc and encapsule methods

* order detail

* add more details on docstrings

* wrong docstring

* add commnet

* Update portfolio_engine.py

* fix bug with unsupported type

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

* fix table header

* fix portfolio integration test

* ruff

* fix tests

* rewrite yfinance call

* fix test_draw

* test_stocks_helper

* bt model

* fix comp analysis

* fix ftd

* fix dd

* fix screener

Co-authored-by: James Maslek <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>
Co-authored-by: hjoaquim <[email protected]>

* Put yf.info behind an exchange flag on `load` (#3951)

* Put yf.info behind an exchange flag

* Guides

Co-authored-by: montezdesousa <[email protected]>

* Last Price Bug into Previous Close #3865 (#3949)

Co-authored-by: James Maslek <[email protected]>

* Add multiple countries option to events (#3938)

* allow multiple countries in events cmd

* fix test

* fix last test

* black

Co-authored-by: James Maslek <[email protected]>

* Minor Fix for branch name check (#3979)

* Gitflow -  Added manual trigger to Linting (#3981)

* Minor Fix for branch name check

* added manual trigger to linting

* Linting fix (#3984)

Linting fix

* Feature/macro convert (#3924)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Issue #3882 Fixed

* 2 files reformatted by black

* tests added

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

* fixed mypy errors

* Fixed parser options for currency conversion

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>
Co-authored-by: James Maslek <[email protected]>

* Update sma.md (#3956)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

* Update sma.md

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>
Co-authored-by: James Maslek <[email protected]>

* Update overlap_model.py (#3955)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

* Update overlap_model.py

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>
Co-authored-by: James Maslek <[email protected]>

* Update vwap.md (#3971)

Co-authored-by: James Maslek <[email protected]>

* Update overlap_model.py - wrong typehint  (#3970)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

* Update overlap_model.py

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>
Co-authored-by: James Maslek <[email protected]>

* Bump yfinance to 0.2.4 and fix tests (#3977)

* upgrade yfinance to 0.2.4

* fix some tests failing bc yfinance new date format

* fix remaining tests

* fix tests

* rewrite failing test

* black

* rerecord test

* fix get_1y_sp500 test

* missing import here

Co-authored-by: Henrique Joaquim <[email protected]>
Co-authored-by: James Maslek <[email protected]>

* Add extra error handling for yf in etf (#3985)

* Fix the news command and making it more stable (#3965)

Co-authored-by: James Maslek <[email protected]>

* Hotfix/bug #3945 (#3963)

* Add exception to http requests made by ftd

* Formatting

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: James Maslek <[email protected]>

* Fix #3787 (#3966)

Make the get_equal_weights handle portfolio's with stock's filtered out, due to the stocks having to many NaNs.

Co-authored-by: James Maslek <[email protected]>

* Add ticker to the load export file (#3997)

* bump

* Change export name to have the ticker

* revert yaml

* Feature/release branch gitflow (#3998)

* release branch gitflow implentation

* Fix integration tests bugs (#3993)

* fix tk

* fix newsletters

* fix lt

* exception on pir

* fix attrib bug and remove warning

* fix earnings

* fix ins, lt, whatif

* fillna

* fix vis

Co-authored-by: James Maslek <[email protected]>

* change .env loading priority (#4005)

* [FIX] Pytorch-lightning trainer conflict with TQDM progress bar (#4002)

* fix for tqdm progress bar conflict

* fix tests

Co-authored-by: James Maslek <[email protected]>

* bump

* Update release branch

* revert conda yaml

* logging hash

* Fix historical futures plot axes (#4006)

* change start date to model

* rewrite test

* ruff

* add end date

* move futures and update test

* return if wrong dates

* fix controller test

* record mode rewrite model and view

Co-authored-by: James Maslek <[email protected]>

* Update version number

* Added scipy to intel

* Fix M1 build (#4010)

* Fix plot look when using eval and add query to choices (#3881)

* convert index to datetime and update choices

* uncomment economy integration test

* fix treasury concat bug

* fix datasets concat on duplciates

* Lock ruff version so that new lints dont break our CI (#3905)

* Lock ruff version so that new lints dont break our CI

* Bumped pre-commit ruff version

* adding xgboost explicitly

* testing juan sugestion

* removing unncessary stuff that the hook deals with

Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>

* Add xgboost to intel

* add scipy libs to windows only

* add scipy sparse

* update scipy and pywin

* update tests

* UPdate installation.md to reflect 2.2

* fix yf unit tests

* Try to get futures tests working

* Ignore tz in yf download

* Found another end date needed

* delelte yf cache

Co-authored-by: [email protected] <[email protected]>
Co-authored-by: montezdesousa <[email protected]>
Co-authored-by: Colin Delahunty <[email protected]>
Co-authored-by: Chavithra PARANA <[email protected]>
Co-authored-by: jose-donato <[email protected]>
Co-authored-by: Jeroen Bouma <[email protected]>
Co-authored-by: Jeroen Bouma <[email protected]>
Co-authored-by: Rob-Rychs <[email protected]>
Co-authored-by: Mert Nuhuz <[email protected]>
Co-authored-by: hjoaquim <[email protected]>
Co-authored-by: Bongani Bendile <[email protected]>
Co-authored-by: Sergio A. S <[email protected]>
Co-authored-by: northern-64bit <[email protected]>
Co-authored-by: martinb-bb <[email protected]>

.github/workflows/branch-name-check.yml

@@ -0,0 +1,53 @@
+name: Branch Name Check
+
+on:
+  pull_request:
+    branches:
+      - develop
+      - main
+    types: [opened, synchronize, edited]
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  check-branch-name:
+    runs-on: ubuntu-latest
+    outputs:
+      source-branch: ${{ steps.branch-name-check.outputs.source-branch }}
+      target-branch: ${{ steps.branch-name-check.outputs.target-branch }}
+    steps:
+    - name: Extract branch names
+      id: branch-name-check
+      run: |
+        source_branch=$(jq -r .pull_request.head.ref "$GITHUB_EVENT_PATH")
+        target_branch=$(jq -r .pull_request.base.ref "$GITHUB_EVENT_PATH")
+
+        echo "Source-branch=$source_branch" >> $GITHUB_OUTPUT
+        echo "target-branch=$target_branch" >> $GITHUB_OUTPUT
+    
+    - name: Show Output result for source-branch and target-branch
+      run: |
+        echo "source-branch=${{ steps.branch-name-check.outputs.source-branch }}"
+        echo "target-branch=${{ steps.branch-name-check.outputs.target-branch }}"
+    
+    - name: Check branch name for develop PRs
+      if: ${{ steps.branch-name-check.outputs.target-branch == 'develop' }}
+      run: |
+        if [[ "${{ steps.branch-name-check.outputs.source-branch }}" =~ ^(main|feature/.*|hotfix/.*|release/[0-9]+\.[0-9]+\.[0-9]+(rc[0-9]+)?)$ ]]; then
+          echo "Branch name is valid"
+        else
+          echo "Invalid branch name. Branches must follow the GitFlow naming convention to be allowed to merge into the develop branch."
+          exit 1
+        fi
+
+    - name: Check branch name for main PRs
+      if: ${{ steps.branch-name-check.outputs.target-branch == 'main' }}
+      run: |
+        if [[ "${{ steps.branch-name-check.outputs.source-branch }}" =~ ^(hotfix/.*|release/[0-9]+\.[0-9]+\.[0-9]+(rc[0-9]+)?)$ ]]; then
+          echo "PR is from a hotfix or release branch and targets the main branch"
+        else
+          echo "PR is not from a hotfix or release branch. Pull requests must be from a hotfix or release branch and target the main branch"
+          exit 1
+        fi

.github/workflows/gh-pages.yml

@@ -1,13 +1,16 @@
 name: Deploy to GitHub Pages
 
 on:
-  push:
+  pull_request:
     branches:
       - main
+    types: [closed]
+
 
 jobs:
   generate:
     name: Generate and Deploy documentation
+    if: github.event.pull_request.merged == true
     runs-on: ubuntu-latest
     steps:
       - name: Git checkout

.github/workflows/intel_macos_build.yml

@@ -104,6 +104,8 @@ jobs:
           /usr/bin/codesign --deep --force --verify --verbose --options runtime --entitlements "build/pyinstaller/entitlements.plist" -s $MACOS_CODESIGN_IDENTITY DMG/OpenBB\ Terminal/.OpenBB/prophet/stan_model/cmdstan-2.26.1/stan/lib/stan_math/lib/tbb/*.dylib
           /usr/bin/codesign --deep --force --verify --verbose --options runtime --entitlements "build/pyinstaller/entitlements.plist" -s $MACOS_CODESIGN_IDENTITY DMG/OpenBB\ Terminal/.OpenBB/torch/.dylibs/*.dylib
           /usr/bin/codesign --deep --force --verify --verbose --options runtime --entitlements "build/pyinstaller/entitlements.plist" -s $MACOS_CODESIGN_IDENTITY DMG/OpenBB\ Terminal/.OpenBB/sklearn/.dylibs/*.dylib
+          /usr/bin/codesign --deep --force --verify --verbose --options runtime --entitlements "build/pyinstaller/entitlements.plist" -s $MACOS_CODESIGN_IDENTITY DMG/OpenBB\ Terminal/.OpenBB/scipy/.dylibs/*.dylib
+          /usr/bin/codesign --deep --force --verify --verbose --options runtime --entitlements "build/pyinstaller/entitlements.plist" -s $MACOS_CODESIGN_IDENTITY DMG/OpenBB\ Terminal/.OpenBB/xgboost/.dylibs/*.dylib
 
           echo "Code Signing Other Files"
           /usr/bin/codesign --deep --force --verify --verbose --options runtime --entitlements "build/pyinstaller/entitlements.plist" -s $MACOS_CODESIGN_IDENTITY DMG/OpenBB\ Terminal/.OpenBB/prophet/stan_model/prophet_model.bin
@@ -168,7 +170,7 @@ jobs:
       - name: Unmount DMG
         run: hdiutil detach /dev/disk2
       - name: Run Integration Tests
-        run: /Users/openbb/Desktop/OpenBB\ Terminal/.OpenBB/OpenBBTerminal /Users/openbb/actions-runner/_work/OpenBBTerminal/OpenBBTerminal/openbb_terminal/miscellaneous/scripts -t
+        run: /Users/openbb/Desktop/OpenBB\ Terminal/.OpenBB/OpenBBTerminal /Users/openbb/actions-runner/_work/OpenBBTerminal/OpenBBTerminal/openbb_terminal/miscellaneous/integration_tests_scripts -t
       - name: Remove OpenBB Folder
         run: rm -rf /Users/openbb/Desktop/OpenBB\ Terminal
       - name: Remove OpenBB Exports Folder

.github/workflows/linting.yml

@@ -0,0 +1,64 @@
+name: General Linting
+
+env:
+  OPENBB_ENABLE_QUICK_EXIT: true
+  OPENBB_LOG_COLLECT: false
+  OPENBB_USE_ION: false
+  OPENBB_USE_PROMPT_TOOLKIT: false
+  PIP_DEFAULT_TIMEOUT: 100
+
+on:
+  push:
+    branches:
+      - 'feature/*'
+      - 'hotfix/*'
+      - 'release/*'
+
+# Cancel previous runs that are not yet completed.
+concurrency:
+  group: ${{ github.workflow }}-${{ github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  code-linting:
+    name: General Code Linting
+    runs-on: ubuntu-latest
+    steps:
+      - name: Checkout Code
+        uses: actions/checkout@2541b1294d2704b0964813337f33b291d3f8596b # actions/checkout v3.0.2
+
+      - name: Setup Python 3.9
+        uses: actions/setup-python@v4
+        with:
+          python-version: "3.9"
+          architecture: x64
+
+      - uses: actions/cache@v3
+        with:
+          path: ~/.cache/pip
+          key: ${{ runner.os }}-linting-${{ hashFiles('**/poetry.lock') }}
+          restore-keys: ${{ runner.os }}-linting-${{ hashFiles('**/poetry.lock') }}
+
+      - run: |
+          pip install bandit black codespell mypy==0.982 pyupgrade safety pylint==2.15.2 packaging==22 ruff==0.0.212
+          pip install types-pytz types-requests types-termcolor types-tabulate types-PyYAML types-python-dateutil types-setuptools types-six
+      - run: bandit -x ./tests -r . || true
+      - run: black --diff --check .
+      - run: codespell --ignore-words-list=commun,statics,ro,zar,zlot,jewl,ba,buil,coo,ether,hist,hsi,mape,navagation,operatio,pres,ser,yeld,shold,ist,varian,datas,ake,creat,vie,hel,ket,toke,certi,buidl,ot,te --quiet-level=2 --skip=./tests,.git,*.css,*.csv,*.html,*.ini,*.ipynb,*.js,*.json,*.lock,*.scss,*.txt,*.yaml,./build/pyinstaller,./website/config.toml
+      - run: ruff .
+      - run: mypy --ignore-missing-imports openbb_terminal
+      - run: shopt -s globstar && pyupgrade --py38-plus **/*.py
+      - run: safety check
+      - run: |
+          pylint terminal.py openbb_terminal tests
+
+  markdown-link-check:
+    name: Markdown Linting
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v3
+        name: Check out the code
+      - name: Lint Code Base
+        uses: docker://avtodev/markdown-lint:v1
+        with:
+          args: "./*.md ./changelogs/*.md ./openbb_terminal/**/*.md ./discordbot/**/*.md"

.github/workflows/m1_macos_build.yml

@@ -89,7 +89,7 @@ jobs:
       - name: Unmount DMG
         run: hdiutil detach /dev/disk4
       - name: Run Integration Tests
-        run: /Users/openbb/Desktop/OpenBB\ Terminal/.OpenBB/OpenBBTerminal /Users/openbb/actions-runner/_work/OpenBBTerminal/OpenBBTerminal/openbb_terminal/miscellaneous/scripts -t
+        run: /Users/openbb/Desktop/OpenBB\ Terminal/.OpenBB/OpenBBTerminal /Users/openbb/actions-runner/_work/OpenBBTerminal/OpenBBTerminal/openbb_terminal/miscellaneous/integration_tests_scripts -t
       - name: Remove OpenBB Folder
         run: rm -rf /Users/openbb/Desktop/OpenBB\ Terminal
       - name: Remove OpenBB Exports Folder

.github/workflows/nightly-build.yml

@@ -0,0 +1,96 @@
+name: Nightly Build on the develop branch
+
+env:
+  OPENBB_ENABLE_QUICK_EXIT: true
+  OPENBB_LOG_COLLECT: false
+  OPENBB_USE_ION: false
+  OPENBB_USE_PROMPT_TOOLKIT: false
+  PIP_DEFAULT_TIMEOUT: 100
+  PYTHONNOUSERSITE: 1
+
+on:
+  schedule:
+    - cron: "0 0 * * *"
+
+concurrency:
+  group: ${{ github.workflow }}-${{ github.ref }}
+  cancel-in-progress: true
+
+jobs:
+  Windows-Build:
+    name: Windows10 Build
+    runs-on: [self-hosted, Windows, x64]
+    # Configuring -------------
+    steps:
+      - name: Setup Windows Git Configuration # This is under the assumption that git is already installed on the system
+        run: |
+          Set-ItemProperty 'HKLM:\System\CurrentControlSet\Control\FileSystem' -Name 'LongPathsEnabled' -value 1
+          git config --system core.longpaths true
+
+      - name: Checkout
+        uses: actions/[email protected]
+        with:
+          ref: develop
+
+      - name: Activate Base & Create OpenBB Environment
+        run: |
+          conda activate base
+          conda env create -n obb --file build/conda/conda-3-9-env-full.yaml
+          conda init
+          conda activate obb
+          conda env list
+      - name: Poetry Install
+        # Conda activate needs to be run every time because of the way that the workflow steps work
+        # on powershell where it creates a new shell every time for every step
+        run: |
+          conda activate obb
+          poetry install
+      - name: Poetry Install Portfolio Optimization and Forecasting Toolkits
+        run: |
+          conda activate obb
+          poetry install -E all
+      - name: Poetry Install Installer
+        run: |
+          conda activate obb
+          poetry install -E installer
+      - name: Install Specific Papermill
+        run: |
+          conda activate obb
+          pip uninstall papermill -y
+          pip install git+https://github.com/nteract/papermill.git@main
+      # Building ------------
+      - name: Build Terminal.spec file
+        run: |
+          conda activate obb
+          pyinstaller build/pyinstaller/terminal.spec --clean
+      - name: Move Files into App Folder
+        run: cp -r .\dist\OpenBBTerminal\ .\build\nsis\app\
+      # don't need this because log collection is turned off
+      # - name: Remove Log Data
+      #   run: Remove-Item .\build\nsis\app\openbb_terminal\logs\ -Recurse
+      - name: Build Exe File
+        run: |
+          conda activate obb
+          C:\'.\Program Files (x86)\'\nsis\makensis.exe .\build\nsis\setup.nsi
+      - name: Save Build Artifact
+        uses: actions/upload-artifact@v3
+        with:
+          name: Windows EXE Artifact
+          path: '.\build\nsis\OpenBB Terminal Setup.exe'
+      - name: Run Integration Tests
+        run: |
+          dist\OpenBBTerminal\OpenBBTerminal.exe C:\Users\Administrator\actions-runner\_work\OpenBBTerminal\OpenBBTerminal\openbb_terminal\miscellaneous\scripts -t
+      # Cleaning ------------------------
+      # Make sure to add Remove-Item C:\Users\Administrator\Desktop\OPENBB-exports -Recurse whenever integration tests get fixed
+      - name: Remove Previous Build
+        run: |
+          Remove-Item '.\build\nsis\OpenBB Terminal Setup.exe' -Recurse
+          Remove-Item .\build\nsis\app\ -Recurse
+          Remove-Item .\dist\ -Recurse
+          Remove-Item .\build\terminal\ -Recurse
+      - name: Deactivate & Remove Conda Environment
+        run: |
+          conda deactivate obb
+          conda deactivate base
+          conda env remove -n obb
+          Remove-Item C:\Users\Administrator\miniconda3\envs\obb\ -Recurse

.github/workflows/test.yml

@@ -5,7 +5,8 @@ env:
   OPENBB_USE_ION: false
   OPENBB_USE_PROMPT_TOOLKIT: false
   PIP_DEFAULT_TIMEOUT: 100
-on: [pull_request, push]
+
+on: [workflow_dispatch]
 
 jobs:
   linting: