Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Mac builds into CI pipeline #143

Merged
merged 6 commits into from
Sep 19, 2023
Merged

Conversation

var77
Copy link
Collaborator

@var77 var77 commented Sep 15, 2023

Description

  • Added macos-13 runner which will build macos binaries. The build script was separated into 3 parts:
    build.sh - this is common script for both linux and mocos platforms. This will be executed from the pipeline
    build-linux.sh - linux specific environment setup functions
    build-mac.sh - macos specific environment setup functions

now the universal archive will have the following structure $arch/$platform/$pg_version/lantern.so

The command to get architecture changed from dpkg --print-architecture to uname -m, so we will have the same output for both linux and macos. Previously the dpkg was printing amd64 and uname -m x86_64.

Cleaned up the build scripts and action yaml files.

I will also open PR on lantern_extras to add macos support

#7

.github/workflows/build.yaml Show resolved Hide resolved
.github/workflows/test-linux.yaml Outdated Show resolved Hide resolved
@var77 var77 requested a review from dqii September 17, 2023 07:44
@Ngalstyan4
Copy link
Contributor

Can you install pgvector in mac as well so our pgvector tests also run?

I think right now those tests will fail because of an innocuous reordering issue in the test.
Feel free to ignore that failure for now

@var77
Copy link
Collaborator Author

var77 commented Sep 19, 2023

Can you install pgvector in mac as well so our pgvector tests also run?

I think right now those tests will fail because of an innocuous reordering issue in the test. Feel free to ignore that failure for now

@Ngalstyan4 currently I do not run tests on mac as in CI it is collecting coverage information now and the postgres should be run in a custom way with gcov enabled. I should separate that part as well, so the tests will run on mac without coverage information. Should I implement it in this PR?

Copy link
Contributor

@Ngalstyan4 Ngalstyan4 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can merge this and then do testing on mac in a separate PR

ci/scripts/build.sh Outdated Show resolved Hide resolved
ci/scripts/run-benchmarks.sh Outdated Show resolved Hide resolved
ci/scripts/run-benchmarks.sh Show resolved Hide resolved
Linux*) PLATFORM=linux;;
Darwin*) PLATFORM=mac;;
CYGWIN*) PLATFORM=cygwin;;
MINGW*) PLATFORM=mingw;;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

when do we expect cygwin, mingw cases to be hit?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

they seems to be some unix like shells for windows, but I didn't test them.

@var77 var77 force-pushed the feature/mac-build branch 3 times, most recently from a2762f1 to ed322f8 Compare September 19, 2023 09:12
@var77
Copy link
Collaborator Author

var77 commented Sep 19, 2023

@Ngalstyan4 @dqii I did the requested changes and also added tests for mac os (with pgvector). There needed to do some modifications on pgvector test file to make it more consistent over the platforms.

@dqii
Copy link
Contributor

dqii commented Sep 19, 2023

It still lgtm. Sorry, I merged Postgres 16 so there are a few conflicts

@var77
Copy link
Collaborator Author

var77 commented Sep 19, 2023

It still lgtm. Sorry, I merged Postgres 16 so there are a few conflicts

No worries, I will fix them later today

@Ngalstyan4 Ngalstyan4 merged commit 493bb04 into lanterndata:main Sep 19, 2023
25 of 26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants