Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding Code of Conduct file #2

Closed

Conversation

facebook-github-bot
Copy link
Contributor

This is pull request was created automatically because we noticed your project was missing a Code of Conduct file.

Code of Conduct files facilitate respectful and constructive communities by establishing expected behaviors for project contributors.

This PR was crafted with love by Facebook's Open Source Team.

fbshipit-source-id: 653a22b831d1ed9f0496f75b86ee762cfe95146c
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 25, 2022
facebook-github-bot pushed a commit that referenced this pull request Oct 13, 2022
…ingle file when the archive has no bitcode object.

Summary:
Current opt step would check if each object in an archive is bitcode. then:
1. If it is, run an actual opt to generate ELF.
2. If it's not bitcode (already an ELF), trigger a copy action to copy the file to the destination.

In the case of prebuilt library since all the objects are ELF already, it's more efficient to just copy the folder than #2.

This change bring down the total number of actions from 186.5k -> 144k (22.7%) for unicorn:index_server

{F780561315}

Reviewed By: christycylee

Differential Revision: D40319823

fbshipit-source-id: 4650cf8f6ef5170d2c6fb4d456e7042de77a4f2f
facebook-github-bot pushed a commit that referenced this pull request Mar 16, 2023
Summary:
**Context**

Supporting fat and non-fat toolchains becomes problematic because a fat toolchain usually combines tools using `command_alias()`. So if we set the platform constraints for the individual tools (which we need, so that the thin toolchain gets the correct platform), we end up producing conflicting constraints.

```
   ┌─────────────────┐          ┌───────────────┐
   │ linux-toolchain │          │ fat-toolchain │
   └─────────────────┘          └───────────────┘
            │                           │
            │                           │
            │                           │
            │                           │
"tool" = attrs.exec_dep()   "tool" = attrs.exec_dep()
            │                           │
            │                           │
            │                           │
            │                           │
            │                           │
            │                           │
            │                           ▼
            │          ┌────────────────────────────────┐
            │          │command_alias(name = "fat-tool")│
            │          └────────────────────────────────┘
            │                           │
            │                      platform_exe
            │                           │
            │                           │
            │         ┌─────────────────┴─────────────────────┐
            │         │                                       │
            │         │                                       │
            │         │                                       │
            │         │                                       │
            ▼         ▼                                       ▼
     ┌─────────────────────────────────┐    ┌───────────────────────────────────┐
     │sh_binary(name="linux-only-tool")│    │sh_binary(name="windows-only-tool")│
     └─────────────────────────────────┘    └───────────────────────────────────┘
```

If we were to set the `target_compatible_with` constraints on `linux-only-tool` and `windows-only-tool`, then `fat-tool` is not resolved to any exec platform, as no exec platform satisfies *both* Windows and Linux.

**Solution/Workaround**

There are two solutions to the problem:

1. Set up mirrored aliases of all underlying tools
2. Set up an placeholder tool on `(apple|cxx|swift)_toolchain()` for the purposes of setting exec platform constraints

We opt for solution #2 as it's much simpler and does not require extensive changes to existing toolchain setup. Since the tools are optional, they can be unused without any downsides.

Reviewed By: rmaz

Differential Revision: D44090642

fbshipit-source-id: 399cfbfdf4dcbb4b334e22545cfea5e86e31c837
facebook-github-bot pushed a commit that referenced this pull request Jun 15, 2023
Summary:
The existing `_get_argsfile_output` does two things:
1. creates the argsfile subtarget DefaultInfo provider
2. sets the `by_ext` attribute for use in xcode_data

Up the stack, #2 is replaced by the `CompileArgsfiles` record which contains a map of extension to `CompileArgsfile`.

Extracting out #1 allows us to restructure the code (later on) to
1. define the argsfile subtarget, DefaultInfo and action only for targets that want it
2. extract it out of compilation so that compilation code is simpler

Reviewed By: milend

Differential Revision: D46743454

fbshipit-source-id: 31a108410e49fb85851d91334ed598a10731e7d9
facebook-github-bot pushed a commit that referenced this pull request Aug 7, 2023
Summary:
This is another version of D47988498, which the minor change that fixes the bug the broke a few of our tests.

The problem was that in the `haskell_ghci` rule, we were generating directory names using the suffix based on the profiling attribute of the `haskell_ghci` target, instead of the one considered when building the actual library.

This meant that the interface files were not found for some packages and their modules couldn't be imported.
---------
# Summary from D47988498

## This stack
See D47987891.

## This diff

Change the names of generated artifacts (e.g. package directories, lib names) to consider the status of profiling.

This is needed to (a) make it clear for every artifact if it was build with or without profiling and (b) to fix buck2 errors from declaring outputs with the same name of running the actions with the same category name (e.g. "haskell_link_...").

Reviewed By: helfper

Differential Revision: D48110784

fbshipit-source-id: e12ec14aacb406d2334bfcd22e5ba81b82c847eb
facebook-github-bot pushed a commit that referenced this pull request Sep 19, 2024
Summary:
This makes lives easier by not needing to passthrough it.
Original diff D62916369
Landed the wrong version, :(

Reviewed By: IanChilds

Differential Revision: D62984484

fbshipit-source-id: 0805c94e694a722edd13e9b91cc73bad8c11e2b7
facebook-github-bot pushed a commit that referenced this pull request Dec 19, 2024
…cross all host platforms

Summary:
### Motivation

My team has a concrete need for buck to generate 100% matching zip files for the same sets of inputs on all host platforms (macOS, Linux, Windows). Current limitations:
1. File order can be different on file system with different case sensitivity.
2. Windows can't write correct posix mode (i.e. permissions) for any entries.

Although the entries themselves might fully match, those discrepancies result in different metadata, which results in a different zip file.

See D67149264 for an in-depth explanation of the use case that requires this level of determinism.

### Tentative solution #1

In D66386385, I made it so the asset generation rule was only executable from Linux. Paired with buck cross builds, it made so that outputs from macOS and Linux matched, but did not work on Windows [due to some lower level buck problem](https://fb.workplace.com/groups/930797200910874/posts/1548299102494011) (still unresolved).

### Tentative solution #2

In D66404381, I wrote my own Python script to create zip files. I got all the files and metadata to match everywhere, but I could not get around differences in the compression results. Decided not to pursue because compression is important for file size.

###  Tentative solution #3

In D67149264, I duplicated and tweaked buck's zip binary. It did work, but IanChilds rightfully pointed out that I'd be making maintenance on those libraries more difficult and that the team is even planning on deleting those, at some point.

### Tentative solution #4 (this diff!)

IanChilds advised me to try to fix buck itself to produce consistent results, so this is me giving it a try.

Because the root problem could not have been done in a backwards compatible way (the file permissions, specifically; see inlined comment), I decided to use an argument to control whether the zip tool should strive to produce a deterministic output or not, at the expense of some loss of metadata. The changes are simple and backwards compatible, but any feedback on the root problem, idea and execution are welcome.

Reviewed By: christolliday

Differential Revision: D67301945

fbshipit-source-id: c42ef7a52efd235b43509337913d905bcbaf3782
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant