These guidelines reflect our shared consensus on protocol and etiquette from what we've built so far. Every single item that is presented here is the result of lots of experimentation. However, that doesn't mean that there isn't a better way to do things. What we have below is simply what we've found to work best for us. In this document you will find notes about:
- Project structure.
- Code style.
- Continuous integration.
- Tests.
- Tasks (asset pipeline, transpiling, releasing, etc).
- Dependency management.
Our toolkit for each of these is not set in stone, and we don't plan to halt our constant search for better tools. Get in touch if you've got ideas. These are guidelines rather than rules.
- Goals
- Tech Leads and Lead Maintainers
- Contributing
- Aegir
- FAQ
- Code of Conduct
- References - Resources and good reads
- Acknowledgments
For the majority of our JavaScript projects, our goals are to:
- Ensure browser compatibility, with the possible exceptions being:
- Access to the file system.
- Native bindings.
- Network transports (uTP, udt, curveCP, etc) that are not available in the browser.
- Don't break CommonJS's
require
. This means that if someone requires a JavaScript module from the IPFS ecosystem, they should be able to require it and use browserify, webpack or other bundlers without having to worry about adding special shims for module internals. - Encourage contribution.
- Have great UX for everyone involved.
This section is a formalization of the proposal and discussion around the Module Lead Maintainers - Sharing the Responsibility over the IPFS module base proposal.
We have two types of leads in the JavaScript project ecosystems, the Tech Lead and the Module Lead Maintainer. A brief description of both roles is:
- A Tech Lead directs the development of an entire ecosystem of modules (i.e js-ipfs, js-libp2p, js-ipld and js-multiformats), it has a complete understanding of the stack, the IPFS project, its goals and participates actively in the ROADMAP planning.
- A Lead Maintainer is a contributor that has shown extraordinary ability to contribute to the project and willingness to make the project better by taking the responsibility of stewarding one of its modules forward.
With this structure, we expect to achieve the following goals:
- Recognize extraordinary contributions and empower contributors to take an even more important role in the project.
- Reduce PR review time and Time To Release.
- Increase the overall quality of the project.
- Help users know who to reach out to for help.
- Have a clear protocol to pass on the baton.
The current Tech Leads are:
- David Dias for js-ipfs, js-libp2p js-multiformats ecosystems.
- Volker Mische for the js-ipld ecosystem.
The current Lead Maintainers can be identified either by the leadMaintainer
field in the package.json of the module and/or the section Lead Maintainer
in the README.md of the module.
Lead Maintainer responsibilities:
- Respect and follow the IPFS Code of Conduct.
- Have a complete understanding of the module purpose, its specification (if any) and how the module is used by other parts of the project.
- Review and merge PRs.
- Respond in a timely manner to Github issues and curate them to ensure that duplicates are coalesced, issues are labeled with difficulty and priority, and also tag any issue that is open for new contributors with the
help wanted
label. - Publish new versions of the module to npm.
Lead Maintainer expected attitude:
- Be proactive in increasing the quality of the module. This goes from improving documentation, tests, codebase and more.
- Show a great level of rigor and polish in the code that they ship.
- Help others in understanding how the module works and why it exists.
- Apply the established Contributing Guidelines to the project and help others do too
How to become a Lead Maintainer:
Currently, there is no formal test or request form to do so. Lead Maintainers will be invited and nominated by the Tech Lead once the expected behaviour and rigor is observed. A Lead Maintainer can nominate the next Lead Maintainer to the Tech Lead
In practice:
- Update each package.json and README.md to have a
leadMaintainer
field. - Update packages table on each entry module (e.g https://github.com/ipfs/js-ipfs#packages) to also list the maintainer for each.
- Protect the master branch and only grant permissions for merge to the Maintainer and the Tech Lead, only.
- Grant publish permission to the Maintainer and Tech Lead (or another Tech Lead if it’s the same person), only.
Please follow the conventions described in this document.
When reporting a bug, if possible, provide a way for us to reproduce it (or even better, write a test that fails with your case).
Always run tests before pushing and PR'ing your code.
IPFS projects support both the Current and Active LTS versions of Node.js. Please see nodejs.org for what these currently are.
Browser code may be transpiled using Babel to take advantage of the latest JavaScript features.
IPFS JavaScript projects default to standard code style. It is a clean codestyle, and its adoption is increasing significantly, making the code that we write familiar to the majority of the developers.
However, we've added an extra linting rule: Enforce the use of strict mode. This avoids issues we had when using ES2015 features outside of strict mode. We enforce this rule by using eslint and extending standard module with the eslint-config-standard.
Using aegir-lint will help you do this easily; it automatically lints your code.
Our rule is: Use ~ for everything below 1.0.0 and ^ for everything above 1.0.0. If you find a package.json that is not following this rule, please submit a PR.
The only exception to this is if a third party library accidentally releases a breaking change, in which case temporarily pin the dependency to a single version (e.g. "my-dep": "1.0.0"
).
Using aegir-lint will show you if any of your dependency versions need changing to comply with this.
Since js-ipfs
is meant to be both a Node.js and Browser app, we strongly recommend having tests that run in both platforms, always. For most cases, we use mocha to run write the tests and karma to automate the test execution in the browser. This solution has been extremely convenient.
Each time a new release happens, these are the steps we follow to make sure nothing gets left out:
- Run linting
- Run all tests
- Build all three different versions described on the build
- Bump the version in
package.json
- Commit the version bump
- Create a git tag
- Push to GitHub
- Publish to npm
We use documentation.js to document our JavaScript repositories. An example for how to use JSDoc to document everything can be seen in this PR to js-ipfs. Ideally, we create a docs
folder in each repository, and make sure it is not tracked to git.
We use aegir-docs
for the actual generation, which relies on JSDoc style comments. For more on aegir, see the section below.
We have very precise rules over how our git commit messages can be formatted. This leads to more readable messages that are easy to follow when looking through the project history. But also, we use the git commit messages to generate the change log.
The commit message formatting can be added using a typical git workflow or through the use of a CLI wizard (Commitizen).
Each commit message consists of a header, a body and a footer. The header has a special format that includes a type, a scope and a subject:
<type>(<scope>): <subject>
<BLANK LINE>
<body>
<BLANK LINE>
<footer>
The header is mandatory and the scope of the header is optional.
Any line of the commit message cannot be longer 100 characters! This allows the message to be easier to read on GitHub as well as in various git tools.
We kindly ask and expect for all commits to be signed off with the same license as the repo and module. This can be done by appending the following to your commit message:
License: MIT
Signed-off-by: User Name <email@address>
where "User Name" is the author's real (legal) name and email@address is one of the author's valid email addresses.
If you want to automatically add this to all of your commits, you can do the following:
Create a file in ~/git-commit-template
with the following contents (notice the two blank lines in the top):
License: MIT
Signed-off-by: Victor Bjelkholm <[email protected]>
Then, add the following to your global git config (Usually at ~/.gitconfig
):
[commit]
template = /home/user/git-commit-template
If the commit reverts a previous commit, it should begin with revert:
, followed by the header of the reverted commit. In the body it should say: This reverts commit <hash>.
, where the hash is the SHA of the commit being reverted.
Must be one of the following:
- feat: A new feature
- fix: A bug fix
- docs: Documentation only changes
- style: Changes that do not affect the meaning of the code (white-space, formatting, missing semi-colons, etc)
- refactor: A code change that neither fixes a bug nor adds a feature
- perf: A code change that improves performance
- test: Adding missing tests
- chore: Changes to the build process or auxiliary tools and libraries such as documentation generation
The scope could be anything specifying the place of the commit change. For example api
, cli
, etc...
The subject contains a succinct description of the change:
- use the imperative, present tense: "change" not "changed" nor "changes"
- don't capitalize first letter
- no dot (.) at the end
Just as in the subject, use the imperative, present tense: "change" not "changed" nor "changes". The body should include the motivation for the change and contrast this with previous behavior.
The footer should contain any information about breaking changes and is also the place to reference GitHub issues that this commit closes.
Breaking Changes should start with the word BREAKING CHANGE:
with a space or two newlines. The rest of the commit message is then used for this.
feat(pencil): add 'graphiteWidth' option
fix(graphite): stop graphite breaking when width < 0.1
Closes #28
perf(pencil): remove graphiteWidth option
BREAKING CHANGE: The graphiteWidth option has been removed. The default graphite width of 10mm is always used for performance reason.
revert: feat(pencil): add 'graphiteWidth' option
This reverts commit 667ecc1654a317a13331b17617d973392f415f02.
This commit strategy is based on:
- https://github.com/conventional-changelog/conventional-changelog-angular/blob/master/convention.md
- https://github.com/angular/angular.js/blob/master/CONTRIBUTING.md#commit
More details about the commit convention can also be found in this document.
There should be no dependencies that rely on commits. Instead, there should be WIP PR and each PR that depends on other WIP PR should list what it depends on. Yes, everyone will have to do the extra work of npm link
ing everything, but this helps us have a cleaner workflow.
We've created a module to help us achieve all of the above with minimal effort. Feel free to also use it for your projects. Feedback is appreciated!
There are a couple of binaries that aegir
provides for you to use
> aegir lint
> aegir test
> aegir test -t browser
> aegir test -t node
> aegir test -t webworker
> aegir build
> aegir release
> aegir release --type minor
> aegir release --type major
If you prefer using npm scripts, you can set them up in your package.json:
{
"scripts": {
"lint": "aegir lint",
"build": "aegir build",
"test": "aegir test",
"test:node": "aegir test -t node",
"test:browser": "aegir test -t browser",
"release": "aegir release",
"coverage": "aegir coverage",
"coverage-publish": "aegir coverage publish"
}
}
You also need to add it your devDependencies
by running:
$ npm install --save-dev aegir
To reduce the amount of configuration, aegir expects your source code to be in src
and your test files in test
.
├── dist # auto-generated by the transpile and minification task.
│ ├── index.js
│ └── index.min.js
├── src # source code. Can use the latest features (ES2015) in JavaScript.
│ ├── index.js
│ └── ...
├── test # tests folder
│ ├── node.js # Node specific test setup
│ ├── browser.js # Browser specific test setup
│ ├── mytest.spec.js # All files ending in .spec.js are considered test files to be run
│ └── ...
├── package.json
├── README.md
├── CONTRIBUTING.md
├── circle.yml
├── .travis.yml
├── .npmignore
├── .gitignore
└── node_modules
You can find samples for Travis and circle in the examples folder.
We also use coveralls.io to automatically publish coverage reports. This is done from travis using this:
script:
- npm run coverage
after_success:
- npm run coverage publish --providers coveralls
To avoid checking in unwanted files, the .gitignore
file should follow the example. This is if you are using aegir
- smaller projects can use smaller .gitignore
files.
NPM uses the .gitignore
by default, so we have to add a .npmignore
file to ensure we actually ship lib
and dist
files. You can use this example to get started.
We suggest either of these:
- david-dm
- greenkeeper to keep your dependencies up to date.
Every module below 1.0.0 should use ~
instead of ^
.
pre-commit helps us check code style run the tests on every commit. In your package.json
:
"pre-commit": [
"lint",
"test"
]
You can get a bundled version by running npm run build
, an npm script we add to the package.json
. You can find the generated bundle in the /dist
folder. This is available for every project that uses aegir
.
For use in the browser through script tags, there are regular and minified versions in the npm release.
You can use unpkg to include those:
<script src="https://unpkg.com/ipfs-api/dist/index.js"></script>
<script src="https://unpkg.com/ipfs-api/dist/index.min.js"></script>
If you install the module through npm, you can require it using:
const API = require('ipfs-api')
There are two possibilities: either it didn’t work out for us, or we don’t know about it. If you think we might have missed it please tell us, but please believe us if we say we tried and it didn’t work for us.
Gulp is not a hard dependency. It’s just a simple way to structure our tasks at the moment. Usually projects only depend on the aegir binaries completely hiding the fact that we are using gulp under the hood. So we are free if we want to switch it out without any issues. We all enjoy npm scripts, and are using them to call the aegir binaries, but there is no nice way of sharing them yet.
Our linting rules are compatible with standard, which has many examples on documentation on this. Please go there and read it if you're still curious.
We want to see the web move forward, and some of us enjoy writing their JavaScript with things like const
and arrow functions.
No.
No. But other people might ask you to at some point, so it may be better to be prepared.
Because it saves us hours every single day. This tooling is the result of a lot of effort, thought, and hard learning. Its goal is to minimize process road bumps and provide a unified low-friction workflow for contributors.
Any IPFS JavaScript project follows the same Code of Conduct applied to the whole IPFS ecosystem.
- Comparison between WebPack, browserify, requirejs, jspm and rollup - https://github.com/webpack/docs/wiki/comparison
- The cost of transpiling ES2015 in 2016
- standardjs.com
This project would not be possible without the hard work of many many people. So a big shout out to all contributors to these projects: