Sprint Nov 16

[daviddias]

Sprint Nov 16

Sprint Goals

Sprint Discussions

Schedule

Please take notes in a separate pad, if you can, and link it here.

Endeavour	Lead	Pad	Permanent Link
Apps on IPFS	Juan Benet and Friedel Ziegelmayer	https://public.etherpad-mozilla.org/p/nov-16-apps-on-ipfs
infrastructure	Lars Gierth	https://public.etherpad-mozilla.org/p/nov-16-infrastructure
libp2p	David Dias	https://public.etherpad-mozilla.org/p/nov-16-libp2p
js-ipfs	David Dias	https://public.etherpad-mozilla.org/p/nov-16-js-ipfs
go-ipfs	Jeromy Johnson	https://public.etherpad-mozilla.org/p/nov-16-go-ipfs
testing + ci	Jeromy Johnson	https://public.etherpad-mozilla.org/p/nov-16-testing-ci
protocol + specs	Juan Benet	https://public.etherpad-mozilla.org/p/nov-16-protocol-specs
bitswap ml	Juan Benet	https://public.etherpad-mozilla.org/p/nov-16-bitswap-ml
Data Structures	Juan Benet	https://public.etherpad-mozilla.org/p/nov-16-data-structures

Please add the Agenda to the Pad before the endeavour sprint starts.

Sprint Deliverables

• Add yourself below, that way we only have people listed who are really in the sprint
• Add links to issues down here. Only add things you can finish this sprint.

David Dias

• libp2p
  • Test go-libp2p
  • Make libp2p-ping be a thing again (guarantees swarm compatibility)
  • great sync with Jeromy on libp2p stuff while going through go-libp2p repo
• npm's registry on IPFS (on hold till 0.3.9 rebase on top of 0.4.0)
  • install modules via IPFS using registry-mirror
  • ~ get Castor juiced up with all of the modules
  • deploy new registry-mirror version on Castor
  • Improve documentation and Roadmap across libp2p impl (providing some guidance to py-libp2p)
  • drop deprecated impl of ipfs-blob-store ipfs-shipyard/ipfs-blob-store@409691c
  • upgrade ipfs-blob-store to latest js-ipfs-api ipfs-shipyard/ipfs-blob-store@bbc2e72
• js-ipfs-api
  • WIP: add and cat big file test (failing) ipfs-inactive/js-ipfs-http-client#131
  • upgrade feat/files-api to use latest js-ipfs-api goodness (including speed boost by moving to Wreck)
  • fix error handling ipfs-inactive/js-ipfs-http-client@fc96f93
• js-ipfs
  • Continue working on jsipfs module Getting jsipfs out the door js-ipfs#35
• extra
  • Deliver Talk at NodeConf Barcelona
  • Travel Logistics
  • IPFS Lisbon Backshop (Thursday)
  • reinstall Go in my brain

@lgierth

• go-ipfs
  • fix gateway links with url rewrites gateway: add path prefix for directory listings kubo#1971 gateway: set X-Ipfs-Gateway-Prefix header infra#116
  • [~] RFCR X-Ipfs-Gateway-Prefix hardening gateway: harden path prefix kubo#1988
  • document refs-denylists-dmca data structure
  • [~] RFCR fix seccat seccat: fix secio context kubo#1987
• infrastructure
  • [~] open up cors on gateways (allow origin *) gateway: open up CORS to everything (allow-origin *) infra#109
  • exclude dev0.4.0 hosts from pinbot CiteSeerX instance infra#123
  • .h.ipfs.io pointing to cjdns addresses
  • chat with gendale/alexandria
  • nodejs 4 and npm for daviddias
• cjdns
  • [~] blocked by secio issue: discover peers from cjdns WIP: discover peers from cjdns kubo#1316
  • [~] invite to fc00 development (aka go-cjdns) https://github.com/fc00/spec
  • iptunnel setup with whyrusleeping
• hope
  • mfs api 500 responses
  • build a prometheus exporter using :5001
  • my todos for 0.4.0 migration

Richard Littauer

• Stub out 5 different methods in HTTP API docs
• Sprint management
• Suggest community infrastructure for meetups
• Make the documentation around Commit Sign-Offs more friendly
• Solidify Discourse - Better community building community#69

@whyrusleeping

• ipfs-update
• add-mem fix
• ship 0.3.10
• fs-repo-migrations for 0.4.0

@victorbjelkholm

Main focus will be to move forward with PinCoop

• IPFS in JS
  • Help out to finish the API.md for js-ipfs-api
• PinCoop - https://github.com/victorbjelkholm/pincoop
  • having PinCoop ready for public consumption, mainly to scratch my own need for ipfsbin
• IPFSBin - https://github.com/victorbjelkholm/ipfsbin
  • start using PinCoop for ipfsbin, to make content more available
• Nodejs versions in IPFS
  • Make Castor to pin the already downloaded binaries
• Community
  • preparing talk for local meetups here in Barcelona

@dignifiedquire

• Bug fixing on js-ipfs-api
• Investigate next steps in webui refactoring (see above)

@jbenet

• QCon SF talk
• CR
  • ipfs-update
  • @rht's PRs
• spec work
  • fix repo spec for @masylum
• sync with @kyledrake re permance + confs
• hacking archiving stuff with mek
• various conversations
• org things

@harlantwood

• plugging away at CI build matrix & selected repo statistics ipfs-inactive/project-repos#1
• considering options for Server side vs client side build matrix generation ipfs-inactive/project-repos#6
• kicking off Github Bridge infra#119

[dignifiedquire]

Apps on IPFS

Lead: Friedel Ziegelmayer

Agenda

Components all the things

• Modularized webui ipfs-webui#73
• https://github.com/ipfs/ipfs/issues/109

Help and Report on station

Participants

• Friedel Ziegelmayer @dignifiedquire
• David Dias @diasdavid
• Johan Kiviniemi @ion1
• Victor @victorbjelkholm
• Juan Benet @jbenet

Notes

Station

• Multiple daemons vs a single daemon
• TODO: Figure out a way to run multiple daemons with station
• TODO: Make a module to check for multicast announcements (using https://github.com/diasdavid/js-libp2p-mdns-discovery)
• TODO(@dignifiedquire): describe better what should happen here Add test setup ipfs-desktop#50 ✅

Components

• "Do not join the components war, just be the arms dealer"
• TODO: polish the webui & add tests!!!!!!
• TODO: Make the webui more modular
• TODO: Recipe for modular components on ipfs
• TODO: Use IPNS hash for the webui

Really great meeting :) Thanks everyone :)

[ghost]

Infrastructure

Lead: Lars Gierth

Hangout: https://hangouts.google.com/hangouts/_/ipfs.io/ipfs-infrastructure

Agenda

• refs
  • go-ipfs side of refs-denylists-dmca
  • gateway prefix
• dev0.4.0
  • pinbot
  • repo migrations
• community pinning
  • ipfs-cluster
• writable gateway
  • put vs. post

Participants

• ion
• jbenet briefly
• kyledrake
• lgierth
• VictorBjelkholm
• whyrusleeping

Notes

• refs
  • why will take care of the go-ipfs side of refs-denylists-dmca (after 0.4.0)
  • lgierth will describe the changes to the dmca data structure
  • dmca: preliminary blocking using nginx
  • dmca link on legal page
• writable gateway
  • ipfs.io should probably be left readonly
  • saves us from hard problems like SEO spam, resource exhaustion
  • might be a space for businesses
• nodejs / iojs archives
  • lgierth & VictorBjelkholm coordinate regarding storage
• arin
  • kyledrake figures out registration and ovh support
  • lgierth figures out hetzner and digitalocean support

[daviddias]

libp2p

Lead: David Dias

Agenda

• go-libp2p is out - goals for the week

You have 30 minutes for this agenda, 5 minutes before the meeting ends, consider moving the remaining items to a github discussion thread so that all the other sprint meetings can start in time.

Participants

• David Dias
• Kyle Drake
• Juan Benet
• Friedel Ziegelmayer
• Johan Kiviniemi
• Victor Bjelkholm

Notes

• Authentication in IPFS with key derivation (key) discussion
• https://github.com/ipfs/specs/tree/master/records
• https://github.com/ipfs/specs/tree/master/keychain
• Key Rotation specs#31
• need for clarification on how a Record is really structured specs#24

After sprint meeting is finished, create the respective action items on the Github sprint issue

[daviddias]

js-ipfs

Lead: David Dias

Agenda

You have 30 minutes for this agenda, 5 minutes before the meeting ends, consider moving the remaining items to a github discussion thread so that all the other sprint meetings can start in time.

Participants

• David Dias
• Kyle Drake
• Friedel Ziegelmayer
• Victor Bjelkholm

Notes

• js-ipfs with delegated Node is an undergoing effort
• js-ipfs-repo is an undergoing endeavour, starter by @masylum
• js-ipfs on top of js-libp2p needs js-ipfs to be implemented first.

After sprint meeting is finished, create the respective action items on the Github sprint issue

[daviddias]

Today I'll be flying at 17:55 for 2 hours and arrive at 18:55 in Lisbon (hacking the time!), I'll make as fast as I can home so I arrive on time for hangouts :)

[daviddias]

SPRINT CHECK IN

Going to drop my check in now as I'm about to board in a plane :)

• libp2p
  • Test go-libp2p
  • great sync with Jeromy on libp2p stuff while going through go-libp2p repo
• npm's registry on IPFS (on hold till 0.3.9 rebase on top of 0.4.0)
  • install modules via IPFS using registry-mirror
  • ~ get Castor juiced up with all of the modules
  • deploy new registry-mirror version on Castor
  • Improve documentation and Roadmap across libp2p impl (providing some guidance to py-libp2p)
  • drop deprecated impl of ipfs-blob-store ipfs-shipyard/ipfs-blob-store@409691c
  • upgrade ipfs-blob-store to latest js-ipfs-api ipfs-shipyard/ipfs-blob-store@bbc2e72
• js-ipfs-api
  • WIP: add and cat big file test (failing) ipfs-inactive/js-ipfs-http-client#131
  • upgrade feat/files-api to use latest js-ipfs-api goodness (including speed boost by moving to Wreck)
  • fix error handling ipfs-inactive/js-ipfs-http-client@fc96f93
  • Code Review over 9000 PRs from @dignifiedquire :D :D
• js-ipfs - Didn't have the chance to put time on this endeavour
• extra
  • Deliver Talk at NodeConf Barcelona (Saturday)
  • Travel Logistics
  • IPFS Lisbon Backshop (Thursday)
  • ~ reinstall Go in my brain

I'm really close to making registry-mirror really nice to use (with ipfs-shipyard/npm-on-ipfs#5 and ipfs-shipyard/npm-on-ipfs#4), I need to get this done ASAP, so that I can solely focus on libp2p and js-ipfs again.

[whyrusleeping]

sprint update

• fs-repo-migrations (complete and working)
• libp2p vendored
• merge flatfs nosync
• wire contexts into libp2p new-stream
• debugging close notify
• gx work

[dignifiedquire]

Sprint Update

WebUI

• Add new labels
• Clean up issues list
• Start preparations for stats dashboard
  • [~] https://github.com/Dignifiedquire/js-ipfs-event-stream
  • [~] https://github.com/Dignifiedquire/ipfs-dash

js-ipfs-api

• fix: Handle non json formatted errors (fix: Handle non json formatted errors. ipfs-inactive/js-ipfs-http-client#120)
• feat: Add for urls (feat: Add urls directly. ipfs-inactive/js-ipfs-http-client#121)
• refactor: Switch to wreck and webpack reducing the minified size by 50% (Wreck and webpack ipfs-inactive/js-ipfs-http-client#125)
• refactor: Consistent ES2015 usage and passing browser tests (style cleanup + browser build fix ipfs-inactive/js-ipfs-http-client#127)
• fix: Correct header detection in the browser (Header work ipfs-inactive/js-ipfs-http-client#128)
• feat: Add diag/sys command (feat: Add diag/sys command ipfs-inactive/js-ipfs-http-client#129)
• feat: Add log/tail back for 0.3.9 (feat: Fix log/tail for 0.3.9 ipfs-inactive/js-ipfs-http-client#130)
• test: Split tests into seperate files (Refactor tests into separate files ipfs-inactive/js-ipfs-http-client#134)
• refactor: Split api definition into seperate files (refactor: Split api definitions into separate files ipfs-inactive/js-ipfs-http-client#136)
• chore: Add gulp release task (chore: Add gulp release task ipfs-inactive/js-ipfs-http-client#137)
• docs: Explore jsdoc@3 ([WIP] jsdoc3 for docs ipfs-inactive/js-ipfs-http-client#132)

go-ipfs

• [~] Fix default cors allow-access-headers (Add correct access control headers to the default api config kubo#1979)

diasdavid/registry-mirror

• feat: Add host and port options (feat: Add host and port options. ipfs-shipyard/npm-on-ipfs#6)

HTTP API Spec

• [~] Look into apiary.io (http://docs.ipfs.apiary.io/)

[RichardLitt]

Update:

Officially this week:

• [~] Stub out 5 different methods in HTTP API docs
• Sprint management
• Suggest community infrastructure for meetups
• Make the documentation around Commit Sign-Offs more friendly
• Solidify Discourse - Better community building community#69

Extra

• PR awesome-ipfs saying it is only for finished projects. PR: Added clarification about already built stuff awesome-ipfs#19.
• PR ipfs/community adding a note that this is only for meta non-code discussions. PR: Added note about meta-non-code discussions community#75.
• PR ipfs/apps and ipfs/archives explaining in the README what they are for. Right now, those are vague. PR: ipfs/apps@d2c522c. Issue: ipfs/archives/commit/cee8bb05dab4a56da1749c021aef56c427a0300f.
• Make a note on ipfs/ipfs saying that the ipfs/ipfs FAQ is closed, open new ones in ipfs/faq. PR: Added a mini-project directory and link to FAQ ipfs#124.
• Make a PR to IPFS/IPFS adding in ipfs.io/docs lists to good repos. PR: Added a mini-project directory and link to FAQ ipfs#124.
• Rewrite Discourse - Better community building community#69 and respond

[ghost]

@lgierth sprint update

• go-ipfs
  • fix gateway links with url rewrites gateway: add path prefix for directory listings kubo#1971 gateway: set X-Ipfs-Gateway-Prefix header infra#116
  • [~] RFCR X-Ipfs-Gateway-Prefix hardening gateway: harden path prefix kubo#1988
  • document refs-denylists-dmca data structure
  • fix seccat seccat: fix secio context kubo#1987
• infrastructure
  • [~] open up cors on gateways (allow origin *) gateway: open up CORS to everything (allow-origin *) infra#109
  • exclude dev0.4.0 hosts from pinbot CiteSeerX instance infra#123
  • .h.ipfs.io pointing to cjdns addresses
  • chat with gendale/alexandria
  • nodejs 4 and npm for daviddias
• cjdns
  • [~] blocked by nasty secio issue: discover peers from cjdns WIP: discover peers from cjdns kubo#1316
  • [~] invite to fc00 development (aka go-cjdns) https://github.com/fc00/spec
  • iptunnel setup with whyrusleeping
• hope
  • mfs api 500 responses
  • build a prometheus exporter using :5001
  • my todos for 0.4.0 migration

[jbenet]

@jbenet

• QCon SF talk
  • talked with cmeik
• CR
  • ipfs-update -- still on it
  • @rht's PRs -- still on it
• spec work
  • repo spec PR
  • update ipld spec PR addressing CR
  • update overviews spec PR
• sync with @kyledrake re permance + confs
• hacking archiving stuff with mek
  • beginning of open journal efforts
  • very productive discussion on POST
• various conversations
• org things
• made https://github.com/jbenet/http2ipfs-web

[jbenet]

hacking the time -- @diasdavid

https://www.youtube.com/watch?v=KEkrWRHCDQU

[dignifiedquire]

@jbenet glorious way to end this spring :D

[masylum]

@masylum

• - Started js-repo implementation and reviewed specs