0.13.0 release #3257

max-sixty · 2019-08-23T21:04:21Z

What do we think about a minor release soon?

My colleague just hit #3145 which reminded me the current release can make filing an issue confusing for folks

We've had a v good pipeline of changes in just a month: https://github.com/pydata/xarray/blob/master/doc/whats-new.rst#L18

I'm happy to help with this; ref #2998 (comment)

shoyer · 2019-08-24T03:53:59Z

There are couple of small fixes for sparse arrays with open pull requests. I would lean toward getting those in before the release.

One thing that would be especially helpful is finalizing some deprecations that have been open for a while, e.g., the removal of the inplace argument and sel_points().

shoyer · 2019-08-24T03:54:57Z

Also it would be great if you’d like to try going through the release process. We can potentially automate and/or remove some of those steps.

max-sixty · 2019-08-27T07:16:35Z

What do you think about writing a small script and deploying with an azure pipeline, triggering only on new tags? Could include the standard running tests etc. I'd need to look into how authentication re PyPI would work if done remotely. Or is this begging the xkcd cartoon?

crusaderky · 2019-08-27T08:32:41Z

Given that's 1 hour of work about once a month... Unless there is appetite for increasing the release frequency, I would say automation is overkill

dcherian · 2019-08-27T14:48:25Z

 4. On the master branch, commit the release in git:
      git commit -a -m 'Release v0.X.Y'
 5. Tag the release:
      git tag -a v0.X.Y -m 'v0.X.Y'
 6. Build source and binary wheels for pypi:
      git clean -xdf  # this deletes all uncommited changes!
      python setup.py bdist_wheel sdist
 7. Use twine to register and upload the release on pypi. Be careful, you can't
    take this back!
      twine upload dist/xarray-0.X.Y*
    You will need to be listed as a package owner at
    https://pypi.python.org/pypi/xarray for this to work.
 8. Push your changes to master:
      git push upstream master
      git push upstream --tags
 9. Update the stable branch (used by ReadTheDocs) and switch back to master:
      git checkout stable
      git rebase master

This bit seems easily scriptable

max-sixty · 2019-08-27T16:24:18Z

Yeah, automation is probably overkill if someone does it correctly each time – it does also mean hopefully no one makes a mistake / forgets a step

shoyer · 2019-08-27T16:29:30Z

My experience has been that the manual processes (e.g., checking release notes, finishing up deprecation cycles) take up most of the effort of issuing a new release. The commands 4-9 take about 5 minutes to run. I agree that the main value of automation there would be reducing the likelihood of manual mistakes.

It looks like there's an experimental documentation builder for pull requests with read the docs. It would be interesting to explore using it in xarray: https://blog.readthedocs.com/building-docs-for-pull-requests/

max-sixty · 2019-08-27T16:54:19Z

It looks like there's an experimental documentation builder for pull requests with read the docs. It would be interesting to explore using it in xarray: https://blog.readthedocs.com/building-docs-for-pull-requests/

Perfect - I emailed. Anything else like this, feel free to push onto us / me

dopplershift · 2019-08-27T17:34:55Z

The benefit to automation also makes it easier to distribute the workload to other people, helping with project sustainability. On my projects, I find it very nice that I make a new release on GitHub and packages appear on PyPI and the web docs are automatically updated to the new version.

dcherian · 2019-08-27T17:55:47Z

I find it very nice that I make a new release on GitHub and packages appear on PyPI and the web docs are automatically updated to the new version.

How do you do this? i.e. trigger PyPI and RTD updates with a tag on github?

dopplershift · 2019-08-27T19:06:42Z

On Travis I have some deploy hooks:

Using Travis' built-in PyPI support, it uploads wheels and sdist, only on tags
Execute a custom script to commit built docs to github pages (not RTD). On master builds, this updates dev docs. On a tag, it adds a new directory for that version of the docs.

Travis Config
Doc Deploy Script

max-sixty · 2019-08-27T22:23:34Z

FYI: we're on the waitlist for the RTD feature

max-sixty · 2019-08-29T17:08:05Z

FYI re RTD PR feature, too many PRs! :)

We are sorry, we can't enable the pull requests builder feature for your project right now. This is because the long build time and many active PRs of your project. We have limited resources, we are working in making the builds faster. We let you know when we can enable the feature for your project.

fmaussion · 2019-08-30T10:07:59Z

RTD is struggling with resources, and I can understand that. What is really annoying (and the problem is often the same on travis) is that the conda install is taking a huge part of the build process resources. See e.g. readthedocs/readthedocs.org#6025 , where I ended up using pip for very satisfying results (!).

crusaderky · 2019-08-30T10:17:25Z

Can't we have a nightly build of docker images with all the xarray depencencies?
Then the individual CI jobs would literally become something like

FROM xarray-ci-py37
RUN pip install .

fmaussion · 2019-08-30T10:27:22Z

Can't we have a nightly build of docker images with all the xarray depencencies?

This would help on Travis yes, but not on RTD which doesn't support docker. But otherwise yes, I've also found that CI is faster and more reliable with docker. In terms of resources "in general", I wonder if it wouldn't be nice to share a common testing image base with other packages of the pydata ecosytem.

shoyer · 2019-09-04T17:00:21Z

I did some searching for "FutureWarning" and "DeprecationWarning", and turned up a bunch worth cleaning up for 0.13:
#3280

Otherwise I think we're ready do a release?

max-sixty · 2019-09-05T04:22:31Z

(FYI I am on vacation — can contribute next week)

dcherian · 2019-09-05T06:02:33Z

It would be nice to get #3239 in since it fixes a longstanding issue with open_mfdataset.

dcherian · 2019-09-07T19:53:45Z

We should also merge the scipy19-docs branch since that has some nice changes (ping @rabernat).

rabernat · 2019-09-10T20:49:30Z

We should also merge the scipy19-docs branch since that has some nice changes

Ideally there are a few things we should finish:

Add an example of ERA5 and GRIB data & visualization to the gallery #3199 - GRIB / ECMWF example for gallery
WIP: tutorial on merging datasets #3131 - My own tutorial on merging / combining datasets

I agree it would be nice to get these into a release. On the other hand, I feel like most doc users are just looking at the "latest" docs, so perhaps not as urgent as the other items on here.

dcherian · 2019-09-10T20:56:54Z

On the other hand, I feel like most doc users are just looking at the "latest" docs

I'm not so sure of this. The default is stable. and it isn't very obvious how to change it.

We can also merge that branch multiple times...

shoyer · 2019-09-10T21:15:54Z

Yes, we can merge/rebase changes into "stable" even after cutting a release.

…

On Tue, Sep 10, 2019 at 1:56 PM Deepak Cherian ***@***.***> wrote: On the other hand, I feel like most doc users are just looking at the "latest" docs I'm not so sure of this. The default is stable. and it isn't very obvious how to change it. We can also merge that branch multiple times... — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#3257?email_source=notifications&email_token=AAJJFVV7GENIIQAJJHZ73VDQJACZPA5CNFSM4IPDKA22YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD6MO3VI#issuecomment-530116053>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAJJFVTWYNFSRJMKFL3GOFDQJACZPANCNFSM4IPDKA2Q> .

max-sixty · 2019-09-17T14:41:10Z

Anything final remaining? A couple of nice-to-haves on #3280 but otherwise I think all done?

If so, I have some time this week to help—I can coordinate

dcherian · 2019-09-17T15:06:09Z

Yes we should release ASAP. #3313 and #3314 are the last two items on the checklist.

shoyer · 2019-09-17T16:09:48Z

OK, @max-sixty or @dcherian do one of you want to take the lead on issuing the release this time? Everything should be in the HOW_TO_RELEASE checklist, but I'm sure something will come up -- nonetheless, it's good to increase the bus factor!

dcherian · 2019-09-17T17:31:57Z

OK happy to do so.

You will need to be listed as a package owner at
https://pypi.python.org/pypi/xarray for this to work.

Do you want to add the rest of the core team as owners on pypi and RTD?

max-sixty · 2019-09-17T18:01:57Z

Great—happy to help @dcherian—thank you!

dcherian · 2019-09-17T19:39:13Z

OK I've done everything but

upload to PyPI
update RTD
announcement email

@max-sixty Can you take over emailing the users list?

Issue the release announcement! For bug fix releases, I usually only email
[email protected]. For major/feature releases, I will email a broader
list (no more than once every 3-6 months):
[email protected], [email protected],
[email protected], [email protected],
[email protected]
Google search will turn up examples of prior release announcements (look for
"ANN xarray").

dcherian · 2019-09-17T19:39:38Z

@shoyer instructions in HOW_TO_RELEASE worked perfectly :)

shoyer · 2019-09-17T20:17:35Z

@dcherian (and anyone else who's interested) could you please send me your pypi and RTD account names?

max-sixty · 2019-09-17T20:22:58Z

Yes, and our Twitter account! Ping back when it's on PyPI and I'll send out

max-sixty · 2019-09-17T20:25:52Z

@shoyer I'm at maximilianroos on PyPI but maybe we lock that down tighter than the GH privileges?

shoyer · 2019-09-17T20:34:50Z

Maintainers permissions enable: "Can upload releases for a package. Cannot add collaborators. Cannot delete files, releases, or the project."

I'm pretty happy passing that out to anyone interested :)

dcherian · 2019-09-17T20:36:28Z

Hahaha, I just signed up at PyPI as dcherian

EDIT: I'm dcherian on RTD also.

shoyer · 2019-09-17T21:08:54Z

@dcherian done! you should have permissions for both RTD and pypi now

dcherian · 2019-09-17T21:13:23Z

Thanks! Done with release on PyPI: https://pypi.org/project/xarray/0.13.0/

Time to announce!

max-sixty · 2019-09-17T21:59:01Z

@dcherian did you add a tag? I don't see that yet

dcherian · 2019-09-17T22:12:15Z

https://github.com/pydata/xarray/releases/tag/v0.13.0 ?

max-sixty · 2019-09-17T22:20:22Z

Great! My mistake

jhamman · 2019-09-17T23:36:46Z

I just merged conda-forge/xarray-feedstock#50, so the release should be available on conda-forge soon.

shoyer · 2019-09-18T02:00:56Z

Success! Thanks team!

…

On Tue, Sep 17, 2019 at 6:33 PM Maximilian Roos ***@***.***> wrote: Closed #3257 <#3257>. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#3257?email_source=notifications&email_token=AAJJFVQP33UC653KRZMYI3DQKGAQBA5CNFSM4IPDKA22YY3PNVWWK3TUL52HS4DFWZEXG43VMVCXMZLOORHG65DJMZUWGYLUNFXW5KTDN5WW2ZLOORPWSZGOTV327OA#event-2641866680>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AAJJFVRON7ZYBJGXQN2NQDLQKGAQBANCNFSM4IPDKA2Q> .

max-sixty · 2019-09-18T02:12:49Z

@pydata/xarray let me know any feedback on the email announcements

max-sixty mentioned this issue Aug 24, 2019

Remove sel_points #3261

Merged

2 tasks

max-sixty closed this as completed Sep 18, 2019

keewis mentioned this issue Dec 17, 2019

update readthedocs.yml #3639

Merged

1 task

0.13.0 release #3257

0.13.0 release #3257

Comments

max-sixty commented Aug 23, 2019

shoyer commented Aug 24, 2019

shoyer commented Aug 24, 2019

max-sixty commented Aug 27, 2019

crusaderky commented Aug 27, 2019

dcherian commented Aug 27, 2019

max-sixty commented Aug 27, 2019

shoyer commented Aug 27, 2019

max-sixty commented Aug 27, 2019

dopplershift commented Aug 27, 2019

dcherian commented Aug 27, 2019

dopplershift commented Aug 27, 2019

max-sixty commented Aug 27, 2019

max-sixty commented Aug 29, 2019

fmaussion commented Aug 30, 2019

crusaderky commented Aug 30, 2019

fmaussion commented Aug 30, 2019 • edited Loading

shoyer commented Sep 4, 2019

max-sixty commented Sep 5, 2019

dcherian commented Sep 5, 2019

dcherian commented Sep 7, 2019

rabernat commented Sep 10, 2019

dcherian commented Sep 10, 2019

shoyer commented Sep 10, 2019 via email

max-sixty commented Sep 17, 2019

dcherian commented Sep 17, 2019

shoyer commented Sep 17, 2019

dcherian commented Sep 17, 2019

max-sixty commented Sep 17, 2019

dcherian commented Sep 17, 2019 • edited Loading

dcherian commented Sep 17, 2019

shoyer commented Sep 17, 2019

max-sixty commented Sep 17, 2019

max-sixty commented Sep 17, 2019

shoyer commented Sep 17, 2019

dcherian commented Sep 17, 2019 • edited Loading

shoyer commented Sep 17, 2019

dcherian commented Sep 17, 2019

max-sixty commented Sep 17, 2019

dcherian commented Sep 17, 2019

max-sixty commented Sep 17, 2019

jhamman commented Sep 17, 2019

shoyer commented Sep 18, 2019 via email

max-sixty commented Sep 18, 2019

fmaussion commented Aug 30, 2019 •

edited

Loading

dcherian commented Sep 17, 2019 •

edited

Loading

dcherian commented Sep 17, 2019 •

edited

Loading