Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Finalise the distribution of variables between streams (and output files) #13

Open
bnlawrence opened this issue Nov 4, 2022 · 1 comment

Comments

@bnlawrence
Copy link
Contributor

No description provided.

@bnlawrence bnlawrence added this to the Pre-Production-Data-Checks milestone Nov 4, 2022
@bnlawrence
Copy link
Contributor Author

Current distribution of streams gives (MB per file, per month):

u-cn134/19500101T0000Z/1d__19500101-19500110.nc: 938.0
u-cn134/19500101T0000Z/1d__19500111-19500120.nc: 939.3
u-cn134/19500101T0000Z/1d__19500121-19500130.nc: 940.9
u-cn134/19500101T0000Z/1d_pt__19500101-19500130.nc: 8.0
u-cn134/19500101T0000Z/1h_pt__19500101-19500110.nc: 567.7
u-cn134/19500101T0000Z/1h_pt__19500111-19500120.nc: 560.9
u-cn134/19500101T0000Z/1h_pt__19500121-19500130.nc: 560.8
u-cn134/19500101T0000Z/1m_0h__195001-195001.nc: 8.6
u-cn134/19500101T0000Z/1m_12h__195001-195001.nc: 8.6
u-cn134/19500101T0000Z/1m_15h__195001-195001.nc: 8.6
u-cn134/19500101T0000Z/1m_18h__195001-195001.nc: 10.0
u-cn134/19500101T0000Z/1m_21h__195001-195001.nc: 7.3
u-cn134/19500101T0000Z/1m_3h__195001-195001.nc: 8.6
u-cn134/19500101T0000Z/1m_6h__195001-195001.nc: 8.6
u-cn134/19500101T0000Z/1m_9h__195001-195001.nc: 8.6
u-cn134/19500101T0000Z/1m__195001-195001.nc: 3,411.5
u-cn134/19500101T0000Z/1m_pt__195001-195001.nc: 1.1
u-cn134/19500101T0000Z/3h__19500101-19500110.nc: 140.9
u-cn134/19500101T0000Z/3h__19500111-19500120.nc: 140.7
u-cn134/19500101T0000Z/3h__19500121-19500130.nc: 141.0
u-cn134/19500101T0000Z/3h_pt__19500101-19500110.nc: 180.8
u-cn134/19500101T0000Z/3h_pt__19500111-19500120.nc: 180.4
u-cn134/19500101T0000Z/3h_pt__19500121-19500130.nc: 180.7
u-cn134/19500101T0000Z/6h__19500101-19500130.nc: 381.4
u-cn134/19500101T0000Z/6h_pt__19500101-19500110.nc: 824.8
u-cn134/19500101T0000Z/6h_pt__19500111-19500120.nc: 823.9
u-cn134/19500101T0000Z/6h_pt__19500121-19500130.nc: 823.2
total: 11,815

which corresponds to (TB for 150x40x12 of these files):

u-cn134/19500101T0000Z/1d__19500101-19500110.nc: 67.5
u-cn134/19500101T0000Z/1d__19500111-19500120.nc: 67.6
u-cn134/19500101T0000Z/1d__19500121-19500130.nc: 67.7
u-cn134/19500101T0000Z/1d_pt__19500101-19500130.nc: 0.6
u-cn134/19500101T0000Z/1h_pt__19500101-19500110.nc: 40.9
u-cn134/19500101T0000Z/1h_pt__19500111-19500120.nc: 40.4
u-cn134/19500101T0000Z/1h_pt__19500121-19500130.nc: 40.4
u-cn134/19500101T0000Z/1m_0h__195001-195001.nc: 0.6
u-cn134/19500101T0000Z/1m_12h__195001-195001.nc: 0.6
u-cn134/19500101T0000Z/1m_15h__195001-195001.nc: 0.6
u-cn134/19500101T0000Z/1m_18h__195001-195001.nc: 0.7
u-cn134/19500101T0000Z/1m_21h__195001-195001.nc: 0.5
u-cn134/19500101T0000Z/1m_3h__195001-195001.nc: 0.6
u-cn134/19500101T0000Z/1m_6h__195001-195001.nc: 0.6
u-cn134/19500101T0000Z/1m_9h__195001-195001.nc: 0.6
u-cn134/19500101T0000Z/1m__195001-195001.nc: 245.6
u-cn134/19500101T0000Z/1m_pt__195001-195001.nc: 0.1
u-cn134/19500101T0000Z/3h__19500101-19500110.nc: 10.1
u-cn134/19500101T0000Z/3h__19500111-19500120.nc: 10.1
u-cn134/19500101T0000Z/3h__19500121-19500130.nc: 10.2
u-cn134/19500101T0000Z/3h_pt__19500101-19500110.nc: 13.0
u-cn134/19500101T0000Z/3h_pt__19500111-19500120.nc: 13.0
u-cn134/19500101T0000Z/3h_pt__19500121-19500130.nc: 13.0
u-cn134/19500101T0000Z/6h__19500101-19500130.nc: 27.5
u-cn134/19500101T0000Z/6h_pt__19500101-19500110.nc: 59.4
u-cn134/19500101T0000Z/6h_pt__19500111-19500120.nc: 59.3
u-cn134/19500101T0000Z/6h_pt__19500121-19500130.nc: 59.3
total: 851

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant