[feature request] TensorBoard weights histogram and tooling for debugging/prunning

[rhy-ama]

Hello, looking at the road map, it seems there are no items to expand on debugging NNs using CNTK. Few items on the wish list are histograms of weights, node activations as well as variance and other metrics useful for debugging NN. Does the team think the framework should expand in that direction - or at least link with other OSS initiatives for the tooling?

[cha-zhang]

It's certainly a good feature to have. Unfortunately the team is tight in resource for this iteration. Will anyone be interested in contributing?

[ghost]

I am currently working on it.

[arijit17]

I would really love this feature!

Currently, I would like to view how the weights (e.g. 1D weight vector learned by a 1D convolution layer) vary during training and extract the final weights.
Is there an way to do so with CNTK 2.3?

Note that my script looks like this.