Large Git repository size

[jamesmbaazam]

I just tried to clone this repository and noticed it is extremely large (1.78 GiB). Could you consider reducing the size?

Enumerating objects: 36546, done.
Counting objects: 100% (36546/36546), done.
Delta compression using up to 8 threads
Compressing objects: 100% (14063/14063), done.
Writing objects: 100% (36546/36546), done.
Total 36546 (delta 6517), reused 36546 (delta 6517), pack-reused 0
count: 0
size: 0 bytes
in-pack: 36546
packs: 1
+size-pack: 1.78 GiB
prune-packable: 0
garbage: 0
size-garbage: 0 bytes

[athowes]

Thanks @jamesmbaazam! I'll try to have a look now to see which are the large objects in the package. Let me know if you already know this.

[sbfnk]

This thread may be useful epiforecasts/EpiNow2#538

[athowes]

Right yes, I was getting confused because I was just looking for large files and wasn't sure what it would be (most of the largest ones below in my local version aren't commited):

(base) adamhowes@Adams-MBP-3 epidist % find . -type f -exec du -h {} + | sort -rh | head -n 30
1.8G	./.git/objects/pack/pack-c0eadcec05734dbd7fbeea35b55b28e4d80163cf.pack
106M	./vignettes/approx-inference_cache/html/unnamed-chunk-3_2985e7a1c33b14dbee6c6ec2e582dd29.rdb
 39M	./vignettes/epidist_cache/html/unnamed-chunk-10_5bc037bca68bb093cd52c5af19833258.rdb
 39M	./vignettes/approx-inference_cache/html/unnamed-chunk-2_d897e4863777c9f2f93bedcef6242c9f.rdb
 26M	./.Rproj.user/9EE3E129/ctx/ctx-11541/environment
4.1M	./.Rproj.user/9EE3E129/ctx/ctx-27423/environment
3.2M	./.Rproj.user/9EE3E129/ctx/ctx-27423/options
2.9M	./.git/objects/pack/pack-b817aae2005187439bb6ca20d19112f1e65bb811.pack
2.2M	./.git/objects/pack/pack-4612fe591aa5b4272815be1d44d4de620084dd3c.pack
1.8M	./.Rproj.user/9EE3E129/ctx/ctx-11541/options
1.3M	./doc/epidist.html
1.1M	./inst/gadm41_SLE_shp/gadm41_SLE_3.shp
964K	./.git/objects/pack/pack-c0eadcec05734dbd7fbeea35b55b28e4d80163cf.idx
780K	./inst/gadm41_SLE_shp/gadm41_SLE_2.shp
708K	./inst/gadm41_SLE_shp/gadm41_SLE_1.shp
684K	./inst/gadm41_SLE_shp/gadm41_SLE_0.shp
612K	./inst/README.html
496K	./data-raw/pnas.1518587113.sd02.xlsx
464K	./.git/objects/0b/d00b70191ce3449fb6e1cc9ace088f1dfc50c3
400K	./vignettes/approx-inference_cache/html/unnamed-chunk-5_f19631317140b7c91d2fad3fbc266f2b.rdb
396K	./vignettes/approx-inference_cache/html/unnamed-chunk-4_5ef2e049d3d4c08bf99ec1df29b55daa.rdb
384K	./docs/articles/epidist_files/bootstrap-3.3.5/css/bootstrap.css.map
328K	./docs/deps/bootstrap-5.3.1/bootstrap.bundle.min.js.map
316K	./.git/objects/53/6f70af7a33634640a582f839e43b6309e02d40
288K	./docs/deps/bootstrap-5.3.1/bootstrap.min.css
284K	./docs/deps/jquery-3.6.0/jquery-3.6.0.js
284K	./docs/articles/epidist_files/jquery-3.6.0/jquery-3.6.0.js
272K	./.Rproj.user/shared/notebooks/BFE9F241-epidist/1/s/cda40rp2ydjfw/000002.snapshot
260K	./vignettes/epidist_cache/html/unnamed-chunk-5_8603d489aac9e0331f40afed22f03136.rdb
208K	./vignettes/epidist_cache/html/unnamed-chunk-3_93116863c5d8a54d61bf388abb31230e.rdb

So the point is that the Git version contains all the histories too, which is ending up being large. Thanks for link @sbfnk, will read and try to implement.

Edit: after a skim it seems like doing this is relatively intricate. As there are not many people using the package currently, I wonder if doing this could be best timed to coincide with a 0.1.0 release. Otherwise, I think it may be that it would need to be done again at that point anyway (likely development will continue to add file histories). Let me know if people disagree about this and think it's a priority to do sooner.

[jamesmbaazam]

This thread may be useful epiforecasts/EpiNow2#538

Thanks, Seb. I was coming here to post this.

[seabbs]

(likely development will continue to add file histories).

It shouldn't add large files. We do want to close out hanging PRs before we do this (and in general).

Thanks for the input all. This is a legacy of pulling the package out of the analysis repo I think

[athowes]

Requires no PRs.