Improve content map, memory cache and dependency resolution

TODO(bep) improve commit message. Hugo has always been a active user of in-memory caches, but before this commit we did nothing to control the memory usage. One failing example would be loading lots of big JSON data files and unmarshal them via `transform.Unmarshal`. This commit consolidates all these caches into one single LRU cache with an eviction strategy that also considers used vs. available memory. Hugo will try to limit its memory usage to 1/4 or total system memory, but this can be controlled with the `HUGO_MEMORYLIMIT` environment variable (a float value representing Gigabytes). A natural next step after this would be to use this cache for `.Content`. Fixes gohugoio#8307 Fixes gohugoio#8498 Fixes gohugoio#8927 Fixes gohugoio#9192 Fixes gohugoio#9189 Fixes gohugoio#7425 Fixes gohugoio#7437 Fixes gohugoio#7436 Fixes gohugoio#7882 Updates gohugoio#7544 Fixes gohugoio#9224
bep · Dec 8, 2021 · 1dc8ac1 · 1dc8ac1
1 parent 5e0947c
commit 1dc8ac1
Show file tree

Hide file tree

Showing 151 changed files with 7,124 additions and 5,549 deletions.
diff --git a/.vscode/settings.json b/.vscode/settings.json
@@ -0,0 +1,3 @@
+{
+    "autoHide.autoHidePanel": false
+}
diff --git a/bench.sh b/bench.sh
diff --git a/benchSite.sh b/benchSite.sh
diff --git a/benchbep.sh b/benchbep.sh
@@ -1 +1 @@
-gobench -package=./hugolib -bench="BenchmarkSiteNew/Deep_content_tree"
+gobench --package ./hugolib --bench "BenchmarkSiteNew/Regular_Deep" -base v0.89.4
diff --git a/bepdock.sh b/bepdock.sh
Original file line number	Diff line number	Diff line change
		@@ -1 +1 @@
		gobench -package=./hugolib -bench="BenchmarkSiteNew/Deep_content_tree"
		gobench --package ./hugolib --bench "BenchmarkSiteNew/Regular_Deep" -base v0.89.4