-
Notifications
You must be signed in to change notification settings - Fork 14.5k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Create nodelocaldns.md to describe NodeLocal DNSCache feature. (#14625)
* Create nodelocaldns.md This contains info about NodeLocal DnsCache feature. * Update nodelocaldns.md * Address review comments
- Loading branch information
1 parent
21d3206
commit b42f019
Showing
2 changed files
with
60 additions
and
0 deletions.
There are no files selected for viewing
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,60 @@ | ||
--- | ||
reviewers: | ||
- bowei | ||
- zihongz | ||
title: Using NodeLocal DNSCache in Kubernetes clusters | ||
content_template: templates/task | ||
--- | ||
|
||
{{% capture overview %}} | ||
This page provides an overview of NodeLocal DNSCache feature in Kubernetes. | ||
{{% /capture %}} | ||
|
||
{{% capture body %}} | ||
|
||
## Introduction | ||
|
||
NodeLocal DNSCache improves Cluster DNS performance by running a dns caching agent on cluster nodes as a Daemonset. In today's architecture, pods in ClusterFirst DNS mode reach out to a kube-dns serviceIP for DNS queries. This is translated to a kube-dns/CoreDNS endpoint via iptables rules added by kube-proxy. With this new architecture, pods will reach out to the dns caching agent running on the same node, thereby avoiding iptables DNAT rules and connection tracking. The local caching agent will query kube-dns service for cache misses of cluster hostnames(cluster.local suffix by default). | ||
|
||
|
||
## Motivation | ||
|
||
* With the current DNS architecture, it is possible that pods with the highest DNS QPS have to reach out to a different node, if there is no local kube-dns/CoreDNS instance. | ||
Having a local cache will help improve the latency in such scenarios. | ||
|
||
* Skipping iptables DNAT and connection tracking will help reduce [conntrack races](https://github.com/kubernetes/kubernetes/issues/56903) and avoid UDP DNS entries filling up conntrack table. | ||
|
||
* Connections from local caching agent to kube-dns servie can be upgraded to TCP. TCP conntrack entries will be removed on connection close in contrast with UDP entries that have to timeout ([default](https://www.kernel.org/doc/Documentation/networking/nf_conntrack-sysctl.txt) `nf_conntrack_udp_timeout` is 30 seconds) | ||
|
||
* Upgrading DNS queries from UDP to TCP would reduce tail latency attributed to dropped UDP packets and DNS timeouts usually up to 30s (3 retries + 10s timeout). Since the nodelocal cache listens for UDP DNS queries, applications don't need to be changed. | ||
|
||
* Metrics & visibility into dns requests at a node level. | ||
|
||
* Negative caching can be re-enabled, thereby reducing number of queries to kube-dns service. | ||
|
||
## Architecture Diagram | ||
|
||
This is the path followed by DNS Queries after NodeLocal DNSCache is enabled: | ||
|
||
![ ](nodelocaldns.jpg "NodeLocal DNSCache") | ||
|
||
## Configuration | ||
|
||
This feature can be enabled using the command: | ||
|
||
`KUBE_ENABLE_NODELOCAL_DNS=true go run hack/e2e.go -v --up` | ||
|
||
This works for e2e clusters created on GCE. On all other environments, the following steps will setup NodeLocal DNSCache: | ||
* A yaml similar to [this](https://github.com/kubernetes/kubernetes/blob/master/cluster/addons/dns/nodelocaldns/nodelocaldns.yaml) can be applied using `kubectl create -f` command. | ||
* --cluster-dns flag to kubelet needs to be modified to use the LOCAL_DNS IP that NodeLocal DNSCache is listening on (169.254.20.10 by default) | ||
|
||
Once enabled, node-local-dns pods will run in the kube-system namespace on each of the cluster nodes. This pod runs [CoreDNS](https://github.com/coredns/coredns) in cache mode, so all CoreDNS metrics exposed by the different plugins will be available on a per-node basis. | ||
|
||
### Feature availability | ||
|
||
The addon can be applied using the yaml specified above in any k8s version. The feature support is as described: | ||
|
||
| k8s version | Feature support | | ||
| :---------: |:-----------:| | ||
| 1.15 | Beta(Not enabled by default) | | ||
| 1.13 | Alpha(Not enabled by default) | |