etcd, with Xiang Li

Kubernetes Podcast from Google

Episode | Podcast

Date: Tue, 17 Mar 2020 18:33:14 +0000

<p>If you’re running Kubernetes, you’re running etcd. The distributed key-value store was started as an intern project at <a href="https://coreos.com/">CoreOS</a> by <a href="https://twitter.com/xiangli0227">Xiang Li</a>, who is still maintaining it but now working on infrastructure at Alibaba. Xiang joins <a href="https://kubernetespodcast.com/about">your hosts</a> to discuss.</p> <p>Do you have something cool to share? Some questions? Let us know:</p> <ul> <li>web: <a href="https://kubernetespodcast.com">kubernetespodcast.com</a></li> <li>mail: <a href="mailto:kubernetespodcast@google.com">kubernetespodcast@google.com</a></li> <li>twitter: <a href="https://twitter.com/kubernetespod">@kubernetespod</a></li> </ul> <h3 id="chatter-of-the-week">Chatter of the week</h3> <ul> <li><a href="https://twitter.com/reybango/status/1238961313839222785">Getting toilet paper be like</a></li> <li><a href="https://www.theverge.com/platform/amp/2020/3/16/21181915/synth-apps-free-moog-korg-kaossilator-minimoog-model-d-coronavirus"> So, stay at home and play with free synth apps!</a> <ul> <li><a href="https://en.wikipedia.org/wiki/Korg_Kaossilator">Korg Kaossilator</a>: download for <a href="https://play.google.com/store/apps/details?id=jp.co.korg.kaossilator.android"> Android</a> or <a href="https://apps.apple.com/us/app/korg-ikaossilator/id452559831">iOS</a></li> <li><a href="https://en.wikipedia.org/wiki/Minimoog">MiniMoog Model D</a>: download for <a href="https://apps.apple.com/us/app/minimoog-model-d-synthesizer/id1339418001"> iOS</a></li> </ul> </li> <li><a href="https://www.youtube.com/channel/UCDuL7JTPSW1QryB8Ep4qepQ">iSongs</a> on YouTube</li> </ul> <h3 id="news-of-the-week">News of the week</h3> <ul> <li><a href="https://blogs.vmware.com/cloudnative/2020/03/10/become-a-modern-software-organization-with-vmware-tanzu/"> vSphere 7 and VMware Tanzu announcements</a></li> <li><a href="https://www.docker.com/blog/docker-strategy-helping-devs-build-and-ship-faster/"> Docker announces new strategy</a> and <a href="https://github.com/docker/roadmap/projects/1">roadmap</a></li> <li><a href="https://www.hitachivantara.com/blog/hitachi-vantara-makes-kubernetes-container-technology-acquisition/"> Hitachi Vantara acquires Containership’s assets</a> <ul> <li><a href="http://web.archive.org/web/20190921084614/https://blog.containership.io/shutdown/"> Containership’s since-removed “goodbye” post</a></li> </ul> </li> <li><a href="https://github.com/lensapp/lens">Lens</a>, now from Lakend Labs</li> <li><a href="https://github.com/cncf/toc/issues/335">KEDA</a> and <a href="https://github.com/cncf/toc/pull/336">SMI</a> join the <a href="https://www.cncf.io/sandbox-projects/">CNCF Sandbox</a></li> <li><a href="https://aws.amazon.com/blogs/aws/bottlerocket-open-source-os-for-container-hosting/"> AWS Bottlerocket blog post</a> and <a href="https://github.com/bottlerocket-os/bottlerocket">GitHub repo</a></li> <li><a href="https://aws.amazon.com/blogs/containers/enable-traffic-encryption-between-services-in-aws-app-mesh-using-aws-certificate-manager-or-customer-provided-certificates/"> Enable encryption on App Mesh with custom or ACM certs</a></li> <li><a href="https://aws.amazon.com/about-aws/whats-new/2020/03/amazon-eks-now-supports-kubernetes-version-1-15/"> EKS supports Kubernetes 1.15</a></li> <li><a href="https://twitter.com/micahhausler/status/1238496944684597248">Firecracker thread</a> by Micah Hausler</li> <li><a href="https://twitter.com/IanMLewis/status/1239349864342802433">gVisor thread</a> by Ian Lewis</li> <li><a href="https://kublr.com/blog/kubernetes-rolling-upgrades-zero-downtime-cloud-and-on-prem/"> Kublr adds rolling upgrades</a></li> <li><a href="https://security.googleblog.com/2020/03/how-google-does-certificate-lifecycle.html"> Google Cloud moves to its own ACME certificate provider</a></li> <li><a href="https://mobile.twitter.com/whyhiannabelle/status/1238530862494310400"> GKE Workload Identity is GA</a></li> <li><a href="https://medium.com/flant-com/redis-kubernetes-operator-and-data-analysis-tools-afce55b02123"> Analysis of Redis operators</a> by Flant</li> <li><a href="https://banzaicloud.com/blog/vault-hsm/">Bank Vaults 1.0 and HSM support</a> by Banzai Cloud</li> <li><a href="https://www.cncf.io/blog/2020/03/09/cncf-joins-google-summer-of-code-2020/"> CNCF joins Google Summer of Code</a></li> <li><a href="https://www.cncf.io/blog/2020/03/12/lifemiles-building-an-agile-loyalty-program-with-kubernetes/"> Lifemiles case study</a></li> <li><a href="https://rancher.com/press/rancher-labs-raises-series-d-fundraising-to-accelerate-growth-of-kubernetes-management-platform"> Rancher Labs raises $40m</a> <ul> <li><a href="https://kubernetespodcast.com/episode/057-rancher-labs/">Episode 57, with Darren Shepherd</a></li> </ul> </li> </ul> <h3 id="links-from-the-interview">Links from the interview</h3> <ul> <li><a href="https://etcd.io/">etcd</a> <ul> <li><a href="https://github.com/etcd-io/etcd">etcd on GitHub</a></li> </ul> </li> <li><a href="https://kubernetes.io/docs/concepts/overview/components/#etcd">How Kubernetes uses etcd</a></li> <li><a href="https://coreos.com/blog/history-etcd">The history of etcd</a>, including the famous garage</li> <li><a href="https://coreos.com/os/docs/latest/update-strategies.html">Built to handle upgrading CoreOS Container Linux nodes</a></li> <li>Prior art: <ul> <li><a href="https://zookeeper.apache.org/">Zookeeper</a>: too much JVM</li> <li><a href="https://github.com/ha/doozerd">Doozer</a>: not enough community</li> <li><a href="https://research.google/pubs/pub27897/">Chubby</a>: too private to Google</li> </ul> </li> <li><a href="https://en.wikipedia.org/wiki/Paxos_(computer_science)">Paxos</a> <ul> <li><a href="https://lamport.azurewebsites.net/pubs/lamport-paxos.pdf">The paper</a></li> <li><a href="https://research.google/pubs/pub33002/">Paxos Made Live - An Engineering Perspective</a></li> </ul> </li> <li><a href="https://en.wikipedia.org/wiki/Paxos_(computer_science)#Multi-Paxos"> Multi-Paxos</a></li> <li><a href="https://raft.github.io/">raft</a> <ul> <li><a href="https://raft.github.io/raft.pdf">The paper</a></li> </ul> </li> <li><a href="https://coreos.com/blog/distributed-configuration-with-etcd.html">Announcing etcd</a> <ul> <li><a href="https://twitter.com/benbjohnson">Ben</a> and <a href="https://twitter.com/bmizerany">Blake</a></li> </ul> </li> <li><a href="https://coreos.com/blog/etcd3-a-new-etcd.html">etcd3 moved from a tree keyspace to flat keyspace</a> <ul> <li><a href="https://kubernetes.io/blog/2019/08/30/announcing-etcd-3-4/">Latest version: etcd 3.4</a></li> </ul> </li> <li>etcd and Kubernetes at Alibaba: <ul> <li><a href="https://www.cncf.io/blog/2019/12/12/demystifying-kubernetes-as-a-service-how-does-alibaba-cloud-manage-10000s-of-kubernetes-clusters/"> Demystifying Kubernetes as a Service – How Alibaba Cloud Manages 10,000s of Kubernetes Clusters</a></li> <li><a href="https://www.cncf.io/blog/2019/05/09/performance-optimization-of-etcd-in-web-scale-data-scenario/"> Performance optimization of etcd in web scale data scenario</a></li> </ul> </li> <li><a href="https://coreos.com/blog/introducing-the-etcd-operator.html">The first etcd operator</a> created by Xiang</li> <li>Jepsen tests of <a href="https://aphyr.com/posts/316-jepsen-etcd-and-consul">0.4.1</a> and <a href="https://jepsen.io/analyses/etcd-3.4.3">3.4.3</a></li> <li><a href="https://www.cncf.io/blog/2018/12/11/cncf-to-host-etcd/">CNCF to host etcd</a> in December 2018</li> <li><a href="https://github.com/etcd-io/etcd/milestones">etcd roadmap</a></li> <li><a href="https://github.com/xiang90">Xiang Li on GitHub</a></li> <li><a href="https://twitter.com/xiangli0227">Xiang Li on Twitter</a></li> </ul>