电子商务网站建设与运营,商城网站项目案例,wordpress 页面加载,wap php网站源码写在前面 分享一个 k8s 集群流量查看器很轻量的一个工具#xff0c;监控方便博文内容涉及#xff1a; Kubeshark 简单介绍Windows、Linux 下载运行监控DemoKubeshark 特性功能介绍 理解不足小伙伴帮忙指正 对每个人而言#xff0c;真正的职责只有一个#xff1a;找到自我。…写在前面 分享一个 k8s 集群流量查看器很轻量的一个工具监控方便博文内容涉及 Kubeshark 简单介绍Windows、Linux 下载运行监控DemoKubeshark 特性功能介绍 理解不足小伙伴帮忙指正 对每个人而言真正的职责只有一个找到自我。然后在心中坚守其一生全心全意永不停息。所有其它的路都是不完整的是人的逃避方式是对大众理想的懦弱回归是随波逐流是对内心的恐惧 ——赫尔曼·黑塞《德米安》 简单介绍
Kubeshark 是 2021 年由 UP9 公司开源的一个 K8s API 流量查看器 Mizu 发展而来试图成为一款 K8s 全过程流量监控工具。 Kubeshark 也被叫做 kubernetes 的 API 流量查看器它提供对进出 Kubernetes 集群内的 pod 的所有 API 流量和负载的深度可见性和监控。类似于针对 Kubernetes 而重新发明的 TCPDump 和 Wireshark。
Kubeshark 是占用空间最小的分布式数据包捕获专门为在大规模生产集群上运行而构建。
Kubeshark 架构
Kubeshark 由四个不同的软件组成它们可以协同工作CLI、Hub 和 Worker、基于 PCAP 的分布式存储。 CLI(命令行界面) Kubeshark 客户端的二进制分布它是用 Go 语言编写的。它通过 K8s API 与集群通信以部署 Hub 和 Worker Pod。。用于启动关闭 Kubeshark.
Hub(枢纽) 它协调 worker 部署接收来自每个 worker 的嗅探和剖析并收集到一个中心位置。它还提供一个 Web 界面用于在浏览器上显示收集到的流量。
Work 作为 DaemonSet 部署到集群中以确保集群中的每个节点都被 Kubeshark 覆盖。
基于 PCAP 的分布式存储 : Kubeshark 使用基于 PCAP 的分布式存储其中每个工作线程将捕获的 TCP 流存储在节点的根文件系统中。Kubeshark 的配置包括默认设置为 200MB 的存储限制。可以通过 CLI 选项更改该限制。
下载安装 功能Demo介绍
windows 下载安装
通过下面的方式安装
PS C:\Users\山河已无恙 curl -o kubeshark.exe https://github.com/kubeshark/kubeshark/releases/download/38.5/kubeshark.exe运行时需要提前复制 集群的 kubeconfig 文件。只能通过命令行运行运行方式.\kubeshark.exe tap -A 监控所有命名空间的流量
PS C:\Users\山河已无恙 .\kubeshark.exe tap -A
2023-03-03T12:08:20-05:00 INF versionCheck.go:23 Checking for a newer version...
2023-03-03T12:08:20-05:00 INF tapRunner.go:45 Using Docker: registrydocker.io/kubeshark/ taglatest
2023-03-03T12:08:20-05:00 INF tapRunner.go:53 Kubeshark will store the traffic up to a limit (per node). Oldest TCP streams will be removed once the limit is reached. limit200MB
2023-03-03T12:08:20-05:00 INF common.go:69 Using kubeconfig: pathC:\\Users\\山河已无恙\\.kube\\config
2023-03-03T12:08:20-05:00 INF tapRunner.go:74 Targeting pods in: namespaces[]
2023-03-03T12:08:20-05:00 INF tapRunner.go:129 Targeted pod: cadvisor-5v7hl
2023-03-03T12:08:20-05:00 INF tapRunner.go:129 Targeted pod: cadvisor-7dnmk
2023-03-03T12:08:20-05:00 INF tapRunner.go:129 Targeted pod: cadvisor-7l4zf
2023-03-03T12:08:20-05:00 INF tapRunner.go:129 Targeted pod: cadvisor-dj6dm
2023-03-03T12:08:20-05:00 INF tapRunner.go:129 Targeted pod: cadvisor-sjpq8
2023-03-03T12:08:20-05:00 INF tapRunner.go:129 Targeted pod: alertmanager-release-name-kube-promethe-alertmanager-0
2023-03-03T12:08:20-05:00 INF tapRunner.go:129 Targeted pod: details-v1-5ffd6b64f7-wfbl2
...............................
确定所有 pod 启动成功 如果 pod 可以正常创建那么会直接打开监控页面。 如果启动失败 pod 没有创建成功或者监控页面没有正常打开提示 8899,8898 端口不通尝试使用kubeshark.exe clean 清理环境重新安装。也可以尝试通过 --storagelimit 5000MB 指定存储大小
PS C:\Users\山河已无恙 .\kubeshark.exe clean
2023-03-03T12:59:58-05:00 INF versionCheck.go:23 Checking for a newer version...
2023-03-03T12:59:58-05:00 INF common.go:69 Using kubeconfig: pathC:\\Users\\山河已无恙\\.kube\\config
2023-03-03T12:59:58-05:00 WRN cleanResources.go:16 Removing Kubeshark resources...
PS C:\Users\山河已无恙 .\kubeshark.exe tap -A --storagelimit 5000MB重新启动
PS C:\Users\山河已无恙 .\kubeshark.exe tap -A --storagelimit 5000MB
2023-03-03T12:30:36-05:00 INF versionCheck.go:23 Checking for a newer version...
2023-03-03T12:30:36-05:00 INF tapRunner.go:45 Using Docker: registrydocker.io/kubeshark/ taglatest
2023-03-03T12:30:36-05:00 INF tapRunner.go:53 Kubeshark will store the traffic up to a limit (per node). Oldest TCP streams will be removed once the limit is reached. limit5000MB
2023-03-03T12:30:36-05:00 INF common.go:69 Using kubeconfig: pathC:\\Users\\山河已无恙\\.kube\\config
2023-03-03T12:30:37-05:00 INF tapRunner.go:74 Targeting pods in: namespaces[]
2023-03-03T12:30:37-05:00 INF tapRunner.go:129 Targeted pod: cadvisor-5v7hl
。。。。。。。。。。
2023-03-03T12:31:21-05:00 INF proxy.go:29 Starting proxy... namespacekubeshark servicekubeshark-hub src-port8898
2023-03-03T12:31:21-05:00 INF workers.go:32 Creating the worker DaemonSet...
2023-03-03T12:31:21-05:00 INF workers.go:51 Successfully created the worker DaemonSet.
2023-03-03T12:31:23-05:00 INF tapRunner.go:402 Hub is available at: urlhttp://localhost:8898
2023-03-03T12:31:23-05:00 INF proxy.go:29 Starting proxy... namespacekubeshark servicekubeshark-front src-port8899
2023-03-03T12:31:23-05:00 INF tapRunner.go:418 Kubeshark is available at: urlhttp://localhost:8899多次测试发现启动不成功时一个偶然性的问题并且会经常发生有可能镜像拉取超时或者代理没有创建成功 ,本地端口无法访问。
特新介绍
通过监控页面可以看到流量协议请求路由 请求响应状态请求方式请求源/目标地址 IP,由那个 POD 发起。可以通过过滤器对 包进行过滤。 过滤表达式有专门的文档 Demo 过滤 HTTP 请求返回状态码为 404 的请求 可以看到 集群备份工具 velero 可能有问题查看对应的拓扑关系确认 顶部可以展示所有的 Pod 列表 选择对应的包可以查看详细信息 请求报文响应报文 可以查看报文的具体内容 不加包过滤默认情况下右上角的拓扑信息可以查看当前监控信息的整体视图 箭头的粗细表示流量数量。颜色表示不同的协议 Linux 下载安装
也可以在 Linux 下安装。需要注意一下几点
默认情况下 kubeshark 会自动创建部署节点的端口代理所以不需要修改 创建的 hub SVC 为 NodePort 或 LB如果当前环境没有桌面端需要添加 --set headlesstrue ,--proxy-host 0.0.0.0,限制其打开浏览器并且运行外部IP访问
下载运行的二进制文件
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$curl -s -Lo kubeshark https://github.com/kubeshark/kubeshark/releases/download/38.5/kubeshark_linux_amd64 chmod 755 kubeshark
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$ls
kubeshark_linux_amd64
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$移动文件修改名字是其可以直接执行
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$mv kubeshark_linux_amd64 /usr/local/bin/kubeshark
┌──[rootvms100.liruilongs.github.io]-[/usr/local/bin]
└─$chmod x kubesharkkubeshark clean 用于清空当前部署环境
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$kubeshark clean
2023-03-03T09:44:3208:00 INF versionCheck.go:23 Checking for a newer version...
2023-03-03T09:44:3208:00 INF common.go:69 Using kubeconfig: path/root/.kube/config
2023-03-03T09:44:3208:00 WRN cleanResources.go:16 Removing Kubeshark resources...运行 kubeshark 监控所有的命名空间
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$kubeshark tap -A --storagelimit 2000MB --proxy-host 0.0.0.0 --set headlesstrue
2023-03-04T01:53:4708:00 INF tapRunner.go:45 Using Docker: registrydocker.io/kubeshark/ taglatest
2023-03-04T01:53:4708:00 INF tapRunner.go:53 Kubeshark will store the traffic up to a limit (per node). Oldest TCP streams will be removed once the limit is reached. limit2000MB
2023-03-04T01:53:4708:00 INF versionCheck.go:23 Checking for a newer version...
。。。。。。。。。
2023-03-04T01:53:4808:00 INF tapRunner.go:240 Added: podkubeshark-front
2023-03-04T01:53:4808:00 INF tapRunner.go:160 Added: podkubeshark-hub
2023-03-04T01:54:2508:00 WRN watch.go:61 K8s watch channel closed, restarting watcher...
2023-03-04T01:54:2508:00 WRN watch.go:61 K8s watch channel closed, restarting watcher...
2023-03-04T01:54:2508:00 WRN watch.go:61 K8s watch channel closed, restarting watcher...
2023-03-04T01:54:3008:00 INF tapRunner.go:240 Added: podkubeshark-front
2023-03-04T01:54:3008:00 INF tapRunner.go:160 Added: podkubeshark-hub
2023-03-04T01:54:5808:00 INF proxy.go:29 Starting proxy... namespacekubeshark servicekubeshark-hubsrc-port8898
2023-03-04T01:54:5808:00 INF workers.go:32 Creating the worker DaemonSet...
2023-03-04T01:54:5908:00 INF workers.go:51 Successfully created the worker DaemonSet.
2023-03-04T01:55:0008:00 INF tapRunner.go:402 Hub is available at: urlhttp://localhost:8898
2023-03-04T01:55:0008:00 INF proxy.go:29 Starting proxy... namespacekubeshark servicekubeshark-front src-port8899
2023-03-04T01:55:0008:00 INF tapRunner.go:418 Kubeshark is available at: urlhttp://localhost:8899
2023-03-04T01:55:5608:00 WRN watch.go:61 K8s watch channel closed, restarting watcher...
2023-03-04T01:55:5608:00 WRN watch.go:61 K8s watch channel closed, restarting watcher...
2023-03-04T01:55:5608:00 WRN watch.go:61 K8s watch channel closed, restarting watcher...
2023-03-04T01:56:0108:00 INF tapRunner.go:240 Added: podkubeshark-front
2023-03-04T01:56:0108:00 INF tapRunner.go:160 Added: podkubeshark-hub
浏览器访问 拓扑信息查看 部署中遇到的问题
如果启动失败可以通过 kubeshark check命名检查 该命令用于检查部署pod代理是否成功
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$kubeshark check
2023-03-03T22:33:2208:00 INF checkRunner.go:21 Checking the Kubeshark resources...
2023-03-03T22:33:2208:00 INF versionCheck.go:23 Checking for a newer version...
2023-03-03T22:33:2208:00 INF kubernetesApi.go:11 Checking: procedurekubernetes-api
..........
2023-03-03T22:33:2208:00 INF kubernetesPermissions.go:89 Can create services
2023-03-03T22:33:2308:00 INF kubernetesPermissions.go:89 Can create daemonsets in api group apps
2023-03-03T22:33:2308:00 INF kubernetesPermissions.go:89 Can patch daemonsets in api group apps
2023-03-03T22:33:2308:00 INF kubernetesPermissions.go:89 Can list namespaces
..........
2023-03-03T22:33:2308:00 INF kubernetesResources.go:116 Resource exist. namekubeshark-cluster-role-binding typecluster role binding
2023-03-03T22:33:2308:00 INF kubernetesResources.go:116 Resource exist. namekubeshark-hub typeservice
2023-03-03T22:33:2308:00 INF kubernetesResources.go:64 Pod is running. namekubeshark-hub
2023-03-03T22:33:2308:00 INF kubernetesResources.go:92 All 8 pods are running. namekubeshark-worker
2023-03-03T22:33:2308:00 INF serverConnection.go:11 Checking: procedureserver-connectivity
2023-03-03T22:33:2308:00 INF serverConnection.go:33 Connecting: urlhttp://localhost:8898
2023-03-03T22:33:2608:00 ERR serverConnection.go:16 Couldnt connect to Hub using proxy! errorCouldnt reach the URL: http://localhost:8898 after 3 retries!
2023-03-03T22:33:2608:00 INF serverConnection.go:33 Connecting: urlhttp://localhost:8899
2023-03-03T22:33:2908:00 ERR serverConnection.go:23 Couldnt connect to Front using proxy! errorCouldnt reach the URL: http://localhost:8899 after 3 retries!
2023-03-03T22:33:2908:00 ERR checkRunner.go:50 There are issues in your Kubeshark resources! Run these commands: command1kubeshark clean command2kubeshark tap [POD REGEX]
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$如果代理创建不成功可以尝试下面的方式使用。
https://github.com/kubeshark/kubeshark/wiki/CHANGELOG
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$jobs
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$coproc kubectl port-forward -n kubeshark service/kubeshark-hub 8898:80;
[1] 125248
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$coproc kubectl port-forward -n kubeshark service/kubeshark-front 8899:80;
-bash: 警告:execute_coproc: coproc [125248:COPROC] still exists
[2] 125784
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$jobs
[1]- 运行中 coproc COPROC kubectl port-forward -n kubeshark service/kubeshark-hub 8898:80
[2] 运行中 coproc COPROC kubectl port-forward -n kubeshark service/kubeshark-front 8899:80 重新检查校验
┌──[rootvms100.liruilongs.github.io]-[~/ansible/Kubeshark]
└─$kubeshark check
2023-03-03T23:35:5008:00 INF checkRunner.go:21 Checking the Kubeshark resources...
2023-03-03T23:35:5008:00 INF kubernetesApi.go:11 Checking: procedurekubernetes-api
2023-03-03T23:35:5008:00 INF versionCheck.go:23 Checking for a newer version...
2023-03-03T23:35:5008:00 INF kubernetesApi.go:18 Initialization of the client is passed.
2023-03-03T23:35:5008:00 INF kubernetesApi.go:25 Querying the Kubernetes API is passed.
2023-03-03T23:35:5008:00 INF kubernetesVersion.go:13 Checking: procedurekubernetes-version
2023-03-03T23:35:5008:00 INF kubernetesVersion.go:20 Minimum required Kubernetes API version is passed. k8s-versionv1.25.1
2023-03-03T23:35:5008:00 INF kubernetesPermissions.go:16 Checking: procedurekubernetes-permissions
2023-03-03T23:35:5008:00 INF kubernetesPermissions.go:89 Can list pods
。。。。。。。
2023-03-03T23:35:5108:00 INF kubernetesResources.go:64 Pod is running. namekubeshark-hub
2023-03-03T23:35:5108:00 INF kubernetesResources.go:92 All 8 pods are running. namekubeshark-worker
2023-03-03T23:35:5108:00 INF serverConnection.go:11 Checking: procedureserver-connectivity
2023-03-03T23:35:5108:00 INF serverConnection.go:33 Connecting: urlhttp://localhost:8898
2023-03-03T23:35:5208:00 INF serverConnection.go:19 Connected successfully to Hub using proxy.
2023-03-03T23:35:5208:00 INF serverConnection.go:33 Connecting: urlhttp://localhost:8899
2023-03-03T23:35:5208:00 INF serverConnection.go:26 Connected successfully to Front using proxy.
2023-03-03T23:35:5208:00 INF checkRunner.go:45 All checks are passed.博文部分内容参考
© 文中涉及参考链接内容版权归原作者所有如有侵权请告知, 这是一个开源项目如果你认可它不要吝啬星星哦 https://github.com/kubeshark/kubeshark
https://medium.com/kernel-space/kubeshark-wireshark-for-kubernetes-4069a5f5aa3d
https://docs.kubeshark.co/en/config
https://github.com/kubeshark/kubeshark/wiki/CHANGELOG © 2018-2023 liruilongergmail.com, All rights reserved. 保持署名-非商用-相同方式共享(CC BY-NC-SA 4.0)
