网站导入,免费入口,wordpress设置不显示摘要,百度搜索入口官网文章目录 一、 Fastdfs 介绍二、部署 信息三、步骤tracker/storage 机器的 compose 内容storage 机器的 composetracker 与 storage 启动目录层级与配置文件测试测试集群扩容与缩减注意事项 一、 Fastdfs 介绍
FastDFS 是一款高性能的分布式文件系统#xff0c;特别适合用于存… 文章目录 一、 Fastdfs 介绍二、部署 信息三、步骤tracker/storage 机器的 compose 内容storage 机器的 composetracker 与 storage 启动目录层级与配置文件测试测试集群扩容与缩减注意事项 一、 Fastdfs 介绍
FastDFS 是一款高性能的分布式文件系统特别适合用于存储和管理大量的文件
二、部署 信息
使用 docker 部署 Fastdfs 集群
角色服务器 IP服务器系统服务器配置docker /docker-compose版本tracker/storage10.10.11.35麒麟 V10127G 96C18.09.0/v2.25.0tracker/storage10.10.11.56麒麟 V10254G 64C20.10.17/v2.5.0
默认 tracker 端口为 22122 storage 端口为 23000文件访问端口为 8080此文档使用镜像在 dockerhub 上有x86 与 arm 双架构均存在可以直接 pull
三、步骤
tracker/storage 机器的 compose 内容
由于此容器内部启动使用 sed所以根据内部命令来启动编辑环境变量以及域名解析多个 tracker 使用 \n 换行符实现
version: 3.8
services:tracker:container_name: trackerimage: ygqygq2/fastdfs-nginx:V6.12.1command: trackernetwork_mode: hostprivileged: truerestart: alwaysextra_hosts:- tracker1:10.10.11.56- tracker2:10.10.11.35environment:- TRACKER_SERVERtracker1:22122\ntracker_server tracker2:22122- GROUP_NAMEgroup111volumes:- ./data/tracker:/var/fdfs- /etc/localtime:/etc/localtimestorage:container_name: storageimage: ygqygq2/fastdfs-nginx:V6.12.1command: storagenetwork_mode: hostprivileged: truerestart: alwaysextra_hosts:- tracker1:10.10.11.56- tracker2:10.10.11.35environment:- TRACKER_SERVERtracker1:22122\ntracker_server tracker2:22122- GROUP_NAMEgroup111volumes:- ./data/storage:/var/fdfs/- /etc/localtime:/etc/localtimestorage 机器的 compose
version: 3.8
services:storage:container_name: storageimage: ygqygq2/fastdfs-nginx:V6.12.1command: storagenetwork_mode: hostprivileged: truerestart: alwaysextra_hosts:- tracker1:10.10.11.56- tracker2:10.10.11.35environment:- TRACKER_SERVERtracker1:22122\ntracker_server tracker2:22122- GROUP_NAMEgroup111volumes:- ./data/storage:/var/fdfs/- /etc/localtime:/etc/localtimetracker 与 storage 启动
# 在142上查看 storage 日志可以看到会输出其他节点连接成功的信息
docker logs -f storage
[2024-12-16 16:50:46] INFO - file: storage_func.c, line: 338, tracker_client_ip: 10.10.11.35, my_server_id_str: 10.10.11.35, g_server_id_in_filename: 587926026
[2024-12-16 16:50:46] INFO - file: tracker_client_thread.c, line: 315, successfully connect to tracker server 10.10.11.56:22122, as a tracker client, my ip is 10.10.11.35
[2024-12-16 16:50:46] INFO - file: tracker_client_thread.c, line: 2077, tracker server: #0. 10.10.11.35:22122, my_report_result: -1
[2024-12-16 16:50:46] INFO - file: tracker_client_thread.c, line: 315, successfully connect to tracker server 10.10.11.35:22122, as a tracker client, my ip is 10.10.11.35
[2024-12-16 16:50:47] INFO - file: tracker_client_thread.c, line: 2077, tracker server: #0. 10.10.11.35:22122, my_report_result: -1
[2024-12-16 16:51:16] INFO - file: tracker_client_thread.c, line: 1441, tracker server 10.10.11.56:22122, set tracker leader: 10.10.11.56:22122
[2024-12-16 16:51:16] INFO - file: tracker_client_thread.c, line: 790, my status: 6 (ONLINE) from tracker #0 ! my status: 0 (INIT) from leader tracker #1, set report_my_status to true
[2024-12-16 16:51:16] INFO - file: storage_sync_func.c, line: 126, successfully connect to storage server 10.10.11.56:23000
[2024-12-16 16:51:16] INFO - file: tracker_client_thread.c, line: 2484, tracker server: 10.10.11.35:22122, try to set storage status from 6 (ONLINE) to 7 (ACTIVE)
[2024-12-16 16:51:17] INFO - file: tracker_client_thread.c, line: 315, successfully connect to tracker server 10.10.11.35:22122, as a tracker client, my ip is 10.10.11.35
[2024-12-16 16:51:46] INFO - file: storage_sync_func.c, line: 126, successfully connect to storage server 10.10.11.56:23000# 在139查看tracker日志
[2024-12-16 16:50:45] INFO - FastDFS v6.12.1, base_path/var/fdfs, max_connections1024, connect_timeout5, network_timeout60, thread_stack_size256 KB, max_pkg_size256 KB, min_buff_size8 KB, max_buff_size256 KB, tcp_quick_ack1, log_levelINFO, run_by_group, run_by_user, error-log: {sync_log_buff_interval1, rotate_everyday1, rotate_time00:00, rotate_on_size0, compress_old0, compress_days_before1, keep_days0, delete_old_time01:30}, port22122, bind_addr, address_familyauto, accept_threads1, work_threads4, store_lookup2, store_group, store_server0, store_path0, reserved_storage_space1.00%, download_server0, allow_ip_count-1, check_active_interval120s, storage_ip_changed_auto_adjust1, storage_sync_file_max_delay86400s, storage_sync_file_max_time300s, use_trunk_file0, slot_min_size256, slot_max_size1024 KB, trunk_alloc_alignment_size256, trunk_file_size64 MB, trunk_create_file_advance0, trunk_create_file_time_base02:00, trunk_create_file_interval86400, trunk_create_file_space_threshold20 GB, trunk_init_check_occupying0, trunk_init_reload_from_binlog0, trunk_free_space_merge1, delete_unused_trunk_files0, trunk_compress_binlog_min_interval86400, trunk_compress_binlog_interval86400, trunk_compress_binlog_time_base03:00, trunk_binlog_max_backups7, use_storage_id0, id_type_in_filenameip, trust_storage_server_id1, storage_id/ip_count0 / 0, store_slave_file_use_link0, use_connection_pool0, g_connection_pool_max_idle_time3600s
[2024-12-16 16:50:46] ERROR - file: tracker_service.c, line: 686, client ip: 10.10.11.56, leader 10.10.11.56:22122 not exist
[2024-12-16 16:50:47] INFO - file: tracker_mem.c, line: 4393, sys files loaded from tracker server 10.10.11.56:22122
[2024-12-16 16:50:47] INFO - file: tracker_relationship.c, line: 356, the tracker leader is 10.10.11.56:22122
[2024-12-16 16:51:15] WARNING - file: tracker_mem.c, line: 4963, storage server: 10.10.11.56:23000, dest status: 2, my status: 1, should change my status!
[2024-12-16 16:51:15] WARNING - file: tracker_mem.c, line: 4963, storage server: 10.10.11.56:23000, dest status: 5, my status: 2, should change my status!
[2024-12-16 16:51:16] INFO - file: tracker_service.c, line: 1229, client ip: 10.10.11.35, do NOT change storage status, old status: 7 (ACTIVE), new status: 7 (ACTIVE)目录层级与配置文件
# 目录层级如下
data├── storage└── tracker├── data└── logs查看集群信息
# 查看当前集群信息任意节点的 storage 容器查看即可
docker exec -it storage fdfs_monitor /etc/fdfs/client.conf
# server_count 2 表示 tracker 有两个
server_count2, server_index0tracker server is 10.10.11.35:22122group count: 1Group 1:
group name group111
disk total space 400,088 MB
disk free space 15,674 MB
trunk free space 0 MB
storage server count 2
active server count 2
storage server port 23000
storage HTTP port 8080
store path count 1
subdir count per path 256
current write server index 0
current trunk file id 0
。。。。。。
Storage 1: # 表示第一个storage的信息id 10.10.11.35ip_addr 10.10.11.35 ACTIVE
。。。。。。
Storage 2: # 第二个storage的信息id 10.10.11.56ip_addr 10.10.11.56 ACTIVE
测试
# 通过访问tracker接口上传但有可能会报错文件过大
curl -F file./test.txt http://10.10.11.140:22122/upload# 通过容器内部命令上传
docker exec -it storage bash
cd
echo 11111 test.txt
fdfs_test /etc/fdfs/client.conf upload test.txtThis is FastDFS client test program v6.12.1Copyright (C) 2008, Happy Fish / YuQingFastDFS may be copied only under the terms of the GNU General
Public License V3, which may be found in the FastDFS source kit.
Please visit the FastDFS Home Page http://www.fastken.com/
for more detail.tracker_query_storage_store_list_without_group: server 1. group_name, ip_addr10.10.11.35, port23000server 2. group_name, ip_addr10.10.11.56, port23000group_namegroup111, ip_addr10.10.11.56, port23000
storage_upload_by_filename
group_namegroup111, remote_filenameM00/00/00/CgoLOGdf6m6AeFMrAAAABqkTGlI497.txt
source ip address: 10.10.11.56
file timestamp2024-12-16 16:53:02
file size6
file crc322836601426
example file url: http://10.10.11.56/group111/M00/00/00/CgoLOGdf6m6AeFMrAAAABqkTGlI497.txt
storage_upload_slave_by_filename
group_namegroup111, remote_filenameM00/00/00/CgoLOGdf6m6AeFMrAAAABqkTGlI497_big.txt
source ip address: 10.10.11.56
file timestamp2024-12-16 16:53:02
file size6
file crc322836601426
example file url: http://10.10.11.56/group111/M00/00/00/CgoLOGdf6m6AeFMrAAAABqkTGlI497_big.txt
rootlocalhost:~# curl http://10.10.11.56:8080/group111/M00/00/00/CgoLOGdf6m6AeFMrAAAABqkTGlI497_big.txt
11111
rootlocalhost:~# curl http://10.10.11.35:8080/group111/M00/00/00/CgoLOGdf6m6AeFMrAAAABqkTGlI497_big.txt
11111访问地址 http://10.10.11.35:8080/group111/M00/00/00/CgoLOGdf6m6AeFMrAAAABqkTGlI497_big.txt fastdfs 集群直接的 storage 会自动同步数据更换 ip 再次访问也可以成功访问 测试集群扩容与缩减
扩容目前有两种方法扩容容量需要增加硬盘挂载分区扩容节点需要增加新的 group修改新节点的配置后就可以加入集群原有集群有数据后是无法直接增加节点的除了上面增加 group 的方法就只能清除数据重新部署节点所以推荐在部署集群之前最好先确认架构防止后续因为架构调整带来的不必要的麻烦缩减由于集群会自动同步数据要缩减直接直接关闭storage、修改nginx代理即可
nginx 负载配置示例配置
upstream storage {server 10.10.11.56:23000;server 10.10.11.35:23000;
}upstream storage_file {server 10.10.11.56:8080;server 10.10.11.35:8080;
}
upstream tracker {server 10.10.11.56:22122;server 10.10.11.35:22122;
}server {listen 23001 ;server_name _;location / {proxy_set_header Host $http_host;proxy_set_header X-Real-IP $remote_addr;proxy_set_header X-Forwarded-Proto $scheme;proxy_set_header X-Forwarded-Host $http_host;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;proxy_pass http://storage;}
}server {listen 8889;server_name _;location / {proxy_set_header Host $http_host;proxy_set_header X-Real-IP $remote_addr;proxy_set_header X-Forwarded-Proto $scheme;proxy_set_header X-Forwarded-Host $http_host;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;proxy_pass http://storage_file;}
}server {listen 22123;server_name _;location / {proxy_set_header Host $http_host;proxy_set_header X-Real-IP $remote_addr;proxy_set_header X-Forwarded-Proto $scheme;proxy_set_header X-Forwarded-Host $http_host;proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;proxy_pass http://tracker;}
}注意事项
fastdfs 默认保留的磁盘空间为 10%当至少有一个节点的磁盘存储小于或等于 10%时文件无法写入可以更改保留空间修改 tracker 容器中 /etc/fdfs/tracker.conf进入容器使用 echo “reserved_storage_space 1%” /etc/fdfs/tracker.conf 追加所有的 tracker 都需要更改然后单独重启 tracker清空原有数据即 data 下的所有内容重启 storage 即可如果遇到一直不同步的清空则删除 等待节点重新启动或删除全部 数据重新创建容器
