Amar Tumballi
2018-05-09 08:20:21 UTC
Hi,
On a debian 9 client,
========
8><---
ii glusterfs-client 3.8.8-1 amd64
clustered file-system (client package)
=======
I am trying to to do a mount to a Centos 7 gluster setup,
=======
glusterfs-4.0.2-1.el7.x86_64
=======
mount -t glusterfs glusterp1.graywitch.co.nz:/gv0/kvm01/images
/var/lib/libvirt/images
I see that you are trying 'subdir' mount. (as I see '/gv0' was able toOn a debian 9 client,
========
8><---
ii glusterfs-client 3.8.8-1 amd64
clustered file-system (client package)
=======
I am trying to to do a mount to a Centos 7 gluster setup,
=======
glusterfs-4.0.2-1.el7.x86_64
=======
mount -t glusterfs glusterp1.graywitch.co.nz:/gv0/kvm01/images
/var/lib/libvirt/images
mount fine).
If that is the case, please make sure to add a proper 'auth.allow' entry
for subdir.
something like 'gluster volume set gv0 auth.allow "/(*),/kvm01/images(*)"
But, while typing above, noticed that subdir mount is enabled by default
for every directory if none of the options are given. So, looking deeper, I
see below line in your client:
[2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main]
0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs* version 3.8.8*
(args: /usr
/sbin/glusterfs --volfile-server=glusterp1.graywitch.co.nz
--volfile-id=/gv0/kvm01/images/ /var/lib/libvirt/images)
and for that version, we didn't had that particular feature.
-Amar
the logs are telling me,
=========
libvirt-images.log
/gv0/kvm01/images/ /var/lib/libvirt/images
Mount failed. Please check the log file for more details.
libvirt-images.log
[2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main]
0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.8
(args: /usr
/sbin/glusterfs --volfile-server=glusterp1.graywitch.co.nz
--volfile-id=/gv0/kvm01/images/ /var/lib/libvirt/images)
[2018-05-08 03:33:48.996244] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker]
0-epoll: Started thread with index 1
[2018-05-08 03:33:48.998694] E [glusterfsd-mgmt.c:1590:mgmt_getspec_cbk]
0-glusterfs: failed to get the 'volume file' from server
[2018-05-08 03:33:48.998721] E [glusterfsd-mgmt.c:1690:mgmt_getspec_cbk]
0-mgmt: failed to fetch volume file (key:/gv0/kvm01/images/)
[2018-05-08 03:33:48.998891] W [glusterfsd.c:1327:cleanup_and_exit]
(-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)
[0x7f25cd69ba20]
-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x494) [0x558e7de496f4]
received signum (0), s
hutting down
Unmounting '/var/lib/libvirt/images'.
[2018-05-08 03:33:49.019805] W [glusterfsd.c:1327:cleanup_and_exit]
(-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x7494) [0x7f25cc72c494]
-->/usr/sbin/gluster
fs(glusterfs_sigwaiter+0xf5) [0x558e7de435e5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x54)
[0x558e7de43444] ) 0-: received signum (15), shutting down
==========
though,
mount -t glusterfs glusterp1.graywitch.co.nz:/gv0 /isos
works fine.
===========
Filesystem Size Used Avail Use% Mounted on
udev 7.8G 0 7.8G 0% /dev
tmpfs 1.6G 9.2M 1.6G 1% /run
/dev/mapper/kvm01--vg-root 23G 3.8G 18G 18% /
tmpfs 7.8G 0 7.8G 0% /dev/shm
tmpfs 5.0M 4.0K 5.0M 1% /run/lock
tmpfs 7.8G 0 7.8G 0% /sys/fs/cgroup
/dev/mapper/kvm01--vg-home 243G 61M 231G 1% /home
/dev/mapper/kvm01--vg-tmp 1.8G 5.6M 1.7G 1% /tmp
/dev/mapper/kvm01--vg-var 9.2G 302M 8.4G 4% /var
/dev/sda1 236M 63M 161M 28% /boot
tmpfs 1.6G 4.0K 1.6G 1% /run/user/115
tmpfs 1.6G 0 1.6G 0% /run/user/1000
glusterp1.graywitch.co.nz:/gv0 932G 247G 685G 27% /isos
also, I can mount the sub-directory fine on the gluster cluster itself,
=======
Filesystem Size Used Avail Use%
Mounted on
/dev/mapper/centos-root 20G 3.4G 17G 17% /
devtmpfs 3.8G 0 3.8G 0% /dev
tmpfs 3.8G 6.1M 3.8G 1%
/dev/shm
tmpfs 3.8G 9.0M 3.8G 1% /run
tmpfs 3.8G 0 3.8G 0%
/sys/fs/cgroup
/dev/sda1 969M 206M 713M 23% /boot
/dev/mapper/centos-tmp 3.9G 33M 3.9G 1% /tmp
/dev/mapper/centos-home 50G 4.3G 46G 9% /home
/dev/mapper/centos-var 20G 341M 20G 2% /var
/dev/mapper/centos-data1 120G 36M 120G 1% /data1
/dev/mapper/centos00-var_lib 9.4G 179M 9.2G 2%
/var/lib
/dev/mapper/vg--gluster--prod1-gluster--prod1 932G 233G 699G 25%
/bricks/brick1
tmpfs 771M 12K 771M 1%
/run/user/42
tmpfs 771M 32K 771M 1%
/run/user/1000
glusterp1:gv0/glusterp1/images 932G 247G 685G 27%
/var/lib/libvirt/images
glusterp1:gv0 932G 247G 685G 27% /isos
========
Is this a version mis-match thing? or what am I doing wrongly please?
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users
=========
libvirt-images.log
/gv0/kvm01/images/ /var/lib/libvirt/images
Mount failed. Please check the log file for more details.
libvirt-images.log
[2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main]
0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.8
(args: /usr
/sbin/glusterfs --volfile-server=glusterp1.graywitch.co.nz
--volfile-id=/gv0/kvm01/images/ /var/lib/libvirt/images)
[2018-05-08 03:33:48.996244] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker]
0-epoll: Started thread with index 1
[2018-05-08 03:33:48.998694] E [glusterfsd-mgmt.c:1590:mgmt_getspec_cbk]
0-glusterfs: failed to get the 'volume file' from server
[2018-05-08 03:33:48.998721] E [glusterfsd-mgmt.c:1690:mgmt_getspec_cbk]
0-mgmt: failed to fetch volume file (key:/gv0/kvm01/images/)
[2018-05-08 03:33:48.998891] W [glusterfsd.c:1327:cleanup_and_exit]
(-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_handle_reply+0x90)
[0x7f25cd69ba20]
-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x494) [0x558e7de496f4]
received signum (0), s
hutting down
Unmounting '/var/lib/libvirt/images'.
[2018-05-08 03:33:49.019805] W [glusterfsd.c:1327:cleanup_and_exit]
(-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x7494) [0x7f25cc72c494]
-->/usr/sbin/gluster
fs(glusterfs_sigwaiter+0xf5) [0x558e7de435e5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x54)
[0x558e7de43444] ) 0-: received signum (15), shutting down
==========
though,
mount -t glusterfs glusterp1.graywitch.co.nz:/gv0 /isos
works fine.
===========
Filesystem Size Used Avail Use% Mounted on
udev 7.8G 0 7.8G 0% /dev
tmpfs 1.6G 9.2M 1.6G 1% /run
/dev/mapper/kvm01--vg-root 23G 3.8G 18G 18% /
tmpfs 7.8G 0 7.8G 0% /dev/shm
tmpfs 5.0M 4.0K 5.0M 1% /run/lock
tmpfs 7.8G 0 7.8G 0% /sys/fs/cgroup
/dev/mapper/kvm01--vg-home 243G 61M 231G 1% /home
/dev/mapper/kvm01--vg-tmp 1.8G 5.6M 1.7G 1% /tmp
/dev/mapper/kvm01--vg-var 9.2G 302M 8.4G 4% /var
/dev/sda1 236M 63M 161M 28% /boot
tmpfs 1.6G 4.0K 1.6G 1% /run/user/115
tmpfs 1.6G 0 1.6G 0% /run/user/1000
glusterp1.graywitch.co.nz:/gv0 932G 247G 685G 27% /isos
also, I can mount the sub-directory fine on the gluster cluster itself,
=======
Filesystem Size Used Avail Use%
Mounted on
/dev/mapper/centos-root 20G 3.4G 17G 17% /
devtmpfs 3.8G 0 3.8G 0% /dev
tmpfs 3.8G 6.1M 3.8G 1%
/dev/shm
tmpfs 3.8G 9.0M 3.8G 1% /run
tmpfs 3.8G 0 3.8G 0%
/sys/fs/cgroup
/dev/sda1 969M 206M 713M 23% /boot
/dev/mapper/centos-tmp 3.9G 33M 3.9G 1% /tmp
/dev/mapper/centos-home 50G 4.3G 46G 9% /home
/dev/mapper/centos-var 20G 341M 20G 2% /var
/dev/mapper/centos-data1 120G 36M 120G 1% /data1
/dev/mapper/centos00-var_lib 9.4G 179M 9.2G 2%
/var/lib
/dev/mapper/vg--gluster--prod1-gluster--prod1 932G 233G 699G 25%
/bricks/brick1
tmpfs 771M 12K 771M 1%
/run/user/42
tmpfs 771M 32K 771M 1%
/run/user/1000
glusterp1:gv0/glusterp1/images 932G 247G 685G 27%
/var/lib/libvirt/images
glusterp1:gv0 932G 247G 685G 27% /isos
========
Is this a version mis-match thing? or what am I doing wrongly please?
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users
--
Amar Tumballi (amarts)
Amar Tumballi (amarts)