[Gluster-users] Volume Creation - Best Practices

[Mark Connor]

Wondering if there is a best practice for volume creation. I don't see this
information in the documentation. For example.
I have a 10 node distribute-replicate setup with one large xfs filesystem
mounted on each node.

Is it OK for me to have just one xfs filesystem mounted and use
subdirectories for my bricks for multiple volume creation?
So I could have, lets say 10 different volumes but each using a brick as
subdir on my single xfs filesystem on each node?
In other words multiple bricks on one xfs filesystem per node?
I create volumes on the fly and creating new filesystems for each node
would be too much work.

Your thoughts?

[Alex K]

Hi,

Post by Mark Connor
Wondering if there is a best practice for volume creation. I don't see
this information in the documentation. For example.
I have a 10 node distribute-replicate setup with one large xfs filesystem
mounted on each node.
Is it OK for me to have just one xfs filesystem mounted and use
subdirectories for my bricks for multiple volume creation?
So I could have, lets say 10 different volumes but each using a brick as
subdir on my single xfs filesystem on each node?
In other words multiple bricks on one xfs filesystem per node?

I usually cut different logical volumes for each brick.

I create volumes on the fly and creating new filesystems for each node

Post by Mark Connor
would be too much work.
Your thoughts?
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users

[Brian Andrus]

You can do that, but you could run into issues with the 'shared'
remaining space. Any one of the volumes could eat up the space you
planned on using in another volume. Not a huge issue, but could bite you.

I prefer to use ZFS for the flexibility. I create a RAIDZ pool and then
separate zfs filesystems within that for each brick. I can reserve a
specific amount of space in the pool for each brick and that can be
modified as well.

It is easy to grow it too. Plus, configured right, zfs does parallel
across all the disks, so you get speedup in performance.

Brian Andrus

Post by Mark Connor
Wondering if there is a best practice for volume creation. I don't see
this information in the documentation. For example.
I have a 10 node distribute-replicate setup with one large xfs
filesystem mounted on each node.
Is it OK for me to have just one xfs filesystem mounted and use
subdirectories for my bricks for multiple volume creation?
So I could have, lets say 10 different volumes but each using a
brick as subdir on my single xfs filesystem on each node?
In other words multiple bricks on one xfs filesystem per node?
I create volumes on the fly and creating new filesystems for each node
would be too much work.
Your thoughts?
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users

[Jim Kinney]

I use single disks as a physical volume. Each gluster host is identical. As more space is needed for a mount point, a set of disks is added to the logical volume of each host. As my primary need is HA, all of my host nodes are simply replicates.

Prior to this config I had a physical raid6 array of 100TB on each host. Lost 3 drives on the same array out of just bad luck. 2 drives died and while replacing them, the third failed. The subsequent rebuild took months

By splitting each mount point into separate physical drives, my plan is to lessen rebuild time. Rebuilding a failed 24TB chunk that had 3 drives fail should take less time than another 100+TB rebuild that slows everyone down. I also added a third host node to retain quorum in the event of a failure.

As these are mounts are for independent research groups, they can acquire additional storage by simply buying a triplet of drives. To mitigate drive batch failures, we buy from different vendors and 2 different brands of drives.

Post by Brian Andrus
You can do that, but you could run into issues with the 'shared'
remaining space. Any one of the volumes could eat up the space you
planned on using in another volume. Not a huge issue, but could bite you.
I prefer to use ZFS for the flexibility. I create a RAIDZ pool and then
separate zfs filesystems within that for each brick. I can reserve a
specific amount of space in the pool for each brick and that can be
modified as well.
It is easy to grow it too. Plus, configured right, zfs does parallel
across all the disks, so you get speedup in performance.
Brian Andrus

Post by Mark Connor
Wondering if there is a best practice for volume creation. I don't

see

Post by Mark Connor
this information in the documentation. For example.
I have a 10 node distribute-replicate setup with one large xfs
filesystem mounted on each node.
Is it OK for me to have just one xfs filesystem mounted and use
subdirectories for my bricks for multiple volume creation?
So I could have, lets say 10 different volumes but each using a
brick as subdir on my single xfs filesystem on each node?
In other words multiple bricks on one xfs filesystem per node?
I create volumes on the fly and creating new filesystems for each

node

Post by Mark Connor
would be too much work.
Your thoughts?
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users