[Gluster-users] Understand Geo Replication of a big Gluster

[Axel Gruber]

Hello

Im new on GlusterFS - so a warm hello to everyone here...

Im testing GlusterFS since some Weeks in different configurations for a big
Media Storage

Currently for start we plan a distributed / Replicated Gluster with for
Nodes (4x70Tb)
I tryed this within a Test Area on differenzt Virtual Machines - works fine.

But for security Reason we also plan Geo Replication of the Whole Gluster.
I have read Doc - but one thing i dont understand:

For example our Start Gluster has 4 Nodes (4x70TB Replicated and
Distributed) i have 140TB Capacity.

So when i want to Geo Replicate this Volume i dont have a sigle Server wich
is able to store 140GB (or later more) - but i can have several Backup
Servers with a total Sice of 140TB

So my Question

How can i say Gluster FS in Geo Replication to use all of this Backup
Servers to GEO REplicate the whole Storage using all Backup Server.

Best Regards

[Kotresh Hiremath Ravishankar]

Hi Axel,

You don't need single server with 140 TB capacity for replication. The
slave (backup) is also a gluster volume similar to master volume.
So create the slave (backup) gluster volume with 4 or more nodes to meet
the capacity of master and setup geo-rep between these two volumes.
Geo-replication is between two gluster volumes and not between gluster
volume and single node.


Thanks,
Kotresh HR

Post by Axel Gruber
Hello
Im new on GlusterFS - so a warm hello to everyone here...
Im testing GlusterFS since some Weeks in different configurations for a
big Media Storage
Currently for start we plan a distributed / Replicated Gluster with for
Nodes (4x70Tb)
I tryed this within a Test Area on differenzt Virtual Machines - works fine.
But for security Reason we also plan Geo Replication of the Whole Gluster.
For example our Start Gluster has 4 Nodes (4x70TB Replicated and
Distributed) i have 140TB Capacity.
So when i want to Geo Replicate this Volume i dont have a sigle Server
wich is able to store 140GB (or later more) - but i can have several Backup
Servers with a total Sice of 140TB
So my Question
How can i say Gluster FS in Geo Replication to use all of this Backup
Servers to GEO REplicate the whole Storage using all Backup Server.
Best Regards
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users

[Axel Gruber]

Hello (i dont know the right name - sorry)

Thanks for fast Reply !

Now i understand it - so i build a Gluster System on the other side with
enough Capacity then i arrange a Geo Replication between this 2 Gluster
Groups.

A other Question regarding this issue:

In documentation i allways see SSH to use for Connection between the both
Gluster Setups.

In my case its also possible to build a VPN between sides so can i also use
direct IP Connection trough a S2S Vpn ?

Best regards




<https://tawk.to/autohausgruber>
Kontaktieren Sie mich direkt per Live Chat - einfach hier Klicken:
----
Mit freundlichen GrÌßen
Autohaus A. Gruber OHG
Axel Gruber / GeschÀftsfÌhrer

Tel: [phone]
Fax: [phone]
E-Mail: ***@agm.de
Internet: www.autohaus-gruber.net

Ihr starker MAZDA und HYUNDAI Partner 4mal in der Region - einmal auch in
Ihrer NÀhe.

Autohaus A. Gruber OHG, Gewerbepark Kaserne 10, 83278 Traunstein.

HRA 8216 Amtsgericht Traunstein, Ust.-Id.-Nr. DE813812187

GeschÀftsfÌhrer: Axel Gruber, Anton Gruber

Steuernummer: 141/151/51801

Post by Kotresh Hiremath Ravishankar
Hi Axel,
You don't need single server with 140 TB capacity for replication. The
slave (backup) is also a gluster volume similar to master volume.
So create the slave (backup) gluster volume with 4 or more nodes to meet
the capacity of master and setup geo-rep between these two volumes.
Geo-replication is between two gluster volumes and not between gluster
volume and single node.
Thanks,
Kotresh HR

Post by Axel Gruber
Hello
Im new on GlusterFS - so a warm hello to everyone here...
Im testing GlusterFS since some Weeks in different configurations for a
big Media Storage
Currently for start we plan a distributed / Replicated Gluster with for
Nodes (4x70Tb)
I tryed this within a Test Area on differenzt Virtual Machines - works fine.
But for security Reason we also plan Geo Replication of the Whole
For example our Start Gluster has 4 Nodes (4x70TB Replicated and
Distributed) i have 140TB Capacity.
So when i want to Geo Replicate this Volume i dont have a sigle Server
wich is able to store 140GB (or later more) - but i can have several Backup
Servers with a total Sice of 140TB
So my Question
How can i say Gluster FS in Geo Replication to use all of this Backup
Servers to GEO REplicate the whole Storage using all Backup Server.
Best Regards
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users

--
Thanks and Regards,
Kotresh H R

[Milind Changire]

Hello Axel,
A warm welcome to you and happy to see you board the Gluster ship.

geo-replication requires two clusters: one master cluster which is the
source cluster and the second cluster called the slave cluster which is the
destination cluster

Just as you have created a primary/master cluster, you need to create
another cluster out of the backup servers in whatever configuration (volume
type) you want to create. The volume type of the slave cluster need not be
the same as the master cluster.

Once you've created the slave cluster, you can then use geo-replication
commands to create a communication channel between the two clusters so that
the sources from the master cluster are replicated to the slave cluster and
to keep pushing any updates to the slave cluster.

Hope this helps.

Post by Axel Gruber
Hello
Im new on GlusterFS - so a warm hello to everyone here...
Im testing GlusterFS since some Weeks in different configurations for a
big Media Storage
Currently for start we plan a distributed / Replicated Gluster with for
Nodes (4x70Tb)
I tryed this within a Test Area on differenzt Virtual Machines - works fine.
But for security Reason we also plan Geo Replication of the Whole Gluster.
For example our Start Gluster has 4 Nodes (4x70TB Replicated and
Distributed) i have 140TB Capacity.
So when i want to Geo Replicate this Volume i dont have a sigle Server
wich is able to store 140GB (or later more) - but i can have several Backup
Servers with a total Sice of 140TB
So my Question
How can i say Gluster FS in Geo Replication to use all of this Backup
Servers to GEO REplicate the whole Storage using all Backup Server.
Best Regards
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users

[Axel Gruber]

Hello

First of all Thank you for Information

As First Try i want to setup Geo -Replication in a Test System with Virtual
Machines

So for the Test i have a distributed Gluster with 3 Nodes:

Status of volume: gpool
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick glusers1:/mnt/glust/gpool 49152 0 Y 568
Brick glusers2:/mnt/glust/gpool 49152 0 Y 574
Brick glusers3:/mnt/glust/gpool 49152 0 Y 665
NFS Server on localhost 2049 0 Y
1127
NFS Server on glusers2 2049 0 Y 926
NFS Server on glusers3 2049 0 Y 695

on The Slave Side i have created also a volume

Status of volume: geovol
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick glusergeo:/mnt/glust/geo 49152 0 Y 629

The Maser Side can "see" the Hostname and Ping the IP of the Slave
***@glusters1:~# ping glusergeo
PING glusergeo (172.20.230.86) 56(84) bytes of data.
64 bytes from glusergeo (172.20.230.86): icmp_seq=1 ttl=64 time=3.85 ms

So for Test i not want to use SSH and i Tryed:


***@glusters1:~# gluster volume geo-replication gpool glusergeo:/geovol
start
Invalid Url: glusergeo:/geovol

Is it not possible to user geoReplication without SSH ?

Best Regards


Am Do., 14. Juni 2018 um 16:27 Uhr schrieb Milind Changire <

Post by Milind Changire
Hello Axel,
A warm welcome to you and happy to see you board the Gluster ship.
geo-replication requires two clusters: one master cluster which is the
source cluster and the second cluster called the slave cluster which is the
destination cluster
Just as you have created a primary/master cluster, you need to create
another cluster out of the backup servers in whatever configuration (volume
type) you want to create. The volume type of the slave cluster need not be
the same as the master cluster.
Once you've created the slave cluster, you can then use geo-replication
commands to create a communication channel between the two clusters so that
the sources from the master cluster are replicated to the slave cluster and
to keep pushing any updates to the slave cluster.
Hope this helps.

Post by Axel Gruber
Hello
Im new on GlusterFS - so a warm hello to everyone here...
Im testing GlusterFS since some Weeks in different configurations for a
big Media Storage
Currently for start we plan a distributed / Replicated Gluster with for
Nodes (4x70Tb)
I tryed this within a Test Area on differenzt Virtual Machines - works fine.
But for security Reason we also plan Geo Replication of the Whole
For example our Start Gluster has 4 Nodes (4x70TB Replicated and
Distributed) i have 140TB Capacity.
So when i want to Geo Replicate this Volume i dont have a sigle Server
wich is able to store 140GB (or later more) - but i can have several Backup
Servers with a total Sice of 140TB
So my Question
How can i say Gluster FS in Geo Replication to use all of this Backup
Servers to GEO REplicate the whole Storage using all Backup Server.
Best Regards
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users

--
Milind

[Kotresh Hiremath Ravishankar]

Hi Axel,

No geo-replication can't be used without SSH. It's not configurable.
Geo-rep master nodes connect to slave and transfers data over ssh.

I assume you have created the geo-rep session before start.
In the command above, the syntax is incorrect. It should use "::" and not
":/"

gluster volume geo-replication gpool glusergeo::geovol start

Thanks,
Kotresh HR

Post by Axel Gruber
Hello
First of all Thank you for Information
As First Try i want to setup Geo -Replication in a Test System with
Virtual Machines
Status of volume: gpool
Gluster process TCP Port RDMA Port Online
Pid
------------------------------------------------------------
------------------
Brick glusers1:/mnt/glust/gpool 49152 0 Y
568
Brick glusers2:/mnt/glust/gpool 49152 0 Y
574
Brick glusers3:/mnt/glust/gpool 49152 0 Y
665
NFS Server on localhost 2049 0 Y
1127
NFS Server on glusers2 2049 0 Y
926
NFS Server on glusers3 2049 0 Y
695
on The Slave Side i have created also a volume
Status of volume: geovol
Gluster process TCP Port RDMA Port Online
Pid
------------------------------------------------------------
------------------
Brick glusergeo:/mnt/glust/geo 49152 0 Y
629
The Maser Side can "see" the Hostname and Ping the IP of the Slave
PING glusergeo (172.20.230.86) 56(84) bytes of data.
64 bytes from glusergeo (172.20.230.86): icmp_seq=1 ttl=64 time=3.85 ms
start
Invalid Url: glusergeo:/geovol
Is it not possible to user geoReplication without SSH ?
Best Regards
Am Do., 14. Juni 2018 um 16:27 Uhr schrieb Milind Changire <

Post by Milind Changire
Hello Axel,
A warm welcome to you and happy to see you board the Gluster ship.
geo-replication requires two clusters: one master cluster which is the
source cluster and the second cluster called the slave cluster which is the
destination cluster
Just as you have created a primary/master cluster, you need to create
another cluster out of the backup servers in whatever configuration (volume
type) you want to create. The volume type of the slave cluster need not be
the same as the master cluster.
Once you've created the slave cluster, you can then use geo-replication
commands to create a communication channel between the two clusters so that
the sources from the master cluster are replicated to the slave cluster and
to keep pushing any updates to the slave cluster.
Hope this helps.

Post by Axel Gruber
Hello
Im new on GlusterFS - so a warm hello to everyone here...
Im testing GlusterFS since some Weeks in different configurations for a
big Media Storage
Currently for start we plan a distributed / Replicated Gluster with for
Nodes (4x70Tb)
I tryed this within a Test Area on differenzt Virtual Machines - works fine.
But for security Reason we also plan Geo Replication of the Whole
For example our Start Gluster has 4 Nodes (4x70TB Replicated and
Distributed) i have 140TB Capacity.
So when i want to Geo Replicate this Volume i dont have a sigle Server
wich is able to store 140GB (or later more) - but i can have several Backup
Servers with a total Sice of 140TB
So my Question
How can i say Gluster FS in Geo Replication to use all of this Backup
Servers to GEO REplicate the whole Storage using all Backup Server.
Best Regards
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users

--
Milind

_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users

[Axel Gruber]

Hello Thanks for Information

I tryed to install Geo Replication again - setup SSH Key - prepared session
Broker and so on (shown in the Manual)

But i get this error:

***@glusters1:~# gluster volume geo-replication gpool geo.com::geovol
create force
Please check gsync config file. Unable to get statefile's name
geo-replication command failed

I use "force" command because Slave Gluster is to small - but its empty -
so whtiout Force i get:

***@glusters1:~# gluster volume geo-replication gpool geo.com::geovol
create
Total disk size of master is greater than disk size of slave.
Total available size of master is greater than available size of slave
geo-replication command failed

Can anyone help me to understand whats going wrong here ?





<https://tawk.to/autohausgruber>
Kontaktieren Sie mich direkt per Live Chat - einfach hier Klicken:
----
Mit freundlichen GrÌßen
Autohaus A. Gruber OHG
Axel Gruber / GeschÀftsfÌhrer

Tel: [phone]
Fax: [phone]
E-Mail: ***@agm.de
Internet: www.autohaus-gruber.net

Ihr starker MAZDA und HYUNDAI Partner 4mal in der Region - einmal auch in
Ihrer NÀhe.

Autohaus A. Gruber OHG, Gewerbepark Kaserne 10, 83278 Traunstein.

HRA 8216 Amtsgericht Traunstein, Ust.-Id.-Nr. DE813812187

GeschÀftsfÌhrer: Axel Gruber, Anton Gruber

Steuernummer: 141/151/51801


Am Fr., 15. Juni 2018 um 03:37 Uhr schrieb Kotresh Hiremath Ravishankar <

Post by Kotresh Hiremath Ravishankar
Hi Axel,
No geo-replication can't be used without SSH. It's not configurable.
Geo-rep master nodes connect to slave and transfers data over ssh.
I assume you have created the geo-rep session before start.
In the command above, the syntax is incorrect. It should use "::" and not
":/"
gluster volume geo-replication gpool glusergeo::geovol start
Thanks,
Kotresh HR

Post by Axel Gruber
Hello
First of all Thank you for Information
As First Try i want to setup Geo -Replication in a Test System with
Virtual Machines
Status of volume: gpool
Gluster process TCP Port RDMA Port Online
Pid
------------------------------------------------------------------------------
Brick glusers1:/mnt/glust/gpool 49152 0 Y
568
Brick glusers2:/mnt/glust/gpool 49152 0 Y
574
Brick glusers3:/mnt/glust/gpool 49152 0 Y
665
NFS Server on localhost 2049 0 Y
1127
NFS Server on glusers2 2049 0 Y
926
NFS Server on glusers3 2049 0 Y
695
on The Slave Side i have created also a volume
Status of volume: geovol
Gluster process TCP Port RDMA Port Online
Pid
------------------------------------------------------------------------------
Brick glusergeo:/mnt/glust/geo 49152 0 Y
629
The Maser Side can "see" the Hostname and Ping the IP of the Slave
PING glusergeo (172.20.230.86) 56(84) bytes of data.
64 bytes from glusergeo (172.20.230.86): icmp_seq=1 ttl=64 time=3.85 ms
start
Invalid Url: glusergeo:/geovol
Is it not possible to user geoReplication without SSH ?
Best Regards
Am Do., 14. Juni 2018 um 16:27 Uhr schrieb Milind Changire <

Post by Milind Changire
Hello Axel,
A warm welcome to you and happy to see you board the Gluster ship.
geo-replication requires two clusters: one master cluster which is the
source cluster and the second cluster called the slave cluster which is the
destination cluster
Just as you have created a primary/master cluster, you need to create
another cluster out of the backup servers in whatever configuration (volume
type) you want to create. The volume type of the slave cluster need not be
the same as the master cluster.
Once you've created the slave cluster, you can then use geo-replication
commands to create a communication channel between the two clusters so that
the sources from the master cluster are replicated to the slave cluster and
to keep pushing any updates to the slave cluster.
Hope this helps.

Post by Axel Gruber
Hello
Im new on GlusterFS - so a warm hello to everyone here...
Im testing GlusterFS since some Weeks in different configurations for a
big Media Storage
Currently for start we plan a distributed / Replicated Gluster with for
Nodes (4x70Tb)
I tryed this within a Test Area on differenzt Virtual Machines - works fine.
But for security Reason we also plan Geo Replication of the Whole
For example our Start Gluster has 4 Nodes (4x70TB Replicated and
Distributed) i have 140TB Capacity.
So when i want to Geo Replicate this Volume i dont have a sigle Server
wich is able to store 140GB (or later more) - but i can have several Backup
Servers with a total Sice of 140TB
So my Question
How can i say Gluster FS in Geo Replication to use all of this Backup
Servers to GEO REplicate the whole Storage using all Backup Server.
Best Regards
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users

--
Milind

_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users

--
Thanks and Regards,
Kotresh H R