Discussion:
[Gluster-users] Vm migration between diff clusters
p***@email.cz
2017-01-18 23:11:12 UTC
Permalink
Hello,
how can I migrate VM between two different clusters with gluster FS ?
( 3.5 x 4.0 )
They have different ovirt mgmt.

regards
Paf1
Kevin Lemonnier
2017-01-18 23:16:44 UTC
Permalink
Post by p***@email.cz
They have different ovirt mgmt.
I don't use ovirt, but when I need to migrate
a VM between two versions I just mount the other
cluster using NFS instead of fuse / libgfapi.
Then I just use the live disk migration of KVM
--
Kevin Lemonnier
PGP Fingerprint : 89A5 2283 04A0 E6E9 0111
WK
2017-01-19 01:32:26 UTC
Permalink
Post by Kevin Lemonnier
I don't use ovirt, but when I need to migrate
a VM between two versions I just mount the other
cluster using NFS instead of fuse / libgfapi.
Then I just use the live disk migration of KVM
In a pinch you can use SSHFS for temp shared storage for a storage
migration, and avoid the NFS setup.

You just make sure the mount points are identical as well as defined as
a POOL and of course since you don't get any locking, you also make sure
only one thing occurs at a time.
but then you use "libvirt blockcopy".

-WK
Kevin Lemonnier
2017-01-19 09:02:10 UTC
Permalink
Post by WK
In a pinch you can use SSHFS for temp shared storage for a storage
migration, and avoid the NFS setup.
GlusterFS comes with an NFS export by default, so there really isn't any
setup to do that, jut a simple mount -t nfs. It's even simpler than sshfs,
and I'm pretty sure the VM will work a lot better during the live migration
using nfs than sshfs :)
--
Kevin Lemonnier
PGP Fingerprint : 89A5 2283 04A0 E6E9 0111
WK
2017-01-19 21:01:54 UTC
Permalink
Actually SSHFS works very well in a single user situation.

We have seen similar performance to NFS with it and of course it tunnels
through firewalls a lot more easily, so its been our go to when live
migrating among clusters, especially as we have a mix of shared storage
and direct storage depending upon the need of the devs who use the
various systems.

That being said, if NFS is already there, then yes, a simple mount is
easier than yum install fuse-ssh and then:


sshfs -o allow_other,compression=no $user@$remote_host:$remote_folder
$mnt_folder

<Grin>

I just checked and on our older Gluster boxes, still on 3.4.

NFS is turned off, perhaps deliberately by the tech who installed it.

On the newer versions, I was under the impression that NFS was
deprecated in favor of Ganesha?

Is that turned on by default?

-wk
Post by Kevin Lemonnier
Post by WK
In a pinch you can use SSHFS for temp shared storage for a storage
migration, and avoid the NFS setup.
GlusterFS comes with an NFS export by default, so there really isn't any
setup to do that, jut a simple mount -t nfs. It's even simpler than sshfs,
and I'm pretty sure the VM will work a lot better during the live migration
using nfs than sshfs :)
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users
Kevin Lemonnier
2017-01-19 22:30:50 UTC
Permalink
Post by WK
On the newer versions, I was under the impression that NFS was
deprecated in favor of Ganesha?
Ah yes, I saw that Ganesha was available for debian now, still
haven't had the time test that out. Looked interesting though
Post by WK
Is that turned on by default?
Don't know after that but I can tell you it is turned on
by default on 3.7 and 3.8, I've used it a bunch for migrating
across clusters quickly :)

I just drop everything on the wan port and accept everything
on the lan port, so I'm not really concerned by firewall anymore.
But that's very dependent on the setup ofcourse, and it did take
me months before realising anyone on the Internet could mess
with our datas by just mounting the volume from anywhere.

We've been insanely lucky no one has, I feel
the "gluster shouldn't be used on internet so we don't care" way
of choosing the defaults is very very dangerous, and
should probably be written in big fat red letter in the doc.
Maybe it is and I just missed it though, but I'm pretty sure
I'm not the only one.
--
Kevin Lemonnier
PGP Fingerprint : 89A5 2283 04A0 E6E9 0111
WK
2017-01-19 23:51:09 UTC
Permalink
Hah, we the opposite problem. We have a resident FireWall Nazi, who is
involved when boxes go online.

You practically have to have a court order to be able to open up a port
on any box/instance, no matter how restricted <grin>

"No port for you!"

-wk
Post by Kevin Lemonnier
Post by WK
On the newer versions, I was under the impression that NFS was
deprecated in favor of Ganesha?
Ah yes, I saw that Ganesha was available for debian now, still
haven't had the time test that out. Looked interesting though
Post by WK
Is that turned on by default?
Don't know after that but I can tell you it is turned on
by default on 3.7 and 3.8, I've used it a bunch for migrating
across clusters quickly :)
I just drop everything on the wan port and accept everything
on the lan port, so I'm not really concerned by firewall anymore.
But that's very dependent on the setup ofcourse, and it did take
me months before realising anyone on the Internet could mess
with our datas by just mounting the volume from anywhere.
We've been insanely lucky no one has, I feel
the "gluster shouldn't be used on internet so we don't care" way
of choosing the defaults is very very dangerous, and
should probably be written in big fat red letter in the doc.
Maybe it is and I just missed it though, but I'm pretty sure
I'm not the only one.
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users
Lindsay Mathieson
2017-01-18 23:34:24 UTC
Permalink
Post by p***@email.cz
how can I migrate VM between two different clusters with gluster FS
? ( 3.5 x 4.0 )
They have different ovirt mgmt.
You can't. You need a shared solution for the VM disk image and they
aren't shared between clusters, or volumes for that matter.


You can take the VM down and copy the image, but I imagine it would be
very slow.
--
Lindsay Mathieson
Lindsay Mathieson
2017-01-19 00:33:10 UTC
Permalink
Wouldn't know I'm afraid, I don't use oVirt. I suspect not though.

Really a question for the oVirt list.
hello Lindsay,
offline available, so If I'll copy Vm from gluster1 to gluster2, than oVirt
will find that VM automaticaly ??
regs.
how can I migrate VM between two different clusters with gluster FS ? (
3.5 x 4.0 )
They have different ovirt mgmt.
You can't. You need a shared solution for the VM disk image and they aren't
shared between clusters, or volumes for that matter.
You can take the VM down and copy the image, but I imagine it would be very
slow.
--
Lindsay Mathieson
--
Lindsay
Дмитрий Глушенок
2017-01-19 07:58:16 UTC
Permalink
Hello,

For offline migration you can use storage domain of type Export, shared between clusters. For online storage migration the source and destination storage have to be present in current cluster.

Regarding the different glusterfs versions - it must not be a problem because oVirt uses vm images as files on filesystem, without gfapi involvement.
Post by p***@email.cz
Hello,
how can I migrate VM between two different clusters with gluster FS ? ( 3.5 x 4.0 )
They have different ovirt mgmt.
regards
Paf1
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users
--
Dmitry Glushenok
Jet Infosystems
Loading...