Discussion:
[Gluster-users] gluster 3.12 memory leak
Alex K
2018-08-03 11:26:37 UTC
Permalink
Hi all,

I am using gluster 3.12.9-1 on ovirt 4.1.9 and I have observed consistent
high memory use which at some point renders the hosts unresponsive. This
behavior is observed also while using 3.12.11-1 with ovirt 4.2.5. I did not
have this issue prior to upgrading gluster.

I have seen a relevant bug reporting memory leaks of gluster and it seems
that this is the case for my trouble. To temporarily resolve the high
memory issue, I put hosts in maintenance then activate them back again.
This indicates that the memory leak is caused from the gluster client.
Ovirt is using fuse mounts.

Is there any bug fx available for this?
This issue is hitting us hard with several production installations.

Thanx,
Alex
Nithya Balachandran
2018-08-03 12:13:34 UTC
Permalink
Hi,

What version of gluster were you using before you upgraded?

Regards,
Nithya
Post by Alex K
Hi all,
I am using gluster 3.12.9-1 on ovirt 4.1.9 and I have observed consistent
high memory use which at some point renders the hosts unresponsive. This
behavior is observed also while using 3.12.11-1 with ovirt 4.2.5. I did not
have this issue prior to upgrading gluster.
I have seen a relevant bug reporting memory leaks of gluster and it seems
that this is the case for my trouble. To temporarily resolve the high
memory issue, I put hosts in maintenance then activate them back again.
This indicates that the memory leak is caused from the gluster client.
Ovirt is using fuse mounts.
Is there any bug fx available for this?
This issue is hitting us hard with several production installations.
Thanx,
Alex
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users
Alex K
2018-08-03 12:43:08 UTC
Permalink
Hi,

I was using 3.8.12-1 up to 3.8.15-2. I did not have issue with these
versions.
I still have systems running with those with no such memory leaks.

Thanx,
Alex
Post by Nithya Balachandran
Hi,
What version of gluster were you using before you upgraded?
Regards,
Nithya
Post by Alex K
Hi all,
I am using gluster 3.12.9-1 on ovirt 4.1.9 and I have observed consistent
high memory use which at some point renders the hosts unresponsive. This
behavior is observed also while using 3.12.11-1 with ovirt 4.2.5. I did not
have this issue prior to upgrading gluster.
I have seen a relevant bug reporting memory leaks of gluster and it seems
that this is the case for my trouble. To temporarily resolve the high
memory issue, I put hosts in maintenance then activate them back again.
This indicates that the memory leak is caused from the gluster client.
Ovirt is using fuse mounts.
Is there any bug fx available for this?
This issue is hitting us hard with several production installations.
Thanx,
Alex
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users
Hari Gowtham
2018-08-03 13:58:24 UTC
Permalink
Hi,

It is a known issue.
This bug will give more insight on the memory leak.
https://bugzilla.redhat.com/show_bug.cgi?id=1593826
Hi,
I was using 3.8.12-1 up to 3.8.15-2. I did not have issue with these versions.
I still have systems running with those with no such memory leaks.
Thanx,
Alex
Post by Nithya Balachandran
Hi,
What version of gluster were you using before you upgraded?
Regards,
Nithya
Post by Alex K
Hi all,
I am using gluster 3.12.9-1 on ovirt 4.1.9 and I have observed consistent high memory use which at some point renders the hosts unresponsive. This behavior is observed also while using 3.12.11-1 with ovirt 4.2.5. I did not have this issue prior to upgrading gluster.
I have seen a relevant bug reporting memory leaks of gluster and it seems that this is the case for my trouble. To temporarily resolve the high memory issue, I put hosts in maintenance then activate them back again. This indicates that the memory leak is caused from the gluster client. Ovirt is using fuse mounts.
Is there any bug fx available for this?
This issue is hitting us hard with several production installations.
Thanx,
Alex
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users
--
Regards,
Hari Gowtham.
Alex K
2018-08-03 14:06:42 UTC
Permalink
Thank you Hari.
Hope we get a fix soon to put us out of our misery J

Alex
Post by Hari Gowtham
Hi,
It is a known issue.
This bug will give more insight on the memory leak.
https://bugzilla.redhat.com/show_bug.cgi?id=1593826
Post by Alex K
Hi,
I was using 3.8.12-1 up to 3.8.15-2. I did not have issue with these
versions.
Post by Alex K
I still have systems running with those with no such memory leaks.
Thanx,
Alex
Post by Nithya Balachandran
Hi,
What version of gluster were you using before you upgraded?
Regards,
Nithya
Post by Alex K
Hi all,
I am using gluster 3.12.9-1 on ovirt 4.1.9 and I have observed
consistent high memory use which at some point renders the hosts
unresponsive. This behavior is observed also while using 3.12.11-1 with
ovirt 4.2.5. I did not have this issue prior to upgrading gluster.
Post by Alex K
Post by Nithya Balachandran
Post by Alex K
I have seen a relevant bug reporting memory leaks of gluster and it
seems that this is the case for my trouble. To temporarily resolve the high
memory issue, I put hosts in maintenance then activate them back again.
This indicates that the memory leak is caused from the gluster client.
Ovirt is using fuse mounts.
Post by Alex K
Post by Nithya Balachandran
Post by Alex K
Is there any bug fx available for this?
This issue is hitting us hard with several production installations.
Thanx,
Alex
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users
--
Regards,
Hari Gowtham.
Hari Gowtham
2018-08-07 06:03:58 UTC
Permalink
Hi,

The reason for memory leak was found. The patch (
https://review.gluster.org/#/c/20437/ ) will fix the leak.
Should be made available with the next release. You can keep an eye on it.
For more info refer the above mentioned bug.

Regards,
Hari.
Post by Alex K
Thank you Hari.
Hope we get a fix soon to put us out of our misery J
Alex
Post by Hari Gowtham
Hi,
It is a known issue.
This bug will give more insight on the memory leak.
https://bugzilla.redhat.com/show_bug.cgi?id=1593826
Hi,
I was using 3.8.12-1 up to 3.8.15-2. I did not have issue with these versions.
I still have systems running with those with no such memory leaks.
Thanx,
Alex
Post by Nithya Balachandran
Hi,
What version of gluster were you using before you upgraded?
Regards,
Nithya
Post by Alex K
Hi all,
I am using gluster 3.12.9-1 on ovirt 4.1.9 and I have observed consistent high memory use which at some point renders the hosts unresponsive. This behavior is observed also while using 3.12.11-1 with ovirt 4.2.5. I did not have this issue prior to upgrading gluster.
I have seen a relevant bug reporting memory leaks of gluster and it seems that this is the case for my trouble. To temporarily resolve the high memory issue, I put hosts in maintenance then activate them back again. This indicates that the memory leak is caused from the gluster client. Ovirt is using fuse mounts.
Is there any bug fx available for this?
This issue is hitting us hard with several production installations.
Thanx,
Alex
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users
--
Regards,
Hari Gowtham.
--
Regards,
Hari Gowtham.
l***@ulrar.net
2018-08-07 06:45:09 UTC
Permalink
Hi,

Any chance that was what's leaking for the libgfapi users too ?
I assume the next release you mention will be 3.12.13, is that correct ?
Post by Hari Gowtham
Hi,
The reason for memory leak was found. The patch (
https://review.gluster.org/#/c/20437/ ) will fix the leak.
Should be made available with the next release. You can keep an eye on it.
For more info refer the above mentioned bug.
Regards,
Hari.
Post by Alex K
Thank you Hari.
Hope we get a fix soon to put us out of our misery J
Alex
Post by Hari Gowtham
Hi,
It is a known issue.
This bug will give more insight on the memory leak.
https://bugzilla.redhat.com/show_bug.cgi?id=1593826
Hi,
I was using 3.8.12-1 up to 3.8.15-2. I did not have issue with these versions.
I still have systems running with those with no such memory leaks.
Thanx,
Alex
Post by Nithya Balachandran
Hi,
What version of gluster were you using before you upgraded?
Regards,
Nithya
Post by Alex K
Hi all,
I am using gluster 3.12.9-1 on ovirt 4.1.9 and I have observed consistent high memory use which at some point renders the hosts unresponsive. This behavior is observed also while using 3.12.11-1 with ovirt 4.2.5. I did not have this issue prior to upgrading gluster.
I have seen a relevant bug reporting memory leaks of gluster and it seems that this is the case for my trouble. To temporarily resolve the high memory issue, I put hosts in maintenance then activate them back again. This indicates that the memory leak is caused from the gluster client. Ovirt is using fuse mounts.
Is there any bug fx available for this?
This issue is hitting us hard with several production installations.
Thanx,
Alex
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users
--
Regards,
Hari Gowtham.
--
Regards,
Hari Gowtham.
_______________________________________________
Gluster-users mailing list
https://lists.gluster.org/mailman/listinfo/gluster-users
--
PGP Fingerprint : 0x624E42C734DAC346
Jim Kinney
2018-08-13 18:24:34 UTC
Permalink
Did this get released yet? Fuse client mounting on a computational
cluster that writes a few thousand files a day on a slow day is causing
many oomkiller problems.
Post by Hari Gowtham
Hi,
The reason for memory leak was found. The patch (
https://review.gluster.org/#/c/20437/ ) will fix the leak.Should be
made available with the next release. You can keep an eye on it.For
more info refer the above mentioned bug.
Regards,Hari.On Fri, Aug 3, 2018 at 7:36 PM Alex K <
Thank you Hari.Hope we get a fix soon to put us out of our misery J
Alex
Hi,
It is a known issue.This bug will give more insight on the memory
leak.https://bugzilla.redhat.com/show_bug.cgi?id=1593826On Fri, Aug
Hi,
I was using 3.8.12-1 up to 3.8.15-2. I did not have issue with these
versions.I still have systems running with those with no such memory
leaks.
Thanx,Alex
On Fri, Aug 3, 2018 at 3:13 PM, Nithya Balachandran <
Hi,
What version of gluster were you using before you upgraded?
Regards,Nithya
Hi all,
I am using gluster 3.12.9-1 on ovirt 4.1.9 and I have observed
consistent high memory use which at some point renders the hosts
unresponsive. This behavior is observed also while using 3.12.11-1
with ovirt 4.2.5. I did not have this issue prior to upgrading
gluster.
I have seen a relevant bug reporting memory leaks of gluster and it
seems that this is the case for my trouble. To temporarily resolve
the high memory issue, I put hosts in maintenance then activate them
back again. This indicates that the memory leak is caused from the
gluster client. Ovirt is using fuse mounts.
Is there any bug fx available for this?This issue is hitting us hard
with several production installations.
Thanx,Alex
_______________________________________________Gluster-users mailing
https://lists.gluster.org/mailman/listinfo/gluster-users
_______________________________________________Gluster-users mailing
https://lists.gluster.org/mailman/listinfo/gluster-users
--Regards,Hari Gowtham.
--
James P. Kinney III

Every time you stop a school, you will have to build a jail. What you
gain at one end you lose at the other. It's like feeding a dog on his
own tail. It won't fatten the dog.
- Speech 11/23/1900 Mark Twain

http://heretothereideas.blogspot.com/
Loading...