Discussion:
[Gluster-users] glusterd2 problem
Dmitry Melekhov
2018-04-04 05:38:13 UTC
Permalink
Hello!

Installed packages from SIG on centos7 ,

at first start it works, but after restart- not:


 glusterd2 --config /etc/glusterd2/glusterd2.toml
DEBU[2018-04-04 09:28:16.945267] Starting
GlusterD                             pid=221581
source="[main.go:55:main.main]" version=v4.0.0-0
INFO[2018-04-04 09:28:16.945824] loaded configuration from
file                file=/etc/glusterd2/glusterd2.toml
source="[config.go:163:main.initConfig]"
DEBU[2018-04-04 09:28:16.946343] running with
configuration                    cert-file=
clientaddress="192.168.222.24:24007"
config=/etc/glusterd2/glusterd2.toml defaultpeerport=24008
etcdcurls="http://192.168.222.24:2379" etcdendpoints="[]"
etcdpurls="http://192.168.222.24:2380" key-file=
localstatedir=/var/lib/glusterd2 logdir=/var/log/glusterd2
logfile=glusterd2.log loglevel=debug noembed=false
peeraddress="192.168.222.24:24008" rundir=/usr/var/run/glusterd2
source="[config.go:129:main.dumpConfigToLog]" statedump=true
version=false workdir=/etc/glusterd2
DEBU[2018-04-04 09:28:17.067244] loading templates
source="[template.go:64:volgen.LoadTemplates]" templatesdir=
DEBU[2018-04-04 09:28:17.068207] generated default templates
source="[template.go:82:volgen.LoadTemplates]" templates="[brick.graph
distreplicate.graph fuse.graph distribute.graph replicate.graph
disperse.graph]"
DEBU[2018-04-04 09:28:17.068361] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=brick.graph
DEBU[2018-04-04 09:28:17.068450] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=distreplicate.graph
DEBU[2018-04-04 09:28:17.068539] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=fuse.graph
DEBU[2018-04-04 09:28:17.068621] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=distribute.graph
DEBU[2018-04-04 09:28:17.068798] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=replicate.graph
DEBU[2018-04-04 09:28:17.068878] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=disperse.graph
DEBU[2018-04-04 09:28:17.069316] saving updated store
config                   source="[config.go:166:store.GetConfig]"
DEBU[2018-04-04 09:28:17.069745] starting embedded
store                       cafile= certfile=
curls="http://192.168.222.24:2379" datadir=/var/lib/glusterd2/store
endpoints="http://192.168.222.24:2379" keyfile=
logdir=/var/log/glusterd2/store
name=10641b8a-7135-4694-9b90-955827c8eba9
purls="http://192.168.222.24:2380"
source="[embed.go:32:store.newEmbedStore]" trustedcafile=
2018-04-04 09:28:17.071331 I | etcdserver/api/v3rpc: grpc:
addrConn.resetTransport failed to create client transport: connection
error: desc = "transport: dial tcp 192.168.222.24:2379: getsockopt:
connection refused"; Reconnecting to {192.168.222.24:2379 <nil>}
2018-04-04 09:28:18.071206 I | etcdserver/api/v3rpc: grpc:
addrConn.resetTransport failed to create client transport: connection
error: desc = "transport: dial tcp 192.168.222.24:2379: getsockopt:
connection refused"; Reconnecting to {192.168.222.24:2379 <nil>}
2018-04-04 09:28:19.681081 I | etcdserver/api/v3rpc: grpc:
addrConn.resetTransport failed to create client transport: connection
error: desc = "transport: dial tcp 192.168.222.24:2379: getsockopt:
connection refused"; Reconnecting to {192.168.222.24:2379 <nil>}
2018-04-04 09:28:22.070811 I | etcdserver/api/v3rpc: Failed to dial
192.168.222.24:2379: context canceled; please retry.
ERRO[2018-04-04 09:28:22.070891] failed to start embedded
store                error="dial tcp 192.168.222.24:2379: getsockopt:
connection refused" source="[embed.go:36:store.newEmbedStore]"
FATA[2018-04-04 09:28:22.071038] Failed to initialize store (etcd
client)      error="dial tcp 192.168.222.24:2379: getsockopt: connection
refused" source="[main.go:89:main.main]"


cat glusterd2.toml
localstatedir = "/var/lib/glusterd2"
logdir = "/var/log/glusterd2"
logfile = "glusterd2.log"
rundir = "/usr/var/run/glusterd2"
peeraddress = "192.168.222.24:24008"
clientaddress = "192.168.222.24:24007"
etcdcurls = "http://192.168.222.24:2379"
etcdpurls = "http://192.168.222.24:2380"


Any ideas?


Thank you!
Prashanth Pai
2018-04-06 10:46:56 UTC
Permalink
Hi Dmitry,

How many nodes does the cluster have ?

If the quorum is lost (majority of nodes are down), additional recovery
steps are necessary to bring it back up:
https://github.com/gluster/glusterd2/wiki/Recovery
Post by Dmitry Melekhov
Hello!
Installed packages from SIG on centos7 ,
glusterd2 --config /etc/glusterd2/glusterd2.toml
DEBU[2018-04-04 09:28:16.945267] Starting GlusterD
pid=221581 source="[main.go:55:main.main]" version=v4.0.0-0
INFO[2018-04-04 09:28:16.945824] loaded configuration from
file file=/etc/glusterd2/glusterd2.toml
source="[config.go:163:main.initConfig]"
DEBU[2018-04-04 09:28:16.946343] running with
24007" config=/etc/glusterd2/glusterd2.toml defaultpeerport=24008
etcdcurls="http://192.168.222.24:2379" etcdendpoints="[]" etcdpurls="
http://192.168.222.24:2380" key-file= localstatedir=/var/lib/glusterd2
logdir=/var/log/glusterd2 logfile=glusterd2.log loglevel=debug
noembed=false peeraddress="192.168.222.24:24008"
rundir=/usr/var/run/glusterd2 source="[config.go:129:main.dumpConfigToLog]"
statedump=true version=false workdir=/etc/glusterd2
DEBU[2018-04-04 09:28:17.067244] loading templates
source="[template.go:64:volgen.LoadTemplates]" templatesdir=
DEBU[2018-04-04 09:28:17.068207] generated default templates
source="[template.go:82:volgen.LoadTemplates]" templates="[brick.graph
distreplicate.graph fuse.graph distribute.graph replicate.graph
disperse.graph]"
DEBU[2018-04-04 09:28:17.068361] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=brick.graph
DEBU[2018-04-04 09:28:17.068450] loaded template
source="[template.go:102:volgen.LoadTemplate]"
template=distreplicate.graph
DEBU[2018-04-04 09:28:17.068539] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=fuse.graph
DEBU[2018-04-04 09:28:17.068621] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=distribute.graph
DEBU[2018-04-04 09:28:17.068798] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=replicate.graph
DEBU[2018-04-04 09:28:17.068878] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=disperse.graph
DEBU[2018-04-04 09:28:17.069316] saving updated store
config source="[config.go:166:store.GetConfig]"
DEBU[2018-04-04 09:28:17.069745] starting embedded
store cafile= certfile= curls="
http://192.168.222.24:2379" datadir=/var/lib/glusterd2/store endpoints="
http://192.168.222.24:2379" keyfile= logdir=/var/log/glusterd2/store
name=10641b8a-7135-4694-9b90-955827c8eba9 purls="http://192.168.222.24:2
380" source="[embed.go:32:store.newEmbedStore]" trustedcafile=
addrConn.resetTransport failed to create client transport: connection
connection refused"; Reconnecting to {192.168.222.24:2379 <nil>}
addrConn.resetTransport failed to create client transport: connection
connection refused"; Reconnecting to {192.168.222.24:2379 <nil>}
addrConn.resetTransport failed to create client transport: connection
connection refused"; Reconnecting to {192.168.222.24:2379 <nil>}
2018-04-04 09:28:22.070811 I | etcdserver/api/v3rpc: Failed to dial
192.168.222.24:2379: context canceled; please retry.
ERRO[2018-04-04 09:28:22.070891] failed to start embedded
connection refused" source="[embed.go:36:store.newEmbedStore]"
FATA[2018-04-04 09:28:22.071038] Failed to initialize store (etcd
client) error="dial tcp 192.168.222.24:2379: getsockopt: connection
refused" source="[main.go:89:main.main]"
cat glusterd2.toml
localstatedir = "/var/lib/glusterd2"
logdir = "/var/log/glusterd2"
logfile = "glusterd2.log"
rundir = "/usr/var/run/glusterd2"
peeraddress = "192.168.222.24:24008"
clientaddress = "192.168.222.24:24007"
etcdcurls = "http://192.168.222.24:2379"
etcdpurls = "http://192.168.222.24:2380"
Any ideas?
Thank you!
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users
Dmitry Melekhov
2018-04-06 10:53:23 UTC
Permalink
Post by Prashanth Pai
Hi Dmitry,
How many nodes does the cluster have ?
If the quorum is lost (majority of nodes are down), additional
https://github.com/gluster/glusterd2/wiki/Recovery
Hello!

just 2 nodes and looks like we had both down.

We tried to create test cluster with 3 nodes, to learn how to use
glusterd2, but had this issue when we had only 2 nodes, i.e. after we
added second node.
just because we found that
gluster
cli uses localhost by default, but we configured glusterd2 to ethernet
interface address, this is another problem we hit, so we restarted both
nodes I guess :-)

Glusterd2 state looks as pre-alpha for me, so we'll wait for at least beta.

Thank you!
Post by Prashanth Pai
Hello!
Installed packages from SIG on centos7 ,
 glusterd2 --config /etc/glusterd2/glusterd2.toml
DEBU[2018-04-04 09:28:16.945267] Starting GlusterD       
pid=221581 source="[main.go:55:main.main]" version=v4.0.0-0
INFO[2018-04-04 09:28:16.945824] loaded configuration from
file                file=/etc/glusterd2/glusterd2.toml
source="[config.go:163:main.in <http://main.in>itConfig]"
DEBU[2018-04-04 09:28:16.946343] running with configuration   
cert-file= clientaddress="192.168.222.24:24007
<http://192.168.222.24:24007>"
config=/etc/glusterd2/glusterd2.toml defaultpeerport=24008
etcdcurls="http://192.168.222.24:2379
<http://192.168.222.24:2379>" etcdendpoints="[]"
etcdpurls="http://192.168.222.24:2380
<http://192.168.222.24:2380>" key-file=
localstatedir=/var/lib/glusterd2 logdir=/var/log/glusterd2
logfile=glusterd2.log loglevel=debug noembed=false
peeraddress="192.168.222.24:24008 <http://192.168.222.24:24008>"
rundir=/usr/var/run/glusterd2
source="[config.go:129:main.dumpConfigToLog]" statedump=true
version=false workdir=/etc/glusterd2
DEBU[2018-04-04 09:28:17.067244] loading templates
source="[template.go:64:volgen.LoadTemplates]" templatesdir=
DEBU[2018-04-04 09:28:17.068207] generated default templates
source="[template.go:82:volgen.LoadTemplates]"
templates="[brick.graph distreplicate.graph fuse.graph
distribute.graph replicate.graph disperse.graph]"
DEBU[2018-04-04 09:28:17.068361] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=brick.graph
DEBU[2018-04-04 09:28:17.068450] loaded template
source="[template.go:102:volgen.LoadTemplate]"
template=distreplicate.graph
DEBU[2018-04-04 09:28:17.068539] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=fuse.graph
DEBU[2018-04-04 09:28:17.068621] loaded template
source="[template.go:102:volgen.LoadTemplate]"
template=distribute.graph
DEBU[2018-04-04 09:28:17.068798] loaded template
source="[template.go:102:volgen.LoadTemplate]"
template=replicate.graph
DEBU[2018-04-04 09:28:17.068878] loaded template
source="[template.go:102:volgen.LoadTemplate]" template=disperse.graph
DEBU[2018-04-04 09:28:17.069316] saving updated store
config                   source="[config.go:166:store.GetConfig]"
DEBU[2018-04-04 09:28:17.069745] starting embedded
store                       cafile= certfile=
curls="http://192.168.222.24:2379 <http://192.168.222.24:2379>"
datadir=/var/lib/glusterd2/store
endpoints="http://192.168.222.24:2379
<http://192.168.222.24:2379>" keyfile=
logdir=/var/log/glusterd2/store
name=10641b8a-7135-4694-9b90-955827c8eba9
purls="http://192.168.222.24:2380 <http://192.168.222.24:2380>"
source="[embed.go:32:store.newEmbedStore]" trustedcafile=
connection error: desc = "transport: dial tcp 192.168.222.24:2379
<http://192.168.222.24:2379>: getsockopt: connection refused";
Reconnecting to {192.168.222.24:2379 <http://192.168.222.24:2379>
<nil>}
connection error: desc = "transport: dial tcp 192.168.222.24:2379
<http://192.168.222.24:2379>: getsockopt: connection refused";
Reconnecting to {192.168.222.24:2379 <http://192.168.222.24:2379>
<nil>}
connection error: desc = "transport: dial tcp 192.168.222.24:2379
<http://192.168.222.24:2379>: getsockopt: connection refused";
Reconnecting to {192.168.222.24:2379 <http://192.168.222.24:2379>
<nil>}
2018-04-04 09:28:22.070811 I | etcdserver/api/v3rpc: Failed to
dial 192.168.222.24:2379 <http://192.168.222.24:2379>: context
canceled; please retry.
ERRO[2018-04-04 09:28:22.070891] failed to start embedded
store                error="dial tcp 192.168.222.24:2379
<http://192.168.222.24:2379>: getsockopt: connection refused"
source="[embed.go:36:store.newEmbedStore]"
FATA[2018-04-04 09:28:22.071038] Failed to initialize store (etcd
client)      error="dial tcp 192.168.222.24:2379
<http://192.168.222.24:2379>: getsockopt: connection refused"
source="[main.go:89:main.main]"
cat glusterd2.toml
localstatedir = "/var/lib/glusterd2"
logdir = "/var/log/glusterd2"
logfile = "glusterd2.log"
rundir = "/usr/var/run/glusterd2"
peeraddress = "192.168.222.24:24008 <http://192.168.222.24:24008>"
clientaddress = "192.168.222.24:24007 <http://192.168.222.24:24007>"
etcdcurls = "http://192.168.222.24:2379"
etcdpurls = "http://192.168.222.24:2380"
Any ideas?
Thank you!
_______________________________________________
Gluster-users mailing list
http://lists.gluster.org/mailman/listinfo/gluster-users
<http://lists.gluster.org/mailman/listinfo/gluster-users>
Loading...