WARNING: Version 0.90 of Elasticsearch has passed its EOL date.
This documentation is no longer being maintained and may be removed. If you are running this version, we strongly advise you to upgrade. For the latest information, see the current release documentation.
Hadoop Gateway
editHadoop Gateway
editThe hadoop gateway is deprecated and will be removed in a future version. Please use the local gateway instead.
The hadoop (HDFS) based gateway stores the cluster meta and indices data
in hadoop. Hadoop support is provided as a plugin and installing is
explained here or
downloading the hadoop plugin and placing it under the plugins
directory. Here is an example config to enable it:
gateway: type: hdfs hdfs: uri: hdfs://myhost:8022
Settings
editThe hadoop gateway requires two simple settings. The gateway.hdfs.uri
controls the URI to connect to the hadoop cluster, for example:
hdfs://myhost:8022
. The gateway.hdfs.path
controls the path under
which the gateway will store the data.
concurrent_streams
editThe gateway.hdfs.concurrent_streams
allow to throttle the number of
streams (per node) opened against the shared gateway performing the
snapshot operation. It defaults to 5
.