Install and configure Elasticsearch

Elasticsearch overview

Using Elasticsearch as your catalog search solution provides the following benefits:

  • Quick and advanced searches on products in the catalog
  • Support for multiple languages
  • Support for stop words and synonyms
  • Indexing does not impact customers until reindex is completed

    Elasticsearch returns search results based on the last generated index until the new one has been completely indexed so there’s no disruption to customers.

  • Accurate, performant, and scalable
  • Works well out of the box
  • Easy to horizontally scale
  • Supports real-time data and analysis
  • Can be used as a document-oriented data store
  • Applications in framework beyond search, including reporting, personalization, performance, and storage

Supported versions

Magento Open Source 2.3.x supports the following Elasticsearch versions:

  • Elasticsearch 5.2
  • Elasticsearch 2.x

Recommended configuration

The following figure shows our recommended configuration. All of the tasks we discuss assume you’ve configured your system this way.

The preceding diagram shows:

  • The Magento application and Elasticsearch are installed on different hosts.

    Running on separate hosts is secure, enables Elasticsearch to be scaled, and is necessary for proxying to work. (Clustering Elasticsearch is beyond the scope of this guide but you can find more information in the Elasticsearch documentation.)

  • Each host has its own web server; the web servers don’t have to be the same.

    For example, the Magento application can run Apache and Elasticsearch can run nginx.

  • Both web servers use Transport Layer Security (TLS).

    Setting up TLS is beyond the scope of our documentation.

Search requests are processed as follows:

  1. A search request from a user is received by the Magento web server, which forwards it to the Elasticsearch server.

    You configure Elasticsearch in the Magento Admin to connect to the proxy’s host and port. We recommend the web server’s SSL port (by default, 443).

  2. The Elasticsearch web server (listening on port 443) proxies the request to the Elasticsearch server (by default, it listens on port 9200).
  3. Access to Elasticsearch is further protected by HTTP Basic authentication.

    For any request to reach Elasticsearch, it must travel over SSL and provide a valid username and password.

  4. Elasticsearch processes the search request.
  5. Communication returns along the same route, with the Elasticsearch web server acting as a secure reverse proxy.

Install prerequisites and Elasticsearch

The tasks discussed in this section require the following:

Firewall and SELinux

Please take into account that security-related software (iptables, SELinux, AppArmor etc.) may be configured by default to block communication between subsystems. It may be a good idea to check them in case of problems.

Set up rules for iptables and SELinux

To set up rules to allow communication with the firewall or SELinux enabled, consult the following resources:

Install the Java Software Development Kit (JDK)

To determine if Java is already installed, enter the following command:

java -version

If the message java: command not found displays, you must install the Java SDK as discussed in the next section.

See one of the following sections:

Install the JDK on CentOS

See this article on digitalocean.

Be sure to install the JDK and not the JRE.

yum -y install java-1.8.0-openjdk

Java version 8 might not be available for all operating systems. For example, you can search the list of available packages for Ubuntu.

Install the JDK on Ubuntu

To install JDK 1.8 on Ubuntu, enter the following commands as a user with root privileges:

add-apt-repository -y ppa:webupd8team/java
apt-get -y update
apt-get install -y oracle-java8-installer

For other options, see Oracle documentation.

Install Elasticsearch 5.2

This section discusses how to install Elasticsearch 5.2 from their repository. You can select a more recent version of 5.x, but 5.2 has been tested.

  1. Log in to your Magento server as a user with root privileges.
  2. CentOS: Enter the following commands in the order shown:

     sudo yum install java-1.8.0-openjdk
     curl -L -O
     sudo rpm -i elasticsearch-5.2.0.rpm
  3. Ubuntu: Install the Elasticsearch 5.2 version using the Elasticsearch documentation

  4. Optionally, configure Elasticsearch as needed. See Configuring Elasticsearch for more information.
  5. Start Elasticsearch:

     sudo service elasticsearch start
  6. Verify that Elasticsearch is working by entering the following command on the server on which it’s running:

     curl -XGET '<host>:9200/_cat/health?v&pretty'

    A message similar to the following is displayed:

     epoch      timestamp cluster       status shards pri relo init unassign pending_tasks
     1519701563 03:19:23  elasticsearch green           1         1      0   0    0    0        0             0

Install Elasticsearch 2.x

This section discusses how to install the latest 2.x version of Elasticsearch from their repository.

To install Elasticsearch:

  1. Log in to your Magento server as a user with root privileges.
  2. CentOS: Enter the following commands in the order shown:

    rpm --import
    vim /etc/yum.repos.d/Elasticsearch.repo

    Add the following:

        name=Elasticsearch repository for 2.x packages

    Enter the following commands:

    yum -y install elasticsearch
    chkconfig --add elasticsearch
  3. Ubuntu: Enter the following commands in the order shown:

    Find the latest 2.x version of Elasticsearch.

    Install the latest 2.x version using Elasticsearch documentation

    For example, to install Elasticsearch version 2.4.4, enter the following commands in the order shown:

    curl -L -O
    tar -xvf elasticsearch-2.4.4.tar.gz
    cd elasticsearch-2.4.4/bin
  4. Open the Elasticsearch configuration file, elasticsearch.yml, in a text editor.

    For example, it might be located in /etc/elasticsearch or <elasticsearch install dir>/config.

  5. Save your changes to elasticsearch.yml and exit the text editor.
  6. Optionally configure the Elasticsearch service.
  7. Start Elasticsearch:

    service elasticsearch start
  8. Verify that Elasticsearch is working by entering the following command on the server on which it’s running:

    curl -i

    Messages similar to the following display if Elasticsearch is running:


Upgrade from Elasticsearch 2.x to 5.x

Refer to Upgrading Elasticsearch for full instructions on backing up your data, detecting potential migration issues, and testing upgrades before deploying to production.

Upgrading from 2.x to 5.x requires a full cluster restart. See Full cluster restart upgrade for details.

Elasticsearch 5.x requires JDK 1.8 or higher. Elasticsearch 2.x requires JDK 1.7 or higher. See Install the Java Software Development Kit (JDK) to check which version of JDK is installed.

Additional resources

For additional information, see Elasticsearch documentation