Migrate from a self-managed cluster with a self-signed certificate using remote reindex

The following instructions show you how to configure remote reindex on Elastic Cloud Hosted from a cluster that uses a self-signed CA.

Let’s assume that the self-managed cluster that uses a self-signed certificate is called Source, and you want to migrate data from Source to Destination on Elastic Cloud Hosted.

1. Get the self-signed CA on the Source cluster, or extract the certificate from the cluster by running the following command:

   echo quit | openssl s_client -showcerts -servername "$SOURCE_SERVER_NAME" -connect "$SOURCE_SERVER:$PORT" > cacert.pem
   

2. Test cecert.pem you have just created with curl, this should return a successful response:

   curl -XGET https://$SOURCE_SERVER:$PORT -u <username>:<password> --cacert cacert.pem
   

3. Create the folder my_source_ca to store the file cacert.pem, and compress the folder to my_source_ca.zip.

To upload your file, follow the steps in the section Add your extension. Enter wildcard * for Version in order to be compatible for all future upgrades, and select A bundle containing dictionary or script as Type.

From the Elastic Cloud Console create a new deployment. This will be the Destination cluster.

1. From your deployment page, go to the Edit page, click Manage user settings and extensions, select tab Extensions then enable my_source_ca.

2. Switch tab to User settings, append the following settings to the elasticsearch.yml. This step adds source_server to the reindex.remote.whitelist, points source CA bundle to be trusted by the Destination cluster using the setting reindex.ssl.certificate_authorities.

   reindex.remote.whitelist: ["$SOURCE_SERVER:$PORT"]
   reindex.ssl.certificate_authorities: "/app/config/my_source_ca/cacert.pem"
   reindex.ssl.verification_mode: "full"
   

   Note

   Make sure reindex.remote.whitelist is in an array format. All uploaded bundles will be uncompressed into /app/config/ folder. Ensure the file path corresponds to your uploaded bundle in Step 1. You can optionally set reindex.ssl.verification_mode to full, certificate or none depending on the validity of hostname and the certificate path. More details can be found in reindex setting.

3. Click Back to the Edit page and scroll to the button of the page to Save changes. This step will restart all Elasticsearch instances.

You can now run reindex on the Elastic Cloud Hosted Destination cluster from Source cluster:

POST _reindex
{
  "source": {
    "remote": {
      "host": "https://$SOURCE_SERVER:$PORT",
      "username": "username",
      "password": "xxx"
    },
    "index": "my_source_index"
  },
  "dest": {
    "index": "my_dest_index"
  }
}