Configuring the Data Processing (sahara) service (optional)¶

Configuring target hosts¶

Modify /etc/openstack_deploy/conf.d/sahara.yml by adding a list containing the infrastructure target hosts in the sahara-infra_hosts section:

In sahara.yml:

sahara-infra_hosts:
  infra01:
    ip: INFRA01_IP_ADDRESS
  infra02:
    ip: INFRA02_IP_ADDRESS
  infra03:
    ip: INFRA03_IP_ADDRESS

Replace *_IP_ADDRESS with the IP address of the br-mgmt container management bridge on each target host.

This hosts will be used to deploy the containers where sahara will be installed.

Configuring the cluster network¶

Sahara is configured to use the neutron implementation of OpenStack Networking.

Object Storage access using proxy users¶

By default sahara is configured to use proxy users and delegated trusts for Object Storage access. In that way, users are not required to enter credentials for their data sources and job binaries referenced in Object Storage. To disable this functionality change the following variable to False.

In user_variables.yml:

sahara_use_domain_for_proxy_users: True

Also, is it possible to change which roles the trust users will receive in the proxy domain, by default it receives the _member_ role.

In user_variables.yml:

sahara_proxy_user_role_names: _member_

Configuring cluster instances NTP¶

By default sahara will enable the NTP service on all cluster instances if the NTP package is included in the image. The default NTP server will be pool.ntp.org this can be overridden using the sahara_default_ntp_server variable.

In user_variables.yml:

sahara_default_ntp_server: "pool.ntp.org"

Configuring plugins¶

The following plugins are installed and loaded by default:

sahara_plugin_base:
  - vanilla
  - spark
  - cdh
  - ambari

To add/remove plugins, just change the sahara_plugin_base variable accordingly, in the user_variables.yml file.

Configuring notifications¶

Sahara can be configured to send notifications to the OpenStack Telemetry module. By default, the variable is set to true if there are any Ceilometer hosts in the environment. To change this, the following variable must be set:

In user_variables.yml:

sahara_ceilometer_enabled: True

Dashboard¶

To enable the Data Processing panel on horizon, the following variable should be set:

In user_variables.yml:

horizon_enable_sahara_ui: True

Setting up Sahara¶

Run the setup-hosts playbook, to create the sahara containers, and the repo-build playbook to update the repository with the sahara packages.

# cd /opt/openstack-ansible/playbooks
# openstack-ansible setup-hosts.yml
# openstack-ansible repo-build.yml

Run the sahara and horizon playbooks to install sahara and enable the Data Processing panel in horizon:

# cd /opt/openstack-ansible/playbooks
# openstack-ansible os-sahara-install.yml
# openstack-ansible os-horizon-install.yml