Skip to main content
Loading

Configuring the Properties of Connections from the Connector to an Aerospike Database

The aerospike section of the aerospike-pulsar-inbound.yml file configures the connection properties that the connector must use when connecting to your Aerospike database.

Procedure

Carry out these steps in the aerospike section of the aerospike-pulsar-inbound.yml file:

List the seed nodes of your Aerospike database.

Use the required seeds stanza to list the nodes in the Aerospike database cluster that you want the connector to connect to. By connecting to a seed node, the connector can discover all of the nodes in the cluster. The connector iterates through the list of nodes until it successfully connects to one of them, then it discovers the other nodes in the cluster. The connector is an Aerospike Smart Client, and stores in memory the partition maps of each node in the cluster, so that it can send updates directly to the appropriate nodes. For more information about Aerospike Smart Clients, see Smart Client.

PropertyRequiredDefaultDescription
portno3000The port to use when making connections to the Aerospike database.
tls-namenoThe TLS name of the Aerospike database.

Example

Here is an example with the seeds stanza at the top of the file:

aerospike:
seeds:
- 192.168.50.1:
port: 3000
tls-name: red
- 192.168.50.2

If the database cluster is configured with a name, specify the name

Use the optional cluster-name property to specify the name of the Aerospike database that you are streaming data to. The connector can run for a long time, during which nodes of the cluster can be removed from the cluster permanently or for maintenance. The IP addresses of those nodes could be reassigned to nodes that are in other Aerospike clusters or in non-Aerospike clusters. By specifying the name of the Aerospike cluster that you are streaming data to, you ensure that the connector always communicates only with nodes that are part of that cluster.

The value must match the value that is set by the configuration property cluster-name in the configuration file for the Aerospike database. For information about setting this property, see cluster-name in "Configuration parameter reference"

Example

Here is an example with the cluster-name property appearing after the seeds stanza:

aerospike:
seeds:
- 192.168.50.1:
port: 3000
tls-name: red
- 192.168.50.2
cluster-name: east

(Optional) Configure Transport Layer Security (TLS) properties

You can use the tls stanza to secure connections from the connector to your Aerospike database with TLS.

This stanza is more complex than the seeds stanza in the first step, so here is an example up front.

aerospike:
seeds:
- 192.168.50.1:
port: 3000
tls-name: red
- 192.168.50.2
cluster-name: east
tls:
key-store:
store-file: /path/to/store/file
store-password-file: /path/to/store/password/file
key-password-file: /path/to/key/password/file
store-type: JKS
trust-store:
store-file: /path/to/store/file
store-password-file: /path/to/store/password/file
key-password-file: /path/to/key/password/file
store-type: JKS
ciphers:
- TLS_RSA_WITH_3DES_EDE_CBC_SHA
revoke-certificates:
- 12345678

Here are descriptions of the main properties in the tls stanza:

PropertyRequiredDefaultDescription
key-storeyesThe key store containing the Aerospike client certificate for mutual authentication. See "Configuring key-store and trust-store".
trust-storenoDefault Java trust store.The trust store containing trusted CA certificate for Aerospike database certificate. See "Configuring key-store and trust-store".
ciphersnodefault ciphers allowed by the JVMAllowed list of TLS ciphers that clients can use for secure connections.
revoke-certificatesnoList of certificate serial numbers to reject.

Configuring key-store and trust-store

key-store takes these properties. trust-store can either take these properties or its default value.

PropertyRequiredDefaultDescription
store-fileyesThe store file
store-password-fileyesThe file that contains the password to the store.
key-password-filenoThe file that contains the password for the key.
store-typenoJKSThe keystore type. Valid values are JKS, JCEKS, PKCS12, PKCS11, DKS, Windows_MY, and BKS.
Example of a tls stanza with the default value for trust-store
tls:
key-store:
store-file: /path/to/store/file
store-password-file: /path/to/store/password/file
key-password-file: /path/to/key/password/file
store-type: JKS
trust-store: default

(Optional) Specify authorization credentials for connecting to your Aerospike database

Use the optional credentials stanza to provide the authentication credentials that you want the connector to use to connect to nodes in the Aerospike database cluster.

PropertyRequiredDefaultDescription
usernameyesThe username.
password-fileyesA file from which the password is read. Everything after the first newline is ignored. Trailing spaces in the first line are not ignored.
auth-modenointernalThe authentication mode. Valid values are internal, external, external-insecure and pki.
  • internal - user credentials are validated internally by the Aerospike cluster, using a hashed password.
  • external - user credentials are validated externally (e.g. via LDAP) by the Aerospike cluster. TLS is required between the clusters for this mode, as the user password is sent in clear text.
  • external-insecure - user credentials are validated externally (e.g. via LDAP) by the Aerospike cluster. TLS is not required for this mode, but since the user password is sent in clear text, this mode is not recommended for production systems.
  • pki - user credentials are validated from the client TLS certificate. No user name or password needs to be configured. This mode requires that the server be configured with TLS mutual auth and that the client have a valid TLS certificate. Requires server 5.7 or later.

Example

Here is an example with the credentials stanza. Also included is the example from previous step.

aerospike:
seeds:
- 192.168.50.1:
port: 3000
tls-name: red
- 192.168.50.2
cluster-name: east
tls:
key-store:
store-file: /path/to/store/file
store-password-file: /path/to/store/password/file
key-password-file: /path/to/key/password/file
store-type: JKS
trust-store:
store-file: /path/to/store/file
store-password-file: /path/to/store/password/file
key-password-file: /path/to/key/password/file
store-type: JKS
ciphers:
- TLS_RSA_WITH_3DES_EDE_CBC_SHA
revoke-certificates:
- 12345678
credentials:
username: admin
password-file: /path/to/password/file.txt
auth-mode: internal

(Optional) Configure optional settings for communicating with your Aerospike database

Use the optional services stanza to configure optional settings for the connector to use when communicating with nodes of your Aerospike database.

PropertyRequiredDefaultDescription
ip-mapnoNo translationIf the connector is outside of the network in which your Aerospike database is running, you can use this property to map node IP addresses visible to the connector to destination IP addresses within your network.
use-services-alternatenofalseUse if alternate-access-address is set in the configuration file for your Aerospike database. See the reference for alternate-access-address for more information about this property.

Example

Here is an example of the services stanza mapping two node IP addresses as exposed outside of an Aerospike database's network to IP addresses for those nodes within the network. Also included is the example from previous step.

aerospike:
seeds:
- 192.168.50.1:
port: 3000
tls-name: red
- 192.168.50.2
cluster-name: east
tls:
key-store:
store-file: /path/to/store/file
store-password-file: /path/to/store/password/file
key-password-file: /path/to/key/password/file
store-type: JKS
trust-store:
store-file: /path/to/store/file
store-password-file: /path/to/store/password/file
key-password-file: /path/to/key/password/file
store-type: JKS
ciphers:
- TLS_RSA_WITH_3DES_EDE_CBC_SHA
revoke-certificates:
- 12345678
credentials:
username: admin
password-file: /path/to/password/file.txt
auth-mode: internal
services:
ip-map:
192.168.50.1: 192.168.60.1
192.168.50.2: 192.168.60.2

(Optional) Throttle the number of connections from the connector

Use the optional performance stanza to throttle the number of connections the connector can open per node in your Aerospike database. You can also throttle the number of threads that the connector runs on nodes that it connects to.

PropertyRequiredDefaultDescription
max-connections-per-nodeno300The maximum number of connections allowed per Aerospike database node
event-loop-sizenoThe number of processors on a node.Number of threads that the client launches on a node.

Example

Here is an example of the performance stanza setting a maximum of 310 connections per node and specifying to launch four threads per node. Also included is the example from previous step.

aerospike:
seeds:
- 192.168.50.1:
port: 3000
tls-name: red
- 192.168.50.2
cluster-name: east
tls:
key-store:
store-file: /path/to/store/file
store-password-file: /path/to/store/password/file
key-password-file: /path/to/key/password/file
store-type: JKS
trust-store:
store-file: /path/to/store/file
store-password-file: /path/to/store/password/file
key-password-file: /path/to/key/password/file
store-type: JKS
ciphers:
- TLS_RSA_WITH_3DES_EDE_CBC_SHA
revoke-certificates:
- 12345678
credentials:
username: admin
password-file: /path/to/password/file.txt
auth-mode: internal
services:
ip-map:
192.168.50.1: 192.168.60.1
192.168.50.2: 192.168.60.2
performance:
max-connections-per-node: 310
event-loop-size: 4

(Optional) Specify rack id where this Aerospike client instance resides

Rack id where this client instance resides.

PropertyRequiredDefaultDescription
rack-idnonullAn integer specifying the rack id where this client resides.

Example

Here is an example specifying rack-id.

aerospike:
seeds:
- 192.168.50.1:
port: 3000
tls-name: red
- 192.168.50.2
rack-id: 1

(Optional) Configure timeouts for communicating with your Aerospike database

Specify timeouts applied to the Aerospike transactions.

PropertyRequiredDefaultDescription
socket-timeoutno30000 (30 seconds)Socket idle timeout in milliseconds when processing a database command.
total-timeoutno1000 (1 second)Total transaction timeout in milliseconds.

Example

Here is an example of the specifying socket-timeout and total-timeout.

aerospike:
seeds:
- 192.168.50.1:
port: 3000
tls-name: red
- 192.168.50.2
cluster-name: east
socket-timeout: 30000
total-timeout: 1000

(Optional) Specify boolean particle type

Specify particle types of boolean bins.

  • If true, boolean is stored on the Aerospike server with a boolean particle type (introduced in Aerospike server 5.6).
  • If false, boolean is stored on the Aerospike server with an integer particle type (1 or 0). Must be false for server versions earlier than 5.6 which do not support boolean bins.
PropertyRequiredDefaultDescription
use-bool-binnofalseSet this property to true if you would like boolean bins stored with boolean particle type in the Aerospike server.

Example

Here is an example specifying use-bool-bin.

aerospike:
seeds:
- 192.168.50.1:
port: 3000
tls-name: red
- 192.168.50.2
use-bool-bin: false