Outdated Version

You are viewing an older version of this section. View current production version.

Configuring SingleStore DB for NUMA

Info

This topic does not apply to SingleStore Managed Service.

Info

If you are managing your cluster with MemSQL Ops, go here instead.

When running SingleStore DB on machines with multiple Non-Uniform Memory Access (NUMA) nodes, you should configure SingleStore DB for NUMA with numactl for optimal performance. If you do not configure SingleStore DB this way, performance will be greatly degraded due to expensive cross-NUMA-node memory access. Configuring for NUMA should be done as part of the installation process; however, you can reconfigure your deployment later, if necessary.

To simplify the configuration process, the SingleStore management tools (sdb-admin, memsqlctl, etc.) can automatically detect if a host machine has multiple NUMA nodes and then configure SingleStore DB with numactl to bind individual SingleStore nodes to NUMA nodes. To download and use the management tools, see the Installation Guides.

Configuring a new cluster for NUMA

On each host that will contain leaf nodes, create one leaf per NUMA node by running sdb-admin create-node and then sdb-admin add-leaf until you have the same number of leaf nodes as NUMA nodes. You will need to provide a different --port argument for each SingleStore node on the same host.

For example, on a host machine with two NUMA nodes, you would deploy two leaf nodes.
```
sdb-admin create-node --host <hostname|IP> --port 3307 --password <secure_pass>
```
```
sdb-admin create-node --host <hostname|IP> --port 3308 --password <secure_pass>
```
```
# Assign the nodes the role of "leaf" and add them to the cluster.
sdb-admin list-nodes -q -r unknown | xargs -I % sdb-admin add-leaf --memsql-id %  -y
```
Run sdb-admin optimize and confirm the prompt.
```
sdb-admin optimize
```
This will configure numactl to bind SingleStore nodes to NUMA nodes, and configure SingleStore DB memory settings.

See sdb-admin optimize for more information.
Restart the cluster for the configuration changes to take effect.
```
sdb-admin restart-node --all
```

Reconfiguring an existing cluster for NUMA

Follow the steps in the previous section to deploy and optimize your leaf nodes.
Rebalance all SingleStore DB databases by running REBALANCE PARTITIONS on each database:
```
REBALANCE PARTITIONS ON <database>
```

Was this Article Helpful?

Questions?