Deploying YDB in AWS EKS
To use Kubernetes to create a cluster YDB, follow the steps below.
Before you start
-
Configure
awscli
andeksctl
to work with AWS resources according to the documentation. -
Install the Kubernetes CLI kubectl.
-
Create a Kubernetes cluster.
You can use an existing Kubernetes cluster or create a new one.
Warning
Make sure that you're using Kubernetes version 1.20 or higher.
How to create Kubernetes clusterCLIeksctl create cluster \ --name yandex-database \ --nodegroup-name standard-workers \ --node-type c5a.2xlarge \ --nodes 3 \ --nodes-min 1 \ --nodes-max 4
A Kubernetes cluster named
yandex-database
is created. The--node-type
flag indicates that the cluster is deployed usingc5a.2xlarge
(8vCPUs, 16 GiB RAM) instances. This meets our guidelines for running YDB.It takes 10 to 15 minutes on average to create a cluster. Wait for the process to complete before proceeding to the next step of YDB deployment. The kubectl configuration will be automatically updated to work with the cluster after it is created.
-
Install the Kubernetes Helm 3 package manager.
-
Add a repository for Yandex.Cloud to Helm:
CLIRun the command:
helm repo add ydb https://charts.ydb.tech/
ydb
: The repository alias.https://charts.ydb.tech/
: The repository URL.
Output:
"ydb" has been added to your repositories
-
Update the Helm chart index:
CLIRun the command:
helm repo update
Output:
Hang tight while we grab the latest from your chart repositories... ...Successfully got an update from the "ydb" chart repository Update Complete. ⎈Happy Helming!⎈
Install the YDB controller in the cluster
Install YDB in the standard configuration:
Run the command:
helm install ydb-operator ydb/operator
ydb-operator
: The release name.ydb/operator
: The name of the chart in the repository you added earlier.
Result:
NAME: ydb-operator
LAST DEPLOYED: Thu Aug 12 19:32:28 2021
NAMESPACE: default
STATUS: deployed
REVISION: 1
TEST SUITE: None
Create a YDB cluster
Apply the manifest for creating a YDB cluster:
Run the command:
kubectl apply -f samples/storage.yaml
This command creates a StatefulSet object that describes a set of containers with stable network IDs and disks assigned to them, as well as Service and ConfigMap objects that are required for the cluster to work.
You can check the progress of YDB cluster creation using the following commands:
kubectl get storages.ydb.tech
kubectl describe storages.ydb.tech
Wait until the status of the Storage resource changes to Ready
.
Warning
The cluster configuration is static. The controller won't process any changes when the manifest is reapplied. You can only update cluster parameters such as version or disk size by creating a new cluster.
The standard configuration includes the minimum required 9 storage nodes, 80 GB each.
For YDB to work efficiently, we recommend using physical (not virtual) disks larger than 800 GB as block devices.
The minimum disk size is 80 GB, otherwise the YDB node won't be able to use the device. Correct and uninterrupted operation with minimum-size disks is not guaranteed. We recommend using such disks exclusively for informational purposes.
Warning
Configurations with disks less than 800 GB or any types of storage system virtualization cannot be used for production services or system performance testing.
Create a database
Apply the manifest for creating a database:
Run the command:
kubectl apply -f samples/database.yaml
Note
The .spec.storageClusterRef.name
key value must match the name of the storage resource of the cluster part.
After processing the manifest, a StatefulSet object that describes a set of dynamic nodes is created. The created database will be accessible from inside the Kubernetes cluster by the database-sample
DNS name or the database-sample.<namespace>.svc.cluster.local
FQDN, where namespace
indicates the namespace that the release was installed. The database is connected to through port 2135
.
View the status of the created resource:
kubectl describe database.ydb.tech
Name: database-sample
Namespace: default
Labels: <none>
Annotations: <none>
API Version: ydb.tech/v1alpha1
Kind: Database
...
Status:
State: Ready
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Provisioning 8m10s ydb-operator Resource sync is in progress
Normal Provisioning 8m9s ydb-operator Resource sync complete
Normal TenantInitialized 8m9s ydb-operator Tenant /root/database-sample created
The database is ready to run.
Test the controller
Test how YDB works:
-
Check that all nodes are in the
Ready
status:kubectl get pods NAME READY STATUS RESTARTS AGE database-sample-0 1/1 Running 0 1m database-sample-1 1/1 Running 0 1m database-sample-2 1/1 Running 0 1m database-sample-3 1/1 Running 0 1m database-sample-4 1/1 Running 0 1m database-sample-5 1/1 Running 0 1m storage-sample-0 1/1 Running 0 1m storage-sample-1 1/1 Running 0 1m storage-sample-2 1/1 Running 0 1m storage-sample-3 1/1 Running 0 1m storage-sample-4 1/1 Running 0 1m storage-sample-5 1/1 Running 0 1m storage-sample-6 1/1 Running 0 1m storage-sample-7 1/1 Running 0 1m storage-sample-8 1/1 Running 0 1m
-
Start a new pod using the YDB CLI:
kubectl run -it --image=cr.yandex/yc/ydb:21.4.30 --rm ydb-cli bash
-
Query the YDB database:
ydb \ --endpoint grpc://database-sample-grpc:2135 \ --database /root/database-sample \ table query execute --query 'select 1;'
--endpoint
: Database endpoint.--database
: The name of the created database.--query
: Query text.
Result:
┌─────────┐ | column0 | ├─────────┤ | 1 | └─────────┘
For more on YDB CLI commands, see the documentation.
Release the resources you don't use
If you no longer need the created resources, delete them:
-
To delete a YDB database, just delete the
Database
resource mapped to it:kubectl delete database.ydb.tech database-sample
-
To delete a YDB cluster, run the following commands:
kubectl delete storage.ydb.tech storage-sample kubectl delete pvc -l app.kubernetes.io/name=ydb
-
To remove the YDB controller from the Kubernetes cluster, delete the release created by Helm:
helm delete ydb-operator
ydb-operator
: The name of the release that the controller was installed under.