You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: modules/ROOT/pages/getting-started.adoc
+25-12Lines changed: 25 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,8 @@
2
2
:page-aliases: getting_started.adoc
3
3
:description: Learn how to set up and test a Stackable Data Platform with Apache ZooKeeper, Kafka, and NiFi using Kubernetes. Ideal for lab environments.
4
4
5
-
One of the best ways of getting started with a new platform is to try it out. Any big data platform has a lot of moving parts and getting some hands on keyboard time with it helps reinforce learning.
5
+
One of the best ways of getting started with a new platform is to try it out.
6
+
Any big data platform has a lot of moving parts and getting some hands on keyboard time with it helps reinforce learning.
6
7
7
8
== About this guide
8
9
@@ -13,7 +14,8 @@ Firstly, let's cover whether this *Getting Started* guide is right for you. This
13
14
14
15
== Overview
15
16
16
-
Stackable is based on Kubernetes and uses this as the control plane to manage clusters. In this guide we will build a simple cluster with 3 services; Apache ZooKeeper, Apache Kafka and Apache NiFi.
17
+
Stackable is based on Kubernetes and uses this as the control plane to manage clusters.
18
+
In this guide we will build a simple cluster with 3 services; Apache ZooKeeper, Apache Kafka and Apache NiFi.
17
19
18
20
== Installing Kubernetes and kubectl
19
21
@@ -30,7 +32,9 @@ Install the Stackable command line utility xref:management:stackablectl:index.ad
30
32
31
33
=== Installing Stackable Operators
32
34
33
-
The Stackable operators are components that translate the service definitions deployed via Kubernetes into deploy services on the worker nodes. These can be installed on any node that has access to the Kubernetes control plane. In this example we will install them on the controller node.
35
+
The Stackable operators are components that translate the service definitions deployed via Kubernetes into deploy services on the worker nodes.
36
+
These can be installed on any node that has access to the Kubernetes control plane.
37
+
In this example we will install them on the controller node.
34
38
35
39
Stackable operators can be installed using `stackablectl`.
36
40
Run the following commands to install ZooKeeper, Kafka and NiFi from the Stackable 25.7 release.
At this point you've successfully deployed Kubernetes and the Stackable operators we need and are ready to deploy services to the cluster. To do this we provide service descriptions to Kubernetes for each of the services we wish to deploy.
83
+
At this point you've successfully deployed Kubernetes and the Stackable operators we need and are ready to deploy services to the cluster.
84
+
To do this we provide service descriptions to Kubernetes for each of the services we wish to deploy.
79
85
80
86
=== Apache ZooKeeper
81
87
@@ -114,7 +120,8 @@ EOF
114
120
115
121
=== Apache Kafka
116
122
117
-
We will deploy an Apache Kafka broker that depends on the ZooKeeper service we just deployed. The zookeeperReference property below points to the namespace and name we gave to the ZooKeeper service deployed previously.
123
+
We will deploy an Apache Kafka broker that depends on the ZooKeeper service we just deployed.
124
+
The zookeeperReference property below points to the namespace and name we gave to the ZooKeeper service deployed previously.
118
125
119
126
[source,bash]
120
127
----
@@ -208,7 +215,8 @@ stringData:
208
215
EOF
209
216
----
210
217
211
-
You can check the status of the services using `kubectl get pods`. This will retrieve the status of all pods running in the default namespace.
218
+
You can check the status of the services using `kubectl get pods`.
219
+
This will retrieve the status of all pods running in the default namespace.
Since this is the first time that each of these services has been deployed to these nodes, it will take some time to download the software from the Stackable repository and deploy the services. Once all the pods are in the running state your cluster is ready to use.
239
+
Since this is the first time that each of these services has been deployed to these nodes, it will take some time to download the software from the Stackable repository and deploy the services.
240
+
Once all the pods are in the running state your cluster is ready to use.
232
241
233
242
== Testing your cluster
234
243
235
244
If all has gone well then you will have successfully deployed a Stackable cluster and used it to start three services that should now be ready for you.
236
245
237
246
=== Apache ZooKeeper
238
247
239
-
We can test ZooKeeper by running the ZooKeeper CLI shell. The easiest way to do this is to run the CLI shell on the pod that is running ZooKeeper.
248
+
We can test ZooKeeper by running the ZooKeeper CLI shell.
249
+
The easiest way to do this is to run the CLI shell on the pod that is running ZooKeeper.
The shell should connect automatically to the ZooKeeper server running on the pod. You can run the `ls /` command to see the list of znodes in the root path, which should include those created by Apache Kafka and Apache NiFi.
256
+
The shell should connect automatically to the ZooKeeper server running on the pod.
257
+
You can run the `ls /` command to see the list of znodes in the root path, which should include those created by Apache Kafka and Apache NiFi.
You should see the message, "Created topic demo." on the console. Now let's check to see if it was actually created:
275
+
You should see the message, "Created topic demo." on the console.
276
+
Now let's check to see if it was actually created:
265
277
266
278
[source,bash]
267
279
----
@@ -299,7 +311,8 @@ Browse to the address of your Kubernetes node on port `31931` e.g. https://172.1
299
311
300
312
image:nifi_login_screen.png[The Apache NiFi web interface login screen]
301
313
302
-
If a password has not been specified for the admin user the Apache NiFi operator will automatically generate the admin user credentials with a random password and store it as a Kubernetes secret in order to provide some security out of the box. In the example above we have provided our own secret, but you can retrieve and confirm this password for the `admin` user with the following kubectl command.
314
+
If a password has not been specified for the admin user the Apache NiFi operator will automatically generate the admin user credentials with a random password and store it as a Kubernetes secret in order to provide some security out of the box.
315
+
In the example above we have provided our own secret, but you can retrieve and confirm this password for the `admin` user with the following kubectl command.
0 commit comments