Adding Flink Support
|Integration with the Lyft Flink Operator has been deprecated since 2.2.0, and will be removed in version 3.x. Flink integration has moved to the Cloudflow-contrib project. Please see the Cloudflow-contrib getting started guide for instructions on how to use Flink Native Kubernetes integration. The documentation that follows describes the deprecated feature.|
|See Storage requirements (for use with Spark or Flink) to setup Storage Requirements for Flink applications.|
If you plan to write applications that utilize Flink you will need to install the Lyft Flink operator before deploying your Cloudflow application.
Install the Lyft Flink operator using the following Helm command:
helm install flink-operator \ https://github.com/lightbend/flink-operator/releases/download/v0.8.2/flink-operator-0.8.2.tgz \ --namespace cloudflow \ --set operatorVersion="v0.5.0"
|The above Helm command uses a Helm chart for the Lyft Flink operator that is hosted here.|
This completes the installation of the Flink operator.
$ kubectl get pods -n cloudflow NAME READY STATUS RESTARTS AGE cloudflow-operator-6b7d7cbdfc-xb6w5 1/1 Running 0 3m29s cloudflow-patch-spark-mutatingwebhookconfig-66xxb 0/1 Completed 0 21s spark-operator-sparkoperator-56d6ffc8cd-cln67 1/1 Running 0 2m29s flink-operator-7999fdd879-phqlg 1/1 Running 0 1m29s