Adding Flink Support

Integration with the Lyft Flink Operator has been deprecated since 2.2.0, and will be removed in version 3.x. Flink integration has moved to the Cloudflow-contrib project. Please see the Cloudflow-contrib getting started guide for instructions on how to use Flink Native Kubernetes integration. The documentation that follows describes the deprecated feature.

See Storage requirements (for use with Spark or Flink) to setup Storage Requirements for Flink applications.

If you plan to write applications that utilize Flink you will need to install the Lyft Flink operator before deploying your Cloudflow application.

Install the Lyft Flink operator using the following Helm command:

helm install flink-operator \
  https://github.com/lightbend/flink-operator/releases/download/v0.8.2/flink-operator-0.8.2.tgz \
  --namespace cloudflow \
  --set operatorVersion="v0.5.0"

The above Helm command uses a Helm chart for the Lyft Flink operator that is hosted here.

This completes the installation of the Flink operator.

$ kubectl get pods -n cloudflow
NAME                                                READY   STATUS      RESTARTS   AGE
cloudflow-operator-6b7d7cbdfc-xb6w5                 1/1     Running     0          3m29s
cloudflow-patch-spark-mutatingwebhookconfig-66xxb   0/1     Completed   0          21s
spark-operator-sparkoperator-56d6ffc8cd-cln67       1/1     Running     0          2m29s
flink-operator-7999fdd879-phqlg                     1/1     Running     0          1m29s