Adding Flink Support

See Storage requirements (for use with Spark or Flink) to setup Storage Requirements for Flink applications.

If you plan to write applications that utilize Flink you will need to install the Lyft Flink operator before deploying your Cloudflow application.

Install the Lyft Flink operator using the following Helm command:

helm install flink-operator \ \
  --namespace cloudflow \
  --set operatorImageName="" \
  --set operatorVersion="v0.5.0"
The above Helm command uses a Helm chart for the Lyft Flink operator that is hosted here.

This completes the installation of the Flink operator.

$ kubectl get pods -n cloudflow
NAME                                                READY   STATUS      RESTARTS   AGE
cloudflow-operator-6b7d7cbdfc-xb6w5                 1/1     Running     0          3m29s
cloudflow-patch-spark-mutatingwebhookconfig-66xxb   0/1     Completed   0          21s
spark-operator-sparkoperator-56d6ffc8cd-cln67       1/1     Running     0          2m29s
flink-operator-7999fdd879-phqlg                     1/1     Running     0          1m29s