I’ve been looking int how to build a custom Pyspark Docker Image to run on our companies Kubernetes pods (that run on scala). Have not found any examples that work. Anyone think that they can help?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Question concerning the creation of a container launching Airflow and Pyspark | 0 | 1583 | March 17, 2023 | |
Pyspark + Hadoop HDFS and Yarn | 1 | 354 | July 24, 2021 | |
Creating docker image | 0 | 415 | February 27, 2020 | |
Is docker file different on WSL and Windows? | 1 | 382 | January 1, 2023 | |
Jupyter lab and Pyspark on compose | 0 | 484 | November 21, 2021 |