Spark RDDs and Dataframes

15 Maio 2024, 15:00 • Mário João Barata Calha

---

Running a Spark container at cloud shell. Spark wordcount. Using Spark's REPL. RDDs and dataframes. Mounting a volume on the Spark container to make python programs accessible for spark-submit.

Spark RDDs and Dataframes

9 Maio 2024, 15:00 • Mário João Barata Calha

---

Running a Spark container at cloud shell. Spark wordcount. Using Spark's REPL. RDDs and dataframes. Mounting a volume on the Spark container to make python programs accessible for spark-submit.

Monitoring

8 Maio 2024, 18:30 • Mário João Barata Calha

---

Deploying metrics server. Collecting metrics. Monitoring a Kubernetes deployment with Prometheus and Grafana.

Spark. RDDs, SQL, Dataframes and Datasets

8 Maio 2024, 16:30 • Mário João Barata Calha

---

Spark RDD transformations and actions. Broadcast variables. Accumulators. Spark SQL operations. Dataframes and datasets. Relation with RDDs.

Monitoring

8 Maio 2024, 15:00 • Mário João Barata Calha

---

Deploying metrics server. Collecting metrics. Monitoring a Kubernetes deployment with Prometheus and Grafana.