Tag

spark

#spark

More content

Read more stories on Hashnode

Articles with this tag

Flyte Map Tasks: A Simpler Alternative to Apache Spark

Vijay Saravana JaishankerVijay Saravana Jaishanker
Oct 4, 202214 min read

By Vijay Saravana Jaishanker, Alex Bain and Varsha Parthasarathy Vijay Saravana Jaishanker is an intern at Woven Planet in the Machine Learning...

Flyte Map Tasks: A Simpler Alternative to Apache Spark

Orchestrating Data Pipelines at Lyft: Comparing Flyte and Airflow

Constantine SlisenkaConstantine Slisenka
Mar 29, 202219 min read

This article was originally published on the Lyft Engineering blog on March 25th, 2022. Introduction In a data-driven company like Lyft, data is the...

Orchestrating Data Pipelines at Lyft: Comparing Flyte and Airflow

Data-Parallel Distributed Training With Horovod and Flyte

Deactivated UserDeactivated User
Dec 8, 20217 min read

This blog is with reference to a talk titled “Efficient Data Parallel Distributed Training with Flyte, Spark & Horovod”, presented by Katrina Rogan...

Data-Parallel Distributed Training With Horovod and Flyte