In this talk, we will present the major achievements of the EU research project IOStack (iostack.eu). IOStack software stack enables efficient execution of virtualized analytics applications over virtualized storage resources thanks to flexible, automated, and low cost data management models based on software-defined storage (SDS). The clean separation of control and data planes of SDS will offer novel programming tools to data engineers. We will showcase in this talk the optimized integration of Apache Spark with Object Storage systems like OpenStack Swift. Finally, we will also introduce Data-driven Serverless Functions for Object Storage as novel programming abstractions for data engineers.

Pedro Garcia Lopez is professor of the Computer Engineering and Mathematics Department at the University Rovira i Virgili (Spain). He leads the “Archi- tectures and Telematic Services” research group and coordinates the H2020 European project IOStack: Software Defined Storage for Big Data. His research topics are distributed systems, cloud storage, software architectures and middleware. He has published more than 80 papers and participated in several spanish and european research projects.