"What can PyArrow do for you - Array interchange, storage, compute and transport" ( 2025 )

Sunday at 11:00, 30 minutes, UD2.218A, UD2.218A, Python Rok Mihevc Alenka Frim , slides , video

PyArrow is a powerful tool for Python developers seeking high-performance data processing and interchange. This talk will provide a pragmatic overview of some of PyArrow's capabilities, demonstrating data interchange, storage, manipulation and transport using a single Python library.

We'll explore four key capabilities:

Array Interchange: Seamless data exchange between NumPy, pandas, and other libraries using zero-copy Storage: Efficient serialization and file format support (Parquet, ORC, Feather) with advanced compression Compute: High-performance in-memory computation and data transformation capabilities Transport: Leveraging Arrow Flight RPC for distributed data movement and processing