AWS Glue upgrades Spark engines, backs Ray framework

AWS Glue upgrades Spark engines, backs Ray framework

AWS Glue, a serverless data integration service provided by Amazon Web Services, showcases Python and Apache Spark capabilities in a version 4.0 release introduced this week.

The upgrade adds engines for Python 3.10 and Apache Spark 3.3.0. Both engines include performance enhancements and bug fixes, with Spark offering capabilities such as row-level runtime filtering and improved error messages.

To read this article in full, please click here

0Shares