Using Docker containers for AWS Glue jobs local development
Locally developing AWS Glue jobs on Docker containers Some time ago, we started using AWS Glue services for data movement and transformation as part of the Globalwork data lake, following a lambda architecture. Glue is a Spark-based serverless resource that lets you focus on things like scalability, flexibility, and getting…
Using Docker containers for AWS Glue jobs local development Locally developing AWS Glue jobs on Docker containers Some time ago, we started using AWS Glue services for data movement and transformation as part of the Globalwork data lake, following a lambda architecture. Glue is a Spark-based serverless resource that lets you focus on things like scalability, flexibility, and getting… cloud-computing
Using Docker container AWS Glue job local development Locally developing AWS Glue job Docker container time ago started using AWS Glue service data movement transformation part Globalwork data lake following lambda architecture Glue Sparkbased serverless resource let focus thing like scalability flexibility getting… cloudcomputing