Data Engineer, Sr.
JobgetherJob Description
📋 Description Design, build, and maintain scalable ETL pipelines for large-scale data migration and integration. Build, configure, and optimize AWS-based data lake/warehouse using Glue, S3, Athena, Redshift, Lake Develop Python scripts and database procedures to automate data processing, transformation Manage relational databases (MySQL, SQL Server, Aurora MySQL) with focus on performance Configure/troubleshoot AWS data engineering services (Glue Catalog, Hudi tables, SQS Monitor data platforms, identify bottlenecks, and implement scalability, security, and operational 🎯 Requirements Proven experience as a Data Engineer with strong expertise in AWS cloud data engineering and Hands-on experience with AWS S3, Athena, Glue, Redshift, Lake Formation, Lambda, Step Functions Strong knowledge of relational databases (MySQL, SQL Server) and data warehouse architecture Proficiency in Python for scripting, automation, ETL, and data transformation. Experience with structured and unstructured data, data cleansing, conversion, and large-scale ETL Knowledge of Hudi table management, AWS Glue Catalog, SQS, and cloud-based data lake 🎁 Benefits Fully remote work environment with flexibility to work from anywhere. Competitive contract compensation based on experience. Opportunity to work on large-scale cloud migration and modern data platform initiatives. Exposure to a broad AWS ecosystem and advanced cloud-native technologies. Collaborative Agile environment with high levels of ownership and technical autonomy. Opportunity to contribute to innovative, product-driven engineering projects and expand cloud data