job description
Join Lewis Personnel Management as a Senior Data Engineer (AWS) and play a pivotal role in designing, building, and optimizing our data infrastructure in the cloud. This is a unique opportunity to work remotely from Bali while collaborating with a dynamic, global team to drive data-driven decision-making.
As a Data Engineer, you will develop scalable ETL pipelines, manage large-scale data warehouses, and ensure seamless data integration across systems. Your expertise in AWS (Redshift, Glue, Lambda, S3, etc.) will be critical in transforming raw data into actionable insights that empower business growth.
We offer a competitive salary, flexible work arrangements, and the chance to work on cutting-edge projects in a fast-paced, innovative environment. If youâre passionate about big data, cloud technologies, and solving complex challenges, weâd love to hear from you!
Responsibility
- Design, develop, and maintain scalable ETL/ELT pipelines using AWS services (Glue, Lambda, Step Functions).
- Build and optimize data warehouses (Redshift, Snowflake) and data lakes (S3, Athena) for high performance.
- Collaborate with data scientists and analysts to ensure data accuracy, consistency, and accessibility.
- Implement data governance, security, and compliance best practices (GDPR, CCPA).
- Automate data workflows using Airflow, AWS MWAA, or custom scripts.
- Monitor and troubleshoot data pipelines to ensure uptime and reliability.
- Optimize queries and data models for cost-efficiency and performance.
- Stay updated with emerging cloud data technologies and recommend improvements.
Qualifications
- Bachelorâs degree in Computer Science, Engineering, or a related field (Masterâs preferred).
- 3+ years of experience as a Data Engineer, with hands-on AWS expertise.
- Proficiency in SQL, Python (Pandas, PySpark), and AWS services (Redshift, Glue, Lambda, S3).
- Experience with big data tools (Spark, Hadoop, Kafka) and data warehousing solutions.
- Strong understanding of data modeling, schema design, and dimensional modeling.
- Familiarity with CI/CD pipelines, Docker, and infrastructure-as-code (Terraform, CloudFormation).
- Excellent problem-solving skills and ability to work in Agile/Scrum environments.
- AWS Certified Data Analytics or similar certification is a plus.