job description
Join RPG Commerce as a Senior Data Engineer and play a pivotal role in transforming raw data into actionable insights that drive business growth. Based in the vibrant and inspiring environment of Bali, youâll work with cutting-edge technologies to design, build, and optimize our data infrastructure, ensuring scalability, reliability, and performance.
As part of our dynamic team, youâll collaborate with cross-functional stakeholders to develop data pipelines, ETL processes, and analytics solutions that empower data-driven decision-making. This is a unique opportunity to shape the future of e-commerce through innovative data engineering in one of the worldâs most sought-after remote work destinations.
If youâre passionate about big data, cloud technologies, and solving complex problems, weâd love to hear from you. Enjoy the perfect work-life balance while contributing to high-impact projects in a fast-paced, global environment.
Responsibility
- Design, develop, and maintain scalable data pipelines and ETL processes to ingest, transform, and load large datasets from multiple sources.
- Optimize and manage data warehouses (e.g., Snowflake, BigQuery, Redshift) and data lakes for efficient storage and retrieval.
- Implement real-time and batch data processing solutions using tools like Apache Spark, Kafka, or Airflow.
- Collaborate with data scientists and analysts to ensure high-quality, clean, and structured data for analytics and machine learning.
- Monitor data pipeline performance, troubleshoot issues, and implement best practices for data governance and security.
- Automate data workflows and deploy CI/CD pipelines to streamline development and operations.
- Stay updated with emerging trends in big data technologies and recommend improvements to enhance system efficiency.
- Document data architectures, processes, and workflows to ensure transparency and maintainability.
Qualifications
- Bachelorâs or Masterâs degree in Computer Science, Data Engineering, or a related field.
- Minimum 5 years of experience in data engineering, with a strong portfolio of data pipeline projects.
- Proficiency in SQL (advanced querying, optimization) and experience with NoSQL databases (e.g., MongoDB, Cassandra).
- Hands-on experience with cloud platforms (AWS, GCP, or Azure) and big data tools (Hadoop, Spark, Databricks).
- Strong programming skills in Python, Scala, or Java for data processing and scripting.
- Experience with data orchestration tools (Airflow, Luigi, Prefect) and containerization (Docker, Kubernetes).
- Familiarity with data modeling, dimensional design, and performance tuning for large-scale datasets.
- Excellent problem-solving skills and the ability to work in a collaborative, remote team environment.