job description
Join Robert Half, a global leader in professional staffing and consulting, as our Senior Data Engineering Manager for a high-impact 1-year contract. This role is perfect for a visionary data leader who thrives in driving transformative data initiatives across the APAC region. Based remotely in Bali, Indonesia, you will lead the migration to Databricks and architect AI-ready data platforms that power analytics, machine learning, and generative AI use cases.
In this role, you will collaborate with cross-functional teams to modernize data infrastructure, ensuring scalability, security, and performance. Youâll have the opportunity to shape the future of data-driven decision-making for a diverse portfolio of clients, from startups to enterprise-level organizations. If youâre passionate about leveraging cutting-edge technologies like Databricks, Spark, Delta Lake, and MLflow, this is your chance to make a lasting impact in a dynamic, fast-paced environment.
As a remote-friendly role, we offer flexibility without compromising on collaboration. Youâll work with a talented team of data professionals, enjoying the best of both worlds: a thriving career and the lifestyle benefits of living in Bali. This is a unique opportunity to grow your leadership skills while contributing to mission-critical projects that drive business innovation.
Apply now and take the next step in your data engineering career with a company that values expertise, innovation, and work-life balance.
Responsibility
- Lead the migration of APAC data infrastructure to Databricks, ensuring seamless integration with existing systems and minimal disruption to business operations.
- Design, develop, and maintain scalable, AI-ready data platforms that support analytics, machine learning, and generative AI use cases.
- Collaborate with data scientists, analysts, and business stakeholders to define data requirements and deliver solutions that drive actionable insights.
- Optimize data pipelines for performance, cost-efficiency, and reliability using Spark, Delta Lake, and Databricks best practices.
- Establish governance frameworks for data quality, security, and compliance, ensuring adherence to industry standards and regulations.
- Mentor and guide a team of data engineers, fostering a culture of innovation, continuous learning, and technical excellence.
- Monitor industry trends and emerging technologies, recommending strategic improvements to keep the data infrastructure ahead of the curve.
- Partner with IT and DevOps teams to implement CI/CD pipelines and infrastructure-as-code (IaC) for data engineering workflows.
Qualifications
- Bachelorâs or Masterâs degree in Computer Science, Data Engineering, or a related field (or equivalent experience).
- 8+ years of experience in data engineering, with at least 3 years in a leadership or managerial role.
- Proven expertise in Databricks, Spark, Delta Lake, and SQL, with hands-on experience in building and optimizing large-scale data pipelines.
- Strong background in cloud platforms (AWS, Azure, or GCP) and experience with MLflow, Airflow, or similar tools.
- Experience with generative AI, machine learning, and analytics use cases, including model deployment and monitoring.
- Familiarity with data governance, security, and compliance (e.g., GDPR, CCPA) in a global context.
- Excellent problem-solving skills and the ability to translate business requirements into technical solutions.
- Strong communication and stakeholder management skills, with fluency in English.