Data Platform Engineer

We are seeking a Data Platform Engineer to design, operate and enhance a global data platform supporting large-scale analytics and data science workloads. You will focus on platform reliability, automation, security and CI/CD for data pipelines across on-premise and hybrid environments. Here's your chance to collaborate closely with security, engineering, and cloud operations teams while applying DevSecOps and Agile practices to deliver resilient, high-performing data solutions. If you are currently a senior data platform or DevOps engineer, this role is for you.

Responsibilities

• Operate and enhance global data platform components including VM servers, Kubernetes, Kafka and enterprise data applications
• Design and implement automation for infrastructure, security and CI/CD to support ELT/ETL pipelines
• Build resilient and observable data pipelines with health checks, monitoring, alerting and data quality controls
• Investigate incidents, perform root cause analysis and drive continuous improvement in platform performance and stability
• Apply DevSecOps and Agile methodologies to deliver secure, scalable solutions
• Collaborate with security, cloud operations and engineering teams on architecture and standards
• Stay current with industry trends to introduce new platform capabilities

Requirements

• Proven experience designing or operating large-scale, fault-tolerant distributed systems
• Strong experience with data platform technologies such as data lakes, streaming platforms and data pipelines
• Hands-on expertise with Kafka, Kubernetes, Spark, distributed storage formats (Parquet, S3-compatible systems) and platform health management including monitoring and alerting
• Proven experience in DevOps or CI/CD automation using tools such as Jenkins or Octopus
• Strong programming skills in Python and Java, Scala or R, with experience building and supporting ELT/ETL pipelines and streaming or file-based ingestion
• Hands-on experience with containerization and orchestration using Docker, Kubernetes and CI/CD image pipelines
• Experience integrating data science platforms such as Dataiku
• No visa sponsorship available

Nice to have

• Experience with on-premise Big Data architectures and cloud migration initiatives
• Exposure to configuration management and release tools like Ansible, Chef, XL Deploy and XL Release
• Familiarity with enterprise analytics and BI tools and ML Ops workflows

We offer

• By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

Life at EPAM

• EPAM is a leading global provider of digital platform engineering and development services. EPAM has been expanding in Singapore since 2013 and delivering the best solutions to our customers. As a recognized leader, EPAM Singapore achieved Great Place to Work® Certification in 2023 and is committed to providing our team with inspiring careers.
• You will have the opportunity to work with fellow talented technologists and accelerate your career by participating in our numerous upskilling, training, and certification programs. That is why EPAM Singapore was awarded Gold for Best In-House Certification Programmes in the Employee Experience Awards 2023 and Silver in the SkillsFuture Employers Awards 2022 for our efforts in championing employees' skills development and building a lifelong learning culture at the workplace. You can also look forward to developing holistically with the multiracial festivals and various wellness and cultural activities organized by our passionate colleagues here.