As a Data Engineer, you will design, build, and maintain scalable data pipelines and infrastructure to support NCINGA’s analytics and AI/ML initiatives. You will work with cross-functional teams to ensure data is reliable, accessible, and optimized for business intelligence.
Key Responsibilities:
Design and maintain data integration and processing pipelines, storage solutions, and computing infrastructure.
Develop and manage streaming data pipelines using Google Cloud Dataflow, Apache Beam, MQTT, and Pub/Sub.
Implement ETL processes with Apache Beam and PySpark for scalable data transformation.
Manage data warehousing solutions for efficient storage, retrieval, and query performance.
Design BI dashboards and reporting solutions with Looker, Grafana, and Looker Studio.
Collaborate with AI/ML teams to ensure reliable data pipelines support model training and deployment.
Ensure data quality, governance, and compliance standards are met across all data workflows.
Qualifications:
Bachelor’s degree in Computer Science, Data Science, or related field (Master’s preferred).
1.5+ years of professional experience in data engineering and integration.
Hands-on expertise with Google Cloud and AWS platforms.
Experience developing ETL pipelines and data warehouses.
Proficiency in Python, SQL, Apache Beam, and PySpark.
Familiarity with BI tools such as Looker, Grafana, and Looker Studio.
Experience with streaming technologies (Dataflow, Pub/Sub, MQTT).
Knowledge of Docker/Kubernetes, Git, and cloud-native development practices.
Google Cloud Professional Data Engineer or similar certification is a plus.
Knowledge of MLOps, model deployment, and data governance frameworks is desirable.
Strong communication, analytical thinking, and team collaboration skills.
KPIs:
Deliver reliable, scalable data pipelines that enable analytics and AI/ML initiatives.
Ensure efficient and secure data storage, integration, and transformation processes.
Maintain high-quality, well-documented ETL and data workflows.
Support business and customer teams with BI dashboards and actionable insights.
Collaborate effectively with data science and engineering teams to meet project objectives.
Contribute to best practices in data governance, cloud architecture, and performance optimization.
At NCINGA, you’ll be at the forefront of powering intelligent business decisions through robust data infrastructure. As a Data & ML Engineer, you’ll design, build, and maintain scalable data pipelines, integrate BI solutions, and ensure reliable data for AI/ML initiatives. You’ll collaborate closely with cross-functional teams to optimize ETL workflows, manage cloud-based platforms, and deliver actionable insights that drive real-world impact.
Apply now and help build the data backbone behind NCINGA’s next chapter of innovation!
Job Type: Full Time Job Location: Colombo, Sri Lanka