Job Title: Data Engineer ( Databricks Platform)

Location: Colombo, Sri Lanka

Location Type: On-site

Employment Type: Full-Time

About the Role

We are seeking a proactive, hands-on Databricks Platform & Data Engineer with 2 to 5 years of experience to support the strategic transition toward a unified Databricks cloud platform. In this role, you will assist in migrating legacy architectures (such as Azure Synapse), build resilient ETL/ELT pipelines, and progressively take ownership of Databricks platform administration, access controls, and governance. You will work closely with data teams across multiple business units to establish strong internal capabilities and streamline analytics delivery.

Responsibilities

Platform Migration & Modernization: Assist in architectural migration and data transition from legacy data platform environments (e.g., Azure Synapse) to a unified Databricks architecture.
Pipeline Engineering: Design, build, and optimize scalable batch and real-time ETL/ELT data pipelines using Apache Spark, Delta Lake, and orchestration platforms such as Azure Data Factory (ADF).
Platform Administration & Security: Oversee Databricks environment administration, including cluster optimization, workspace organization, role-based access control (RBAC), and governance policy enforcement.
Data Quality & Monitoring: Implement automated data quality checks, monitoring alerts, and troubleshooting frameworks to ensure pipeline reliability and data integrity.
Cross-BU Collaboration: Partner with data analysts, data scientists, and business unit teams to model data, optimize queries, and streamline analytical workflows.
Capability Building: Standardize platform management workflows, document data architecture, and build internal technical capability to reduce operational reliance on third-party vendors.

Requirements

Educational Qualifications: Bachelor’s degree in Computer Science, Data Engineering, Information Technology, Software Engineering, or a related discipline.
Years of Experience: Minimum 2 to 5 years of progressive experience in data engineering, BI architecture, or cloud data platform administration.
Technical Stack: Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Azure Data Factory (ADF), Azure Synapse (or SQL-based data warehouses), and SQL/Python scripting.
Platform & Governance Skills: Solid understanding of data pipeline orchestration, cloud security controls, access management, and data quality frameworks.
Core Competencies: Strong analytical and troubleshooting mindset, proactive ownership, excellent team collaboration, and effective communication skills.