Job Title:
Solution Architect – Azure Databricks
Location:
Bogota, Colombia
Travel:
As required based on project needs
About the Role
Celebal Technologies is seeking an experienced
Data Architect
with deep expertise in
Azure Databricks, Unity Catalog, PySpark, and Delta Live Tables
.
In this role, you will lead the design, architecture, and delivery of advanced data solutions, collaborating closely with cross-functional teams to ensure scalable, secure, and high-performance implementations.
Key Responsibilities
- Lead solution architecture and design for Azure Databricks projects, ensuring best practices and performance optimization.
- Implement and manage
Unity Catalog
for data governance and security.
- Develop and optimize data pipelines using
PySpark
and
Delta Live Tables
.
- Collaborate with stakeholders to translate business requirements into technical solutions.
- Provide technical leadership and guidance to development teams.
- Ensure architecture compliance with enterprise standards and security policies.
- Support pre-sales activities, including solution design, effort estimation, and client presentations.
- Travel to client locations as needed for project delivery and stakeholder engagement.
Required Skills & Qualifications
- Proven experience as a Solution Architect or Senior Data Engineer working with
Azure Databricks
.
- Hands-on expertise in
Unity Catalog
setup and governance.
- Strong proficiency in
PySpark
for data processing and transformation.
- Experience with
Delta Live Tables
for building automated and reliable data pipelines.
- In-depth understanding of Azure cloud services, data architecture, and big data technologies.
- Excellent problem-solving, communication, and stakeholder management skills.
Preferred Qualifications
- Experience with other Azure data services (e.g., Azure Data Factory, Azure Synapse).
- Familiarity with enterprise data governance frameworks.
- Prior consulting or client-facing experience in large-scale data projects.