Azure Architect (Databricks Platform & Data Engineering)

Your Team Responsibilities

At MSCI, we power better investment decisions through data and technology. The HR Technology team drives the digital transformation of our people data ecosystem—enabling strategic decision-making, automation, and analytics across global talent, payroll, and workforce systems. We are seeking an Azure Architect with deep Databricks expertise to lead the design and implementation of our next-generation HR data and analytics platform—establishing the foundation for AI-driven insights and scalable cloud transformation.

As the Azure Architect (Databricks Specialist), you will lead the design and build of modern data architectures on Microsoft Azure using Databricks, Data Lake, and other PaaS services. You will play a pivotal role in shaping the Medallion architecture, data pipelines, and AI integration strategy, including building and operationalizing AI agents using Databricks’ Agent Framework (Agent Bricks).

This is a senior, highly technical leadership role, ideal for an architect who blends deep engineering expertise with an innovation mindset to enable AI-first capabilities across HR and beyond.

Your Key Responsibilities

Platform Architecture & Design

• Architect and implement Azure-based data solutions using Databricks, Data Factory, Synapse Analytics, and Data Lake services.
• Design, build, and optimize a Medallion architecture (Bronze, Silver, Gold) supporting both HR and enterprise data domains.
• Develop data pipelines, APIs, and orchestration frameworks that enable seamless data ingestion, transformation, and delivery.
• Establish and maintain data governance, metadata, and lineage frameworks using Databricks Unity Catalog and Azure Purview.

Implementation & Engineering

• Build and maintain ETL/ELT frameworks, data APIs, and real-time workflows connecting diverse HR and enterprise systems.
• Leverage AI and ML capabilities within Databricks, including MLflow, feature stores, and the Agent Framework (Agent Bricks), to build intelligent data agents for automation, monitoring, and analytics enrichment.
• Design and implement AI agent pipelines that can reason over HR data models, automate transformations, and enhance analytical outcomes.
• Apply best practices for performance optimization, scalability, and cost efficiency within the Azure ecosystem.
• Integrate CI/CD pipelines and infrastructure-as-code approaches (Terraform, Bicep, or Azure DevOps).

Leadership & Strategy

• Serve as the technical authority for Azure and Databricks architecture within HR Technology.
• Partner with HR, Analytics, and Infrastructure leaders to define and execute the data and AI modernization roadmap.
• Establish standards, patterns, and reusable frameworks for data engineering, AI agents, and automation.
• Mentor engineers and champion a culture of innovation, experimentation, and delivery excellence.

Your Skills And Experience That Will Help You Excel

• Education: Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
• Experience: Minimum 12 years of hands-on experience architecting and delivering large-scale data platforms using Azure and Databricks.
• Proven success in deploying Medallion architectures, governed data pipelines, and AI-driven data workflows.
• Expertise in:

• Azure Data Lake, Data Factory, and Synapse Analytics
• Databricks (Delta Lake, Unity Catalog, Spark optimization)
• Python, SQL, PySpark, and API development (REST, GraphQL)
• Infrastructure as code (Terraform, Bicep) and DevOps automation
• AI/ML frameworks within Databricks, including Agent Bricks and MLflow

• Strong grounding in data governance, security, and compliance best practices.
• Excellent communication and collaboration skills; ability to translate complex architecture into business outcomes.

Preferred Skills

• Knowledge of Azure Purview, Power BI, and data cataloging tools.
• Experience implementing Databricks Unity Catalog, Delta Live Tables, and AI agent orchestration within enterprise contexts.
• Familiarity with HR data models and effective design for analytics and workforce intelligence.
• Understanding of LLM integration and AI agent frameworks for data enrichment and automation.

About MSCI What we offer you

• Transparent compensation schemes and comprehensive employee benefits, tailored to your location, ensuring your financial security, health, and overall wellbeing.
• Flexible working arrangements, advanced technology, and collaborative workspaces.
• A culture of high performance and innovation where we experiment with new ideas and take responsibility for achieving results.
• A global network of talented colleagues, who inspire, support, and share their expertise to innovate and deliver for our clients.
• Global Orientation program to kickstart your journey, followed by access to our Learning@MSCI platform, LinkedIn Learning Pro and tailored learning opportunities for ongoing skills development.
• Multi-directional career paths that offer professional growth and development through new challenges, internal mobility and expanded roles.
• We actively nurture an environment that builds a sense of inclusion belonging and connection, including eight Employee Resource Groups. All Abilities, Asian Support Network, Black Leadership Network, Climate Action Network, Hola! MSCI, Pride & Allies, Women in Tech, and Women’s Leadership Forum.

At MSCI we are passionate about what we do, and we are inspired by our purpose – to power better investment decisions. You’ll be part of an industry-leading network of creative, curious, and entrepreneurial pioneers. This is a space where you can challenge yourself, set new standards and perform beyond expectations for yourself, our clients, and our industry.

MSCI is a leading provider of critical decision support tools and services for the global investment community. With over 50 years of expertise in research, data, and technology, we power better investment decisions by enabling clients to understand and analyze key drivers of risk and return and confidently build more effective portfolios. We create industry-leading research-enhanced solutions that clients use to gain insight into and improve transparency across the investment process.

MSCI Inc. is an equal opportunity employer. It is the policy of the firm to ensure equal employment opportunity without discrimination or harassment on the basis of race, color, religion, creed, age, sex, gender, gender identity, sexual orientation, national origin, citizenship, disability, marital and civil partnership/union status, pregnancy (including unlawful discrimination on the basis of a legally protected parental leave), veteran status, or any other characteristic protected by law. MSCI is also committed to working with and providing reasonable accommodations to individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation for any part of the application process, please email Disability.Assistance@msci.com and indicate the specifics of the assistance needed. Please note, this e-mail is intended only for individuals who are requesting a reasonable workplace accommodation; it is not intended for other inquiries.

To all recruitment agencies MSCI does not accept unsolicited CVs/Resumes. Please do not forward CVs/Resumes to any MSCI employee, location, or website. MSCI is not responsible for any fees related to unsolicited CVs/Resumes.

Note on recruitment scams We are aware of recruitment scams where fraudsters impersonating MSCI personnel may try and elicit personal information from job seekers. Read our full note on careers.msci.com