Data Solution Architect (Databricks)- Medallion Architecture - Remote

Detailed Description From Employer:

Job Title: Data Solution Architect (Databricks)- Medallion Architecture

Location: Remote (USA)
Employment Type: Contract

Job Summary

We are seeking a highly experienced Data Solution Architect with deep expertise in Databricks and modern cloud data platforms to lead the design and implementation of enterprise-scale data solutions. The ideal candidate will have extensive experience architecting end-to-end data platforms, implementing Medallion Architecture, designing scalable data models, and enabling advanced analytics across the organization.

This is a hands-on architecture role requiring strong technical leadership, data engineering expertise, and the ability to define enterprise data strategies that support business intelligence, AI/ML, and real-time analytics.

Required Skills & Experience

Core Qualifications

• 10+ years of experience in Data Engineering, Data Architecture, or Data Platform Design.
• 5+ years of hands-on experience with Databricks in enterprise environments.
• Proven experience designing and implementing end-to-end cloud data architectures.
• Strong expertise in Lakehouse Architecture and modern data platforms.
• Experience leading architecture discussions and mentoring engineering teams.

Technical Skills

• Extensive experience with Databricks (Delta Lake, Unity Catalog, Delta Live Tables, Workflows).
• Deep understanding and implementation experience of the Medallion Architecture (Bronze, Silver, Gold).
• Strong expertise in Data Modeling, including:
• Conceptual Data Modeling
• Logical Data Modeling
• Physical Data Modeling
• Dimensional Modeling (Star & Snowflake Schema)
• Normalized Data Models (3NF)
• Strong SQL programming and performance tuning.
• Experience designing scalable ETL/ELT pipelines.
• Hands-on experience with Apache Spark and PySpark.
• Experience with cloud platforms such as Azure, AWS, or Google Cloud Platform.
• Knowledge of data governance, metadata management, and data quality frameworks.
• Experience with streaming data and real-time ingestion is preferred.
• Familiarity with orchestration tools such as Airflow, Azure Data Factory, or similar.

Key Responsibilities

Data Architecture

• Design enterprise-scale data architectures using Databricks Lakehouse Platform.
• Define scalable and reusable architecture standards and best practices.
• Develop modern cloud-native data solutions supporting analytics, reporting, and AI initiatives.
• Design robust data ingestion frameworks for batch and streaming workloads.

Medallion Architecture

• Design and implement Bronze, Silver, and Gold data layers.
• Establish data transformation standards across ingestion, cleansing, enrichment, and consumption layers.
• Ensure scalability, performance, governance, and maintainability of the Lakehouse architecture.

Data Modeling

• Design conceptual, logical, and physical data models.
• Build optimized dimensional models for business intelligence and analytics.
• Create enterprise semantic models to ensure consistent business metrics.
• Collaborate with business stakeholders to translate requirements into scalable data structures.

Data Engineering Leadership

• Guide engineering teams in implementing scalable data pipelines.
• Review architecture, code quality, and performance optimization strategies.
• Define standards for CI/CD, deployment automation, monitoring, and observability.
• Drive best practices in data governance, security, and compliance.

Performance Optimization

• Optimize Spark workloads and Databricks clusters.
• Improve query performance through partitioning, indexing, caching, and Delta Lake optimization.
• Design cost-efficient cloud data solutions.

Collaboration

• Partner with business stakeholders, data engineers, BI developers, and data scientists.
• Lead architecture reviews and technical design sessions.
• Provide technical leadership throughout project delivery.

Preferred Qualifications

• Experience with Microsoft Azure, AWS, or Google Cloud Platform.
• Experience with Delta Live Tables and Unity Catalog.
• Knowledge of Data Mesh or Data Fabric architectures.
• Exposure to Power BI, Tableau, or other BI platforms.
• Experience supporting AI/ML workloads on Databricks.
• Databricks certifications are highly preferred.

Education

• Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.

What We're Looking For

• Strong architecture and solution design skills.
• Excellent communication and stakeholder management abilities.
• Proven experience delivering enterprise-scale data modernization initiatives.
• Ability to work independently in a remote environment while collaborating effectively across distributed teams.