Data Solution Architect (M/F/D)

- Architect End-to-End Data Solutions - Design and implement data ingestion, transformation, and storage pipelines using Azure Data Factory, Azure Databricks, and PySpark - Develop lakehouse architectures leveraging Delta Lake and medallion patterns (Bronze/Silver/Gold layers) - Create conceptual, logical, and physical data models for structured and semi-structured data - Implement data governance using Azure Purview and Unity Catalog for metadata and access control - Optimize Databricks clusters for cost and performance; implement auto-scaling and caching strategies - Apply PySpark best practices for distributed data processing and transformation - Integrate with Azure Synapse Analytics, Power BI, and other BI tools for reporting and visualization - Enable real-time and batch data processing using Event Hubs, Stream Analytics, and Spark Structured Streaming - Ensure adherence to data security, privacy, and regulatory compliance standards - Implement RBAC, VNet injection, and encryption for data at rest and in transit - Work closely with business stakeholders, data engineers, and data scientists to translate requirements into technical solutions - Mentor team members on PySpark, Databricks, and Azure best practices