Azure Data Engineer architect - Synapse, Shuvel Digital, Vienna, VA
Shuvel Digital -
Vienna, VA,
US
Azure Data Engineer architect - Synapse
Date Posted: 2024-06-06
Job description
Location: Vienna, VA-Hybrid-1 day a week onsite needed.
Description:
Description:
- Provide technical architecture guidance and expertise in developing, architecting, and maintaining Azure Synapse Analytics end to end solution, Azure Databricks, spark pool, and monitoring of high-volume of complex data warehouse and analytical processes.
- Experience in designing and architecting end to end Analytics solution in Synapse.
- Experience in designing and architecting Change data capture frameworks.
- Demonstrable experience in designing and orchestrating data pipelines to load data efficiently in Synapse dedicated SQL Pool.
- Experience in Azure Data Lake, Azure Data Factory, Azure data flow, Azure functions and Databricks.
- Create data pipeline designs, source to target mappings, and data models.
- Knowledge of data engineering requirements and design practices including fact qualifier matrices, dimensional modeling, business questions
- Investigate data quality, perform data profiling, and understand the meaning of complex operational data.
- Strong relationship and communication skills to collaborate and document end-users needs.
- Work directly with our end users to apply data and analytics to business challenges.
- Experience in architecting solutions to optimize dedicated SQL pools in Azure Synapse Analytics using different data distribution methods, partitioning, and query optimization.
- Experience in architecting consumption patterns like Analytical, Operational, Real-time, and bulk consumption patterns.
- Experience in optimization of data ingestion, curation, Synapse analytics, analyzing large data sets, and Knowledge of Performance/cost optimization techniques
- Experience in large scale warehouse migration from on-prem to cloud.
- PowerBI architect experience is preferred. Relevant certification is a plus.