Senior Data Engineer
- Advansys
- مدينة نصر، محافظة القاهرة، مصر
- Full-time
وصف الوظيفة
- Designed and implemented a comprehensive ETL data engineering pipeline utilizing the Medallion architecture combined with a Data Lakehouse infrastructure featuring Delta Lake.<\/li><\/ul>
- Successfully ingested and archived multi-source data within Azure Data Lake Storage (ADLS) Gen2, optimizing data accessibility.<\/li>
- Executed data processing and transformation on raw datasets through Azure Data Factory, Azure Databricks, and Pyspark.<\/li>
- Leveraged Databricks for analytics purposes to transform and transport data between various layers by developing delta tables.<\/li>
- Utilized a range of Azure services including Azure SQL, Azure Key Vault, and Azure Synapse Analytics.<\/li>
- Implemented Azure DevOps for continuous integration and continuous delivery (CI/CD) pipelines, automating deployment and data engineering tasks.<\/li>
- Engaged in collaborative efforts with data scientists and analysts regarding data transformations and analytics initiatives.<\/li><\/ul>
متطلبات الوظيفة
ETL Tools : SSIS and Power Query, Azure Data Factory
Reporting Tool : Power BI, SSRS, Qlik
OLAP Tools : SSAS and Azure SSAS
Database : SQL Server 2016, SQL Server 2017, Azure SQL
Languages : T-SQL, DAX, Power Query and U-SQL
Operating Systems : Windows 8.1 & Windows 10 and Windows Server.
- 8+yrs of extensive experience in business intelligence applications design, development, and maintenance of SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS),
- Power BI Service, and SQL Server Analytical Services, Tabular Models, SQL Server.
- 2+ Years of experience in Python, Qlik, Azure Data Factory (ADF) Azure Synapse analytics, Azure Analysis Services.
