Job Description
Role- Azure Data Engineer
Locations- Seattle, WA/Remote
Duration- 6-12 Months
USC/GC/H4
Azure Synapse/Fabric-SQL-PowerBI-Notebooks-Spark/Pyspark-Databricks Job Description: We are seeking a skilled and motivated Data Engineer to join our dynamic team. The successful candidate will be responsible for developing, maintaining, and optimizing data pipelines and ETL processes, ensuring data quality, and providing business intelligence insights. This role requires strong proficiency in SQL, an extensive understanding of the Azure stack, experience with Azure Synapse Analytics tools, and a solid grasp of data engineering principles.
Key Responsibilities :
Audit and Validation: Author, test, and schedule audits for data validation reports utilizing Azure SQL stored procedures.
SQL Expertise: Employ advanced MS SQL skills to effectively manage and analyze data.
ETL Development: Design and maintain ETL processes using Azure Synapse Analytics tools, Azure Data Services (Azure Data Factory, Azure Databricks, Azure Functions, Azure Notebooks, Storage Account, Event Hubs, Logic Apps) with strong knowledge of PySpark, SparkSQL, Kusto, etc.
Business Intelligence: Address and resolve data discrepancies while providing actionable insights.
Data Management: Comprehend data lineage, data quality, and relationships. Oversee data extraction, transformation, and loading jobs, and promptly respond to any job failures.
Platform Support: Deliver development support for platforms and applications as assigned by the designated manager.
Production Support: Demonstrate flexibility in supporting production issues.
Development Efforts: Allocate 20%-30% of time to development efforts, including the automation of operational activities, data quality checks, application feature development, development of tabular models, bug fixes, and reporting.
Data Analysis: Display exceptional data analysis skills and domain understanding.
Qualifications: Over 10 years of experience, with a minimum of 5-7 years specifically in the Azure stack related to Data Engineering and Analysis.
Intermediate to expert-level proficiency in Microsoft SQL Server, including writing complex queries, debugging existing stored procedures, improving database performance, and developing quality audits.
Proficient with the Azure stack, including Synapse Analytics, Spark/Python, Azure SQL, Azure Data Factory (ADF), Kusto, among others.
Knowledgeable in ETL tools, particularly Azure Data Services, with a good understanding of PySpark and SparkSQL.
Experienced in building PowerBI reports and dashboards, with the ability to extract actionable insights.
Possesses excellent analytical and problem-solving skills.
Capable of creating clear and concise documentation.
Able to work effectively in an Agile environment, handle ambiguity, and utilize critical thinking to achieve desired results.
Strong communication skills, with the ability to collaborate with customer stakeholders and cross-functional teams by effectively understanding business requirements.
Preferred skills: Prior experience in Microsoft landscape or Corporate Finance is preferred.
Experience working with multi-geographical teams and in an onshore-offshore model is required.
Knowledge of MS Fabric is advantageous, along with a general willingness to learn new technologies.
Job Tags
Remote job, Offshore,