Senior Azure Data Engineer Job at HSO, New York, NY

QmdBN1ZrZFVyNkZLYTB0ZzFUczliUW1VWkE9PQ==
  • HSO
  • New York, NY

Job Description

Senior Azure Data Engineer wanted in New York, NY to Design and develop data pipelines and ETL processes to ingest, transform, and load data from various sources into data warehouses or data lakes.

  • Build and maintain data models and data structures to support analytical and reporting requirements aligning with business objectives.

  • Work closely with data scientists and analysts to operationalize machine learning models, ensuring seamless integration and scalability in production environment.

  • Collaborate with cross-functional teams to integrate data engineering solutions into client applications and enterprise systems.

  • Optimize and tune data pipelines and systems for performance, scalability and cost efficiency.

  • Ensure data quality and integrity throughout the data lifecycle, implementing rigorous monitoring and validation processes to ensure data accuracy and consistency.

  • Stay current with industry trends and best practices and recommend new technologies and approaches.

  • Ensure customer satisfaction by delivering data solutions that exceed expectations, fostering strong relationships, and ensuring alignment with customer objectives and outcomes.

  • Build and design efficient pipelines to get data from different source systems like D365 F&O, CE, Salesforce, Workday, SAP, Apis, SFTP, on-prem data sources.

  • Design and build reusable data extraction, transformation, and loading processes using Synapse pipelines, spark notebooks, fabric dataflows and fabric pipelines.

  • Design or redesign current flows to increase throughput and streamline data for downstream Applications/Consumers.

  • Use Azure Data Factory or Synapse to create multiple complex pipelines and activities using both Azure and On-Prem data stores for full and incremental data loads into ADLS.

  • Work with PowerShell Scripting and ARM templates. Use Cloud concepts such as IaaS, PaaS, SaaS. Design, build, and support advanced cloud automation workflows and tools used to support automated CI/CD pipelines.

  • Use data platforms, data warehouses, Data Lake, and ETL. Use ADF, Spark, Databricks, Python.

  • Use Microsoft fabric data factory and data engineering.

  • Use Data Mesh architecture, Azure Purview, and Data Governance frameworks.

  • Use Common Data Model, Dataverse, Power BI, Data Flows, Data API Gateways, SQL, T-SQL stored procedures and Git and GitHub.

Requirements

  • Option to telecommute.
  • Bachelor’s degree in Computer Science or Data Engineering plus 5 years of experience in job offered or as Software Engineer.
  • Salary: $175,947/yr.

Email resume to: HSO Enterprise Solutions, LLC at [email protected]

Benefits

We offer competitive pay with and performance-based bonus. Our employees also enjoy unlimited paid time off and a flexible and affordable benefits program designed to help you be and stay well, including: medical, dental & vision coverage, flexible spending accounts, health reimbursement account, and a 401(k) plan with a company match. Additionally, you’ll have the benefit of working alongside enthusiastic and energetic teammates in a dynamic and thriving environment.

HSO is an Equal Opportunity Employer.

#LI-BD2

Job Tags

Remote job, Flexible hours,

Similar Jobs

Sony Pictures Entertainment

Visual Development Artist Job at Sony Pictures Entertainment

Visual Development ArtistLos Angeles, California, United StatesArtists in this role will work closely with a hardworking team of directors...  ...with Directors to translate the vision for the film from concept to finished presentation. This is done through the use of... 

Da Dao Qi Yun Group Co., Ltd

Customer assistant Job at Da Dao Qi Yun Group Co., Ltd

1) Actively seek verbal feedback from customers.2) Create a warm and welcoming arrival for visiting guests, ensuring that they feel at a modern super high-rise commercial building when they arrive.3)Organizes and coordinates the Concierge services to ensure that in line...

PAM Health

Food Services Technician - Part-Time Job at PAM Health

 ...Opportunities for growth and advancement Flexible scheduling Employee Bonus Referral Program $$$ Supportive leadership The Food Service Technician supports both patient and retail food and nutrition services, including food production, cashiering, patient... 

The American Association of Immunologists

Postdoctoral Associate-Computational Biology/Cancer Immunology Job at The American Association of Immunologists

Postdoctoral Associate-Computational Biology/Cancer ImmunologyBoston UniversityBoston, MassachusettsWe are looking for a post-doctoral fellow with expertise and interest in Computational Biology/Bioinformatics and Cancer Immunology to work in a research consortium... 

PACTERA TECHNOLOGY LTD

E-commerce Content Copywriter(English, Spanish, and French) Job at PACTERA TECHNOLOGY LTD

 ...Content Strategy Team for multiple languages, including English, Spanish, and French. This role will involve content creation, editing...  ...banners to push notifications, EDMs, navigational text, promotions/marketing material, brand names/slogans and much more.The ideal...