Azure Data Engineer

Overview

Hybrid
Depends on Experience
Contract - Independent
Contract - W2
Contract - 12 Month(s)

Skills

Azure Data Engineer
Data Engineer
Big Data
Azure
Data Lake
Data Factory
Ansible
GitHub
SQL
ETL
Python
Bash
PowerShell
Docker
Kubernetes

Job Details

Consultant needs to be local to NY or NJ only

 

Job Title: Azure Data Engineer


Location: New York, NY (Hybrid Role)

Experience: 2-3 Years of Project Experience in Investment Banking Domain

Duration: 12+Months (W2 / 1099 Contract)

 

Job Description:

This hybrid role requires 2-3 years of hands-on experience in Azure Data Engineering, with expertise in automating data pipelines and infrastructure management in the investment banking domain. The ideal candidate will be responsible for developing, managing, and optimizing data solutions on the Azure platform.

 

Key Responsibilities:

  • Design, implement, and manage data pipelines using Azure Data Factory and other Azure data services.
  • Automate deployment processes and infrastructure management using Ansible and GitHub Actions.
  • Collaborate with data scientists, analysts, and developers to integrate data solutions with business applications.
  • Ensure data quality, reliability, and performance across the Azure platform.
  • Monitor and troubleshoot data workflows, resolving issues efficiently.
  • Maintain version control and continuous integration pipelines for data projects.
  • Ensure adherence to security and compliance standards within the investment banking environment.

Qualifications:

  • 9 years of experience as an Azure Data Engineer with hands-on expertise in Ansible and GitHub Actions.
  • Strong experience with Azure data services (Azure Data Factory, Azure SQL, Azure Blob Storage, etc.).
  • Experience in automating infrastructure and deployment processes using Ansible and GitHub Actions.
  • Strong knowledge of data engineering principles, ETL processes, and data warehousing.
  • Experience working in the investment banking or financial services domain.
  • Proficient in scripting languages like Python, Bash, or PowerShell.
  • Strong problem-solving and analytical skills.
  • Excellent communication and collaboration skills.
  • Bachelor s degree in Computer Science, Engineering, or a related field.

Preferred Skills:

  • Familiarity with Data Lake architecture and big data solutions on Azure.
  • Knowledge of containerization and orchestration tools (Docker, Kubernetes).
  • Familiarity with Agile development methodologies.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.