Lead Data Engineer - Capital Markets - Hybrid

We are seeking an exceptional Lead Data Engineer to join our FD Data team. The ideal candidate will be a seasoned data engineer with extensive experience in designing, developing, and optimizing data pipelines and infrastructure in the capital markets risk domain.

Req.#768873963

#LI-DNI

Responsibilities

• Develop and maintain data pipelines for efficient data processing and analysis
• Collaborate with cross-functional teams to identify business requirements and translate them into technical solutions
• Create and maintain technical documentation for all data engineering projects
• Work with data scientists to ensure models are production-ready
• Ensure all data engineering solutions are high-quality, reliable and scalable
• Troubleshoot and resolve data-related issues promptly and efficiently
• Stay up-to-date with emerging data engineering technologies and trends
• Participate in code reviews to ensure code quality and adherence to standards

Requirements

• Experience in risk analytics, including market risk or credit risk
• Familiarity with risk technology and calculations, including VaR, Stress Testing, Sensitivities, and P&L Vectors
• Strong software development skills in Python or another common programming language (e.g., Java or Scala), with a focus on best practices: low-level design documentation, clean and well-documented code, and thorough testing
• Expertise in Apache Airflow, with demonstrated experience designing, implementing, and managing workflows, DAGs, and tasks. A deep understanding of Airflow's architecture, best practices, and troubleshooting capabilities is mandatory
• Proficiency in deploying and managing Cloud Database Services, with a preference for Snowflake
• Advanced skills in SQL and Python for data manipulation and analysis
• Experience implementing cloud-based solutions using modern cloud technologies (preferably AWS)
• Familiarity with modern SDLC tooling, including Git, Bamboo, Jira, or similar
• Proven ability to implement and enforce data quality standards and practices
• 2-3 days onsite in office in Manhattan mandatory

Nice to have

• Good base of derivatives knowledge, pricing, risk management of structured products, options and more exotic derivatives
• Knowledge of additional data processing libraries and tools to enhance data engineering workflows
• Expertise in real-time data processing frameworks such as Apache Flink or Kafka Streams
• Experience building event-driven and/or streaming data services

We offer

• Medical, Dental and Vision Insurance (Subsidized)
• Health Savings Account
• Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
• Short-Term and Long-Term Disability (Company Provided)
• Life and AD&D Insurance (Company Provided)
• Employee Assistance Program
• Unlimited access to LinkedIn learning solutions
• Matched 401(k) Retirement Savings Plan
• Paid Time Off
• Legal Plan and Identity Theft Protection
• Accident Insurance
• Employee Discounts
• Pet Insurance
• Employee Stock Purchase Program

EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.

YouTube video player

This posting includes a good faith range of the salary EPAM would reasonably expect to pay the selected candidate. The range provided reflects base salary only. Individual compensation offers within the range are based on a variety of factors, including, but not limited to: geographic location, experience, credentials, education, training; the demand for the role; and overall business and labor market considerations. Most candidates are hired at a salary within the range disclosed. Salary range: $150,000 - $175,000. In addition, the details highlighted in this job posting above are a general description of all other expected benefits and compensation for the position.