Senior Data Engineer

Basic Description:
Test and validate ETL logic and Data Pipelines
Own the quality of every release into production with a data-driven approach
Create, deliver and continuously improve our quality processes for delivering operational data to address all types of subscriber and commerce operations to our stakeholders.
Partner with Data Analysts, Product and Engineering teams to deeply understand the underlying transactional systems behavior and business use cases.
Translate reporting and operational technical specifications, including calculations, custom groups, parameters, filtering criteria and/or aggregations into test requirements.
Build automated and reusable tests for data stores to improve quality and development velocity
Diagnose issues, report defects, and propose regression tests to catch recurring bugs
Mentor fellow Test Engineers on the team to ramp up on automation concepts and contribute towards expanding test coverage

Job Qualifications
3 - 5 years' experience in Quality validating ETL pipelines and Data Warehouses
Expert SQL knowledge and experience working with relational databases as well as a working familiarity with a variety of databases.
Good experience in data analytics, data engineering, data modeling, data warehousing, and big data platform
Strong programming (Scala/Java) or scripting skills (Python)
Experience with but not limited to JUnit/TestNG/BDD or similar tools
Experience in a range of common big data tools & technologies such as Airflow, Hive, Snowflake, Databricks, Spark etc.
Experience in working with large datasets (Terabytes or more)
Ability to operate effectively in a team-oriented and collaborative environment
Excellent communication skills and ability to interact with all levels of end users and technical resources