Overview
Accepts corp to corp applications
Contract - W2
Contract - 8 day((s))
Skills
Azure Data Engineer
Pyspark
Job Details
Top skill: Hands-on lead skills in PySpark, Databricks SQL and Medallion architecture. The candidate needs to be an expert to lead large DE teams and take responsibility for architecture and performance tuning.
Sr. Lead Data Engineer:
- Implementation of data pipelines using big data tools, such as Azure Data Factory, PySpark, SparkSQL, SQL, and Azure DevOps, which are critical for building scalable and efficient data workflows.
- Hands-on expertise with PySpark programming.
- Hands-on with SQL (Stored procedures, Complex SQL queries), data modelling.
- ETL (Extract, Transform, Load) scripts and workflow configurations.
- Data validation rules and quality checks.
- Analysing functional specifications and developing dimensional models.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.