DataBricks dev with Python

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - Independent
Contract - 6 Month(s)
No Travel Required
Able to Provide Sponsorship

Skills

Collaboration
Data Architecture
Data Processing
Data Quality
Database
Databricks
Extract
Transform
Load
Microsoft Azure
NoSQL
Oracle
Performance Monitoring
Python
RDBMS
Scala
Scalability
Workflow

Job Details

DataBricks dev with Python

Location: Dallas, TX , onsite

Design and implement scalable data processing solutions using Azure Databricks.

Collaborate with data Scientist and analysts to understand data needs.

Optimize data pipelines and workflows for performance and scalability.

Ensure data quality and integrity throughout Data Transformation and Load processes.

Develop and maintain data architecture and best practices.

Troubleshoot and resolve data-related issues in a timely manner.

Setup Performance Monitoring and Alerting for pipeline and data integrity

Proficient in ETL between different RDBMS like Oracle to Data Bricks and NoSQL Databases.

Working knowledge in python language

Pyspark/ Scala.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.