Overview
On Site
Accepts corp to corp applications
Contract - Contract
Skills
PYSPARK
Databricks
Azure Event Hub
Job Details
Hi,
Our client is looking for a Azure Data Engineer (PySpark) for Long Term Contract project in Las Vegas, NV (Hybrid). below is the detailed requirement.
Job Title : Azure Data Engineer (PySpark)
Location : Las Vegas, NV (Hybrid)
Duration : Long Term Contract
EXP : 12+ Years
Required Skills: Azure Event Hub, PySpark, Azure Key Vault, Databricks Workflows, Databricks CLI, Databricks SQL, Databricks Workspace Admin
Responsibilities:
- Lead the development and implementation of geospatial data solutions using PySpark and Databricks technologies.
- Oversee the integration of data from various sources into Azure Event Hub for real-time processing.
- Provide expertise in managing and securing data using Azure Key Vault.
- Develop and maintain Databricks Workflows to automate data processing tasks.
- Administer Databricks Workspace to ensure optimal performance and security.
- Utilize Databricks SQL to perform complex queries and generate insights from geospatial data.
- Implement and manage Databricks CLI for efficient data operations and management.
Qualifications:
- Possess strong expertise in PySpark for data processing and analysis.
- Have extensive experience with Azure Event Hub for real-time data integration.
- Demonstrate proficiency in managing data security with Azure Key Vault.
- Show advanced knowledge of Databricks Workflows for automation.
- Have experience in Databricks Workspace administration.
- Be skilled in Databricks SQL for querying and data analysis.
- Be proficient in using Databricks CLI for data operations.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.