Overview
On Site
$130,000 - $142,000 annually
Full Time
Skills
User Administration
Access Control
Cost Control
Unity
Data Governance
Collaboration
Analytical Skill
Data Lake
Storage
Data Integration
Firewall
Management
DevOps
Continuous Delivery
Version Control
Continuous Integration
Continuous Integration and Development
Budget
Scripting
Python
PySpark
Windows PowerShell
Bash
Workflow
Extract
Transform
Load
Big Data
Backup & Restore
Communication
SQL
Data Management
Performance Tuning
Optimization
Microsoft Azure
Data Science
Machine Learning (ML)
Disaster Recovery
Databricks
Cloud Computing
Data Security
Regulatory Compliance
Artificial Intelligence
Messaging
Job Details
RESPONSIBILITIES:
Kforce is working with a client in search of a Senior Administrator - Azure Databricks to join their team in NY! This position is full time, direct hire and on-site 1-day a week.
Summary:
As an Azure Databricks Administrator, you will be responsible for managing and maintaining the Databricks platform, ensuring optimal performance and security. This role is crucial in overseeing user administration, managing Azure storage solutions, and implementing CI/CD pipelines using Azure DevOps. By leveraging a deep understanding of Databricks architecture and proficiency in scripting languages, the administrator will automate tasks and enhance the efficiency of data operations.
Responsibilities:
* Manage and maintain Azure Databricks Platform, workspaces, clusters, and jobs
* Oversee user administration including access controls and permissions
* Handle library installations, runtime management, and policy enforcement
* Implement/analyze cost control measures and monitor platform usage and performance
* Administer Unity Catalog for data governance and security
* Collaborate with data engineers, data scientists, and analysts to optimize and streamline data workflows, and analytical pipelines on the Databricks platform
* Manage Azure storage solutions, including Blob Storage and Data Lake Storage
* Administer Azure Key Vault for secure storage of secrets and keys
* Configure and manage Azure Data Factory for data integration and ETL processes
* Implement and manage VNETs, firewalls, Azure policies and security best practices
* Implement and manage Azure DevOps for CI/CD pipelines and version control
* Implement best practices for automated deployment and continuous integration
* Set up budgets and alerts to monitor and control Azure costs and spend
* Implement monitoring solutions for platform health and performance
* Configure alerts for proactive issue detection and resolution
* Databricks Lakehouse Monitoring
REQUIREMENTS:
* Minimum of Bachelor's degree in Computer Science, Information Systems, or Engineering
* 10+ years of related professional experience administering data platforms
* 5+ years of experience with Azure Databricks Lakehouse Platform
* Proficiency in scripting languages such as Python/PySpark, PowerShell, or Bash
* Experience in automating administrative tasks and workflows
* Knowledge of security best practices and compliance requirements
* Experience with ETL processes, data pipelines, and big data technologies
* Experience with backup and restore procedures for Databricks and Azure services
* Ability to troubleshoot and resolve issues in a timely and efficient manner
* Strong verbal and written communication skills
* Ability to document processes, procedures, and configurations clearly
* Commitment to providing high-quality support to internal/external users and stakeholders
* Ability to understand and address the needs of internal and external customers
* Team player with the ability to work collaboratively with cross-functional teams
* Flexibility to adapt to changing requirements and priorities
* Willingness to learn new technologies and continuously improve skills
Preferred Qualifications:
* Deep understanding of Databricks architecture, features, and best practices
* Experience with Delta Lake and Databricks SQL for advanced data management
* Experience in performance tuning and optimization for both Databricks and Azure environments
* Experience supporting/administering data science and ML workloads in Databricks
* Knowledge of disaster recovery planning and implementation
* Experience integrating Databricks with other data platforms and tools
* Understanding of hybrid and multi-cloud environments
* Experience implementing data protection measures and ensuring regulatory compliance
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Kforce is working with a client in search of a Senior Administrator - Azure Databricks to join their team in NY! This position is full time, direct hire and on-site 1-day a week.
Summary:
As an Azure Databricks Administrator, you will be responsible for managing and maintaining the Databricks platform, ensuring optimal performance and security. This role is crucial in overseeing user administration, managing Azure storage solutions, and implementing CI/CD pipelines using Azure DevOps. By leveraging a deep understanding of Databricks architecture and proficiency in scripting languages, the administrator will automate tasks and enhance the efficiency of data operations.
Responsibilities:
* Manage and maintain Azure Databricks Platform, workspaces, clusters, and jobs
* Oversee user administration including access controls and permissions
* Handle library installations, runtime management, and policy enforcement
* Implement/analyze cost control measures and monitor platform usage and performance
* Administer Unity Catalog for data governance and security
* Collaborate with data engineers, data scientists, and analysts to optimize and streamline data workflows, and analytical pipelines on the Databricks platform
* Manage Azure storage solutions, including Blob Storage and Data Lake Storage
* Administer Azure Key Vault for secure storage of secrets and keys
* Configure and manage Azure Data Factory for data integration and ETL processes
* Implement and manage VNETs, firewalls, Azure policies and security best practices
* Implement and manage Azure DevOps for CI/CD pipelines and version control
* Implement best practices for automated deployment and continuous integration
* Set up budgets and alerts to monitor and control Azure costs and spend
* Implement monitoring solutions for platform health and performance
* Configure alerts for proactive issue detection and resolution
* Databricks Lakehouse Monitoring
REQUIREMENTS:
* Minimum of Bachelor's degree in Computer Science, Information Systems, or Engineering
* 10+ years of related professional experience administering data platforms
* 5+ years of experience with Azure Databricks Lakehouse Platform
* Proficiency in scripting languages such as Python/PySpark, PowerShell, or Bash
* Experience in automating administrative tasks and workflows
* Knowledge of security best practices and compliance requirements
* Experience with ETL processes, data pipelines, and big data technologies
* Experience with backup and restore procedures for Databricks and Azure services
* Ability to troubleshoot and resolve issues in a timely and efficient manner
* Strong verbal and written communication skills
* Ability to document processes, procedures, and configurations clearly
* Commitment to providing high-quality support to internal/external users and stakeholders
* Ability to understand and address the needs of internal and external customers
* Team player with the ability to work collaboratively with cross-functional teams
* Flexibility to adapt to changing requirements and priorities
* Willingness to learn new technologies and continuously improve skills
Preferred Qualifications:
* Deep understanding of Databricks architecture, features, and best practices
* Experience with Delta Lake and Databricks SQL for advanced data management
* Experience in performance tuning and optimization for both Databricks and Azure environments
* Experience supporting/administering data science and ML workloads in Databricks
* Knowledge of disaster recovery planning and implementation
* Experience integrating Databricks with other data platforms and tools
* Understanding of hybrid and multi-cloud environments
* Experience implementing data protection measures and ensuring regulatory compliance
The pay range is the lowest to highest compensation we reasonably in good faith believe we would pay at posting for this role. We may ultimately pay more or less than this range. Employee pay is based on factors like relevant education, qualifications, certifications, experience, skills, seniority, location, performance, union contract and business needs. This range may be modified in the future.
We offer comprehensive benefits including medical/dental/vision insurance, HSA, FSA, 401(k), and life, disability & ADD insurance to eligible employees. Salaried personnel receive paid time off. Hourly employees are not eligible for paid time off unless required by law. Hourly employees on a Service Contract Act project are eligible for paid sick leave.
Note: Pay is not considered compensation until it is earned, vested and determinable. The amount and availability of any compensation remains in Kforce's sole discretion unless and until paid and may be modified in its discretion consistent with the law.
This job is not eligible for bonuses, incentives or commissions.
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.
By clicking ?Apply Today? you agree to receive calls, AI-generated calls, text messages or emails from Kforce and its affiliates, and service providers. Note that if you choose to communicate with Kforce via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating via text by using key words such as STOP.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.