Overview
On Site
$140,000 - $160,000
Full Time
Skills
Advanced Analytics
Amazon Redshift
Amazon S3
Amazon Web Services
Analytics
Apache Spark
Artificial Intelligence
Databricks
Generative Artificial Intelligence (AI)
Optimization
Oracle
SAP ECC
SAP HANA
Supply Chain Management
Textual Entailment
Machine Learning (ML)
Mentorship
Talend
Job Details
We are looking for a highly skilled and motivated Databricks Architect to lead the design, implementation, and optimization of scalable data solutions on the Databricks Lakehouse Platform. You will be instrumental in architecting solutions that integrate with our AWS data lake and legacy systems (SAP ECC, S/4, BW HANA, Oracle), while supporting advanced analytics, reporting, and GenAI initiatives.
Your role
- Lead architecture, design, and implementation of scalable and efficient data pipelines and analytics solutions on Databricks.
- Work closely with data engineering, platform, and analytics teams to integrate Databricks with AWS S3 Data Lake, Redshift, Talend, SAP BW/HANA, Oracle, and other tools.
- Architect solutions supporting batch and real-time data processing using Delta Lake, Spark, and MLFlow.
- Collaborate with business stakeholders to understand data requirements, assess current state, and provide strategic direction for future-state architecture.
- Ensure best practices for data quality, governance, and security are implemented using Unity Catalog and other available frameworks.
- Support development of GenAI/ML models leveraging Databricks' ML runtime and integrations with AWS AI/ML services.
- Mentor and guide engineering teams on Databricks best practices, performance tuning, and cost optimization.
- Stay current with Databricks and industry innovations, and bring in new ideas to improve data platform maturity.
Your skills and experience
- Databricks certifications (e.g., Databricks Certified Data Engineer/Architect).
- Experience in regulated manufacturing or industrial environments.
- Knowledge of SAP data extractors, TE-specific domains (e.g., Supply Chain, Pricing, Finance) is a strong plus.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.