Overview
On Site
Full Time
Skills
Software Development
Python
PySpark
Management
Data Lake
Storage
Cloud Computing
Apache Spark
Databricks
Optimization
Data Architecture
Extract
Transform
Load
Operational Efficiency
Evaluation
Analytical Skill
Data Engineering
Productivity
Apache Kafka
Java
Apache HTTP Server
Monte Carlo Method
SQL Azure
Analytics
Microsoft Power BI
Qlikview
SAS
Computer Science
Management Information Systems
IT Service Management
Apex
Oracle Application Express
Innovation
Collaboration
Training
Recruiting
Job Details
Job#: 2058492
Job Description:
Position: Senior Spark Data Engineer
Direct Hire
100% Remote
Apex Systems is seeking a Senior Spark Data Engineer for a Direct-Hire position that is 100% remote. You will be joining an innovating Data team to help drive our recent Databricks adoption. The ideal candidate will have a deep background in Data Engineering and can help lead our Data Unification & Optimization approach.
Must Have Qualifications:
10+ years of enterprise-level Data Engineering and/or Software Development
4-5 years' experience Spark
Advanced in Python or PySpark
Databricks background OR Databricks Spark
Managing and tuning of Data Lake and Lakehouse storage objects with accompanying data engineering pipelines.
Job Duties/Responsibilities:
Serve as the subject matter expert in technologies used for our data strategy in the cloud.
Help drive Adoption of Spark DataBricks across the organization
Facilitate and drive our Data Unification & Optimization approach
Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals
Solve complex data problems to deliver insights that helps the organizations business to achieve their goals
Create data products for analytics and data scientist team members to improve their productivity
Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions
Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering to improve the organizations productivity as a team
Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
Nice to Have:
Kafka or JAVA background (Observability)
Apache Iceberg or other similar tools such as Monte Carlo
SQL , Azure Data Factory
Experience in designing and/or developing Analytics applications using tools such as Power BI, QlikView, SAS, RapidMiner or other comparable products.
Experience in creating, analyzing and documenting ER and Dimensional models.
Education:
Bachelors degree in computer science, MIS or a related field + 10 years of relative experience.
Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.
Job Description:
Position: Senior Spark Data Engineer
Direct Hire
100% Remote
Apex Systems is seeking a Senior Spark Data Engineer for a Direct-Hire position that is 100% remote. You will be joining an innovating Data team to help drive our recent Databricks adoption. The ideal candidate will have a deep background in Data Engineering and can help lead our Data Unification & Optimization approach.
Must Have Qualifications:
10+ years of enterprise-level Data Engineering and/or Software Development
4-5 years' experience Spark
Advanced in Python or PySpark
Databricks background OR Databricks Spark
Managing and tuning of Data Lake and Lakehouse storage objects with accompanying data engineering pipelines.
Job Duties/Responsibilities:
Serve as the subject matter expert in technologies used for our data strategy in the cloud.
Help drive Adoption of Spark DataBricks across the organization
Facilitate and drive our Data Unification & Optimization approach
Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals
Solve complex data problems to deliver insights that helps the organizations business to achieve their goals
Create data products for analytics and data scientist team members to improve their productivity
Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions
Lead the evaluation, implementation and deployment of emerging tools and process for analytic data engineering to improve the organizations productivity as a team
Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
Nice to Have:
Kafka or JAVA background (Observability)
Apache Iceberg or other similar tools such as Monte Carlo
SQL , Azure Data Factory
Experience in designing and/or developing Analytics applications using tools such as Power BI, QlikView, SAS, RapidMiner or other comparable products.
Experience in creating, analyzing and documenting ER and Dimensional models.
Education:
Bachelors degree in computer science, MIS or a related field + 10 years of relative experience.
Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.