apache spark Jobs

Refine Results
1 - 20 of 1,354 Jobs

Lead Software Engineer, Full Stack (Python, Spark, AWS)

Capital One

Chicago, Illinois, USA

Full-time

Lead Software Engineer, Full Stack (Python, Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Full Stack Software Engineers who are passionate about marrying data with emerging technologies.

Senior Lead Data Engineer (Python/Scala, Spark, AWS)

Capital One

New York, New York, USA

Full-time

Senior Lead Data Engineer (Python/Scala, Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One S

Lead Data Engineer (Python/Scala, Spark, AWS)

Capital One

Chicago, Illinois, USA

Full-time

Lead Data Engineer (Python/Scala, Spark, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Dat

Spark Developer

Georgia IT

Columbus, Ohio, USA

Contract

Job Title: Spark Developer Location: Columbus, OH / Remote Job Description: We are seeking a Sr. Spark Developer with extensive experience in Big Data technologies to lead the migration of workloads from Cascading/MapReduce to Spark 3 within a Kubernetes environment. The ideal candidate is skilled in Scala programming and has a strong background in designing and implementing Spark solutions. Key Responsibilities: Migrate existing Big Data workloads from Cascading/MapReduce to Spark 3.Design and

Spark Scala Engineer

Maveric NXT Inc

Irving, Texas, USA

Full-time

Job title: Spark + Scala Engineer location: Irving, TX (Hybrid) Type: Full-time (Not open for C2C) Job Summary: We are looking for a Spark Scala Engineer to develop and optimize data pipelines using Apache Spark and Scala. You will work on processing large datasets, ensuring scalability and performance. Key Responsibilities: Build and maintain ETL pipelines with Spark and Scala.Optimize data processing workflows.Collaborate with teams to deliver data-driven solutions.Qualifications: Strong exper

Lead Software Engineer (Spark/AWS/Data pipeline/Java/Spring)--ACSGSWA2

Pro Integrate

Wilmington, Delaware, USA

Contract

Sr Software Engineer (Spark/AWS/Data pipeline/Java/Spring) Wilmington, DE (Nearby candidates only) W2 Candidates Preferred Need Lead Software Engineer with atleast 7+ years hands-on development(Java SpringBoot) + Frontend (Angular OR React) + Any familiarity with mobile technologies or tools (Android or IOS or any mobile frameworks of irrespective of android and IOS like Kotlin or Swift) Job Description- Engineering Manager with experience in leading or managing one or more technology teams

ETL/Spark Developer

Innova Solutions, Inc

Charlotte, North Carolina, USA

Contract

Innova Solutions has a client that is immediately looking for an ETL/Spark Developer Position type: Full-time, Contract Duration: 12 months (with high possibilities of extension) Location: Charlotte, NC (Hybrid 3 days onsite 2 days remote) As an ETL/Spark Developer you will: Description: To support Ongoing Regulatory changes in Americas Reg Reporting with large focus on Axiom development for FRR reports.If role not approved, it will impact our ability to address reg reporting changes within thei

Spark developer (W2 only)

Yashco Systems, Inc.

Remote

Contract

Skills needed Opportunity for a skilled consultant in conversion of Cascading/MapReduce to SparkThe Sr Software Engineer will be responsible for migrating Big Data workloads to Kubernetes/Spark 3.Will lead the conversion of Cascading/MapReduce to Spark 3.Will be touching the code daily within the IntelliJ IDEdoing Scala code reviews, making coding changes needed for the Scala/Spark upgrade, designing the new Kubernetes environment, etc.Yashco Systems, Inc. is an Equal Opportunity Employer M/F/V/

Bigdata Developer with Apache Spark

Federal Soft Systems Inc.

Phoenix, Arizona, USA

Full-time

Job/Role Description: Senior Bigdata Developer with Apache Spark Location: Phoenix, Arizona, USA Employment Type: Contractor/Full-time Key Responsibilities: Data pipeline development: Design, develop, and maintain large-scale, distributed data pipelines using Apache Spark. ii. Performance optimization: Implement best practices for optimizing Spark jobs for performance and scalability. . Integration: Work with diverse data sources, including HDFS, NoSQL databases, relational databases, and cloud

Java Spring SQL Spark Developer

Kforce Technology Staffing

Houston, Texas, USA

Contract

RESPONSIBILITIES: Kforce has a client that is seeking a team of intermediate to senior Java Spring SQL Spark Developers in Houston, TX and Jersey City, NJ. This is an 11-month plus contract with opportunity to become fulltime employee with client. Key Tasks: * Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems * Creates secure and high-quality producti

Cloud Engineer III (Java/Spark/AWS)

Eliassen Group

Westlake, Texas, USA

Contract

Description: We are currently sourcing for a Cloud Engineer to work for us in the Dallas-Fort-Worth area! The Role We are looking for a Cloud Engineer with Strong working experience in AWS to augment the capability of core platforms using Cloud services. This position involves working as a senior developer, building tools to support cloud enablement, supporting the team; with a focus on achieving solutions of high value. As an AWS Cloud Engineer, you will be applying your development and auto

Java Spring SQL Spark Developer

Kforce Technology Staffing

Jersey City, New Jersey, USA

Contract

RESPONSIBILITIES: Kforce's client is seeking a team of intermediate to senior Java Spring SQL Spark Developer in Houston, TX & Jersey City, NJ. This is an 11-month plus contract with opportunity to become fulltime employee with client. Responsibilities: * Java Spring SQL Spark Developer will execute software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems * Creates s

Java Spark Engineer

Veear

Seattle, Washington, USA

Contract

6+ years overall software development experience with at least 3+ years of experience in large scale data platforms.Excellent expertise in Spark and Java.Knowledge of Golang is highly desirable.Good understanding of containerization using Docker and Kubernetes.Understanding of version control like Git and CI/CD workflow.Understanding of Parquet/Avro/Hive/Iceberg.Well experienced in debugging and troubleshooting.Good Communication and excellent collaboration skills to interact with internal custo

SAS Developer

Trident Consulting Inc.

Minneapolis, Minnesota, USA

Third Party, Contract

Trident Consulting is seeking a "SAS Developer for one of our clients in Minneapolis, MN/ Onsite. A global leader in business and technology services Job Title: SAS Developer Job Location: Minneapolis, MN/ Onsite Job Type: Contract Job summary: We are seeking an experienced SAS Developer with 10 to 14 years of experience to join our team.The ideal candidate will have a strong background in Azure, Spark, and Pyspark.The candidate will be responsible for designing and implementing scalable soluti

Data Engineer - Java/Spark/Scala

Eliassen Group

Durham, North Carolina, USA

Contract

Description: Our client, a leader in the financial services industry, has an excellent opportunity for a Data Engineer to work on a 12-month contract-to-hire position in Durham, NC. This position is available for W-2 only. This position is hybrid onsite, two weeks a month. Local candidates are preferred but open for relocation candidates. Due to client requirement, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes

Cloud Engineer (AWS, Java OR Spark, CI/CD)

Randstad Digital

Texas, USA

Contract

job summary: Location: Westlake, TX/Merrimack, NH Required Skills: AWS (Identity and Access Management)Spark or Java (Must be able to design and develop REST API's)Knowledge of building CI/CD pipelinesMust be a solid communicatorExperience working with Test Automation Frameworks.Experience working with JavaScript frameworks such as Angular JS and front-end programming languages such as Java Script, HTML and CSS. location: Roanoke, Texas job type: Contract salary: $72 - 73 per hour work hou

Sr. Databricks Engineer (Databricks + Spark + Azure) :: Fulltime :: Onsite @Dallas,TX

TESTINGXPERTS, INC. DBA DAMCOSOFT

Dallas, Texas, USA

Full-time

Primary Skills Databricks PySpark ETL DWH Responsibilities Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders Follow the Agile development methodology; think strategically and execute methodically Develop and manage capacity and growth projection forecasts of the environment within budgets Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional busi

Senior Java Developer with Golang and Spark experience

Cyma Systems Inc

Seattle, Washington, USA

Full-time

Sr Java DeveloperLocation- Seattle or NY- 3 days onsiteRate- $65/hr Design and develop high-performance, scalable software architectures using Java and GoLead API development initiatives, ensuring best practices in RESTful web servicesArchitect and implement big data solutions using Apache SparkMentor and guide development teams on best practices and design patternsCollaborate with stakeholders to gather and define system requirementsEnsure code quality and system performance through code review

Sr Lead Data Engineer Spark, SQL, Data Bricks

ChaTeck Incorporated

Seattle, Washington, USA

Third Party

Role - Sr Lead Data Engineer Apache Spark, Spark Core, Spark SQL, Spark Streaming Data Bricks Location: Hybrid (Seattle, WA) Job description This position contributes to our success by building enterprise data services for analytic solutions. This position is responsible for design, development, testing and support for data pipelines to enable continuous data processing for data exploration, data preparation and real-time business analytics. Models and acts in accordance with our guiding prin

Data Engineer with Scala & Spark expereince (Contract W2 Hybrid onsite)

Xoriant Corporation

San Francisco, California, USA

Contract

Job Title : Data Engineer (Spark & Scala) Location: San Francisco, CA (3 days a week Hybrid Onsite) Duration : Long term contract Contract: W2 / C2C IC (Own corp Independent contractor only) Core skill needed is Apache Spark and a programming language (preferably Scala with Java) or else Python. Skill level expected: excellentSecondary skill needed is some experience with Distributed computing, Big Data, Oozie, Postgres etc. Skill level expected: good.Job Description: True Hands-On Developer