hadoop big data spark engineer Jobs

Refine Results
81 - 100 of 959 Jobs

Data Scientist

I-Giants

•

Remote

Full-time

Job Title: Data Scientist Duration: Contract To Hire Location: Remote (CST or PST time zones is preferred) Key Skills: Machine Learning, AI, Data Science, Python, SQL, NLP, Spark/Hadoop 5-6 years of hands-on relevant experience in Data Science, Machine Learning and AI.Process data, develop algorithms and models to solve for a problem of needStrong programming skills in Python or R, with experience in ML libraries (scikit-learn, TensorFlow, PyTorch).Ability to ingest and process text, categorica
Easy Apply
Posted 8 days ago

Software Engineer Co-Op (January 2025 - May 2025)

LiveRamp

•

San Francisco, California, USA

Full-time

LiveRamp is the data collaboration platform of choice for the world's most innovative companies. A groundbreaking leader in consumer privacy, data ethics, and foundational identity, LiveRamp is setting the new standard for building a connected customer view with unmatched clarity and context while protecting precious brand and consumer trust. LiveRamp offers complete flexibility to collaborate wherever data lives to support the widest range of data collaboration use cases-within organizations, b
Posted 60+ days ago | Updated 3 hours ago

Senior Data Engineer

Garmin

•

Olathe, Kansas, USA

Full-time

Overview We are seeking a full-time Senior Data Engineer in our Olathe, KS location. In this role, you will be responsible for leading administration of technology by contributing expertise in researching new technologies and proposing cost effective solutions. Essential Functions Provides technical input to feature development plans and concept documentsUnderstands production and operations issues as they relate to engineeringDevelops scalable, extensible solution architectures leveraging cont
Posted 3 hours ago

Data Engineer

Unissant, Inc.

•

Ashburn, Virginia, USA

Full-time, Third Party

Unissant, Inc delivers innovative capabilities to the agencies that keep our nation healthy and safe. We apply our domain expertise, data acumen, and technology know-how to achieve breakthrough results for our clients. Working collaboratively, we advance missions and careers through a focus on honesty, integrity, and dependability. We continuously look for talent excited to join that effort. To learn more about our exciting organization, please visit us at . Unissant is seeking a Data Engineer
Posted 9 days ago | Updated 8 days ago

Security Clearance DevOps Engineer

Global Channel Management, Inc.

•

Columbia, Maryland, USA

Full-time

Security Clearance DevOps Engineer needs 9+ years' 9+ years of experience in DevOps Engineering or Software Development (Java preferred) Security Clearance DevOps Engineer duties: Proficient in configuration management tools such as Terraform, Ansible or Puppet Knowledge of AWS services (EC2, EBS, S3, Lambda) and their application to deployment and management of infrastructure. Experience with application and OS deployment, scaling, and management Ability to develop in multiple programming lang
Posted 10 days ago | Updated 3 hours ago

Fulltime opportunity - Data Solution Architect - Photon - Jersey City, NJ

Photon

•

Jersey City, New Jersey, USA

Full-time

Architect, implement, and optimize end-to-end solutions designed for large-scale datasets, ensuring scalability and efficiency. Big data ecosystem (Good understanding of Hadoop, Cloudera), exposure to Hive, Impala, Yarn, Kafka. Drive cross-functional collaboration, bridging technical teams and business stakeholders. Oversee data pipeline design, model development, and deployment with a focus on scalability and accuracy. Drive compliance with policies/standards (e.g., data quality) and adoption o
Easy Apply
Posted 11 days ago | Updated 9 days ago

Data Engineer::St. Louis, MO

VLink Inc

•

St. Louis, Missouri, USA

Contract, Third Party

Role: Data Engineer Location: St. Louis, MO Duration:12 Months Job Description: Good experience with NIFI and MongoDBWriting mongo queriesSetting up NIFI flowsKafka streaminghands-on experience with PySpark/Spark SQLExperience with Big Data or Hadoop tools such as Spark, Hive.Experience with Data Frames and Resilient Distributed Datasets (RDDs).Experience in building and scaling the distributed infrastructure.Experience in production cloud infrastructure with AWS services especially S3, Lambda,
Easy Apply
Posted 8 hours ago

Hadoop developer

Collabera LLC

•

Jersey City, New Jersey, USA

Full-time

Description: Characteristics of a top performer: Strategically architect, design, develop and implement efficient BigData programs and initiatives. Always eager to learn more.Education Requirements: Bachelor s in Computer Science with 8 years or Master s in Computer Science with 6 years of relevant experienceDeal Breaker Items: If the resource is not hands on technicallyScope of work:Understand business requirements , study existing application landscape, and conceptualize technical solutions to
Easy Apply
Posted 17 days ago | Updated 2 hours ago

Senior Data Scientist

Lifespace Communities Inc

•

Dallas, Texas, USA

Full-time

Community: Texas Home Office Address: 3501 Olympus Boulevard Dallas, Texas 75019 Pay Range $128,800.00-$184,500.00+ Annual Live your purpose. Grow your career. Thrive through teamwork. Create meaningful, personalized experiences. At Lifespace, team members are at the center of delivering a purpose driven experience for our residents! We provide an environment where each team member can live their aspirations, developing in their career, making a difference, and being a part of a meaningfu
Posted 5 days ago | Updated 3 hours ago

Software Engineering Manager - Analytics Platform

Apple, Inc.

•

No location provided

Full-time

Great and meaningful insights require a solid platform that will enable easy and fast access-to and analysis-of large amount of data coming in. The Core Telemetry Platform team is responsible for providing a cutting edge, reliable, scalable and extensible platform for defining/collecting/ingesting/processing data, and innovative analytics tools to easily discover those meaningful insights. Our team is looking for a leader to bring their passion for software and big data technologies, and inspire
Posted 60+ days ago | Updated 11 days ago

Business Systems Analyst - Capital Markets, Big Data Project

TEKsystems c/o Allegis Group

•

Toronto, Ontario, Canada

Full-time

About the Role: We are seeking a highly skilled Business Systems Analyst to join our client, a leading bank in Canada. This role involves supporting the measurement and management of balance sheet, market, and liquidity risks for portfolios. The successful candidate will work with cutting-edge technologies, including Big Data and NoSQL databases, to enhance risk management processes. Key Responsibilities: Analyze, document, and validate business rules requirements from business users.Write, tes
Posted 7 days ago | Updated moments ago

Python/Spark Developer

NasTech Global, Inc.

•

Charlotte, North Carolina, USA

Contract

Job Title: Python/Spark Developer Location: Charlotte, NC Job Type: Contract W2 Job Description: Python/Spark Hadoop big data. We are looking for 7-10 years of experience with strong hands on coding skills and strong experience in building frameworks. Priority skill sets are Python and Spark We need someone who has strong development experience using Python and Spark for handling Big data, develop frameworks and optimization techniques. We are working on a time sensitive project and would nee
Posted 16 days ago | Updated 3 days ago

Data Analyst

Stripe

•

Chicago, Illinois, USA

Full-time

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies-from the world's largest enterprises to the most ambitious startups-use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone's reach while doing the most important
Posted 13 days ago | Updated 3 hours ago

Data Scientist/Architect-Principal

IKCON TECHNOLOGIES Inc.

•

Mason, Ohio, USA

Contract

IKCON TECHNOLOGIES INC delivers exceptional IT services and solutions that provide clients with definite edge over competitors and promoting highest standards of quality. We are currently looking for a Data Scientist/Architect-Principal with one of our clients in Mason, OH. If you are actively looking for opportunities, please send us your updated resume with your contact details. "U.S. Citizens and those authorized to work in the U.S. are encouraged to apply." JOB TITLE Data Scientist/Architec
Easy Apply
Posted 16 days ago | Updated 8 days ago

Sr Scala/Spark Developer

Photon

•

Tampa, Florida, USA

Full-time

Key Responsibilities: Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data proces
Easy Apply
Posted 3 days ago

Sr. ML Engineer

Veear

•

Remote

Contract

We are seeking a highly skilled and experienced Senior Machine Learning Engineer to join our team. As a Senior ML Engineer, you will be responsible for developing and implementing advanced machine learning models and algorithms to enhance our retail operations. Your work will directly impact customer experience, inventory management, pricing optimization, demand forecasting, and fraud detection, among other critical areas. If you have a passion for cutting-edge technology, a strong background in
Easy Apply
Posted 9 days ago | Updated 8 hours ago

Ab Initio Engineer

Vega Consulting Solutions

•

Remote

Third Party, Contract

Vega is Hiring! Ab Initio Engineer for a remote based position with our direct client. Seeking candidates with 10 years Experience leading database design and ETL development. Experience in leading data engineering and cross functional teams to implement scalable and fine tuned ETL/ELT solutions (batch and streaming) for optimal performance. Experience developing and updating ETL/ELT scripts. Hands-on experience with Ab Initio ETL development in Hadoop and AWS ecosystem, relational database layo
Easy Apply
Posted 2 days ago | Updated 1 day ago

Geospatial Big Data

CrackaJack Digital Solutions

•

Houston, Texas, USA

Contract

Key ResponsibilitiesDesign and implement scalable big data architectures using Hadoop, Spark, or other distributed processing frameworks.Ingest, store, and manage large volumes of structured and unstructured geospatial data from various sources (e.g., satellite, drone, IoT, APIs).Optimize geospatial data storage using formats like GeoParquet, GeoJSON, and PostGIS-enabled databases.Develop and maintain ETL/ELT pipelines with a focus on spatial data enrichment, transformation, and aggregation.Work
Easy Apply
Posted 3 days ago

Lead Data Engineer

Sensiple Inc.

•

Lake City, Florida, USA

Contract

Sensiple Inc is a New Jersey corporation with over two decades of expertise in technology-driven solutions specialising in Customer Experience, Contact Center Solutions, Digital Transformation, Cloud Computing & Independent Testing. With an expert team that has enriched experience in executing & developing sustainable IT strategies in Healthcare, Technology, Retail, Logistics, Education, Telecommunications, Government and Media, we help our diverse customers to envision the future. By developing
Easy Apply
Posted 9 days ago | Updated 7 hours ago

Sr. Data Engineer

Object Technology Solutions, Inc.

•

Remote

Contract

Object Technology Solutions, Inc (OTSI) has an immediate opening for Sr. Data Engineer. SKILLS AND ABILITIES REQUIRED: Experience with Spark programming (pyspark or scala or java)Strong SQL/Spark coding skillsExperience on designing and developing Data Pipelines for Data Ingestion or Transformation using Java or Scala or Python.Good communication skills are required.QUALIFICATIONS AND EXPERIENCE Bachelor s degree or MS Degree.8+ years of total IT experience5+ years of experience with Hadoop (Clo
Easy Apply
Posted 60+ days ago | Updated 1 day ago