hadoop admin Jobs in san diego, ca

Refine Results
1 - 20 of 169 Jobs

AWS Technical Lead - San Diego, CA / Acton, MA &Boston, MA (Onsite) - Full Time

Avtech Solutions

San Diego, California, USA

Full-time

Title : AWS Technical Lead Location: San Diego, CA (Hybrid) Duration : Full Time Description: Mandatory Skills: Apache Spark, Apache Hadoop, Big Data, Java/Scala OR Kubernetes

Test Architect - Python - San Diego, CA - Hybrid Model

Gandiva Insights

San Diego, California, USA

Full-time

Job DescriptionJob DescriptionTitle: Automation Architect - Python Location: San Diego, CA Hybrid Model Primary Skills: Python, Pyspark, Pytest Secondary Skills: AWS, MongoDB, Kafka, RabbitMQ JD: *Experience in data architecture, cloud infrastructure, and automation. *Hands-on experience with cloud platforms like AWS, Azure, or Google Cloud, with deep expertise in services such as AWS Lambda, S3, RDS, EMR, Azure Data Factory, Databricks, etc. *Hands-on experience in Python, PySpark, PyTest, Doc

Senior Data Engineer (San Diego, CA):

Sysintelli, Inc.

San Diego, California, USA

Full-time

Senior Data Engineer (San Diego, CA):Dsgn & dvlp data mgmt & data persistence solns for app use cases leveraging relational, non-relational DBs & enhancing data processing capabilities. Dsgn & dvlp distributed data solns using Python, Java, Spark in Hadoop & AWS EMR. Code using advanced SQL. Dvlp w/ legacy & modern integration methods using Informatica, Teradata, Oracle & Relational data systems. Build data pipelines in Cloud. Dimensional data modelling & governance using Erwin. Req. BS (or equ

Systems Analyst (San Diego, CA):

Sysintelli, Inc.

San Diego, California, USA

Full-time

Systems Analyst (San Diego, CA):Gather & analyze user rqmts; create gap analysis reprt; dsgn & dvlp high-level dsgn architecture for new apps; monitor data governance; anlz existing s/w systems & new business rqmts & system specs to determine parameters of s/w app; test, maintain, backup & monitor comptr progs & systems, incl coordinating their installation. Mnge stakeholder & prep proj plan. Req. BS (or equiv) in CompSci, BusAdmin or a rltd fld & 5 yrs exp in follwng technlgy/software tools: J2

Data Engineer (San Diego, CA):

Sysintelli, Inc.

San Diego, California, USA

Full-time

Data Engineer (San Diego, CA): Work through all stages of the model development lifecycle: define the business problem, capture and structure data, craft end-to-end solutions from sourcing and wrangling relevant data, build out dashboards that revel data insights, and present recommendations and business impacts to partners. Build and support data pipelines to optimize data retrieval from various sources and build data engineering assets to surface useful business insights. Utilize extensive han

Engineering Project Manager

Penn State

San Diego, California, USA

Full-time

APPLICATION INSTRUCTIONS: CURRENT PENN STATE EMPLOYEE (faculty, staff, technical service, or student), please login to Workday to complete the internal application process . Please do not apply here, apply internally through Workday.CURRENT PENN STATE STUDENT (not employed previously at the university) and seeking employment with Penn State, please login to Workday to complete the student application process. Please do not apply here, apply internally through Workday.If you are NOT a current em

C2C - 15+ Must - Python Architect (Test - Exp) - San Diego, CA (Locals)

Prohires

San Diego, California, USA

Contract, Third Party

Job Description Python Test Architect : Location: San Diego, CAExp: 15+ (Must)Client: Cigniti Technologies Key Responsibilities:Design, build, and maintain scalable cloud data architectures and automated solutions that support data ingestion, processing, and storage.Develop automation frameworks and tools for deploying and managing cloud infrastructure and data services.Collaborate with data engineers, DevOps teams, and data scientists to implement end-to-end data pipelines and workflows.Ensure

Internship - IT Cloud Data Engineer

ASML USA

San Diego, California, USA

Full-time

Introduction ASML US, including its affiliates and subsidiaries, bring together the most creative minds in science and technology to develop lithography machines that are key to producing faster, cheaper, more energy-efficient microchips. We design, develop, integrate, market and service these advanced machines, which enable our customers - the world's leading chipmakers - to reduce the size and increase the functionality of their microchips, which in turn leads to smaller, more powerful consum

Sr Data Engineer

Apple, Inc.

San Diego, California, USA

Full-time

Summary Posted: Oct 17, 2024 Weekly Hours: 40 Role Number:200566638 Apple's Software Engineering group is renowned for its work in user experience, integration, functionality and lifestyle. We are responsible for developing and delivering every state-of-the-art operating system, application and firmware to Apple customers. It's a critical component of Apple's ecosystem and one that continues to break new ground every day!The Software Engineering team leverages compute resources for a variety

Technical Architect/ Spark Streaming Architect

TekLeaders, Inc

Remote or New York, New York, USA

Full-time, Part-time, Third Party, Contract

Title: Technical Architect Spark Streaming Architect (Postgres SQL, Kafka) - Kafka Admin with spark streaming Duration: 6 Months Location: 100% Remote (NYC, NY) Responsibilities: 10 +years Design and implement efficient data handling system based off Postgres or Spark tech stack. Experience investigating/troubleshooting & resolving PostgreSQL performance issues, SQL query tuning and optimization. Experience in Database Administration, specifically in PostgreSQL. Perform and oversee tasks such a

Gen AI Architect

Savvyan Technologies

Remote

Contract

We are looking for a Generative AI Enterprise Architect, please check the below job description and kindly share your response to proceed further. A Generative AI Enterprise Architect is a specialized role within an organization that focuses on designing and implementing generative artificial intelligence solutions to solve complex business challenges. This role requires a deep understanding of AI technologies, business processes, and a strategic mindset to align AI initiatives with the organiza

ETL Big Data Tester - - Fulltime or W2 Contract

ClifyX

Remote

Full-time

Job Title : ETL Big Data Tester Location : ClifyX Payroll - Any location but need to work onsite Fulltime or W2 Contract only (H1 Transfer can work)Design and execute test plans for ETL processes and big data pipelines.Validate data extraction, transformation, and loading (ETL) accuracy across various sources and formats.Perform data validation, integrity, and quality testing for large datasets using SQL and big data technologies.Automate testing for ETL processes using tools and scripting langu

Lead ML Engineer

BayOne Solutions

Remote

Full-time

Role: Lead ML Engineer Location: FSC REMOTE SF/NY/DC Type: Fulltime Hire We Are Excited About You If You Have University or advanced degree in engineering, computer science, mathematics, or a related field5+ years of experience developing and deploying machine learning systems into production8+ years of experience in Software engineering space.Experience working with a variety of relational SQL and NoSQL databasesExperience working with: Hadoop, Spark, Kafka, Scala, Python, R etc.Knowledge of cl

ETL Developer (San Diego, CA):

Sysintelli, Inc.

San Diego, California, USA

Full-time

ETL Developer (San Diego, CA): Use Informatica power center for (ETL) extraction, transformation and loading data from heterogeneous source system into target database. Create mappings using Designer and extract data from various sources, transform data according to the requirement involved in extracting data from flat files and relational databases into staging area. Migrate mappings, sessions, workflows from development to test and then to UAT, Production environment. Develop Informatica mappi

Data Architect

Savvyan Technologies

Remote or Irving, Texas, USA

Contract

We are looking for Data Architect for one of our client. Please find the JD below and revert if interested in. Job Description: Develop and implement the overall data architecture strategy, ensuring alignment with business goals and technology roadmap.Design and maintain the data models, data flow diagrams, and data dictionaries.Ensure data accuracy, integrity, and security across all systems.Oversee data governance policies and procedures.Implement data quality standards and data management bes

Systems Analyst (San Diego, CA):

Sysintelli, Inc.

San Diego, California, USA

Full-time

Systems Analyst (San Diego, CA):Gather and analyze user requirements. Convert user requirements into technical solution. High-level design of software applications. Prepare functional and technical specifications. Implement software system requirements by defining and analyzing system problems. Analyze existing software systems and its new business requirements and system specifications to determine all the parameters of software applications. Conduct feasibility study and gap analysis to imple

Java Developer

TEKsystems

Remote or Phoenix, Arizona, USA

Full-time

Job DescriptionJob DescriptionWe are looking for java developers with at least 2 years of experience for our client in Phoenix. These are contract to hire positions that are remote until next year. Skills & Qualifications 2 3 years of full stack Java experience is needed. Experience with In-memory computing frameworks and caching frameworks like Apache Ignite or Redis is a plus. Experience with open-source frameworks such as SpringBoot, DROOLS, Camel, Kafka is desirable. Experience with various

Senior Backend Developer - Java/VUE

cyberThink, Inc.

Remote

Contract

As a Senior Software Developer on the OnVUE team, you will play a significant role as an individual contributor on a major core offering. Your primary responsibility is to develop new features and make technical improvements. Working closely with the team lead, you will also provide technical supervision of the other engineers work. The hourly range for roles of this nature is $70 to 90/hr. Rates are heavily dependent on skills, experience, location and industry. About the Product: The OnVUE re

DevSecOps Integration & Support Engineer

Penn State

San Diego, California, USA

Full-time

APPLICATION INSTRUCTIONS: CURRENT PENN STATE EMPLOYEE (faculty, staff, technical service, or student), please login to Workday to complete the internal application process . Please do not apply here, apply internally through Workday.CURRENT PENN STATE STUDENT (not employed previously at the university) and seeking employment with Penn State, please login to Workday to complete the student application process. Please do not apply here, apply internally through Workday.If you are NOT a current em

DevSecOps Integration & Support Engineer

Penn State

San Diego, California, USA

Full-time

APPLICATION INSTRUCTIONS: CURRENT PENN STATE EMPLOYEE (faculty, staff, technical service, or student), please login to Workday to complete the internal application process . Please do not apply here, apply internally through Workday.CURRENT PENN STATE STUDENT (not employed previously at the university) and seeking employment with Penn State, please login to Workday to complete the student application process. Please do not apply here, apply internally through Workday.If you are NOT a current em