apache spark Jobs in connecticut

Refine Results
1 - 20 of 264 Jobs

Spark SQL Developer(Posted By Rup)

Global Force USA

Remote

Contract

Minimum of 5 years experience of Spark SQL programmingExperience with Databricks Unity CatalogWriting complex SQL queries with data discovery, creation, and managementQuery optimization (Partitioning, Indexing, and Scans)

Data Engineer (SPARK, EMR, REDSHIFT, AWS) - 100% REMOTE

Provish Consulting

Remote

Full-time

Job Title: Data Engineer (SPARK, EMR, REDSHIFT, AWS) Job Location: 100% REMOTE (Candidate needs to work in PST time zone) Job Type: 6 + Months Role Summary: We are seeking a highly skilled Data Engineer to join our client, focusing on developing and maintaining databases, driving efficient data analysis, and providing analytical support for cross-functional teams. The ideal candidate should be experienced with EMR, SPARK, REDSHIFT and AWS Cloud, and a background in data privacy. Preferred candid

Data Architect

Amiti Consulting, Inc

Remote

Contract

Position : Data Architect Duration : 6 + Months Remote Top Skills: Data Modeling exp is a must ER Studio exp is a must NOSQL exp is a must (HM prefers DynamoDB/Delta Formats) Spark exp is a must AWS exp is a must Team Info: Earlier this team was under Card Eco System and now they are part of EP Tech - Consumer Identity & Digital Marketing Recently onboarded DMs & DEs and this is for the same project Marketing data systems Big initiative for standardize the data for marketing campaigns Derive fea

Urgent Requirement : Snowflake Sr Developer

Aspire IT Experts Solutions LLC

Remote

Full-time

Job Requirements: - Experience in data integration activities, including architecting, designing, coding, and testing phases. - Architect the data warehouse and provide guidance to the team in implementation using Snowflake, SnowSQL, and other big data technologies. - Hands-on experience with Snowflake utilities, SnowSQL, SnowPipe, and big data modeling techniques using Python. - Experience in performance tuning of the Snowflake pipelines and the ability to troubleshoot issues quickly. - Extensi

Sr. Data Science Data Scientist

Aroghia

Remote

Third Party, Contract

SUMMARY Analyzes complex business problems and issues using data from internal and external sources to provide insight to decision-makers. Identifies and interprets trends and patterns in datasets to locate influences. Constructs forecasts, recommendations and strategic/tactical plans based on business data and market knowledge. Creates specifications for reports and analysis based on business needs and required or available data elements. May provide consultation to users and lead cross- functi

Expert Data Architect

Infogen Labs

Remote

Full-time

This is a remote role 10+ years of technology experience with enterprises class applications 8+ years of experience in data architecture Previous experience working in IT services / consulting space Azure cloud experience is a must Strong expertise in data modeling, database design, and SQL Proficiency in Azure Databricks, Spark, and other components of the Microsoft Fabric ecosystem is a strong preference Skills we are looking out for: Data Architecture, Azure, MS Fabric, Data Factory, Sy

Lead Data Engineer - Supply Chain Exp (12 + Years Exp)

SBC Solutions

Remote or Portland, Oregon, USA

Contract

NO C2C VISA: USC Experience: 12+ Years Strong SQL, Python, Pyspark, AWS(AMR, Athena), Databricks etc. Required Skills: 12 years of professional experience in software engineering, data engineering, machine learning, or related fieldStrong problem solving and analytical mindsetAbility to write robust, maintainable, and extendable code in PythonExperience with cloud architecture and technologies, in particular Amazon Web ServicesExperience with technologies like Spark, Kubernetes, Docker, Jenkins,

Data Architect with FHIR modeling

Xoriant Corporation

Remote

Contract

Title: Data Architect with FHIR modeling Location: Remote (EST Time zone) Duration: Long Term We need a mid-level data architect with data mapping, data governance, FHIR modeling(Mandatory) with Clinical Domain Kowledge.5-7 years Experience building data pipelines on AWS, following best practices in Cloud deployments.Hands-on experience of developing big data using big data tools Spark, Hands on experience in writing complex SQL queries.Good understanding of Data Architecture, Active adherence t

Solution Architect / data security governance solution

Prutech Solutions

Remote

Contract

About Us: Established in 1997, PruTech is committed to innovative problem-solving, solution creation, and fostering strong client partnerships. Serving a diverse array of industries, from government to finance, retail, and manufacturing, PruTech operates from strategic locations including New York City, Washington DC, North Carolina, and boasts a nearshore office in Mexico City and multiple offshore offices in India. With over two decades of experience in Information Technology and system integr

REMOTE - Data Engineer - Azure / MS Fabric

JSR Tech Consulting

Remote

Contract

Remote contract position with a major Financial client. Microsoft Azure/Fabric Data Engineer You will work with our ML Engineers, Data Scientist and various BUs to define solutions for operationalizing data-driven decision making in a cost effective and scalable manner. Qualifications: Bachelor's degree in computer science, Software Engineering, MIS, or an equivalent combination of education and experience. Experience implementing and supporting data lakes, data warehouses, and data applicatio

Geospatial Data Engineer

The It Capsule

Remote

Third Party, Contract

We are looking for a Geospatial Data Engineer to design and manage geospatial data pipelines and workflows. This role combines expertise in geospatial data formats, big data processing, and GIS integration to support large-scale geospatial analysis and visualization. Key ResponsibilitiesDevelop and maintain geospatial data pipelines for ingestion, transformation, and analysis.Work with geospatial data formats, including shapefiles, GeoJSON, KML, and raster datasets.Utilize Databricks and Spark f

AWS Developer

GalaxE.Solutions

Remote

Full-time

What You Will DoDesign and Develop using AWS ETL Solutions, Glue, PySpark, Python, etc.Strong RDBMS skills on PostgreSQLShould be able to understand existing code and understand the business logic, Integration with other components, DB connections, Other AWS services interactions key failure points etc.Design solutions to handle large volume of dataCollaborate with other teams to integrate solutions with existing systemsWrite clean, maintainable, and efficient codeTroubleshoot and debug issues a

Java Architect - Big Data

URSI Technologies Inc.

Remote

Full-time

The Position As Follows:Position : Java Architect - Big Data Emp Type : Full-Time Location : New Jersey (Remote) Job DescriptionSystem Design: Create and maintain efficient, reusable, and reliable Java code and big data solutions. Data Management: Design and implement data processing systems, including ETL processes, data modeling, and data warehousing. Integration: Integrate new data management technologies and software engineering tools into existing structures. Performance Optimization: Optim

Palantir Tech Lead

Centraprise Corp

Remote

Full-time

Relevant Experience (in Yrs) 7yrs+ with the experience of working in an Onsite / Offshore model Must Have Technical/Functional Skills Experience Required : Experience in developing and Maintains application on Palantir Foundry Platform. Experience in coding in Python , PySpark Expertise in designing and implementing large-scale, distributed software systems, with a strong understanding of system architecture and design patterns.Proficiency in multiple programming languages, such as Python, Java,

Senior Data Analyst

Xoriant Corporation

Remote

Contract

Senior Data Analyst Duration: Long Term Location: Washington DC (This is a remote position, and the candidate should be available to work in the Eastern Standard Time (EST) time zone.) Job Description: This role is exclusively focused around 5-7 years of Data Modelling, Lineage, Data Governance, Understand and ability to read Data Specs, convert them into standard format, Perform Data Extractions and normalization and define Canonical models to enable efficient development of Data Pipelines for

Full Time Remote AWS Databricks Architect with Program Management

Arkhya Tech

Remote or US

Full-time

Role - AWS Databricks Architect with Program Management expertise. Location - Remote + (30% Travel to client location for meetings and workshops) Hire type - FTE Note - Only Immediate joiners Required Skills/Qualifications: Bachelor's and/or master's degree in computer science or equivalent experience. Responsibilities: Design and implement scalable data engineering solutions using Databricks, AWS, Apache Spark, and Python. Architect cloud and hybrid cloud platforms, ensuring optimal data pr

Data Engineer (Middle/Senior) ID26045

Agile Engine

Remote

Full-time

AgileEngine is one of the Inc. 5000 fastest-growing companies in the US and a top-3 ranked dev shop according to Clutch. We create award-winning custom software solutions that help companies across 15+ industries change the lives of millions If you like a challenging environment where you re working with the best and are encouraged to learn and experiment every day, there s no better place - guaranteed! :) What you will do Work collaboratively with other engineers, architects, data scientists, a

Azure Developer

Innova Solutions, Inc

Remote

Contract, Third Party

A client of Innova Solutions is immediately hiring for an Azure Developer. Position type: Full-time Contract Duration: 6+ months Location: Lakeland, FL (100% remote) Azure Development - (50%) Front End Presentation Layer (10%) Middle Tier Logic Layer (20%) Back End Data Layer (20%) Skills Required: 7+ years of experience in Enterprise Code Development5+ years of hands-on test-driven development experience in C#, .Net with strong understanding of Object-Oriented principles (OOD/OOP)5+ years of de

Data Scientist

Buaut

Remote

Full-time

Position Overview:As a Data Scientist, you will work closely with cross-functional teams to analyze and interpret large datasets, build predictive models, and provide actionable insights that will help drive business decisions. You will apply statistical methods, machine learning algorithms, and data mining techniques to solve complex problems and contribute to key projects across the organization. Key Responsibilities:Analyze large and complex datasets to uncover patterns, trends, and insights.

Data Engineer - Per Resident only- REMOTE - Newark-NJ

Cynosure Technologies LLC

Remote

Contract

Hi there, reply requested for below job opportunity. Thank you. Please connect me for more details at: Data Engineer - Per Resident only REMOTE - Newark-NJ Qualification: Bachelor s degree in computer science, Software Engineering, MIS, or an equivalent combination of education and experience.Experience implementing and supporting data lakes, data warehouses, and data applications on AWS or Microsoft Azure for large enterprises (Fabric is plus)Programming experience with Python, Spark, and SQL