apache spark Jobs in chicago, il

Refine Results
301 - 320 of 375 Jobs

ETL Developer

Amiseq Inc.

•

Remote

Contract, Third Party

Job Description: Strong expertise in Apache Spark, Apache Flink, Kafka, and Scala. Strong experience with Kafka Expertise in Scala Experience working in cloud environments (AWS, Google Cloud Platform, or Azure). Building and optimizing ETL pipelines for high-performance systems
Easy Apply
Posted 9 days ago | Updated 3 days ago

Workday Extent Consultant

HCL America Inc.

•

Remote

Full-time

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 219,000 people across 60 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. () The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version o
Easy Apply
Posted 7 days ago | Updated 6 days ago

Python (PySpark) Developer

Dexian DISYS

•

Remote

Full-time, Contract

Job Title: Python (PySpark) Developer Location: 100% remote, must be located in the US Duration: 6-month contract to hire Pay: targeting $50-$60/hour W2 Other Requirements: must be highly skilled in Python Number of Positions: 1 JOB OVERVIEW We are looking for a highly skilled and experienced Google Cloud Platform Cloud Developer to join our Eligibility team. The ideal candidate will have a strong background in cloud development with expertise in Python, Spark, DataProc, Data Lake, and DevO
Easy Apply
Posted 23 days ago | Updated 2 hours ago

Infrastructure Engineer (BMC Control-M Scheduler)

DISCOVER

•

Remote or Riverwoods, Illinois, USA

Full-time

About This Role Discover. A brighter future. With us, you'll do meaningful work from Day 1. Our collaborative culture is built on three core behaviors: We Play to Win, We Get Better Every Day & We Succeed Together. And we mean it - we want you to grow and make a difference at one of the world's leading digital banking and payments companies. We value what makes you unique so that you have an opportunity to shine. Come build your future, while being the reason millions of people find a brighter
Posted 29 days ago | Updated 22 hours ago

Lead Data Engineer / Azure Data Engineer

KPI Partners, Inc.

•

Remote

Contract

Need only on W2. Minimum of 10-12+ years.experience in Data Integration platform with 5years on Azure cloud.Strong hold Experience on Azure platform mandatory on Azure Data factory, Azure Data BricksStrong working experience in Implementation of Azure cloud components using Azure Data Factory , Azure Data Analytics, Azure Data Lake, Azure Data Catalogue, LogicApps & FunctionAppsExperience on Python scripting ,Spark SQL & PySpark
Easy Apply
Posted 16 days ago | Updated 17 hours ago

AWS Data Engineer/11+years/USCOnly/PPMust

Prism IT Corp

•

Remote

Contract, Third Party

o AWS stack experience (Data Engineering) - Redshift, Glue, catalogue exp, GITLab and Terraform o experience in the following technologies o Data integration experience with large scale data (change ( design) o CI/CD development with Gitlab and terraform (CLI and c to security) o Data processing using spark (Glue), Python, informatica, S o AWS stack experience (Data Engineering) - Redshift, Glue, RDS/SQL o Data model and catalog experience nice to have
Easy Apply
Posted 14 days ago | Updated 14 days ago

Lead Azure Data Engineer

GSPANN Technologies

•

Remote

Contract, Third Party

About GSPANN Headquartered in Milpitas, California (U.S.A.), GSPANN provides consulting and IT services to global clients, ranging from mid-size to Fortune 500 companies. With our experience in retail, high-technology, and manufacturing, we help our clients to transform and deliver business value by optimizing their IT capabilities, practices, and operations. Counting on our ten offices, including four global delivery centers, and approximately 1400 employees globally, we offer the intimacy of a
Easy Apply
Posted 3 days ago | Updated 18 hours ago

Aws Data Engineer

Quality IT Source, LLC

•

Remote

Contract

Data Engineer(Python, SQL, Airflow and AWS) Key Responsibilities: Develop and maintain efficient data pipelines and workflows.Write clean, efficient, and scalable code using Python and/or PySpark on databricks.Design, implement, and optimize SQL queries for data extraction and manipulation.Utilize Spark and Airflow to process and manage large datasets.Preferred Qualifications: Hands on with databricks concepts / delta table formats.Experience working with Amazon Web Services (AWS).Problem-solv
Easy Apply
Posted 30 days ago

Salesforce Marketing Cloud Developer

HCL America Inc.

•

Remote

Full-time

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 219,000 people across 60 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. () The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version o
Easy Apply
Posted 9 days ago | Updated 6 days ago

(Elasticsearch) Data Engineer

Brahma Consulting Group

•

Remote

Full-time

Title: Data and ElasticSearch and Design Location: (100%Remote) Type: Full-time (Permanent) Job Description: We are seeking an experienced Data Scientist with a deep understanding of search technologies, particularly Elasticsearch. You will be responsible for designing and optimizing search algorithms, building scalable search systems, and leveraging data to enhance user experience. Key Responsibilities: Design and implement search algorithms using Elasticsearch.Analyze and interpret large data
Easy Apply
Posted 9 days ago

Workday Finance Consultant

HCL America Inc.

•

Remote

Full-time

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 219,000 people across 60 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. () The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version o
Easy Apply
Posted 31 days ago | Updated 6 days ago

Databricks Solution Architect

Pozent

•

Remote or South Plainfield, New Jersey, USA

Full-time, Contract

Responsibilities include: design and implementation of end-to-end Databricks solutions, analysis of customer requirements and software specifications, providing technical guidance and mentoring to project team members, assisting in solutions documentation, and collaborating with project teams to ensure the delivery of high-quality solutions.Qualifications Bachelor's degree or higher in Computer Science, Information Technology, or a related field. 10+ years' experience in a software development o
Easy Apply
Posted 7 days ago | Updated 8 hours ago

Data Scientist (Elasticsearch)

Brahma Consulting Group

•

Remote

Full-time

Title: Data Scientist (Elasticsearch) Location: Remote Type: Full-time (Permanent) Salary:$100k to 120k yearly with all benefits Job Description: We are seeking an experienced Data Scientist with a deep understanding of search technologies, particularly Elasticsearch. You will be responsible for designing and optimizing search algorithms, building scalable search systems, and leveraging data to enhance user experience. Key Responsibilities: Design and implement search algorithms using Elasticse
Easy Apply
Posted 15 days ago | Updated 15 days ago

Big Data Engineer - 100% Remote - Fulltime-Client Direct Hire Opportunity

Matrix7i

•

Remote

Full-time

iitjobs is seeking a Big Data Engineer who is responsible for big data software and platform architecture and development. Big Data Engineer 100% Remote Direct Hire/Client Fulltime Required Skills:- 5+ years of experience in big data software and platform developmentFluent in two or more of the programming languages such as Python, Scala, Java, GoLang-Heavy hands-on experience requiredHands-on experience with Airflow.Knowledge of microservices & serverless architecturesExperience building large
Easy Apply
Posted 13 days ago | Updated 17 hours ago

Data bricks Architect

ClifyX

•

Remote

Full-time

About us ClifyX has immense experience of over 20 years in Digitalization, Service Management, Cloud Transformation, and now in enabling implementation and deployments for its end customer through Salesforce, ServiceNow, Selenium, Cloud and Automation. Our rich experience, combined with our unyielding care for our employees, is the driving force behind all we do. And we deliver! At Clifyx, aligning great talent with clients needs is at the core of who we are. We are passionate about our Consult
Easy Apply
Posted 1 day ago

Sr. Data Engineer strong with AWS and Python

R Systems, Inc.

•

Remote

Contract

Note: Advanced in AWS they are setting up platform and infrastructure on AWS setting up tooling for data pipelines Strong with building ETL Setting up tooling (doesn t need to be fully from scratch but setting up at least a part of it and not just a user) Coding Python is preferred Experience with CI/CD Athena, Spark Qualifications 5+ years in a Data Engineering or Data Warehousing role 2+ years coding experience (python, java, scala) 2+ years hands on experience with big data technologies (G
Easy Apply
Posted 15 days ago | Updated 8 days ago

ETL Big Data Tester - - Fulltime or W2 Contract

ClifyX

•

Remote

Full-time

Job Title : ETL Big Data Tester Location : ClifyX Payroll - Any location but need to work onsite Fulltime or W2 Contract only (H1 Transfer can work)Design and execute test plans for ETL processes and big data pipelines.Validate data extraction, transformation, and loading (ETL) accuracy across various sources and formats.Perform data validation, integrity, and quality testing for large datasets using SQL and big data technologies.Automate testing for ETL processes using tools and scripting langu
Easy Apply
Posted 2 days ago

AWS Engineer

Mastech Digital

•

Remote or New York, New York, USA

Contract

Mastech Digital provides digital and mainstream technology staff as well as Digital Transformation Services for all American Corporations. We are currently seeking an AWS Engineer for our client in the Consulting domain. We value our professionals, providing comprehensive benefits and the opportunity for growth. This is a Contract position, and the client is looking for someone to start immediately. Duration: 6+ Months Contract Location: Remote (New York, NY) Salary: $95.00-$100.00/Hourly Role:
Easy Apply
Posted 14 days ago | Updated 1 hour ago

Salesforce Developer

HCL America Inc.

•

Remote

Full-time

We are HCLTech, one of the fastest-growing large tech companies in the world and home to 219,000 people across 60 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud. () The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version o
Easy Apply
Posted 23 days ago | Updated 6 days ago

AWS Data Engineer

Laiba Technologies LLC

•

Remote

Full-time

Title: AWS Data Engineer Location: Remote (USA) Mode of hire : Fulltime /Permanent Job Description:o AWS stack experience (Data Engineering) - Redshift, Glue, Informatica, RDS/SQL, Data model catalogue exp, GITLab and Terraformo Total 5 to 8 years of experience in the following technologies:o Data integration experience with large scale data (change data capture, partitioning, performance design)o CI/CD development with Gitlab and terraform (CLI and console don't work in gov environment due to
Easy Apply
Posted 51 days ago | Updated 13 days ago