Overview
On Site
Depends on Experience
Contract - Independent
Contract - W2
Contract - 12 Month(s)
Skills
AWS Glue
Collaborate
Computer Science
ETL
ETL processes
Lambda
Python
Redshift
S3
data engineering
data governance
data modeling
data pipelines
data warehousingStrong
performance tuning
presentation skills
Job Details
NexSolv is seeking a Data Engineer for our direct client, State of Maryland. Onsite from Day 1 is mandatory.
Job Description:
Data Engineer, you will play a crucial role in designing, implementing, and maintaining the data infrastructure of our shared platform environment. You will collaborate with stakeholders to understand their data requirements, design scalable solutions, and ensure the platform meets business needs. Your role will be instrumental in addressing challenges such as resource contention, data integrity, performance tuning, data governance, and security in our shared platform environment.
Responsibilities:
- Design, develop, and maintain scalable data pipelines using AWS services such as AWS Glue, AWS Lambda, and Amazon S3 to ingest, process, and store data.
- Collaborate with stakeholders to gather requirements and ensure alignment with business goals, providing expertise on data engineering best practices.
- Optimize performance and cost-effectiveness of data solutions in the AWS environment, including tuning ETL processes, managing data partitions, and optimizing data storage.
- Implement data governance and security best practices within the AWS environment to ensure data integrity, consistency, and security.
- Provide technical support and training to users, helping them leverage AWS' capabilities for their data engineering needs.
- Monitor and troubleshoot issues in the AWS data infrastructure, working closely with other teams to resolve technical challenges.
- Stay updated with the latest AWS features, tools, and best practices in data engineering, incorporating them into the organization's data strategy.
- Collaborate with other data engineers, analysts, and administrators to integrate data sources and ensure data quality and consistency.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or related field. A master's degree is a plus.
- At least eight years of experience designing and developing ETL experience with min 3 years in developing Spark/Glue jobs
- Proven experience as a Data Engineer or similar role, with a focus on AWS technologies
- In-depth knowledge of data engineering best practices, including data modeling, ETL design, and data warehousing
- Strong programming skills in languages such as Python, SQL, and Scala
- Experience with AWS services such as Glue, Lambda, S3, Redshift, and RDS
- Strong communication and presentation skills to effectively convey complex technical concepts to non-technical stakeholders.
Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.