AWS Databricks Data Engineer Lead

Overview

On Site
USD51 - USD56
Contract - W2

Skills

AWS Databricks Data Engineer Lead

Job Details

job summary:

Overview



Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise As a Data Engineer you will play a key role in growing and transforming analytics landscape



Looking for Data Engineer lead having experience on building ingestion solutions to integrate 3rd party data using databricks



Requirements



strong python skills



AWSCloud infrastructure knowledge commonly used AWS Glue S3 IAM Airflow



Experience with building data pipelines using Databricks on AWS



Knowledge and Handson Snowflake



Experience in Agile methodologies and Atlassian tools like JIRA



Expertise in using version control tools like Git Bitbucket



Experience on CICD using Kubernetes GIT and Monitoring and ing tools



Experience on data migration from OnPrem databases to AWS Cloud on S3



Roles resposibilities



Acts as a single point of contact for databricks projects for customer



Provides innovative and costeffective solution using AWS databricks python



Develops solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit



As a leader in the Cloud Engineering you will be responsible for the overseeing development



Learnadapt quickly to new Technologies as per the business need



Develop a team of Operations Excellence building tools and capabilities that the Development teams leverage to maintain high levels of performance scalability security and availability



Understand where to obtain information needed to make the appropriate decisions



Demonstrate ability to break down a problem to manageable pieces and implement effective timely solutions



Identify the problem versus the symptoms



Develop solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit



Skills



The Candidate must have 3-5 yrs of experience in Databricks AWS Python



Hands on experience on AWS Cloud platform especially S3 Glue Lamda



Experience on spark scripting



Has working knowledge on migrating relational and dimensional databases on AWS Cloud platform



Relevent experience with ETL methods and with retrieving data from dimensional data models and data warehouses



strong experience with relational databases and data access methods especially SQL



Knowledge of Amazon AWS architecture and design



Minimum Qualifications



Bachelors degree or equivalent training with data tools techniques and manipulation



Four years of data engineering or equivalent experience



Skills



Databricks-SparkSQL-Scala/Python/Java





location: Hartford, Connecticut

job type: Contract

salary: $50.55 - 55.55 per hour

work hours: 8am to 4pm

education: Bachelors



responsibilities:


Overview



Data Engineering team constructs pipelines that contextualize and provide easy access to data by the entire enterprise As a Data Engineer you will play a key role in growing and transforming analytics landscape



Looking for Data Engineer lead having experience on building ingestion solutions to integrate 3rd party data using databricks



Requirements



strong python skills



AWSCloud infrastructure knowledge commonly used AWS Glue S3 IAM Airflow



Experience with building data pipelines using Databricks on AWS



Knowledge and Handson Snowflake



Experience in Agile methodologies and Atlassian tools like JIRA



Expertise in using version control tools like Git Bitbucket



Experience on CICD using Kubernetes GIT and Monitoring and ing tools



Experience on data migration from OnPrem databases to AWS Cloud on S3



Roles resposibilities



Acts as a single point of contact for databricks projects for customer



Provides innovative and costeffective solution using AWS databricks python



Develops solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit



As a leader in the Cloud Engineering you will be responsible for the overseeing development



Learnadapt quickly to new Technologies as per the business need



Develop a team of Operations Excellence building tools and capabilities that the Development teams leverage to maintain high levels of performance scalability security and availability



Understand where to obtain information needed to make the appropriate decisions



Demonstrate ability to break down a problem to manageable pieces and implement effective timely solutions



Identify the problem versus the symptoms



Develop solutions to meet business needs that reflect a clear understanding of the objectives practices and procedures of the corporation department and business unit



Skills



The Candidate must have 3-5 yrs of experience in Databricks AWS Python



Hands on experience on AWS Cloud platform especially S3 Glue Lamda



Experience on spark scripting



Has working knowledge on migrating relational and dimensional databases on AWS Cloud platform



Relevent experience with ETL methods and with retrieving data from dimensional data models and data warehouses



strong experience with relational databases and data access methods especially SQL



Knowledge of Amazon AWS architecture and design



Minimum Qualifications



Bachelors degree or equivalent training with data tools techniques and manipulation



Four years of data engineering or equivalent experience



Skills



Databricks-SparkSQL-Scala/Python/Java







qualifications:

  • Experience level: Experienced
  • Education: Bachelors


skills:
  • Data Analysis



    Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

    At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

    Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).

    This posting is open for thirty (30) days.



  • Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

    About Randstad Digital