Data Engineer Google BigQuery & Google Cloud Platform (Google Cloud Platform)

  • Houston, TX
  • Posted 1 day ago | Updated 1 day ago

Overview

On Site
Depends on Experience
Accepts corp to corp applications
Contract - W2
Contract - 12 Month(s)

Skills

Google Cloud Platform (GCP)
BigQuery
Dataflow
Dataproc
Airflow
DAG
Python
PySpark
Pandas
ETL/ELT
Data Integration
Data Transformation
Data Quality
Data Lineage
DevSecOps
CICD
Big Data (Spark
Hadoop
Hive)
DBT
SQL
NoSQL
Data Visualization
Automation

Job Details

Job Title: Data Engineer Google BigQuery & Google Cloud Platform (Google Cloud Platform)
Location:Houston, TX (Onsite)
Duration /Term: Long Term Contract

 

Job Description

A Data Engineer with hands-on experience in Google BigQuery (GBQ) and Google Cloud Platform (Google Cloud Platform), responsible for building and optimizing data pipelines, automating data processes, and ensuring the efficient integration and transformation of data. This role involves utilizing modern data tools and technologies to deliver high-quality data solutions.

 

Key Responsibilities

  • Data Pipeline Development: Design, develop, and optimize end-to-end data pipelines using Google BigQuery, Dataflow, Dataproc, Cloud Composer, and other Google Cloud Platform tools.
  • ETL/ELT Framework Development: Build ETL/ELT frameworks, leveraging BigQuery for data extraction, transformation, and loading.
  • Big Data Technologies: Work with Big Data technologies (Spark, Hadoop, Hive, MapReduce) for data processing and transformation.
  • Airflow Management: Create and configure Airflow DAGs for orchestrating data pipelines, including scheduling and variable management.
  • Data Integration & Transformation: Work on data integration, data transformation, data quality, and data lineage tools.
  • Automation & API Integration: Automate data loads using scripting languages (Python, YAML) and APIs for seamless data transfer into BigQuery.
  • Data Visualization & Prototyping: Design and prototype data solutions, including usability testing and data visualization literacy for end-users.
  • DevSecOps (CICD) Environment: Work in a DevSecOps (CICD) environment for continuous integration and deployment of data engineering processes.
  • Collaboration: Collaborate with data scientists, analysts, and business teams to ensure high-quality data solutions that meet business needs.

 

Qualifications

  • Educational Background: Bachelor s degree in Computer Science, Data Engineering, or related field.
  • Experience Requirements: 4+ years of experience in Data Engineering, with a focus on Google Cloud Platform and BigQuery.
  • Technical Expertise:
    • Expertise in Google Cloud Platform services (BigQuery, Dataflow, Dataproc, Cloud Composer, Airflow, etc.)
    • Advanced Python programming skills (PySpark, Pandas) for data processing and pipeline development.
    • Strong experience with big data technologies (Spark, Hadoop, Hive, MapReduce).
    • Hands-on experience with SQL and NoSQL databases.
    • Experience with DBT for data lineage creation in Google Cloud Platform (Optional).
  • Soft Skills: Strong problem-solving skills, excellent communication, collaboration, and the ability to manage multiple tasks in a fast-paced environment.

 

Key Skills: Google Cloud Platform (Google Cloud Platform), BigQuery, Dataflow, Dataproc, Airflow, DAG, Python, PySpark, Pandas, ETL/ELT, Data Integration, Data Transformation, Data Quality, Data Lineage, DevSecOps, CICD, Big Data (Spark, Hadoop, Hive), DBT, SQL, NoSQL, Data Visualization, Automation.

 

VDart Group, a global leader in technology, product, and talent management, empowers businesses with comprehensive solutions through our four distinct, industry-leading business units With a diverse team of over 4,000 professionals across 13 countries, we deliver strong results across various industries, including Fortune 500 companies

Committed to "People, Purpose, Planet," we prioritize social responsibility and sustainability, as evidenced by our EcoVadis Bronze Medal Certification and participation in the UN Global Compact

Our dedication to delivering strong results has earned us recognition as a trusted advisor for businesses seeking to drive innovation and growth, including many Fortune 500 companies

Join our network! Partner with VDart Group to leverage our global network, industry expertise, and proven track record with a diverse clientele

 

 

 

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.