Overview
Skills
Job Details
JOB: Data Integration Engineer
EXPERIENCE : 10 Years
LOCATION: Metro park, NJ
SKILLS: Astronomer Airflow experience, Python, Pyspark, SQL and data warehousing for enterprise level systems.
Data bricks environment to process and analyze large volumes of data.
Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Experience with Data warehouse Dimensional data modeling.
Implement best practices for data management, security, and governance within the Databricks environment.
Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Experience with Cloud based data architectures, messaging, and analytics.
Cloud certification(s).