Spark Java Developer

Job Title: Spark Java Developer Location: Hartford CT - Onsite Employment Type: Long Term Contract
About VLink: Started in 2006 and headquartered in Connecticut, VLink is one of the fastest growing digital technology services and consulting companies. Since its inception, our innovative team members have been solving the most complex business, and IT challenges of our global clients.
Job Description:
7+ years of experience. Must have Java and Spark and strong SQL.

• Design and implement highly efficient Spark applications in Java, focusing on performance optimization, including tuning Spark jobs, optimizing transformation, and leveraging advanced Spark features for batch and real-time processing.
• Responsible for developing data pipelines using Apache Spark (Big Data Processing).
• Responsible for analyzing performance concerns and issues. Identifying the bottlenecks that require changes to improve performance.
• Utilize in-depth knowledge of functional and technical expertise in Java Micro-services (Spring Boot) and Big Data in delivering solutions.
• Responsible for configuring the applications for Devops using Jenkins and GIT and build pipeline using Jenkins
• Deploy the applications to the cloud enviornment using various cloud services and mantaining the application in Open Shift and AWS.
• Responsible for developing Staging Layer using Delta Lake for the Ingestion Framwork.
• Implement and manage data publishing and consumption using Kafka.
• Implement solutions to transform and serialize datasets into JSON messages using Spark SQL.
• Understanding of RESTFUL web services and API development.
• Technologies & Skills Used: Java, Apache Spark, Delta Lake, Spark SQl, MySQL, Kafka, drools, Spring Boot, REST APIs, Maven, Jenkins, Docker, Kubernetes.