Overview
Skills
Job Details
Position Overview: We are looking for a highly skilled and independent NodeJS + TypeScript Engineer to join our team. This role involves building scrapers and other automation bots, and requires extensive experience in web scraping and browser automation using NodeJs and Puppeteer. You will be responsible for developing custom solutions to interact with various web interfaces, handle complex form submissions, bypass captchas, and more.
This is not a role where you'll be given a detailed set of instructions success in this position depends on your ability to think creatively, independently solve complex problems, and proactively seek out solutions to new and unique challenges.
Key Responsibilities:
- Develop & Implement Automation Solutions:
- Design and build advanced web scrapers and automation bots using NodeJs, TypeScript, and Puppeteer.
- Automate complex web interactions, including form submissions, file uploads, navigation through dynamic content, and custom interactions with non-standard form elements.
- Implement strategies to handle captchas, rate limiting, and anti-bot mechanisms.
- Problem Solving & Innovation:
- Identify creative solutions to overcome roadblocks and web security measures.
- Develop strategies for scraping data efficiently from various websites, ensuring data integrity and accuracy.
- Work independently to research, prototype, and implement solutions for new and unfamiliar challenges.
- Ownership & Leadership:
- Take full ownership of your projects, from initial concept to deployment, with minimal guidance.
- Lead by example, establishing best practices for automation and web scraping.
- Mentor and provide technical guidance to junior team members when needed.
- Documentation & Reporting:
- Document automation scripts, strategies, and processes for future reference.
- Provide regular updates and communicate challenges and solutions to stakeholders.
Required Skills & Qualifications:
- 5+ years of experience in JavaScript development, with at least 3 years focused on web scraping or browser automation.
- Expertise in JavaScript and TypeScript with NodeJs.
- Strong experience using Puppeteer or similar browser automation libraries.
- Demonstrated experience in developing complex web scrapers and automation scripts.
- Ability to creatively solve complex problems, often with limited information or precedent.
- Understanding of web technologies (HTML, CSS, JavaScript) and experience with manipulating the DOM.
- Experience with captchas, anti-bot measures, and dealing with web security mechanisms.
- Familiarity with debugging and performance optimization for high-volume scraping tasks.
- Strong self-motivation, curiosity, and a passion for tackling unique challenges.
Preferred Qualifications:
- Experience with other scraping and automation tools (e.g., Playwright, Selenium).
- Familiarity with cloud-based scraping and deployment solutions.
- Previous experience leading or mentoring technical teams.
What We Offer:
- Competitive salary and performance bonuses.
- Comprehensive benefits package, including health, dental, and vision insurance.
- Opportunity to lead in a highly creative and challenging environment.
- Professional development and continuous learning opportunities.
Location: Fully Remote
Employment Type: Full-time