Tracxn is hiring for Senior Engineer β Web Crawling & Automation in Bangalore
π Job Summary
Company: Tracxn Technologies Ltd
Role: Senior Engineer β Web Crawling & Automation
Location: Bangalore, Karnataka, India
Experience: 1 β 8 Years
Skills Required: JavaScript/Node.js/Python, Web Crawling (Puppeteer/Playwright), Web technologies. :contentReference[oaicite:0]{index=0}
π§ Job Description
As a Senior Engineer in Web Crawling & Automation at Tracxn, you will design and build scalable web crawler solutions to extract large-scale data from diverse sources, using frameworks such as Puppeteer and Playwright. Youβll implement advanced proxy management, anti-bot techniques, and automated monitoring systems while collaborating with the technology team to make architectural decisions. :contentReference[oaicite:1]{index=1}
Main Responsibilities
- Design and develop scalable web crawling solutions using modern tooling like Puppeteer and Playwright. :contentReference[oaicite:2]{index=2}
- Implement proxy management and anti-bot strategies for reliable crawling at scale. :contentReference[oaicite:3]{index=3}
- Create systems for debugging, monitoring, and performance optimization. :contentReference[oaicite:4]{index=4}
- Participate in technical discussions and contribute to architectural design. :contentReference[oaicite:5]{index=5}
- Work with distributed systems and advanced data pipelines (desired). :contentReference[oaicite:6]{index=6}
πΌ Salary Expectations
While the exact salary for this senior crawling role isnβt disclosed publicly, broader salary data suggests:
- Software engineers in India at Tracxn can earn approximately βΉ4.6 LPA to βΉ10.5 LPA depending on experience and role specifics. :contentReference[oaicite:7]{index=7}
- Salaries for related automation roles may vary widely and depend on expertise with distributed systems, crawling scale, and cloud technologies. :contentReference[oaicite:8]{index=8}
π How to Prepare for this Role
- Deep Expertise in JavaScript/Node.js & Python: Strong programming fundamentals, asynchronous patterns, and advanced language features.
- Web Crawling Frameworks: Hands-on with Puppeteer, Playwright and understanding of HTTP mechanics, headers, sessions, and bots mitigation.
- Anti-Bot & Proxy Management: Knowledge of rotating proxies, captcha handling, and request throttling strategies.
- Distributed Systems & Data Pipelines: Familiarity with scalable architectures, queues, and monitoring systems.
- Cloud Platforms: Experience with AWS/GCP services like Lambda, EC2, or similar is a plus.
- System Design Skills: Practice designing fault-tolerant workflows and high-throughput pipelines.
π’ About Tracxn Technologies
Tracxn Technologies is a Bangalore-based product company that provides a research and deal sourcing platform used by venture capital, private equity, and corporate development teams globally. The platform aggregates startup and market intelligence data to power investment decisions and corporate strategy. :contentReference[oaicite:9]{index=9}
The tech team works with a diverse technology stack and focuses on building scalable products with ownership and minimal hierarchy. :contentReference[oaicite:10]{index=10}
π Company Culture & Reviews
Employee reviews on platforms like AmbitionBox and Indeed indicate a mixed experience:
- Overall company rating around 3.1/5 suggests a moderately positive environment. :contentReference[oaicite:11]{index=11}
- Work-life balance and culture scores around average, with flexible work arrangements noted by some reviews. :contentReference[oaicite:12]{index=12}
- Glassdoor reviews indicate some positive aspects like supportive teams, but also mention challenges like micro-management and fixed office expectations. :contentReference[oaicite:13]{index=13}
Note: Ratings vary across teams and functions. Always consider connecting with current or past employees for role-specific insights. :contentReference[oaicite:14]{index=14}
π₯ Industry Demand & Trends
Web crawling, automation, and advanced data extraction skills are in high demand across sectors including finance, research, e-commerce, and analytics. Expertise in scaling crawlers, handling anti-bot measures, and building robust data pipelines positions engineers for strong career growth in data-centric product companies. :contentReference[oaicite:15]{index=15}
βοΈ Pros & Cons of Working at Tracxn
| Pros | Cons |
|---|---|
| Strong focus on scalable technology and ownership | Mixed employee reviews on compensation and culture |
| Exposure to challenging crawling & automation problems | Work culture varies by team |
| Opportunity to work on data products used globally | Job security and advancement perception varies |
π Apply Now
π’ Join Our Telegram Channel
πΌ Get Daily IT Job Updates, Interview Tips & Exclusive Alerts directly on Telegram!
π Join Telegram