Skip to main content

iCapital

Python Developer - Associate

IN - Jaipurfull-timeentryAdded yesterday

About this role

Build and deploy scalable web scraping solutions using Python and Playwright to extract data from complex, authenticated portals. You'll architect serverless AWS infrastructure for high-volume data extraction while handling MFA, JavaScript rendering, and security challenges.

What you'll do

  • Design and implement advanced web scraping solutions using Python, Playwright, and AWS services
  • Automate portal interactions including MFA flows, CAPTCHA handling, and session-based authentication
  • Architect serverless pipelines using Lambda, Step Functions, S3, CloudWatch, and Secrets Manager
  • Build fault-tolerant systems with retry logic and intelligent logging for high-volume data extraction
  • Integrate workflows across multiple portals, APIs, and data sources
  • Contribute to architectural decisions and establish best practices

What they're looking for

  • Python (5+ years)
  • Playwright and browser automation
  • AWS Lambda, S3, IAM, CloudWatch, Secrets Manager
  • Web scraping (Scrapy, BeautifulSoup, Selenium)
  • Multi-factor authentication and session management
  • Asynchronous programming and headless browsers
  • HTTP/HTTPS protocols and network debugging
  • API integration and data transformation (JSON/XML)

Benefits

  • Competitive salary with annual performance bonus
  • Equity grants for full-time employees
  • 100% employer-paid health and dental insurance
  • Generous paid time off
  • Hybrid flexibility (4 days office, 1 day remote)
Apply with Autofill

Opens the application — the Jobs AI extension fills it for you. Set up autofill

Opens the official application on the employer’s site. No login required.

iCapital

iCapital builds high-performance APIs, applications, and web platforms on microservices architecture, serving the investment and insurance domains. The company is hiring software engineers, full stack developers, QA analysts, and rotation program participants to develop features, maintain code quality, and collaborate across product and engineering teams.

View all jobs at iCapital

Likely interview questions

  • Describe your experience handling multi-factor authentication in automated scraping workflows—what challenges did you face and how did you solve them?
  • How have you deployed and scaled scraping workloads on AWS Lambda, and what strategies did you use to manage costs and performance?
Unlock all 7 questions free — and practice them live →