iCapital
Python Developer - Associate
About this role
Experienced Python developer needed to design and build web scraping solutions using Playwright and AWS serverless services. You'll automate complex portal interactions, handle authentication flows, and architect scalable data extraction pipelines for high-volume extraction tasks.
What you'll do
- Design and implement advanced scraping solutions using Python, Playwright, and AWS services
- Automate interactions with JavaScript-heavy websites and secured portals, including MFA and CAPTCHA handling
- Architect serverless scraping pipelines using Lambda, Step Functions, S3, CloudWatch, and Secrets Manager
- Build fault-tolerant systems with intelligent logging and retry mechanisms for high-volume data extraction
- Integrate complex workflows across multiple portals, APIs, and data sources
- Contribute to architectural decisions and establish best practices
What they're looking for
- Python development (5+ years)
- Playwright and browser automation
- Web scraping (Selenium, Scrapy, BeautifulSoup)
- AWS (Lambda, S3, IAM, CloudWatch, Secrets Manager)
- Multi-factor authentication and session management
- Asynchronous programming
- Web protocols and network reverse-engineering
- APIs and data transformation (JSON/XML)
Benefits
- Competitive salary with annual performance bonus
- Equity for full-time employees
- 100% employer-paid health and dental insurance
- Generous paid time off
- Hybrid work arrangement (4 days office, 1 day remote on Friday)
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
iCapital
iCapital builds high-performance APIs, applications, and web platforms on microservices architecture, serving the investment and insurance domains. The company is hiring software engineers, full stack developers, QA analysts, and rotation program participants to develop features, maintain code quality, and collaborate across product and engineering teams.
View all jobs at iCapitalLikely interview questions
- Describe your experience with Playwright and how you've handled MFA flows in production scraping solutions.
- Walk us through your approach to architecting a scalable scraping pipeline on AWS Lambda and Step Functions.