Datalynn
Professional Experience
EXACT DATES TO ADD
Software Engineer Intern
- Built a high-concurrency data collection pipeline with Python, AsyncIO, aiohttp, and Playwright, reducing end-to-end latency by approximately 60% and processing more than 180,000 rows per day.
- Designed a reusable crawler plugin from requirements through deployment for on-demand data updates and upstream query workflows.
- Distributed processing across five workers, improving throughput from approximately 0.5 GB/hour to 2 GB/hour.
- Processed results with Pandas, stored structured data in MySQL, and exposed CRUD workflows through FastAPI APIs.