Srikeerthi Srinivasan Project Overview: Developed an advanced tool to automate the extraction of meal data from various culinary websites using the Scrapy framework. This project enhances the efficiency of dietary planning and analysis by providing detailed insights into meal composition.
Technical Skills and Tools:
- Web Scraping: Utilized Python with the Scrapy framework to create custom spiders for targeted data extraction from multiple culinary websites.
- Data Handling: Implemented data pipelines in Python to process, store, and manage large datasets in MongoDB, ensuring data integrity and security.
- Software Development: Structured and maintained a robust directory architecture to facilitate easy installation, operation, and scalability of the scraping tool.
- Database Management: Configured MongoDB for data storage, creating an efficient system for querying and managing scraped meal information.
- Problem Solving: Devised solutions for resuming interrupted scraping sessions, enhancing data collection efficiency without data loss.
Impact:
- Enabled dieticians and nutrition experts to access a consolidated database of meal information, streamlining nutritional analysis and meal planning.
- Contributed to data-driven decision-making in dietary management by providing comprehensive, accurate meal data.