Data Analyst & Web Scraper Developer
Exploratory data analysis and information extraction automation for the mining sector, developing interactive visualization tools and web scraping workflows with Python.
Detailed description
Data Analysis and Visualization
Performed exploratory data analysis (EDA) using Python and Pandas to support strategic decision-making in the mining sector, identifying key patterns and trends in client datasets. Developed an interactive metrics visualization application with Dash and Plotly, enabling the team to explore data dynamically without requiring advanced technical knowledge.
Web Scraping and Data Extraction
Automated data extraction workflows through Web Scraping with Python and BeautifulSoup4, retrieving drilling information from mining news portals in a structured and periodic manner. For dynamic content sites, performed reverse engineering on the DOM to ensure accurate data extraction regardless of frontend complexity.
Responsibilities
- Exploratory data analysis (EDA) with Python and Pandas for strategic decision-making.
- Development of interactive data visualization applications with Dash and Plotly.
- Automated web scraping workflows for structured data extraction from dynamic sites.
- DOM reverse engineering to ensure reliable extraction from complex frontends.
Key achievements
- Automated drilling code extraction from 2 mining news portals, eliminating the need for personnel dedicated exclusively to manually reviewing articles one by one.
- Performed exploratory data analysis across 5 to 7 datasets, consolidating dispersed information into actionable insights to support the client's strategic decision-making.