Automation Tools
A collection of Python automation tools: data pipeline scripts, report generators, web scraping utilities, and API integration connectors built for specific business needs.
- Role
- Solo Developer
- Dates
- 2024 – 2025
Context
Business teams spend hours weekly on repetitive data tasks: pulling reports, cleaning spreadsheets, and entering data across systems.
My contribution
Built focused Python workflows for extraction, transformation, reporting, and integration with external services.
What I built
Built reusable Python scripts that automate these workflows. Each tool handles a specific task — data extraction, report generation, or cross-system data synchronisation.
Implementation
Modular Python scripts organised by function. FastAPI provides an orchestration layer for scheduled jobs. SQL databases store job logs and configuration. Playwright handles web automation where needed.
Implementation decisions
- Organised Python scripts by function behind a FastAPI orchestration layer.
- Stored job logs and configuration in SQL databases.
- Used retry logic for unreliable external APIs.
Key features
- Scheduled data extraction from multiple sources
- Automated Excel and CSV report generation
- Web scraping pipeline with error handling and retries
- API integration connectors for common business services
Tech stack
- Python
- FastAPI
- SQL
- Playwright
- REST APIs
Challenges
- Handling flaky external APIs with retry logic
- Making tools configurable without becoming complex
What I learned
- Configuration over code when non-technical users need control
- Error handling and logging are the most important part of automation
- Simple scripts composed together beat monolithic solutions
Future improvements
- Web UI dashboard for job monitoring
- Notification integrations for Slack and Teams