Key Responsibilities
Data Pipeline Development & Maintenance
Design, build, and maintain scalable ETL/ELT pipelines for structured and unstructured data
Develop solutions on AWS
Ensure pipelines are secure, performant, monitored, and production-ready
Implement logging, alerting, and monitoring mechanisms
Data Modelling & Architecture
Design and optimise data models (normalised and denormalised)
Align with enterprise data architecture and metadata standards
Support analytics and reporting requirements
Data Quality & Governance
Ensure data accuracy, completeness, and consistency
Support governance requirements (classification, retention, privacy)
Conduct unit and integration testing of data pipelines
Reporting & Visualisation Support
Support and enhance Power BI dashboards
Contribute to monthly Exco reporting
Develop new KPIs and reporting features
Stakeholder Collaboration
Partner with Product teams and Analysts to translate business needs into technical solutions
Contribute to technical solution documentation
Participate in onboarding and knowledge transfer sessions
Documentation & Handover
Maintain clear technical documentation:
Architecture diagrams
Data flow specifications
Transformation logic
Implementation guidelines
Provide structured handover to internal teams where required
Deliverables
Technical Solution Design Documents
Production-ready operational data pipelines
Optimised data models and schemas
Monitoring and logging implementation
Complete documentation and handover packs