PROJECT 01 • DATA ENGINEERING
UK Housing Data Platform
An end-to-end data platform built around HM Land Registry transaction data, with automated ingestion, PostgreSQL modelling, an API layer and an interactive Streamlit dashboard.
FOCUS
End-to-end delivery
The project covers ingestion, storage, analytical modelling, API access and a deployed dashboard rather than stopping at a single analysis.
DATA
HM Land Registry
Large-scale Price Paid Data is downloaded, loaded and shaped into datasets designed for fast exploration of market trends and geography.
DEPLOYMENT
Public interactive app
The dashboard is deployed with Streamlit and backed by PostgreSQL, with automated keep-alive checks supporting the public portfolio demo.
Architecture
PostgreSQL views and materialised views prepare analytical datasets for the application, while Docker keeps the local services reproducible.
What I built
- Automated ingestion for large Land Registry files.
- PostgreSQL tables, views and materialised views for analytical workloads.
- A FastAPI layer for filtered access to the underlying data.
- A multi-page Streamlit application covering trends, geography and market behaviour.
- Containerised local services using Docker Compose.
- A deployed PostgreSQL-backed portfolio version of the application.
LIVE PROJECT
Explore the platform
The full Streamlit application is embedded below. Use the dashboard sidebar to move between Overview, Price Trends, Geography, COVID Era Analysis, Data Explorer and the other pages.
What I learned
Building the platform strengthened my understanding of handling large static datasets, separating raw and analytical layers, designing data for reporting and connecting several services into one reproducible application.