Skip to main content

PROJECT 01 • DATA ENGINEERING

UK Housing Data Platform

An end-to-end data platform built around HM Land Registry transaction data, with automated ingestion, PostgreSQL modelling, an API layer and an interactive Streamlit dashboard.

PythonPostgreSQLFastAPIDockerStreamlit

FOCUS

End-to-end delivery

The project covers ingestion, storage, analytical modelling, API access and a deployed dashboard rather than stopping at a single analysis.

DATA

HM Land Registry

Large-scale Price Paid Data is downloaded, loaded and shaped into datasets designed for fast exploration of market trends and geography.

DEPLOYMENT

Public interactive app

The dashboard is deployed with Streamlit and backed by PostgreSQL, with automated keep-alive checks supporting the public portfolio demo.

Architecture

HM Land Registry → Python ingestion → PostgreSQL → FastAPI → Streamlit

PostgreSQL views and materialised views prepare analytical datasets for the application, while Docker keeps the local services reproducible.

What I built

  • Automated ingestion for large Land Registry files.
  • PostgreSQL tables, views and materialised views for analytical workloads.
  • A FastAPI layer for filtered access to the underlying data.
  • A multi-page Streamlit application covering trends, geography and market behaviour.
  • Containerised local services using Docker Compose.
  • A deployed PostgreSQL-backed portfolio version of the application.

LIVE PROJECT

Explore the platform

The full Streamlit application is embedded below. Use the dashboard sidebar to move between Overview, Price Trends, Geography, COVID Era Analysis, Data Explorer and the other pages.

Open in new tab ↗
Live dashboard

What I learned

Building the platform strengthened my understanding of handling large static datasets, separating raw and analytical layers, designing data for reporting and connecting several services into one reproducible application.