UK Public Sector Code by Organisation

A cookiecutter template for data science projects within His Majesty's Government and wider public sector.

Guidance for quality assurance of code for civil service researchers and analysts.

R package: generate best-practice stats spreadsheets for publication

Good Practice Tables - an XlsxWriter wrapper to write consistently formatted statistical tables to Excel.

ONS Design System

Development website for collecting and disseminating UK data for the Sustainable Development Goal global indicators.

afcharts is an R package for creating accessible plots by the Government Analysis Function.

Reusable map components for Svelte projects.

A Python package for text-classification tasks associated with the production of official statistics, utilising semantic search and Retrieval Augmented Generation

ONS Map templates

Data repository for SDGs

The official repository of all publication ready ONS charts.

Runs an in-memory MongoDB instance for Go unit tests

Beeswarm plot templates

Reusable chart templates for Svelte projects.

A Python package for creating accessible charts following Government Analysis Function guidance

Django Wagtail CMS for managing and publishing content for the Office for National Statistics (ONS)

This repository contains CROW, the Clerical Resolution Online Widget, an open-source project designed to help data linkers with their clerical matching needs!

Starter page templates using ONS svelte-components.

ONS Dissemination development team documentation.

Repository to store code for outputs that are produced from the Subnational Statistics and Analysis division.

Python and PySpark implementation of Goldstein et al.'s Scalelink method of data linkage.

For any specific queries or detailed feedback, please contact us at [email protected]

This data set family supports the Explore Subnational Statistics initiative of the Office for National Statistics and provides low level geography data across many indicators for the United Kingdom's four nations. For any specific queries or detailed feedback, please contact us at [email protected]

Legacy headless CMS used by the ONS website

ONS SDC Method for Cell Key Perturbation in R

ONS Address Index Matching Service containerised deployment for external users

Resources and templates for documenting analytical workflows, assumptions and limitations.

Dataset API for customise my data

Digital publishing resumable file upload service that handles on the fly encryption and writing to S3. It updates images through the CMS

Svelte components for ONS projects

A template for scrolly projects with a .docx and ArchieML parser

Automated Data Checker for Python

Go module implementing a kafka client wrapper, abstracting messages to go channels

Controller for handling datasets on the ONS website

A helpful command line tool to make Digital Publishing developers' lives better

Routes website requests to the appropriate apps

Search API on to the ONSWebsite Search engine

An API for validating survey schemas

Reads CMD dataset dimensions and dimension options from the Dataset API and writes them to the graph DB.

Scripts for translating eq-survey-runner surveys

Scripts for generating common geography files.

ONS Data Scientist Learning Pathway

Fork of WorldPop's repo for Malawi census support

An API used to manage the authorisation of users accessing data publishing services.

Get data from the landregistry sparql endpoint and process it

A dashboard to monitor SDC survey response rates

A collection of api clients written in go and used for the ONS website

Examples of services generated by the dp-cli tool

Docker containers for Concourse CI

R package for ONS ggplot2 themes and scales.

Github actions to format CPI items data

An HTTP service for the controlling of search query

API for submitting and monitoring Cantabular filter/flex jobs to produce customised dataset outputs.

A service for managing the retrieval of files from public and private s3 buckets

Static File Publisher

An API used by florence and internal micro services to create import datasets which is then updated by other micro services

A project to assist in composing multiple DP services

Templates for tables created by the data visualisation team, including static, interactive, and chables.

API for managing access control permissions for Digital Publishing API resources

Test components in isolation using Godog / Gherkin

Repository for work-in-progress and infrequently used chart templates.

Common resources for ONS charts

Library of classification functionality associated with UK SIC (Standard Industrial Classification)

A web page for checking the accessibility of spreadsheets

SIC Classification Utilities

SOC Classification Utilities

Event driven nomad deployer service.

Library of classification functionality associated with UK SOC (Standard Occupational Classification)

An ONS branded theme for MkDocs based on Material for MkDocs

RAP minimum standard guidance for the Office for National Statistics

RAP-RPG

Bootstrap module to support the use of terraform template

Terraform module for Google Cloud Privileged Access Manager (PAM) CI entitlements. Provisions a JIT elevation entitlement and the required PAM service agent binding for a target service account, with configurable approvers and grant duration.

Data processing for the ONS Visual Journalism catalogue of releases.

For testing SimPy concepts

A benchmarking tool for EQ Survey Runner

Renders a table in multiple formats, given data in json format

Enables greater flexibility in creating journeys through the website

Results processing methods for ONS business surveys

The dis-bundle-api is a backend service for managing and publishing datasets and content as bundles, similar to Florence’s collections.

A registry of questionnaire schemas for eq-questionnaire-runner.

Resource api for customise my data

Takes a CMD filter job and produces a filtered dataset CSV.

Tracks CMD dataset imports, recording the completion of the import steps to the Dataset API and then updating the import API job to state to completed.

A Svelte Kit template for creating embedded semi-automated journalism content to sit within an iframe.

Template for robo articles

Component that breaks down the 'Databakered' CSV into individual rows and writes them to a Kafka queue.

An API for handling file meta data

Supply Cantabular metadata for Florence metadata journey.

Service that consumes CMD observations to import from Kafka and writes them to the Graph DB.

Logging library for Go

Configuration for cloud foundry UAA

Common embedding functionality used by Survey Assist

Utilities used as part of Survey Assist API or UI

A wrapper for govulncheck to allow exclusions

A live editor for RosaeNLG PUG templates.

API for submitting and monitoring CMD filter jobs. Also proxies Cantabular filter jobs.

Shared classification library, LLM interface and LLM prompts for Survey Assist

Quarto extension to create nested category lists.

Architecture artifacts around the EMM metadata model

Repo for the eQ team to create prototypes using the ONS Design System

Generates the static HTML for https://developer.ons.gov.uk/

Smoke tests for the dataset catalogue

react component ui for table builder

Repository holding tools and code snippets relating to all units on the Analysis for Action platform

Copy of Census 2021 UI Prototype inside ONS Digital Org

Welcome to the Dissemination Engineering Standards repository

Analysis for the coding in analysis and research survey.

R Hackathon Repo

A sandbox repo for the Fintrans project

A registry of census questionnaire schemas for census31-eq-questionnaire-runner.

Service to store searchable content into elasticsearch

Action to scrape CPI weights for use in the ONS inflation calculator

Take screenshots of all ONS visualisations

Housing affordability explorer

A Go Service to redirect legacy URLs requested by users

A Go API for management of redirects.

A Go API for data migration.

Get mortgage interest rates from the Bank of England api

A rendering library for Dissemination frontend go microservices. dis-design-system-go contains template, localisations, model structs, css and javascript that are core to all dissemination frontend services.

Service to retrieve data to update search index

A scheduler application for automating the purging of cache for paths to be published.

Periodic nomad job for checking integrity of zebedee workspace

REST API for managing cache control information for pages within the legacy CMS

Proxy for handling the cache for pages within the legacy CMS

Image importer

Digital Publishing image management API

Provides a GET endpoint to generate and download files

Controller for handling homepage on ONS website

To allow user feedback on the ONS website

This contains the code for the dp feedback api

Reusable Python logging library implementing the ONS Dissemination JSON log standard for Lambda functions

A simple FastAPI to mock the SDS service required by eq-runner.

A questionnaire launcher for eq-survey-runner

Data Admin UI

REST API providing querying of CMD dataset observations with limited filtering capability.

Data pipeline for ONS Beta website

Library for search algorithm and improvement mechanisms

Legacy part of the ONS website

Automated quality assurance methods for demographic outputs

Svelte code for a prototype wellbeing dashboard

Search Reindexing Batch Job

ONS content object notation

A Svelte Kit scrollytelling template designed to run from RosaeNLG PUG templates, as generated using [this editor](https://github.com/ONSvisual/robo-editor)).

Weekly deaths Svelte dashboard

Frontend service to host filter and flexing of datasets

Network utilities library

Release Calendar frontend controller

Frontend code for the personal inflation calculator interactive

Automated scripts to scrape data from ONS time series tool to supply data for the personal inflation calculator interactive.

Extracts dimensions and dimension options from the uploaded CMD CSV dataset files and writes them to the Dataset API

Begins the process of retrieving categories from Catabular API to begin the population of dimensions into our datastore

Consumes error messages from the CMD import process and report them to the Dataset API

Storage for files generated and consumed by the geo-scripts repo

A logging library to be used for python projects in Dissemination

Consumes a Kafka message (cantabular-export-start) to begin the process of retrieving the counts from Cantabular.

A simple FastAPI to mock the CIR service required by eq-runner

Cantabular xlsx exporter

Routes API requests to set services, with additional header tags

This repository holds the code for the data-api bundle scheduler, which is used to automate the publication of datasets included within a bundle.

dp-cantabular-metadata-exporter

A Golang microservice that expands industry codes, output area codes, identifies survey codes and years in the search query and returns them separately

Extracts dimension options (aka categories) from the Cantabular server and writes them to the dataset API.

A healthcheck library to be used for python apps in Dissemination.

Golang library for accessing specific cookies

Terraform infrastructure to generate load test against eq-survey-runner

Dissemination client library for Redis or similar protocols.

A REST API wrapper around the Cantabular Extended GraphQL API allowing querying of information about observations, variables, and categories.

Utilities for robo-journalism.

A collection of API clients written in Python for use across the ONS.

HTML dashboard produced using Quarto displaying data from the Office for National Statistics’ Health Insight Survey, commissioned by NHS England.

Fake upstream search stub to mimic upstream services using a generic search contract to integrate with our search stack

Generate accessible XLSX spreadsheets in JS

Achived visualisations from ONSvisual

Encrypted HTTP Multipart Upload

An application to serve dataset overview pages on the ONS website

Fork of davidcarboni/cryptolite

OpenTelemetry startup code for Go services

A Java client library for the dp-image-api

Brutally opinionated REST micro-framework.

A Java client for the dp-dataset-api service

A repo containing code that clips shapefiles or geopackage files to a geographical bound set by the user (for example, a local authority boundary).

JS library for client side token renewal

Svelte code for RTI weekly dashboard

Generate accessible ODS spreadsheets with in a web browser or using Node.js

Frontend svelte app for ONS visual journalism's searchable release catalogue

An interactive tool to allow users to adjust and explore population projections for the UK.

Proof of concept for using svelteplot library to replace svelte-charts for advanced data visualisation products

Prototype for building census profiles for sub-population groups. Based on synthetic data.

Scrolly project on the intersectionality of disability, unemployment and ethnicity.

Using the table templates to prototype the ELS Area Comparison Page

An experimental linter for use when working with Go templates that construct JSON snippets.

A vault library for Go.

Check desired apps are running on both web_mount boxes and report any issues to Slack

A registry for supplementary dataset schemas for the SDS service.

Repo for EQ maintenance page

R package for the production of vital statistics from civil registration data. The package handles data validation, processing/derivation, aggregation and analysis.

A java client library for sending slack messages

A Java JSON Web Token (JWT) verification library

Access Java resources as .properties, File, XML or String

Fork of davidcarboni/httpino

GitHub Desktop tutorial repository

CPI items interactive

A basic Python template to jump start a Python project

A basic Python template to jump start a Python project

A basic ETL pipeline Python template to jump start a Python project

A basic Python template to jump start a Python project