Open source Python libraries for the public sector
-
AI Powered Migration Tools
This repository outlines processes and includes tools used for interpreting data generated from site crawls to inform content migrations. The tools are designed to assist with data migration, data cleaning, and AI-fueled data analysis tasks. The goal is to apply data-based decisions to consolidating the migration of multiple sites. -
AllUSGov
This project attempts to map the organization of the US Federal Government by gathering and consolidating information from various directories. -
Argus
Argus is a CI/CD pipeline plugin that brings “a hundred eyes” to your project, combining leading open source security tools into a scalable, automated, continuous security pipeline. Argus supports emerging compliance profiles including FedRAMP 20X and NIST, as well as custom-defined compliance frameworks, to provide continuous visibility into a system's security posture.
Contributed by Huntridge Labs. -
Comet-API
The goal of this project is to provide a Python-based starter API, which comes pre-configured with tools supporting the accelerated development of both Comet as well as general python APIs.
Contributed by Metrostar. -
Compliance IO
Python library for reading/writing compliance as code:- Read / write OpenControl repositories
- Serialize OSCAL SSP and component definitions to JSON
-
m2py
m2py is a MUMPS-to-Python transpiler that uses textX to parse MUMPS source code into an Abstract Semantic Graph (ASG), enrich it through multi-pass analysis, and generate executable Python code, with a runtime library to support MUMPS semantics. -
Medium Post Scripts
Download CivicActions Medium accessibility posts using and save them as posts in a separate site. -
Pyction
Run Python scripts with uv inside a slim, fast Docker container based on Python 3.13. -
Python Site Evaluation Tools
Scan alt text from government sites to produce CSV's with images and associated text descriptions. There is also an AI component which generates AI alt text for comparison with the existing alt text. -
SSP-Flask
The CivicActions SSP Toolkit is a collection of Python scripts and markdown and YAML file templates that are used to automate the generation of System Security Plan documents. SSP Flask is a wrapper for the SSP Toolkit which uses a Flask web application to facilitate the generation and management of the files. -
Template-Application-Flask
This is a template application that can be used to quickly create an API using Python and the Flask framework.
Contributed by Nava. -
Datapusher+
A fifth-generation data ingestion and transformation tool built for CKAN, Datapusher+ is designed to handle the complexities of modern data pipelines. It supports a wide range of data formats and sources, and provides robust features for data validation, transformation, and loading into CKAN. It features configurable FAIRification, with an AI-enabled metadata suggestion engine, built-in support for DCAT-US v3, and is designed to be easily extensible to support additional metadata standards and agency-specific metadata requirements.
Contributed by datHere. -
qsv Data Wrangling Toolkit
The blazing fast, all-in-one toolkit for data wrangling, analysis, and transformation that datHere found was common in its open data deployments. With a focus on speed (e.g. it compiles 48 statistical measure for a million row, 520mb, 41-column CSV in 0.563 seconds) - qsv provides a suite of command-line tools for working with tabular data files, including filtering, sorting, aggregating, and more. Whether you're dealing with small datasets or large cloud-based data, qsv is designed to handle your data processing needs with ease. Powers the FAIRification engine in Datapusher+.
Contributed by datHere. -
qsv MCP Server & Claude Cowork Plugin qsv is a very powerful data wrangling toolkit, but it can be intimidating for users who are not familiar with command-line tools or data processing concepts. To make qsv more accessible to a wider audience, datHere has developed an MCP Server and a Claude Cowork Plugin that allow users to perform complex data analysis of large datasets using natural language queries.
Specifically targeted for Evidence-based Policymaking use cases in the public sector - it allows business and policy analysts who may not be familiar with typical data science tools, to leverage advanced data processing with ease.
The Claude Cowork plugin has built-in support for the US Census MCP server, BLS MCP server, and the FBI Crime Data MCP server, allowing users to easily add additional context from these high-value data sources.
Contributed by datHere. -
FBI Crime Data MCP Server
An MCP server that provides access to the FBI Crime Data Explorer API with smart caching. Query crime statistics, arrest data, hate crimes, NIBRS incidents, law enforcement employment, and more — directly from any MCP-compatible client.
Contributed by datHere. -
CKAN Ecosystem Catalog
Explore the CKAN Ecosystem - a comprehensive catalog of sites, tools, extensions, and resources for the CKAN Data Management System (DMS) platform. And of course, the catalog is built using CKAN itself!
Developed by University of Pittsburgh and datHere as part of the NSF Pathways to Enable Open Source Ecosystems (POSE) project and contributed to the CKAN community.
Contributed by datHere.
Supported by
