Dataset inventory

A. SUMMARY
The dataset inventory provides a list of data maintained by departments that are candidates for open data publishing or have already been published and is collected in accordance with Chapter 22D of the Administrative Code. The inventory will be used in conjunction with department publishing plans to track progress toward meeting plan goals for each department.

B. HOW THE DATASET IS CREATED
This dataset is collated through 2 ways:
1. Ongoing updates are made throughout the year to reflect new datasets, this process involves DataSF staff reconciling publishing records after datasets are published
2. Annual bulk updates - departments review their inventories and identify changes and updates and submit those to DataSF for a once a year bulk update - not all departments will have changes or their changes will have been captured over the course of the prior year already as ongoing updates

C. UPDATE PROCESS
The dataset is synced automatically daily, but the underlying data changes manually throughout the year as needed

D. HOW TO USE THIS DATASET
Interpreting dates in this dataset
This dataset has 2 dates:
1. Date Added - when the dataset was added to the inventory itself
2. First Published - the open data portal automatically captures the date the dataset was first created, this is that system generated date

Note that in certain cases we may have published a dataset prior to it being added to the inventory. We do our best to have an accurate accounting of when something was added to this inventory and when it was published. In most cases the inventory addition will happen prior to publishing, but in certain cases it will be published and we will have missed updating the inventory as this is a manual process.

First published will give an accounting of when it was actually available on the open data catalog and date added when it was added to this list.

Companion systems inventory dataset
This is a list of datasets published and unpublished, a companion dataset of citywide enterprise systems of record can be accessed online as well.