IDS Site Assessment Tool

Great work on having an MOU(s) in place with at least two agencies and a project-by-project approval process. To become a fully-operational IDS site, your organization’s next step should focus on having an MOU with at least 3 agencies that includes regular and planned data sharing processes and research approval processes established across the agencies.

To become an exemplary IDS site in the Legal Issues category, your organization should have MOUs across three or more agencies with a regular plan for data updates and approval processes of research protocols.

Congratulations, your organization has met the criteria to be considered a fully-operational IDS site within the Legal Issues category. There is one more step your organization can complete to become an exemplary site in the Legal Issues category: build a regular plan for data updates and approval processes for research protocols with 3 or more agencies.

Excellent, based on your results, your site meets the standards of an exemplary IDS site in the Legal Issues category. Your organization has 3 or more MOU’s across different agencies and a regular plan for data updates and approval processes for research protocols.

Because your organization does not have any procedures established to evaluate the quality of your data, we recommend taking the following steps in order to become a fully-operational IDS site in the Data Quality category:

1. Create procedures to check the quality of your record linkage results.
2. Establish regular, manual review of data linkage results and conduct audits of certain data elements.

Once steps 1 and 2 are complete, your organization can work on becoming an exemplary IDS site by establishing automated routines for checking consistency, completeness, and accuracy of the data records each agency will be sharing and conducting routine validity testing of common data elements from different sources.

Great work on establishing some systematic reviews for a couple of your organizations’ record linkage and data quality.

To become a fully-operational IDS site, establish regular reviews of data linkage and audits of data elements.

To become an exemplary IDS site in the Data Quality category, your organization should establish automated routines for checking consistency, completeness, and accuracy of the data records each agency will be sharing and conduct routine validity testing of common data elements from different sources.

Congratulations, your organization has met the criteria to be considered a fully-operational IDS site within the Data Quality category. There is one more step your organization can complete to become an exemplary site in the Data Quality category: create automated routines for checking consistency, completeness, and accuracy of data records plus routine validity testing of common data elements from different data sources.

Excellent, based on your results, your site meets the standards of an exemplary IDS site in the Data Quality category.   Your organization has automated routines for checking consistency, completeness and accuracy of data records, and conducts routine validity testing of common data elements from different data sources.

Because your organization does not have a governance process established, below are the following steps you should consider if you would like to become a fully-operational IDS site in the Governance category:

1. Create data use agreements that stipulate the procedures for IRB approvals and for vetting study results.
2. Work on creating a governing board with defined processes for reviewing proposals and results.

Once steps 1 and 2 are complete, your organization can work on becoming an exemplary IDS site by establishing a research advisory board to review projects for scientific integrity, and building a community and practitioner stakeholder engagement component.

Great work on establishing some data use agreements to stipulate the procedures for IRB approvals and vetting study results.

To become a fully-operational IDS site, your organization should start working on creating a governing board with a defined process for reviewing proposals and results.

To become an exemplary IDS site in the Governance category, your organization can then work on creating a research advisory board that reviews projects for scientific integrity, and building a community and practitioner stakeholder engagement component.

Congratulations, your organization has met the criteria to be considered a fully-operational IDS site within the Governance category. There is one more step your organization can complete to become an exemplary site in the Governance category: establish a research advisory board that reviews projects for scientific integrity, and develop a community and practitioner stakeholder engagement component.

Excellent, based on your results, your site meets the standards of an exemplary IDS site in the Governance category.

Your organization has established a governing board with a defined process for reviewing proposals and ­­ results, has established a research advisory board that reviews projects for scientific integrity, and has developed a community and practitioner stakeholder engagement component.

Because your organization does not have a technical system in place for integrating data, below are the following steps you should consider if you would like to become a fully-operational site in the Technology category:

1. Discuss the possibilities of creating a technology system to share data with other organizations.
2. Focus on creating a technology system where data are imported, linked, and shared on a regular basis, and build routines to clean and process the data regularly.

Once steps 1 and 2 are complete, your organization can work on becoming an exemplary IDS site by developing automated procedures for data transmission, linkage, storage, and cohort construction.

Great work on having data exchanged on an ad hoc or project-by-project basis.   To become a fully-established IDS site, begin developing a technology plan so data can be imported, linked, and stored on a regular basis. You should also build routines to clean and process the data regularly.

To become an exemplary IDS site in the Technology category, establish automated procedures for data transmission, linkage, storage, and cohort construction.

Congratulations, your organization has met the criteria to be considered a fully-operational IDS site within the Technology category. There is one more step your organization can complete to become an exemplary site in the Technology category: create automated procedures for data transmission, linkage, storage, and cohort construction.

Excellent, based on your results, your site meets the standards of an exemplary IDS site in the Technology category because you have automated procedures for data transmission, linkage, storage, and cohort construction.

Because your organization does not have executive leadership fully supporting the IDS effort, below are the following steps you should consider if you would like to become a fully-operational IDS site in the Political Sustainably Category:

1. Start working on having at least one executive leader behind your effort.
2. Focus on obtaining the backing of multiple agency executive leaders (3 or more) who have agreed to provide support to the effort and receive periodic updates on its progress.

Once steps 1 and 2 are complete, your organization can work on becoming an exemplary IDS site by establishing the IDS so that successive agency administrators will assume ongoing stewardship.

Great work on having at least one executive leader fully behind your IDS effort. To become a fully-established IDS site, plan to have multiple agency executive leaders (3 or more) who have agreed to provide support to the effort and receive periodic updates on its progress.

After you have three or more executive leaders on board, your organization can work on becoming an exemplary IDS site by aiming to have the IDS established so that successive agency administrators will assume ongoing stewardship.

Congratulations, your organization has met the criteria to be considered a fully-operational IDS site within the Political Sustainability category. There is one more step your organization can complete to become an exemplary site in the Political Sustainability category: establish your IDS operation so that successive agency administrators will assume ongoing stewardship.

Excellent, based on your results, your site meets the standards of a fully-operational IDS site in the Political Sustainability category. Your IDS has been established so that successive agency administrators will assume ongoing stewardship.

Because your organization does not have any funding in place, below are the following steps you should consider if you would like to become a fully-operational IDS site in the Economic Sustainability Category:

1. Obtain a planning grant that also funds at least one project to demonstrate the value of linked administrative records.
2. Aim to complete the demonstration project(s) and have other new projects underway.

Once steps 1 and 2 are complete, your organization can work on becoming an exemplary IDS site by creating an ongoing funding stream (or streams) that includes both operational and project expenses.

Great work on having a planning grant and at least one project underway that demonstrates the value of linked administrative records. To become a fully-established IDS site, your organization should focus on is completing the demonstration project(s) and starting new project(s). To become an exemplary IDS site in the Economic Sustainability category, establish an ongoing funding stream (or streams) that includes both operational and project expenses.

Congratulations, your organization has met the criteria to be considered a fully-operational site within the Economic Sustainability category. There is one more step your organization can complete to become an exemplary site in the Economic Sustainability category: establish an ongoing funding stream (or streams) that includes both operational and project expenses.

Excellent, based on your results, your site exceeds the standards of an exemplary IDS site in the Economic Sustainability category. Your organization has an ongoing funding stream (or streams) in place that includes both operational and project expenses.