+
## Clinical data handling tools
-## Importance of keeping clinical data safe
+Clinical research relies heavily on the collection, processing, analysis, and management of data. Efficient and effective data handling is crucial to ensure the integrity, reliability, and validity of clinical trials and studies. Selecting the right tools for handling clinical data is a critical step in the research process. This section defines data handling in the context of clinical research and contrasts it with data quality, discusses the importance of privacy, provides a comprehensive guide on how to find suitable clinical data handling tools with a focus on open-source options, and emphasizes the importance of testing data handling methods using dummy data in the preliminary phases of a clinical trial.
+
+### Clinical data handling
+
+**Clinical data handling** involves the processes and tools used to collect, manage, store, process, and share clinical data in a way that maintains its integrity, security, and usability. It encompasses a range of activities, including:
+
+- Data Collection: Gathering data from various sources such as case report forms (CRFs), electronic health records (EHRs), patient surveys, and laboratory results.
+- Data Storage and Management: Safely storing data in databases or data warehouses and managing access to ensure that only authorized personnel can interact with the data.
+- Data Cleaning and Processing: Ensuring data consistency, accuracy, and completeness by detecting and rectifying errors, missing values, and inconsistencies.
+- Data Analysis: Using statistical and analytical tools to generate insights from the data that can inform clinical decisions and study outcomes.
+- Data Sharing and Reporting: Providing access to data for collaborators, regulators, or stakeholders in a secure and controlled manner and generating reports that summarize findings.
+
+The goal of effective data handling is to ensure that data is accurate, reliable, and available when needed, while also protecting patient privacy and complying with regulatory standards.
+
+#### Data quality vs data handling
+
+Data quality and data handling are closely related but distinct concepts in clinical research.
+
+- **Data Quality**: Refers to the accuracy, completeness, consistency, and reliability of data. High-quality data is essential for producing valid and reliable research outcomes. It involves processes such as data validation, error checking, and quality control measures.
+- **Data Handling**: Encompasses the broader scope of managing the data lifecycle, from collection and storage to processing, analysis, and sharing. While data quality is a component of data handling, the latter also involves aspects like data security, access management, and regulatory compliance.
+
+Both data quality and data handling are critical for ensuring the integrity of clinical research. Data handling tools must support high data quality standards through features like automated data validation checks, error reporting, and data cleaning functions.
+
+### Selecting clinical data handling tools
+
+Choosing the right tools for clinical data handling depends on several factors, including the study's size, complexity, data types, regulatory requirements, and budget. Key considerations include:
+
+- **Compatibility and Integration**: The tool should be compatible with existing data systems and workflows, allowing for seamless integration of data from multiple sources.
+- **Scalability**: The tool should be able to handle the volume of data expected in the study and scale as the study progresses.
+- **User-Friendliness**: A user-friendly interface can reduce the learning curve for researchers and data managers, improving efficiency and reducing errors.
+- **Regulatory Compliance**: The tool should comply with relevant data privacy and security regulations to protect patient data.
+- **Support and Documentation**: Adequate support, including user manuals, tutorials, and customer service, is essential for troubleshooting and maximizing the tool's potential.
+
+Research teams should conduct thorough evaluations, including reading reviews, seeking recommendations, and conducting pilot tests, to identify the best tool for their specific needs.
+
+#### Open source options
+
+Open-source tools provide a cost-effective and flexible alternative to proprietary software for handling clinical data. These tools are often developed and maintained by vibrant communities and can be customized to fit specific research needs.
+
+Advantages of open-source tools include:
+
+- They are typically **free to use**
+- They provide **transparency** by allowing users to review the codebase for security and compliance
+- They can be **modified** to meet unique requirements
+- They often have strong **community support**, which can be valuable for troubleshooting and enhancing functionalities.
+
+Examples of popular open-source data handling tools include:
+
+- **REDCap**: A secure, web-based application for building and managing online surveys and databases, widely used in clinical research for data collection and management.
+- **OpenClinica**: An open-source clinical trial software that supports data capture, management, and analysis, compliant with regulatory standards like FDA requirements for electronic data (FDA 21 CFR Part 11).
+- **KNIME**: A data analytics, reporting, and integration platform that can be used for data cleaning, processing, and analysis, with extensive capabilities for machine learning and data visualization.
+- **R and Python**: These programming languages offer powerful libraries and packages (such as the `tidyverse` for R, and `pandas` and `NumPy` for Python) that support a wide range of data handling and analysis tasks.
+
+Each of these tools carries their own idiosyncratic pros and cons. For example, KNIME is a code-free analytical platform that may be ideal for students or new analysts to get comfortable with data processing and management. However, KNIME is not easily scalable, so it may not be ideal for large or multi-site projects. REDCap is a highly scalable and customizable survey and data collection platform that offers some basic statistical and data visualization tools, and offers APIs to allow the real-time analytics in other platforms (R, C#, cURL, etc.). However, REDCap licensing limits it to non-profit institutions (and other potentially limiting requirements), so this should be investigated before plans are made to use the environment. REDCap and R both allow for regulatory compliance. The FDA has issued [guidance](https://www.r-project.org/doc/R-FDA.pdf) on using R for clinical trials. REDCap can be configured to support compliance with the FDA 21 CFR Part 11, HIPAA, and GDPR.
+
+While open-source tools are beneficial, it is essential to ensure they are secure, well-maintained, and compliant with relevant privacy and regulatory standards.
+
+When moving between multiple data handling tools, it is important to consider interoperability. As an example, REDCap and R play very nicely together via API tokens, but this may not be true of all electronic data capture systems or databases. The sharing, integration and redistribution of data between systems - whether internally or externally - needs to be carefully planned, tested and documented.
+
+### Testing data handling tools
+
+Before implementing data handling methods in an actual clinical trial, it is crucial to run tests using **dummy data**. This step ensures that the data handling process is robust, efficient, and free from errors across different conditions, without risking sensitive patient information.
+
+- **Creating Realistic Dummy Data**: Dummy data should mimic the real data in terms of format, structure, and complexity. It should include various scenarios (e.g., missing data, outliers, data entry errors) to test the system's error-handling capabilities.
+- **Simulating the Full Data Handling Workflow**: The process should involve every stage of data handling, from data collection and entry to storage, cleaning, analysis, and reporting. This comprehensive simulation helps identify potential issues early, such as data loss, security vulnerabilities, or errors in data processing algorithms.
+- **Refining and Optimizing Data Handling Methods**: Based on the findings from dummy data tests, researchers can refine their data handling protocols, adjust tools and settings, and optimize workflows to ensure smooth operations when real data is introduced.
+
+Testing with dummy data provides an additional layer of quality assurance and helps build confidence in the data handling process before the clinical trial begins.
+
+### Conclusion
+
+Effective clinical data handling is fundamental to the success of clinical trials and studies. Selecting the right tools requires careful consideration of privacy, regulatory compliance, open-source versus proprietary options, and the specific needs of the study. Understanding the difference between data quality and data handling is crucial, as both are essential for ensuring the validity and reliability of research outcomes. Running preliminary tests using dummy data is a critical step in validating data handling methods, ensuring that the chosen tools and processes are robust, secure, and efficient. By following these guidelines, researchers can enhance data management practices, protect patient privacy, and achieve meaningful and reliable clinical research outcomes.
+
+## Privacy considerations for clinical data
+
+Privacy is a fundamental consideration in clinical data management, given the sensitive nature of the information involved. Clinical data often contains personally identifiable information (PII) or personal health information (PHI), which must be protected to comply with privacy regulations such as the [Health Insurance Portability and Accountability Act](https://www.hhs.gov/hipaa/for-professionals/privacy/laws-regulations/index.html) (HIPAA) in the United States, the [General Data Protection Regulation](https://gdpr.eu/what-is-gdpr/) (GDPR) in the European Union, and other regional laws. More information about PII and PHI can be found in [this course](https://hutchdatascience.org/Ethical_Data_Handling_for_Cancer_Research/data-privacy.html) about ethical data handling.
+
+- **Data Anonymization and De-identification**: One of the primary methods to protect privacy is to anonymize or de-identify data, removing or encrypting any information that could directly or indirectly identify an individual.
+- **Privacy-Preserving Record Linkages**: In scenarios where data from multiple sources need to be linked without compromising individual privacy, privacy-preserving record linkage techniques are essential. These methods enable the integration of datasets by matching records in a way that minimizes the risk of re-identification. Techniques such as secure multi-party computation, homomorphic encryption, and differential privacy can be employed to ensure that the linkage process itself does not expose sensitive information.
+- **Access Control and Encryption**: Tools should support robust access controls, ensuring that only authorized users have access to the data. Encryption should be used for both data at rest and data in transit to prevent unauthorized access.
+- **Compliance and Auditing**: Tools should facilitate compliance with regulatory standards and provide auditing capabilities to track data access and usage.
+
+When selecting data handling tools, it is crucial to prioritize those that offer comprehensive privacy features to safeguard sensitive information and maintain public trust in clinical research.
## Government regulators
+Clinical data is governed by several different types of regulations. In this section, we will review some of the major regulatory frameworks and organizations.
+
+### Health Insurance Portability and Accountability Act (HIPAA)
+
+The [Health Insurance Portability and Accountability Act](https://www.hhs.gov/hipaa/for-professionals/privacy/laws-regulations/index.html) (HIPAA), regulated by the U.S. Department of Health and Human Services (HHS), establishes national standards to protect individuals’ medical records and other personal health information. It applies to health plans, healthcare clearinghouses, and healthcare providers that conduct certain healthcare transactions electronically. The HIPAA Privacy Rule requires appropriate safeguards to protect the privacy of protected health information (PHI) and sets limits on the uses and disclosures of such information without patient authorization.
+
+### Food and Drug Administration (FDA)
+
+The U.S. [Food and Drug Administration](https://www.fda.gov/regulatory-information/fda-rules-and-regulations) (FDA) regulates the safety, efficacy, and security of human and veterinary drugs, biological products, medical devices, food, cosmetics, and products that emit radiation. The FDA’s regulations ensure that clinical trials are conducted ethically and that data collected is reliable and accurate. This includes oversight of clinical trial protocols, informed consent, and reporting of adverse events.
+
+### General Data Protection Regulation (GDPR)
+
+The [General Data Protection Regulation](https://gdpr.eu/what-is-gdpr/) (GDPR), governed by the European Union (EU), is a comprehensive data protection law that governs the collection, processing, storage, and transfer of personal data within the EU. It aims to enhance individuals’ control over their personal data and simplify the regulatory environment for international business. GDPR applies to any organization that processes the personal data of EU residents, regardless of where the organization is based. Key provisions include the right to be forgotten, data portability, and mandatory breach notifications.
+
+### Honest brokers
+
+Honest brokers act as neutral intermediaries between the data source and researchers, typically regulated by Institutional Review Boards (IRBs) or equivalent bodies. They are responsible for de-identifying data to ensure that researchers cannot trace the data back to individual patients. Honest brokers must complete specific training, such as Collaborative Institutional Training Initiative (CITI) Research Ethics and HIPAA training, before accessing data. They play a crucial role in maintaining the confidentiality and integrity of clinical data.
+
## Documentation
+In data management, several types of documentation are frequently encountered, each serving a specific purpose throughout the lifecycle of a research project. These documents are crucial for ensuring data integrity, regulatory compliance, and effective project management.
+
+### Data Management Plan
+
+A Data Management Plan (DMP) outlines how data will be handled during and after a research project. Typically created at the beginning of a project, it is stored in project documentation repositories or institutional databases. Often required by funding agencies, a DMP may include plans for testing with dummy data to ensure data integrity. The importance of a DMP lies in its role in planning and managing data throughout the project, ensuring that data is handled consistently and [responsibly](https://www.tableau.com/learn/articles/what-is-data-management).
+
+### Statistical Analysis Plan
+
+The Statistical Analysis Plan (SAP) details the statistical methods and analyses to be performed on the collected data. Developed before data analysis begins, it is stored with project documentation or in electronic lab notebooks. Essential for clinical trials and other research requiring rigorous statistical analysis, the SAP may involve testing statistical methods on dummy data. The SAP is crucial for maintaining the integrity and reproducibility of statistical [analyses](https://www.questionpro.com/blog/data-documentation/).
+
+### Standard Operating Procedures
+
+Standard Operating Procedures (SOPs) provide detailed instructions on how to perform specific tasks or processes. Used throughout the project lifecycle, they are stored in organizational repositories or document management systems. SOPs are often required for regulatory compliance and may include procedures for testing with dummy data. The importance of SOPs lies in their ability to standardize processes, ensuring consistency and compliance with regulatory [requirements](https://managing-qualitative-data.org/modules/2/a/).
+
+### Data Use Agreements
+
+Data Use Agreements (DUAs) define the terms and conditions for data sharing and use. Encountered before data is shared with external parties, they are stored in legal or administrative offices. DUAs are required when sharing data with external collaborators but are typically not directly related to dummy data. DUAs are important for protecting data privacy and ensuring that data is used [appropriately](https://www.ibm.com/topics/data-compliance).
+
+### Data Sharing Agreements
+
+Data Sharing Agreements (DSAs) specify the terms for sharing data between organizations. Encountered prior to data sharing, they are stored in legal or administrative offices. DSAs are necessary for formalizing data sharing arrangements and generally do not relate to dummy data. The importance of DSAs lies in their role in facilitating collaboration while protecting data integrity and compliance with legal [requirements](https://atlan.com/know/data-governance/data-compliance-management/).
+
+### Documentation across the span of a project
+
+These documents are encountered at various stages of a project, from planning (DMP, SAP) to execution (SOP) and data sharing (DUA, DSA). They are typically stored in project documentation repositories, institutional databases, or document management systems, with access restricted to authorized personnel. Not all documents are required for every project; their necessity depends on the project’s scope, regulatory requirements, and institutional policies. Some documents, like the DMP, SAP, and SOP, may include provisions for testing with dummy data to ensure data integrity and validate processes.
+
+To ensure compliance with these documents, organizations should implement robust data governance frameworks that include regular audits, training programs, and clear policies and [procedures](https://teamhub.com/blog/document-management-compliance-2/). Standardized templates for these documents are often available from funding agencies, regulatory bodies, or institutional guidelines, helping to ensure consistency and compliance with best practices. It’s best to ask before starting any document to ensure the correct format is used.
+
+For further reading, consider the following resources:
+
+- Guide to Clinical Data Management Procedures (GCDMP): GCDMP
+- Books by Suzanne Prokscha: Writing and Managing SOPs for GCP and Practical Guide to Clinical Data Management
+
+Additionally, remember the insightful quote by [Damian Conway](https://www.questionpro.com/blog/data-documentation/): “Documentation is a love letter that you write to your future self.” This is an invaluable tidbit to keep in mind throughout the lifecycle of a study.
+
## Conclusion
diff --git a/docs/03-data_management_files/figure-html/1ivDTcLjb2078O0GemkSeCgC1jmxk4fMsiFQaPaer9mQ_g3edc229d226_1_0.png b/docs/03-data_management_files/figure-html/1ivDTcLjb2078O0GemkSeCgC1jmxk4fMsiFQaPaer9mQ_g3edc229d226_1_0.png
new file mode 100644
index 0000000..7110e24
Binary files /dev/null and b/docs/03-data_management_files/figure-html/1ivDTcLjb2078O0GemkSeCgC1jmxk4fMsiFQaPaer9mQ_g3edc229d226_1_0.png differ
diff --git a/docs/404.html b/docs/404.html
index 34285ba..1a78c50 100644
--- a/docs/404.html
+++ b/docs/404.html
@@ -4,18 +4,18 @@
- -
@@ -190,7 +188,7 @@
- 5 Clinical Data Management
- 5.1 Learning Objectives -
- 5.2 Clinical data handling tools -
- 5.3 Importance of keeping clinical data safe -
- 5.4 Government regulators -
- 5.5 Documentation -
- 5.6 Conclusion +
- 5.2 Clinical data handling tools + +
- 5.3 Privacy considerations for clinical data +
- 5.4 Government regulators + +
- 5.5 Documentation + +
- 5.6 Conclusion
- 6 Appendix I: Ontologies, Vocabularies, Taxonomies, and Standards
-
@@ -190,7 +188,7 @@
- Data Collection: Gathering data from various sources such as case report forms (CRFs), electronic health records (EHRs), patient surveys, and laboratory results. +
- Data Storage and Management: Safely storing data in databases or data warehouses and managing access to ensure that only authorized personnel can interact with the data. +
- Data Cleaning and Processing: Ensuring data consistency, accuracy, and completeness by detecting and rectifying errors, missing values, and inconsistencies. +
- Data Analysis: Using statistical and analytical tools to generate insights from the data that can inform clinical decisions and study outcomes. +
- Data Sharing and Reporting: Providing access to data for collaborators, regulators, or stakeholders in a secure and controlled manner and generating reports that summarize findings. +
- Data Quality: Refers to the accuracy, completeness, consistency, and reliability of data. High-quality data is essential for producing valid and reliable research outcomes. It involves processes such as data validation, error checking, and quality control measures. +
- Data Handling: Encompasses the broader scope of managing the data lifecycle, from collection and storage to processing, analysis, and sharing. While data quality is a component of data handling, the latter also involves aspects like data security, access management, and regulatory compliance. +
- Compatibility and Integration: The tool should be compatible with existing data systems and workflows, allowing for seamless integration of data from multiple sources. +
- Scalability: The tool should be able to handle the volume of data expected in the study and scale as the study progresses. +
- User-Friendliness: A user-friendly interface can reduce the learning curve for researchers and data managers, improving efficiency and reducing errors. +
- Regulatory Compliance: The tool should comply with relevant data privacy and security regulations to protect patient data. +
- Support and Documentation: Adequate support, including user manuals, tutorials, and customer service, is essential for troubleshooting and maximizing the tool’s potential. +
- They are typically free to use +
- They provide transparency by allowing users to review the codebase for security and compliance +
- They can be modified to meet unique requirements +
- They often have strong community support, which can be valuable for troubleshooting and enhancing functionalities. +
- REDCap: A secure, web-based application for building and managing online surveys and databases, widely used in clinical research for data collection and management. +
- OpenClinica: An open-source clinical trial software that supports data capture, management, and analysis, compliant with regulatory standards like FDA requirements for electronic data (FDA 21 CFR Part 11). +
- KNIME: A data analytics, reporting, and integration platform that can be used for data cleaning, processing, and analysis, with extensive capabilities for machine learning and data visualization. +
- R and Python: These programming languages offer powerful libraries and packages (such as the
tidyversefor R, andpandasandNumPyfor Python) that support a wide range of data handling and analysis tasks.
+ - Creating Realistic Dummy Data: Dummy data should mimic the real data in terms of format, structure, and complexity. It should include various scenarios (e.g., missing data, outliers, data entry errors) to test the system’s error-handling capabilities. +
- Simulating the Full Data Handling Workflow: The process should involve every stage of data handling, from data collection and entry to storage, cleaning, analysis, and reporting. This comprehensive simulation helps identify potential issues early, such as data loss, security vulnerabilities, or errors in data processing algorithms. +
- Refining and Optimizing Data Handling Methods: Based on the findings from dummy data tests, researchers can refine their data handling protocols, adjust tools and settings, and optimize workflows to ensure smooth operations when real data is introduced. +
- Data Anonymization and De-identification: One of the primary methods to protect privacy is to anonymize or de-identify data, removing or encrypting any information that could directly or indirectly identify an individual. +
- Privacy-Preserving Record Linkages: In scenarios where data from multiple sources need to be linked without compromising individual privacy, privacy-preserving record linkage techniques are essential. These methods enable the integration of datasets by matching records in a way that minimizes the risk of re-identification. Techniques such as secure multi-party computation, homomorphic encryption, and differential privacy can be employed to ensure that the linkage process itself does not expose sensitive information. +
- Access Control and Encryption: Tools should support robust access controls, ensuring that only authorized users have access to the data. Encryption should be used for both data at rest and data in transit to prevent unauthorized access. +
- Compliance and Auditing: Tools should facilitate compliance with regulatory standards and provide auditing capabilities to track data access and usage. +
- Guide to Clinical Data Management Procedures (GCDMP): GCDMP +
- Books by Suzanne Prokscha: Writing and Managing SOPs for GCP and Practical Guide to Clinical Data Management +
@@ -214,21 +212,148 @@Chapter 5 Clinical Data Management
5.2 Clinical data handling tools
+Clinical research relies heavily on the collection, processing, analysis, and management of data. Efficient and effective data handling is crucial to ensure the integrity, reliability, and validity of clinical trials and studies. Selecting the right tools for handling clinical data is a critical step in the research process. This section defines data handling in the context of clinical research and contrasts it with data quality, discusses the importance of privacy, provides a comprehensive guide on how to find suitable clinical data handling tools with a focus on open-source options, and emphasizes the importance of testing data handling methods using dummy data in the preliminary phases of a clinical trial.
+++5.2.1 Clinical data handling
+Clinical data handling involves the processes and tools used to collect, manage, store, process, and share clinical data in a way that maintains its integrity, security, and usability. It encompasses a range of activities, including:
+-
+
The goal of effective data handling is to ensure that data is accurate, reliable, and available when needed, while also protecting patient privacy and complying with regulatory standards.
+++5.2.1.1 Data quality vs data handling
+Data quality and data handling are closely related but distinct concepts in clinical research.
+-
+
Both data quality and data handling are critical for ensuring the integrity of clinical research. Data handling tools must support high data quality standards through features like automated data validation checks, error reporting, and data cleaning functions.
+++5.2.2 Selecting clinical data handling tools
+Choosing the right tools for clinical data handling depends on several factors, including the study’s size, complexity, data types, regulatory requirements, and budget. Key considerations include:
+-
+
Research teams should conduct thorough evaluations, including reading reviews, seeking recommendations, and conducting pilot tests, to identify the best tool for their specific needs.
++- +5.2.2.1 Open source options
+Open-source tools provide a cost-effective and flexible alternative to proprietary software for handling clinical data. These tools are often developed and maintained by vibrant communities and can be customized to fit specific research needs.
+Advantages of open-source tools include:
+-
+
Examples of popular open-source data handling tools include:
+-
+
Each of these tools carries their own idiosyncratic pros and cons. For example, KNIME is a code-free analytical platform that may be ideal for students or new analysts to get comfortable with data processing and management. However, KNIME is not easily scalable, so it may not be ideal for large or multi-site projects. REDCap is a highly scalable and customizable survey and data collection platform that offers some basic statistical and data visualization tools, and offers APIs to allow the real-time analytics in other platforms (R, C#, cURL, etc.). However, REDCap licensing limits it to non-profit institutions (and other potentially limiting requirements), so this should be investigated before plans are made to use the environment. REDCap and R both allow for regulatory compliance. The FDA has issued guidance on using R for clinical trials. REDCap can be configured to support compliance with the FDA 21 CFR Part 11, HIPAA, and GDPR.
+While open-source tools are beneficial, it is essential to ensure they are secure, well-maintained, and compliant with relevant privacy and regulatory standards.
+When moving between multiple data handling tools, it is important to consider interoperability. As an example, REDCap and R play very nicely together via API tokens, but this may not be true of all electronic data capture systems or databases. The sharing, integration and redistribution of data between systems - whether internally or externally - needs to be carefully planned, tested and documented.
++5.2.3 Testing data handling tools
+Before implementing data handling methods in an actual clinical trial, it is crucial to run tests using dummy data. This step ensures that the data handling process is robust, efficient, and free from errors across different conditions, without risking sensitive patient information.
+-
+
Testing with dummy data provides an additional layer of quality assurance and helps build confidence in the data handling process before the clinical trial begins.
+++5.2.4 Conclusion
+Effective clinical data handling is fundamental to the success of clinical trials and studies. Selecting the right tools requires careful consideration of privacy, regulatory compliance, open-source versus proprietary options, and the specific needs of the study. Understanding the difference between data quality and data handling is crucial, as both are essential for ensuring the validity and reliability of research outcomes. Running preliminary tests using dummy data is a critical step in validating data handling methods, ensuring that the chosen tools and processes are robust, secure, and efficient. By following these guidelines, researchers can enhance data management practices, protect patient privacy, and achieve meaningful and reliable clinical research outcomes.
++5.3 Privacy considerations for clinical data
+Privacy is a fundamental consideration in clinical data management, given the sensitive nature of the information involved. Clinical data often contains personally identifiable information (PII) or personal health information (PHI), which must be protected to comply with privacy regulations such as the Health Insurance Portability and Accountability Act (HIPAA) in the United States, the General Data Protection Regulation (GDPR) in the European Union, and other regional laws. More information about PII and PHI can be found in this course about ethical data handling.
+-
+
When selecting data handling tools, it is crucial to prioritize those that offer comprehensive privacy features to safeguard sensitive information and maintain public trust in clinical research.
5.4 Government regulators
+Clinical data is governed by several different types of regulations. In this section, we will review some of the major regulatory frameworks and organizations.
+++5.4.1 Health Insurance Portability and Accountability Act (HIPAA)
+The Health Insurance Portability and Accountability Act (HIPAA), regulated by the U.S. Department of Health and Human Services (HHS), establishes national standards to protect individuals’ medical records and other personal health information. It applies to health plans, healthcare clearinghouses, and healthcare providers that conduct certain healthcare transactions electronically. The HIPAA Privacy Rule requires appropriate safeguards to protect the privacy of protected health information (PHI) and sets limits on the uses and disclosures of such information without patient authorization.
+++5.4.2 Food and Drug Administration (FDA)
+The U.S. Food and Drug Administration (FDA) regulates the safety, efficacy, and security of human and veterinary drugs, biological products, medical devices, food, cosmetics, and products that emit radiation. The FDA’s regulations ensure that clinical trials are conducted ethically and that data collected is reliable and accurate. This includes oversight of clinical trial protocols, informed consent, and reporting of adverse events.
+++5.4.3 General Data Protection Regulation (GDPR)
+The General Data Protection Regulation (GDPR), governed by the European Union (EU), is a comprehensive data protection law that governs the collection, processing, storage, and transfer of personal data within the EU. It aims to enhance individuals’ control over their personal data and simplify the regulatory environment for international business. GDPR applies to any organization that processes the personal data of EU residents, regardless of where the organization is based. Key provisions include the right to be forgotten, data portability, and mandatory breach notifications.
++5.4.4 Honest brokers
+Honest brokers act as neutral intermediaries between the data source and researchers, typically regulated by Institutional Review Boards (IRBs) or equivalent bodies. They are responsible for de-identifying data to ensure that researchers cannot trace the data back to individual patients. Honest brokers must complete specific training, such as Collaborative Institutional Training Initiative (CITI) Research Ethics and HIPAA training, before accessing data. They play a crucial role in maintaining the confidentiality and integrity of clinical data.
+- diff --git a/docs/reference-keys.txt b/docs/reference-keys.txt index 72187e0..7d9769d 100644 --- a/docs/reference-keys.txt +++ b/docs/reference-keys.txt @@ -57,3 +57,24 @@ rxnorm loinc emerging-standards-such-as-fhir omop +clinical-data-handling +data-quality-vs-data-handling +privacy-considerations +selecting-clinical-data-handling-tools +open-source-options +testing-data-handling-tools +conclusion-2 +hipaa +fda +gdpr +honest-brokers +health-insurance-portability-and-accountability-act-hipaa +food-and-drug-administration-fda +general-data-protection-regulation-gdpr +data-management-plan +statistical-analysis-plan +standard-operating-procedures +data-use-agreements +data-sharing-agreements +documentation-across-the-span-of-a-project +privacy-considerations-for-clinical-data diff --git a/docs/search_index.json b/docs/search_index.json index 20ed5e0..95f3996 100644 --- a/docs/search_index.json +++ b/docs/search_index.json @@ -1 +1 @@ -[["index.html", "Clinical Data Analysis for Cancer Informatics About this Course", " Clinical Data Analysis for Cancer Informatics May, 2026 About this Course This course is part of a series of courses created for the Informatics Technology for Cancer Research (ITCR) Training Network (ITN). The ITN is a collaborative effort of researchers around the United States that supports cancer informatics and data science training through resources, technology, and events. This initiative is funded by the following grant: National Cancer Institute (NCI) UE5 CA254170. Our courses feature tools developed by ITCR Investigators and make it easier for principal investigators, scientists, and analysts to integrate cancer informatics into their workflows. Please see our website at itcrtraining.org for more information. Except where otherwise indicated, the contents of this course are available for use under the Creative Commons Attribution 4.0 license. You are free to adapt and share the work, but you must give appropriate credit, provide a link to the license, and indicate if changes were made. Sample attribution: Cancer Data Management by Fred Hutchinson Data Science Lab (CC-BY 4.0). You can download the illustrations by clicking on this link for our slides. "],["introduction.html", "Chapter 1 Introduction 1.1 Motivation 1.2 Topics Covered 1.3 Curriculum", " Chapter 1 Introduction 1.1 Motivation This course is intended for researchers (including postdocs and students) with limited to intermediate experience with informatics research. The conceptual material will also be useful for those in management roles who are collecting data and using informatics pipelines. This course is intended to provide an overview of the different kinds of data commonly used in clinical research, the questions that can typically be asked with such data, as well as guidance for how to manage this data. 1.2 Topics Covered 1.3 Curriculum The course will cover key underlying principles and concepts in ethical data handling. "],["clinical-data-types.html", "Chapter 2 Clinical Data Types 2.1 Learning Objectives 2.2 Clinical data is unique 2.3 Major clinical data types 2.4 How to acquire clinical data 2.5 Description of data 2.6 Summary", " Chapter 2 Clinical Data Types Clinical data is health-related information collected from patients throughout their healthcare journey. It may come in many forms and its sensitive nature requires careful management by researchers. 2.1 Learning Objectives 2.2 Clinical data is unique Clinical data refers to information collected from patients during healthcare delivery, clinical trials, and medical research. Clinical data comes from a wide variety of sources and as such, requires careful consideration when designing, collecting, and analyzing this data. Unlike domains such as Finance or other areas in the sciences which predominantly use structured data with predictable and consistent formats, clinical data is often heterogeneous, integrating many forms of both structured and unstructured data: quantitative measurements, categorical data, genotyping, images, subjective narratives from patient notes, and objective observations or conclusions. The unstructured nature of free text from notes reflecting subjective patient experiences or qualitative insights from healthcare professionals especially adds a further layer of complexity. Furthermore, the contrast between patient and doctor notes reflects the dual perspectives of symptoms and formal diagnoses. In essence, clinical data’s unique blend of structured and unstructured components, along with its multidisciplinary nature, necessitates specialized methodologies for comprehensive analysis and interpretation in the realm of healthcare. Further, because clinical data contains sensitive, personal information about patients, there are additional security and ethics concerns in the handling and management of clinical data. 2.3 Major clinical data types Clinical data can come in many different forms, including patient demographics medical history or records such as diagnoses, lab results, vital signs, medication records, or procedure history genetic reports health monitor data images scanned documents, and notes written by physicians, nurses, and other clinicians survey/ case report form (CRF responses) and more … Some sources of clinical data are more prevalent and readily obtainable than others. For instance, notes, demographics, images, and histories or observations/records (lab results, vitals, medications, procedures) are often stored directly in electronic medical record systems making them more easily accessible and so are the focus of most Electronic Health Record (EHR) data research efforts. 2.3.1 Structured data Observational records such as test results and demographic data are often collectively referred to as “structured data”, as they are stored in electronic health record databases and often provided to researchers in tabular form. Structured data types frequently used in EHR research consist of comprehensive longitudinal records of a patient’s interactions with a healthcare system and may include demographics, diagnoses, lab values, procedures, vitals, and medication records. The structured nature of this data allows for it to be stored in tables which may be indexed by a patient or visit ID and often include timestamps and other supporting descriptors. For example, medication orders might specify the drug name, class, dose, unit, quantity, route, frequency, and other instructions. Structured data tables often describe entries in terms of codes from standardized vocabularies. Diagnoses might be described with codes from the International Classification of Diseases (ICD) vocabulary, lab tests with Logical Observation Identifiers Names and Codes (LOINC), medications with National Drug Code (NDC), and procedures with Current Procedural Terminology (CPT) codes. These terms, or “billing codes”, provide a common foundation that can be invaluable for identifying patients with a specific disease or who have received specified medications, particularly when integrating data from multiple sources. As we’ve described it, structured clinical data is expected to have similarities, although specific details may vary based on the type of EHR being used and any customizations to the EHR for the specific environment or institution in which data was collected (e.g., any specialized pre-processing by institutional research offices prior to providing data to researchers). So it is important for researchers to consider differences present in their data if they’ve obtained it from multiple contexts or institutions. 2.3.2 Unstructured data / clinical notes Clinical notes are, perhaps unsurprisingly, generally shared as seemingly straightforward text files. However, the simple format should not be taken as a suggestion that the data are easy to interpret. Some EHR systems contain literally dozens of types of notes, covering specialties such as pathology or surgery; specific moments in care such as admission or discharge; particular procedures such as colonoscopies; patient-provider interactions such as telehealth or phone encounters, and many others. In addition to differing in content, these sources may have different layouts and formats, ranging from free-form reports to structured SOAP (subjective, objective, assessment, and plan) formats or even templated procedure reports. Understanding the types of notes available in a given context and where relevant data might be found is a key step in effectively using clinical notes. When used in EHR research, both structured data and clinical notes are generally de-identified to protect patient privacy. Patient ID numbers might be replaced with new identifiers, with linkages maintained by institutional “honest brokers” (Dhir et al. 2008) charged with providing clinical data for research purposes. In some cases, dates may be changed as well. Clinical notes are generally “de-identified” through specialized software designed to remove names, dates, locations, and other sensitive details. Researchers working with institutions to access clinical data should be sure to understand local data de-identification practices. 2.4 How to acquire clinical data 2.4.1 Secondary Sources 2.5 Description of data 2.5.1 File types 2.5.2 Metadata 2.6 Summary References "],["specific-clinical-data-types.html", "Chapter 3 Specific Clinical Data Types 3.1 Learning Objectives 3.2 Physiological 3.3 Monitoring data 3.4 Radiology 3.5 Pathology 3.6 Synthetic Data 3.7 Summary", " Chapter 3 Specific Clinical Data Types 3.1 Learning Objectives 3.2 Physiological 3.3 Monitoring data This section was written by: Jennifer Kelleher, Ph.D.1; Abigail S. Robbertz, Ph.D.1; and Meghan E. McGrady, Ph.D.1,2 NOTE: Jennifer Kelleher, Ph.D.1 and Abigail S. Robbertz, Ph.D.1 contributed equally. 1 Center for Adherence and Self-Management, Division of Behavioral Medicine and Clinical Psychology, Cincinnati Children’s Hospital Medical Center, Cincinnati, OH, USA 2 Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, OH, USA The work discussed in this section was also supported by the National Cancer Institute at the National Institutes of Health (R21CA263704, K07CA200668) to MEM. JK and ASR are supported by the Eunice Kennedy Shriver National Institute of Child Health & Human Development at the National Institutes of Health (T32HD068223). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. Electronic monitoring devices are digital tools that can be used to track health behaviors over time such as: Sleep Physical activity Medication adherence Calorie intake Electronic monitoring devices can also be used to assess physical health indicators including: * Blood glucose levels * Blood pressure * Heart rate and heart rate variability * Oxygen saturation Electronic monitoring devices enable researchers to track day-to-day health behaviors in the patient’s “real-world” setting. This allows researchers to explore patterns or changes in a patient’s health behavior and provides a richer understanding of daily behavior over time. 3.3.1 Benefits of Monitoring Data Electronic monitoring devices often include data transmission abilities that enable healthcare providers or researchers to access these data in near real-time potentially informing intervention and/or medical decision-making. Electronic monitoring devices also have the potential to produce more accurate estimates of health behaviors than alternative strategies (e.g., self-report) as they are not subject to recall bias and can detect efforts to inflate adherence due to social desirability. 3.3.2 Considerations This section is not exhaustive. Research teams are strongly encouraged to consult with experts with experience and training in collecting and analyzing data from specific devices. To ensure the outcome variables are aligned with the research question of interest and ethical and age/developmental considerations (Psihogios et al. (2024); Modi et al. (2012)) have been appropriately accounted for, readers are encouraged to consult with researchers in their field who have integrated these measurement strategies into their work. 3.3.2.1 Medication Adherence There are three major components of medical adherence (the tracking of taking medication): Initiation: Starting a prescribed regimen Implementation: The amount of which a patient’s medication-taking behavior corresponds with the treatment regimen or protocol Discontinuation: Stopping a perscribed regimen For more information see: A new taxonomy for describing and defining adherence to medications (Vrijens et al., 2012) Pediatric self-management: A framework for research, practice, and policy. (Modi et al., 2012) 3.4 Radiology 3.5 Pathology 3.6 Synthetic Data 3.7 Summary References "],["clinical-data-uses.html", "Chapter 4 Clinical Data Uses 4.1 Learning Objectives 4.2 General uses of clinical data 4.3 Types of questions that can be asked with clinical data 4.4 Research Design Considerations 4.5 Conclusion", " Chapter 4 Clinical Data Uses 4.1 Learning Objectives 4.2 General uses of clinical data 4.2.1 Cancer Prevention and Care The near universal adoption of electronic health record (EHR) systems in the US has created unprecedented opportunities to improve cancer prevention and care. As described in previous chapters, EHR systems store comprehensive longitudinal records of a patient’s interactions with a healthcare system, including data about: demographics conditions family history clinical notes laboratory test results medications procedures imaging genetic test reports These data can be accessed not only by health professionals, but also by patients through patient portals. EHR data can also be used to enable data-driven interventions such as provider- and patient-facing clinical decision support (CDS) and population health management (PHM). CDS has been defined as tools that “provide clinicians, staff, patients, or other individuals with knowledge and person-specific information, intelligently filtered or presented at appropriate times, to enhance health and health care” (Osheroff et al. 2007). Examples of widely adopted CDS tools with demonstrated effectiveness for cancer prevention, diagnosis, and care include: provider and patient reminders for cancer screening decision aids and shared decision-making tools (e.g., for prostate cancer treatment, lung cancer screening) AI-supported diagnostic imaging chemotherapy decision support at-home symptom care While CDS tools generally provide decision support focused on a specific patient at a time, PHM are strategies that target specific patient populations (Swarthout and Bishop 2017). PHM efforts generally consist of: population algorithms that are applied over EHR and other data sources to identify individuals who are eligible for a specific healthcare intervention (e.g., colorectal cancer screening, tobacco cessation, HPV vaccination) patient engagement strategies (e.g., patient portals, text messaging, chatbots, patient navigators) that provide education and access to those interventions analytic tools that assess the effectiveness of the PHM program. Several PHM programs have demonstrated to be effective in increasing the uptake of cancer prevention. For example, the colorectal cancer screening program at Kaiser Permanente uses digital (i.e., text messaging, patient portal), mailed, and patient navigation approaches to increase colorectal cancer screening by mailing Fecal Immunohistochemical Test (FIT) kits to patients’ homes (Gupta et al. 2020). Also the Cancer Moonshot BRIDGE trial used the GARDE platform (Bradshaw et al. 2022) (ITCR-funded) to identify candidates for genetic testing of hereditary cancer syndromes based on EHR data; and for patient outreach, pre- and post-test education via automated chatbots (Kaphingst et al. 2024). Clinical Decision Support (CDS) can help patients and clinicians make decisions about an individual’s care, while Population Health Management (PHM) can help identify individuals for interventions and engagement. The image shows a single person getting a colorectal screening reminder for CDS and a population being identified for possibly needing colorectal screening for PHM. While some CDS and PHM approaches have been successfully adopted widely, emerging technologies such as the use of generative AI approaches to analyze diagnostic imaging, large language models (LLMs) to extract information from narrative texts (e.g., clinical notes), LLM-based chatbots to communicate with patients, and digital health tools such as home-based sensors are creating unprecedented opportunities for next generation CDS and PHM. These approaches have the potential to enable significant breakthroughs through the implementation of patient-tailored cancer prevention and care at a population scale. Nevertheless, substantial research is needed to ensure effective and fair implementation of these CDS and PHM interventions. 4.3 Types of questions that can be asked with clinical data 4.3.1 Risk Prediction Risk prediction in clinical research involves using data to assess the likelihood of certain outcomes or events occurring in patients. This could include predicting the risk of developing a particular disease, experiencing a specific complication, or responding to a treatment. Data used for risk prediction can come from various sources, including: Clinical Data: This includes patient demographics, medical history, laboratory results, and imaging studies. Genetic Data: Genetic information, such as DNA sequencing results, can provide valuable insights into an individual’s susceptibility to certain diseases. Environmental and Lifestyle Data: Factors such as diet, exercise habits, smoking status, and environmental exposures can influence disease risk and may be included in risk prediction models. Biomarkers: Biological markers indicative of disease or physiological processes can be used as predictors in risk models (Bodaghi, Fattahi, and Ramazani 2023). Once relevant data is collected, statistical and machine learning techniques can be applied to develop predictive models. These models aim to identify patterns and relationships within the data that are associated with the outcome of interest. Common techniques include logistic regression, decision trees, random forests, support vector machines, and neural networks. After the model is trained on a dataset, it can be validated using independent datasets to assess its performance and generalizability. Once validated, the model can be used to predict risk in new patients based on their individual characteristics and data. Clinical prediction rules are a subset of risk prediction models, specific to clinical research. Examples of risk prediction models … Risk prediction models are important because … Overall, risk prediction in clinical research allows healthcare professionals to identify individuals at higher risk of certain outcomes, enabling targeted interventions, personalized treatments, and more efficient resource allocation. 4.3.2 Cohort identification for research Clinical data plays a crucial role in cohort identification for research purposes. Researchers typically use electronic health records (EHRs), medical databases, or registries to identify cohorts based on specific criteria such as age, gender, medical conditions, treatments, medications, and outcomes. Advanced data mining and natural language processing techniques can also be employed to extract relevant information from unstructured data sources like clinical notes. Once cohorts are identified, researchers can analyze the data to study disease progression, treatment effectiveness, and outcomes. Cohort identification is important regardless of research study type, but to provide specific examples: Research Design: Identifying cohorts allows researchers to design studies with appropriate inclusion or exclusion criteria. By selecting specific groups of individuals with similar characteristics or exposures, researchers can investigate hypotheses effectively. Clinical Insights: Cohort studies enable researchers to observe the natural history of diseases, track outcomes over time, and assess the effectiveness of interventions or treatments. Understanding how different factors influence disease progression or treatment response can inform clinical decision-making and improve patient care. Epidemiological Studies: Cohort identification is crucial for epidemiological research to understand the incidence, prevalence, and risk factors associated with diseases. By following cohorts over time, researchers can identify trends, patterns, and associations that contribute to our understanding of disease causation and prevention. Precision Medicine: Identifying cohorts based on genetic profiles, biomarkers, or other specific characteristics allows researchers to tailor treatments and interventions to individual patients. This approach, known as precision medicine, aims to optimize therapeutic outcomes while minimizing adverse effects. Healthcare Policy and Planning: Cohort studies provide valuable data for informing healthcare policies, resource allocation, and public health strategies. By identifying high-risk populations or groups with specific healthcare needs, policymakers can develop targeted interventions to improve health outcomes and reduce disparities. 4.3.3 Case report forms (CRFs) In clinical research, case report forms (CRFs) are essential tools for collecting standardized data from study participants. Note that case report forms are any paper or form that will be filled in at the case or participant level. By that definition, even a consent form is a case report form! And each clinical study may utilize multiple CRFs (e.g., one for consent, another for medical history, another for reporting any adverse effects). CRFs are useful for several tasks already discussed within this chapter – specifically, tracking adverse events or outcomes (like those discussed in the Risk Prediction section) or tracking demographics and medical history for identifying cohorts (as discussed in the Cohort Identification section). CRFs are also useful for topics this chapter will discuss in later sections (e.g., Retrospective analyses). Designing CRFs that are accessible and sensitive to the different needs of participants requires careful consideration. Questions within CRFs should be formulated to gather comprehensive and accurate clinical data while ensuring participants feel safe, respected, and comfortable. This section explores the types of questions that can be asked using CRFs with a focus on accessibility, sensitivity, specificity, and comfort for people While within a study, CRFs help to ensure standardization in data collection, there may be a lack of standardization when comparing data between studies if each study did not use the same CRFs or comparable/subsets of questions within forms. This section will provide guidelines for types of questions that may be found within CRFs and writing these questions; however, there aren’t necessarily templates that have been used widely within the field. Further, your specific study needs may also require different or additional types of questions – the guidelines within this section are not exhaustive/all-encompassing of what may be encountered within the field. Here, we explore the different categories of questions that may be included within case report forms: Demographic and Socioeconomic Questions Capturing demographic and socioeconomic data is fundamental in clinical research to understand the background of study participants. However, these questions must be asked in a manner that respects privacy, avoids assumptions, and helps identify people with different life experiences. It’s also good practice in order to respect privacy to include an option allowing the participants to leave the question unanswered or respond with “prefer not to answer”. Sex and Gender: When asking about gender and sex include an option of “prefer to self-describe” to capture more information. Ethnicity and Race: Ethnicity and race questions should be specific and use respectful language, allowing participants to self-identify rather than selecting from a predefined list. Socioeconomic Status: Questions about employment, income, or education should be framed to capture social determinants of health without making participants feel judged. For example, asking, “What is your current employment status?” with choices that include full-time, part-time, unemployed, student, and unable to work can help gather relevant data without stigma. It is essential to use neutral, non-judgmental language and to explain why these questions are being asked, ensuring participants understand the relevance of their responses. Health and Medial History Questions Health and medical history questions provide critical information about baseline conditions and potential risk factors of participants. These questions should be framed clearly and respectfully to avoid any discomfort. Medical Conditions and History: Questions about past and present health conditions should use clear, accessible language. For example, “Have you ever been diagnosed with any of the following conditions? (Please check all that apply)” followed by a comprehensive list containing all necessary options. Medication Use: Questions about current and past medications should include over-the-counter and alternative therapies, and space should be provided for free-text responses to capture additional details. Disability and Functional Status: For many populations, it is important to use person-first language, such as “Do you have any physical, sensory, or cognitive impairments that you would like us to be aware of?” and provide space for participants to describe their specific needs. However, different populations have different preferences. The “Disability Language Style Guide” from the National Center on Disability and Journalism provides some basic guidelines, thorough discussion, and community specific advice on this topic (“Disability Language Style Guide” 2021). Avoiding medical jargon and providing definitions or examples can help ensure that participants understand the questions, and confidentiality should be emphasized to encourage honest responses. Experience and Quality of Life Questions Understanding how health conditions and treatments affect participants’ daily lives and well-being is essential, particularly for those from communities who experience health disparities and may also experience unique challenges. Daily Living and Social Functioning: Questions like “How often do your health conditions affect your ability to perform daily tasks (e.g., cooking, cleaning, working)?” can help assess the impact on daily life, with options ranging from “never” to “always.” Emotional and Psychological Well-Being: Including questions such as “In the past week, how often have you felt anxious or depressed?” using a scale from “not at all” to “very often” can provide insights into mental health needs. Support Systems and Social Networks: Asking about social support (e.g., “Do you have someone you can rely on for emotional support?”) can help identify participants’ needs for social and emotional resources. Using sensitive language and providing mental health support resources where needed is crucial when discussing emotional well-being to avoid triggering emotional distress. Sexual and Reproductive Health Questions Questions about sexual and reproductive health must be asked with sensitivity, as they can be deeply personal, particularly for groups who may face stigma. Sexual Orientation and Gender Identity (SOGI): Instead of just predefined categories, open-ended questions like “How would you describe your sexual orientation?” and “What is your gender identity?” allow participants to self-identify. Offering the option to skip these questions respects participants’ privacy. Options can be provided with a space or text box for the person to fill in their own descriptor, but having the categorical data will allow for easier analysis for those that select one rather than every response being from variable open text responses. Reproductive Health: Questions about menstrual health, contraception, or pregnancy should be framed neutrally. For example, “Are you currently using any form of contraception? If yes, please specify.” Sexual Activity and History: Questions should be direct but framed sensitively, such as “Are there any sexual health concerns you would like to discuss? Your answers will help us understand how to better support your care needs.” These questions should always be optional, with confidentiality emphasized to encourage honest, comfortable participation. Treatment Preferences and Decision-Making Questions Understanding participants’ preferences for treatment and decision-making is vital for providing patient-centered care, especially for certain groups of people. Decision-Making Preferences: Questions like “How involved would you like to be in decisions about your healthcare?” offer a range of choices from “I prefer to make decisions myself” to “I prefer my healthcare provider to make decisions,” allowing participants to express their autonomy. Cultural and Religious Considerations: Asking, “Are there any cultural, religious, or personal beliefs that we should consider when discussing treatment options with you?” ensures that care is respectful and culturally appropriate. Treatment Burden: Questions such as “What level of inconvenience or side effects would be acceptable to you when considering a treatment?” help to gauge participants’ preferences and comfort levels. These questions should be framed to respect participants’ autonomy and encourage honest responses without fear of judgment. Accessibility and Accommodation Needs Questions To ensure that all participants can fully engage with the study, it is essential to ask about accessibility and accommodation needs. Language and Communication Needs: “What is your preferred language for communication? Do you need an interpreter or translated materials?” These questions help ensure that participants can understand the materials. Physical Accessibility: Asking, “Do you require any specific accommodations to participate in this study (e.g., wheelchair access, hearing aids, visual aids)?” ensures physical accessibility. Format Preferences: “Would you prefer to complete this form online, on paper, or verbally with assistance?” helps accommodate different needs and preferences. Providing multiple options and allowing participants to request changes at any time is crucial to accommodate evolving needs. Providing multiple options and allowing participants to request changes at any time is crucial to accommodate evolving needs. Cultural Sensitivity and Identity Questions CRFs should respect different cultural backgrounds, values, and identities without perpetuating biases or assumptions. Cultural Identity and Practices: An open-ended question such as “Are there any cultural practices or beliefs that are important for us to be aware of in your care?” allows participants to share relevant information. Dietary Restrictions and Preferences: Asking, “Do you have any dietary restrictions or preferences that are culturally or religiously motivated?” ensures that these are respected. Community and Belonging: “Is there anything about your community or background that you would like us to know to provide better care?” encourages participants to share relevant aspects of their identity. These questions should be open-ended, allowing participants to skip questions they find irrelevant or uncomfortable. Ensuring Comfort, Trust, and Privacy Questions Fostering a sense of safety and trust is especially important for individuals who may have experienced discrimination in healthcare settings. Comfort and Confidentiality: Asking, “Do you feel comfortable with the way your information is being collected and stored? Are there any specific concerns you would like to address?” helps build trust. Feedback and Preferences: “Is there anything about this form or the study process that you find confusing, uncomfortable, or concerning?” invites participants to share their feedback. Consent and Voluntary Participation: Questions like, “Would you like to be contacted about the results of this study or for future research opportunities? Participation is entirely voluntary.” reinforce autonomy and respect. Reminding participants of the confidentiality and voluntary nature of their involvement can help foster a trusting environment. The guidelines above sometimes suggest use of open-ended questions where participants would provide free-text responses rather than selecting pre-defined categories. This will require researchers to process those free-text responses and may decrease the overall standardization. Designing specific and sensitive CRFs for clinical studies requires a thoughtful approach that respects the different backgrounds, privacy, and comfort of all participants, especially those from communities that experience health disparities. By using accessible language, offering multiple options, respecting autonomy, and providing a safe space for participants to express themselves, researchers can gather meaningful and accurate data while ensuring participants feel valued and respected. These considerations are vital to fostering clinical research that captures enough information about a wide variety of individuals. Case report forms (CRFs) are often tailored to specific studies and may vary widely in structure and content, lacking standardization across different projects. Despite this, certain themes are commonly expected in CRFs, including sections on participant demographics, medical history, treatment outcomes, and adverse events, ensuring essential data collection across a variety of study designs. By thoughtfully addressing both unique study requirements and universally relevant data points, researchers can optimize CRFs for consistency across clinical studies. 4.3.4 Clinical studies and trials Clinical data generated from clinical trials and observational studies form the backbone of evidence-based medicine. The ability to analyze and interpret this data enables researchers and clinicians to answer a variety of important questions that directly impact patient care, treatment decisions, and healthcare policies. Clinical trials are tightly regulated studies, controlling patient recruitment and monitoring administration and impact of treatments or interventions (“What Are Clinical Trials and Studies?” 2023). The goals of clinical trials include assessing the safety and efficacy of new treatments or interventions, comparing different/existing treatment options, determining the optimal dosage and administration of interventions, and identifying potential side effects or adverse events. Definition 4.1 The NIH’s definition of a clinical trial is “a research study in which one or more human subjects are prospectively assigned to one or more interventions (which may include placebo or other control) to evaluate the effects of those interventions on health-related biomedical or behavioral outcomes.” The NIH provides 4 questions and additional clarifications to consider when identifying if a study is a clinical trial or just a clinical study (“NIH’s Definition of a Clinical Trial,” n.d.). Definition 4.2 Prospectively assigned: Refers to a pre-defined process (e.g., randomization) specified in an approved protocol that stipulates the assignment of research subjects (individually or in clusters) to one or more arms (e.g., intervention, placebo, or other control) of a clinical trial (“NIH Clinical Trials,” n.d.). Here, we explore the different categories of questions that can be addressed using clinical trials data, ranging from the evaluation of treatment efficacy and safety to the exploration of predictive factors for disease prognosis and the personalization of medical care. Efficacy and Effectiveness Questions One of the primary objectives of clinical trials is to determine the efficacy of new treatments or interventions. Clinical data is used to answer fundamental questions such as “Is the new treatment effective?” and “How does its effectiveness compare to existing treatments?” Researchers design studies to measure the magnitude of treatment effects, comparing outcomes between treatment and control groups (e.g., a new drug versus a placebo or standard care). Beyond controlled settings, data from real-world evidence (RWE) studies can further address questions about the effectiveness of treatments when applied in routine clinical practice. For example, “Is Drug A more effective than Drug B in managing hypertension in a real-world patient population?” Such questions help to assess how treatments perform outside the controlled environment of clinical trials where patient adherence comorbidities, and polypharmacy may influence outcomes. While clinical trials are an important source of real-world data (RWD), they are typically conducted under tightly controlled conditions, which may not fully reflect the complexities of real-world studies. This makes RWE particularly valuable for understanding how treatments work when patients have varying levels of adherence or multiple chronic conditions that are often excluded from clinical trails. Definition 4.3 Comorbidities: refer to the presence of one or more additional medical conditions or diseases that coexist with a primary condition in a patient. These conditions can occur independently or be related to the primary disease. Safety and Tolerability Questions Safety is a critical aspect of any clinical study, and clinical data is essential in identifying and characterizing the safety profile of new treatments. Questions like “What are the common adverse effects of the new treatment?” or “What is the incidence of serious adverse events (SAEs) in patients receiving Drug A?” are addressed by carefully monitoring and recording adverse events throughout the study. Comparative safety questions also arise, such as “Does Drug A have fewer adverse effects compared to Drug B?” These questions are crucial in weighing the benefits of a treatment against its risk and in identifying specific populations that may be at higher risk of adverse reactions. Definition 4.4 Serious Adverse Events (SAEs): Any medical occurrence during a clinical trial or medical treatment that results in significant negative outcomes, such as death, life-threatening situations, hospitalization (or its prolongation), persistent or significant disability, or congenital anomalies. SAEs also include any event that requires intervention to prevent one of these outcomes. Definition 4.5 Incidence: Refers to the rate or number of new cases of SAEs that occur within a specific population during a defined time period, typically during a clinical trial or study. Is it usually expressed as a proportion, such as the number of SAEs per 100 or 1,000 participants, and helps measure how frequently these serious events happen among those exposed to a particular treatment or intervention. Comparative Effectiveness and Cost-Effectiveness Questions Beyond safety and efficacy, clinical data can be used to evaluate the comparative effectiveness of different treatments and their cost-effectiveness. These questions often guide healthcare policy and clinical guidelines: “Is Drug A more cost-effective than standard care for managing chronic heart failure?” and “What is the cost per quality-adjusted life year (QALY) gained with the new intervention?” Such analyses provide valuable information for stakeholders, including healthcare providers, payers, and policymakers, to make informed decisions on resource allocation. Definition 4.6 Cost per quality-adjusted life year (QALY) is a metric used in health economics to assess the value of a medical intervention by measuring the cost of gaining one year of life adjusted for its quality. A QALY incorporates both the quantity and quality of life lived, where one QALY is equivalent to one year of life in perfect health. If a treatment improves both the length and quality of life, it earns more QALYs. The cost per QALY is calculated by dividing the cost of the treatment by the number of QALYs gained, helping to determine the cost-effectiveness of healthcare interventions. Lower cost per QALY indicates better value for money in terms of health benefits achieved (2015). Mechanistic and Biomarker Questions Clinical studies often explore not just whether a treatment works, but also how it works. Mechanistic questions delve into the underlying biological pathways affected by a treatment. For instance, “Does Drug A work by inhibiting a specific enzyme involved in the disease process?” Biomarker data can play a key role in such analyses, helping to identify molecular markers that predict response to treatment. Questions like “Are there biomarkers that can predict which patients are more likely to benefit from Drug A?” help in developing targeted therapies and personalized treatment approaches. Predictive and Prognostic Questions Clinical trials and studies frequently aim to identify factors that predict disease outcomes or treatment responses. For example, “What baseline characteristics predict a better response to Drug A?” or “What are the predictors of mortality in patients with severe heart failure?” Such prognostic and predictive questions are crucial for identifying high-risk patients, guiding treatment decisions, and developing clinical guidelines. Identifying patient subgroups that benefit more or less from a treatment also facilitates personalized medicine approaches, ensuring that the right treatment is delivered to the right patient at the right time. With the advent of personalized medicine, clinical data is increasingly being used to answer questions tailored to individual patient profiles. For instance, “What patient characteristics modify the effect of the treatment?” or “Can we predict which patients are most likely to benefit from Drug A using machine learning models?” These questions are at the forefront of precision medicine, where the goal is to customize healthcare to each patient based on their unique genetic, biomarker, and clinical characteristics. Quality of Life and Patient-Reported Outcome Questions In modern clinical research, the impact of treatments on patients’ quality of life and their subjective experiences has gained prominence. Questions such as “How does Drug A affect patients’ quality of life compared to standard care?” or “What are the patient-reported outcomes associated with the new intervention?” are increasingly addressed in clinical trials. Data from quality of life assessments which are standardized and validated questionnaires (for example, the Health Assessment Questionnaire or HAQ), patient-reported outcome measures (PROMs, tools or questionnaires used to assess a patient’s health status or health-related quality of life directly from the patient’s perspective), and other patient-centric endpoints (Smoking History, Surgical History, etc.) provide valuable insights into how treatments affect patients beyond traditional clinical endpoints. Longitudinal and Follow-Up Questions Long-term follow-up studies are essential for understanding the durability of treatment effects and any delayed adverse effects. Questions like “What are the long-term outcomes associated with Drug A?” and “Is there a sustained benefit of Drug A in reducing symptoms after five years?” are vital for assessing the overall value of treatments. Such longitudinal analyses help in determining the optimal duration of therapy, the need for maintenance treatments, and the overall benefit-risk profile of an intervention. Safety in Special Populations Questions Clinical data can also be used to evaluate the safety and efficacy of treatments in special populations, such as children, pregnant women, or elderly patients. Questions such as “Is Drug A safe for use in pregnant women?” and “What is the risk of adverse events when Drug A is administered to patients with multiple comorbidities?” are essential for developing age- and condition-specific clinical guidelines. These questions help ensure that treatments are tailored to the needs of different patient populations, minimizing harm and maximizing benefits. Adherence and Compliance Questions Patient adherence to prescribed treatment regimens can significantly impact the outcomes of clinical studies. Questions like “What factors influence patient adherence to the new treatment?” and “How does adherence affect treatment efficacy?” are addressed through analyzing adherence data through monitors if a regulated study, or with interim/baseline analysis if non-regulated. Understanding these factors can lead to interventions that improve adherence and, consequently, the effectiveness of the treatment. Real-World Evidence and Generalizability Questions Real-world evidence (RWE) studies help bridge the gap between clinical trial results and clinical practice. Questions such as “How generalizable are the results of this clinical trial to the broader population?” or “What is the impact of real-world use patterns on treatment outcomes?” are essential for understanding how well clinical trial findings apply to everyday clinical settings. These questions help determine if the benefits observed in clinical trials can be replicated in diverse patient populations under routine care conditions. Prevention and Risk Reduction Questions Clinical data is also crucial in answering questions related to prevention and risk reduction strategies. For example, “Can the new treatment reduce the risk of developing diabetes in high-risk individuals?” or “What factors are associated with a reduced risk of cardiovascular disease in a large cohort study?” These questions are fundamental in preventive medicine, guiding public health interventions and informing clinical practice. Clinical Data provides a wealth of information that can be leveraged to answer a broad array of questions in clinical trials and studies. From understanding treatment efficacy and safety to exploring long-term outcomes, quality of life impacts, and the potential for personalized medicine, clinical data is foundational to advancing medical knowledge and improving patient care. Case report forms (CRFs) are instrumental in identifying patient cohorts or subgroups, documenting baseline characteristics, and capturing information on comorbidities, while also monitoring adherence data, which are essential for ensuring accurate and meaningful analysis. The type of questions that can be asked and answered are continually evolving as new data sources, analytical methods, and research paradigms emerge, further enriching the field of clinical research. 4.3.5 Retrospective analysis Retrospective analysis involves the examination of pre-existing clinical data to answer specific research questions, explore hypotheses, and identify patterns or trends. This method leverages historical data collected from medical records, administrative databases, registries, electronic health records (EHRs), or other sources of clinical information. The types of questions that can be asked through retrospective analysis span a wide range of clinical and epidemiological domains. The questions typically focus on understanding patient characteristics, disease epidemiology, treatment outcomes, risk factors, healthcare utilization, and more. Here, we explore the different categories of questions that can be addressed using retrospective data analysis: Descriptive Questions Descriptive questions aim to summarize and describe the characteristics of a patient population, disease, or healthcare process. They provide a foundational understanding of a dataset and are often the starting point for more complex analyses. Patient Demographics and Characteristics: What are the demographic profiles (age, gender, ethnicity, socioeconomic status) of patients diagnosed with a specific condition? What are the common comorbidities and risk factors in this population? Disease Prevalence and Incidence: What is the prevalence or incidence of a specific disease or condition in a particular population or geographic area over a defined period? Clinical Presentation: What are the most common presenting symptoms, clinical signs, or laboratory findings associated with a specific disease or condition? These questions help in understanding the baseline characteristics and epidemiology of diseases, which is crucial for planning further studies or developing public health interventions. Treatment and Intervention Questions Retrospective data can be used to examine the real-world effectiveness, safety, and patterns of treatment and interventions. These questions are critical for understanding how treatments are applied in clinical practice and their outcomes: Treatment Effectiveness: What is the effectiveness of a specific treatment or intervention in reducing symptoms, improving quality of life, or achieving clinical outcomes in a real-world setting? Adherence and Persistence: What are the rates of adherence and persistence with a prescribed treatment regimen over time? What factors are associated with higher or lower adherence rates? Comparative Effectiveness: How does the effectiveness of one treatment compare to another in a similar population? What are the relative benefits and risks associated with different treatment options? By examining historical data, researchers can gain insights into how different treatments perform outside the controlled environment of clinical trials, thereby informing clinical decision-making and guidelines. Outcome and Prognostic Questions Understanding patient outcomes and prognostic factors is central to retrospective analyses. These questions focus on the end results of healthcare practices and patient management, including survival, complications, and quality of life: Survival and Mortality: What are the survival rates and mortality rates associated with a particular disease, condition, or treatment? What factors are associated with increased or decreased survival rates? Complication Rates: What are the rates and types of complications associated with specific diseases, surgeries, or treatments? Are there identifiable risk factors for these complications? Prognostic Factors: What are the key prognostic factors (e.g., age, stage of disease, comorbidities) that influence the outcomes of patients with a particular condition? These questions help identify factors that influence patient outcomes, guiding clinicians in predicting disease progression and tailoring individual treatment plans. Risk Factor and Predictive Modeling Questions Retrospective analyses are often used to identify potential risk factors for diseases and develop predictive models. These questions aim to uncover associations between variables and outcomes to help predict future events: Risk Factors for Disease: What are the risk factors associated with developing a particular disease or condition? Are there demographic, genetic, behavioral, or environmental factors that significantly increase the risk? Prediction Models: Can we develop a predictive model to estimate the likelihood of disease progression, relapse, or adverse outcomes based on historical patient data? Multivariable Analysis: How do multiple factors interact to influence the risk of an outcome? Are there synergistic or antagonistic effects between different risk factors? These questions are critical for developing tools that help clinicians assess risk and make more informed decisions in preventive care and early intervention. Healthcare Utilization and Cost Questions Understanding how healthcare resources are utilized and the associated costs is important for optimizing healthcare delivery. Retrospective data can provide valuable insights into patterns of care and resource allocation for questions such as: Healthcare Resource Utilization: What are the patterns of healthcare utilization (e.g., hospitalizations, emergency room visits, outpatient visits) for patients with a specific condition? How does utilization vary by patient demographics, disease severity, or geographic location? Cost of Care: What are the direct and indirect costs associated with managing a specific disease or condition? How do different treatment options impact overall healthcare costs? Cost-Effectiveness: How does the cost-effectiveness of one treatment or intervention compare to another? What are the economic impacts of different clinical management strategies? These questions can inform healthcare policy, budget planning, and the development of strategies to improve cost-effectiveness and access to care. Quality of Care and Patient Safety Questions Retrospective analysis can be used to evaluate the quality and safety of care provided to patients, identifying areas for improvement and potential patient safety concerns, helping to answer questions such as: Quality Indicators: Quality indicators are standardized measures of health care quality and may focus on more specialized groups of care like preventative, inpatient or emergency care, pediatric or maternal health, etc. What are the levels of observed mortality or morbidity for a certain population in a specific setting? How utilized are certain procedures? (“AHRQ Quality Indicator Measures,” n.d.) Adverse Events and Safety: What is the incidence of adverse events, medication errors, or healthcare-associated infections in a particular patient population? What factors are associated with higher or lower rates of adverse events? Patient Satisfaction and Experience: What are the reported levels of patient satisfaction with healthcare services? How does satisfaction vary by demographic or clinical characteristics? These questions help in assessing healthcare quality, identifying gaps in care, and developing interventions to enhance patient safety and satisfaction. Temporal and Trend Analysis Questions Retrospective studies often involve analyzing temporal patterns to understand how diseases, treatments, or outcomes change over time. These questions help in recognizing trends and patterns that can inform future research and policy decisions: Temporal Trends in Disease Incidence and Prevalence: How have the incidence and prevalence of a specific disease changed over the past decade? Are there seasonal or cyclical patterns in disease occurrence? Trends in Treatment Practices: How have treatment practices and prescribing patterns evolved over time? Are there emerging trends in the use of certain medications or interventions? Trends in Outcomes and Survival: How have patient outcomes, such as survival rates or complication rates, changed over time with advances in treatment and healthcare delivery? These questions are essential for monitoring public health trends, evaluating the impact of interventions, and planning future healthcare strategies. Subgroup and Stratified Analysis Questions Subgroup analyses can help uncover differences in disease characteristics, treatment responses, and outcomes among different patient groups. This type of analysis is particularly valuable for personalized medicine and addressing questions related to health disparities: Differences by Demographic Group: How do treatment outcomes, risk factors, or disease characteristics differ between various demographic groups (e.g., age, gender, race/ethnicity)? Subgroup-Specific Effectiveness: Does a particular treatment work better in one subgroup of patients compared to another? What factors might explain these differences? Health Disparities: Are there disparities in healthcare access, treatment outcomes, or disease burden across different socioeconomic or minority groups? Questions focusing on subgroups are crucial for understanding variations in care and outcomes, identifying at-risk populations, and developing targeted interventions. Retrospective analysis of clinical data allows researchers to ask a wide range of questions that provide valuable insights into patient characteristics, disease epidemiology, treatment effectiveness, outcomes, risk factors, healthcare utilization, and more. By carefully formulating questions and analyzing historical data, researchers can uncover patterns, identify trends, and generate evidence that informs clinical practice, healthcare policy, and future research directions. This chapter outlines the various categories of questions that can be addressed through retrospective analysis, highlighting the potential of this approach to advance knowledge and improve patient care in diverse clinical settings. 4.4 Research Design Considerations Researchers need to intentionally use methods earlier in the research process than data analysis to manage data biases associated with clinical data, especially EHR. One of the most important challenges in using EHR data in cancer research is that, as in many other fields, healthcare data are plagued with several types of biases that result from disparities in the delivery of healthcare. Overall, cancer research has historically relied on data from high resource academic medical centers, which disproportionately provide care to patients who are White, have high socioeconomic status, and live in urban areas. As a result, medical knowledge produced from these data have disproportionately benefited those patients. Different sources of bias are prevalent in EHR data. For example, Information representativeness bias occurs when certain groups are disproportionately less present in the EHR because they have no contact with the healthcare system. Information presence bias, on the other hand, occurs when certain groups may be represented in the EHR, but have disproportionately less comprehensive healthcare data due to issues such as overall lower access to and use of healthcare service, lack of a primary care provider, lack of access to specialty care, and lack of access to digital resources (e.g., patient portals, home sensors, telehealth) that can be used to provide healthcare data. Treatment biases happen when certain groups receive disproportionate access to more advanced treatments, which is often determined by social drivers such as insurance, distance, health literacy, and socioeconomic status. Algorithm bias further amplifies these previous sources of bias by leveraging biased EHR data to make predictions about diagnosis, treatment and prognosis that are used by clinicians to make potentially biased healthcare decisions, which are then documented in the EHR. Recent advances in sophisticated and costly technology such as genetic testing, artificial intelligence, and digital health, which are disproportionately available in high resource healthcare systems further compound the problem. Therefore, cancer researchers increasingly need to use intentional methods to prevent, identify, and correct for biases in EHR data. For example, the National Institutes of Health Pragmatic Trials Collaboratory has made several recommendations to address EHR data biases in research (Andrew D. Boyd et al. 2023a; Andrew D. Boyd et al. 2023b): Include data from low resource healthcare settings such as community health centers that provide care for patients who have low socioeconomic status and live in rural areas. Engage with communities during study design and study conduct to ensure proper data collection, analysis, and representation. Use data collection methods for self-reported data that rely on more accessible technology such as text messaging, using accessible and culturally adapted communication. Include subgroup analysis by different demographic groups according to variables such as socioeconomic status, race, ethnicity, sex, geographical location, and social determinants of health. With such approaches, cancer researchers while aiming to avoid exacerbating health disparities, in addition help to reduce disparities. 4.5 Conclusion References "],["clinical-data-management.html", "Chapter 5 Clinical Data Management 5.1 Learning Objectives 5.2 Clinical data handling tools 5.3 Importance of keeping clinical data safe 5.4 Government regulators 5.5 Documentation 5.6 Conclusion", " Chapter 5 Clinical Data Management 5.1 Learning Objectives 5.2 Clinical data handling tools 5.3 Importance of keeping clinical data safe 5.4 Government regulators 5.5 Documentation 5.6 Conclusion "],["appendix-i-ontologies-vocabularies-taxonomies-and-standards.html", "Chapter 6 Appendix I: Ontologies, Vocabularies, Taxonomies, and Standards 6.1 SNOMED 6.2 ICD10 6.3 RxNorm 6.4 LOINC 6.5 Emerging standards such as FHIR 6.6 OMOP", " Chapter 6 Appendix I: Ontologies, Vocabularies, Taxonomies, and Standards 6.1 SNOMED 6.2 ICD10 6.3 RxNorm 6.4 LOINC 6.5 Emerging standards such as FHIR 6.6 OMOP "],["about-the-authors.html", "About the Authors", " About the Authors These credits are based on our course contributors table guidelines. Credits Names Pedagogy Lead Content Instructor(s) FirstName LastName Lecturer(s) (include chapter name/link in parentheses if only for specific chapters) - make new line if more than one chapter involved Delivered the course in some way - video or audio Content Author(s) (include chapter name/link in parentheses if only for specific chapters) - make new line if more than one chapter involved If any other authors besides lead instructor Content Contributor(s) (include section name/link in parentheses) - make new line if more than one section involved Jennifer Kelleher, Ph.D.1*; Abigail S. Robbertz, Ph.D. Content Editor(s)/Reviewer(s) Julia K. Herriott, B.S. Content Director(s) Helped guide the content direction Content Consultants (include chapter name/link in parentheses or word “General”) - make new line if more than one chapter involved Gave high level advice on content Acknowledgments Gave small assistance to content but not to the level of consulting Production Content Publisher(s) Helped with publishing platform Content Publishing Reviewer(s) Reviewed overall content and aesthetics on publishing platform Technical Course Publishing Engineer(s) Helped with the code for the technical aspects related to the specific course generation Template Publishing Engineers Candace Savonen, Carrie Wright Publishing Maintenance Engineer Candace Savonen Technical Publishing Stylists Carrie Wright, Candace Savonen Package Developers (Leanbuild) John Muschelli, Candace Savonen, Carrie Wright Art and Design Illustrator(s) Created graphics for the course Figure Artist(s) Created figures/plots for course Videographer(s) Filmed videos Videography Editor(s) Edited film Audiographer(s) Recorded audio Audiography Editor(s) Edited audio recordings Funding Funder(s) Institution/individual who funded course including grant number Funding Staff Staff members who help with funding ## ─ Session info ─────────────────────────────────────────────────────────────── ## setting value ## version R version 4.3.2 (2023-10-31) ## os Ubuntu 22.04.4 LTS ## system x86_64, linux-gnu ## ui X11 ## language (EN) ## collate en_US.UTF-8 ## ctype en_US.UTF-8 ## tz Etc/UTC ## date 2026-05-10 ## pandoc 3.1.1 @ /usr/local/bin/ (via rmarkdown) ## ## ─ Packages ─────────────────────────────────────────────────────────────────── ## package * version date (UTC) lib source ## bookdown 0.46 2025-12-05 [1] CRAN (R 4.3.2) ## bslib 0.6.1 2023-11-28 [1] RSPM (R 4.3.0) ## cachem 1.0.8 2023-05-01 [1] RSPM (R 4.3.0) ## cli 3.6.5 2025-04-23 [1] CRAN (R 4.3.2) ## devtools 2.4.5 2022-10-11 [1] RSPM (R 4.3.0) ## digest 0.6.34 2024-01-11 [1] RSPM (R 4.3.0) ## ellipsis 0.3.2 2021-04-29 [1] RSPM (R 4.3.0) ## evaluate 1.0.5 2025-08-27 [1] CRAN (R 4.3.2) ## fastmap 1.1.1 2023-02-24 [1] RSPM (R 4.3.0) ## fs 1.6.3 2023-07-20 [1] RSPM (R 4.3.0) ## glue 1.7.0 2024-01-09 [1] RSPM (R 4.3.0) ## htmltools 0.5.7 2023-11-03 [1] RSPM (R 4.3.0) ## htmlwidgets 1.6.4 2023-12-06 [1] RSPM (R 4.3.0) ## httpuv 1.6.14 2024-01-26 [1] RSPM (R 4.3.0) ## jquerylib 0.1.4 2021-04-26 [1] RSPM (R 4.3.0) ## jsonlite 2.0.0 2025-03-27 [1] CRAN (R 4.3.2) ## knitr 1.50 2025-03-16 [1] CRAN (R 4.3.2) ## later 1.3.2 2023-12-06 [1] RSPM (R 4.3.0) ## lifecycle 1.0.4 2023-11-07 [1] RSPM (R 4.3.0) ## magrittr 2.0.3 2022-03-30 [1] RSPM (R 4.3.0) ## memoise 2.0.1 2021-11-26 [1] RSPM (R 4.3.0) ## mime 0.12 2021-09-28 [1] RSPM (R 4.3.0) ## miniUI 0.1.1.1 2018-05-18 [1] RSPM (R 4.3.0) ## pkgbuild 1.4.3 2023-12-10 [1] RSPM (R 4.3.0) ## pkgload 1.4.1 2025-09-23 [1] CRAN (R 4.3.2) ## profvis 0.3.8 2023-05-02 [1] RSPM (R 4.3.0) ## promises 1.2.1 2023-08-10 [1] RSPM (R 4.3.0) ## purrr 1.0.2 2023-08-10 [1] RSPM (R 4.3.0) ## R6 2.6.1 2025-02-15 [1] CRAN (R 4.3.2) ## Rcpp 1.0.12 2024-01-09 [1] RSPM (R 4.3.0) ## remotes 2.4.2.1 2023-07-18 [1] RSPM (R 4.3.0) ## rlang 1.1.6 2025-04-11 [1] CRAN (R 4.3.2) ## rmarkdown 2.25 2023-09-18 [1] RSPM (R 4.3.0) ## sass 0.4.8 2023-12-06 [1] RSPM (R 4.3.0) ## sessioninfo 1.2.2 2021-12-06 [1] RSPM (R 4.3.0) ## shiny 1.8.0 2023-11-17 [1] RSPM (R 4.3.0) ## stringi 1.8.3 2023-12-11 [1] RSPM (R 4.3.0) ## stringr 1.5.1 2023-11-14 [1] RSPM (R 4.3.0) ## urlchecker 1.0.1 2021-11-30 [1] RSPM (R 4.3.0) ## usethis 2.2.3 2024-02-19 [1] RSPM (R 4.3.0) ## vctrs 0.6.5 2023-12-01 [1] RSPM (R 4.3.0) ## xfun 0.55 2025-12-16 [1] CRAN (R 4.3.2) ## xtable 1.8-4 2019-04-21 [1] RSPM (R 4.3.0) ## yaml 2.3.12 2025-12-10 [1] CRAN (R 4.3.2) ## ## [1] /usr/local/lib/R/site-library ## [2] /usr/local/lib/R/library ## ## ────────────────────────────────────────────────────────────────────────────── "],["references.html", "References", " References "],["404.html", "Page not found", " Page not found The page you requested cannot be found (perhaps it was moved or renamed). You may want to try searching to find the page's new location, or use the table of contents to find the page you are looking for. "]] +[["clinical-data-management.html", "Chapter 5 Clinical Data Management 5.1 Learning Objectives 5.2 Clinical data handling tools 5.3 Privacy considerations for clinical data 5.4 Government regulators 5.5 Documentation 5.6 Conclusion", " Chapter 5 Clinical Data Management 5.1 Learning Objectives 5.2 Clinical data handling tools Clinical research relies heavily on the collection, processing, analysis, and management of data. Efficient and effective data handling is crucial to ensure the integrity, reliability, and validity of clinical trials and studies. Selecting the right tools for handling clinical data is a critical step in the research process. This section defines data handling in the context of clinical research and contrasts it with data quality, discusses the importance of privacy, provides a comprehensive guide on how to find suitable clinical data handling tools with a focus on open-source options, and emphasizes the importance of testing data handling methods using dummy data in the preliminary phases of a clinical trial. 5.2.1 Clinical data handling Clinical data handling involves the processes and tools used to collect, manage, store, process, and share clinical data in a way that maintains its integrity, security, and usability. It encompasses a range of activities, including: Data Collection: Gathering data from various sources such as case report forms (CRFs), electronic health records (EHRs), patient surveys, and laboratory results. Data Storage and Management: Safely storing data in databases or data warehouses and managing access to ensure that only authorized personnel can interact with the data. Data Cleaning and Processing: Ensuring data consistency, accuracy, and completeness by detecting and rectifying errors, missing values, and inconsistencies. Data Analysis: Using statistical and analytical tools to generate insights from the data that can inform clinical decisions and study outcomes. Data Sharing and Reporting: Providing access to data for collaborators, regulators, or stakeholders in a secure and controlled manner and generating reports that summarize findings. The goal of effective data handling is to ensure that data is accurate, reliable, and available when needed, while also protecting patient privacy and complying with regulatory standards. 5.2.1.1 Data quality vs data handling Data quality and data handling are closely related but distinct concepts in clinical research. Data Quality: Refers to the accuracy, completeness, consistency, and reliability of data. High-quality data is essential for producing valid and reliable research outcomes. It involves processes such as data validation, error checking, and quality control measures. Data Handling: Encompasses the broader scope of managing the data lifecycle, from collection and storage to processing, analysis, and sharing. While data quality is a component of data handling, the latter also involves aspects like data security, access management, and regulatory compliance. Both data quality and data handling are critical for ensuring the integrity of clinical research. Data handling tools must support high data quality standards through features like automated data validation checks, error reporting, and data cleaning functions. 5.2.2 Selecting clinical data handling tools Choosing the right tools for clinical data handling depends on several factors, including the study’s size, complexity, data types, regulatory requirements, and budget. Key considerations include: Compatibility and Integration: The tool should be compatible with existing data systems and workflows, allowing for seamless integration of data from multiple sources. Scalability: The tool should be able to handle the volume of data expected in the study and scale as the study progresses. User-Friendliness: A user-friendly interface can reduce the learning curve for researchers and data managers, improving efficiency and reducing errors. Regulatory Compliance: The tool should comply with relevant data privacy and security regulations to protect patient data. Support and Documentation: Adequate support, including user manuals, tutorials, and customer service, is essential for troubleshooting and maximizing the tool’s potential. Research teams should conduct thorough evaluations, including reading reviews, seeking recommendations, and conducting pilot tests, to identify the best tool for their specific needs. 5.2.2.1 Open source options Open-source tools provide a cost-effective and flexible alternative to proprietary software for handling clinical data. These tools are often developed and maintained by vibrant communities and can be customized to fit specific research needs. Advantages of open-source tools include: They are typically free to use They provide transparency by allowing users to review the codebase for security and compliance They can be modified to meet unique requirements They often have strong community support, which can be valuable for troubleshooting and enhancing functionalities. Examples of popular open-source data handling tools include: REDCap: A secure, web-based application for building and managing online surveys and databases, widely used in clinical research for data collection and management. OpenClinica: An open-source clinical trial software that supports data capture, management, and analysis, compliant with regulatory standards like FDA requirements for electronic data (FDA 21 CFR Part 11). KNIME: A data analytics, reporting, and integration platform that can be used for data cleaning, processing, and analysis, with extensive capabilities for machine learning and data visualization. R and Python: These programming languages offer powerful libraries and packages (such as the tidyverse for R, and pandas and NumPy for Python) that support a wide range of data handling and analysis tasks. Each of these tools carries their own idiosyncratic pros and cons. For example, KNIME is a code-free analytical platform that may be ideal for students or new analysts to get comfortable with data processing and management. However, KNIME is not easily scalable, so it may not be ideal for large or multi-site projects. REDCap is a highly scalable and customizable survey and data collection platform that offers some basic statistical and data visualization tools, and offers APIs to allow the real-time analytics in other platforms (R, C#, cURL, etc.). However, REDCap licensing limits it to non-profit institutions (and other potentially limiting requirements), so this should be investigated before plans are made to use the environment. REDCap and R both allow for regulatory compliance. The FDA has issued guidance on using R for clinical trials. REDCap can be configured to support compliance with the FDA 21 CFR Part 11, HIPAA, and GDPR. While open-source tools are beneficial, it is essential to ensure they are secure, well-maintained, and compliant with relevant privacy and regulatory standards. When moving between multiple data handling tools, it is important to consider interoperability. As an example, REDCap and R play very nicely together via API tokens, but this may not be true of all electronic data capture systems or databases. The sharing, integration and redistribution of data between systems - whether internally or externally - needs to be carefully planned, tested and documented. 5.2.3 Testing data handling tools Before implementing data handling methods in an actual clinical trial, it is crucial to run tests using dummy data. This step ensures that the data handling process is robust, efficient, and free from errors across different conditions, without risking sensitive patient information. Creating Realistic Dummy Data: Dummy data should mimic the real data in terms of format, structure, and complexity. It should include various scenarios (e.g., missing data, outliers, data entry errors) to test the system’s error-handling capabilities. Simulating the Full Data Handling Workflow: The process should involve every stage of data handling, from data collection and entry to storage, cleaning, analysis, and reporting. This comprehensive simulation helps identify potential issues early, such as data loss, security vulnerabilities, or errors in data processing algorithms. Refining and Optimizing Data Handling Methods: Based on the findings from dummy data tests, researchers can refine their data handling protocols, adjust tools and settings, and optimize workflows to ensure smooth operations when real data is introduced. Testing with dummy data provides an additional layer of quality assurance and helps build confidence in the data handling process before the clinical trial begins. 5.2.4 Conclusion Effective clinical data handling is fundamental to the success of clinical trials and studies. Selecting the right tools requires careful consideration of privacy, regulatory compliance, open-source versus proprietary options, and the specific needs of the study. Understanding the difference between data quality and data handling is crucial, as both are essential for ensuring the validity and reliability of research outcomes. Running preliminary tests using dummy data is a critical step in validating data handling methods, ensuring that the chosen tools and processes are robust, secure, and efficient. By following these guidelines, researchers can enhance data management practices, protect patient privacy, and achieve meaningful and reliable clinical research outcomes. 5.3 Privacy considerations for clinical data Privacy is a fundamental consideration in clinical data management, given the sensitive nature of the information involved. Clinical data often contains personally identifiable information (PII) or personal health information (PHI), which must be protected to comply with privacy regulations such as the Health Insurance Portability and Accountability Act (HIPAA) in the United States, the General Data Protection Regulation (GDPR) in the European Union, and other regional laws. More information about PII and PHI can be found in this course about ethical data handling. Data Anonymization and De-identification: One of the primary methods to protect privacy is to anonymize or de-identify data, removing or encrypting any information that could directly or indirectly identify an individual. Privacy-Preserving Record Linkages: In scenarios where data from multiple sources need to be linked without compromising individual privacy, privacy-preserving record linkage techniques are essential. These methods enable the integration of datasets by matching records in a way that minimizes the risk of re-identification. Techniques such as secure multi-party computation, homomorphic encryption, and differential privacy can be employed to ensure that the linkage process itself does not expose sensitive information. Access Control and Encryption: Tools should support robust access controls, ensuring that only authorized users have access to the data. Encryption should be used for both data at rest and data in transit to prevent unauthorized access. Compliance and Auditing: Tools should facilitate compliance with regulatory standards and provide auditing capabilities to track data access and usage. When selecting data handling tools, it is crucial to prioritize those that offer comprehensive privacy features to safeguard sensitive information and maintain public trust in clinical research. 5.4 Government regulators Clinical data is governed by several different types of regulations. In this section, we will review some of the major regulatory frameworks and organizations. 5.4.1 Health Insurance Portability and Accountability Act (HIPAA) The Health Insurance Portability and Accountability Act (HIPAA), regulated by the U.S. Department of Health and Human Services (HHS), establishes national standards to protect individuals’ medical records and other personal health information. It applies to health plans, healthcare clearinghouses, and healthcare providers that conduct certain healthcare transactions electronically. The HIPAA Privacy Rule requires appropriate safeguards to protect the privacy of protected health information (PHI) and sets limits on the uses and disclosures of such information without patient authorization. 5.4.2 Food and Drug Administration (FDA) The U.S. Food and Drug Administration (FDA) regulates the safety, efficacy, and security of human and veterinary drugs, biological products, medical devices, food, cosmetics, and products that emit radiation. The FDA’s regulations ensure that clinical trials are conducted ethically and that data collected is reliable and accurate. This includes oversight of clinical trial protocols, informed consent, and reporting of adverse events. 5.4.3 General Data Protection Regulation (GDPR) The General Data Protection Regulation (GDPR), governed by the European Union (EU), is a comprehensive data protection law that governs the collection, processing, storage, and transfer of personal data within the EU. It aims to enhance individuals’ control over their personal data and simplify the regulatory environment for international business. GDPR applies to any organization that processes the personal data of EU residents, regardless of where the organization is based. Key provisions include the right to be forgotten, data portability, and mandatory breach notifications. 5.4.4 Honest brokers Honest brokers act as neutral intermediaries between the data source and researchers, typically regulated by Institutional Review Boards (IRBs) or equivalent bodies. They are responsible for de-identifying data to ensure that researchers cannot trace the data back to individual patients. Honest brokers must complete specific training, such as Collaborative Institutional Training Initiative (CITI) Research Ethics and HIPAA training, before accessing data. They play a crucial role in maintaining the confidentiality and integrity of clinical data. 5.5 Documentation In data management, several types of documentation are frequently encountered, each serving a specific purpose throughout the lifecycle of a research project. These documents are crucial for ensuring data integrity, regulatory compliance, and effective project management. 5.5.1 Data Management Plan A Data Management Plan (DMP) outlines how data will be handled during and after a research project. Typically created at the beginning of a project, it is stored in project documentation repositories or institutional databases. Often required by funding agencies, a DMP may include plans for testing with dummy data to ensure data integrity. The importance of a DMP lies in its role in planning and managing data throughout the project, ensuring that data is handled consistently and responsibly. 5.5.2 Statistical Analysis Plan The Statistical Analysis Plan (SAP) details the statistical methods and analyses to be performed on the collected data. Developed before data analysis begins, it is stored with project documentation or in electronic lab notebooks. Essential for clinical trials and other research requiring rigorous statistical analysis, the SAP may involve testing statistical methods on dummy data. The SAP is crucial for maintaining the integrity and reproducibility of statistical analyses. 5.5.3 Standard Operating Procedures Standard Operating Procedures (SOPs) provide detailed instructions on how to perform specific tasks or processes. Used throughout the project lifecycle, they are stored in organizational repositories or document management systems. SOPs are often required for regulatory compliance and may include procedures for testing with dummy data. The importance of SOPs lies in their ability to standardize processes, ensuring consistency and compliance with regulatory requirements. 5.5.4 Data Use Agreements Data Use Agreements (DUAs) define the terms and conditions for data sharing and use. Encountered before data is shared with external parties, they are stored in legal or administrative offices. DUAs are required when sharing data with external collaborators but are typically not directly related to dummy data. DUAs are important for protecting data privacy and ensuring that data is used appropriately. 5.5.5 Data Sharing Agreements Data Sharing Agreements (DSAs) specify the terms for sharing data between organizations. Encountered prior to data sharing, they are stored in legal or administrative offices. DSAs are necessary for formalizing data sharing arrangements and generally do not relate to dummy data. The importance of DSAs lies in their role in facilitating collaboration while protecting data integrity and compliance with legal requirements. 5.5.6 Documentation across the span of a project These documents are encountered at various stages of a project, from planning (DMP, SAP) to execution (SOP) and data sharing (DUA, DSA). They are typically stored in project documentation repositories, institutional databases, or document management systems, with access restricted to authorized personnel. Not all documents are required for every project; their necessity depends on the project’s scope, regulatory requirements, and institutional policies. Some documents, like the DMP, SAP, and SOP, may include provisions for testing with dummy data to ensure data integrity and validate processes. To ensure compliance with these documents, organizations should implement robust data governance frameworks that include regular audits, training programs, and clear policies and procedures. Standardized templates for these documents are often available from funding agencies, regulatory bodies, or institutional guidelines, helping to ensure consistency and compliance with best practices. It’s best to ask before starting any document to ensure the correct format is used. For further reading, consider the following resources: Guide to Clinical Data Management Procedures (GCDMP): GCDMP Books by Suzanne Prokscha: Writing and Managing SOPs for GCP and Practical Guide to Clinical Data Management Additionally, remember the insightful quote by Damian Conway: “Documentation is a love letter that you write to your future self.” This is an invaluable tidbit to keep in mind throughout the lifecycle of a study. 5.6 Conclusion "],["404.html", "Page not found", " Page not found The page you requested cannot be found (perhaps it was moved or renamed). You may want to try searching to find the page's new location, or use the table of contents to find the page you are looking for. "]] diff --git a/resources/dictionary.txt b/resources/dictionary.txt index 5d61f70..c96aa77 100644 --- a/resources/dictionary.txt +++ b/resources/dictionary.txt @@ -1,4 +1,7 @@ al +analytics +Anonymization +anonymize ASR biomarker biomarkers @@ -9,37 +12,58 @@ bookdown Bookdown CDS centric +CFR chatbots +CITI +codebase Coursera Collaboratory colorectal comorbidities Comorbidities CPT +CRF CRFs CUIs +cURL +customizable customizations DaSL data's de +DMP +DSA +DSAs +DUA +DUAs et EHR faq +FDA's FHIR GARDE +GCDMP +GCP +GDPR generalizability generalizable HAQ HD +HIPPA +homomorphic https ICD Immunohistochemical +individuals' +IRBs ITCR itcrtraining ITN JK Kelleher +KNIME Leanpub +lifecycle LLM LLMs LOINC @@ -53,6 +77,7 @@ NDC NIH's NLP OMOP +OpenClinica ontologies participants' perscribed @@ -60,23 +85,30 @@ Permanente personalization Ph PHM +PII polypharmacy pre +Prokscha PROMs QALY QALYs +REDCap representativeness +reproducibility Robbertz RMarkdown RWD RWE RxNorm +Scalability +scalable SAEs sexualized Shriver SNOMED socio SOGI +SOPs telehealth templated Tolerability5.5 Documentation
+In data management, several types of documentation are frequently encountered, each serving a specific purpose throughout the lifecycle of a research project. These documents are crucial for ensuring data integrity, regulatory compliance, and effective project management.
+++5.5.1 Data Management Plan
+A Data Management Plan (DMP) outlines how data will be handled during and after a research project. Typically created at the beginning of a project, it is stored in project documentation repositories or institutional databases. Often required by funding agencies, a DMP may include plans for testing with dummy data to ensure data integrity. The importance of a DMP lies in its role in planning and managing data throughout the project, ensuring that data is handled consistently and responsibly.
+++5.5.2 Statistical Analysis Plan
+The Statistical Analysis Plan (SAP) details the statistical methods and analyses to be performed on the collected data. Developed before data analysis begins, it is stored with project documentation or in electronic lab notebooks. Essential for clinical trials and other research requiring rigorous statistical analysis, the SAP may involve testing statistical methods on dummy data. The SAP is crucial for maintaining the integrity and reproducibility of statistical analyses.
+++5.5.3 Standard Operating Procedures
+Standard Operating Procedures (SOPs) provide detailed instructions on how to perform specific tasks or processes. Used throughout the project lifecycle, they are stored in organizational repositories or document management systems. SOPs are often required for regulatory compliance and may include procedures for testing with dummy data. The importance of SOPs lies in their ability to standardize processes, ensuring consistency and compliance with regulatory requirements.
+++5.5.4 Data Use Agreements
+Data Use Agreements (DUAs) define the terms and conditions for data sharing and use. Encountered before data is shared with external parties, they are stored in legal or administrative offices. DUAs are required when sharing data with external collaborators but are typically not directly related to dummy data. DUAs are important for protecting data privacy and ensuring that data is used appropriately.
+++5.5.5 Data Sharing Agreements
+Data Sharing Agreements (DSAs) specify the terms for sharing data between organizations. Encountered prior to data sharing, they are stored in legal or administrative offices. DSAs are necessary for formalizing data sharing arrangements and generally do not relate to dummy data. The importance of DSAs lies in their role in facilitating collaboration while protecting data integrity and compliance with legal requirements.
++5.5.6 Documentation across the span of a project
+These documents are encountered at various stages of a project, from planning (DMP, SAP) to execution (SOP) and data sharing (DUA, DSA). They are typically stored in project documentation repositories, institutional databases, or document management systems, with access restricted to authorized personnel. Not all documents are required for every project; their necessity depends on the project’s scope, regulatory requirements, and institutional policies. Some documents, like the DMP, SAP, and SOP, may include provisions for testing with dummy data to ensure data integrity and validate processes.
+To ensure compliance with these documents, organizations should implement robust data governance frameworks that include regular audits, training programs, and clear policies and procedures. Standardized templates for these documents are often available from funding agencies, regulatory bodies, or institutional guidelines, helping to ensure consistency and compliance with best practices. It’s best to ask before starting any document to ensure the correct format is used.
+For further reading, consider the following resources:
+-
+
Additionally, remember the insightful quote by Damian Conway: “Documentation is a love letter that you write to your future self.” This is an invaluable tidbit to keep in mind throughout the lifecycle of a study.
+
diff --git a/docs/clinical-data-management.html b/docs/clinical-data-management.html
index 881ebf4..1aedea1 100644
--- a/docs/clinical-data-management.html
+++ b/docs/clinical-data-management.html
@@ -4,18 +4,18 @@
- Chapter 5 Clinical Data Management | Clinical Data Analysis for Cancer Informatics
+ Chapter 5 Clinical Data Management | Appendix I
-
+
-
+
@@ -57,28 +57,6 @@
div.hanging-indent{margin-left: 1.5em; text-indent: -1.5em;}
-
@@ -158,11 +136,31 @@
