The National Academies Committee on Processes to Evaluate the Safety and Efficacy of Drugs for Rare Diseases or Conditions in the United States and the European Union sought qualitative information from biopharmaceutical and biotechnology companies to better understand:
A series of semi-structured qualitative interviews were conducted by National Academies staff to supplement information gathered from the published literature and public statements made by industry representatives and other stakeholders. All interviewees were asked the same set of starting questions (see methodology), which covered the following topics:
Coverage of these topics varied depending on time available and breadth of interviewee expertise. Information shared by interviewees was collected and summarized in this document by National Academies staff. Interviewee responses to questions were anonymized and statements were not attributed to specific interviewees or companies to protect the identification of individuals who agreed to participate and enable more open sharing of information. A more in-depth description of the methodology is located at the end of this document.
Aggregated, de-identified results of the semi-structured interviews may help inform deliberations of the committee on the study statement of task and may be included in the final published report of the committee.
Exemption from Institutional Review Board (IRB) approval for this work was obtained February 19, 2024, from the Committee to Review Human Subjects, acting as the National Academies of Sciences, Engineering, and Medicine’s IRB (#IRB00000281; expires February 17, 2026).
Companies represented: AMO Pharma; AbbVie; Affinia Therapuetics; Agios; Bayer; BioMarin Pharmaceuticals; Biogen; BridgeBio; Dyne Therapeutics; GlaxoSmithKline; Glycomine; Janssen Pharmaceutical Companies of Johnson & Johnson; Mahzi Therapeutics; Prilenia Therapeutics; Reata; Recordati; Roche; Sanofi; Stealth BioTherapeutics; Takeda; Ultragenyx Pharmaceutical Inc.
Roles: Clinical Development and Operations; Medical; Regulatory Policy; Patient Advocacy; Product Development; Research and Development
| Invitations Sent | Responses Received | Interviews Held | Interview Success Rate |
|---|---|---|---|
| 95 | 28 | 21 | 22.1% |
| Pharma | 9 |
| Biotech | 6 |
| Pre-revenue | 6 |
| Both | 17 |
| FDA Only | 4 |
| EMA Only | 0 |
| Neurology | 13 |
| Metabolic Disorders | 9 |
| Hematology | 4 |
| Nephrology | 3 |
| Oncology | 2 |
| Endocrinology | 2 |
| Cardiology | 1 |
| Pulmonology | 1 |
| Infectious Diseases | 1 |
| General Pediatrics | 1 |
FDA
EMA
Semi-structured interview questions were developed by the committee to better understand (1) how regulatory flexibilities have been applied by FDA and EMA towards drugs to treat rare diseases or conditions, (2) the use of “supplemental data” (e.g., open label extension studies, expanded access programs, natural history studies, and patient registries), and (3) the impact of collaboration between FDA and EMA on drug review/approval for rare diseases or conditions.
The use of pre-determined questions included flexibility for follow-up questions to allow for further clarification of interviewee experiences as needed. Information gathered on the interviewees (e.g., organization type, products approved, and circumstances surrounding product approval) also helped inform follow-up questions.
During the interview, National Academies staff asked interviewees the following questions:
These interview questions were included in a note-taking template to standardize response recording to and simplify the analysis.
Recruitment of interviewees was purposive, based on their expertise in leading clinical development and regulatory submission of rare disease drug products. The following criteria were used to identify and select interviewees:
After identifying the final list of interviewees, National Academies staff will contact selected individuals by email to inform them of the study and qualitative interview process and gauge interest in participation. The invitation email will include a subject line which clearly states that it is an interview invitation to provide input for the study. National Academies staff will attach an interview process overview and FAQ document to ensure all interviewees understand the purpose and process for participation. Interviewees will be made aware that their participation is voluntary and that they have the opportunity to retract responses up to when the committee holds its last meeting on May 23, 2024. They will also be made aware upfront that should they choose to retract their responses, all materials related to their interview will be deleted immediately.
National Academies staff assembled an initial list of 89 individuals who represent companies based in the United States and European Union and cover a range of rare disease therapeutic areas. These individuals were contacted by email to inform them of the study, the qualitative interview process, and gauge interest in participation. National Academies staff provided
documentation on the interview process and FAQs to ensure all interviewees understood the purpose and process for interview participation. An additional 6 individuals were identified from a snowballing process – individuals who received an invitation to participate in the interview process were asked for suggestions of other people who might be added to the list.
A total of 95 individuals received an email invitation to participate in the interview process. 28 of the individuals responded to the invitation and 21 individuals were interviewed by National Academies staff.
Once interviewees agreed to participate, 45-minute Zoom interviews were scheduled via a Calendly account with each interviewee. Prior to invitation emails being sent, all interviewees were assigned a unique identification (ID) number using the RAND function in Microsoft Excel. This enabled all internal references to individual interviewees to be anonymized after they agreed to participate.
Interviews were conducted via videoconference between February 23, 2024, and March 22, 2024, by at least two National Academies staff—one to facilitate the interview and one to capture notes in the note-taking template. When conducting each interview, National Academies staff followed an interview guide, which included an overview of the interview process and efforts taken to anonymize responses. National Academies staff obtained verbal consent to proceed with the interview and saved an audio recording for note-taking purposes if interviewees explicitly agreed to this request. If an interviewee did not agree to recording, staff would verify statements with the interviewee to ensure the notes taken during the interview were accurate. Prior to each interview, note-taking templates were labeled by interviewee unique IDs to help protect interviewee identification and anonymization of their responses.
Following each interview, National Academies staff reviewed notes taken during the interview and confirmed the content based on available audio recordings. After reviewing three randomly selected interview notes, National Academies staff developed a set of common themes and subthemes for each set of questions (see Interview Themes and Sub-Themes for list and description of themes). Once themes and subthemes were developed, National Academies staff reviewed and organized all interviewee responses into a filterable Excel file based on these themes and subthemes. To add context for each interviewee, the following additional information was included in the Excel file: type of company (clinical stage/pre-revenue/-
biotech/pharma), FDA experience, EMA experience, and therapeutic area. To aggregate responses, National Academies staff used the Excel file to filter responses to a particular theme and subtheme. All responses for a particular theme and subtheme were then aggregated.
All interviewees were assigned a unique identification (ID) number using the RAND function in Microsoft Excel. The key for anonymization of interviewees will be stored on the private drive of a National Academies study staff member whose laptop is password protected and requires a personal identification number and VPN application to access.
Interviews were conducted by two individuals and, as such, data could not be blinded. However, all interview materials (audio, transcript, notes, and rubric analysis) were tagged with a unique ID to anonymize responses. The following steps were used to help protect interviewee identification:
Interview audio recordings, transcripts and notes will be stored on a private folder on SharePoint, accessible only to the National Academies study team.
Zoom audio recordings will be stored on a local drive before being moved to SharePoint. All local drive recordings will be promptly deleted after being moved to SharePoint. Following the development of interview analysis (using an inductive approach), audio recordings will be deleted permanently.
After the release of the pre-publication version of the report in August 2024, all materials containing identifiable information (e.g., the anonymization key) and de-identified meeting transcripts will be deleted permanently. The original notes and analysis will be deleted after the final electronic version of the report, prepared by the National Academies Press, is submitted to the sponsor in October 2024.
Any identifying information on interviewees will be anonymized. Only aggregated, de-identified information will be made available to the full committee. Only a summary of key themes will be included in the study’s public access file.
Themes: The themes below were identified by using three randomly selected interview notes to identify common topics raised by interviewees in response to each question.
Subthemes: The subthemes below were identified by using the same process as above, but serve to further categorize responses within a theme. The subthemes were used to review and organize interviewee responses to each question.
Themes and subthemes identified based on interviewee responses to questions on regulatory flexibilities, authorities, and mechanisms:
| Theme | Subtheme |
|---|---|
| Sponsor Support by FDA and EMA | Speed |
| Type of Engagement (e.g., oral, in-person, written, etc.) | |
| Generic vs. Tailored Feedback | |
| Agency Structure | FDA: Consistency/Inconsistency Between Divisions |
| EMA: Committee Engagement, Decentralization, and National-Level Engagement | |
| Alignment/Misalignment Between FDA and EMA | Guidance |
| Submissions Requirements |
Themes and subthemes identified based on interviewee responses to questions on FDA and EMA use of regulatory flexibilities and acceptance alternative and confirmatory data
| Theme | Subtheme |
|---|---|
| Openness | FDA |
| EMA | |
| Rigidity | FDA |
| EMA | |
| FDA and EMA Variability | Use of Biomarkers/Surrogate Endpoints |
| Acceptance of Trial Design/ACD | |
| Guidance Documents | |
| Intra-FDA Variability | Center/Division Differences |
| Application of Lessons across Centers/Divisions | |
| Leadership Influence |
Themes and subthemes identified based on interviewee responses to questions on FDA and EMA collaboration
| Theme | Subtheme |
|---|---|
| General | Considerations of when to use PSA |
| Favorable | No subtheme here |
| Unfavorable | Misalignment Between FDA and EMA advice |
| Influence of one agency over the other | |
| Non-binding nature of advice | |
| Timing of PSA |
Themes and subthemes identified based on interviewee responses to questions on inclusion of pediatric populations in trials
| Theme | Subtheme |
|---|---|
| Practicality of policies | Timeline for inclusion (e.g., initiation in adults vs. children) |
| Data requirements | |
| Pediatric Plans (iPSP & PIP) | Timeline for plan development/submission |
| Difficulties with PIP/PSP approval | |
| Orphan exemption |
Themes and subthemes identified based on interviewee responses to questions on use of patient and caregiver input
| Theme | Subtheme |
|---|---|
| Program Specific Inclusion | FDA |
| EMA | |
| General Patient Engagement/Inclusion | PFDD |
| Listening Sessions |
Themes and subthemes identified based on interviewee responses to questions on changes to the rare disease regulatory processes
| Theme | Subtheme |
|---|---|
| Regulatory Authorities & Mechanisms | Sponsor Engagement |
| Internal Expertise | |
| Regulatory Flexibilities & Acceptance of ACD | Inclusion of Patient Voice/Input |
| Intra-FDA Consistency | |
| Use of data from other clinical dev. programs | |
| FDA-EMA Collaboration | Harmonized advice |
| Aligned acceptance of trial design, endpoints, and ACD | |
| Joint validation of/consensus on endpoints | |
| Collaboration Programs |
This page intentionally left blank.