NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Cover of Developing an Item Bank of Survey Questions to Measure Women's Experiences with Childbirth in Hospitals

Developing an Item Bank of Survey Questions to Measure Women's Experiences with Childbirth in Hospitals

Authors

, MD, MPH,1 , MD, PhD,2 , PhD,3 , MPH, CCRP,1 and , PhD4.

Affiliations

1 Department of Obstetrics and Gynecology, Cedars-Sinai Medical Center, Burns Allen Research Institute, Los Angeles, California
2 Childbirth Research Associates, LLC, North Hollywood, California
3 AMF Consulting
4 Division of General Internal Medicine and Department of Health Policy Management, University of California Los Angeles, Los Angeles
Copyright © 2019. Cedars-Sinai Medical Center. All Rights Reserved.

Structured Abstract

Background:

Patient-reported experiences and outcomes (PROs) are an important component of health care quality assessment. Current PRO item banks do not include childbirth, the number 1 reason for hospital admission in the United States.

Objective:

Develop a conceptual framework and preliminary item bank for childbirth-specific PRO domains, limited to the delivery and immediate postpartum period.

Methods:

Using PROMIS® methodology, we conducted a comprehensive literature review to identify self-reported survey items eliciting childbirth patient-reported values and preferences (V&P) measured in pregnancy and associated experiences and outcomes (PROs) measured immediately postpartum. The V&P/PRO domains largely overlapped and were validated and complemented by focus groups. In collaboration with our community partners, we used a modified Delphi approach to select domains and items that were included in the survey. We conducted an observational study using national survey response panels organized through The Nielsen Company to identify women's V&P in childbirth. Eligible participants were US pregnant women (English or Spanish speaking) ≥18 years old, and ≥20 weeks pregnant. We used bivariate analyses to test whether key predisposing conditions (eg, demographics, prior experiences, beliefs) were associated with V&P items using data weighted to reflect the US pregnant population. We also fitted a multivariable logistic regression model to each V&P item to describe “who” wanted each item. Women participated in a postpartum follow-up survey to collect information about their childbirth experiences and outcomes (PROs). In bivariate analyses, we tested whether predisposing conditions, V&P, PROs, and the “gaps” between V&P and PROs were predictors of women's satisfaction with hospital childbirth services, which was measured using an ordinal scale of 1 to 10. Multivariable logistic regression models confirmed the results. We used PROMIS guidelines to finalize the conceptual framework and preliminary item bank for childbirth-specific V&P/PROs and key predisposing conditions.

Results:

We identified 5902 PRO items that mapped to 19 domains and 58 subdomains within an empirical conceptual framework. Of 2757 respondents to the antepartum survey, 81.6% (N = 2250) anticipated a vaginal delivery in a hospital and are reported on in detail here. Maternal characteristics that were associated with each V&P item varied (eg, hospital services desired by nulliparas versus multiparas differed, with nulliparas more likely to want to avoid medical interventions and to receive information regarding baby care and feeding). Predisposing conditions, such as maternal confidence and ability to cope well with pain, appeared frequently as predictors in the models. Of 500 laboring women who answered the postpartum survey, key findings included the following: (1) The strongest predictors of women's satisfaction with hospital childbirth services were items in the domains of staff communication, compassion, empathy, and respect; and (2) 23 PROs, including being told about progress in labor and adequate pain relief in labor, appeared especially relevant to women experiencing childbirth. A final model predicting women's satisfaction with hospital childbirth services included a total of 8 items that could be optimized by doctors, midwives, and hospitals. Variables that were eligible for the model were selected in a hierarchical fashion, in the order of predisposing conditions, V&P, PRO, and gap items.

Conclusions:

We developed a conceptual framework and preliminary item bank for childbirth experiences and outcomes. The preliminary item bank consisted of 60 key predisposing conditions and 100 V&P/PRO items, forming the foundation for the Childbirth Experiences and Outcomes Survey and providing a tool for patient-reported data collection and benchmarking efforts.

Limitations and Subpopulation Considerations:

Detailed results were limited to the subpopulation of women who planned for vaginal birth in a hospital. Additional analyses will need to be conducted for women who planned for cesarean delivery or delivery at home or in a birth center. Further, the use of national online panels included the potential for recruitment bias.

Background

With nearly 4 million births annually in the United States,1 childbirth is the number 1 reason for hospital admission,2 and women rely on the medical system to provide them with safe and appropriate care. Childbirth clinical outcomes are a top public health challenge because rates of severe maternal morbidity (eg, renal failure, pulmonary embolism, blood transfusion)3 and mortality4 have been rising and racial/ethnic disparities have been widening in recent years.5-7 Safety concerns are real. One in 5 low-risk women experiences maternal or newborn morbidity during vaginal birth, and composite hospital morbidity rates exhibit wide variation (range, 3%-58%), in addition to cesarean morbidity.8,9

Numerous organizations are developing national strategies to make childbirth safer.10,11 However, because medical interventions in childbirth (eg, continuous fetal heart rate monitoring, increasing use of cesarean delivery) have been linked to decreasing childbirth satisfaction,12 these efforts may have contributed to a gap between what hospitals believe is needed for safety and what women believe is an optimal childbirth experience.13-20 The Institute of Medicine (now the National Academy of Medicine) defines patient-centered outcomes as distinct from clinical outcomes, and includes dimensions such as respect, communication, and physical comfort.21,22 Patient-centered outcomes have received less attention than safety issues but are a complementary component of health care quality measurement.23,24 Details regarding which patient-reported data are most meaningful require development.25,26

The National Institutes for Health funded PROMIS® in 2004 to develop standardized methods for measuring patient-reported outcomes (PROs), including the production of banks of standardized and validated survey items that correspond to various health domains.27-29 To date, PROs have largely been used for clinical research purposes and to guide clinical care,30 although PROs are now being integrated into the “performance measurement” of hospitals and physicians.31-33 PCORI,34,35 the PROMIS group,30 and the National Quality Forum (NQF)26 have published their perspectives regarding the uses of PROs in such endeavors.

PROs include not only measures of clinical outcomes from the patient perspective but also measures of the patient experience36,37 of the process of care. Our project was funded through an award from PCORI that required the use of PROMIS methodology (current award). Our project's principal goal was to develop a conceptual framework and preliminary item bank of PROs as a foundation for the development of childbirth hospital performance measures.

Given the resources available for this project, we anticipated that this approach would meet not only PCORI and PROMIS requirements but also the NQF guidelines for the development of performance measures38 and the Agency for Healthcare Research and Quality (AHRQ) guidelines for measures of the patient experience.39

The financial incentive of the federal Value-based Purchasing Program,40 which stipulates that Medicare reimbursement dollars be withheld from hospitals with poor satisfaction scores, creates a strong business case for childbirth hospitals to collect and utilize patient-reported data. As measured through the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey,41 the hospital satisfaction scores include the aggregate response from medical, surgical, and maternity care service lines. These scores provide feedback for hospitals to improve their services.

Because of the generic nature of the HCAHPS survey, hospitals do not know how to improve their scores in the maternity service line. This fact was emphasized at the expanded stakeholders meeting that was conducted for the current project. These circumstances argue for the development and implementation of a “maternity HCAHPS” so that hospitals can develop strategies to improve satisfaction with the childbirth experience and increase their revenue.42

Our specific objectives comprised the following:

  1. Develop a conceptual framework for—and document the breadth of—women's values and preferences for hospital childbirth services. What health care services do pregnant women want?
  2. Conduct a national antepartum survey to identify specific childbirth values and preferences of pregnant women in the United States.
  3. Conduct a follow-up postpartum survey to describe women's actual childbirth experiences and immediate outcomes (before hospital discharge) in relation to their values and preferences and satisfaction with hospital childbirth services.
  4. Use this information to finalize a conceptual framework and preliminary item bank to elicit women's values and preferences for hospital childbirth services and assess their experiences and outcomes.

The PROMIS Instrument Maturity Model describes the stages of instrument scientific development from conceptualization through evidence of psychometric properties in multiple diverse populations. The model assists developers in meeting the progressive scientific standard criteria from item pool or scale development to fully validated instruments ready for use in clinical research and practice.43 We were funded by PCORI to complete stage 1: developmental—conceptualization and preliminary item bank development. The subsequent stages, (2) developmental—calibration phase, (3) public release—calibrated and preliminary validation completed, (4) maturing—responsiveness and expansion, and (5) fully mature—user support, remain to be developed.

This report will primarily be useful to the research community seeking to advance the use of PROs in hospital performance monitoring. This report provides a firm foundation for continued development of the PROs into PRO-performance measures (PRO-PMs), patient-reported experiences, and patient-reported experience performance measures.36 Additionally, this report (both the conceptual framework and preliminary item bank) may also assist those in clinical settings (hospital administrators and maternity care providers) who aim to improve the childbirth experience.

Participation of Patients and Other Stakeholders

The Childbirth PRO Partnership, a group of community partners, health services researchers, maternity care providers, and advocates for pregnant women, convened before the research activities. The Partnership conceptualized the initial project and participated in the formulation and submission of the initial project proposal.

The study team recruited partners based on clinical or health policy expertise, access to diverse groups of patients, experience with health advocacy, and whether they were currently or recently pregnant. Including Nielsen panel members, 15 community partners were engaged in the project. At the end of the project, this group expanded to include external stakeholders who provided guidance on disseminating and implementing the results. The study team invited hospital quality experts; senior administrators such as patient care managers, nurse managers, department chairmen, state regional directors, and representatives from health insurers; and other health service researchers to participate in the summary meetings. We emailed invitations that included letters introducing and explaining the project. See Table 1 for a list of the Childbirth PRO Partnership members.

Each partner completed a memorandum of understanding that established clear and formalized goals, work processes, roles, responsibilities, and decision-making processes. Each agreed to participate at least once a month and to provide guidance on all research activities. We held weekly meetings to advance the work and monthly meetings to vote on final decisions and project direction. We used a modified Delphi method44 to ensure team representation in decision-making throughout the research process. Half of our community partners directly recruited women to (1) participate in focus groups, (2) pilot the survey, (3) assist with face and construct validity, and (4) resolve survey or focus group translation subtleties.

In addition to recruiting, the community partners hosted focus group sessions at their facilities or online via videoconference and served as cofacilitators for all sessions. Participant familiarity with the location and personnel established a comfortable environment for the participants to speak candidly about their experiences. Working collaboratively with the community partners and their constituents afforded us the opportunity to hear directly from pregnant and recently pregnant women regarding their values and preferences in childbirth.

All investigators participated in a standing weekly meeting for the project's duration. Community partners attended these meetings (in person or by phone or videoconference) to contribute to study planning and implementation, and to monitor study conduct and progress. In addition, a standing monthly Partnership meeting convened on the third Thursday of the month to update all community partners of activities to date, ensure feedback, and make plans for focus group recruitment. We posted meeting minutes in a Box account. We compensated community partners for their expertise and participation in direct proportion to their involvement, if they desired it.

The community partners helped develop the study proposal and formulate the relevant study questions. They also provided input into the study design and initial pilot data submitted with the application. Although they did not directly affect the study's rigor or quality, they did ensure the transparency of the research process. In the spirit of a true 2-way learning environment, we held several mini-lectures on statistical techniques to help ensure that the partners understood in layman's terms what factor analysis is, what logistic regression is, and how these techniques help reduce data and provide prediction estimates.

Importantly, when evaluating items that measure the same domain or subdomains, the Partners participated in “binning” and “winnowing” (ie, providing input regarding how to map the items to the conceptual framework domains and determining which items to keep or discard—especially when trying to nuance subtleties between different communities). For example, focus groups identified newborn feeding as an important PRO domain. Our literature review confirmed this and specified 2 subdomains: (1) receiving breastfeeding information, and receiving practical support about what and how to feed the newborn. Input from the community partners helped the research team appreciate that some women did not want breastfeeding information and were offended or made to feel guilty if they decided not to breastfeed. Importantly, many of these women could benefit from receiving practical support about feeding the newborn. The researchers learned about the public perceptions and preferences for terms related to newborn feeding that distinguish “breastfeeding,” “bottle-feeding breast milk,” and “bottle-feeding formula.” The team used to finalize the final survey items for this topic.

Our community partners have continued to participate in quarterly conference calls. Hospital partners have agreed to participate as clinical sites to develop hospital performance measures for childbirth PROs if we obtain subsequent funding for dissemination and implementation. We invited additional multidisciplinary stakeholders to participate in separate “expanded” partnership meetings to discuss dissemination and implementation opportunities (see Table 1).

Methods

This study complied with Cedars-Sinai Medical Center IRB stipulations under protocol #Pro00037750. The team used PROMIS methodology for the development of PRO item banks as the basis for the research approach.43,45 The first steps of PROMIS methodology are foundational to PRO development and include (1) a comprehensive literature search for potential PRO items, (2) use of this literature to empirically develop PRO domains and a conceptual framework that details the hypothesized relationships between women's values and preferences and satisfaction with hospital childbirth services, (3) the binning and winnowing of the items retrieved, and (4) iteratively eliciting feedback from the target population throughout the process. This basic process is intended to develop the conceptual framework and domains of the PROs, which can then serve as a foundation for further development through the PROMIS PRO pathway, the NQF PRO-PM pathway, or the AHRQ methodology for developing measures of the patient experience.

The Childbirth PRO Partnership (described in the preceding section) is a group of community partners that include health services providers, health and policy advocates for pregnant women, and currently or recently pregnant women; the Partnership participated in all research activities. Throughout this report, we have addressed the relevant methodology standards as required by PCORI (Appendix A).

Broad Overview of Methods

As noted above, this study has 4 objectives: (1) Develop a conceptual framework for PROs and map relevant PRO items to the framework domains; (2) conduct a national antepartum survey to test the prevalence, distribution, and statistical significance of PRO items in the framework domains; (3) conduct a follow-up postpartum survey to (a) describe women's experiences and outcomes of childbirth (PROs), and (b) determine the statistical significance of these various predictors in women's satisfaction with their hospital childbirth services; and (4) using the study data, finalize the conceptual model and preliminary item bank.

  1. Study design and rationale: We conducted a national cross-sectional online survey of pregnant women to document values and preferences (V&P) for hospital childbirth services and followed up with recently postpartum women to document their PROs and determine gaps between V&P and actual experiences and outcomes. Investigators wanted participants to be as representative of the US population as possible.
  2. Formation of survey study cohort: Nielsen recruited pregnant women using its national online panels. Inclusion criteria for the antepartum survey was US pregnant women ≥18 years old, ≥20 weeks' gestation, and English or Spanish speaking.
  3. Study setting: We used an online survey, with a convenience sample of online panels.
  4. Intervention: This was a longitudinal, observational study (Time 1-Time 2). The antepartum survey conducted during pregnancy identified women's anticipated V&P for childbirth-related hospital services. Supplemental funding allowed us to modify the original project to include a postpartum follow-up survey to determine these women's actual childbirth experiences and outcomes (PROs) in relation to these V&P.
  5. Follow-up: Through serial email alerts and a 1-time phone call to nonresponders, we requested that women respond to the postpartum follow-up survey up to 12 weeks postpartum.
  6. Study outcomes: We created (1) a conceptual framework that describes the breadth of childbirth services domains important to pregnant women; and (2) a preliminary item bank of predisposing conditions (eg, demographics, prior experiences, clinical risk factors, beliefs), V&P, and experiences and outcomes (PROs) that contributed to the development of the Childbirth Experiences and Outcomes Survey.
  7. Data collection and sources: See 1, 2, and 5.
  8. Analytical and statistical approaches: See the detailed discussion under the methods for each objective. For the antepartum survey data analyses, we used multivariable logistic regression models to determine the statistical significance of predisposing conditions (eg, demographics, prior experiences, beliefs) to each V&P item. We hypothesized that V&P items were associated with various “communities” of women (defined by parity, race/ethnicity, insurance status, and so on). For the postpartum survey data analyses, we used logistic regression models to determine the statistical significance of the association of the PRO items with women's satisfaction with hospital childbirth services. We hypothesized that women's satisfaction with hospital childbirth services was associated with predisposing conditions, V&P, PROs (both experiences and outcomes), and gaps between V&P items and PROs.
  9. Conduct of the study: The original protocol was for a cross-sectional survey administered during the antepartum period only. We modified the protocol after receipt of supplemental funding to include a postpartum survey.

Objective 1: Develop a Conceptual Framework for PROs and Map Relevant PRO Items to the Framework Domains

Conceptual Framework for Elaborating PROMIS Domains

Because a childbirth-specific PRO item bank did not exist, we advanced a conceptual framework that we built on empirically using the PROMIS® guidelines.43,45 Our conceptual framework for this study appears in Figure 1. The framework follows Andersen's Behavioral Model of Health Services Use46 with the addition of multiple theoretical guidelines regarding health expectations and service preferences, health information seeking, satisfaction, and patient-centered and childbirth outcomes.13,47-54

As depicted in Figure 1, we posited that predisposing conditions (ie, women's personal characteristics, prior childbirth experience, clinical risk) generate V&P for the services desired. Upon giving birth, women assess whether these V&P were fulfilled. Last, women provide summary measures of their satisfaction with their birth and hospital services.

We hypothesized satisfaction to be dependent on (1) predisposing conditions, (2) V&P, and (3) PROs. V&P capture the concept of “value expectations” (ie, patients' desires, hopes, or wishes concerning clinical events).55,56 For brevity, we refer to all value expectations as V&P.

This framework implies that, although quality improvement efforts focus on PROs, V&P may be equally or more important in predicting overall patient experiences and outcomes for childbirth. Therefore, for childbirth, the QI program analysis plan must consider V&P. The simplest example is mode of delivery. If a pregnant woman desired a vaginal birth (V&P item), postpartum follow-up would indicate whether she had a vaginal or cesarean birth (PRO item). Satisfaction may depend on the V&P item or the PRO item, or a combination of both. For the example, satisfaction may depend most strongly on wanting a vaginal birth, getting a vaginal birth, wanting and getting a vaginal birth, or wanting and not getting a vaginal birth. All these possibilities must be tested in the analysis plan.

Identification of Specific Items That May Be Relevant to Either (1) V&P, (2) PROs, or (3) Predisposing Conditions That May Affect the PROs

Working with a medical librarian, we performed a comprehensive literature search for English-language V&P and PROs associated with childbirth and the immediate postpartum period. Relying on Figure 1, we set up standardized search strategies of the English-language publications in PubMed from January 1975 through December 2014 (Appendix A).35,57-60 Because our goal was to capture items that reflect the breadth of childbirth experiences and outcomes important to US women, and not to evaluate the efficacy of any intervention, we did not assess individual studies for quality or synthesize study results.

Study Selection

The title and abstract (TIAB) of the first 1700 articles were read by 2 investigators who finalized the inclusion and exclusion criteria. Criteria explicitly required for the inclusion of studies were (1) questionnaires that included patient-reported items, (2) publication in English, a focus on women's assessment of the childbirth experience or on the consequences of childbirth occurring during the hospital experience, and (4) relevance to US health care. Criteria for the specific exclusion of studies were (1) editorials, letters, news, or opinion pieces; (2) a primary focus not related to patient assessment of her experience (ie, no trials regarding drugs or specific clinical interventions); (3) a discussion of questionnaires in languages other than English or Spanish; (4) case studies of individuals, natural disasters, or epidemics; (5) investigations of factors that affect conception or a desire for pregnancy; and (6) a lack of results or questionnaire items (eg, no qualitative studies). In addition, relying on our conceptual model, we abstracted items related to patient-specific conditions, such as personal characteristics, pregnancy/delivery history, clinical risk factors, and prior experiences with childbirth services, for potential inclusion in the conceptual framework. The librarian reran the search using the expanded criteria.

Two investigators reviewed all TIAB from all retrieved studies, retaining articles that met relevance criteria. The investigators retrieved and reviewed the full text of all potentially relevant studies. We retained all articles found to be relevant by at least 1 reviewer for inclusion in a study database.

Domain Development for the Conceptual Framework

Starting with the articles found in the literature search, we developed a list of PRO domains or “bins” relevant to childbirth.46 From these articles, we abstracted potentially relevant survey items, mapping each item to its appropriate bin. At the framework level, these domains generally housed both V&P and PRO items. For example, if an item asked a pregnant woman her preference for route of delivery, we mapped this item to the delivery route domain. If an item asked a postpartum woman the route of her delivery, we also mapped this item to the delivery route domain. Some domains, such as pain assessment or satisfaction, housed only postpartum items because we could ask these items only after the delivery.

We modified bins and added new bins for items that did not easily fit into an existing bin. We also created sub-bins within each domain. This resulted in a series of bins and sub-bins for categorizing the retrieved items and a list of individual items within each bin. These bins became synonymous with “domains” of the conceptual framework.

At the end of this binning process, we had created domains of the conceptual framework. Most domains included both V&P and PRO items. The PRO items also included patient-reported experiences and outcomes.

“Winnowing” is the elimination of items that do not have face validity or are redundant.46 Our goal in winnowing was to identify a limited set of items representative of the domains identified in the literature and ranked as important using a modified Delphi method by the Childbirth PRO Partnership. We divided the bins among 4 teams, each consisting of at least 1 investigator and up to 3 community partners. All the community partners and investigators had an opportunity to weigh in on the domains and items.

The process generated a final set of potential survey item bank members. We also identified survey items that reflected predisposing conditions so that the data collected could describe “who wants what,” with “what” representing the V&P/PRO items and “who” representing women's predisposing conditions (eg, personal characteristics, beliefs, clinical risks) that might vary in association with these PROs.

We organized focus groups to understand women's experiences in depth and to identify additional important outcome domains (Table 2). Focus group participants were at least 18 years old, pregnant or recently pregnant (less than 1 year postpartum) and living in the United States. Eligible participants recruited by our community partners served as diverse sociodemographic and socioeconomic populations. We deliberately selected participants representative of specific childbirth communities (ie, Hispanic, Spanish speaking, African American, Asian, low income, or college educated).

We organized and facilitated our focus groups in collaboration with The Childbirth PRO Partnership, conducting sessions in English and Spanish. We prospectively determined our focus group sample size using qualitative saturation methods.61 A community partner (or designee) cofacilitated all focus groups in a community partner facility, utilizing a standardized script and guide. The script ensured that all participants received the same disclosure information and rules of conduct. The guide specified the objectives and research questions, provided a general timeline, and outlined probes, to maximize group participation.

The focus groups were conducted in person between June and November 2015 and lasted approximately 60 minutes. Each participant received a $50 Target gift card for attending the session. With the participants' permission, we recorded, transcribed, and entered the sessions into Atlas.Ti, a computer-assisted qualitative data analysis and research software (Version 7.1.1).

We used a grounded theory approach, whereby several investigators and members of The Childbirth PRO Partnership debriefed after each focus group session and collaboratively identified emerging themes.62 Two independent reviewers mapped participant responses to the domains identified in the literature search (code-by-list) and used the Atlas.Ti code manager to identify the most referenced domains. We categorized major and minor themes under the bins previously described, created additional bins as needed, and modified the conceptual framework and domain definitions with respect to the themes that surfaced in the qualitative data analysis.

Objective 2: Conduct a National Antepartum Survey to Test the Prevalence, Distribution, and Statistical Significance of PRO Items in the Framework Domains

Survey Development

We developed a survey using a subset of the predisposing conditions and V&P identified in objective 1. Before national administration, we piloted the instrument among 30 English-speaking women,63 assessing content and construct validity, interpretability, and respondent and administrative burden for use in online administration (Table 2). We administered the pilot survey either in person using individual laptops or online via videoconferencing with participants responding on their own computers. Community partners cofacilitated all sessions. We edited or removed survey questions per participant feedback.

Using similar methods, we created a Spanish version using a professional translation service and piloted it among women who identified Spanish as their primary language.

Survey completion time was <30 minutes. Responses for items in the predisposing condition domains were formatted as categorical or dichotomous variables. We used a Likert scale for the items in the V&P domains (eg, “not at all important” to “extremely important”; “strongly disagree” to “strongly agree”).

We conducted a national survey of pregnant women ≥18 years old who had completed at least 20 weeks of gestation. Nielsen recruited women through its online panels (Critical Mix, Survey Sampling, Market Cube, Peanut Labs, and Prodege), and it developed quotas based on anticipated demographic characteristics.64

Survey Administration

Nielsen sent potential participants from these panels an email invitation that contained a unique URL, and then screened respondents to determine their eligibility. Eligible respondents proceeded with the survey and received weekly reminders if they did not respond. Nielsen administered the survey from secure servers using digital fingerprint technology to prevent duplicate entries. Nielsen designated all eligible participants who completed a subset of mandatory items as having “completed” the survey. Nielsen applied specific protocols to ensure survey completeness and the distribution of incentive payments (approximately $15 cash equivalent in Nielsen points). Nielsen monitored survey completeness on a weekly basis and left the survey open until the goal of at least 2700 completed surveys was reached. Incomplete surveys were not analyzed (Figure 2).

We weighted the national survey data to replicate the distribution of demographic variables from the 2011-2013 National Survey of Family Growth65 and the 2014 Current Population Survey,66 to improve generalizability to the US population (Appendix B). Data were also weighted by Nielsen's proprietary propensity score to mitigate potential selection bias owing to online recruitment methods.

Women who planned to have a cesarean delivery or planned to deliver at home or in a birth center are not described here in detail because of small sample sizes that did not allow for factor analysis or modeling. We used subpopulation analysis methods for weighted data to compute statistics for the women anticipating or considering vaginal delivery in a hospital—the most prevalent delivery expectation for American women. Subpopulation analysis methods were needed because we derived the data weights for the full sample, not for sample subsets. We performed statistical analysis of the survey data using SAS, Version 9.3. All analytical tests were 2 sided. Means are reported with SDs.

Exploratory Factor Analysis

We performed an exploratory factor analysis to achieve data reduction, to confirm the domains of predisposing conditions and V&P, and to establish construct validity. Exploratory factor analysis is a statistical technique that is used to reduce data to a smaller set of summary variables and to explore the underlying relationships between measured variables. We used the national antepartum sample from Round 1 (see Figure 2) to conduct this analysis. However, the factors extracted were applied in all subsequent analyses of antepartum and postpartum data. We performed a factor analysis for the V&P items using both a segmented analysis (to validate the anticipated domains) and an overall analysis (to allow for potential shifting of closely related items from one domain to another).

We used standard criteria to determine both the number of factors and which items loaded to a factor.67 We applied distinct oblique rotations and selected the rotation that provided better factorization in terms of separation of loadings for continued evaluation. We also tested Cronbach α correlation as a measure of internal validity for each factor.36 The team selected the final set of factors based on empirical fit and confirmed face validity with the Childbirth PRO Partners, retaining factor-based scores (total score for items included divided by the number of items in the factor) for subsequent analyses and items that did not load on any factors.

Descriptive Analysis

We examined the continuous distribution of each V&P item and factor. To simplify the analysis and interpretation of results, the investigators determined whether the ordinal or interval scale responses could be categorized as either 2-level or 3-level variables. We used 2-level variables when the V&P exhibited a monotonic preference or trend, and 3-level variables for V&P that had a U-shape or mound-shape distribution that prevented binary collapsing. In general, and if possible for the 2 principal ordinal response scales, scores 1 to 3 were collapsed versus scores 4 to 5.

For example, the PRO item “It is important that providers respect my spiritual/religious/cultural beliefs” had the following distribution: 1 = “not at all important” (9.3%); 2 = “slightly important” (9.1%); 3 = “moderately important” (18.3%); 4 = “very important” (26.6%); 5 = “extremely important” (36.2%). Consequently, scores 1 to 3 were collapsed versus scores 4 to 5 (very to extremely important), creating a 2-level variable. Rating of the “encouragement for breastfeeding from providers” had the following distribution: “far too little” (6.8%), “too little” (9.1%), “about right” (67.0%), “too much” (10.9%), and “far too much” (6.3%). Consequently, the categories “far too little” and “too little” were collapsed. “Too much” and “far too much” were also collapsed, and “about right” remained its own category, hence creating a 3-level variable. For each predisposing condition, we measured the frequency of each V&P item.

Modeling

After completing the bivariate analyses, we developed a multivariable logistic regression model for each V&P item to identify the independent predisposing conditions that were associated with that item. For 3-level items, we used generalized logistic models. The dependent variable was the V&P item and the independent variables used in each model were maternal age, race/ethnicity, education level, US region, parity (nulliparity/multiparity with no prior cesarean/prior cesarean), any medical/pregnancy-related complications, gestational age at the time of the survey, and multiple gestation. Other potential predictors of the V&P item were also assessed. To limit the number of additional predisposing conditions assessed in each model, we entered only those conditions associated with the V&P item resulting in a P < .05 in bivariate analysis.

For each model, we report the proportion of respondents who indicated a preference for the V&P item, the C statistic and the max-rescaled generalized R2. These are both measures of the model's predictive power. The C statistic is a measure between 0.5 and 1 of the classification accuracy of the model predictions of the outcome based on the model's covariates (also calculated as the area under the receiver operating characteristic curve).68 The generalized R2 for nonlinear models is similar to the coefficient of determination (known as R2) for linear models but based on the ratio of the likelihood function value under the null hypothesis that all covariate coefficients are equal to 0 (null model) relative to the unrestricted maximum value using the model covariates (full model). Because the upper bound of this statistic is not 1, it is rescaled by dividing the original value by its upper bound.69,70

Objective 3: Conduct a Follow-up Postpartum Survey to (1) Describe Women's Experiences and Outcomes of Childbirth (PROs) and (2) Determine the Statistical Significance of These Various Predictors in Women's Satisfaction With Their Hospital Childbirth Services

Postpartum Survey Development

We received supplemental funding to conduct a follow-up postpartum survey. In collaboration with the Childbirth PRO Partnership, we revised the items in the antepartum national survey to make it appropriate for postpartum administration. For most items, this primarily involved changing the tense of the verb associated with the item. All PRO items retained the same response scales used for the V&P items so that, when possible, they could be compared. The postpartum survey updated women's pregnancy complications after the completion of the antepartum survey and before delivery and added items for the following domains that could not be assessed antepartum: maternal/newborn clinical outcomes, pain assessment, communication with physicians/midwives and nurses, following of the birth plan, and measures of satisfaction.

Satisfaction measures included several items from the HCAHPS.41 We selected a specific item, rating the hospital on a scale of 0 to 10, as the outcome measure for objective 3. We chose this measure because it is currently used by the federal Value-based Purchasing Program, and therefore impacts hospital reimbursement,71 and is also a target for hospital-based quality improvement efforts. We piloted the postpartum survey among 10 women, using methods similar to those described for the antepartum survey. Survey completion time was <30 minutes.

Postpartum Survey Administration and Data Collection

Nielsen conducted the postpartum survey in both English and Spanish as a follow-up to the antepartum survey, using methods similar to those previously described. Nielsen contacted women who completed the antepartum survey approximately 3 weeks after their due date. Nonresponders received weekly reminders on a rolling basis until they completed the survey or until the field period ended.

The postpartum response rate estimate was 30%, a number based on similar surveys done by Nielsen for postpartum women.72 We used this baseline to perform a sensitivity analysis and determined that given n = 2757 women who had taken the antepartum survey, and anticipating 825 (30%) postpartum responses, with the exclusion of 214 (26%) nonlaboring patients, (3%) home and freestanding birth center births, and 59 (10% of remaining 586) for missing data, yielding N = 527. In a linear equation that uses the outcome of a summary measure for hospital rating (0-10), a sample of N = 527 women achieves 80% power to detect an R2 of 0.01 attributed to 1 independent variable with a significance level (α) of .05 and adjusted for an additional 25 independent variables with an R2 of 0.30. However, the response rate varied between 15% to 20% per week. Approximately 2 months after starting the postpartum survey in the field, Nielsen employed efforts to increase participation. It upgraded the incentive from $10 to $15 in reward points redeemable for gift cards or merchandise; improved the survey-taking experience on mobile devices; revised invitation and reminder language; sent alert emails 5 weeks before the survey's due date; and, where possible, made phone calls to nonresponders.

To collect the contracted number of postpartum responses, Nielsen initiated a second round of antepartum and postpartum surveys, using the same online panels except for Peanut Labs. It used the same methodology as in the first round but maintained incentives at $15 for completion of both the antepartum and postpartum surveys (see Figure 2).

Data Analysis

Nielsen provided a deidentified data set that linked the antepartum and postpartum survey responses, tabulating predisposing characteristics, V&P, PROs, and satisfaction data per respondent. The investigative team derived “gap data” to reflect differences between the V&P and PRO data items as follows. We dichotomized V&P items, with few exceptions, reflecting whether a respondent did or did not want an item. For example, the V&P item regarding whether the woman wanted the baby placed skin to skin immediately following delivery was originally a 5-point ordinal score that was dichotomized into “very” or “extremely” important versus the other responses. We also dichotomized most PRO items, reflecting whether a respondent did or did not get a service item or outcome. For example, in the postpartum survey we asked whether a woman “got” the service, in this case, the baby was placed skin to skin upon delivery. We defined “gap data” in 4 categories: (1) respondent did not want the item and did not get it; (2) respondent did not want the item but got it; (3) respondent wanted the item and got it; and (4) respondent wanted the item but did not get it.

Objective 3 focused on participants who answered both the antepartum and postpartum survey. We further restricted this group to those women who noted on the antepartum survey that they anticipated having a vaginal delivery in a hospital and on the postpartum survey stated that they labored and delivered in a hospital (either by cesarean or vaginal birth). We chose this group of women as the denominator to maximize data interpretability because the antepartum survey had different items for women who anticipated an elective (scheduled) cesarean delivery and those who anticipated a vaginal delivery. Specifically, items related to V&P about labor (most items) were not relevant for those who planned a cesarean.

We tested data from respondents who met these criteria for bivariate association with hospital satisfaction, an HCAHPS item that asks respondents to rate their hospital on a scale of 0 to 10. We operationalized this measure of satisfaction by dichotomizing it at a score of 9 to 10 (satisfied) versus 0 to 8 (unsatisfied). We chose this outcome because our principal goal for this study was the development of a foundation for childbirth hospital performance measurement. Furthermore, hospitals are familiar with this item, dividing it as above, using it to track hospital satisfaction, and relying on the premise that any score lower than 9 is meaningful.71

We did not weight analyses for postpartum data because weights were not developed for the postpartum sample. Means are reported ± the standard deviation. We adjusted odds ratios (ORs) for maternal age, race/ethnicity, education level, parity/prior cesarean birth, US region, pregnancy complications before admission (by either antepartum or postpartum survey), overall health (antepartum survey), and overall mental/emotional health (antepartum survey) and included 95% CIs.

Models

To investigate the relationship between predisposing conditions, V&P, PROs, and gap data with women's satisfaction with hospital childbirth services, we used information from the bivariate frequency tables to build the final multivariate models. In these models, women's satisfaction with hospital childbirth services was the dependent variable, and independent variables were chosen from the items for predisposing conditions, V&P, PROs, and gaps. We built all models using backward, stepwise, and forward multiple logistic regression techniques. We considered any differences in covariates selected to each particular model and made final model decisions based on face validity as evaluated by the team and by improvement in the C statistic. We chose 9 variables—(1) maternal age, (2) race/ethnicity, (3) education level, (4) multiple gestation, (5) delivery category (combination of multiparity and prior cesarean delivery), (6) US region, (7) complicated pregnancy (based on a positive response to either the antepartum or postpartum items regarding clinical risk), (8) antepartum overall health, and (9) antepartum mental/emotional health—to be forced into all models and excluded all variables missing 20 or more responses.

We hypothesized that there were 4 categories of potential predictors of overall women's satisfaction with hospital childbirth services: (1) predisposing conditions, (2) V&P items, (3) PROs, and (4) gap data (eg, wanted but did not get). The study team further evaluated V&P items and PROs for their close relation to women's satisfaction with hospital childbirth services and for their specification of actionable or mutable services, practices, or policies.

To better understand the data and to limit the number of predictors, we tested predisposing conditions against the dichotomized variable for women's satisfaction with hospital childbirth services as described previously. In addition to the variables forced into all models, any predisposing condition with a P < .10 for bivariate analysis was eligible to be entered in the model. This P value allowed for a slightly more liberal inclusion criterion than normally used (P < .05) and created an alternative to forcing more predisposing conditions in the models. The predictors identified here were eligible to be used in the final models.

We performed multivariate logistic regression modeling using the predisposing conditions that reached statistical significance in the previous step (P < .10), as well as all V&P, PRO, and gap items that had a P < .05 in bivariate analysis with women's satisfaction with hospital childbirth services. Gap items with a nonsignificant 10% difference in categories were also eligible for inclusion, given that a 10% difference might be clinically relevant. Because 3 potential entries existed for a similar item (the V&P item, the PRO item, or the gap item), any significant one was eligible for the model. In the case of competing similar items, we first ranked items in order of the chi-square of the bivariate association with satisfaction, and sequentially tested in the models to determine which, if any, contributed to the model with the highest C statistic. We retained the model with the highest C statistic.

Objective 4: Using the Study Data, Finalize the Conceptual Model and Preliminary Item Bank

In accordance with PROMIS guidelines, our next step was to format the selected items (listed in Table 3) in a uniform style (uniform instructions and response options)45 and perform cognitive debriefing for the items' content validity (Table 2).43 On the basis of additional discussion with the community partners as well as interviews with pregnant and postpartum women, we crafted a final iteration of the item bank, specifying the relevant domains in the conceptual framework. The final childbirth-specific preliminary item bank included items that specified predisposing conditions, V&P, PROs, and gaps.

Results

Overview

The following sections present the results of objective 1 (literature search and domain mapping), objective 2 (the antepartum survey), objective 3 (the postpartum survey), and objective 4 (the conceptual framework and final preliminary item bank). Figure 3 provides a flow diagram of the steps in the item selection process.

Objective 1: Develop a Conceptual Framework for PROs and Map Relevant PRO Items to the Framework Domains

Building on the initial conceptual framework, the search strategies identified 5102 unique titles; from these, we identified 5902 relevant PRO items. In collaboration with the Childbirth PRO Partnership participants, we categorized these items into 19 domains and 58 subdomains (Table 3). We conducted 8 focus groups with 45 women of varying age, race/ethnicity, socioeconomic background, and region. Each focus group included 3 to 10 women. One focus group (n = 8) was facilitated in Spanish. We captured the value expectations of women who anticipated delivering or had delivered at a hospital, freestanding birth center, or home.

Focus group data confirmed the importance of these 19 priority domains; the 3 most frequently discussed domains were communication, involvement in decision-making, and the need for respect and empathy. Only 1 new subdomain that was not part of the literature search emerged from the focus groups—health insurance concerns. This included the nuances of different types of services, hospitals, and deductibles in different types of networks. While this concern arose in only 1 focus group, all women within that group thought it was important, each raising her own individual coverage issues. As a result, we added insurance/cost of care as a subdomain under decision-making. After the winnowing process, 68 V&P items and 64 items describing predisposing conditions remained.

Objective 2: Conduct a National Antepartum Survey to Test the Prevalence, Distribution, and Statistical Significance of PRO Items in the Framework Domains

We administered the survey in November 2015 over a 2-week period. Of 22 503 logins to the survey, 2757 fully qualified respondents completed it. Twenty-nine surveys (1.1%) were in Spanish. Of these respondents, 2033 (73.7%) anticipated a vaginal birth in a hospital; 217 (7.9%) anticipated a hospital birth but were uncertain regarding the planned delivery route; 393 (14.3%) anticipated a cesarean delivery; 23 (0.8%) anticipated delivery in a freestanding birth center; 47 (1.7%) anticipated delivering at home; 17 (0.6%) anticipated a vaginal delivery but were unsure of location; and 27 (1.0%) gave inconsistent or incomplete responses.

All geographic regions were represented. Most (55%) respondents were White, had at least some college (64%), and planned to be delivered by an obstetrician (69%). A third of the respondents (33.1%) were 30 to 34 years old, and 41% made at least $35 000 per year (Appendix B). Although 17% were Hispanic, only 7% indicated they needed an interpreter (language not specified); approximately 2% of women took the Spanish version of the survey. Table 4 lists the frequency distribution of the 37 predisposing conditions tested in the national sample.

For the predisposing conditions, as part of the factor analysis, we extracted 2 factors: discrimination (6 items; α = .89) and confidence (8 items; α = .76). Both factors used the 5-point response scale 1 = strongly disagree to 5 = strongly agree. We retained all other predisposing conditions as independent items. For the V&P, we extracted 4 factors. Overall and segmented factor analyses were consistent. These factors were (1) choice of labor environment (6 items; α .72); (2) communication regarding the newborn (8 items; α .89); (3) option to use labor tub, ball, or stool (3 items; α .90); and (4) desire to avoid interventions (6 items; α .80). All the involved items used the “importance” response scale. We calculated factor-based scores and collapsed to produce binary items for all the above factors. All remaining V&P remained as independent items.

The results of the multiple logistic regression models for those who anticipated a vaginal delivery appear in Table 5, which details the predisposing conditions associated (positively or negatively) with each V&P item, organized by the conceptual framework domain. In general, women who had high confidence, those who prepared a birth plan, and those who anticipated coping well with labor pain expressed preference for a more physiological birth and willingness to being more involved and in control of their childbirth.

Objective 3: Conduct a Follow-up Postpartum Survey to (1) Describe Women's Experiences and Outcomes of Childbirth (PROs), and (2) Determine the Statistical Significance of These Various Predictors in Women's Satisfaction With Their Hospital Childbirth Services

Descriptive Results

For Round 1, we collected antepartum survey data in November 2015 and postpartum data from December 2015 through June 2016. Of 2757 antepartum respondents, 399 (14.5%) also responded postpartum. For Round 2, we collected antepartum data from February through April 2016 and postpartum data from April through October 2016. Of 2098 antepartum respondents, 439 (20.9%) also responded postpartum. Of the total 838 respondents who answered both surveys, 500 (59.7%) met inclusion criteria (anticipated vaginal delivery and labored/delivered in a hospital), and 58 (11.6%) of these had a cesarean delivery. The mean number of weeks for completion of the postpartum response was 6.7 (5.0).

The mean rate for women's satisfaction with hospital childbirth services for this group of 500 women who answered both surveys was 8.6 ± 1.6, with a median of 9.0. Approximately 50% (59.6%; n = 298) had a “high” satisfaction score (≥9). We describe predisposing conditions and their association with women's satisfaction with hospital childbirth services separately in Table 6. Good overall health, good mental health, high confidence, and confidence filling out forms were the predisposing conditions most significantly associated with women's satisfaction with hospital childbirth services.

We tested the association of each V&P, PRO, and gap item with women's satisfaction with hospital childbirth services and reported those variables to have an association with a statistical significance of P < .05 or a nonsignificant 10% difference between any of the gap data categories, as shown in Table 7. The only V&P item significantly associated with women's satisfaction with hospital childbirth services was “wanted partner/support person in the room.” Several gap variables and numerous postpartum PROs reached statistical significance.

Variables that describe intrapartum and postpartum clinical complications appear in Table 8. None of the clinical complication items achieved statistical significance at the P < .05 level with respect to women's satisfaction with hospital childbirth services after adjustment.

Models

Because of the large number of potential predictors, we built the models of women's satisfaction with hospital childbirth services in steps. For the first step, we determined the predisposing conditions associated with women's satisfaction with hospital childbirth services. Table 9 describes the modeling of the predisposing conditions with women's satisfaction with hospital childbirth services, yielding “high confidence” as the only predictor of women's satisfaction with hospital childbirth services (in addition to the covariates used for model adjustment) retained in subsequent models (N = 489; C statistic = 0.637).

Table 10 describes the variables eligible for inclusion in the final model of women's satisfaction with hospital childbirth services.

Table 11 describes the final model of women's satisfaction with hospital childbirth services considering all the variables in Table 8 as potential covariates (N = 479; C statistic = 0.845).

Upon building the model described in Table 11, we realized that most (7 of 9) of the retained items apart from the forced covariates did not explicitly suggest actions hospital staff could take to improve the patient experience. For example, 1 of these items is that the patient felt the staff was compassionate, a quality that may not be easily or consistently translated into a prescribed set of staff behaviors. On the other hand, use of a birthing stool, a specific piece of equipment included in the model and highly associated with women's satisfaction with hospital childbirth services, could easily be accommodated by staff. Distinguishing this difference is important as it provides an opportunity to improve patient satisfaction by providing or performing these actionable items. This result prompted us to create an alternative model that excluded predictors of women's satisfaction with hospital childbirth services that we felt were difficult to act on. We refer to these as “high-level” items. We empirically selected 17 items from Table 10 that we labeled as high-level items and therefore not directly actionable:

  1. The respondent felt that staff respected her spiritual and cultural needs.
  2. The respondent felt the childbirth went smoothly.
  3. The respondent felt safe.
  4. The respondent left all choices to her provider.
  5. The respondent felt in control.
  6. The respondent was reassured by her provider.
  7. The respondent felt that she was treated by nurses with courtesy and respect.
  8. The respondent felt that she was treated by doctors/midwives with courtesy and respect.
  9. The respondent felt that the doctor/midwife explained things in a way she could understand.
  10. The respondent knew how to care for herself and baby upon discharge.
  11. The respondent saw the doctor/midwife enough.
  12. The respondent saw the nurses enough.
  13. The respondent felt that staff did not always explain what was happening.
  14. The respondent felt that she could not question providers.
  15. The respondent felt ignored by staff.
  16. The respondent felt staff was compassionate.
  17. The respondent felt staff was pleasant.

Table 12 describes this alternative model of women's satisfaction with hospital childbirth services based on all the actionable items in Table 10 and excluding the high-level items (N = 465; C statistic = 0.762). This model had a lower C statistic compared with the previous model in Table 11 because of the exclusion of the high-level items. However, the items in the alternative model were more explicit, informative, and/or actionable, as follows: coped well with labor pain (postpartum), continuous electronic fetal monitoring, adequate space/food for support person, debriefed regarding events of labor, practical support for breastfeeding, was told about progress in labor, wanted massage and got it (gap), and wanted partner/support person in the room (V&P).

Objective 4: Using the Study Data, Finalize the Conceptual Model and Preliminary Item Bank

Upon completion of the above aims, we performed cognitive debriefing (see Table 2) to test for (1) comprehension (What did the patient believe the question was trying to ask?); (2) memory retrieval process (What strategy was employed to retrieve information to answer the question?); (3) social desirability (Was the patient motivated by social desirability [or pressure] in answering the question?); and (4) response processing (Did the patient's internal response metric for an item match those of the question?). We then finalized the domains and items (Table 13).

Table 14 highlights those items that had the largest statistically significant odds ratios with respect to women's satisfaction with hospital childbirth services. We propose to include these items in a Childbirth Experiences and Outcomes Survey to be disseminated and implemented through an antepartum and postpartum patient-reported data collection process as we take the most meaningful and logical next steps. The items used in the antepartum and postpartum surveys described in this report appear in Appendices C and D, respectively. We anticipate that the next version of the Childbirth Experiences and Outcomes Survey will be a shortened version of these 2 surveys.

Discussion

Rationale and Context for This Study

This work provides a foundation for assessing what is important to women during their childbirth experience and emphasizes the need for both antepartum and postpartum data collection to ensure the reporting of predisposing factors, services valued and preferred, services received, and clinical outcomes. Our conceptual framework suggests that, for childbirth, measurement of both V&P and PROs is important. Using PROMIS methodology and a community-based research approach, we developed a conceptual framework, a preliminary item bank of predisposing conditions, and items relevant to women's V&P and PROs for childbirth in a hospital.

Study Results in Context

Our research addresses a long-standing evidence gap regarding the drivers of women's assessment of their childbirth experience. Although physicians and hospitals have focused on improving the safety of childbirth, women's V&P—including, but not limited to, safety—remain unexplored.

An early attempt to address this void was first published in a national survey, Listening to Mothers, in 2002. The report described childbirth experiences but did not systematically address V&P or PROs.74 Since the funding of our current PCORI project, the International Consortium for Health Outcomes Measurement (ICHOM) has developed a much broader and less specific set of standards for measuring pregnancy and childbirth outcomes that include several maternity patient self-reports.75 Furthermore, Gartner et al. developed core domains for women's birth-specific priorities that were largely consistent with our work.76 Neither this effort, nor that of ICHOM, measured the statistical significance of these domains with respect to the overall childbirth experience.

Our work narrows this long-standing evidence gap, offers a tool to assess women's V&P, and identifies the childbirth services that should be optimized to have the greatest impact on women's satisfaction. Many of our findings identify specific, actionable items that hospitals could readily address.

Our results are consistent with multiple studies13-15, 77-79 demonstrating that fulfillment of women's antenatal V&P (ie, what they desire, prefer, expect, think is important, or think should be important55,56) is a strong determinant of women's satisfaction with hospital childbirth services. In addition, components of the childbirth process, including not only labor and pain management but also the supportive services provided and quality of communication, appear to be as relevant as some clinical outcomes. These results are consistent with satisfaction studies for patients hospitalized for other health conditions.80-84

Additionally, our results confirmed the importance of the domains covered in the HCAHPS survey, a generic assessment of the following dimensions of the patient experience: communication with nurses, communication with doctors, responsiveness of staff, pain management, cleanliness and quietness of hospital environment, communication about medicines, and adequacy of discharge information.85 As suggested by the results of the focus group analyses, those PROs with the strongest associations were in our framework domains of (1) communication and decision-making, and (2) empathy and respect (Table 13). In the postpartum analyses, “high-level” items such as “staff was compassionate” and “the doctors explained things in a way I could understand” demonstrated strong associations with women's satisfaction with hospital childbirth services.

These findings firmly ground our results for pregnant women in the existing body of work regarding the elements of the patient experience that predict women's satisfaction with hospital childbirth services. However, our results go beyond this confirmation. We were also able to identify 23 PROs in Table 10 describing explicit, childbirth-related services and experiences that ultimately had an important association with women's satisfaction with hospital childbirth services. This set of items is a key result of our work because it gives childbirth providers and hospitals specific avenues for improving the childbirth hospital experience and for developing paths toward improving the more broad-based need for compassion, respect, empathy, and communication with staff.

The communication and decision-making domain included this set of explicit items: “was told about my progress in labor” and “was debriefed regarding events during labor.” The empathy and respect domain included these items specifically relevant to childbirth: “had adequate space and food for my support partner” and “was able to choose who was in the room during procedures.” Because these postpartum PROs were independent predictors of satisfaction (ie, not strongly associated with antepartum V&P), they are candidates for a menu of “universally desired” components of the childbirth experience.

Summary of Key Study Findings

The final conceptual framework had 15 domains and 46 subdomains, and the preliminary item bank had 100 V&P/PROs and 60 personal characteristics that were important predictors of these V&P/PROs. We developed a preliminary draft (English and Spanish versions) of a Childbirth Experience and Outcome Survey consisting of 2 parts: antepartum (documenting predisposing conditions and evaluating V&P) and postpartum (evaluating self-reported experiences and outcome). Each survey took approximately 30 minutes to complete.

The results reported here focused on the immediate hospital experience of women who anticipated vaginal hospital births. Of the 37 V&P tested as either single items or factors in the antepartum survey, some were desired by nearly all respondents (eg, having reassurance/comfort from the nurse [96.1%]), some by a moderate proportion of the respondents (eg, wanting to eat/drink during labor [56.0%]), and some by relatively few respondents (eg, wanting acupuncture/acupressure as a pain treatment option [6.5%]). These results confirmed that childbirth is a highly preference-sensitive condition73 and suggest that childbirth services preferences must be elicited and not inferred.

We confirmed our hypothesis that the desire for specific childbirth services and outcomes (V&P) varied not only across demographic groups but also across women with different levels of confidence, different levels of pain coping ability, and different attitudes toward childbirth preparedness. Some models performed better than others, with C statistics ranging from about 0.6 to 0.8. These results will guide us in determining which items should be retained for further refinement of the Childbirth Experiences and Outcomes Survey.

Our findings suggest the necessity for new data collection efforts if providers want the ability to predict “who” wants “what,” because much of this information (eg, levels of confidence, pain coping ability) is not routinely asked of pregnant women.

Of note is that women's reports of pregnancy complications rarely contributed to the V&P models. Nearly half (41.4%) reported having a complicated pregnancy, yet this perception did not appear to affect their desired outcomes.

The postpartum data analysis yielded several important results. First, items from each of the potential predictor categories (ie, predisposing conditions, V&P, gaps, and PROs) were independently associated with women's satisfaction with hospital childbirth services. This confirms our hypothesis that all these predictor categories include important items; it also raises the potential for identifying and possibly mitigating some of these items in the predisposing conditions and V&P categories in advance.

Second, we found few predisposing conditions independently associated with women's satisfaction with hospital childbirth services. Demographics, parity, and reported pregnancy complications had no demonstrable association with women's satisfaction with hospital childbirth services in bivariate or multivariate analysis. Some bivariate associations did occur for reports of overall health and overall mental health, a result that is well described in satisfaction literature for other patient populations. However, only mental health reported as poor or fair remained consistently (and negatively) associated with satisfaction in all postpartum models. Other predisposing conditions, including high maternal confidence and literacy (confidence in filling out medical/health forms), were generally more important, particularly in bivariate analysis. Both had strong positive associations with satisfaction.

Third, although fewer of those who reported clinical complications, such as transfusion or intensive care unit admission, appeared highly satisfied with the hospital, these differences rarely reached statistical significance. Cesarean delivery, defined as emergent in this population, was, in fact, positively associated with women's satisfaction with hospital childbirth services, although this did not reach statistical significance (OR 1.79 [95% CI, 0.94-3.41]; P = .0785).

Fourth, “high-level” items (eg, “the staff was compassionate,” “doctors explained things in a way I could understand”) dominated the full model for women's satisfaction with childbirth hospital services (Table 9) and confirms the importance of such items, present in the original HCAHPS model. Most of the more explicit items regarding childbirth, found in Table 8, were not retained by the model. Because this project's goal of was to focus on “actionable” items that could be addressed to improve women's satisfaction with hospital childbirth services, our alternative modeling attempt (Table 10) excluded these high-level variables and resulted in a more explicit model featuring 6 PRO items (“coped well with labor pain,” “had continuous electronic fetal monitoring,” “had adequate space/food for support person,” “got debriefed regarding events during labor,” “received practical support for feeding the newborn,” “and was told about progress in labor”), 1 gap item (“wanted and got a massage”), and 1 V&P item (“wanted the spouse/partner in the room”). The differences between the results in Tables 9 and 10 suggest the need to further explore these high-level variables.

Implementation of Study Results

We have developed an early version of the Childbirth Experiences and Outcomes Survey for use before birth, to allow the opportunity for discussion between patients and providers, and after birth, to determine whether women received the services and outcomes they wanted. A survey instrument that identifies women's V&P for childbirth has not previously been available. The development of this instrument fills an existing gap, bringing our work to Step 4 in the NQF pathway for the development of performance measures.72 The next step is implementation in multiple hospitals. A draft of the preliminary Childbirth Experiences and Outcomes Survey is in Appendices C (antepartum) and D (postpartum).

The implementation of a data collection and reporting process for childbirth-specific V&P/PROs has the potential to inform the health care decisions made by hospitals, by providers, and by pregnant women themselves. Hospitals determine their policies and patient services and can evaluate the availability of those services against what their patients want. For example, most hospitals do not support vaginal delivery of twins or vaginal birth after cesarean (VBAC) because of concerns about liability, limited expertise, and/or limited resources. In response, some women may have undergone labor outside the hospital to avoid automatic cesarean delivery or opted to deliver at birth centers or at home with lay midwives.86 If meeting these childbirth preferences is a high priority for some women, hospitals may want to further examine the potential for offering these services, thereby increasing the safety of childbirth and patient satisfaction.

Hospitals can also prioritize improvements in general patient–staff interactions, ensuring women's participation in labor and pain management decisions. For example, staff training, performance/quality monitoring, condition-specific toolkits, order sets, policies, and protocols are all tools that can support the dynamic interactions between staff and laboring patients.

The integration of childbirth-specific PROs into the hospital setting and the development of performance measures with the potential for public release could provide families with valuable information in choosing a childbirth hospital that fits their personal and clinical needs. Such performance measures would also be of interest to employers and insurers who negotiate benefit packages with childbirth hospitals.

We confirmed our hypothesis that the desire for specific childbirth services and outcomes varied not only across demographic groups but also across women with different levels of confidence, different levels of pain coping ability, and different attitudes toward childbirth preparedness. First, we identified items from each of the potential predictor categories (ie, predisposing conditions, V&P, gaps, and PROs) independently associated with women's satisfaction with hospital childbirth services. This confirms our hypothesis that all the categories may include important items, and raises the potential identifying and possibly mitigating in advance some of these items in the predisposing conditions and V&P categories.

Further validating and testing the Childbirth Experiences and Outcomes Survey in a multihospital environment is the obvious next step, and participants in the expanded stakeholders meeting have volunteered their hospitals for dissemination and implementation feasibility testing.

Generalizability of the Results

Strengths of this work include the use of PROMIS methodology to develop and build on the conceptual framework and the community-based research approach. This foundational effort can be expanded on and serve as a basis for continued advancement using the methodologies promoted by PROMIS, NQF, PCORI, or AHRQ.

We developed 3 products: (1) a conceptual framework and childbirth V&P/PRO preliminary item bank; (2) an antepartum survey that demonstrates the variation in V&P by different predisposing conditions; and (3) a postpartum survey that demonstrates the relationship between various potential categories of predictors (ie, predisposing conditions, V&P, gaps, and PROs) and women's satisfaction with hospital childbirth services. Given the extensive literature review and item search, we believe the framework and preliminary item bank should serve as a solid foundation for further development of childbirth V&P and PROs for US women, although further domains and items may continue to be developed.

The antepartum survey confirmed our hypothesis that the desire for specific childbirth services and outcomes varied not only across demographic groups but also across women with different levels of confidence, different levels of pain coping ability, and different attitudes toward childbirth preparedness. This variation is likely to be found in most test settings, including hospital populations, and supports the concept that women's childbirth services preferences cannot necessarily be inferred.

A sample recruited through Nielsen produced data for the antepartum survey regarding patient V&P. These data were weighted by relevant demographic characteristics to maximize generalizability to the US population of reproductive-age women. Thus, our results describing “who wants what” should generally describe the preferences of pregnant women in the United States. Further exploration and confirmation of the statistical significance of these predisposing conditions will take place in the future in the hospital setting, where different hospitals will likely have different base populations that vary by both demographics and predisposing conditions.

The third set of results, which relates to the postpartum data, confirms our hypothesis that antepartum V&P and gap data may also contribute to women's satisfaction with hospital childbirth services. However, we found many items associated with women's satisfaction with hospital childbirth services, and we anticipate that as we further develop the Childbirth Experiences and Outcomes Survey, new test settings may alter what items contribute to the final satisfaction models. Also, as we employ a wider variety of satisfaction measures (eg, birth satisfaction, hospital loyalty), we may also find that certain items or categories of items are most important. The postpartum results were not weighted and are less likely to be generalizable. We recognize the potential for recruitment bias based on the online panels used for recruitment and the low response rate for the postpartum survey. However, we did have women of all age groups, racial/ethnic groups, and geographic regions. Furthermore, our postpartum findings are consistent with findings from the literature, as noted previously.

Subpopulation Considerations

The findings presented here are specific to the services women received while in labor and in the immediate postpartum period (before hospital discharge). For interpretability, we limited our analysis to women who planned a vaginal birth in a hospital. We have data on women planning a cesarean and women planning births at home or at a birth center (approximately 2%, consistent with national estimates), but the numbers of these women are too limited to be explored sufficiently in adjusted analyses. Several of our community partners have expressed an interest in participating in analyses of these cohorts, but conclusions will be limited by the small sample sizes.87 Additional data should be collected in these patient populations to confirm similarities and differences from women planning hospital births.

Study Limitations

This study is an early effort in the development of an approach to evaluating women's childbirth experiences and outcomes, so there are many limitations to this work. Most of these limitations can be addressed through continued development using the documented PROMIS, NQF, or AHRQ methodologies and will depend on funding opportunities. These limitations and potential efforts to mitigate them appear in Table 15.

Future Research

We envision at least 6 opportunities for future research, which are outlined below.

Development of Childbirth-Specific PROs as Hospital Performance Measures

This work brings us to Step 4 of the NQF Pathway for the development of PROs as hospital performance measures.72 The NQF outlines a clear research path proceeding through implementation of the PROs in the hospital environment and comparisons across hospitals to determine PRO variation in this environment and the potential for quality improvement. The further development of the Childbirth Experiences and Outcomes Survey may also lead to integration in AHRQ's CAHPS suite of patient experience surveys. We are proposing that the next meaningful and logical step is to demonstrate the feasibility of such an implementation in a limited number of hospitals.

Further Development of Childbirth-Specific PROs as Self-reported Clinical Outcomes

Continued development under the PROMIS methodology could lead to a better understanding of women's assessments of their own health and their newborn's health after the childbirth experience. Comparison of clinical events (eg, through the medical record) with self-assessments would advance our understanding of the extent to which self-assessments are clinically accurate and reliable in the absence of electronic medical record linkage.

Development of Strategies to Improve the Childbirth Experience

Once an infrastructure is in place to measure women's V&P/PROs, this information can help providers and hospitals identify vulnerable patients (ie, those unlikely to be satisfied with their care) and develop strategies to address anticipated gaps (ie, unfulfilled preferences) before delivery. Types of strategies and their effectiveness in improving the patient experience remain to be explored.

Further Exploration of Childbirth-Specific V&P/PROs to Determine Their Relationship to Clinical Outcomes

Based on Figure 1 and supported by the results of the national survey, hospitals that address women's childbirth priorities (V&P) should improve their patient experience. It remains unknown whether improved attention to women's V&P will impact maternal or neonatal clinical outcomes. Because to date there have been no formal mechanisms for identifying what women want in childbirth, research in this area is limited. To elicit and document women's priorities would encourage caregivers to respond to these priorities, and would begin to define the following: (1) the domains in which women have choices, (2) under which circumstances and to what extent those choices exist, (3) the potential for mutability of these choices, and (4) methods to help clarify choices (eg, through education of both patients and providers).88,89

Further Exploration of V&P/PROs as Predictors of Birth Satisfaction

Birth satisfaction is an important patient-centered outcome. The proposed conceptual framework can facilitate further study. Further exploration of V&P/PROs with respect to subpopulations such as those anticipating a scheduled cesarean birth and those planning to deliver outside the hospital Some women schedule a cesarean birth for clinical indications, and others do so out of preference. Providers and hospitals need a deeper understanding of women's preferences regarding route and location of delivery. We have begun to explore some of the subpopulations (women who want home births or VBACs) with our community partners as lead authors.

Conclusions

In conclusion, we have developed a conceptual framework and preliminary item bank for childbirth-specific patient-reported V&P and experiences and outcomes. We have explored the statistical significance of these V&P/PROs with respect to their association with women's satisfaction with hospital childbirth services and have developed a Childbirth Experiences and Outcomes Survey based on these results. Throughout this process we have relied on community-based participatory research techniques and the PROMIS guidelines for item bank development. We have also adhered to the PCORI Methodology Standards. Our work is consistent with prior work in both the childbirth satisfaction literature and the general patient satisfaction literature, and it specifically identifies domains of care and actionable items providers and hospitals can address to improve the patient experience. Our study findings will be useful to hospital administrators and maternity care providers who want to improve the patient care experience and their hospital satisfaction scores.

The next meaningful and logical step for the further development of this framework and preliminary item bank is to implement a data collection system for the childbirth predisposing conditions, V&P, PRO, and gap items in a multiple-hospital setting, thereby making V&P/PRO data available to providers for clinical decision-making and to researchers for the development of childbirth hospital performance monitoring.

The NQF,90 the US national clearinghouse for the assessment and endorsement of health care performance measures, has published standards for the design and selection of PROs that relate to the performance of health care organizations. NQF has emphasized that the incorporation of the patient perspective into health care services quality monitoring must ensure that the infrastructure is in place to document and respond to that perspective, and that valid and comprehensive measures of that perspective are in place.25 The work described here lays a foundation for further development of childbirth V&P and PROs as hospital performance measures of the childbirth experience and outcomes.

References

1.
Martin JA, Hamilton BE, Osterman MJK, Driscoll AK, Mathews TJ. Births: final data for 2015. Natl Vital Stat Rep. 2017;66(1):1-70. [PubMed: 28135188]
2.
Centers for Disease Control and Prevention. National Center for Health Statistics. National Hospital Discharge Survey. Number and rate of discharges by first-listed diagnostic categories, 2010. Accessed October 3, 2017. https://www​.cdc.gov/nchs​/data/nhds/2average​/2010ave2_firstlist.pdf
3.
Centers for Disease Control and Prevention. Severe Maternal Morbidity in the United States. Trends in severe maternal morbidity in the United States, 1998-2011. Accessed October 3, 2017. https://www​.cdc.gov/reproductivehealth​/maternalinfanthealth​/severematernalmorbidity.html
4.
Centers for Disease Control and Prevention. Pregnancy Mortality Surveillance System. Trends in pregnancy-related deaths. Accessed October 3, 2017. http://www.cdc.gov/reproductivehealth/maternalinfanthealth/pmss.html
5.
Fridman M, Korst LM, Chow J, Lawton E, Mitchell C, Gregory KD. Trends in maternal morbidity before and during pregnancy in California. Am J Public Health. 2014;104(suppl 1):S49-S57. [PMC free article: PMC4011109] [PubMed: 24354836]
6.
Bryant AS, Worjoloh A, Caughey AB, Washington AE. Racial/ethnic disparities in obstetrical outcomes and care: prevalence and determinants. Am J Obstet Gynecol. 2010;202(4):335-343. [PMC free article: PMC2847630] [PubMed: 20060513]
7.
Creanga AA, Bateman BT, Kuklina EV, Callaghan WM. Racial and ethnic disparities in severe maternal morbidity: a multistate analysis, 2008-2010. Am J Obstet Gynecol. 2014:210:435.e1-e8. [PubMed: 24295922]
8.
Korst LM, Fridman M, Lu MC, et al. Monitoring childbirth morbidity using hospital discharge data: further development and application of a composite measure. Am J Obstet Gynecol. 2014;211:268.e1-16. [PubMed: 24631432]
9.
Gregory KD, Fridman M, Shah S. Korst LM. Global measures of quality and patient safety- related childbirth outcomes: should we monitor adverse or ideal rates? Am J Obstet Gynecol. 2009;200:681.e1-681.e7. [PubMed: 19482115]
10.
American College of Obstetricians and Gynecologists. Levels of maternal care. obstetric care consensus no. 2. Obstet Gynecol. 2015;125(2):502-515. [PubMed: 25611640]
11.
Council on Patient Safety in Women's Health Care website. Accessed October 3, 2017. http://www​.safehealthcareforeverywoman​.org/
12.
Hodnett ED. Pain and women's satisfaction with the experience childbirth: a systematic review. Am J Obstet Gynecol. 2002;186(Suppl 5 Nature):S160-S172. [PubMed: 12011880]
13.
Goodman P, Mackey MC, Tavakoli AS. Factors related to childbirth satisfaction. J Adv Nurs. 2004;46(2):212-219. [PubMed: 15056335]
14.
Green JM, Coupland VA, Kitzinger JV. Expectations, experiences and psychological outcomes of childbirth: a prospective study of 825 women. Birth. 1990;17:15-23. [PubMed: 2346576]
15.
Waldenstrom U, Borg IM, Ollson B, Skold M, Wall S. The childbirth experience: a study of 295 new mothers. Birth. 1996;23:144-153. [PubMed: 8924100]
16.
Bryanton J, Gagnon AJ, Johnston C, Hatem M. Predictors of women's perceptions of the childbirth experience. J Obstet Gynecol Neonatal Nurs. 2008;37:24-34. [PubMed: 18226154]
17.
Mei JY, Afshar Y, Gregory KD, Kilpatrick SJ, Esakoff TF. Birth plans: what matters for birth experience satisfaction. Birth. 2016;43(2):144-150. [PubMed: 26915304]
18.
Childbirth Connection. Listening to Mothers III: Report of the Third National U.S. Survey of Women's Childbearing Experiences. Published May 2013. Accessed October 3, 2017. https://www​.nationalpartnership​.org/our-work​/resources/health-care​/maternity/listening-to-mothers-iii-pregnancy-and-birth-2013.pdf
19.
Beck CT, Gable RK, Sakala C, Declercq ER. Posttraumatic stress disorder in new mothers: results from a two-stage U.S. national survey. Birth. 2011;38(3):216-227. [PubMed: 21884230]
20.
Rudman A, el-Khouri B, Waldenstrom U. Women's satisfaction with intrapartum care—a pattern approach. J Adv Nurs. 2007;59(5):474-487. [PubMed: 17645495]
21.
Committee on Quality of Health Care in America. Crossing the Quality Chasm: a New Health System for the 21st Century. Institute of Medicine; 2001. Accessed October 3, 2017. http://www​.nap.edu/catalog/10027.html
22.
Gerteis M, Edgman-Levitan S, Daley J. Through the Patient's Eyes. Understanding and Promoting Patient-Centered Care. Jossey-Bass; 1993.
23.
Bowling A, Rowe G, Lambert N, et al. The measurement of patients' expectations for health care: a review and psychometric testing of a measure of patients' expectations. Health Technol Assess. 2012;16(30):1-509. [PubMed: 22747798]
24.
Lloyd H, Jenkinson C, Hadi M, Gibbons E, Fitzpatrick R. Patient reports of the outcomes of treatment: a structured review of approaches. Health Qual Life Outcomes. 2014;12(5):1-9. [PMC free article: PMC3899626] [PubMed: 24422873]
25.
National Quality Forum. Measuring performance: what NQF endorsement means. Accessed October 3, 2017. http://www​.qualityforum​.org/Measuring_Performance​/ABCs/What_NQF​_Endorsement_Means.aspx
26.
Deutsch A, Smith L, Gage B, Kelleher C, Garfinkel. Patient-Reported Outcomes in Performance Measurement. Commissioned Paper on PRO-Based Performance Measures for Healthcare Accountable Entities. Prepared for the National Quality Forum. Published October 22, 2012. Accessed October 3, 2017.
27.
Cella D, Yount S, Rothrock N, et al; PROMIS® Cooperative Group. The Patient-Reported Outcomes Measurement Information System (PROMIS®): progress of an NIH Roadmap Cooperative Group during its first two years. Med Care. 2007;45(5 Suppl 1):S3-S11. [PMC free article: PMC2829758] [PubMed: 17443116]
28.
Hays RD, Morales LS, Reise SP. Item response theory and health outcomes measurement in the 21st century. Med Care. 2000;38(9 Suppl II):II28-II42. [PMC free article: PMC1815384] [PubMed: 10982088]
29.
Cella D, Riley W, Stone A, et al; PROMIS® Cooperative Group. The Patient-Reported Outcomes Measurement Information System (PROMIS®) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008. J Clin Epidemiol. 2010;63:1179-1194. [PMC free article: PMC2965562] [PubMed: 20685078]
30.
Cella D, Hahn EA, Jensen SE, Butt Z, Nowinski CJ, Rothrock N. Methodological Issues in the Selection, Administration and Use of Patient-Reported Outcomes in Performance Measurement in Health Care Settings. Accessed October 3, 2017.
31.
Department of Health and Human Services, Centers for Medicare & Medicaid. Medicare Program; Hospital Inpatient Value-based Purchasing Program. Federal Register. 2011:76(9):2454-2491. Accessed October 3, 2017. https://www​.federalregister​.gov/documents​/2011/05/06/2011-10568​/medicare-program-hospital-inpatient-value-based-purchasing-program
32.
Centers for Medicare & Medicaid Services. MACRA: delivery system reform, Medicare payment reform. Accessed October 3, 2017. https://www​.cms.gov/Medicare​/Quality-Initiatives-Patient-Assessment-Instruments​/Value-Based-Programs​/MACRA-MIPS-and-APMs/MACRA-MIPS-and-APMs
33.
Miller P, Klein D. Physician and Hospital Reimbursement: From “Lodge Medicine” to MIPS. Merritt Hawkins; 2015. Accessed October 3, 2017. https://www​.wsha.org​/wp-content/uploads/mhawhitepaperreimbursement.pdf
34.
Patient-Centered Outcomes Research Institute (PCORI). PCORI Patient-Reported Outcomes (PRO) Infrastructure Workshop “Integrating PROs into EHRs.” November 19-20, 2013; Atlanta, GA. Executive Summary Draft October 15, 2014. Accessed October 3, 2017. https://www​.pcori.org​/sites/default/files​/PCORI-PRO-Infrastructure-Workshop​%20Report-111913.pdf
35.
Wu AW. Advances in the use of patient reported outcome measures in electronic health records: including case studies. Patient-Centered Outcomes Research Institute (PCORI). Published November 7, 2013. Accessed October 3, 2017. https://www​.pcori.org​/assets/2013/11/PCORI-PRO-Workshop-EHR-Landscape-Review-111913.pdf
36.
Cella D, Hahn EA, Jensen SE, et al. Patient-Reported Outcomes in Performance Measurement. RTI Press; 2015. https://www​.ncbi.nlm​.nih.gov/books/NBK424378/ [PubMed: 28211667]
37.
Coulter A. Measuring what matters to patients. BMJ. 2017;356:j816. doi:10.1136/bmj.j816 [PubMed: 28219884] [CrossRef]
38.
National Quality Forum. Measuring performance. Accessed October 3, 2017. https://www​.qualityforum​.org/Measuring_Performance​/Measuring_Performance.aspx
39.
Agency for Healthcare Research and Quality. CAHPS. Accessed October 3, 2017. https://www​.ahrq.gov/cahps/index.html
40.
Centers for Medicare & Medicaid Services. Hospital value based purchasing. Accessed October 3, 2017. https://www​.cms.gov/Medicare​/Quality-Initiatives-Patient-Assessment-Instruments​/Value-Based-Programs​/HVBP/Hospital-Value-Based-Purchasing
41.
Agency for Healthcare Research and Quality. CAHPS hospital survey (HCAHPS). Accessed October 3, 2017. https://www​.ahrq.gov​/cahps/surveys-guidance/hospital/index​.html
42.
National Partnership for Women and Families. The priority of developing and implementing CAHPS maternity care facility, clinician and health plan surveys. Published March 2015. Accessed October 3, 2017. https://www​.nationalpartnership​.org/our-work​/resources/health-care​/maternity/cahps-maternity-care-fact-sheet.pdf
43.
Patient-Reported Outcomes Management Information System. PROMIS Instrument Maturity Model. Published 2013. Accessed October 3, 2017. http://www​.healthmeasures​.net/images/PROMIS​/PROMISStandards_Vers​_2_0_MaturityModelOnly_508.pdf
44.
O'Haire C, McPheeters M, Nakamoto EK, et al. Methods for Engaging Stakeholders to Identify and Prioritize Future Research Needs (prepared by Oregon EPC under Contract No. HHSA 290-2007-10057-I). Agency for Healthcare Research and Quality; December 2010. [PubMed: 21977526]
45.
DeWalt DA, Rothrock N, Yount S, Stone AA; PROMIS Cooperative Group. Evaluation of item candidates: the PROMIS qualitative item review. Med Care. 2007;45:S12-S21. [PMC free article: PMC2810630] [PubMed: 17443114]
46.
Andersen RM. National health surveys and the behavioral model of health services use. Med Care. 2008;46(7):647-653. [PubMed: 18580382]
47.
Mead N, Bower P. Patient-centeredness: a conceptual framework and review of the empirical literature. Soc Sci Med. 2000;51:1087-1110. [PubMed: 11005395]
48.
Baker LM, Pettigrew KE. Theories for practitioners: two frameworks for studying consumer health information-seeking behavior. Bull Med Libr Assoc. 1999;87(4):444-450. [PMC free article: PMC226619] [PubMed: 10550029]
49.
Janzen JA, Silvius J, Jacobs S, Slaughter S, Dalziel W, Drummond N. What is a health expectation? developing a pragmatic conceptual model from psychological theory. Health Expect. 2006;9:37-48. [PMC free article: PMC5060332] [PubMed: 16436160]
50.
Cleary PD, Edgman-Levitan S, Roberts M, et al. Patients evaluate their hospital care: a national survey. Health Aff (Millwood). 1991;10(4):254-267. [PubMed: 1778560]
51.
Schwarzer R, Renner B. Social-cognitive predictors of health behavior: action self-efficacy and coping self-efficacy. Health Psychol. 2000;19(5):487-495. [PubMed: 11007157]
52.
Staniszewska S. The concepts of expectation and satisfaction: do they capture the way patients evaluate their care? J Adv Nurs. 1999;29(2):364-372. [PubMed: 10197936]
53.
Sitzia J, Wood N. Patient satisfaction: a review of issues and concepts. Soc Sci Med. 1997;45(12):1829-1843. [PubMed: 9447632]
54.
Lyerly AD, Mitchell LM, Armstrong EM, et al. Risks, values and decision making surrounding pregnancy. Obstet Gynecol. 2007;109(4):979-984. [PubMed: 17400862]
55.
Kravitz RL. Patients' expectations for medical care: an expanded formulation based on review of the literature. Med Care Res Rev. 1996;53:3-27. [PubMed: 10156434]
56.
Uhlmann RF, Inui TS, Carter WB. Patient requests and expectations. definitions and clinical applications. Med Care. 1984;22:681-685. [PubMed: 6748787]
57.
Khanna P, Agarwal N, Khanna D, et al. Development of an online library of patient-reported outcome measures in gastroenterology: the GI-PRO Database. Am J Gastroenterol. 2014;109:234-248. [PMC free article: PMC4275098] [PubMed: 24343547]
58.
Klem M, Saghafi E, Abromitis R, et al. Creation of exhaustive item banks: the role of the health sciences librarian. In: PROMIS Conference: Building Tomorrow's Patient-Reported Outcome Measure. Gaithersburg, MD; 2006.
59.
Terwee CB, Jansma EP, Riphagen II, de Vet HCW. Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Qual Life Res. 2009;18:1115-1123. [PMC free article: PMC2744791] [PubMed: 19711195]
60.
Eden J, Levit L, Berg A, Morton S, eds; Institute of Medicine Committee on Standards for Systematic Reviews of Comparative Effectiveness Research. Finding What Works in Health Care. Standards for Systematic Reviews. National Academies Press; 2011. [PubMed: 24983062]
61.
Glaser B, Strauss A. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine; 1967.
62.
Patton MQ. Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999;34(5, pt 2):1189-1208. [PMC free article: PMC1089059] [PubMed: 10591279]
63.
Fink A. Evaluation Fundamentals: Insights Into the Outcomes, Effectiveness, and Quality of Health Programs. 2nd ed. Sage Publications; 2005.
64.
Nielsen website. Accessed October 3, 2017. https://www​.nielsen.com/us/en/
65.
Centers for Disease Control and Prevention, National Center for Health Statistics. National survey of family growth. Accessed October 3, 2017. https://www​.cdc.gov/nchs/nsfg/
66.
US Census Bureau and US Bureau of Labor Statistics. Current population survey. Accessed October 3, 2017. http://www​.census.gov​/programs-surveys/cps.html
67.
Hatcher L. A Step-by-Step Approach to Using the SAS System for Factor Analysis and Structural Equation Modeling. SAS Institute, Inc; 1994.
68.
Hosmer DW, Lemeshow S. Applied Logistic Regression. John Wiley & Sons Inc; 1989.
69.
Negelkerke NJD. A note on a general definition of the coefficient of determination. Biometrika. 1991;78:691-692.
70.
Allison PD. Logistic Regression Using SAS: Theory and Applications. 2nd ed. SAS Institute Inc; 2012.
71.
Hospital and Consumer Assessment of Healthcare Providers and Systems. Summary analyses. Accessed October 3, 2017. http://www​.hcahpsonline​.org/SummaryAnalyses.aspx
72.
National Quality Forum. Patient-Reported Outcomes in Performance Measurement. 2013. https://www​.qualityforum​.org/Publications​/2012/12/Patient-Reported​_Outcomes_in_Performance​_Measurement.aspx
73.
Wennberg JE, Fisher ES, Skinner JS. Geography and the debate over Medicare reform. Health Aff (Millwood). 2002;suppl Web Exclusives:W96-W114. [PubMed: 12703563]
74.
DeClercq ER, Sakala C, Corry MP, Applebaum S, Risher P. Listening to Mothers: Report of the First National U.S. Survey of Women's Childbearing Experiences. Published October 2002. Accessed October 3, 2017. https://www​.nationalpartnership​.org/our-work​/resources/health-care​/maternity/listening-to-mothers-i​_2002.pdf
75.
International Consortium for Healthcare Outcomes Measures. ICHOM standard set for pregnancy and childbirth. Accessed October 3, 2017. https://www​.ichom.org​/portfolio/pregnancy-and-childbirth/
76.
Gartner FR, Freeman LM, Rijnders ME, et al. A comprehensive representation of the birth experience: identification and prioritization of birth-specific domains based on a mixed- method design. BMC Pregnancy Childbirth. 2014;14:147. [PMC free article: PMC4021407] [PubMed: 24758274]
77.
Bramadat IJ, Driedger M. Satisfaction with childbirth: theories and methods of measurement. Birth. 1993;20(1):22-29. [PubMed: 8503963]
78.
Slade P, MacPherson SA, Hume A, Maresh M. Expectations, experiences and satisfaction with labour. Br J Clin Psychol. 1993;32:469-483. [PubMed: 8298545]
79.
Linder-Pelz S. Toward a theory of patient satisfaction. Soc Sci Med. 1982;16:577-582. [PubMed: 7100990]
80.
Sinclair RR, Fleming WD, Radwinsky R, Clupper DR, Clupper JH. Understanding patients' reactions to services: the role of personal service values in heart patient satisfaction and wellness. J Appl Soc Psychol. 2002;32(2):424-442.
81.
Rozenblum R, Lisby M, Hockey PM, et al. Uncovering the blind spot of patient satisfaction: an international survey. BMJ Qual Saf. 2011;20:959-965. [PubMed: 21949436]
82.
Fiala TG. What do patients want: technical quality versus functional quality: a literature review for plastic surgeons. Aesthet Surg J. 2012;3296:751-759. [PubMed: 22859547]
83.
Grönroos C. A service quality model and its marketing implications. Eur J Mark. 1984;29:36-44.
84.
Ware JE, Snyder MK. Dimensions of patient attitudes regarding doctors and medical services. Med Care. 1975;26:669-673. [PubMed: 1152557]
85.
Patient- and caregiver-centered experience of care/care coordination domain. Medicare.gov/Hospital Compare website. Accessed October 3, 2017. https://www​.medicare​.gov/HospitalCompare​/Data/patient-and-caregiver-centered-experience-of-care-care-coordination-domain.html
86.
87.
Afshar Y, McCulloch J, Korst L, et al. Patient centered outcomes research: clinical characteristics & patient preferences among women planning out-of-hospital births (OOHB). Poster presented at: ACOG Annual Clinic and Scientific Meeting; May 6-9, 2017; San Diego, CA.
88.
Street RL, Elwyn G, Epstein RM. Patient preferences and healthcare outcomes: an ecological perspective. Expert Rev Pharmacoecon Outcomes Res. 2012;12(2):167-180. [PubMed: 22458618]
89.
Muhlbacher AC, Juhnke C. Patient preferences versus physicians' judgement: does it make a difference in healthcare decision making? Appl Health Econ Health Policy. 2013;11:163-180. [PubMed: 23529716]
90.
National Quality Forum. NQF's work in quality management. Accessed October 3, 2017. http://www​.qualityforum​.org/about_nqf/work​_in_quality_measurement/

Acknowledgments

We are grateful to PCORI for the opportunity to conduct this study and for our project officer, Jason Gerson, for his support and guidance. We would also like to acknowledge the members of The Childbirth Patient-Reported Outcomes (PRO) Partnership, who provided guidance and insight throughout the development of the project. The Childbirth PRO Partnership authors include (listed alphabetically by organization): Adriana Lozada and Jeanette McCulloch (Birthswell); Jennifer Anger, MD; Yalda Afshar, MD, PhD; Mykel LeCheminant, RNC, MSN, ICCE; Naomi Greene, PhD; Caroline Marshall, MLS, AHIP; Katy Sharma, MD; and Brennan Spiegel, MD, MSHS (Cedars-Sinai Medical Center); Lisa Bollman, RNC, MSN, CPHQ (Community Perinatal Network); Hindi Stohl, MD, JD (Harbor-UCLA Medical Center); Cordelia Hanna Cheruiyot, MPH, CHES, ICCE, CLE, CBA (The Association for Wholistic Maternal and Newborn Health); Sandra Applebaum; Peg Jaynes; and Roz Pierson, PhD (The Nielsen Company); Geraldine Perry-Williams, MSN, PHN (Pasadena Department of Public Health–Pasadena Black Infant Health Program); Diana Ramos, MD, MPH; Leslie Lopez, MPH, CHES; Joanne Roberts, PHN (Los Angeles County Department of Public Health); Janice French, CNM, MS (Los Angeles Best Babies Network); Nathana Lurvey, MD (South Bay Family Healthcare Center); Priya Batra, MD, MS (UCLA); Gerson Hernandez, MD (University of Southern California); and Minerva Pineda, MD, MPH (UCLA).

Research reported in this report was [partially] funded through a Patient-Centered Outcomes Research Institute® (PCORI®) Award (#ME-1402-10249) Further information available at: https://www.pcori.org/research-results/2014/developing-item-bank-survey-questions-measure-womens-experiences-childbirth

Appendices

Appendix A.

Literature Search Strategy (PDF, 179K)

Appendix C.

Antepartum Survey (PDF, 507K)

Appendix D.

Postpartum Survey (PDF, 365K)

Figures

Figure 1. Conceptual Framework for Determining PROs in Childbirth.

Figure 1Conceptual Framework for Determining PROs in Childbirth

Figure 2. Nielsen Survey Administration Flow Diagram.

Figure 2Nielsen Survey Administration Flow Diagram

Figure 3. Flow Diagram of Steps in the Item Selection Process.

Figure 3Flow Diagram of Steps in the Item Selection Process

Abbreviations: PROs, patient-reported outcomes; V&P, values and preferences.

Tables

Table 1List of Community Partners and Their Associated Organizations

NameOrganization
Academic research team (attended weekly meetings)
 Kimberly Gregory, MD, MPHCedars-Sinai Medical Center
 Samia Saeb, MPHCedars-Sinai Medical Center
 Lisa Korst, PhDMaternal Metrics
 Moshe Fridman, PhDMaternal Metrics
 Arlene Fink, PhDUCLA
Community partners (attended *weekly, monthly, or #quarterly meetings)
 Adriana LozadaBirthSwell: Social Media for Improved Maternal Outcomes
 Jeanette McCulloch*BirthSwell: Social Media for Improved Maternal Outcomes
 Jennifer Anger, MD#Cedars-Sinai Medical Center
 Yalda Afshar, MD#Cedars-Sinai Medical Center
 Naomi Greene, PhD*Cedars-Sinai Medical Center
 Mykel LeCheminant, RNC, BS*Cedars-Sinai Medical Center
 Caroline Marshall, MLS, AHIP*Cedars-Sinai Medical Center
 Katy Sharma, MD*Cedars-Sinai Medical Center
 Brennan Spiegel, MD, MSHS#Cedars-Sinai Medical Center
 Lisa Bollman, RNC, MSN, CPHQ#Community Perinatal Network
 Hindi Stohl, MD*Harbor UCLA Medical Center
 Cordelia Hanna Cheruiyot, MPH, CHES, ICCE, CLE, CBA*The Association for Wholistic Maternal and Newborn Health
 Sandra Applebaum*The Nielsen Company
 Peg Jaynes*The Nielsen Company
 Roz Pierson, PhD*The Nielsen Company
 Geraldine Perry-Williams, MSN, PHN*Pasadena Department of Public Health–Pasadena Black Infant Health Program
 Diana Ramos, MD, MPH*Los Angeles County Department of Public Health
 Leslie Lopez, MPH, CHES#Los Angeles County Department of Public Health
 Joanne Roberts, PHN#Los Angeles County Department of Public Health
 Janice French, CNM#Los Angeles Best Babies Network
 Nathana Lurvey, MD#South Bay Family Healthcare
 Priya Batra, MD, MS, FACOG*UCLA
 Gerson Hernandez, MDUniversity of Southern California
 Minerva Pineda, MPHUCLA
Invited expanded stakeholders (*attended at least 1 meeting, call or presentation)
 Leslie Cragin*ACNM Healthy Birth Initiative
 Stephanie Teleki, MPH, PhD*California Healthcare Foundation
 Sarah Kilpatrick, MD, PhD*Cedars-Sinai Medical Center
 Susan Jackman RN, MSCedars-Sinai Medical Center
 Tunessa Mallet-Price, RNCHA Hollywood Presbyterian Medical Center
 Joyce Edmonds, PhD, MPH, RNBoston College
 Rachel Thompson, PhD*Dartmouth
 NameOrganization
 Tracy Flanagan, MD*Kaiser, Director of Women Services
 Sarah Mandel, MD*Kaiser, Director Patient Care Experiences
 Janice French, CNM, MS*LA Best Babies Executive Director, Patient Advocate
 Christine H. Holschneider, MD*Los Angeles County/Olive View–UCLA Medical Center, Chair
 Jennifer Bailit, MD, MPH*Metro Health, Director, Women & Children Services
 David Lagrew, MD*Memorial Care Health Systems, Medical Director
 Carol Sakala, PhD, MSPH*National Partnership for Women and Families
 Karen Pace, PhD, RN*National Quality Forum
 Terri Cornelison, MD, PhD, FACOG*Office of Research on Women's Health
 Brynn Rubinstein*Pacific Business Group on Health
 Tanya Wicks, MPH*Perinatal Advisory Council: Leadership, Advocacy, and Consultation
 Aida Simonian, MSN, RNC-NIC, SCM, SRN*Perinatal Advisory Council: Leadership, Advocacy, and Consultation
 Ellen Silver, NP*Pomona Community Health Center, Executive Director
 Hellen Rodriguez, MD*Pomona Valley Hospital Medical Center, Chief Quality Officer
 Sherri Mendelson, PhD, RNC, CNS, IBCLC*Providence Holy Cross Medical Center
 Bryan T. Oshiro, MD*Riverside Community Hospital, Riverside County Regional Medical Center, St. Mary Medical Center, Apple Valley
 Lydia Lee, MD, PhD*Santa Monica UCLA Medical Center, Ronald Reagan UCLA Medical Center, Director Quality
 Sean Currigan, MPH*The American College of Obstetricians and Gynecologists
 Deborah A. Wing, MD, MBAUniversity of California Irvine Medical Center
 Brian S. Mittman, PhD*US Department of Veterans Affairs
 Beni Adeniji, MD, DFFP*Valley Children's/St. Agnes Regional Medical Center
 Kathryn Shaw, MD*White Memorial Medical Center

Abbreviations: ACNM, American College of Nurse Midwives; UCLA, University of California Los Angeles.

Table 2PCORI Focus Groups: Sites and Number of Participants

Preferences and expectations N = 45 (8 Spanish)Antepartum survey pilot N = 50 (20 Spanish)Postpartum survey pilot N = 21 (5 Spanish)Content validity/cognitive debriefing N = 10 (2 Spanish)
Site name (target group)nSite name (target group)nSite name (target group)nSite name (target group)n
San Judas Clinic (Spanish speakers)8BirthSwell (online)16Birthswell (online)12Pasadena Black Infant Health Program (Hispanic and African American women)4
Pasadena Black Infant Health Program (Hispanic women)4The Association for Wholistic Maternal and Newborn Health (homebirth/birth center)4Birthswell (online Spanish)5BirthSwell (online)4
Pasadena Black Infant Health Program (African American women)12Pasadena Black Infant Health Program (Hispanic and African American women)5Cedars-Sinai Medical Center (mixed group)4BirthSwell (online Spanish)2
New Life Midwifery (homebirth/birth center)5Cedars-Sinai Medical Center (mixed group)5
Beanie Birth (homebirth/birth center)3BirthSwell (online Spanish)15
Harbor UCLA (Medicaid)4Pasadena Black Infant Health Program (Spanish)5
Cedars-Sinai Medical Center (mixed group)6
USC Perinatal Group (Asian women)3

Abbreviations: UCLA, University of California Los Angeles; USC, University of Southern California.

Table 3Initial Domains and Subdomains Identified Through Literature Review and Focus Groups, and the Number of Items per Domain

Domains N = 19Subdomains N = 58Total items (N = 5902)
Clinical concerns Provider competence; safety; preterm labor; intrapartum complications; indication for cesarean delivery; maternal and newborn clinical outcomes; additional maternal or neonatal hospitalization259
Communication Communication with providers regarding labor and delivery, and regarding newborn181
Confidence Confidence, self-efficacy109
Continuity Continuity of care, care coordination; provider availability96
Decision-making Decision-making and birth plans; maternal control395
Empathy Cultural competence; discrimination; provider empathy; provider support; respect, privacy219
Feeding newborn Breastfeeding, bottle feeding249
Interventions in labor Labor interventions; food and drink in labor157
Labor management Hospital admission; labor management; labor and birth positions244
Location of delivery Birth environment; childbirth location; provider type257
Mental health Anxiety, fear, worry; depression; maternal psychological issues970
Newborn Newborn, newborn care; neonatal intensive care unit; nursery environment355
Pain assessment Labor pain assessment; labor pain expectations131
Pain management Cesarean delivery anesthesia; epidural; labor pain management505
Parenting Family impact; fetal attachment; parental concerns192
Postpartum Postpartum care; postpartum environment; postpartum long-term issues; postpartum work intention353
Route of delivery Route of delivery; vacuum, forceps; vaginal birth after cesarean; cesarean delivery anxiety497
Summary measures Cesarean delivery experience; negative experience; overall experience303
Support Labor social support; labor teaching; nursing support; partner support430

Table 4Frequency of 37 Predisposing Conditions in the National Sample

CharacteristicTotal (weighted), N = 2218, No. (%)
Age, y N = 2218
 18-24546 (24.7)
 25-29581 (26.2)
 30-34733 (33.1)
 35-39292 (13.2)
 40-5462 (2.8)
Race/ethnicity N = 2218
 Asian81 (3.7)
 Black425 (19.2)
 Hispanic383 (17.3)
 Other100 (4.5)
 White1229 (55.4)
Highest education level N = 2218
 High school or less784 (35.4)
 Some college674 (30.4)
 College 4 y or more760 (34.2)
Incomea N = 2084
 <$15 000556 (26.7)
 $15 000 to <$35 000680 (32.6)
 $35 000 to <$75 000503 (24.1)
 ≥$75 000346 (16.6)
Delivery category N = 2218
 Multiparous without prior CD1149 (51.8)
 Multiparous with prior CD395 (17.8)
 Nulliparous674 (30.4)
Gestational age ≥34 wk N = 2218
 Yes664 (29.9)
Pregnant with more than 1 baby N = 2218
 Yes178 (8.0)
Use of infertility treatment for this pregnancy N = 2213
 Yes218 (9.9)
Intentional pregnancy N = 2107
 Yes1438 (68.2)
First prenatal care visit in first trimester N = 2199
 Yes1745 (79.4)
Body mass index (from prepregnancy weight and height) N = 2198
 Underweight (<18.5)173 (7.9)
 Normal (18.5-24.9)1073 (48.8)
 Overweight (25.0-29.9)549 (25.0)
 Obese (≥30.0)403 (18.4)
Rating of overall health during pregnancy as poor/fair N = 2215
 Yes130 (5.9)
Rating of mental/emotional health during pregnancy as poor/fair N = 2215
 Yes296 (13.4)
Pregnancy complicationsb N = 2179
 Yes901 (41.4)
Currently has a spouse or partner N = 2218
 Yes2056 (92.7)
Having immediate help or social support if needed N = 2128
 Yes1975 (92.8)
Having negative memories from a previous labor or birth N = 2217
 Somewhat to strongly agree554 (25.0)
Having anybody repress, degrade, or humiliate them over a long period of time N = 2215
 Yes (abuse 1)648 (29.3)
Having anybody threatening to hurt them or someone close to them N = 2211
 Yes (abuse 2)550 (29.4)
Having anybody trying to physically abuse them N = 2212
Yes (abuse 3) 543 (24.6)
Having anybody trying to force them into sexual actions N = 2216
 Yes (abuse 4)476 (21.5)
Abuse aggregate (any of abuse 1, 2, 3, or 4) N = 2205
 Yes887 (40.2)
Having personally experienced discrimination (experienced discrimination)d N = 2189
Yes605 (27.7)
High confidence in the birth process (high confidence)e N = 2170
 Yes1497 (69.0)
Very to extremely confident filling out medical/health paperwork by oneself N = 2217
 Yes1721 (77.6)
Feeling pressure from the provider, family, or friends to have a cesarean birth N = 2085
 Yes346 (16.6)
Public health insurance N = 2098
 Yes998 (47.6)
Need to travel ≥30 min from home to deliver N = 2131
 Yes619 (29.0)
Person who will deliver baby N = 2161
 Family practitioner275 (12.7)
 Midwife251 (11.6)
 Obstetrician1475 (68.3)
 Partner159 (7.4)
Need for an interpreter N = 2182
 Yes149 (6.8)
Anticipated coping with labor pain N = 1973
 Very well to extremely well751 (38.0)
Feeling that giving birth is being in a very helpless condition N = 2211
 Somewhat to strongly agree732 (33.1)
Feeling that it is better not to know in advance about the processes of giving birth N = 2213
 Somewhat to strongly agree477 (21.5)
Worried about the birth N = 2217
 Yes1353 (61.0)
Will be making a birth plan N = 2215
 Yes1203 (54.3)
Planning tubal sterilization N = 1707
 Yes314 (18.4)
US generation N = 2183
 Neither respondent or parent born in US167 (7.7)
 Respondent but not parent born in US191 (8.8)
 Both respondent and parent born in US1824 (83.6)
US region N = 2218
 East397 (17.9)
 Midwest464 (20.9)
 South840 (37.9)
 West518 (23.3)
Religion—none or atheist N = 2211
 Yes411 (18.6)
Heterosexual N = 2212
 Yes2025 (91.6)
Survey taken in Spanish N = 2218
 Yes23 (1.0)

Abbreviation: CD, cesarean delivery.

aThe unweighted number of participants was 2250.

b2014 household income before taxes, in dollars.

cAn aggregate variable defined as having 1 or more of the following: a preexisting or chronic maternal condition, a gestational condition, a high-risk pregnancy, or a problem with the fetus.

dA factor combining 6 items that asked whether the respondent had ever experienced discrimination because of race, culture, finances, insurance, gender, or disability (Likert scale 1 = “not at all” to 5 = “very much”; α = .89). “Yes” was defined as a factor-based score ≥2.

eA factor combining the following 8 items: (1) “I feel confident in protecting my own interests during pregnancy and childbirth”; (2) “I know where to get information regarding childbirth options”; (3) “I want to be in charge of planning my care”; (4) “Giving birth is a powerful experience”; (5) “My job as a mother is to make sure my baby is born healthy”; (6) “I believe I will be in control”; (7) “I expect my childbirth will go smoothly”; and (8) “Childbirth is a safe experience for the mother” (Likert scale 1 = “strongly disagree” to 5 = “strongly agree”; α = .76). “Yes” was defined as a factor-based score ≥4.

Table 5Results of Multiple Logistic Regression Models for Women Considering Having a Vaginal Delivery, by Domain (Total N, Weighted = 2218; all Ns Are Weighted)

V&P itemPredictors: predisposing conditions with a positive association (more likely to want V&P item)Predictors: predisposing conditions with a negative association (less likely to want V&P item)
Labor management
Want labor tub/ball/stool (factor)a
  •  Yes: 1174/2091 (56.1%)
  •  C statistic: 0.728
  •  Maximum pseudo-R2 = 0.235
  • Intentional pregnancy
  • Having a birth plan
  • Experienced discrimination (factor)b
  • Feeling pressure to have a cesarean birth
  • Underweight
  • Heterosexual
  • Provider = obstetrician
Want to avoid interventions in labor (factor)c
  •  Yes: 589/2168 (27.2%)
  •  C statistic: 0.664
  •  Maximum pseudo-R2 = 0.112
  • High confidence (factor)d
  • Negative memories of previous birth
  • Experienced discrimination (factor)
  • Anticipate coping well with pain
  • Oldest age stratum
  • Multiparous without prior CD
Want to avoid continuous electronic fetal monitoring
  •  Yes: 873/2213 (39.5%)
  •  C statistic: 0.717
  •  Maximum pseudo-R2 = 0.218
  • Oldest age stratum
  • Multiparous with prior CD
  • High confidence (factor)
  • Confident filling out medical/health forms
  • Feeling pressure to have a cesarean birth
  • Lack of childbirth preparatione
  • Pregnancy complicationsf
  • White race
  • Respondent and parents not born in United States
Important to eat/drink during labor
  •  Yes: 1239/2211 (56.0%)
  •  C statistic: 0.657
  •  Maximum pseudo-R2 = 0.152
  • Older gestational age (≥34 wk)
  • High confidence (factor)
  • Feeling pressure to have a cesarean birth
  • Anticipate coping well with pain
  • Feeling helplessg
  • Lack of childbirth preparation
  • Obese
Important to use shower
  •  Yes: 1319/2202 (59.9%)
  •  C statistic: 0.680
  •  Maximum pseudo-R2 = 0.160
  • Having a birth plan
  • High confidence (factor)
  • Feeling pressure to have a cesarean birth
  • Anticipate coping well with pain
  • Lack of childbirth preparation
  • White or Asian race
Important to use massage
  •  Yes: 863/1972 (43.8%)
  •  C statistic: 0.712
  •  Maximum pseudo-R2 = 0.209
  • Black or Hispanic race
  • Older gestational age (≥34 wk)
  • Having a birth plan
  • High confidence (factor)
  • Negative memories of a previous birth
  • Feeling pressure to have a cesarean birth
  • Anticipate coping well with pain
  • Planning to have a support person during labor
  • Lack of childbirth preparation
  • Multiparous without prior CD
Want to be on back for delivery
  •  Yes: 1201/2212 (54.3%)
  •  C statistic: 0.681
  •  Maximum pseudo-R2 = 0.165
  • Women with some college (compared with college graduates)
  • Multiparous without prior CD
  • Planning to have a support person during labor
  • Lack of childbirth preparation
  • Belief that childbirth is safe for mother
  • Public insurance
  • Negative memories of a prior birth
  • Experienced sexual abuse
  • Experienced discrimination (factor)
  • Travel ≥30 min from home
  • Provider = midwife (compared with obstetrician)
Want choice of labor position
  •  Yes: 1272/2205 (57.7%)
  •  C statistic: 0.671
  •  Maximum pseudo-R2 = 0.127
  • Oldest age stratum
  • Having a birth plan
  • High confidence (factor)
  • Feeling pressure to have a cesarean birth
  • Anticipate coping well with pain
  • Lack of childbirth preparation
  • Delivery route uncertain
Continuity of care
Want to know deliverer
  •  Yes: 1822/2198 (82.9%)
  •  C statistic: 0.684
  •  Maximum pseudo-R2 = 0.144
  • Having a birth plan
  • High confidence (factor)
  • Planning to have a support person during labor
  • Anticipate coping well with pain
  • Provider = midwife (compared with obstetrician)
Want to know pediatrician
  •  Yes: 1388/2138 (64.9%)
  •  C statistic: 0.697
  •  Maximum pseudo-R2 = 0.168
  • All multiparous (compared with nulliparous)
  • Having a birth plan
  • Having immediate help/social support
  • High confidence (factor)
  • Anticipate coping well with pain
  • Lack of childbirth preparation
  • Provider = midwife (compared with obstetrician)
Communication and decision-making
Plan to leave choices to providerh
  •  Yes: 519/2211 (23.5%)
  •  Maybe: 486/2211 (22.0%)
  •  No: 1207/2211 (54.6%)
  •  Maximum pseudo-R2 = 0.323
  • Asian race (both yes and maybe groups)
  • Hispanic race (yes group but not maybe group)
  • Other race (maybe group but not yes group)
  • Feeling helpless (yes group but not maybe group)
  • Lack of childbirth preparation (yes group but not maybe group)
  • Family practice doctor (compared with obstetrician) (both groups)
  • Need interpreter (yes group but not maybe group)
  • College graduate less likely (maybe group but not yes group)
  • Some college (maybe group but not yes group)
  • First-trimester prenatal care (yes group but not maybe group)
  • High confidence (factor) (maybe group but not yes group)
  • Planning to have a support person during labor (yes group but not maybe group)
Will talk with family before making decisionsh
  •  Yes: 1661/2212 (75.1%)
  •  Maybe: 350/2212 (15.8%)
  •  No: 201/2212 (9.1%)
  •  Maximum pseudo-R2 = 0.223
  • High confidence (factor) (yes group but not maybe group)
  • Partner is supportive (yes group but not maybe group)
  • Planning to have a support person during labor (yes group but not maybe group)
  • Worry regarding birth (no group versus maybe group)
  • Lack of childbirth preparation (both groups)
  • Family practice doctor (compared with obstetrician) (maybe group but not yes group)
  • None
Will refuse treatment believed not necessary
  •  Yes: 1349/2212 (61.0%)
  •  C statistic: 0.699
  •  Maximum pseudo-R2 = 0.189
  • College graduate
  • Negative memories of previous birth
  • High confidence (factor)
  • Confident filling out medical/health forms
  • Experienced threats of abuse
  • Feeling pressure to have a cesarean birth
  • Lack of childbirth preparation
  • Provider = family practice doctor
  • (compared with obstetrician)
Empathy/respect
Important to be respected for spiritual/cultural beliefs
  •  Yes: 1451/2208 (65.7%)
  •  C statistic: 0.687
  •  Maximum pseudo-R2 = 0.164
  • Youngest stratum
  • Black race
  • Western region
  • Having a birth plan
  • High confidence (factor)
  • Anticipate coping well with pain
  • Lack of childbirth preparation
  • Heterosexual
  • No religion or atheist
Important to have reassurance/comfort from nurse
  •  Yes: 1898/1976 (96.1%)
  •  C statistic: 0.694
  •  Maximum pseudo-R2 = 0.139
  • First-trimester prenatal care
  • High confidence (factor)
  • Confident filling out medical/health forms
  • Worry regarding birth
  • None
Important to give support person adequate space and food
  •  Yes: 1652/2058 (82.3%)
  •  C statistic: 0.662
  •  Maximum pseudo-R2 = 0.110
  • Pregnancy complications
  • High confidence (factor)
  • Confident filling out medical/health forms
  • Partner not supportive
Important to have female provider
  •  Yes: 1437/1941 (74.0%)
  •  C statistic: 0.700
  •  Maximum pseudo-R2 = 0.162
  • Intentional pregnancy
  • Having a birth plan
  • Feeling pressure to have a cesarean birth
  • Feeling helpless
  • Lack of childbirth preparation
  • Provider = midwife (compared with obstetrician)
  • No religion or atheist
  • High confidence (factor)
Want choices in the environment (factor)i
  •  Yes: 1707/2198 (77.7%)
  •  C statistic: 0.731
  •  Maximum pseudo-R2 = 0.224
  • Some college (compared with high school only)
  • First-trimester prenatal care
  • High confidence (factor)
  • Confident filling out medical/health forms
  • Planning to have a support person during labor
  • Anticipate coping well with pain
  • Experienced humiliation
  • Heterosexual
  • Provider = family practice doctor
  • (compared with obstetrician)
Feeding
Breast-milk feeding
  •  Yes: 1883/2139 (88.0%)
  •  C statistic: 0.730
  •  Maximum pseudo-R2 = 0.158
  • College graduate
  • Nulliparous
  • Asian race
  • First-trimester prenatal care
  • Need interpreter
  • Oldest age stratum
  • US regions: South and East regions (compared with West)
  • Lack of childbirth preparation
Important to have practical support for feeding
  •  Yes: 1553/2209 (70.3%)
  •  C statistic: 0.663
  •  Maximum pseudo-R2 = 0.116
  • Nulliparous
  • High confidence (factor)
  • Partner supportive
  • Confident filling out medical/health forms
  • Feeling pressure to have a cesarean birth
  • Worry regarding birth
  • None
Breastfeeding encouragementh
  •  Too little: 180/2204 (8.2%)
  •  Just right: 1759/2204 (79.8%)
  •  Too much: 265/2204 (12.0%)
  •  Maximum pseudo-R2 = 0.224
  • Multiparous with prior CD (compared with nulliparous) (too much group only)
  • Pregnancy complications (too much group only)
  • Report overall health as poor/fair (too little group only)
  • Travel ≥30 min (too much group only)
  • Having immediate help/social support (too little group only)
  • Experienced discrimination (factor) (too much group only)
  • Experienced threats (too little group only)
  • Having a birth plan (too much group only)
  • Feeling helpless (too much group only)
  • Lack of childbirth preparation (too much group only)
  • None
Newborn
Important to have skin-to-skin placement of newborn
  •  Yes: 1556/2211 (70.4%)
  •  C statistic: 0.674
  •  Maximum pseudo-R2 = 0.115
  • Having a birth plan
  • High confidence (factor)
  • Confident filling out medical/health forms
  • Anticipate coping well with pain
  • None
Important for baby to stay with mother
  •  Yes: 2004/2216 (90.4%)
  •  C statistic: 0.788
  •  Maximum pseudo-R2 = 0.264
  • White race
  • High confidence (factor)
  • Confident filling out medical/health forms
  • Planning to have a support person during labor
  • Older gestational age (≥34 wk)
  • Feeling pressure to have a cesarean birth
  • Highest income stratum
  • Need interpreter
Communication regarding newborn (factor)j
  •  Yes: 903/2162 (41.8%)
  •  C statistic: 0.740
  •  Maximum pseudo-R2 = 0.235
  • Older age stratum
  • Some college (compared with high school)
  • Nulliparous
  • Having a birth plan
  • High confidence (factor)
  • Feeling pressure to have a cesarean birth
  • Planning to have a support person during labor
  • Worried about birth
  • Lack of childbirth preparation
  • White race (compared with Asians, Blacks, and Hispanics)
  • Provider = midwife (compared with obstetrician)
Pain management
Important to have pain option: massage
  •  Yes: 1340/2215 (60.5%)
  •  C statistic: 0.649
  •  Maximum pseudo-R2 = 0.118
  • Nulliparous
  • Older gestational age (≥34 wk)
  • First-trimester prenatal care
  • Having a birth plan
  • High confidence (factor)
  • Having immediate help/social support
  • Experienced discrimination (factor)
  • Worry regarding birth
  • Oldest age stratum
Important to have pain option: walking
  •  Yes: 1405/2218 (63.4%)
  •  C statistic: 0.647
  •  Maximum pseudo-R2 = 0.115
  • Having a birth plan
  • High confidence (factor)
  • Anticipate coping well with pain
  • Multiparous
  • Lack of childbirth preparation
Important to have pain option: breathing techniques
  •  Yes: 1354/2213 (61.2%)
  •  C statistic: 0.630
  •  Maximum pseudo-R2 = 0.088
  • Oldest age stratum
  • College graduate
  • Nulliparous
  • First-trimester prenatal care
  • Having immediate help/social support
  • Having a birth plan
  • Lack of childbirth preparation
  • Feeling pressure to have a cesarean birth
Important to have pain option: shower/tub
  •  Yes: 937/2161 (43.4%)
  •  C statistic: 0.645
  •  Maximum pseudo-R2 = 0.090
  • Nulliparous
  • Pregnancy complications
  • First-trimester prenatal care
  • High confidence (factor)
  • Planning to have a support person during labor
  • Provider = midwife (compared with obstetrician)
  • Lack of childbirth preparation
Important to have pain option: mental strategies
  •  Yes: 885/2218 (39.9%)
  •  C statistic: 0.644
  •  Maximum pseudo-R2 = 0.128
  • Any college
  • Nulliparous
  • Older gestational age (≥34 wk)
  • High confidence (factor)
  • Experienced sexual abuse
  • Lack of childbirth preparation
  • Provider = family practice doctor (compared with obstetrician)
Important to have pain option: narcotics
  •  Yes: 535/2175 (24.6%)
  •  C statistic: 0.660
  •  Maximum pseudo-R2 = 0.122
  • Pregnancy complications
  • White race
  • Experienced threats
  • Worry regarding birth
  • Feeling helpless
  • US region: South (compared with West)
  • Having a birth plan
  • Anticipate coping well with pain
Important to have pain option: epidural
  •  Yes: 1144/1921 (59.6%)
  •  C statistic: 0.732
  •  Maximum pseudo-R2 = 0.226
  • White race
  • US region: South
  • Supportive partner (compared with no partner)
  • Confident filling out medical/health forms
  • Worry regarding birth
  • Provider = obstetrician (compared with other providers)
  • Heterosexual
  • Having a birth plan
  • Feeling pressure to have a cesarean birth
  • Anticipate coping well with pain
Important to have pain option: nitrous oxide
  •  Yes: 212/2218 (9.6%)
  •  C statistic: 0.689
  •  Maximum pseudo-R2 = 0.108
  • Nulliparous
  • Multiple gestation
  • Feeling helpless
  • Anticipate coping well with pain
  • Lack of childbirth preparation
  • Heterosexual
Important to have pain option: TENS
  •  Yes: 159/2218 (7.2%)
  •  C statistic: 0.654
  •  Maximum pseudo-R2 = 0.096
  • Nulliparous
  • Multiple gestation
  • Experienced sexual abuse
  • Worry regarding birth
  • None
Important to have pain option: acupuncture
  •  Yes: 143/2215 (6.5%)
  •  C statistic: 0.686
  •  Maximum pseudo-R2 = 0.102
  • Provider = midwife (compared with obstetrician)
  • Public insurance
Postpartum concerns
Important to have tubal sterilization
  •  Yes: 314/1706 (18.4%)
  •  C statistic: 0.812
  •  Maximum pseudo-R2 = 0.359
  • Any college (compared with high school only)
  • Hispanic or other race (compared with White)
  • Experience of threats of abuse
  • Feeling pressure to have a cesarean birth
  • Feeling helpless
  • Public insurance
  • Need for interpreter
  • Lower age stratum
  • Nulliparous
Important to have length of stay postpartum >48 h
  •  Yes: 574/2213 (25.9%)
  •  C statistic: 0.590
  •  Maximum pseudo-R2 = 0.044
  • Multiparous with prior CD (compared with nulliparous)
  • Complicated pregnancy
  • US region: Midwest or South (compared with West)
  • No religion or atheist
Support
Important to have partner/support person in the room
  •  Yes: 1960/2090k (93.8%)
  •  C statistic: 0.789
  •  Maximum pseudo-R2 = 0.247
  • First-trimester prenatal care
  • High confidence (factor)
  • Uncertain delivery route
  • Experienced discrimination (factor)

Abbreviations: CD, cesarean delivery; PRO, patient-reported outcome; TENS, transcutaneous electrical nerve stimulation; V&P, values and preferences.

aA factor combining 3 items that asked whether the respondent believed these resources were important.

bA factor combining 6 items that asked whether the respondent had ever experienced discrimination because of race, culture, finances, insurance, gender, or disability (Likert scale 1 = “not at all” to 5 = “very much”; α = .89). “Yes” was defined as a factor-based score ≥ 2.

cA factor combining answers to the following items with respect to the desire to avoid them: induction, Pitocin augmentation, intravenous line, episiotomy, cesarean, and vacuum/forceps delivery (Likert scale 1 = “strongly disagree” to 5 = “strongly agree”; α = .80). “Yes” was defined as a factor-based score ≥4.

dA factor combining the following 8 items: (1) “I feel confident in protecting my own interests during pregnancy and childbirth”;(2) “I know where to get information regarding childbirth options”; (3) “I want to be in charge of planning my care”; (4) “Giving birth is a powerful experience”; (5) “My job as a mother is to make sure my baby is born healthy”; (6) “I believe I will be in control”; (7) “I expect my childbirth will go smoothly”; and (8) “Childbirth is a safe experience for the mother” (Likert scale 1 = “strongly disagree” to 5 = “strongly agree”; α = .76. “Yes” was defined as a factor-based score ≥4.

eThis variable is derived from agreement with the statement, “It is better not to know in advance about the processes of giving birth.”

fAn aggregate variable defined as having 1 or more of the following: a preexisting or chronic maternal condition, a gestational condition, a high-risk pregnancy, or a problem with the fetus.

gThis variable is derived from agreement with the statement, “Giving birth is being in a very helpless condition.”

hThree V&P remained as 3-level variables.

iA factor combining the following items: ability to walk during labor, choose labor/delivery position, have a private room, have a choice of who is in the room during procedures, be involved in decisions about labor pain management, and be reassured by the doctor or midwife (Likert scale 1 = “not at all important” to 5 = “extremely important”; α = .72. “Yes” was defined as a factor-based score ≥4.

jA factor combining the following items: be debriefed regarding events of labor and delivery; be debriefed regarding feelings during labor and delivery; be given information regarding where the baby sleeps, baby sleep position, vaccines, and day-to-day care; and be given breastfeeding and bottle-feeding information (Likert scale 1 = “not at all important” to 5 = “extremely important”; α = .89. “Yes” was defined as a factor-based score ≥4.

kOf 72 participants missing, 59 stated that they did not have a partner.

Table 6Frequencies of Key Predisposing Conditions in the Postpartum Population and Their Association With Women's Satisfaction With Hospital Childbirth Services (N [Unweighted] = 500)

CharacteristicHospital satisfaction ≥9 No. (%)P value
Age (n = 500), y .9515
 18-24 (n = 97; 19.4%)56 (57.7%)
 25-29 (n = 187; 37.4%)110 (58.8%)
 30-34 (n = 149; 29.8%)91 (61.1%)
 35-39 (n = 49; 9.8%)29 (59.2%)
 40-54 (n = 18; 3.6%)12 (66.7%)
Race/ethnicity (n = 500) .1430
 Asian (n = 28; 5.6%)19 (67.9%)
 Black (n = 31; 6.2%)17 (54.8%)
 Hispanic (n = 74; 14.8%)35 (47.3%)
 White (n = 354; 70.8%)7 (53.8%)
 Other (n = 13; 2.6%)220 (62.1%)
Education (n = 500) .6961
 High school or less (n = 88; 17.6%)56 (63.6%)
 Some college (n = 157; 31.4%)92 (58.6%)
 College graduate or more (n = 255; 51.0%)150 (58.8%)
Multiple gestation (n = 500) .7797
 Yes (n = 77; 15.4%)47 (61.0%)
 No (n = 423; 84.6%)251 (59.3%)
Delivery category (n = 500) .8409
 Multiparous without prior CD (n = 279; 55.8%)166 (55.7%)
 Multiparous with prior CD (n = 72; 14.4%)41 (13.8%)
 Nulliparous (n = 149; 29.8%)91 (30.5%)
US region (n = 500) .7194
 East (n = 70; 14.0%)45 (64.3%)
 Midwest (n = 126; 25.2%)71 (56.3%)
 South (n = 193; 38.6%)114 (59.1%)
 West (n = 111; 22.2%)68 (61.3%)
Public insurance (n = 478) .3591
 Yes (n = 150; 31.4%)94 (62.7%)
 No (n = 328; 68.6%)191 (58.2%)
Pregnancy complicationsa (AP and PP) (n = 500) .6921
 Yes (n = 257; 51.4%)151 (58.8%)
 No (n = 243; 48.6%)147 (60.5%)
Overall health poor/fair (AP) (n = 500) .0068
 Yes (n = 35; 7.0%)13 (37.1%)
 No (n = 465; 93.0%)285 (61.3%)
Overall mental health poor/fair (AP) (n = 500) .0003
 Yes (n = 56; 11.2%)21 (37.5%)
 No (n = 444; 88.8%)277 (62.4%)
High confidenceb (n = 489) .0019
 Yes (n = 342; 69.9%)219 (64.0%)
 No (n = 147; 30.1%)72 (49.0%)
Confident filling out medical/health forms (n = 498) .0177
 Yes (n = 397; 79.7%)248 (62.5%)
 No (n = 101; 20.3%)50 (49.5%)
Experienced discriminationc (n = 497) .0780
 Yes (n = 79; 15.9%)40 (50.6%)
 No (n = 418; 84.1%)256 (61.2%)
Has immediate help (n = 489) .0504
 Yes (n = 457; 93.5%)280 (61.3%)
 No (n = 32; 6.5%)14 (43.8%)
Negative memories of a prior birth (n = 500) .0844
 Yes (114; 22.8%)60 (52.6%)
 No (386; 77.2%)238 (61.7%)
Most days in last year have been stressful (n = 500) .0788
 Yes (n = 109; 21.8%)57 (52.3%)
 No (n = 391; 61.6%)241 (61.6%)
Worry about the birth (n = 500) .0192
 Yes (n = 321; 64.2%)179 (55.8%)
 No (n = 179; 35.8%)119 (66.5%)

Abbreviations: AP, antepartum; CD, cesarean delivery; PP, postpartum.

aAn aggregate variable defined as having 1 or more of the following: a preexisting or chronic maternal condition, a gestational condition, a high-risk pregnancy, or a problem with the fetus.

bA factor combining the following 8 items: (1) “I feel confident in protecting my own interests during pregnancy and childbirth”; (2) “I know where to get information regarding childbirth options”; (3) “I want to be in charge of planning my care”; (4) “Giving birth is a powerful experience”; (5) “My job as a mother is to make sure my baby is born healthy”; (6) “I believe I will be in control”; (7) “I expect my childbirth will go smoothly”; and (8) “Childbirth is a safe experience for the mother” (Likert scale 1 = “strongly disagree” to 5 = “strongly agree”; α = .76). “Yes” was defined as a factor-based score ≥4.

cA factor combining 6 items that asked whether the respondent had ever experienced discrimination because of race, culture, finances, insurance, gender, or disability (Likert scale 1 = “not at all” to 5 = “very much”; α = .89). “Yes” was defined as a factor-based score >2.

Table 7V&P, PROs, and Gap Data Statistically Significantly Associated With Women's Satisfaction With Hospital Childbirth Services; N (unweighted) = 500a

CharacteristicCrude hospital satisfaction ≥9, No. (%)P valueAdjusted hospital satisfaction ≥9, % (95% CI)OR (95% CI)P value
V&P Items
Want partner/support person in the room (n = 481)b .0036.0162
 Yes (n = 465; 96.7%)285 (61.3%)61.6 (56.9-66.0)4.39 (1.31-14.6)
 No (n = 16; 3.3%)4 (25.0%)26.7 (10.0-54.5)REF
Gap Data
Gap wanted and got massage (n = 500) .0173.0079
 Yes (n = 96; 19.2%)68 (70.8%)71.1 (58.6-81.0)2.00 (1.20-3.32)
 No (n = 404; 80.8%)230 (57.1%)55.2 (44.3-65.6)REF
Gap wanted and got pain treatment: massage (n = 500) .0033.0079
 Yes (n = 80; 16.0%)60 (75.0%)77.3 (64.3-86.6)2.62 (1.48-4.63)
 No (n = 420; 84.0%)238 (56.7%)56.5 (46.1-66.4)REF
Gap wanted and got shower/tub (n = 500) .0753.0327
 Yes (n = 36; 7.2%)27 (75.0%)77.6 (59.3-89.1)2.42 (1.08-5.43)
 No (n = 464; 92.8%)271 (58.4%)58.8 (48.6-68.3)REF
Gap wanted but did not get narcotics (n = 500) .0510.0464
 Yes (n = 74; 14.8%)36 (48.6%)49.1 (34.5-63.9)0.59 (0.36-0.99)
 No (n = 426; 85.2%)262 (61.5%)61.9 (51.7-71.1)REF
Gap wanted but did not get to be involved in decisions regarding labor pain (N = 498) .0001.0008
 Yes (n = 38; 7.6%)11 (28.9%)31.8 (17.2-51.2)0.27 (0.13-0.58)
 No (n = 460; 92.4%)286 (62.2%)63.4 (53.3-72.5)REF
PROs
PP nurse comfort (n = 498) .0023.0401
 Yes (n = 486; 97.6%)294 (60.5%)60.5 (56.0-64.9)5.34 (1.08-26.5)
 No (n = 12; 2.4%)2 (16.7%)22.3 (5.5-58.4)REF
PP pain treatment massage (n = 500) .0089.0024
 Yes (n = 103; 20.6%)73 (70.9%)73.5 (64.0-81.3)2.15 (1.31-3.54)
 No (n = 396; 79.4%)225 (56.7%)56.3 (51.2-61.3)REF
PP coped well with labor pain (n = 499) .0004.0013
 Not well or moderately well (n = 289; 57.9%)153 (52.9%)53.4 (47.4-59.3)REF 1.91 (1.29-2.83)
 Very to extremely well (n = 210; n = 42.1%)144 (68.6%)68.6 (61.7-74.8)
PP pain relief during labor inadequate (n = 500) .0008.0007
 Yes (n = 86; 17.2%)37 (43.0%)42.7 (32.4-53.6)0.43 (0.26-0.70)
 No (n = 413; 82.8%)261 (63.2%)63.5 (58.6-68.1)REF
PP doula in room (n = 500) .1345.0428
 Yes (n = 38; 7.6%)27 (71.1%)67.1 (59.8-87.2)2.26 (1.03-4.97)
 No (n = 265; 92.4%)271 (58.7%)58.5 (53.8-63.1)REF
PP had choice of who was in the room (n = 500) .0025.0050
 Yes (n = 440; 88.0%)273 (62.0%)62.3 (57.6-66.9)2.30 (1.28-4.10)
 No (n = 60; 12.0%)25 (41.7%)41.9 (29.6-55.3)REF
PP had assistance with positions (n = 500) .0001.0002
 Yes (n = 396; 79.2%)253 (63.9%)64.3 (59.3-69.0)2.38 (1.51-3.76)
 No (n = 104; 20.8%)45 (43.3%)43.1 (33.6-53.1)REF
PP continuous electronic fetal monitoring (n = 500) .0054.0164
 Yes (n = 408; 81.6%)255 (62.5%)62.5 (57.6-67.2)1.79 (1.11-2.87)
 No (n = 92; 18.4%)43 (46.7%)48.3 (37.9-58.8)REF
PP involved in decisions regarding labor pain management (n = 500) .0003.0021
 Yes (n = 446; 89.2%)278 (62.3%)62.5 (57.7-67.0)2.69 (1.43-5.05)
 No (n = 54; 10.8%)20 (37.0%)38.3 (25.5-52.9)REF
PP adequate space and food for support person (n = 494) <.0001<.0001
 Yes (n = 446; 89.2%)272 (64.0%)64.3 (59.5-68.8)3.60 (2.06-6.28)
 No (n = 54; 10.8%)23 (33.3%)33.4 (23.0-45.6)REF
PP adequate space and food for support person (n = 494) <.0001<.0001
 Yes (n = 425; 86.0%)272 (64.0%)64.3 (59.5-68.8)3.60 (2.06-6.28)
 No (n = 69; 14.0%)23 (33.3%)33.4 (23.0-45.6)REF
PP used birthing stool (n = 494) .2360.0139
 Yes (n = 30; 6.1%)21 (70.0%)81.5 (64.6-91.4)3.12 (1.26-7.74)
 No (n = 464; 93.9%)274 (59.1%)58.5 (53.8-63.1)REF
PP told about progress in labor (n = 499) <.0001<.0001
 Yes (n = 436; 87.4%)275 (63.1%)63.5 (58.7-68.0)3.31 (1.86-5.88)
 No (n = 63; 12.6%)22 (34.9%)34.6 (23.5-47.4)REF
PP satisfied with support person (n = 495) .0008.0044
 Yes (n = 455; 91.9%)282 (62.0%)62.1 (57.4-66.5)2.78 (1.38-5.63)
 No (n = 40; 8.1%)14 (35.0%)37.0 (23.0-53.6)REF
PP debriefed regarding events of labor (n = 498) <.0001.0002
 Yes (n = 310; 62.2%)207 (66.8%)66.5 (56.0-75.4)2.09 (1.41-3.08)
 No (n = 188; 37.8%)90 (47.9%)48.6 (36.8-60.5)REF
PP debriefed regarding patient's feelings (n = 500) .0002.0005
 Yes (n = 268; 53.6%)180 (67.2%)67.3 (61.3-72.8)1.96 (1.34-2.86)
 No (n = 232; 46.4%)118 (50.9%)51.3 (44.6-57.9)REF
PP newborn placed skin to skin (n = 500) .0116.0148
 Yes (n = 383; 76.6%)240 (62.7%)63.0 (57.9-67.9)1.74 (1.11-2.71)
 No (n = 117; 23.4%)58 (49.6%)49.5 (40.1-59.0)REF
PP given breastfeeding info within 24 h (n = 499) .0145.0177
 Yes (n = 462; 92.6%)282 (61.0%)61.4 (56.7-65.9)2.39 (1.16-4.90)
 No (n = 37; 7.4%)15 (40.5%)40.0 (25.1-57.1)REF
PP breastfeeding encouragement from provider (n = 499) .0001.0005
 Just right (n = 408; 81.8%)261 (64.0%)64.2 (59.3-68.8)REF
 Too little (n = 44; 8.8%)15 (34.1%)35.1 (21.9-51.0)0.31 (0.15-0.60).0007
 Too much (n = 47; 9.4%)22 (46.8%)46.3 (32.2-61.1)0.48 (0.25-0.91).0245
PP got practical support feeding baby (n = 497) <.0001<.0001
 Yes (n = 423; 85.1%)275 (65.0%)65.5 (60.7-70.0)4.30 (2.48-7.47)
 No (n = 74; 14.9%)23 (31.1%)30.6 (21.0-42.3)REF
PP received info regarding newborn daily care (n = 500) .0513.0316
 Yes (n = 436; 87.2%)267 (61.2%)61.8 (57.0-66.4)1.84 (1.06-3.20)
 No (N = 64; 12.8%)31 (48.4%)46.9 (34.6-59.6)REF
PP received info regarding vaccines (n = 498) .0005.0004
 Yes (n = 388; 77.9%)248 (63.9%)64.5 (59.5-69.3)2.26 (1.44-3.54)
 No (n = 110; 22.1%)50 (45.5%)44.6 (35.3-54.3)REF
PP received info regarding newborn's sleep position (n = 500) .0036.0072
 Yes (n = 435; 87.0%)270 (62.1%)62.3 (57.5-66.9)2.14 (1.23-3.73)
 No (n = 65; 13.0%)28 (43.1%)43.6 (31.6-56.5)REF
PP comfortable holding baby (n = 496) .1136.1894
 Yes (n = 458; 92.3%)277 (60.5%)60.7 (56.0-65.2)1.61 (0.79-3.28)
 No (n = 38; 7.7%)18 (47.4%)48.9 (32.6-65.4)REF
PP felt safe holding baby (n = 477) .0079.0050
 Yes (n = 431; 90.4%)270 (62.6%)63.3 (63.1-72.5)2.19 (1.27-3.77)
 No (n = 46; 9.6%)19 (41.3%)44.1 (29.9-59.4)REF
PP length of stay <24 h (n = 500) .0137.0176
 Yes (n = 40; 8.0%)16 (40.0%)40.9 (26.3-57.3)0.43 (0.22-0.86)
 No (n = 460; 92.0%)282 (61.3%)61.5 (56.9-66.0)REF
PP tubal sterilization (n = 498) .0457.0281
 Yes (n = 34; 6.8%)26 (76.5%)79.9 (62.7-90.4)2.71 (1.11-6.59).0283
 Planned but not donec (n = 32; 6.4%)15 (46.9%)46.5 (29.3-64.7)0.59 (0.27-1.28).1838
 No (n = 432; 86.8%)257 (59.5%)59.5 (54.7-64.2)REF
Childbirth-specific High-level Variables
PP staff respected spiritual/cultural needs (n = 500) <.0001<.0001
 Yes (n = 390; 78.0%)258 (66.2%)65.9 (60.9-70.6)3.16 (1.98-5.02)
 No (n = 110; 22.0%)40 (36.4%)38.0 (29.0-47.9)REF
PP childbirth went smoothly (n = 500) <.0001<.0001
 Yes (n = 391; 78.2%)254 (65.0%)65.0 (60.0-69.7)2.61 (1.65-4.13)
 No (n = 109; 21.8%)44 (40.4%)41.6 (32.3-51.5)
PP felt safe (n = 500) <.0001<.0001
 Yes (n = 444; 88.8%)282 (63.5%)63.8 (59.0-68.2)4.27 (2.24-8.13)
 No (n = 56; 11.2%)16 (28.6%)29.2 (18.3-43.1)
PP left choices to provider (n = 500) .0001<.0001
 Yes (n = 187; 37.4%)132 (70.6%)70.5 (59.8-79.4)2.31 (1.54-3.47)
 No (n = 313; 62.6%)166 (53.0%)50.9 (39.7-61.9)REF
Gap wanted to stay in control but didn't (n = 499) <.0001<.0001
 Yes (n = 53; 10.6%)17 (32.1%)34.5 (21.1-50.8)0.28 (0.15-0.53)
 No (n = 446; 89.4%)280 (94.3%)65.0 (54.8-74.0)REF
PP lost control (n = 498) .0443.0382
 Yes (n = 125; 25.1%)65 (52.0%)51.7 (42.6-60.7)0.64 (0.41-0.98)
 No (n = 373; 74.9%)232 (62.2%)62.7 (57.5-67.7)REF
PP believed to be in control (n = 500) <.0001<.0001
 Yes (n = 397; 79.4%)256 (64.5%)64.8 (59.8-69.5)2.65 (1.66-5.23)
 No (n = 103; 20.6%)42 (40.8%)41.0 (31.5-51.2)REF
PP got reassurance from the provider (n = 500) .0002.0003
 Yes (n = 455; 91.0%)283 (62.2%)62.7 (58.0-67.1)3.47 (1.78-6.79)
 No (n = 45; 9.0%)15 (33.3%)32.6 (20.3-47.8)REF
Wanted but did not get reassurance from the provider (n = 499) .0002.0002
 Yes (n = 39; 7.8%)12 (30.8%)29.2 (15.6-48.0)0.25 (0.12-0.52)
 No (n = 460; 92.2%)286 (62.2%)62.3 (62.2-71.4)REF
Nonspecific high-level variables
HCAHPS nurse showed respect top boxd <.0001<.0001
 Yes (381; 76.7%)267 (70.1%)70.8 (65.9-75.3)7.31 (1.50-2.48)
 No (116; 23.3%)30 (25.9%)24.9 (17.8-33.8)REF
HCAHPS doctor showed respect top boxd <.0001<.0001
 Yes (388; 78.2%)268 (69.1%)69.6 (64.8-74.1)6.80 (4.13-11.18)
 No (108; 21.8%)28 (25.9%)25.2 (17.8-34.4)REF
HCAHPS doctor explained top boxd <.0001<.0001
 Yes (359; 71.9%)252 (70.2%)70.6 (65.5-75.2)5.10 (3.29-7.92)
 No (140; 28.1%)45 (32.1%)31.9 (24.5-40.4)REF
Knew how to care for self and newborn at discharge <.0001.0001
 Yes (469; 94.0%)296 (63.1%)63.5 (58.9-67.8)55.42(7.23-424.9)
 No (30; 6.0%)1 (3.3%)3.0 (0.4-19.2)REF
PP saw doctor enough (n = 496) <.0001<.0001
 Yes (n = 303)211 (69.6%)70.2 (64.6-75.2)3.11 (2.10-4.60)
 No (n = 193)84 (43.3%)43.1 (36.1-50.4)REF
PP saw RN enough (n = 497) <.0001<.0001
 Yes (n = 440)277 (62.8%)63.3 (58.6-67.8)3.76 (2.02-6.99)
 No (n = 57)19 (33.3%)31.5 (20.4-45.2)REF
PP no one explained what was happening (n = 499) <.0001<.0001
 Yes (n = 106)43 (40.6%)40.1 (30.8-50.2)0.36 (0.22-0.57)
 No (n = 393)255 (64.7%)65.2 (60.2-69.9)REF
PP could not question providers (n = 499) <.0001<.0001
 Yes (n = 61)18 (29.5%)29.9 (19.4-43.1)0.24 (0.13-0.44)
 No (n = 438)280 (63.8%)64.0 (59.3-68.5)REF
PP felt providers ignored them (n = 498) <.0001<.0001
 Yes (n = 57)19 (33.3%)32.3 (21.1-46.1)0.27 (0.15-0.51)
 No (n = 441)279 (63.1%)63.6 (58.8-68.1)REF
PP staff was compassionate (n = 497) <.0001<.0001
 Yes (n = 441)286 (64.7%)64.9 (60.2-69.3)7.34 (3.59-15.00)
 No (n = 56)11 (19.6%)20.1 (11.3-33.3)REF
PP staff was pleasant (n = 497) <.0001<.0001
 Yes (n = 458)287 (62.5%)62.9 (58.3-67.4)5.09 (2.34-11.05)
 No (n = 39)10 (25.6%)25.0 (13.7-41.3)REF

Abbreviations: HCAHPS, Hospital Consumer Assessment of Healthcare Providers and Systems; OR, odds ratio; PP, postpartum; PRO, patient-reported outcome; REF, reference; RN, registered nurse; V&P, values and preferences.

aResults are adjusted for maternal age, education level, race/ethnicity, US region, delivery category, pregnancy complications, overall health, and overall mental health.

bOf 19 participants with missing data, 8 stated they had no partner.

cWomen who planned for a tubal sterilization and got it were more likely than those who planned for it and did not have it to be satisfied with the hospital: OR = 4.58 (95% CI, 1.48-14.14); P = .0082.

d“Top box” refers to the most positive response to HCAHPS survey items.

Table 8Clinical variables and women's satisfaction with hospital childbirth servicesa

CharacteristicCrude hospital satisfaction ≥9, N (%)P valueAdjusted hospital satisfaction ≥9, % (95% CI)OR (95% CI)P value
PP transfusion (n = 500) .6349.8345
 Yes (n = 19; 3.8%)10 (52.6%)57.4 (33.6-78.2)0.90 (0.33-2.44)
 No (n = 481; 96.2%)288 (59.9%)60.0 (55.4-64.4)REF
PP maternal intensive care unit (n = 497) .6062.5286
 Yes (n = 15; 3.0%)8 (53.3%)51.6 (26.8-75.5)0.71 (0.24-2.09)
 No (n = 482; 97.0%)288 (59.8%)60.1 (55.6-64.5)REF
PP neonatal intensive care unit (n = 496) .9122.8499
 Yes (n = 58; 11.7%)35 (60.3%)58.8 (45.0-71.3)0.94 (0.52-1.71)
 No (n = 438; 88.3%)261 (59.6%)60.1 (55.3-64.8)REF
PP healthy normal baby (n = 500) .0146.0575
 Yes (n = 407; 81.4%)253 (62.2%)62.0 (57.0-66.8)1.60 (0.99-2.61)
 No (n = 93; 18.6%)45 (48.4%)50.5 (39.8-61.1)REF
PP baby home with mom (N = 494) .6215.4559
 Yes (n = 448; 90.7%)270 (60.3%)60.8 (56.1-65.3)1.28 (0.67-2.45)
 No (n = 46; 9.3%)26 (56.5%)54.8 (39.6-69.1)REF
PP baby length of stay >3 d (n = 498) .2126.1078
 Yes (n = 69; 13.9%)46 (66.7%)69.5 (57.1-79.6)1.61 (0.91-2.86)
 No (n = 429; 86.1%)252 (58.7%)58.7 (53.8-63.4)REF
PP readmission baby (n = 490) .0587.0730
 Yes (n = 43; 8.8%)20 (46.5%)6.4 (31.2-62.3)0.54 (0.27-1.06)
 No (n = 447; 91.2%)274 (61.3%)61.7 (57.0-66.3)REF
PP admit to delivery time over 24 h (n = 500) .1417.0927
 Yes (n = 60; 12.0%)41 (68.3%)70.5 (57.2-81.1)1.70 (0.92-3.15)
 No n = (440; 88.0%)257 (58.4%)58.5 (53.7-63.1)REF
PP readmission mother (n = 497) .4601.5480
 Yes (n = 44; 8.9%)24 (54.5%)55.5 (39.7-70.3)0.81 (0.41-1.60)
 No (n = 453; 91.1%)273 (60.3%)60.5 (55.8-65.1)REF
CD (n = 500) .0344.0785
 Yes (n = 58; 11.6%)42 (72.4%)71.5 (57.7-82.2)1.79 (0.94-3.41)
 No (n = 442; 88.4%)256 (57.9%)58.4 (53.5-63.1)REF
Gap expect vaginal birth (n = 467) .0240.0710
 Wanted but did not get (n = 49; 10.5%)37 (75.5%)74.0 (58.9-85.0)1.95 (0.95-4.00)
 Wanted and got (n = 418; 89.5%)246 (58.9%)59.4 (54.5-64.2)REF
Unknown delivery route .0866.2180
 Yes (n = 33; 6.6%)15 (45.5%)48.7 (31.1-66.7)0.62 (0.28-1.33)
 No (n = 467; 93.4%)283 (60.6%)60.7 (56.0-65.2)REF

Abbreviations: CD, cesarean delivery; OR, odds ratio; PP, postpartum; REF, reference.

aResults are adjusted for maternal age, education level, race/ethnicity, US region, delivery category, pregnancy complications, overall health, and overall mental health.

Table 9Multiple Logistic Regression Model Results for Women's Satisfaction With Hospital Childbirth Services Using Predisposing Conditions Only (N = 489 With C Statistic = 0.637)a

VariableOR (95% CI)P value
Age (ref = 40-54 y), y .8847
 18-240.79 (0.25-2.55)
 25-290.85 (0.28-2.61)
 30-340.94 (0.30-2.94)
 35-390.66 (0.19-2.25)
Education level (ref = some college) .5626
 High school or less1.21 (0.68-2.17)
 College graduate or more0.89 (0.57-1.39)
Race (ref = White) .1736
 Asian1.29 (0.52-3.17)
 Black0.72 (0.33-1.59)
 Hispanic0.51 (0.29-0.90)
 Other0.78 (0.24-2.52)
Region (ref = West) .3466
 East0.95 (0.48-1.86)
 Midwest0.62 (0.35-1.10)
 South0.76 (0.46-1.28)
Delivery category (ref = nulliparous) .5717
 Multiparous without prior CD0.83 (0.53-1.30)
 Multiparous with prior CD0.73 (0.39-1.37)
 Multiple gestation1.21 (0.68-2.16).5206
Pregnancy complications 1.15 (0.77-1.73).5007
Overall health poor/fair 0.50 (0.22-1.16).0896
Overall mental health poor/fair 0.46 (0.24-0.88).0198
High confidence (factor)b 1.72 (1.14-2.60).0103

Abbreviations: CD, cesarean delivery; ref, reference.

aResults are adjusted for the following 9 forced covariates: (1) maternal age, (2) race/ethnicity, (3) education level, (4) multiple gestation, (5) delivery category (combination of multiparity and prior CD), (6) US region, (7) complicated pregnancy (based on a positive response to either the antepartum or postpartum items regarding clinical risk), (8) antepartum overall health, and (9) antepartum mental/emotional health.

bA factor combining the following 8 items: (1) “I feel confident in protecting my own interests during pregnancy and childbirth”; (2) “I know where to get information regarding childbirth options”; (3) “I want to be in charge of planning my care”; (4) “Giving birth is a powerful experience”; (5) “My job as a mother is to make sure my baby is born healthy”; (6) “I believe I will be in control”; (7) “I expect my childbirth will go smoothly”; and (8) “Childbirth is a safe experience for the mother” (Likert scale 1 = “strongly disagree” to 5 = “strongly agree”; α = .76). “Yes” was defined as a factor-based score ≥4.

Table 10Final List of Items That Were Eligible for the Model of Women's Satisfaction With Hospital Childbirth Services (in Addition to the 9 Forced Covariates)

Item typeAssociation with satisfactionItem
Predisposing condition PositiveHigh confidence (factor)a
Patient-reported values and preferences PositiveWanted partner in the room
Gap variables PositiveWanted and got massage; wanted and got pain treatment massage; received pain treatment massage
PositiveWanted and got to use shower/tub
NegativeWanted but did not get narcotics
NegativeWanted to be but was not involved in decisions regarding labor pain management or involved in decisions regarding labor pain management
Patient-reported outcome PositiveReceived reassurance/comfort from nurse
PositiveCoped well with labor pain or Pain relief in labor was adequate
PositiveDoula was in the room
PositiveHad a choice of who was in the room
PositiveHad assistance with positions
PositiveHad continuous electronic fetal monitoring
PositiveAdequate space/food for support person
PositiveUsed birthing stool
PositiveWas told about progress in labor
PositiveSatisfied with support person
PositiveDebriefed regarding events of labor
PositiveDebriefed regarding patient's feelings postpartum
PositiveNewborn placed skin to skin immediately after birth
PositiveGiven breastfeeding information within 24 h
NegativeHad too much breastfeeding encouragement from provider
PositiveGot practical support about feeding the baby
PositiveReceived information regarding newborn daily care
PositiveReceived information regarding vaccines
PositiveReceived information regarding newborn sleep position
PositiveFelt comfortable holding the baby
PositiveFelt safe holding the baby
NegativePlanned but did not get tubal sterilization
NegativeShort postpartum hospital stay
Childbirth-specific high-level variables PositiveFelt spiritual and cultural needs were respected
PositiveFelt that the childbirth went smoothly
PositiveFelt safe
PositiveLeft all choices to the provider
PositiveFelt in control or anticipated being in control or gap anticipated being in control but was not (negative)
PositiveFelt reassured by her provider
Nonspecific high-level variables PositiveNurses treated respondent with courtesy and respect
PositiveDoctors treated respondent with courtesy and respect
PositiveDoctors explained things in a way respondent could understand
PositiveKnew how to care for self and baby at discharge
PositiveSaw doctor/midwife enough
PositiveSaw nurse enough
NegativeThere were times when no one explained what was happening
NegativeFelt I could not question providers
NegativeFelt ignored by providers
PositiveStaff was compassionate
PositiveStaff was pleasant

aA factor combining the following 8 items: (1) “I feel confident in protecting my own interests during pregnancy and childbirth”; (2) “I know where to get information regarding childbirth options”; (3) “I want to be in charge of planning my care”; (4) “Giving birth is a powerful experience”; (5) “My job as a mother is to make sure my baby is born healthy”; (6) “I believe I will be in control”; (7) “I expect my childbirth will go smoothly”; and (8) “Childbirth is a safe experience for the mother” (Likert scale 1 = “strongly disagree” to 5 = “strongly agree”; α = .76). “Yes” was defined as a factor-based score ≥4.

Table 11Model for Predictors of Women's Satisfaction With Hospital Childbirth Services, Including Childbirth-specifica and Nonspecificb High-level Items (N = 479 With C Statistic = 0.845)

VariableOR (95% CI)P value
Age (ref = 40-54), y .9578
 18-240.52 (0.09-2.90).4531
 25-290.55 (0.10-2.86).4727
 30-340.58 (0.11-3.11).5268
 35-390.97 (0.55-1.68).4763
Education (ref = some college) .5855
 College graduate or more0.97 (0.55-1.68).8988
 High school or less1.41 (0.57-2.98).3620
Race (ref = White) .7785
 Asian1.30 (0.44-3.86).6333
 Black0.81 (0.27-2.43).7053
 Hispanic0.65 (0.31-1.36).2503
 Other0.75 (0.12-4.80).7634
Region (ref = West) .2340
 East1.03 (0.43-2.44).9494
 Midwest0.53 (0.26-1.07).0760
 South0.80 (0.42-1.52).4929
Delivery category (ref = nulliparous) .2537
 Multiparous without prior CD0.67 (0.38-1.19).1682
 Multiparous with prior CD0.54 (0.24-1.23).1407
Multiple gestation 0.88 (0.40-1.92).7411
Perceived health problem (composite) 1.64 (0.97-2.77).0634
Overall health poor/fair 0.50 (0.18-1.40).1870
Overall mental health poor/fair 0.33 (0.14-0.79).0124
PP used birthing stool 5.47 (1.33-22.55).0186
Gap wanted got massage 2.74 (1.32-5.68).0069
Respondent knew how to care for self and baby at discharge 17.64 (1.98-157.48).0102
Felt providers ignored me 0.28 (0.11-0.74).0099
Staff compassionate 6.12 (2.49-15.09)<.0001
HCAHPS nurse respect 4.02 (2.17-7.45)<.0001
HCAHPS doctor explained 2.59 (1.50-4.45).0006
Staff respected spiritual and cultural needs 2.50 (1.39-4.48).0022
Left choices to provider 2.32 (1.37-3.92).0018

Abbreviations: CD, cesarean delivery; HCAHPS, Hospital Consumer Assessment of Healthcare Providers and Systems; OR, odds ratio; PP, postpartum; ref = reference.

aChildbirth-specific high-level items: (1) The respondent felt that staff respected her spiritual and cultural needs; (2) the respondent felt the childbirth went smoothly; (3) the respondent felt safe; (4) the respondent left all choices to her provider; the respondent felt in control; and (6) the respondent was reassured by her provider.

bNonspecific high-level items: (1) The respondent felt that she was treated by nurses with courtesy and respect; (2) the respondent felt that she was treated by doctors/midwives with courtesy and respect; (3) the respondent felt that the doctor/midwife explained things in a way she could understand; (4) the respondent knew how to care for herself and baby upon discharge; (5) the respondent saw the doctor/midwife enough; (6) the respondent saw the nurses enough; (7) the respondent felt that staff did not always explain what was happening; (8) the respondent felt that she could not question providers; (9) the respondent felt ignored by providers; (10) the respondent felt staff was compassionate; and (11) the respondent felt staff was pleasant.

Table 12Model for Predictors of Women's Satisfaction With Hospital Childbirth Servicesa

VariableOR (95% CI)P value
Age (ref = 40-54), y .5656
 18-240.29 (0.07-1.27).1010
 25-290.31 (0.07-1.28).1048
 30-340.34 (0.08-1.46).1468
 35-390.31 (0.07-1.43).1319
Education (ref = some college) .3837
 College plus0.77 (0.46-1.27).3006
 High school or less1.16 (0.59-2.28).6632
Race (ref = White) .6003
 Asian1.00 (0.38-2.60).9969
 Black0.58 (0.22-1.52).2662
 Hispanic0.65 (0.34-1.24).1916
 Other0.75 (0.19-3.02).6873
Region (ref = West) .4757
 East0.90 (0.42-1.93).7903
 Midwest0.62 (0.33-1.16).1319
 South0.79 (0.44-1.40).4162
 VariableOR (95% CI)P Value
Delivery category (ref = nulliparous) .3616
 Multiparous without prior CD1.01 (0.61-1.66).9851
 Multiparous with prior CD0.63 (0.31-1.30).2134
Multiple gestation 0.83 (0.43-1.61).5788
Perceived health problem (composite) 1.18 (0.76-1.85).4630
Overall health poor/fair 0.77 (0.32-1.88).5645
Overall mental health poor/fair 0.45 (0.21-0.96).0384
PP coped well with labor pain 1.71 (1.09-2.71).0207
PP continuous electronic fetal monitoring 2.40 (1.38-4.19).0021|
PP adequate space/food for support person 2.26 (1.20-4.23).0113
PP debriefed regarding events during labor 1.91 (1.22-2.99).0050
PP practical support feeding newborn 3.32 (1.76-6.26).0002
PP told about progress in labor 2.56 (1.29-5.07).0071
Gap wanted got massage 1.97 (1.05-3.17).0369
Wanted partner/support person in the room 5.56 (1.12-27.71).0364

Abbreviations: CD, cesarean delivery; OR, odds ratio; PP, postpartum; ref, reference.

aThis model has excluded high-level items. N = 465 with C statistic = 0.762. Childbirth-specific high-level items: (1) The respondent felt that staff respected her spiritual and cultural needs; (2) the respondent felt the childbirth went smoothly; (3) the respondent felt safe; (4) the respondent left all choices to her provider; (5) the respondent felt in control; and (6) the respondent was reassured by her provider. Nonspecific high-level items: (1) The respondent felt that she was treated by nurses with courtesy and respect; (2) the respondent felt that she was treated by doctors/midwives with courtesy and respect; (3) the respondent felt that the doctor/midwife explained things in a way she could understand; (4) the respondent knew how to care for herself and baby upon discharge; (5) the respondent saw the doctor/midwife enough; (6) the respondent saw the nurses enough; (7) the respondent felt that staff did not always explain what was happening; (8) the respondent felt that she could not question providers; (9) the respondent felt ignored by providers; (10) the respondent felt staff was compassionate; and (11) the respondent felt staff was pleasant.

Table 13Framework for Childbirth V&P, PROs, and Predisposing Conditions

V&P/PRO itemsAntepartum survey question No.Postpartum survey question No.
DomainSubdomainV&P/PRO itema
Location Location1. Where do you expect to deliver (hospital, freestanding birth center, home)/where did you deliver?1A. Q5401P. Q1115
Route of delivery Route of delivery anticipated2. How do you expect to give birth (vaginal versus cesarean delivery)/how did you give birth?2A. Q510
Labor management Want tub/ball/stool (factor)3. Important/got to use labor tub
4. Important/got to use birth ball
5. Important/got to use birth stool
3A. Q655_1
4A. Q655_2
5A. Q655_3
3P. Q1410_1
4P. Q1410_2
5P. Q1410_3
Want to avoid interventions (factor)6. Important/got to avoid induction
7. Important/got to avoid IV
8. Important/got to avoid Pitocin augmentation
9. Important/got to avoid cesarean
10. Important/got to avoid vacuum/forceps delivery
11. Important/got to avoid episiotomy
6A. Q630_1
7A. Q630_2
8A. Q630_3
9A. Q630_4
10A. Q630_5
11A. Q630_7
6P. Q1350
7P. Q1355
8P. Q1360
9P. Q1365
10P. Q1370
11P. Q1380
Want to avoid continuous monitoring12. Important/got to avoid continuous electronic fetal monitoring12A. Q630_612P. Q1375
Other labor concerns13. Important/got to use massage
14. Important/got to use shower during labor
15. Important/got to eat/drink during labor
13A. Q625_2
14A. Q625_3
15A. Q625_5
13P. Q1295_2
14P. Q1295_3
15P. Q1295_5
Labor and birth position16. Want to deliver/delivered while lying on back
17. Important/got to choose labor/delivery position
16A. Q665
17A. Q670
16P. Q1435_1
17P. Q1440
Hospital admission processNo current items
Continuity of care Familiar with providers18. Important to know/knew doctor in advance
19. Important to know/knew midwife in advance
20. Important to know/knew pediatrician in advance
18A. Q575_1
19A. Q575_2
20A. Q575_3
18P. Q1263
19P. Q1270
20P. Q1260
Communication and decision-making Decision-making21. Plan to leave/left choices to provider
22. Will talk/talked with family before making decisions
23. Will refuse/refused treatment believed not necessary
21A. Q690_5
22A. Q690_6
23A. Q690_7
21P. Q1225_3
 
23P. Q1235
Follow birth plan24. Postpartum: followed birth plan
25. Postpartum: birth went as expected
26. Postpartum: childbirth went smoothly
24P. Q1245
25P. Q1655
26P. Q1225_1
Staff communication27. Important to have/got debriefing regarding labor events
28. Important to have/got debriefing regarding feelings
29. Postpartum: saw doctor/midwife enough
30. Postpartum: saw nurse enough
31. Postpartum: no one explained what was happening
32. Postpartum: could not question providers
33. Postpartum: felt ignored by providers
34. Postpartum: staff was pleasant
35. Postpartum: doctor explained so respondent could understand
36. Postpartum: told about progress in labor
27A. Q720_1
28A. Q720_2
 
28P. Q1565
29P. Q1490_1
30P. Q1490_2
31P. Q1615_2
32P. Q1615_3
33P. Q1615_4
34P. Q1485
35P. Q1630
36P. Q1335
Empathy and respect Cultural competence37. Important to have/got staff respect for spiritual beliefs/culture37A. Q435_137P. Q1205
Empathy and respect Empathy38. Important to have/got reassurance from nurse
39. Postpartum: staff was compassionate
38A. Q620_238P. Q1290_2
39P. Q1480
Respect40. Important to have/got adequate space/food for support person
41. Important to have/got female provider
42. Postpartum: nurse treated respondent with courtesy and respect
43. Postpartum: doctor treated respondent with courtesy and respect
40A. Q615
41A. Q435_2
40P. Q1505
41P. Q1210
42P. Q1620
43P. Q1625
Want choices in the environment44. Important/got to walk around during labor
45. Important/got to have a private room
46. Important/got to have choice of who is in the room during procedures/exams
47. Important/got to have providers help with positions/methods of delivery
48. Important/got to be involved in decisions re: pain
49. Important/got to have reassurance from doctor/midwife
44A. Q625_1
45A. Q625_4
46A. Q625_6

47A. Q625_7
48A. Q660

49A. Q620
44P. Q1295_1
45P. Q1295_4
46P. Q1295_6

47P. Q1295_7

48P. Q1390
49P. Q1290
Feeding Feeding type50. Plan/was able to breastfeed, bottle-feed breast milk, bottle-feed formula50A. Q72550P. Q1575
Practical support51. Important to have/got practical support for feeding
52. Important to have/got information regarding breastfeeding within 24 h
53. Important to have/got information regarding bottle feeding within 24 h
51A. Q740
52A. Q735_1

53A. Q735_2
51P. Q1595
52P. Q1580_1

53P. Q1580_2
Encouragement54. Important to have/got encouragement for breastfeeding54A. Q73054P. Q1590
Newborn Immediate care55. Important to have/got to have baby placed skin to skin immediately after birth55A. Q70555P. Q1510
Rooming in56. Important to have/got to have baby stay in room with mother56A. Q71056P. Q1529
Nursery or neonatal intensive care unit environmentNo current items
Newborn care57. Important to have/got information regarding day-to-day care of newborn
58. Important to have/got information regarding vaccines
59. Important to have/got information regarding baby's sleep position
60. Important to have/got information regarding baby's sleep location
57A. Q715_1

58A. Q715_2
59A. Q715_3

60A. Q715_4
Pain management Options for labor61. Consider use of/got massage
62. Consider use of/got walking
63. Consider use of/got to use breathing techniques
64. Consider use of/ got to use shower/tub
65. Consider use of/got to use mental strategies
66. Consider use of/got narcotics
67. Consider use of/got epidural
68. Consider use of/got nitrous oxide gas
69. Consider use of/got to use TENS unit
70. Consider use of/got acupuncture/acupressure
61A. Q650_1
62A. Q650_2
63A. Q650_3
64A. Q650_4
65A. Q650_5
66A. Q650_6
67A. Q650_7
68A. Q650_8
69A. Q650_9
70A. Q650_10
61P. Q1400_1
62P. Q1400_2
63P. Q1400_3
64P. Q1400_4
65P. Q1400_5
66P. Q1400_6
67P. Q1400_7
68P. Q1400_8
69P. Q1400_9
70P. Q1400_10
Options for cesarean birthNo current items
PostpartumNo current items
Postpartum care Postpartum environmentNo current items
Postpartum care71. Important to have/got tubal sterilization
72. Important to have/got hospital stay >48 h
73. Postpartum: needed more time in the hospital
74. Postpartum: knew how to care for self and baby at discharge
71A. Q750
72A. Q745
71P. Q1610
72P. Q1508
73P. Q1555
74P. Q1645
Support Social support partner75. Important to have/got to have spouse/partner in room75A. Q610_175P. Q1275_1
Social support children76. Important to have/got to have other children in room76A. Q610_276P. Q1275_3
Social support other family77. Important to have/got to have other family in room77A. Q610_577P. Q1275_5
Social support friends78. Important to have/got to have friends in room78A. Q610_378P. Q1275_4
Doula79. Important to have/got to have doula in room79A. Q610_479P. Q1275_2
Clinical concerns Maternal/neonatal childbirth complications80. Emergency cesarean
81. Emergency cesarean reason why
82. Forceps/vacuum delivery
83. Maternal: blood transfusion
84. Maternal: intensive care unit
85. Newborn: neonatal intensive care unit, transfer out
86. Newborn: healthy/normal baby
87. Newborn: home with mother
80P. Q1160
81P. Q1165
82P. Q1340_4
83P. Q1420
84P. Q1425
85P. Q1430
86P. Q1560
87P. Q1545
Maternal/neonatal readmission88. Maternal readmission
89. Newborn readmission
88P. Q1608
89P. Q1609
Provider competenceNo current items
Safety90. Felt safe during delivery
91. Felt safe when first held baby
92. Felt comfortable when first held baby
90P. Q1225_2
91P. Q1527
92P. Q1525
Summary measures Satisfaction with birth93. Summary score 1-1093P. Q1650
Summary measures Satisfaction with hospital94. Summary score 1-1094P. Q1635
Loyalty to hospital95. Summary score recommend/return 1-495P. Q1640
Pain assessment Intrapartum96. Postpartum: pain relief during labor inadequate
97. Postpartum: coped well with labor pain
98. Postpartum: lost control
96P. Q1470_2
97P. Q1385
98P. Q1495
During cesarean birth99. Postpartum: pain-free during cesarean99P. Q1450_5
Postpartum100. Pain during first 24 h was unbearable/severe100P. Q1455
Parenting Family impactNo current items
Fetal attachmentNo current items
Parental concernsNo current items
Predisposing conditions (tested antepartum)
DomainItemsAntepartum survey question No.
Maternal demographics1. US region
2. Maternal age
3. Race/ethnicity: Asian, Black, Hispanic, White, other (includes mixed race)
4. Education: less than or equal to high school, some college, college graduate
5. Income: 2014 household income before taxes, categorized as <$15 000, $15 000-<$35 000, $35 000-<$75 000, >$75 000
6. Acculturation: US generation: born in US, parents born in US
7. Religion: categorized as none/atheist versus other
8. Insurance: public versus private
1.
2.
3.
4.
5.

6.
7.
8.
Q318
Q125
Q135
Q434
Q462

810
Q830
Q542
Previous birth experience9. No. of prior births: multiparity
10. Prior cesarean delivery, number of prior cesareans
11. Prior labor
12. History of infertility
9.
10.
11.
12.
Q145
310
Q140
Q530_11
Gestational age at time of survey13. Calculated from due date13.Q150
Body mass index14. Calculated from height and prepregnancy weight14.Q345/Q340
Provider type15. Planned provider: obstetrician, family practitioner, midwife, other15.Q570
Distance from hospital16. Need to travel >30 min to reach hospital16.Q560
Mental health17. Rates overall mental/emotional health as poor/fair
18. Agrees that during the past year, most days were not stressful to very stressful
19. Has negative memories from a previous labor/birth
20. Worries about pain in labor
21. Worries about giving birth
17.
18.
19.
20.
21.
Q360
Q420
Q415_5
Q680_1
Q680_3
Self-rated health22. Rates overall health as poor/fair22.Q360_1
Self-reported clinical risk23. Has a preexisting medical condition
24. Has a pregnancy-related medical condition (eg, hypertension, diabetes)
25. Told that pregnancy was high risk
26. Told that had a problem with the baby
27. Has a multiple gestation
28. Had prenatal care in first trimester
23.
24.
25.
26.
27.
28.
Q365
Q370
Q375
Q380
Q315
Q335
Literacy29. Confident filling out medical forms
30. Need for an interpreter
29.
30.
Q440
Q685
Intentional pregnancy31. Choose answer: Wanting to be pregnant: sooner, later, not at all, or at time of pregnancy discovery31.Q330
High confidence (factor)Agrees with the following items:
32. I can figure out how/where to get the information I need.
33. I want to be in charge of planning my care during childbirth.
34. Giving birth is a powerful experience.
35. I believe I will be in control.
36. I Expect my childbirth to go smoothly.
37. It is my job as a mother to make sure my baby is born healthy.
38. Childbirth is a safe experience for the mother.

32.
33.
34.
35.
36.
37.
38.

Q415_4
Q415_6
Q690_2
Q690_8
Q690_9
Q690_4
Q690_10
Birth plan39. Will be completing a birth plan39.Q415
Childbirth preparedness40. Agrees that it is better not to know in advance re: processes of giving birth40.Q690_3
Locus of control41. Agrees that giving birth is being in a very helpless condition41.Q690_1
Partnered42. Has a spouse/partner
43. Plans to have a support person for labor/birth
44. Spouse/partner/support person is supportive of pregnancy
42.
43.
44.
Q405
Q605
Q415_1
Heterosexual45. Identifies as heterosexual45.Q835
Social support46. Has immediate help available if needed it46.Q410
History of abuseHas experienced the following types of abuse:
47. Humiliation over a long period
48. Threats of harm
49. Physical
50. Sexual

47.
48.
49.
50.

Q425_1
Q425_2
Q425_3
Q425_4
Experienced discrimination (factor)Factor-based score including experiencing discrimination in each of the following areas:
51. Race/ethnicity
52. Cultural background/language
53. Sexual/gender orientation
54. Physical disability
55. Finances
56. Health insurance

51.
52.
53.
54.
55.
56.

Q430_1
Q430_2
Q430_3
Q430_4
Q430_5
Q430_6
Feeling pressure to have a cesarean57. From provider
58. From family
59. From friends
57.
58.
59.
Q505_1
Q505-_
Q505_3
Able to cope with pain60. Anticipate coping well with labor pain60.Q643_1

Abbreviations: IV, intravenous; PROs, patient-reported outcomes; TENS, transcutaneous electrical nerve stimulation; V&P, values and preferences.

Note: The sentence structure of V&P items would be appropriate for antepartum administration and the structure of PRO items would be appropriate for postpartum administration. The predisposing conditions would be appropriate for antepartum administration.

aSome of the domains or subdomains state “no current items.” This occurred because, although potential items were identified through literature and focus groups, and the domain was felt to be important by the Childbirth Patient-reported Outcomes Partnership, during the current effort, the Partnership viewed these areas as less important to develop and include in the national survey.

Table 14Key Items Needed for Collection in Childbirth Experiences and Outcomes Survey

AntepartumPostpartumAdditional variables needed for adjustmentHigh-level variables that were key predictors of women's satisfaction with hospital childbirth services
Mental health poor/fairReceived reassurance/comfort from nurseaMaternal ageKnew how to care for self/newborn at discharge
High confidenceCoped well with labor painaMaternal race/ethnicityFelt providers ignored me
Want partner in the roomaDoula was in the roomaMaternal education levelStaff was compassionate
Gap wanted and got massage treatment for painaHad a choice of who was in the roomaMultiple gestationStaff was pleasant
Had assistance with positionsaDelivery category: nulliparous, multiparous no prior cesarean, multiparous with prior cesareanSaw doctor/midwife enough
Had continuous electronic fetal monitoringaUS region (if applicable)Saw nurse enough
Adequate space/food for support personaPregnancy complicationsCould not question providers
Used birthing stoolaNurses treated me with respect
Was told about progress in laboraDoctors explained things to me
Satisfied with support personStaff respected spiritual and cultural needs
Debriefed regarding events of laboraCould leave choices to provider (trust)
Debriefed regarding patient's feelings postpartuma
Newborn placed skin to skin immediately after birtha
Was given breastfeeding information within 24 ha
Had too much breastfeeding encouragement from providera
Got practical support feeding the babya
Received information regarding newborn daily carea
Received information regarding vaccinesa
Received information regarding newborn sleep positiona
Felt comfortable holding the baby
Planned but did not get tubal sterilizationa
Short postpartum hospital staya

aPotentially actionable items.

Table 15Study Limitations and Future Mitigation Efforts

LimitationPotential mitigation
The narrowed scope that includes only the immediate childbirth experience in the hospitalRepeat these efforts in the pregnant or postpartum population.
The lack of power to model V&P/PROs for women who anticipate cesarean delivery or out-of-hospital birthsRecruit in these less prevalent populations.
The potential for recruitment bias using national online panelsRecruit in multiple hospitals.
The difficulty in recruiting women both antepartum and postpartum (Time 1-Time 2 study)Offer incentives within the hospital environment, or focus subsequent efforts on either survey but not both.
The low participation of Spanish-speaking womenRecruit in multiple hospitals.
The inability to include women who speak other languagesIncrease funding to develop and test the survey materials in other languages, and in hospitals where women who speak these languages routinely deliver.
The relatively affluent nature of the sampleRecruit in multiple hospitals.
The inability to explore birth satisfaction and other satisfaction summary measures fullyPlace further attention to these end points in multiple hospitals.
The inability to further explore satisfaction with newborn care, particularly for women whose newborns had clinical problemsExpand efforts to focus specifically on newborn health.
Limited power to explore the impact of clinical conditions or complications on hospital satisfactionEnhance efforts designed to link self-reports of clinical risk and complications to the EMR.

Abbreviation: EMR, electronic medical record; PROs, patient-reported outcomes; V&P, values and preferences.

Institution: Cedars-Sinai Medical Center
Original Project Title: Expanding PROMIS Item Bank Development to the Pregnant Population
PCORI ID: ME-1402-10249

Suggested citation:

Gregory KD, Korst LM, Fridman K, et al. (2019). Developing an Item Bank of Survey Questions to Measure Women's Experiences with Childbirth in Hospitals. Patient-Centered Outcomes Research Institute (PCORI). https://doi.org/10.25302/3.2019.ME.140210249

Disclaimer

The [views, statements, opinions] presented in this report are solely the responsibility of the author(s) and do not necessarily represent the views of the Patient-Centered Outcomes Research Institute® (PCORI®), its Board of Governors or Methodology Committee.

Copyright © 2019. Cedars-Sinai Medical Center. All Rights Reserved.

This book is distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs License which permits noncommercial use and distribution provided the original author(s) and source are credited. (See https://creativecommons.org/licenses/by-nc-nd/4.0/

Bookshelf ID: NBK594804PMID: 37721986DOI: 10.25302/3.2019.ME.140210249