The Next Frontier: ROI Evaluation in International Student Recruitment
Megha Roy and Zhengrong Lu, Research Associates, WES
In the coming decade, institutions of higher education across the U.S. will face two realities now reshaping the enrollment landscape. On the one hand, global demand for international higher education is projected to nearly triple to 8 million students by 2025. On the other hand, a drop in domestic enrollment has already made international student recruitment a financial priority.
In this environment, international student recruitment is becoming an increasingly important part of an institution’s strategic plan. As universities compete for a finite number of qualified students, understanding which international recruitment efforts work and which don’t—as well as what each effort costs and how many enrollments each yields—will likely become ever more important. In other words, going forward, higher education institutions (HEIs) must understand the return on investment (ROI) of their global recruitment efforts.
Where are we now?
In June 2015, researchers at World Education Services (WES) set out to study the ROI of international recruitment practices at U.S. HEIs. Exploratory in nature, this study sought to provide an overview of current ROI processes in international recruitment. The starting point for our research was to understand the current practices. We framed the following questions to guide our research:
- How are international student recruitment budgets allocated?
- What are the best practices for assessing the effectiveness/ROI of specific international student recruitment activities?
- What are the benefits and importance of ROI measurements in international student recruitment?
What we discovered was that ROI evaluation processes in international recruitment are in the early stages. Overall, the way many HEIs currently measure ROI is unscientific. Most HEIs lack solid tools, mechanisms and metrics to determine recruitment effectiveness. However, we also saw some HEIs that have managed to come up with strategies to evaluate their outcomes and to develop these evaluation practices into clearly defined processes.
Significantly, we also found that, although there is substantial interest in assessing and addressing the ROI of international recruitment in terms of number of enrolled students, there has been little emphasis on other tangible and intangible benefits.
Based on our findings, we identified some key challenges that prevent many HEIs from effectively measuring the ROI of their international recruitment efforts. We also devised a series of recommendations about how the field might move toward more comprehensive and effective ROI measures. Both challenges and recommendations are summarized at the end of this article.
Methodology
To address our three key questions, we employed a mixed-methods research design. We collected data from several primary and secondary sources, and cross-validated the findings in three phases:
- Phase 1: Literature review: The first phase consisted of a literature review of best practices for international student recruitment, and measurements of ROI for marketing initiatives within and outside the international higher education industry.
- Phase 2: Quantitative research (survey): To better understand the ROI of recruitment practices, we developed an online survey of international higher education professionals1 based on the background information gathered in phase 1. The purpose of the survey was (a) to gauge the types and effectiveness of different recruitment activities, and (b) to determine the extent to which ROI measurements are employed across different institutional profiles. The survey gathered 410 responses from U.S. higher-education professionals responsible for international student enrollment, marketing or recruitment.
- Phase 3: Qualitative research (interviews): The third and final phase consisted of follow-up interviews with survey participants2 to gain additional insights into (a) the evaluation process for the ROI of international recruitment practices and (b) related impacts on overall international enrollment management.
The following article summarizes what we learned.
How are international student recruitment budgets allocated?
Based on our interviews with professionals in the international education field, we found that many institutions have an overall budget allocated for a range of international student recruitment activities. According to our survey findings, the most popular recruitment initiatives are in-person recruitment trips, education fairs, and social media marketing. Our interviews revealed that traditional recruitment techniques such as overseas recruitment trips and education fairs are used more often than activities such as digital or social media marketing.
Although traditional recruitment techniques are used more extensively in international student recruitment, they have inherent disadvantages in terms of difficulty in collecting and tracking student data for ROI evaluation. Digital marketing platforms, by contrast, often come with built-in analytics. (Channel-specific measurement practices for assessing the effectiveness/ROI of specific international student recruitment activities are discussed later in the paper.)
While recent polls indicate nearly every institution of higher education uses some form of social media, it remains unclear how effective the use of such tools are in terms of enrollment or creating awareness:
- On the one hand, a survey from Hanover Research found that the most effective recruitment strategies for universities are events‐based and involve direct interaction with potential students.
- On the other hand, a WES 2014 research report found that only 23 percent of prospective international students selected education fairs (in-person) as a means of seeking study abroad, indicating that institutions need to rethink their recruitment strategies by looking at the benefits of a broader array of channels they are using for communicating with the international students.
Common budgeting practices
Survey responses indicate that the majority (61%) of institutions measure the total cost of their recruitment efforts and allocate budget based on what they spent in the year prior. Some institutions allocate budgets based on the previous year’s overall tuition revenue from both domestic and international students. Depending on an institution’s organizational structure, budgets are sometimes allocated by departments; alternately they may be divided up by undergraduate and graduate levels. Sometimes they are allocated by both department and level.
Many higher education institutions use the yield number of students enrolled as the ultimate marker of the overall effectiveness of their international recruitment practices. However, given the number and variety of touchpoints involved in the student recruitment process, more nuanced ways of calculating ROI are needed.
What are best practices for assessing the ROI of international student recruitment activities?
As noted above, our research revealed that most institutions measure ROI based on a simple quantitative metric: the number of students who matriculate. However, some institutions have begun to tease out more effective ways of measuring the ROI of international student recruitment initiatives.
The right measures: Hard and soft metrics
An effective ROI measurement of international recruitment efforts is based on two categories:
- Hard returns are tangible, short-term, and easily tied to financial gains, such as number of leads generated by a given activity, website page views, applicants, enrollees, and even the diversity of the student body.
- Soft returns are intangible, long-term, and more challenging to measure. Soft returns include brand awareness, presence in a new country, student engagement, and partnerships with HEIs among other benefits.
Currently in international student enrollment, institutions place little emphasis on soft returns, focusing much more heavily on the hard returns of international recruitment efforts.
Looking beyond cost per student: Understanding the funnel
Success in the new recruitment landscape depends on analysis of the entire enrollment funnel and a number of varied inputs.
The full ROI for international recruitment activities – from enquiry to application to final enrollment – can be realized over a period of one to three years. Some investments are made very early in a prospective student’s admission life-cycle; some far later. To calculate the benefits of all these recruitment efforts, institutions must capture and analyze multiple inputs – the number of prospects, the number of people viewing a website, the number of applications, the impact of overseas recruitment trips, digital contacts, and more — at multiple points along the student journey.
Measuring the ROI of traditional recruitment activities
Traditional recruitment activities such as overseas recruitment trips can be calculated based on the cost-per-lead, cost-per-applicant, and cost-per-enrollee for each school or country visited, with time periods ranging from one to three years. Measurement should take place (and be reviewed) on a month-to-month or year-to-year basis for comparison. Some institutions have tracking processes and tools in place for this purpose. There are likewise mechanisms for tracking other traditional recruitment tools such as commission-based agents, advertising or purchasing leads. By designating each activity with a specific source code that then goes into a database, institutions are able to quantify returns.
The increasing use of customer relationship management (CRM) tools in international enrollment management shows the promise of this approach. Our survey found that more than half of responding institutions are using a CRM or information management systems to engage potential students and keep track of communications.
These statements point to the benefits of CRM and other emerging tools in collecting, analyzing, tracking, and evaluating the performance of recruitment efforts.
Another useful marketing concept, often used in the advertising industry is the AIDA (awareness, interest, desire, action) model, which covers a customer’s decision making journey. The AIDA concept is well suited to helping HEI’s measure returns at different stages of the enrollment funnel by defining metrics for all touchpoints in the prospective student journey.
Ongoing struggles
In an international recruitment context, many activities are related. Parsing out which activity is the most effective, or determining whether activities are effective only in conjunction with one another is an ongoing challenge. Many institutions have yet to achieve the integration offered by CRMs and/or make full use of other technologies that can help to surface and report on information logged in backend databases.
For many institutions, tracking each step of a student’s complete enrollment journey and tagging each phase with a recruitment activity still remains either aspirational or achievable only with great effort. While most institutions are only able to track applicants through their online application systems, some institutions are trying to go above and beyond by using manual techniques (such as using feedback forms, surveys, and interviews of applicants and enrollees) to get more information about the success of their marketing activities.
Measuring the ROI of digital or social media marketing
Interview respondents unanimously said that social media is a great source for generating leads and an effective tool for brand building.
They also noted the difficulty of quantifying its benefits in any meaningful way. Digital or social media marketing, with its built-in analytics platforms, is, on one level, easy to measure. Most institutions consider the key performance indicators (KPIs) of their digital marketing based on brand engagement, brand awareness, and word-of-mouth publicity. Currently, KPI’s from digital and social media marketing are measured on the basis of simple interactions such as page views, followers, and the number of clicks, shares, and “likes” through platforms such as Google Analytics. However, these measurements are often only loosely tied to other metrics around recruitment.
Adding “calls to action” (CTAs) to social media messages and campaigns, and then measuring the social conversion rate3 is another technique that allows both measurement of results and, in some cases, better integration with more traditional recruitment activities. In order to more meaningfully assess the returns of social media marketing, other measures such as the number of comments and replies per social media post can be captured. Traditionally, brand awareness, brand engagement and word-of-mouth publicity has been measured using surveys and interviews; however social media can act as proxy measures to quantify these softer measures. Using a broader range of metrics for each social media application (blogs, social networks, videos etc.) can help institutions to more successfully quantify the soft returns of their social media campaigns.
What is the importance of measuring ROI in international student recruitment/what are the benefits of doing so?
Subjective judgement can lead to inefficient allocation of resources in answering key questions about where to invest limited dollars for the greatest returns. Administrators must annually make decisions around questions such as:
- Which region or market should be this year’s focus?
- Which recruitment activities should we defund? Where should we allocate additional budget?
- What is the best use of the remaining funds?
A nuanced approach to ROI can provide more informed and effective answers to all these questions, helping institutions to allocate limited resources intelligently, both in terms of the actual dollars spent and the nature of the rewards reaped. Consider: An advertisement for a specific event could lead a student to attend the event, engage in social media, or to inquire further about the institution, yet it is not always clear which of these activities is associated with the student’s decision to apply or whether they can be isolated. Well-designed ROI measurements can help untangle the chain of events leading from a given expenditure to an event.
Our research showed that most HEIs understand the value of ROI analysis – even when they lack the capability to do it effectively. According to our interviews, institutions view ROI as an important indicator, helping them to assess not only the value of monetary outlays, but also of the intangible resources such as time, effort and man-hours that go into each recruitment activity.
Challenges
Based on our interviews with institutions we were able to identify some of the challenges that currently impeded effective measurement of the ROI for international student recruitment activities:
- Lack of data: Many institutions are new to international student recruitment, which has resulted in a lack of student data to track over a longer period of time.
- Poor understanding of the international student enrollment lifecycle: International students do not follow the traditional enrollment funnel or models which are used for domestic recruitment. Too often, schools use the same model to evaluate both.
- Immature measurement processes/tools: There is an inability to directly correlate leads/applicants/enrollments with specific recruitment activities at different stages of the enrollment funnel, making the evaluation process complex and resulting in isolated approaches to measurement. Institutions likewise fail to adequately address “soft returns” of various recruitment efforts.
- Ambiguity in determining where the control of international recruitment activities sits: Most universities have little consensus about how international recruitment should be strategically organized and managed, resulting in poor oversight of the ROI of international student enrollment efforts. With different departments managing marketing and recruitment functions, data “silos” are common, as is the failure to share data cross functionally.
Recommendations
Despite the challenges, some HEIs have managed to come up with strategies to consistently evaluate their outcomes and to develop these evaluation practices into more defined processes. Based on their experiences and insights, we have developed a few key recommendations to consider when devising a more effective institutional ROI evaluation process.
- Broaden the definition of ROI. Measure both hard and soft returns. Ensure that social media metrics are used to scope softer returns such as brand awareness and reputation.
- Determine both costs and the desired returns for each recruitment activity (traditional and digital marketing) by segmenting tangible (measurable) and intangible (difficult to measure) returns for both short-term as well as long-term goals.
- Quantify the stages of the prospective student’s journey. Use the AIDA model and create end-to-end reporting by developing metrics for all recruitment channels at different stages of the enrollment funnel (inquiry, application, acceptance and matriculation).
- Employ website analytics as applicable throughout the enrollment journey. Drive prospects to a series of web landing pages or ask them to complete a form at each step of the enrollment funnel.
- Break down silos to share data between different departments to enable more effective practices at an institution wide level.
- Track progress over time and compare results. Measurement should be continuous and closely linked to ROI.
- Develop dashboards or use existing CRM tools to track overall performance of both off- and online marketing in an integrated way. Dashboards can be easily shared and also help to measure each stage of the enrollment decision process from awareness to consideration, and from enrollment to brand loyalty.
- Test and continually refine processes. Enable management to make better decisions when it comes to allocating budget and resources.
1. Survey respondents: Higher education professionals that specifically recruit international students, have international student recruitment budgets and carry out at least some form of international student recruitment marketing activities.
2. Interview respondents:
- Senior administrator title (Associate/Assistant Director/Dean), employed in a higher education institution in the U.S. and primarily responsible for international enrollment marketing & recruitment at their respective institution.
- Directly/indirectly responsible for managing budgets & measuring ROI for international recruitment activities.
3. Benson, Vladlena. Cutting-Edge Technologies and Social Media Use in Higher Education. (383-384). IGI Global