Questionnaire development
This study was a population survey across Aotearoa New Zealand (ANZ) and Australia. The target population of the questionnaire was adults aged 18 years or older diagnosed with pancreatic cancer currently living in either country. The survey instrument was developed by a multi-disciplinary team including dietitians, doctors and consumers which focused on knowledge, beliefs, and practices pertaining to PERT. The full survey (Supplementary File One) included 32 unique question items and was administered via Qualtrics (Provo, UT). The questionnaire was piloted by both the research team and people without clinical background to check for comprehension and clarity. Survey items collected data on:
-
demographics of the respondent,
-
knowledge of PERT,
-
dosage of PERT,
-
symptoms of malabsorption prior to beginning PERT,
-
symptom improvement after beginning PERT,
-
side effects from PERT.
Changes were made to the questionnaire in response to feedback from those testing the instrument. Initially, participants were asked a single screening question “Have you heard of pancreatic enzyme replacement (PERT) e.g., CREON prior to this study?” The research team then recognised that this excluded the group of patients who had heard of PERT but not been commenced on the enzymes. A second eligibility question was then added “Have you been started on pancreatic enzyme replacement therapy (PERT)?” to allow the research team to understand prescribing practices. A negative response to either question directed participants to a “thank you” message and a webpage with a link to a PERT patient information brochure designed by the research group. Eligible participants who wished to complete the survey in more than one sitting were able to resume the survey at any time by re-using their own personalised link. Partially completed surveys were automatically recorded if no activity was observed for one week.
All study materials and procedures, including questionnaire and advertisement images, were submitted to University of Otago Ethics Committee (Human) review. The study was ratified by the University of Technology Sydney (UTS) Ethics Committee.
Patient and Public Involvement
Māori (Indigenous Peoples of ANZ) consultation occurred throughout the development of the questionnaire to ensure Māori engagement in the study was optimised. Consultation with Indigenous people of Australia did not occur.
Recruitment strategy
Recruitment across ANZ and Australia required a flexible and adaptable strategy due to different health systems and local research processes. The traditional methods of recruiting through clinicians and via hospital departments was deemed insufficient to reach the wider pancreatic cancer population who may not be engaged with these services. A multi-media strategy for participant recruitment was designed by a research team member (AK) who had a communications background. Initially, the research team focused heavily on use of traditional media such as radio and newspapers, the rationale being that eligible participants would likely be older and therefore more likely to interact with these forms of media. These methods proved costly and unproductive in regards to translation into survey responses.
Social media platform accounts were then organised by a research team member (PM) and linked to a webpage located on the UTS website. Social media platforms included Facebook, Instagram, Twitter, and LinkedIn. Google Ad words were also utilised later in the campaign. The research team created and populated a Facebook page called Aotearoa Australia Pancreatic Enzyme Replacement Therapy (ASPERT) research group, with the intention of using this for recruitment as well as study updates and the building of general awareness of this treatment option. The associated Meta Business Suite was utilised to develop paid advertisements shown to selected audiences across Facebook and Instagram.
Relationships were formed with consumer organisations such as Palliative Care Aotearoa New Zealand (PCANZ) and the National Gut Cancer Foundation in ANZ. To ensure the research team achieved a representative study population the Māori advisor contacted indigenous organisations such as the Māori Women’s League and Māori health providers within each region of ANZ. The Whipple’s Warriors in Australia contacted the research team early in the recruitment period and a reciprocal arrangement occurred with social media posts and information being shared. The Australian Pancreatic Cancer Foundation (PanKind) hosted a free online seminar which two members of the research team hosted; which led to survey completions. Throughout the recruitment process these support groups encouraged survey participation from their members by posting on their Facebook groups as well as sharing video resources from the ASPERT team.
Recruitment budget
Approximately $5,600 was initially budgeted for marketing the study, over a recruitment period of 6 months. The overall marketing objective set for the advertisements was completed surveys. A secondary objective was the number of views of our assets, which potentially could correlate with an increased awareness of pancreatic cancer and PERT in the general population.
In establishing a budget for the advertisement, Meta required the selection of an optimisation focus for advertisement delivery. The “link clicks” optimisation strategy was chosen to best utilise our budget and show our advertisements to the audience most likely to engage. An initial daily budget of $7.50 per country was set for the first day of advertising. The amount was manually adjusted throughout the recruitment period based on monitoring of the response rate in ANZ and Australia. This daily budget reflected an approximate amount Facebook would spend on distributing the advertisement each day. If the algorithm detected a higher recruitment potential on a specific day, it may spend up to 25% above the daily budget. However, it would not exceed the stipulated daily budget when averaged across the week i.e., over 7 days not more than $52.50 would be spent.
Meta advertisement allowed the selection of audience demographics based on data collected on users. For the broad demographic selections, we set locations as ANZ and Australia, the age ranges from 40–65 + and to all genders. For our initial advertisements, the research team selected detailed targeting categories including interest-based options such as ‘Pancreatic disease’, ‘Diabetes Health’, and ‘Digestive enzyme.’ The research team also kept “Advantage detailed targeting” on, which allowed our advertisements to be shown to people outside of our targeted demographic where it may perform well in relation to our campaign goal of lowest cost per click. During the recruitment campaign, Facebook changed the guidelines on interest-based options and the research team was required to broaden the categories.
In addition to the main advertising campaign, the research team improved our reach and link clicks by “boosting” posts from our Facebook page. “Boosting” involved allocating money to a particular post, so it is highlighted in a target audience’s Facebook Feed. These posts were varied and included informative videos about tips for taking PERT, preliminary findings from the survey and awareness posts about pancreatic cancer. Facebook allocated a specific budget for selected posts to use as short-term advertisements. Most often the research team set the budget at approximately $50 and ran the post for four days. These posts would then show as ads across Facebook and associated platforms.
The research team also used Google AdWords to set up search-word triggered advertising that would be displayed at the top of a Google search. This involved creating keywords that would prompt our advertisement to be shown. Phrases such as “pancreatic cancer”, “pancreatic enzyme replacement” and “pancreatic cancer research” were utilised. The research team then set up a simple text advertisement with the link to the survey.
Advertisement design and evaluation
In designing the assets for the Facebook campaign, the “Single Image” format was selected. Facebook then prompted the creator to add media, primary text, headline, and a description as well as the website URL which was displayed and linked by a “call to action” button. The research team ensured that wording for our primary text was simple, brief and that headlines were accurate and striking. The team used the “optimise creative mode” which allowed the inputting of various headlines and text. The programme then optimised which version of the ad to display to individuals.
The research team initially began with an “A/B Test” which allowed comparison of results between two slightly differing advertisements. The measured parameter was set as cost per link click, with each advertisement being shown with a “Learn More” button as our “call to action”. This opened a website link to the UTS which hosted a generic study page. With the “A/B Test”, an image-based advertisement was created and compared with a block colour background with text type advertisement. This was set to run with a budget of $15 per day for 5 days as a short, inexpensive way to test survey completions. The more effective advertisement was the image-based option, with a cost per click of $0.14 and it was decided to continue using this media. As an example, Picture. 1 displays one version of the advertisement. The image of the torso with the pancreas highlighted was displayed in the advertisement to draw people’s attention.
The “boosted” post type advertisements were created using Canva (Canva Pty Ltd, Perth) and were a mix of videos and infographic style posts. PM developed an ASPERT brand pallet which allowed the colouring of the assets to be cohesive across posts (Picture 2). Most of these posts had a similar banner style with a “Learn more” button alongside the survey link.
Recruitment adjustments
Recruitment adjustments were required as survey completion started well then tapered off after a few months. It also became clear over time which modalities were more successful and cost effective. Monitoring of views, impressions and clicks allowed the research team to focus time and money into more effective methods. The team increased the budget and boosted more assets around particular relevant events such as Pancreatic Cancer Awareness month. The budget, therefore, needed to be flexible over the whole recruitment period.
Over time, it became obvious the Australian advertisements were not translating to survey completions and therefore required further adjustments. The daily budget across all social media platforms for the Australian advertisements was increased, and the team ensured that the wording was Australia-specific. We also selected the best delivery system to optimise placements across Facebook and Instagram including across newsfeeds, stories, in-stream video, and marketplace. In creating our advertisements after the initial test, the research team decided to create two separate ad sets under the same campaign for the different countries. This allowed wording to be country-specific and for budget alterations in response to recruitment numbers. A step-by-step guide designed by the research team in utilising mixed media to recruit participants for a study is included (Supplementary File Two).