Study on Online News Consumption
Thank you for your interest in participating in this study.
This study is carried out by Graz University of Technology, Austria, and Dublin City University, Ireland, in coopereation with Trinity College Dublin, Ireland, and Cibervoluntarios Foundation, Spain, in the context of the Provenance project.
Your participation will help us to better understand how online news are perceived and shared.
Please continue with 'Next'!
DevZone
Shortcuts: Demographic • Instruction • Article 1 • Article 2 • Article 3 • Article 4 • Article 5 • Article 6 • Feedback
Article Sequence:
Warning icon is shown:
Participant Information and Consent
Participant Information:
This study is undertaken as part of the PROVENANCE project, which has received funding from the European Union’s Horizon 2020 programme (grant No 825227). The principal investigator is Dr Jane Suiter (jane.suiter@dcu.ie), Dublin City University, Ireland.
The survey will take approximately 20 minutes to complete. Your participation is entirely voluntary. Should you wish to withdraw you may do so at any time.
All data will be anonymised and comply with GDPR requirements. All data arising from the study will be destroyed after a period of seven years.
If participants have concerns about this study and wish to contact an independent person, please contact: The Secretary, Dublin City University Research Ethics Committee, c/o Research and Innovation Support, Dublin City University, Dublin 9. Tel 01-7008000, e-mail rec@dcu.ie. If you are concerned about your data, please contact the Data Protection Officer in Dublin City University (Mr. Martin Ward, data.protection@dcu.ie 00 353 17008257).
For a more detailed version of this participant information please refer to the full plain language statement available here.
I have read and understood the information in this form
About yourself
First of all, kindly answer a few questions about yourself:
What is your age?
18 - 35
36 - 55
over 55
What is your gender?
female
other
prefer not to say
What is the highest degree or level of education you have completed?
I did not complete secondary/high school
Secondary school (Leaving certificate or equivalen
Professional qualification
Bachelor's degree
Master's degree
Doctorate
How often do you use the Internet (websites, social media, apps) to access news and information about current events?
Once a month
Several times a month
Once a week
Several times a week
Once a day
Several times a day
Once an hour
Several times an hour
All the time
How often do you come across news on social media (e.g. Facebook, Twitter)?
Never
Once a month
Several times a month
Once a week
Several times a week
Once a day
Several times a day
Once an hour
Several times an hour
All the time
I generally trust online information.
I am concerned about online disinformation or "fake news"
I usually check the facts and/or source of news stories to determine whether a story is real or fake.
I am concerned about sharing disinformation or “fake news” by mistake.
I usually check the facts and/or sources of news stories before sharing them.
How interested are you in news and information about immigration?
not much interested
somewhat interested
very much interested
Some people say that immigration creates problems for a country. Others see it as an opportunity for a country. Which comes closer to your point of view?
Immigration is a problem for a country
Instruction
On the following pages you will see in random order some exemplary online news stories. You are requested to have a look at each story and to share your opinion about it by answering the items listed on the bottom of the page.
In this process you have the opportunity to use the prototype demo-version of a novel tool, the Provenance Verification Indicator Tool (in short Provenance tool). You can use the tool by clicking the Provenance button, which you can find on the top right of each article:
The idea of the tool is to provide background information about a news article structured into categories of indicators. By clicking on an indicator button further details can be retrieved.
- General Information (Date, Location, Soruce): ... provides information about the origins of the content.
- Source Comparison (Similarity): ... provides information if the news are reported by other news agencies.
- Language Use (Tone, Writing Quality): ... provides information about the nature of the text.
These categories of information are based on the identified needs of information seekers and are derived from news tracking, expert judgements and automated text analysis. The indicators are flagged with warning symbols. The warning levels for each indicator include ok (no warning), low, medium, and high:
The tool shows a visual warning if an article has been flagged based on its analysis.
News Article [1]:
French Senate Says Notre Dame Cathedral Must Be Restored Exactly As it Was Before Fire — No Islamic Minarets or Swimming Pools
Following the disastrous fire on April 15th, modern architects made plans for the new and updated Notre Dame Catholic Cathedral in Paris, France.
Proposed plans included a giant glass spire to signify secularism or an Islamic minaret to respect the growing Muslim population.
This came after President Emmanuel Macron’s prime minister announced there would be a competition in design to rebuild the infamous cathedral.
On Monday the French Senate approved the government’s Notre-Dame restoration bill – but added a clause that it must be restored to the state it was before the blaze.
The Local reported:
French Senators have stipulated that Notre-Dame cathedral must be restored exactly how it was before the devastating fire that tore through the Paris landmark.
On Monday evening, the French Senate approved the government’s Notre-Dame restoration bill – but added a clause that it must be restored to the state it was before the blaze, striking a blow to the government which had launched an international architecture competition to debate ideas on the restoration.
The subject of the rebuilding of the cathedral – which was left badly damaged after fire tore through the roof and destroyed the spire on April 15 – has become a fraught battleground between traditionalists who want an exact restoration and others who favour a more imaginative take.
Provenance Tool 
General Information
Date
Location
Source
Source Comparison
Similarity
Language Use
Tone
Writing Quality
Information on Date
The publishing date of this story is unknown.
Information on Location
The publishing location of this story is unknown.
Information on Source
This story was published on CBTV.
Information on Similarity
This indicator presents information on the similarity to news reported by other news agencies.
The details of this story have not been reported by other news outlets.
Information on Tone
This indicator presents information on the emotionality of the language used.
An analytical tone is evident in this text. This may indicate information that is designed to help you understand a topic.
Information on Writing Quality
This indicator presents information on the professional use of grammar and punctuation.
The standard of writing is not typical of professional journalism regarding the spelling, grammar, and writing style. This may indicate low-quality information.
Please answer the following questions:
Have you seen or heard about this story or a similar story before?
How would you describe the story you just read?
Would you consider sharing this story online (for example, through Facebook or Twitter)?
News Article [2]:
Canada’s Prime Minister Begs Nigeria President for 1 million Immigrants
The Prime Minister of Canada, Justin Trudeau, has pleaded with Nigeria’s President Muhammadu Buhari, to allow one million Nigerians enter Canada under a new Employment and Migration Programme designed for immigrants.
According to Trudeau, immigrants from Nigeria have been a strong force in Canada’s growth in all sectors of its economy.
"We can’t undermine or overlook the contribution of immigrants in Canada’s development especially our brothers and sisters from Nigeria”, Trudeau said.
The PM added that, over the past three years, Canada has granted residency to all Nigerians who were illegally living in Canada and applied to remain. “We granted them and urging everyone to apply. It’s good we document everyone to know how many people we are to cater for”, he said.
Earlier this year, the Canadian Parliament announced plans to add more new permanent residents in the next three years.
Canada welcomed more than 286,000 permanent residents in 2017 and projects that number could reach 350,000 this year in addition to one million seeking from the West Africa nation.
Provenance Tool
General Information
Date
Location
Source
Source Comparison
Similarity
Language Use
Tone
Writing Quality
Information on Date
This story was published on 13 December 2019.
Information on Location
The publishing location of this story is unknown.
Information on Source
This story was published on Knights Templar International.
Information on Similarity
This indicator presents information on the similarity to news reported by other news agencies.
Some details of this story have not been reported by other news outlets.
Information on Tone
This indicator presents information on the emotionality of the language used.
Negative emotions - anger - are manifest in this text. This may indicate low-quality information that is designed to make you fearful or angry. An analytical tone is not evident in this text. This may indicate low-quality information that does not provide a clear analysis of a topic.
Information on Writing Quality
This indicator presents information on the professional use of grammar and punctuation.
The standard of writing is not typical of professional journalism regarding the spelling, grammar, and writing style. This may indicate low-quality information.
Please answer the following questions:
Have you seen or heard about this story or a similar story before?
How would you describe the story you just read?
Would you consider sharing this story online (for example, through Facebook or Twitter)?
News Article [3]:
UN Agrees to Outlaw Criticism of Immigration
United Nations Compact to make mass migration to Western nations even easier, and to outlaw criticism of immigration, was passed in Morocco yesterday. And the ONE politician who dared to object was immediately arrested and hauled away by UN security guards!
The global pact seeking to better manage migration was approved by delegates from 164 nations following 18 months of debate and negotiation.
It was rejected by President Donald Trump a year ago. Since then Austria, which holds the EU presidency, has pulled out of the process, along with Australia, Chile, the Czech Republic, Italy, Hungary, Poland, Latvia, Slovakia and the Dominican Republic.
Six countries, among them Israel and Bulgaria, are debating whether to quit the deal, a UN spokesman said after the pact was adopted. Thirty out of the 193 UN countries that agreed on the pact did not attend the conference.
The global pact lays out 23 objectives to open up legal migration and to commit signatories to legal steps to outlaw criticism not only of badly behaved immigrants, but even of immigration itself.
The lone protester, Udo Voigt, is the Member of the European Parliament for the National Democratic Party of Germany (NPD). He was able to give brief interviews about his protest to various news media before he was taken away by UN security staff. Reportedly, he now faces being deported and banned from Morocco. It certainly didn’t take the UN long to start applying the clampdown, did it?
Provenance Tool
General Information
Date
Location
Source
Source Comparison
Similarity
Language Use
Tone
Writing Quality
Information on Date
This story was published on 28 May 2019.
Information on Location
The publishing location of this story is unknown.
Information on Source
This story was published on The Gateway Pundit.
Information on Similarity
This indicator presents information on the similarity to news reported by other news agencies.
Some details of this story have not been reported by other news outlets.
Information on Tone
This indicator presents information on the emotionality of the language used.
An analytical tone is evident in this text. This may indicate information that is designed to help you understand a topic.
Information on Writing Quality
This indicator presents information on the professional use of grammar and punctuation.
The standard of writing is not typical of professional journalism regarding the spelling, grammar, and writing style. This may indicate low-quality information.
Please answer the following questions:
Have you seen or heard about this story or a similar story before?
How would you describe the story you just read?
Would you consider sharing this story online (for example, through Facebook or Twitter)?
News Article [4]:
Migrants occupy Athens rail station in border passage bid
Dozens of asylum seekers occupied the main railway station in Athens on Friday in a burgeoning protest demanding access to the border and passage to other EU states.
The protest has shut down Larissis Station, the main hub connecting Athens to the north, and unfolded hours after a similar move at the migrant camp of Diavata near Thessaloniki, where clashes erupted.
Authorities said the Athens demonstration was sparked by anonymous calls on social media over recent days, telling asylum seekers that human rights groups will assist them in crossing into North Macedonia and on to other EU states.
Both the government and the UN refugee agency have stressed that no such possibility exists.
In Athens, the migrants shouted "Saloniki" (Thessaloniki) and "Germany", an AFP reporter at the station said. At the Diavata camp, skirmishes broke out between migrants and riot police on Thursday and Friday, with the security forces making sporadic use of tear gas.
A senior migration ministry official said on Friday the demonstration was intended as a "message" to the European Union. "It's a message that Europe must understand that this is a problem demanding a European solution," Miltiadis Klapas, general secretary of the migration ministry, told reporters at the station.
"But it cannot be imposed like this," he added, referring to the station shutdown.
More than 70,000 refugees and migrants are believed to live in Greece in the wake of a mass influx beginning in 2015, mainly fuelled by the Syrian civil war.
Provenance Tool
General Information
Date
Location
Source
Source Comparison
Similarity
Language Use
Tone
Writing Quality
Information on Date
This story was published on 13 April 2019.
Information on Location
The publishing location of this story is UK.
Information on Source
This story was published on BBC.
Information on Similarity
This indicator presents information on the similarity to news reported by other news agencies.
A similary story has been reported by other news outlets.
Information on Tone
This indicator presents information on the emotionality of the language used.
An analytical tone is evident in this text. This may indicate information that is designed to help you understand a topic.
Information on Writing Quality
This indicator presents information on the professional use of grammar and punctuation.
The standard of writing is typical of professional journalism.
Please answer the following questions:
Have you seen or heard about this story or a similar story before?
How would you describe the story you just read?
Would you consider sharing this story online (for example, through Facebook or Twitter)?
News Article [5]:
EU countries take migrants after Mediterranean stand-off
Four EU countries have agreed to take in 64 African migrants who were rescued after being stranded in the Mediterranean Sea for almost two weeks.
The Alan Kurdi ship, operated by the German humanitarian group Sea-Eye, had been refused entry by Italy and Malta. Both countries had said it was Libya's responsibility, Sea-Eye had claimed.
But on Saturday the Maltese government announced that the migrants will be redistributed among Germany, France, Portugal and Luxembourg. "None of the migrants will remain in Malta. The ship Alan Kurdi will not be allowed to enter Malta," the government said in a statement. The agreement had come through the co-ordination of the European Commission, it added.
Two migrants had already been evacuated to Malta after falling ill on the German ship, named after the three-year old boy who drowned as his family fled the conflict in Syria.
"Once again the smallest member of the European Union was put under unnecessary pressure, being asked to resolve a case which was neither its responsibility nor its remit," the Maltese government said. "A solution was found in order not to let the situation deteriorate further while making it clear Malta cannot keep shouldering this burden."
Three teenage migrants were charged in Malta last month after "hijacking" an oil tanker that had rescued them.
Provenance Tool
General Information
Date
Location
Source
Source Comparison
Similarity
Language Use
Tone
Writing Quality
Information on Date
This story was published on 5 April 2019.
Information on Location
The publishing location of this story is France.
Information on Source
This story was published on France 24.
Information on Similarity
This indicator presents information on the similarity to news reported by other news agencies.
A similary story has been reported by other news outlets.
Information on Tone
This indicator presents information on the emotionality of the language used.
An analytical tone is evident in this text. This may indicate information that is designed to help you understand a topic.
Information on Writing Quality
This indicator presents information on the professional use of grammar and punctuation.
The standard of writing is typical of professional journalism.
Please answer the following questions:
Have you seen or heard about this story or a similar story before?
How would you describe the story you just read?
Would you consider sharing this story online (for example, through Facebook or Twitter)?
News Article [6]:
Counter-terror police investigating after five Birmingham mosques attacked with sledgehammer
Five mosques in Birmingham have been targeted in a string of violent attacks after having their windows smashed with sledgehammers, prompting a counter-terror investigation.
West Midlands Police said it was yet to establish a motive for the attacks, which are believed to be linked, as it confirmed that officers from its Counter Terrorism Unit had opened an investigation.
The attacks come just days after Sajid Javid, the Home Secretary, announced that mosques are set to share in a multimillion pound government cash injectionto boost security after the New Zealand terror attack in which 50 people died.
A spokeswoman for West Midlands Policesaid that officers were called to reports of a man smashing windows with a sledgehammer on Birchfield Road at 02:30 on Thursday.
Officers were then alerted to a similar attack in Erdington about 45 minutes later, with more in Aston and Perry Barr reported. Another on Albert Road was struck at 10:00am. One of the attacks is understood to have taken place at a Muslim girls’ school.
Chief Constable Dave Thompson said: "Since the tragic events in Christchurch, New Zealand, officers and staff from West Midlands Police have been working closely with our faith partners across the region to offer reassurance and support at mosques, churches and places of prayer.
"At the moment we don't know the motive for last night's attacks.
"What I can say is that the force and the Counter Terrorism Unit are working side-by-side to find whoever is responsible."
The force have asked anyone with information to come forward.
Provenance Tool
General Information
Date
Location
Source
Source Comparison
Similarity
Language Use
Tone
Writing Quality
Information on Date
This story was published on 21 March 2019.
Information on Location
The publishing location of this story is UK.
Information on Source
This story was published on The Telegraph.
Information on Similarity
This indicator presents information on the similarity to news reported by other news agencies.
A similary story has been reported by other news outlets.
Information on Tone
This indicator presents information on the emotionality of the language used.
Negative emotions - fear and anger - are manifest in this text. This may indicate low-quality information that is designed to make you fearful or angry. An analytical tone is evident in this text. This may indicate information that is designed to help you understand a topic.
Information on Writing Quality
This indicator presents information on the professional use of grammar and punctuation.
The standard of writing is typical of professional journalism.
Please answer the following questions:
Have you seen or heard about this story or a similar story before?
How would you describe the story you just read?
Would you consider sharing this story online (for example, through Facebook or Twitter)?
Feedback
Questions on articles
It was easy/difficult to judge the news stories.
I intend to check the facts and sources of news stories more critically in the future.
To what extent did you make use of the Provenance tool?
Questions on the Provenance Tool
I found the Provenance tool useful in making up my opinion about the news stories.
Using the Provenance tool enabled me to judge the news stories more effectively.
I found the Provenance tool easy to use.
The Provenance tool's capabilities meet my requirements.
Assuming that I had access to the Provenance tool, I intend to use it in the future.
Using the Provenance tool in the future would help me to reflect deeper about a news story.
Using the Provenance tool in the future would make me think it over before sharing a news story.
How much do you think did the use of the Provenance tool influence your judgement of the news stories?
I would find it fair to pay for a service like the Provenance tool.
Questions on the Provenance Tool information and design
Remember the design of and the information provided by the Provenance tool (see screenshot below)
and respond to the following questions:
What do you think about the design and presentation of the warning level?
What do you think about the design of the icons for the different indicators?
very unclear very clear
Date:
Location:
Source:
Similarity
Tone
Writing Quality
Which indicator of information provided by the Provenance tool did you find particularly useful?
not useful very useful
The explanations provided for the different indicators were suitable.
The level of detail presented on the indicators was appropriate.
What other or additional kind of information or explanation would be helpful and suitable for you?
I trust the information provided by the Provenance tool.
The Provenance tool would make me more confident in dealing with online news
The Provenance tool may increase my trust in online news.
Other questions
Do you have any further comments on the news stories, the Provenance tool and the information it presents?
Thank you for your participation and your valuable feedback!
Your responses will help to build and improve the Provenance tool in order to provide the most suitable support for users in browsing and reading online content.
Finally, a short explanation on the news stories that you saw:
Some of the statements in the news stories were false:
- Canada’s Prime Minister did not set up a programme for 1 million Nigerian Immigrants
- Architects are not planning to put a minaret on Notre Dame Cathedral
- The UN migration pact does not outlaw criticism of immigration
For tips on how to evaluate online information, please visit Be Media Smart
For further information on the Provenance project and news on the Provenance Tool, please visit the Provenance Project Website