Nearly all assess only frequency and duration of use rather than content or context. “We’re asking the wrong questions,” Hancock says. And results are regularly overstated—sometimes by the scientists, often by the media. “Social media research is the perfect storm showing us where all the problems are with our scientific methodology,” Orben says. “This challenges us as scientists to think about how we measure things and what sort of effect size we think is important.”
Although people like Jean Twenge might be right about the impact of social media on health, correlation does not always equal conclusion:
No one disagrees about the importance of young people’s health, but they do think that Twenge has gotten ahead of the science. “Why wait for causal evidence?” says Dennis-Tiwary. Because the story might not be so straightforward.
For example, in an analysis of 24 longitudinal studies, it was found that framing the discussion around addiction often makes negative findings more likely.
“It’s ironic that in the end the real danger is not smartphones—it’s the level of misinformation that’s being directed at the public and at parents,” Odgers says. “It’s consuming so much of the airtime that it’s causing us to miss potentially some of the real threats and problems around digital spaces.” For her part, Odgers is far more worried about privacy and unequal access to technology for kids from families with lower socioeconomic status. She also suspects that some adolescents find much needed social support online and that adults should pay closer attention to what works in that regard.
Responding to this situation, two researchers, Amy Orben and Andrew K. Przybylski, produced a series of papers designed to ‘tackle some of the pitfalls’:
- In Nature Human Behaviour, they used specification curve analysis to improve transparency.
- In Psychological Science, they measured screen time by getting participants to complete a diary one day each year over five years.
- In the Proceedings of the National Academy of Sciences USA, they used longitudinal data to analyse satisfaction over time.
Denworth explains that although some of these reports provide more nuance through their methodology, there is still more needed in understanding social media and screentime. This all captures danah boyd’s message that the relationship between technology and teens is complicated and that the negatives and benefits can depend. Also, for more research and advice on screentime, Ian O’Byrne and Kristen Turner have created the site The Screentime Age.
Kelli Vogstad share how here school uses Freshgrade to support pedagogical documentation. She shares the four types of documentation that she uses:
Two of the Same
Showing the Knowing
Celebrating the Learning
Communicating the How and Whys
Although Vogstad focuses on Freshgrade, I think that much of this could be completed using a range of applications and platforms. It is also a great example of ongoing reporting.
Aaron Davis mentioned this bookmark on collect.readwriterespond.com.
Also on:
Linda, your point about rigor reminds me of the recent piece by @LydiaDenworth on the need for more nuance and research