Can Big Data Point Us Towards Faster, Higher-Impact Scientific Discoveries?

How can the process of science be better? How can we move faster towards groundbreaking scientific discoveries? In Science magazine, Fortunato et al. write about what large-scale data analysis tells us about the science of doing science. (They call it the Science of Science, or SciSci.)

There is more data available than ever before – “from research funding, productivity, and collaboration to paper citations and scientist mobility” – and that, combined with methods that emerge from collaborations among different kinds of scientists (including the social kind), allows the study of what drives science.

Here are a few findings that struck me:

  1. Lots of science, with more every year! The amount of scientific research has grown exponentially, and the number of new ideas in scientific research has also grown dramatically (but not exponentially).

scisci1

Source: Fortunato et al. 2018

  1. Most scientists are conservative in their research. Scientists tend to do research on the areas of their expertise. “Although an innovative publication tends to result in higher impact than a conservative one, high-risk innovation strategies are rare, because the additional reward does not compensate for the risk of failure to publish at all.” But those conservative strategies “serve individual careers well but are less effective for science as a whole.”

 

  1. Interdisciplinarity yields big gains in impact, but not in funding. “The successful combination of previously disconnected ideas and resources that is fundamental to interdisciplinary research often violates expectations and leads to novel ideas with high impact.” But “truly novel or interdisciplinary” grant applications tend to earn lower scores from expert evaluators. The highest impact science is a mix of old and new, “primarily grounded in conventional combinations of prior work, yet it simultaneously features unusual combinations.”

 

  1. It’s the scientist that creates impact, not the university. “When examining changes in impact associated with each move [by scientists across institutions] as quantified by citations, no systematic increase or decrease was found, not even when scientists moved to an institution of considerably higher or lower rank.”

 

  1. Collaboration yields impact. “Nowadays, a team-authored paper in science and engineering is 6.3 times more likely to receive 1000 citations or more than a solo-authored paper, a difference that cannot be explained by self-citations.” One possible explanation is #3 above. As you can see in the figure below, the above-average cited papers (black line) are those with larger teams than average (red line).

scisci2

Source: Fortunato et al. 2018

  1. Who gets credit for a multi-authored paper? “Most credit will go to the coauthors with the most consistent track record in the domain of the publication.”

There’s much more in the review article; I recommend it. But here’s a last word from the authors on how to think about the impact of scientific research: “Science often behaves like an economic system with a one-dimensional ‘currency’ of citation counts. This creates a hierarchical system, in which the ‘rich-get-richer’ dynamics suppress the spread of new ideas, particularly those from junior scientists and those who do not fit within the paradigms supported by specific fields. Science can be improved by broadening the number and range of performance indicators.”

Disclosure: One of the authors of Fortunato et al. is my brother James Evans.

Advertisements

When is a movie more than a movie? When it gives you a role model

Over at Let’s Talk Development, I write about an experiment that showed an inspirational movie to Ugandan high school students and led many of them to pass their math exams:

How going to the movies helped Ugandan high schoolers pass their tests

Why every academic should have a Twitter profile

If you are interested in greater exposure for your research, I recommend that you create a Twitter account with a recognizable, professional picture and a link to the page where you list your research. You can just use the picture from your research page, if you have one there. (The picture isn’t even essential; your affiliation and the link to your research website will do.)

I recommend this even if you have no intention of using Twitter. I recommend this even if you think Twitter is a waste of time.

Here is why: People who want to popularize research are on Twitter. Other researchers are on Twitter. When someone mentions your research on Twitter, then they often will “tag” you IF you have a recognizable Twitter profile. That tag means that curious people can click over to your profile, then EASILY follow the link to your research page and learn about the rest of your research. 
There are good reasons not to be active on Twitter. I’m listening to Cal Newport’s book Deep Work, and he makes the case that social media gets an outsize influence because we don’t have good metrics of productive impact. So we spend time chasing short-run retweets and likes rather than serious impact from concentrated, uninterrupted work. All good.

But in this case, the cost is low and fixed, probably ten minutes of your time. Again, this isn’t an argument to be active on Twitter. Just make it easy for the people who ARE on Twitter to find your work.

Here’s mine:

In January and February of this year, about 10,000 people have visited my profile page. Some (probably small) fraction of those clicked through to read more about my work.

What do you think? Why am I wrong?