What's New Under the Sun

What's New Under the Sun

Download on the App Store

All What's New Under the Sun episodes

  • Biases Against Risky Research

    A frequent worry is that our scientific institutions are risk-averse and shy away from funding transformative research projects that are high risk, in favor of relatively safe and incremental science. Why might that be?

    Let’s start with the assumption that high-risk, high-reward research proposals are polarizing: some people love them, some hate them. If this is true, and if our scientific institutions pay closer attention to bad reviews than good reviews, then that could be a driver of risk aversion. In this podcast, I look at three channels through which negative assessments may have outsized weight in decision-making, and how this might bias science away from transformative research.This podcast is an audio read through of the (initial version of the) article Biases Against Risky Research, originally published on New Things Under the Sun.Articles mentionedGross, Kevin, and Carl T. Bergstrom. 2021. Why ex post peer review encourages high-risk research while ex ante review discourages it. PNAS 118(51) e2111615118. https://doi.org/10.1073/pnas.2111615118

    Krieger, Joshua, and Ramana Nanda. 2022. Are Transformational Ideas Harder to Fund? Resource Allocation to R&D Projects at a Global Pharmaceutical Firm. Harvard Business School Working Paper 21-014. 

    Jerrim, John, and Robert Vries. 2020. Are peer reviews of grant proposals reliable? An analysis of Economic and Social Research Council (ESRC) funding applications. The Social Science Journal 60(1): 91-109. https://doi.org/10.1080/03623319.2020.1728506

    Lane, Jacqueline N., Misha Teplitskiy, Gary Gray, Harder Ranu, Michael Menietti, Eva C. Guinan, and Karim R. Lakhani. 2022. Conservatism Gets Funded? A Field Experiment on the Role of Negative Information in Novel Project Evaluation. Management Science 68(6): 3975-4753. https://doi.org/10.1287/mnsc.2021.4107



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit mattsclancy.substack.com
    21 min
  • Audio: How common is independent discovery?

    This is an audio read-through of the initial version of How Common is Independent Discovery?

    Like the rest of New Things Under the Sun, the underlying article upon which this audio recording is based will be updated as the state of the academic literature evolves; you can read the latest version here.



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit mattsclancy.substack.com
    34 min
  • Audio: Science is getting harder

    This is an audio read-through of the initial version of Science is getting harder.

    Like the rest of New Things Under the Sun, the underlying article upon which this audio recording is based will be updated as the state of the academic literature evolves; you can read the latest version here.



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit mattsclancy.substack.com
    28 min
  • Audio: When Extreme Necessity is the Mother of Invention

    This is an audio read-through of the initial version of When Extreme Necessity is the Mother of Invention. To read the initial newsletter text version of this piece, click here.

    Like the rest of New Things Under the Sun, this underlying article upon which this audio recording is based will be updated as the state of the academic literature evolves; you can read the latest version here.



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit mattsclancy.substack.com
    12 min
  • Audio: Steering Science with Prizes

    This is an audio read-through of the initial version of Steering Science with Prizes. To read the initial newsletter text version of this piece, click here.

    Like the rest of New Things Under the Sun, this underlying article upon which this audio recording is based will be updated as the state of the academic literature evolves; you can read the latest version here.



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit mattsclancy.substack.com
    29 min
  • Audio: Progress in Programming as Evolution

    This is an audio read-through of the initial version of Progress in Programming as Evolution. To read the initial newsletter text version of this piece, click here.

    Like the rest of New Things Under the Sun, this underlying article upon which this audio recording is based will be updated as the state of the academic literature evolves; you can read the latest version here.



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit mattsclancy.substack.com
    17 min
  • Pulling more fuel efficient cars into existence

    Like the rest of New Things Under the Sun, this article will be updated as the state of the academic literature evolves; you can read the latest version here.

    Note: An audio version of New Things Under the Sun is now available on all major podcast platforms. Apple, Spotify, Google, Amazon, Stitcher

    Think of new technologies as proceeding through a set of stages:

    * Basic scientific research that explores phenomena

    * Applied research to better understand how to harness certain phenomena

    * Technology development to capture and orchestrate phenomena for a purpose

    * Marketing and diffusion of the new technology

    The real world can be more complicated with back-and-forth interplay between the stages, but this is a fine place to start. If you want to shape the direction of technology, you can intervene early in this process and try to push the kinds of technology you want onto the market, by subsidizing research. Or you can intervene at the end of the process and try to pull the kinds of technology you want into existence by shaping how markets will receive different kinds of technology.

    One specific context where we have some really nice evidence about the efficacy of pull policies is the automobile market. Making fuel more expensive or just flat out mandating carmakers meet certain emissions standards seems to pretty reliably nudge automakers into developing cleaner and more fuel efficient vehicles. We’ve got two complementary lines of evidence here: patents and measures of progress in fuel economy. In this post, first I’ll go over the evidence, and then I’ll talk a bit what I think we should take away from it. In my view, we have strong evidence that pull policies work well for incremental progress, but the case for their efficacy at promoting radical innovation is a lot shakier.

    Patents, Progress, and Pull Policies

    One pull policy is a tax on undesirable technologies, since, all else equal, that makes the taxed technology less profitable to develop and alternatives more profitable to develop. A carbon tax is the most famous example of this kind of policy. Aghion et al. (2016) are interested in how a carbon tax might change innovation in the auto sector, but given how rarely anyone actually tries to implement a carbon tax, they can’t directly study the question. Instead, they do the next best thing. From the perspective of a carmaker, one of the main effects of a carbon tax is to raise the price of fuel. So how do carmakers respond to higher fuel prices?

    To answer that question, they need a way to measure innovation. More specifically, they want to measure the kind of innovation a firm decides to do: do carmakers focus on clean technology (electric, hydrogen fuel cell, and hybrid vehicle) or conventional fossil fuel innovation? Patents are a useful dataset for this kind of problem, since they are correlated with inventive effort and can be easily categorized into different kinds of technology. One problem though is that patents vary tremendously in how valuable they are. Some are very important, but a lot are junk. So Aghion and coauthors focus on the subset of patents for which the patent-holder sought patent protection in three big markets: the USA, the European Union, and Japan. Since it’s costly to apply for a patent in each market, doing so in all these markets is a signal that the inventor thinks the patented invention is sufficiently valuable to be worth protecting in multiple large markets. So in this paper, you can think of them measuring innovation by counting the number of valuable patents for different kinds of automobile technology.

    In an ideal setting, if we really wanted to assess the impact of fuel prices on the innovation decisions of carmakers, we would want to randomly assign some carmakers to face higher fuel prices than others. Then we could compare the subsequent patenting behavior across groups facing different fuel prices. And if we wanted to establish this robustly, we would want to do this kind of experiment many times.

    We can’t do that. But Aghion and coauthors do something that gets you closer to this ideal. The price of fuel varies a lot from year-to-year, thanks to fluctuations in the price of oil (see left figure below), but it also varies a lot from country-to-country, because countries vary substantially in the size of their taxes on fuel (see right figure below).

    Moreover, carmakers typically sell to multiple countries, but have different footprints in different countries. Aghion and coauthors reason that carmakers are more sensitive to (tax-inclusive) fuel prices in the countries where they have a larger share of their total sales. For example, in the figure above it’s clear that the UK raised taxes pretty substantially over the 1990s, while taxes remained flat in the USA. In other words, if we have two carmakers, one with most of its sales in the USA and some in the UK, and another with most of its sales in the UK rather than the USA, then these carmakers are effectively facing different fuel prices. The carmaker selling primarily to the UK sees an increase in effective fuel prices, and we can compare their behavior to the one selling primarily in the USA.

    For every carmaker, Aghion and coauthors construct an “effective” fuel price that is specific to that carmaker, by weighting the fuel price in each country by the carmaker’s exposure to that country. They estimate this exposure from the share of patents the carmaker seeks protection for in that country over 1965-1985, because generally you don’t bother seeking patent protection in countries where you don’t plan to operate in the future. They then look to see how the patents of carmakers differ in the subsequent 20 years (1985-2005) as each carmaker faces a different effective fuel price. We can then compare the behavior of firms that were established in markets that went on to have higher fuel prices to the behavior of firms that were established in markets that went on to have lower fuel prices.

    (Note that they estimate the markets where a firm is established over 1965-1985, but look at the effect of fuel prices over 1985-2005; this prevents their results from being driven by innovative fuel efficient companies entering markets when they raise taxes, or from their measure of exposure to different markets from being whipped around by subsequent patenting activity)

    Aghion and coauthors find fuel prices exert a powerful impact on innovation. A 10% increase in the effective price of fuel (that a specific carmaker is exposed to) is associated with roughly 5% fewer patents of the conventional “fossil fuel” type, and a 10% increase in clean energy patents.

    Rozendaal and Vollebergh (2021) adapt this strategy to study the impact of emissions standards on auto innovation (in addition to fuel prices). Emissions standards are essentially a requirement that a carmaker’s average CO2 emissions per mile fall below some target by some date. It’s not actually quite that simple; but that’s the gist of the idea. Just as fuel prices differ across time and space, so to do regulatory standards. And just as a carmaker is more likely to care about the fuel prices in markets where it has a lot of sales, so too is a carmaker more likely to care about the emissions standards of markets where they have a lot of sales.

    Rozendaal and Vollebergh make one of those kinds of observations that is obvious in retrospect but which some previous papers apparently missed. In terms of its impact on the rate and direction of innovation, what matters is not whether a country has an emissions target, or even if this target is high or low. What matters is (1) how high or low is this target relative to today’s average emissions and (2) how long do carmakers have to meet the target? If the standard is high, but you’ve already cleared it, then even though it’s high it imposes no extra incentive to innovate. On the other hand, if the standard is high and you have not met it yet, but actually have a long way to …



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit mattsclancy.substack.com
    29 min
  • "Patent Stocks" and Technological Inertia

    Like the rest of New Things Under the Sun, this article will be updated as the state of the academic literature evolves; you can read the latest version here.

    Note: An audio version of New Things Under the Sun is now available on all major podcast platforms. Apple, Spotify, Google, Amazon, Stitcher

    There’s this idea that technology is characterized by path dependency: once you start going down one technology trajectory, you kind of get locked in and it’s hard to switch to another, possibly better trajectory. That can happen for lots of reasons, but one possibility is that it’s something about the nature of knowledge itself. The more you know, the more you can learn: knowledge begets more knowledge. So whichever technology trajectory we start on becomes the one we know the most about, and therefore the one it makes most sense to stick with.

    One line of evidence about this comes from dynamics of patenting. You know what’s a pretty good predictor of patent activity in the future? Patent activity in the recent past. In this post, I want to see what we can learn from a literature that directly or indirectly looks at this dynamic. But while I think this line of evidence is useful, I want to be up front that it also has significant limitations. Most importantly, in this literature we almost never get anything like an experiment. Instead, we’re reading the tea leaves in observational data.

    Patent Stocks

    Specifically, we’re going to look at the conceptual category of a “patent stock” (also frequently called a “knowledge stock”). To illustrate just what a patent stock is, let’s start with a practical implementation of the notion in a paper.

    Aghion et al. (2016) is a paper interested in three kinds of technological progress among automobiles: clean tech (think electric cars, hydrogen fuel cells, and hybrid vehicles), fossil fuel technology (think internal combustion engine), and “grey” tech (think more fuel efficient fossil fuel technology). The paper measures innovation in these different technologies by counting valuable patents. There are about 2,500 companies and 1,000 individuals who hold one of these patents, and Aghion and coauthors construct three patent stocks for each of these inventive entities, one for each of these three flavors of technological progress. (Constructing patent stocks is hardly the only thing this paper does, but it’s what I’m focusing on today)

    Constructing a patent stock basically means adding up all the patents that an inventive entity has taken out in the past, giving more weight to the more recent patents. To be very explicit, suppose Ford Motor Company had a clean technology patent stock of 1,000 last year and obtains 250 new patents for clean technology this year. Then, to construct the patent stock for current year, we take last years’ patent stock, multiply it by 80%, and then add to that the number of new patents. So this year’s patent stock is 0.8 x 1000 + 250 = 1050. Suppose we get 150 patents next year. Then the patent stock next year is 0.8 x 1050 + 150 = 990. The exact value of 80% isn’t that important and people use different numbers, though always less than or equal to 100%. The key idea is it’s telling us, in a single number, something about the prior patent activity of the Ford Motor Company. Note that last year’s patents are worth less than this year’s patents (in this case, 80% as much). And since we apply the 80% discount each year, patents from two years ago are worth even less (80% x 80% = 64%).

    For the data that Aghion et al. (2016) have, for clean technology, a 10% increase in last year’s clean tech patent stock is associated with a 3% increase in this year’s new clean tech patents (for that firm). For fossil fuel technology, the link is even better: if a firm has a 10% higher patent stock in fossil fuels last year, that’s associated with 5% more new fossil fuel patents this year.

    This is quite a robust (though not universal) finding. Rozendaal and Vollebergh (2021) look at the same context (clean and dirty innovation in automobiles), but with a more recent slice of data (2000-2016, instead of Aghion and coauthors’ 1986-2005). In their sample, they find an even stronger link: roughly speaking, a 10% increase in last year’s patent stock is associated with a 10% increase in patenting this year. Noailly and Smeets (2015) do something similar for innovation in renewable energy and fossil fuel energy (not automobiles). They also find that firms sought many more clean or fossil fuel patents when last year’s patent stock (of the appropriate type) was higher.

    You can also go beyond firms and look at whole countries. Looking specifically at US patents, a famous 2002 paper by David Popp uses a slightly different approach to create patent stocks for 11 different technologies related to energy. He finds that a 10% increase in last year’s patent stock for a particular technology was associated with 7% more patents for that technology this year. And Porter and Stern (2000) compute patent stocks for 17 different OECD countries (looking at patents they seek in the USA, to hold consistent the definition of a patent). Again, a 10% increase in a country’s patent stock last year is associated with 8-11% more patents this year.

    This isn’t a universal finding. Lazkano, Nøstbakken, and Pelli (2017) look at innovation in renewable energy, conventional energy, and storage (battery) technology. Unlike the work discussed above, they typically find the opposite result: a higher patent stock for energy storage technology last year is associated with less energy storage patenting today. Similarly for renewable energy. That said, this paper is the outlier (I’ll return to it briefly later). For now, let’s proceed with the understanding that a positive link between yesterday’s patent stock and today’s patenting is a pretty robust correlation. But before jumping from a correlation to a conclusion, we need to think a bit harder about what’s really going on here. Why is there this correlation?

    (And if you feel like saying “patents don’t measure innovation!” I hear you, but bear with me for a bit)

    What’s Going on Under the Hood?

    One potential explanation is quite interesting. Suppose:

    * Patent stocks measure how much knowledge we have about a technology

    * When we have more knowledge, it’s easier to discover new things

    * The new knowledge we discover gets added to our existing knowledge

    If this is what’s “really” going on, then it explains why we have a positive link between last year’s patent stock and this year’s patenting. Knowledge begets more knowledge! And this is especially true of more recent knowledge, for which we have not already wrung out all the possible implications (hence the higher weight on recent patents).

    If we really believe this story, we can even use the estimated statistical models to make neat little forecasts of how technologies will develop. For every year, we can use last year’s patent stock to predict how many new patents will be discovered. We then use that to predict what next year’s patent stock will be. Rinse and repeat.

    There’s also a policy implication. If we can temporarily accelerate the accumulation of knowledge in a field, it can pay huge dividends. That’s because the benefits will compound, since they’ll enable more knowledge creation next year, which will enable more knowledge creation in the following year and so on.

    Moreover, this model implies path dependence is a powerful force in technology. If one technology gets a minor head start, it might keep it’s lead for a very long time. In fact, if the relationship is strong enough (a 10% increase in the patent stock increases patenting by 10% or more), then all else equal a technology that is a bit behind can never catch up!

    But before we get too far ahead of ourselves, we need to strongly consider some other potentially important explanations.

    Let’s jettison the conceptual category “patent stock” for a minute. So far all we have really shown is that patenting in the recent past…



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit mattsclancy.substack.com
    30 min
  • Building a new research field

    Like the rest of New Things Under the Sun, this article will be updated as the state of the academic literature evolves; you can read the latest version here.

    Suppose we think there should be more research on some topic: asteroid deflection, the efficacy of social distancing, building safe artificial intelligence, etc. How do we get scientists to work more on the topic?

    Buy it

    One approach is to just pay people to work on the topic. Capitalism!

    The trouble is, this kind of approach can be expensive. To estimate just how expensive, Myers (2020) looks at the cost of inducing life scientists to apply for grants they would not normally apply for. His research context is the NIH, the US’ biggest funder of biomedical science. Normally, scientists seek NIH Funding by proposing their own research ideas. But sometimes the NIH wants researchers to work on some kind of specific project, and in those cases it uses a “request for applications” grant. Myers wants to see how big those grants need to be to induce people to change their research topics to fit the NIH’s preferences.

    Myers has data on all NIH “request for applications” (RFA) grant applications from 2002 to 2009, as well as the publication history of every applicant. RFA grants are ones where NIH solicits proposals related to a prespecified kind of research, instead of letting investigators propose their own topics (which is the bulk of what NIH does). Myers tries to measure how much of a stretch it is for a scientist to do research related to the RFA by measuring the similarity of the text between the RFA description and the abstract of each scientist’s most similar previously published article (more similar texts contain more of the same uncommon words). When we line up scientists left to right from least to most similar to a given RFA, we can see the probability they apply for the grant is higher the more similar they are (figure below). No surprise there.

    Myers can also do the same thing with the size of the award. As shown below, scientists are more likely to apply for grants when the money on offer is larger. Again, no surprise there.

    The interesting thing Myers does is combine all this information to estimate a tradeoff. How much do you need to increase the size of the grant in order to get someone with less similarity to apply for the grant at the same rate as someone with higher similarity? In other words, how much does it cost to get someone to change their research focus?

    This is a tricky problem for a couple reasons. First, you have to think about where these RFAs come from in the first place. For example, if some new disease attracts a lot of attention from both NIH administrators and scientists, maybe the scientists would have been eager to work on the topic anyway. That would overstate the willingness of scientists to change their research for grant funding, since they might not be willing to change absent this new and interesting disease. Another important nuance is that bigger funds attract more applicants, which lowers the probability any one of them wins. That would tend to understate the willingness of scientists to change their research for more funding. For instance, if the value of a grant increases ten-fold, but the number of applicants increases five-fold, then the effective increase in the expected value of the grant has only doubled (I win only a fifth as often, but when I do I get ten times as much). Myers provides some evidence that the first concern is not really an issue and explicitly models the second one.

    The upshot of all this work is that it’s quite expensive to get researchers to change their research focus. In general, Myers estimates getting one more scientist to apply (i.e., getting one whose research is typically more dissimilar than any of the current applicants, but more similar than those who didn’t apply) requires increasing the size of the grant by 40% or nearly half a million dollars over the life of a grant!

    Sell it

    Given that price tag, maybe a better approach is to try and sell scientists on the importance of the topic you think is understudied. Academic scientists do have a lot of discretion in what they choose to study; convince them to use it on the topic you think is important!

    The article “Gender and what gets researched” looked at some evidence that personal views on what’s important do affect what scientists choose to research: women are a bit more likely to do female-centric research then men, and men who are exposed to more women (when their schools go coed) are more likely to do gender-related research. But we also have a bit of evidence from other domains that scientists do shift priorities to work on what they think is important.

    Perhaps the cleanest evidence comes from Hill et al. (2021), which looks at how scientists responded to the covid-19 pandemic. In March 2020, it became clear to practically everyone in the world that more information on covid-19 and related topics was the most important thing in the world for scientists to work on. The scientific community responded: by May 2020 and through the rest of the year, about 1 in every 20-25 papers published was related to covid-19. And I don’t mean 1 in every 20-25 biomedical papers - I mean all papers!

    This was a stunning shift by the standards of academia. For comparison, consider Packalen and Bhattacharya (2011), which looks at how biomedical research changed over the second-half of the twentieth century. Packalen and Bhattacharya classify 16 million biomedical publications, all the way back to 1950 and look at the gradual changes in disease burden that arise due to the aging of the US population and the growing obesity crisis. As diseases associated with being older and more obese became more prevalent in the USA, surely it was clear that those diseases were more important to research. Did the scientific establishment respond by doing more research related to those diseases?

    Sort of. As diseases related to the aging population become more common, the number of articles related to those diseases does increase. But the effect is a bit fragile - it disappears under some statistical models and reappears in others. Meanwhile, there seems to be no discernible link between the rise of obesity and research related to diseases more prevalent in a heavier population.

    Further emphasizing the extraordinary pivot into covid-related research, most of this pivot preceded changes in grant funding. The NIH did shift to issuing grants related to covid, but with a considerable lag, leaving most scientists to do their work without grant support. As illustrated below, the bulk of covid related grants arrived in September, months after the peak of covid publications (the NSF seems to have moved faster).

    On the one hand, I think these studies do illustrate the common-sense idea that if you can change scientists beliefs about what research questions are important, then you can change the kind of research that gets done. But on the other hand, the weak results in Packalen and Bhattacharya (2011) are a bit concerning. Why isn’t there a stronger response to changing research needs, outside of global catastrophes?

    It’s hard

    I would point to two challenges to swift responses in science; these are also likely reasons why Myers (2020) finds it so expensive to induce scientists to apply for grants they would not normally apply for. Both reasons stem from the fact that a scientific contribution isn’t worth much unless you can convince other scientists it is, in fact, a contribution.

    The first challenge with convincing scientists to work on a new topic is there need to be other scientists around who care about the topic. This is related to the model presented in Akerlof and Michaillat (2018). Akerlof and Michaillat present a model where scientists’ work is evaluated by peers who are biased towards their own research paradigms. They show that if favorable …



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit mattsclancy.substack.com
    19 min
  • Gender and What Gets Researched

    Like the rest of New Things Under the Sun, this article will be updated as the state of the academic literature evolves; you can read the latest version here.

    How do scientists and inventors decide what to work on? Part of it comes down to what they find personally meaningful. And that, in turn, can be informed by your specific life experiences.

    We can actually see this in data, if we look in the right places. Every human life is unique, but in this article we’re going to collapse diverse life experiences down into something quite crude: binary gender. This can be a useful exercise because, as we’ll see in a minute, there are a variety of non-controversial strands of evidence that women are slightly more likely to work on some things than men, and that this may well reflect different perceptions on what questions are meaningful (likely derived from lived experience). But it’s also an exercise fraught with risks, because there may well be a variety of other factors that lead men and women to work on different topics.

    For example, it turns out that the share of scientists who are women differs a lot across fields. Over 1990-2011, West et al. (2013) find that 41% of published authors in sociology are women, compared to just 14% of authors in economics. Should we read this as evidence that different life experiences lead men and women to have different interests in sociology, relative to economics? I don’t think so, as there are many other possible barriers to entry in one field relative to another: discrimination or bias, culture, access to networks, and so on.

    But cognizant of these risks, we can still look at the choices people make within a specific, narrow, field. That won’t completely rule out the possibility that the choices of research question is constrained by bias and discrimination (even within a specific subfield), but it’s an informative place to start.

    Gender and the Direction of Technological Innovation

    Koning, Samila, and Ferguson (2021) analyze a set of ~400,000 US biomedical patents from 1976-2010. For each patent, they classify the gender of the inventors based on their names (they can match 98% of inventors with 95% confidence; note they have a binary classification of gender, which they point out is a not appropriate in all cases). They next run a sample of the text of these biomedical patents through an algorithm designed to classify academic articles into different biomedical categories. This algorithm classifies about 13% of these biomedical patents as being related to “female organs, diseases, physiologic processes, genetics, etc.” and another 13% as being related to male analogues. They also cross-check these classifications with a variety of alternative metrics: are patents classified as having a female focus more likely to be based on all-female clinical trials? Are they more likely to be related to diseases that have much higher incidence in women than men?

    They find that patents where the majority of the inventors are men are more likely to patent male-focused patents and patents where the majority of the inventors are women are more likely to patent female-focused patents.

    Einiö, Feng, and Jaravel (2019) find something similar using a variety of other datasets.

    Via Nielsen data, they have information on a sample of households that purchase a wide range of specific consumer products, as well the barcode associated with each product. They can link these barcodes back to the manufacturing firm, which they can then link to patents owned by these firms. Finally, they can use the same strategy as Koning, Samila, and Ferguson to classify the inventors on these patents as men or women. This lets them draw a connection between the gender of inventors and the gender of the people purchasing products manufactured by the companies that own these patents. They find, indeed, that products that are disproportionately purchased by female households also have a higher share of female inventors.

    Stepping away from patents, they also use data from Crunchbase to identify startups with female founders, and use the same Nielsen data to assess the gender of purchasers of these startups’ products. They find that startups with a female founder are also more likely to sell products with a disproportionately female consumer base.

    So along three different axis, we see that inventors who are women (or at least, have names traditionally given to women) are more likely to develop new products and new technologies that appeal to women, as compared to inventors who are probably men. We can see a similar effect when we look at research papers.

    Gender and the Direction of Science

    Koning, Samila, and Ferguson (2021) also perform a similar exercise on biomedical science. They extract data on about 2 million biomedical research articles published between 2002 and 2020 and once again classify the authors as male or female based on their names. They focus this analysis on original research published in journals whose articles tend to be highly cited by patents (because this paper’s main focus was on patents).

    There’s no need to process these articles through a machine-learning algorithm to see if they focus on female or male related topics (i.e., pertain to female/male organs, diseases, physiologic processes, genetics, etc.), since the articles had already been classified into biomedical categories as part of the publication process. Again, they find articles with more women as authors are more likely to focus on female topics. The following figure is how much more likely a given article is to be female-focused, estimated with two different statistical models.

    (If interested - the black estimate comes from a basic regression, controlling for journal-year and team size-year commonalities, the gray one from a model where teams are matched to all-male control teams that are observationally similar).

    Nielsen et al. (2017) looks at the influence of gender on biomedical research in a different way. Rather than seeing if papers are classified as pertaining to male or female biomedical categories, Nielsen and coauthors look to see if the gender of the author affects the probability papers incorporate gender and sex analysis, defined by them as “scientific approaches that are aimed at understanding how social and behavioral differences between women, men and gender-diverse people (gender analysis) and biological differences between female and male research subjects (sex analysis) relate to health outcomes.” The GenderMed dataset identifies approximately 5,000 papers, published between 2008 and 2015, incorporating such an analysis. Over the same period, about 1.5 million papers were published on diseases for which such an analysis can be relevant, so a gender and sex analysis is a pretty rare event (3 in 1,000 papers). Nonetheless, Nielsen and coauthors find papers with more women coauthors were more likely to include such an analysis, even within a specific disease category and country.

    First and Second Order Effects of Representation

    These differences are never huge, but they are persistent across quite a range of evidence. It seems to me pretty likely this reflects either a relative lack of awareness or a relative lack of empathy by male scientists/inventors about the importance of these issues. That, in turn, supplies one reason why representation in science is important. If we want research to broadly reflect the priorities of society at large, and if a part of society is not represented in the research space, the above evidence suggests we’re not going to get the kind of research we want.

    That’s a first order effect: if you want research related to a specific group, the chances of getting it may be higher if that group is able to participate in the research process. But there is also a secon…



    This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit mattsclancy.substack.com
    15 min