EconLit

Highlights from ASSA 2023

James Bailey1 Comment

I expected the meetings would shrink, but I was still surprised by how much they did:

That said, I mostly didn’t notice the smaller numbers on the ground, because most of the missing people are those on the job market, who used to spend most of their time shut away doing interviews anyway. There was still a huge variety of sessions and most seemed well-attended. ASSAs is also still unparalleled for pulling in top names to give talks; I got to talk to Nobel laureate Roger Myerson at a reception. But there may be a trend of the big names being more likely to stay remote:

The big problem with attendance falling to 6k is that they’ve planned years worth of meetings with the assumption of 12k+ attendance. Getting one year further from Covid and dropping mask and vaccine mandates might help some, but the core issue is that 1st-round job interviews have gone remote and aren’t coming back. The best solution I can think of is raising the acceptance rate for papers, which in recent history has been well under 20%.

In terms of the actual economic research, two sessions stood out to me:

How many factors are there in the stock market? Classic work by Fama and French argues for 3 (size, value, and market risk), but the finance literature as a whole has identified a “zoo” of over 500. Two papers presented one after the other at ASSA argued for two extremes. “Time Series Variation in the Factor Zoo” argues that the number of factors varies over time, but is quite high, typically over 20 and sometimes over 100:

In contrast, “Three Common Factors” argues that there really are just 3 factors, though they are latent and not the same as the Fama-French 3 factors. In this case, the whole zoo of factors in the literature is mostly non-robust results driven by p-hacking and a desire to find more factors (fortune and fame potentially await those who do). Overall these asset pricing papers make me want to look into all this myself; when reading them I’m always struck by an odd mix of reactions- “I don’t understand that”, “why would you do it that way, it seems wrong and unnecessarily complicated”, and “why didn’t the field settle such a seemingly basic question decades ago?”.

Hayek: A Life this session covered the new book by Bruce Caldwell (who taught me much of what I know of the history of economic thought) and Hansjoerg Klausinger. Discussants Emily Skarbek and Stephen Durlauf agreed it is surprisingly readable for a long work of original scholarship, calling it a beautifully written 800p pageturner. Vernon Smith asked Caldwell if Hayek read the Theory of Moral Sentiments. Caldwell: “he cited it.” Smith: “but did he read it? Seems like he didn’t understand it very well.” Caldwell agreed he may not have, or if he did it was a German translation.

Vernon Smith’s own talk featured great comments on market instability: instability in markets comes from retrading. Markets are stable when consumers just value goods for their use, like haircuts and hamburgers. The craziness and potential for bubbles and crashes comes in when people are thinking about reselling something, whether it be tulips, stocks, houses, or crypto.

I asked Bruce Caldwell at a reception how he was able to finish writing such a big book that involved lots of archival work and original research. He said “one chapter at a time”, and noted that its fine to write the easiest chapters first to get the ball rolling.

Overall, while ASSA is diminished from the pre-Covid days and I often disagree with the AEAs decisions, its still a top-tier conference, especially when in New Orleans.

College Major, Marriage, and Children Update

James Bailey2 Comments

In a May post I described a paper my student my student had written on how college majors predict the likelihood of being married and having children later in life.

Since then I joined the paper as a coauthor and rewrote it to send to academic journals. I’m now revising it to resubmit to a journal after referee comments. The best referee suggestion was to move our huge tables to an appendix and replace them with figures. I just figured out how to do this in Stata using coefplot, and wanted to share some of the results:

Points represent marginal effects of coefficient estimates from Logit regressions estimating the effect of college major on marriage rates relative to non-college-graduates. All regressions control for sex, race, ethnicity, age, and state of residence. MarriedControls additionally controls for personal income, family income, employment status, and number of children. Married (blue points) includes all adults, others include only 40-49 year-olds. Lines through points represent 95% confidence intervals.
Points represent coefficient estimates from Poisson regressions estimating the effect of college major on the number of children in the household relative to non-college-graduates. All regressions control for sex, race, ethnicity, age, and state of residence. ChildrenControls additionally controls for personal income, family income, employment status, and number of children. Children (blue points) includes all adults, others include only 40-49 year-olds. Lines through points represent 95% confidence intervals.

Many details have changed since Hannah’s original version, and a lot depends on the exact specification used. But 3 big points from the original paper still stand:

  1. Almost all majors are more likely to be married than non-college-graduates
  2. The association of college education with childbearing is more mixed than its almost-uniformly-positive association with marriage
  3. College education is far from uniform; differences between some majors are larger than the average difference between college graduates and non-graduates

Empirical Papers for Undergraduate Statistics Students

Joy BuchananLeave a comment

Once undergraduates have learned the basics of interpreting regression results, we would like to introduce them to the world of economics research papers. Reading these papers will help reinforce the statistical concepts, and also we want them to get access to the insights in the literature.

Many empirical papers in economics are too long or too difficult to assign to undergraduates, especially if the course is focused more on analytics than economics specifically. Here I provide materials and instructions for teaching two published econ articles to undergraduates. Assume the students have learned the basics of interpreting a regression model (perhaps from a course textbook) but have had few opportunities to apply theses skills or engage in scientific literature.

“The Effects of Attendance on Student Learning in Principles of Economics” is only 4 pages long! Students do not need to read past page 7 of “My Reference Point, Not Yours” to answer the reading guide questions. So, these readings can be assigned outside of class, but I did some of the reading during our class period.

Handing out printed copies of at least one of the papers and my guided questions can make a good classroom activity. If students do not have experience reading tables of regression results, it can be useful to do it together in person.

The questions in the reading guide help students to identify the main variables and hypotheses. Then, students are asked to pull specific results from the tables in the papers. You can customize this list of questions by deleting lines if you do not want to discuss issues like non-linear effects or the null hypothesis.

I provide links below. First is the reading guide with about 30 short-answer questions about the two articles.

  1. Link to download the reading guide that goes with both papers, starting with the shorter one.
readingguideempiricalpapersDownload link for the reading guide questions (Word doc)

2. This is a web link to download the Effects of Attendance paper. (4 pages long and the topic is relatable to undergraduates)

3. Two web sources for “My Reference Point, Not Yours” (15 pages in total in the JEBO manuscript, but students do not need to read past page 7 for this exercise, and they can skip the Literature Review section)

JEBO link: https://www.sciencedirect.com/science/article/abs/pii/S0167268120300299

SSRN working paper link: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3434182

Mises’s Interventionism, A Recap

Zachary Bartsch1 Comment

I suspect that Mises may have felt somewhat restless after writing Socialism. He had taken a very good stab at describing the socialist economy and its inadequacy for the promotion of human flourishing. By 1940 fascism had arisen in both Italy and in Germany, who Mises considered the clear antagonists of World War II. Further, the communist Soviets were allied with Germany at the time of writing Interventionism.

A communist-fascist alliance may seem strange to idealogues, but it appeared quite natural to Mises that the two distasteful versions of socialism should find cooperation convenient to achieve their own ends. In America, the revelations of German atrocities had yet to arrive and there were many sympathizers with both Russia and Germany. In Britain, union leaders were promoting the idea of socialism as a reward to the public who would be bearing the costs of the war.

Mises thought that the disfunction of socialism was adequate to describe its ultimate failure as an economic system. However, socialist tendencies were pervasive in the liberal market economies among both idealogues and demagogues enough to make the transition to socialism a very real threat. After all, while socialism may not be a stable regime in a dynamic world, certain features within specific market economies may nonetheless tend toward it. What is the cause of such tendencies?

Continue reading →

New Data: State Regulatory Procedures

James BaileyLeave a comment

Released this April, but I just heard about it today. Researchers did the painstaking work of going through all 50 states to determine which steps must be taken in each state before new regulations can take effect. For instance, it turns out half of states require economic analysis for new regulations, and half don’t. The paper is here: https://www.mercatus.org/publications/regulation/50-state-review-regulatory-procedures

New Double Auction Paper

Joy BuchananLeave a comment

This weekend I am at the Economic Science Association meeting.

Most of the economists in this group use experiments as part of their empirical research. In this post I will highlight some recently published work that is in the tradition of Vernon Smith, who influenced all of us so much.

Martinelli, C., Wang, J. & Zheng, W. Competition with indivisibilities and few traders. Experimental Economics (2022). https://doi.org/10.1007/s10683-022-09772-9

Abstract: We study minimal conditions for competitive behavior with few agents. We adapt a price-quantity strategic market game to the indivisible commodity environment commonly used in double auction experiments, and show that all Nash equilibrium outcomes with active trading are competitive if and only if there are at least two buyers and two sellers willing to trade at every competitive price. Unlike previous formulations, this condition can be verified directly by checking the set of competitive equilibria. In laboratory experiments, the condition we provide turns out to be enough to induce competitive results, and the Nash equilibrium appears to be a good approximation for market outcomes. Subjects, although possessing limited information, are able to act as if complete information were available in the market.

This small excerpt from their results shows a market converging toward equilibrium over time, under different treatment conditions. With some opportunities for practice and feedback, agents create surplus value by trading.

Figure 4 plots the average efficiency in each round in the four treatments. Efficiency is defined as the percentage of the maximum social surplus realized. … learning takes longer under the clearing house institution; hence, average efficiency under the clearing house institution presents a stronger upward trend over time. Under the clearing house institution, the average efficiencies start at levels lower than under the double auction institution, and remain statistically lower in the second half of the experiment. Nevertheless, we can observe from Fig. 4 that the upward trend of the efficiencies in clearing house treatments persist over time, and at the end of the experiment, the efficiency levels from the two institutions are close.

But Who Will Build the Roads? 19th Century Edition

Jeremy Horpedahl1 Comment

In the United States and much of the developed world today, most roads are publicly provided, i.e., they are built and operated by governments. This is not exclusively true, as many private toll roads exist, but the vast majority of roads are owned and operated by governments. Must it be this way?

A recent working paper by Alan Rosevear, Dan Bogart, and Leigh Shaw-Taylor looks at a very important case study: Britain in the 19th century. Britain is important because they were the leading economy in the world at the time, at the forefront of the Industrial Revolution. How were roads built and improved in England and Wales at this time? Here’s what the authors have to say in the abstract:

“non-profit organizations, known as turnpike trusts, built more new roads by attracting private investors and capable surveyors. We also show the Government Mail Road had the highest quality. Nevertheless, most turnpike trust roads were good quality, indicating their practical achievements.”

In the conclusion of the paper, they further add:

“Our analysis demonstrates that turnpike trusts were responsible for building 4,000 miles of new, good quality road in England and Wales, much of it between 1810 and 1838. On a directly comparable basis, the not-for-profit trusts built thirty times the mileage than had been built with direct Government funding during the early 1800s.”

To be clear, this paper is not a completely new discovery. It was already well-known that private companies built roads in Britain, as the authors make clear in their literature review. Similarly, there were many private turnpikes and toll roads in the US in the 19th century, as summarized in an encyclopedia entry by Klein and Majewski.

The Rosevear et al. paper adds new important details. First, they document the extent of private road building and improvements in the 19th century. Second, they show that these roads were generally of good quality, or at least they were of good quality for the time. Prior research had not documented these facts, thus making this a very important advance in our understanding of this time period. But perhaps more importantly, we see the possibility that many more roads today could be privately built and funded with user fee, especially considering that we are much, much wealthier today than 19th century Britain, we have more extensive and functional capital markets for raising the funds, etc.

An intervention for children to change perceptions of STEM

Joy Buchanan1 Comment

Here is a a new paper related to the topic of women getting into technical fields (see previous post on my paper about programming).

Grosch, Kerstin, Simone Haeckl, and Martin G. Kocher. “Closing the gender STEM gap-A large-scale randomized-controlled trial in elementary schools.” (2022).

These authors were thinking about the same problem at the same time, unbeknownst to me. In their introduction they write, “We currently know surprisingly little about why women still remain underrepresented in STEM fields and which interventions might work to close the gender STEM gap.”

My conclusion from my paper is that, by college age, subjective attitudes toward tech are very important. This leads to the questions of whether those subjective attitudes are shaped at younger ages. Grosch et al. have run an experiment to target 3rd-graders with a STEM-themed game. I’ll quote their description:

The treatment web application (treatment app) intends to increase interest in STEM directly by increasing knowledge and awareness about STEM professions and indirectly by addressing the underlying behavioral mechanisms that could interfere with the development of interest in STEM. The treatment app presents both fictitious and real STEM professionals, such as engineers and programmers, on fantasy planets. Accompanied by the professionals, the children playfully learn more about various societal challenges, such as threats from climate change and to public health, and how STEM skills can contribute to combating them. The storyline of the app comprises exercises, videos, and texts. The app also informs children about STEM-related content in general. To address the behavioral mechanisms, the app uses tutorials, exercises, and (non-monetary) rewards that teach children a growth mindset and improve their self-confidence and competitive aptitude. Moreover, the app introduces female STEM role models to overcome stereotypical beliefs. To test the app’s effect, we recruited 39 elementary schools in Vienna (an urban area) and Upper Austria (a predominantly rural area).

This is a preview of their results, although I recommend reading their paper to understand how these measurements were made:

Girls’ STEM confidence increases significantly in the treatment group (difference: 0.047 points or 0.28 standard deviations, p = 0.002, Wald test), and the effect for girls is significantly larger than the effect for boys.

Result 2: Children’s competitiveness is positively associated with children’s interest in STEM. We do not find evidence that stereotypical thinking and a growth mindset is associated with STEM interest.

Lastly, my kids play STEM-themed tablet games. PBS Kids has a great suite of games that are free and educational. Unfortunately, I have not tried to treat one kid while giving the other kid a placebo app, so my ability to do causal inference is limited.

Willingness to be Paid Treatments

Joy Buchanan1 Comment

This is the second of two blog posts on my paper “Willingness to be Paid: Who Trains for Tech Jobs”. Follow this link to download the paper from Labour Economics (free until November 27, 2022).

Last week I focused on the main results from the paper:

  • Women did not reject a short-term computer programming job at a higher rate than men.
  • For the incentivized portions of the experiment, women had the same reservation wage to program. Women also seemed equally confident in their ability after a belief elicitation.
  • The main gender-related outcomes were, surprisingly, null results. I ran the experiment three times with slightly different subject pools.
  • However, I did find that women might be less likely to pursue programming outside of the experiment based on their self-reported survey answers. Women are more likely to say they are “not confident” and more likely to say that they expect harassment in a tech career.
  • In all three experiments, the attribute that best predicted whether someone would program is if they say they enjoy programming. This subjective attitude appears more important even than having taken classes previously.
  • Along with “enjoy programming” or “like math”, subjects who have a high opportunity cost of time were less willing to return to the experiment to do programming at a given wage level.

I wrote this paper partly written to understand why more people are not attracted to the tech sector where wages are high. This recent tweet indicates that, although perhaps more young people are training for tech than ever before, the market price for labor is still quite high.

The neat thing about controlled experiments is that you can randomly assign treatment conditions to subjects. This post is about what happened after adding either extra information or providing encouragement to some subjects.

Informed by reading the policy literature, I assumed that a lack of confidence was a barrier to pursuing tech. A large study done by Google in 2013 suggested that women who major in computer science were influenced by encouragement.

I provided an encouraging message to two treatment groups. The long version of this encouraging message was:

If you have never done computer programming before, don’t worry. Other students with no experience have been able to complete the training and pass the quiz.

Not only did this not have a significant positive effect on willingness to program, but there is some indication that it made subjects less confident and less willing to program. For example, in the “High Stakes” experiment, the reservation wage for subjects who had seen the encouraging message was $13 more than for the control subjects.

My experiment does not prove that encouragement never matters, of course. Most people think that a certain type of encouragement nudges behavior. My results could serve as a cautionary tale for policy makers who would like to scale up encouragement. John List’s latest book The Voltage Effect discusses the difficulty of delivering effective interventions at scale.

The other randomly assigned intervention was extra information, called INFO. Subjects in the INFO treatment saw a sample programming quiz question. Instead of just knowing that they would be doing “computer programming,” they saw some chunks of R code with an explanation. In theory, someone who is not familiar with computer programming could be reassured by this excerpt. My results show that INFO did not affect behavior. Today, most people know what programming is already. About half of subjects said that they had already taken a class that taught programming. Perhaps, if there are opportunities for educating young adults, it would be in career paths rather than just the technical basics.

Since the differences between treatments turned out to be negligible, I pooled all of my data (686 subjects total) for certain types of analysis. In the graph below, I group every subject as either someone who accepted the programming follow-up job or as someone who refused to return to program at any wage. Recall that the highest wage level I offered was considerably higher on a per-hour basis than what I expect their outside earning option to be.

Fig. 5. Characteristics of subjects who do not ask for a follow-up invitation, pooling all treatments and sample

I’ll discuss the three features in this graph in what appear to be the order of importance for predicting whether someone wants to program. There was an enormous difference in the percent of people who were willing to return for an easy tedious task that I call Counting. By inviting all of these subjects to return to count at the same hourly rate as the programming job, I got a rough measure of their opportunity cost of time. Someone with a high opportunity cost of time is less likely to take me up on the programming job. This might seem very predictable, but this is a large part of the reason why more Americans are not going into tech.

Considering the first batch of 310 subjects, I have a very clean comparison between the programming reservation wage and the reservation wage for counting. People who do not enjoy programming require a higher payment to program than they do to return for the counting job. Self-reported enjoyment is a very significant factor. The orange bar in the graph shows that the majority of people who accepted the programming job say that they enjoy programming.

Lastly, the blue bar shows the percent of female subjects in each group. The gender split is nearly the same. As I show several ways in the paper, there is a surprising lack of a gender gap for incentivized decisions.

I hope that my experiment will inspire more work in this area. Experiments are neat because this is something that someone could try to replicate with a different group of subjects or with a change to the design. Interesting gaps could open up between subject types under new circumstances.

The topic of skill problems in the US represents something reasonably new for labor market and public policy discussions. It is difficult to think of a labor market issue where academic research or even research using standard academic techniques has played such a small role, where parties with a material interest in the outcomes have so dominated the discussion, where the quality of evidence and discussion has been so poor, and where the stakes are potentially so large.

Cappelli, PH, 2015. Skill gaps, skill shortages, and skill mismatches: evidence and arguments for the United States. ILR Rev. 68 (2), 251–290.

Willingness to be Paid Paper Accepted

Joy Buchanan4 Comments

I am pleased to announce that my paper “Willingness to be Paid: Who Trains for Tech Jobs?” has been accepted at Labour Economics.

Having a larger high-skill workforce increases productivity, so it is useful to understand how workers self-select into high-paying technology (tech) jobs. This study examines how workers decide whether or not to pursue tech, through an experiment in which subjects are offered a short programming job. I will highlight some results on gender and preferences in this post.

Most of the subjects in the experiment are college students. They started by filling out a survey that took less than 15 minutes. They could indicate whether or not they would like an invitation for returning again to do computer programming.

Subjects indicate whether they would like an invitation to return to do a one-hour computer programming job for $15, $25, $35, …, or $85.[1]This is presented as 9 discrete options, such as:

“I would like an invitation to do the programming task if I will be paid $15, $25, $35, $45, $55, $65, $75 or $85.”,

or,

“I would like an invitation to do the programming task if I will be paid $85. If I draw a $15, $25, $35, $45, $55, $65 or $75 then I will not receive an invitation.”,

and the last choice is

“I would not like to receive an invitation for the programming task.”

Ex-ante, would you expect a gender gap in the results? In 2021, there was only 1 female employee working in a tech role at Google for every 3 male tech employees. Many technical or IT roles exhibit a gender gap.

To find a gender gap in this experiment would mean female subjects reject the programming follow-up job or at least they would have a different reservation wage. In economics, the reservation wage is the lowest wage an employee would accept to continue doing their job. I might have observed that women were willing to program but would reject the low wage levels. If that had occurred, then the implication would be that there are more men available to do the programming job for any given wage level.

However, the male and female participants behaved in very similar ways. There was no significant difference in reservation wages or in the choice to reject the follow-up invitation to program. The average reservation wage for the initial experiment was very close to $25 for both males and females. A small number of male subjects said they did not want to be invited back at even the highest wage level. In the initial experiment, 5% of males and 6% of females refused the programming job.

The experiment was run in 3 different ways, partly to test the robustness of this (lack of) gender effect. About 100 more subjects were recruited online through Prolific to observe a non-traditional subject pool. Details are in the paper.

Ex-ante, given the obvious gender gap in tech companies, there were several reasons to expect a gender gap in the experiment, even on a college campus. Ex-post, readers might decide that I left something out of the design that would have generated a gender gap. This experiment involves a short-term individual task. Maybe the team culture or the length of the commitment is what deters women from tech jobs. I hope that my experiment is a template that researchers can build on. Maybe even a small change in the format would cause us to observe a gender gap. If that can be established, then that would be a major contribution to an important puzzle.

For the decisions that involved financial incentives, I observed no significant gender gaps in the study. However, subjects answered other questions and there are gender gaps for some of the self-reported answers. It was much more likely that women would answer “Yes” to the question

If you were to take a job in a tech field, do you expect that you would face discrimination or harassment?

I observed that women said they were less confident if you just asked them if they are “confident”. However, when I did an incentivized belief elicitation about performance on a programming quiz, women appear quite similar to men.

Since wages are high for tech jobs, why aren’t more people pursing them? The answer to that question is complex. It does not all boil down to subjective preferences for technical tasks, however in my results enjoyment is one of the few variables that was significant.

People who say they enjoy programming are significantly more likely to do it at any given wage level, in this experiment.

Fig. 3 Histogram of reservation wage for programming job, by reported enjoyment of computer programming (CP) and gender, pooling all treatments and samples

Figure 3 from the paper shows the reservation wage of participates from all three waves. Subjects who say that they enjoy programming usually pick a reservation wage at or near the lowest possible level. This pattern is quite similar whether you are considering males or females.

Interestingly, enjoyment mattered more than some of the other factors that I though would predict willingness to participate. About half of subjects said they had taken a class that taught them some coding, but that factor did not predict their behavior in the experiment. Enjoyment or subjective preferences seemed to matter more than training. To my knowledge, policy makers talk a lot about training and very little about these subjective factors. I hope my experiment helps us understand what is happening when people self-select into tech. Later, I will write another blog about the treatment manipulation and results, and perhaps I will have the official link to the article by then.

Buchanan, Joy. “Willingness to be Paid: Who Trains for Tech Jobs.” Labour Economics.

[1] We use a quasi-BDM to obtain a view of the labor supply curve at many different wages. The data is not as granulated as that which a traditional Becker-DeGroot-Marschak (BDM) mechanism obtains, but it is easy for subjects to understand. The BDM, while being theoretically appropriate for this purpose, has come under suspicion for being difficult for inexperienced subjects to understand (Cason and Plott, 2014). We follow Bartling et al. (2015) and use a discrete version.