How to be a Quant
Since writing about my experience writing the CFA Level I exam in June, I have received many emails from people interested in finding out how to become a quant. To some extent this post will answer that question. That said, this post is actually not about how to become a quant, it is about how to be a quant in whatever sector of the financial services industry you already work in. Being is quant isn't rocket science, it's really just an ideology.
In my opinion, quantitative finance should be viewed as a science and not as a profession. This means that knowing how to become a quant is less important than knowing how to be a quant. The latter deals with the principles and ideologies of quantitative finance (which I believe can be applied successfully in any area of finance or technology), whereas the former deals with the practical activities it takes to get a job with the title 'quant'.
At a fundamental level being a quant is not just about knowing how to derive closed form formulas for estimating the value of an exotic option given some stochastic model nor is being a quant just about knowing how to develop, train, and test systematic trading strategies which use statistical regression models. Being a quant is about believing in and applying the scientific method to the study of financial markets in general.
This ideology gained popularity with the valuation of derivatives (quantitative analysts), but quickly spread to risk management (quantitative risk analysts), and asset management and trading (quantitative traders and strategists). I predict that in coming decades this ideology will continue its spread into fields such as corporate finance, investment banking, private equity, and even venture capital. In each field it may take on a different form, evolve slightly, and maybe even take on a new name (data science?), but the ideology will remain the same.
The remainder of this article will attempt to articulate what I believe it means to be a quant. That having been said, I have only been a quant for a few years so my views are still developing, so should you find anything disagreeable or wish to add something please let me know in the comment section below. The article is divided into three parts:
- Part 1 - The philosophy of science
- Part 2 - The scientific method
- Part 3 - Thinking with models
- And lastly, conclusions and final remarks.
The Philosophy of Science
How to be a quant ~ Know the limitations of empirical science and inductive reasoning. Understand that all financial theories are fallible and all quantitative models are fragile.
During my honours degree in Computer Science the rest of my class and I were forced to do a year-long module called "research methodologies". The two textbooks for the module were Philosophy of Science: From Problem to Theory and Philosophy of Science: From Explanation to Justification both by Mario Bunge. Despite our professor's best efforts to make the subject as boring as possible, I enjoyed learning about the philosophy of science and have found many of the ideas presented in the module useful during my career as a quant.
The philosophy of science is a branch of philosophy which deals with the logical foundations, methods, and implications of science. Broadly speaking it tries to answer the questions: 'what is science?', 'why does science work?', and 'what are the limitations of science?'. Over time different and sometimes contradictory philosophies of science have formed. These include, but are not limited to, scientific realism vs. constructive empiricism vs. instrumentalism, induction vs. deduction vs. abduction, and even logical positivism vs. falsifiability.
For an interesting diagram showing each of these philosophies relative to each other, click here.
Realism vs. Empiricism
Realism is the view that the world described by science is the real world and not instead what the real world is perceived to be. Empiricism, on the other hand, is the view that because knowledge is based on experiences, all knowledge is tentative and probabilistic and, therefore, subject to revision and falsification. Various forms of realism and empiricism which differ in terms of their strictness do exist e.g. Scientific vs. Structural Realism.
The main argument in favour of realism over empiricism is the accuracy of scientific theories. In other words, if a theory is accurate, meaning that it can be used to predict what happens in the real world, then it must describe the real world. Whilst this may be mostly true in physics, given the inadequacy of financial theories, I think that we should recognize financial theories as tentative in nature and subject to refinement and falsification.
Deduction vs. Induction vs. Abduction
The philosophy of science distinguishes between a few different forms of logical reasoning.
Deductive reasoning (deduction) involves reasoning from one or more logical premises to reach a certain logical conclusion. Deductive reasoning is the form of reasoning found in mathematics and the formal methods of Computer Science, it connects sound premises with conclusions which are, by necessity, true.
Abductive reasoning (abduction) is a slightly weaker form of deductive reasoning which argues that the conclusions obtained through deductive reasoning may not be true by necessity, but that they will always be the best possible conclusion given the available data and premises.
Inductive reasoning (induction) involves reasoning from one or more strong premises which are based on evidence and observations to a reach a conclusion which is probabilistically true given the supporting evidence. Inductive reasoning can never be proven true, only falsified when contradictory evidence is observed.
The flaw of inductive reasoning is that knowledge obtained through induction is fragile. This is epitomized by the story of the black swan. If every observed swan up until now has been white, we may use this evidence to reason that "all swans must by white"; however, it takes just one observation of a black swan to falsify the theory. As such, knowledge obtained through inductive reason is said to be fragile. This is the premise of Nassim Taleb's research.
Quantitative theories about the market are built on inductive reasoning made from empirical observations. As such these theories are typically fragile and can be invalidated or falsified in the presence of contradictory evidence (outliers and black swans not predicted by the model). This is however only true in theory, and in practice most theories are subscribed to religiously and contradictory evidence is, more often than not, simply ignored.
You may be wondering how the philosophy of science helps you be a quant? I believe that it is important because it forces us recognize our limitations, it keeps us objective, but most importantly it reminds us that even though some financial theories are so deeply ingrained into our profession that they may appear infallible to empirical results which refute them, they are not. Having made this statement some economic models and popular quantitative model assumptions come to mind namely, uncovered interest rate parity (UIP), normally distributed returns, linearity, and stationarity, and the random walk hypothesis / efficient market hypotheses.
The Scientific Method
How to be a quant ~ use the scientific method. It helps guide scientific thinking and will improve the overall testability of your models and their assumptions (hypotheses).
The scientific method is defined as an ongoing process which generally involves systematic observation, quantitative measurement, experimentation, hypothesis formulation, hypothesis testing, and hypothesis refinement. In this section we will walk through this process with respect to the random walk hypothesis.
Here is a very helpful slideshow explaining the scientific method. It is also the source of the below image.
Observations are typically things which we see, however in the context of financial markets observations can extend to ideas that we have come across in books, on the television, or perhaps even whilst reading good (or bad) blogs. Keeping with our example, we might observe that many academic papers and popular books have been published which state that market returns evolve according to a random walk / stochastic process.
Come up with Interesting Questions
Asking interesting questions is almost always about being a little bit skeptical (for a nice take on healthy skepticism read this post by Gestaltu - Empirical Finance: Meeting Fiduciary Standards Through Skepticism, Not Cynicism. Begin by asking the simplest questions: who? what? where? when? why? and how? Just asking these questions can uncover interesting avenues of further research. Let's ask these questions of the random walk hypothesis:
- Who, in terms of markets, does this apply to? Are all markets equally random? How do liquidity and other measures of relative efficiency correlate to measure of market randomness?
- What are the underlying forces which make markets random? Is it really true that efficiency leads to randomness? If the markets are random, there would be no incentive for agents to compete in the markets, so wouldn't the market stop being efficient which implies it would not be random?
- Where are markets random? This ties back to question 1. Are there places in the world where markets are less random for example developing markets? And if so, why? Are the dynamics different?
- When are markets random? Are markets always random, or does this randomness break down during certain non-random regimes? If markets are not always random does this imply that there are profit opportunities?
- Why are markets random? This ties back to question 2. What are the market forces which keep markets random. Assuming the main driver is market efficiency then ...
- How can we measure efficiency and test the random walk hypothesis? Could we simulate an efficient economy using an agent based model and test whether or not the price discovery mechanism is random?
As you can see, this process is, ironically, quite random and many of the questions may have been already answered either fully or partially by previous researchers. This is why doing a literature review is important. Once you have asked enough questions and read enough of the existing literature on the topic some 'good ideas' will start to form in your mind. These are the kinds of ideas we want to formulate into testable scientific hypotheses.
A hypothesis is declarative statement which asserts a particular relationship between a set of variables. Good hypotheses should be concise, declarative, easily testable, and take into consideration the previous body of scientific research (so as to avoid frivolous pursuits). Take, for example, the following interesting idea, which was actually posited by a very passionate reader on my previous blog post:
Market returns exhibit randomness because markets adapt quickly to remove any weaknesses.
Despite the fact that this is a great idea it would make a terrible hypothesis. It leaves many of the terms undefined, is not very easily testable or refutable, and is actually a whole bunch of hypotheses mashed together.
Lets try make some hypotheses from it:
Hypothesis 1 - Market movements (up or down) are indistinguishable from binary Martin Lof random sequences.
This was, of course, the hypothesis behind my previous article entitled, Hacking the Random Walk Hypothesis. As with most research, my study resulted in one fragile conclusion that "markets are not random, at least according to the above definition", and many more questions . These questions typically lead to more hypotheses and more research. As you can see, research, especially when done using the scientific method, is an ongoing process which never truly stops. Let's break down the hypothesis into two more parts:
Hypothesis 2 - Market efficiency, timely accessibility to all information, necessitates that markets evolve randomly.
We will discuss how to possibly test this hypothesis in the next section. However, I would like to draw your attention to two papers written by LeRoy in 1973, Risk aversion and the martingale property of stock prices, and Lucas in 1978, Asset Prices in an Exchange Economy. These papers set out to test whether or not rational agents acting in an exchange economy with timely access to all relevant information necessitates that stock prices move randomly. Their conclusions were that whilst it is possible to construct a market which evolves according to a random walk, it is also possible to not. As such, efficiency does not necessarily imply that markets must be random.
"With respect to the random character of stock prices, it is evident that one can construct rigorous economic models in which price series have this characteristic and ones with equally rational and well-informed agents in which they do not. This would suggest that the outcomes of tests as to whether actual price series have the Martingale property do not in themselves shed light on the generally posed issue of market "efficiency." - Lucas
Lastly, we can break this statement into a third hypothesis which, despite being the most interesting, is the least actively researched. This is mostly due to the difficultly with which is can be tested.
Hypothesis 3 - Regardless of whether markets evolve randomly, all profitable opportunities are crowded out too quickly for investors to generate consistent alpha over time. ... hmmm what an interesting idea.
If we constrained the above hypothesis to a specific time frame e.g. 5 years, and defined alpha perhaps we could test this hypothesis. That having been said, this hypothesis is definitely a bit less concise and declarative than the others and would be harder to refute i.e. it isn't a great hypothesis and could be broken down.
Develop Testable Predictions
To develop predictions start off by assuming your hypothesis were true or false. Now work out what quantities you would expect, or wouldn't expect, to exist. For example, if the first hypothesis I formulated were true, then we would expect that market returns (up or down) would do as well on the NIST suite of cryptographic tests as a sequence whose behavior was known to be a binary Martin Lof sequence. In my previous post I used the Mersenne Twister RNG for comparison and showed that this was not true. This, in turn, implied that the hypothesis was false.
One mistake that many people fall into is that they think that they falsely believe that the objective in doing research is to be right. In actual fact it doesn't matter whether the hypothesis is true or false, what matters is that we have contributed novel information to the existing scientific body of knowledge for a particular problem.
If I were to test the second hypothesis, I might go one step further and develop an agent based model in which efficiency were guaranteed. From this model I would extract return sequences and, once again, test them to see whether or not they were random. We will discuss thinking with models further down in this article.
Gather Data to Test Predictions
This is self explanatory. The only point I would like to add is that the data used to test the predictions could either be gathered from the real world (empirical) or, alternatively, simulated using a model which matches the hypothesis. Both approaches have pros and cons. Empirical data is subject to biases in how it was measured, gathered, and maintained; and simulated data assumes that the model is correctly implemented.
Refine, Alter or Reject Hypotheses
Based on the data collected, we can either say "yes, our predictions were correct, this evidence supports the hypothesis" or "no, our predictions were wrong, the hypothesis is wrong". Notice that in the first outcome the evidence only supports the hypothesis whereas in the second outcome the evidence falsifies the hypothesis. This comes back to the philosophy of science. A hypothesis (or theory) may be falsified, but it cannot ever be proven.
Develop General Theories
Once a sufficient number of hypothesis have been developed and tested rigorously they may be combined into more general theories. For example, it took decades of scientific research into the relationship between risk and return before modern portfolio theory was generally accepted. In fact, at the time of publishing his Ph.D research Markowitz's portfolio theory was almost rejected when he defended it:
... When I defended my dissertation as a student in the Economics Department of the University of Chicago, Professor Milton Friedman argued that portfolio theory was not Economics, and that they could not aware me a Ph.D. degree in Economics for a dissertation which was not about Economics. I assume he was only half serious, since they did award me the degree without long debate. As to the merits of his arguments, at this point I am quite willing to concede: at the time I defended my dissertation, portfolio theory was not part of Economics. But now it is. - Markowitz
I think we can all learn something from this story. Just because an idea you have is unpopular, or not widely accepted, does not necessarily mean that you are wrong. The finance community, in my opinion, is very antiquated and likes to hold onto certain ideals with almost religious tenacity. It is the role of the quant to look at the world of finance objectively and slowly unearth the truths about the financial markets. Seek truth not consensus.
I must award the credit for the Markowitz quote and knowledge about the papers by LeRoy and Lucas to the book, A Non Random Walk down Wall Street, by Andrew Lo and Craig MacKinlay.
Thinking with Models
How to be a quant ~ Formalize your ideas as models. Then use those models to think more clearly, test the validity of your ideas, and identify hidden patterns.
The last part of this article involves thinking with models. A model is a representation of some object or process in the real world. The tools used by quants to build models are Mathematics and Computer Science. For example, a quant might maintain a model of the risks associated with a particular portfolio of assets. But why use models in the first place? Especially when they were one of the biggest contributors to the 2008 Financial Crisis.
Models help us to think more clearly
Taking an idea and developing it into a proper model, whether it be in code, mathematics or both, forces us to very clearly define that idea. Models force us to think about an ideal in terms of its inputs, processing, and outputs. This process just by itself helps us to identify missing components and correct broken ones.
Models are testable; intuitions are not
Once an idea has been codified as a model it is testable. The ultimate test for every model is to see how well it stacks up against the real world. Take for example a geometric Brownian Motion stochastic model of an asset. How does the model compare to the real world? Does it have market crashes? Does it have periods of higher and lower volatility? The answers, of course, are no it doesn't. These differences are what led us to develop more complex stochastic models such as the Merton Jump Diffusion Model and the Heston Stochastic Volatility Model.
Another, more common, test for a model is to see if it would have worked in the past i.e. whether or not it fits the data. Take for example a simple value-biased investment strategy. So long as that strategy is based on the intuition (discretion) of the fund manager you can't back test it to see if it would have generated superior returns in the past. All you can do is hope that the fund manager is as good as he says he is. For those interesting, two fantastic quant blogs who regularly argue the merits of model-based trading are Alpha Architect and Flirting with Models.
Models help us to uncover hidden patterns
Never-mind all the amazing recent developments in pattern recognition using machine learning models such as neural networks; even dead simple models can help us uncover hidden patterns and insights into our world.
Take for example the following simple question: what percentage of people need to be racist in order for the racial segregation of a city to reach 80%? The results may surprise you, because it turns out that racial segregation can emerge in a city or town if as little at 30% of individuals are racist. That's the beauty of a simple model such as the Schelling Model of Segregation; they can help us arrive at insights we never would have without the model. Please take a look at the below video for an explanation of the Schelling Model and, if you enjoy it, sign up for Model Thinking on Coursera. It is a fantastic course; I personally just need to find time to finish it.
In the end, I would say that the biggest benefit of mathematical and computational models is that they allow us to break away from the imprecise mental models in our heads and in doing do they can significantly reduce the cognitive load on an individual. Basically I am trying to say that they make us smarter. Much, much smarter.
Conclusions and Final Remarks
Quantitative finance is an ideology and being a quant is about more than being good at maths and knowing how to code; it is about believing in, and applying, the scientific method to the study of financial markets in general. Given this belief, my advice to individuals wishing to become a quant is simple: just be one regardless of whether you have the title or not. Quite frankly, I can't think of any reason why the fundamental principles and methodologies of quantitative finance can't be applied successfully to other non-quantitative areas of financial services or even to non financial-services companies. In my opinion this is the next logical step for quantitative finance and a couple of decades from now I think that quantitative venture capitalism and quantitative investment banking will be all the rage. Let me end off by saying that even if you got nothing out of trying except a mind-shift and the ability to demonstrate that you can apply these principles in an interview, you would still have come out on top.
I have studied Mathematics up to Hons. My programming skills are limited. I would like to be a Quant. Does every Quant need to be competent in coding? I really love Mathematics and I developed a coding interest late in my studies.
Which (and why) programming language is best for the aspiring quant?
I disagree with your central premise. Like economics, finance is not a science. There are some scientific tools that we use, similar to a mechanic working on a car. But given that human behavior is not fully quantifiable, finance is not a science like physics is on intermediate size entities.
And yes, I am an actuary and a quant. Also, much as they call it "actuarial science" it's not really a science either. The problem is the assumption of long dated return assumptions. We don't have to assume the constants of physics and chemistry. Guesses are not scientific, and economics, finance and actuarial math are filled with them.
Great article Stuart, and very useful advice on how to progress with R. I am an aspiring quant, self-taught coder and currently trading for a living and find myself delving into code on a daily basis. I realised just recently that being a quant is not a destination but a journey, and i am well on my way.