Two Stocks at 0.7 With the Same Index, and Still −0.02 With Each Other
The two correlations you are handed do not pin the third one down, but they fence it into exactly [−1/50, 1], and that interval dips below zero. The fence falls out of a 3×3 determinant read as a quadratic in the unknown, and out of a picture: 0.7 is an angle of 45.573°, both stocks live on a cone of that half-angle around the index, and putting them on opposite sides opens 91.146° between them. Also here: why the real tipping point is ab ≥ 0 together with a² + b² ≥ 1 rather than "both above 0.707", why 0.9 and 0.5 force a positive answer while 0.9 and −0.9 allow −1, why standing on the floor costs a rank, and why three Bernoulli(0.5) indicators with the same two correlations are confined to [0.40, 1] instead.
The question usually arrives in one sentence: two stocks each move with the same index at a correlation of 0.7. How correlated are the two stocks with each other? You get about ten seconds, and the person asking already knows the answer.
Three replies come back most often. That it is 0.7 again, because both stocks are close to the index so they must be close to each other. That it is 0.49, from multiplying. Or the shrug: no information, could be anything. The last one costs candidates the most, because the two numbers you were handed rule out 49% of the dial. They just do not pick a single point on what is left.
This turns up on first-round screens for quant trading and quant research seats, and again much later on risk and portfolio desks, where the same fact walks in disguised as a covariance matrix somebody wants signed off. It survives as a screen because it costs ten seconds to ask and splits the room. Nobody is checking whether you can quote a formula. They want to know whether you treat three correlations as three separate facts, or notice that they are three angles in one room and cannot be chosen independently.
With , the correlation between the two stocks can be anything in and nothing outside it. Both endpoints are reachable. The floor is exactly , a rational number rather than a rounded decimal, and it is negative: the two stocks are allowed to move against each other.
Which tables of correlations are real
Write the three numbers into a table, each variable against each other variable, ones down the diagonal:
Not every such table comes from real data. Suppose I tell you the first pair is perfectly in step and the second pair perfectly opposed. I have already decided the third pair, and if I write anything else in that cell I have described a world that does not exist. The condition separating the possible tables from the impossible ones is short: has to be positive semi-definite. That is not an extra technical requirement bolted on, it is forced. Standardise the three variables to unit variance and any weights give
A portfolio cannot have negative variance, so any correlation matrix satisfies this, and Higham takes it as the definition: a correlation matrix is a symmetric positive semi-definite matrix with unit diagonal. For semi-definiteness you need every principal minor to be non-negative, not just the leading ones. Here the minors are all 1, the minors are , and , and everything else is carried by the determinant:
Now read that as a statement about , which is the only unknown. It is a quadratic, and the sign in front of is negative, so the determinant is non-negative exactly between the two roots:
The discriminant tidies itself up. What ends up under the square root is , which factors as , and both factors are non-negative because a correlation lives in . So the roots are real, always, and they are
The remaining condition, , comes for free. Read as the dot product of the unit vectors and ; Cauchy–Schwarz caps it at 1, and the same argument floors at . Put into (2). The product is , and the square root is , a rational number because the two factors are equal. That is where the exactness comes from:
Correlation is an angle wearing a disguise
The algebra gives the answer and explains nothing. Here is the same result as a picture, and the picture is what you want in the room, because you can draw it while you talk.
Take a return series and subtract its average, so it wobbles around zero. Ask what covariance does to two of those. It is symmetric, so the order does not matter. It is linear in each slot. And the covariance of something with itself is its variance, which is never negative and is zero only for something that never moves. Those three properties are the axioms of an inner product, so centred square-integrable random variables form an inner-product space with . Lengths and angles come with the structure, whether or not the objects started life as arrows. The length is the standard deviation, and
The centring is not decoration. Drop it and the cosine of the raw series measures the angle between two clouds that both sit far from the origin, so two perfectly opposed return streams with the same average level come back at . Correlation is the cosine after the means are removed.
So 0.7 is not a proportion of anything. It is , which is 45.573°. Point the index arrow wherever you like; nothing depends on that. The first stock leans 45.573° away from it, and that is the whole content of the number, so it can sit anywhere on a cone of half-angle 45.573° around the index. The second stock gets the same instruction and lives on the same cone. The question has quietly become a question about two arrows on a cone: how far apart can they get?
Slide one arrow on top of the other and the angle is zero: correlation 1, the top of the interval. Slide it to the opposite side and the two stocks lean away from the index in exactly opposite directions, so the angle between them is 45.573° twice over, which is 91.146°. That is past the right angle, and the cosine of anything past 90° is negative. Its value is .
This is not a rhyme with the algebra, it is the algebra. Write and . Then , likewise for , and equation (2) reads
The two endpoints are the two ways of stacking the angles, and the feasible set is every angle in between. Castano, Paksoy and Zhang prove exactly this identity on the way to a broader result about correlation matrices and metric-preserving functions; the equivalence between angles and feasibility is old enough to have a name, Kreĭn’s inequality, the triangle inequality for angles in a Hilbert space.
One restriction has to travel with the picture. The plain angular triangle inequality lines up with positive semi-definiteness only while the two known angles add to no more than 180°. Past that, a second spherical condition starts to bite, and a literal reading of the triangle inequality lets through triples that no random variables realise: with satisfies all three inequalities on the angles and still has a negative determinant. Here both known angles are 45.573°, so their sum is 91.146° and we are nowhere near the trouble. The cone argument is exact for this problem, and I am claiming it for this problem.
The candidate who multiplies is right about the wrong thing
Average the two endpoints in (2) and the square roots cancel:
So 0.49 is not a wrong guess that happens to be close. It is the exact centre of the set of admissible answers, and it would be the exact centre for any other pair of correlations too. The candidate who multiplies has found the midpoint of the answer without noticing there was an answer to have a midpoint of, which is a stranger place to land than being wrong.
There is a reason, and it is worth carrying around. Split each stock into the part explained by the index and the part that is not. In the geometry that is just resolving an arrow into a component along the index and a component perpendicular to it:
Take the inner product. The index parts are shared, so they always agree and contribute no matter what else happens. The leftover parts contribute whatever they feel like:
The free quantity is the partial correlation of the two stocks given the index, and it ranges over the whole of with no constraint whatsoever from and . That is the honest content of the puzzle: the two numbers you were handed say precisely nothing about how the residuals relate. For 0.7 and 0.7 the shared part is worth 0.49 and the private parts are worth 0.51 in either direction, which is the whole interval in one line. The width is out of a possible 2, so the two given numbers eliminate 49% of the dial and leave the rest genuinely open.
The lens shape says something the algebra hides. The band pinches to a single point at : if the second stock is the index, there is nothing left to choose and the third correlation is forced to be . It is widest at , where knowing that is uncorrelated with the index tells you almost nothing about how it sits against . Information about the third number comes from the two given ones being extreme, not from them being large. And since correlation is a cosine, it is blind to shifts and rescalings of either series, which is why a change of units moves nothing here, and why volatilities combine with the law of cosines rather than by adding.
Where the floor stops being negative
The useful version of this question is not the arithmetic, it is knowing in advance whether the answer can dip below zero at all. Multiply the two roots of the quadratic. The product of the roots of is the constant term, so
One identity, and the whole sign question falls out of it. The two endpoints share a sign exactly when , which is to say exactly when the pair , plotted as a single point on a page, sits outside the unit circle. Which sign it is comes from the sum of the roots, . So the criterion has two halves and needs both:
Getting there directly is a good habit to have: means , and since the right side is never negative you need before you are allowed to square. Squaring then gives , which is the circle condition. The sign proviso is not fine print, it is the step that makes the squaring legal.
Now the shortcut people carry out of this problem, which is that both correlations have to clear for the third to be forced positive. That is the case and nothing more. Set in the circle condition and you get , hence . Off the diagonal it fails in both directions.
Take and . Only one of the two clears 0.707, so the shortcut says the third correlation could go negative. It cannot. Here and , so (9) applies and the feasible interval is
Strictly positive at the bottom, and strictly below 1 at the top. That second half is easy to miss: equals 1 only when the two angles coincide, so the ceiling reaches 1 if and only if . With 0.9 and 0.5 the two stocks can be at most 83% correlated. There is no world in which they are the same thing.
The failure in the other direction is sharper. Take and . Then , comfortably outside the circle, and yet
Perfect opposition, the worst the dial has. Clearing the circle test on its own forces nothing; it only says the two endpoints agree in sign, and with the sign they agree on is negative. Two strong positives force a positive, one of each forces a negative, and that is what the two shaded corners in Fig. 3 are for.
One more piece of small print on the shortcut. Squaring the two numbers, adding, and taking away one returns the floor itself only when . Equation (8) says , and the denominator is 1 exactly on the diagonal. For 0.7 and 0.7 the recipe gives , which is right. For 0.9 and 0.5 it gives 0.06, while the floor is 0.0725. The sign is still correct, because the numerator carries the sign, so the trick survives as a sign test and dies as a formula.
Building a world where it happens, and what it costs
An inequality tells you a value is permitted. It does not hand you the world in which it happens, and an interviewer who is enjoying himself will ask for one. Take the index and one more thing with nothing to do with it, both centred with unit variance, independent. Then set
Each has variance , so each correlates with the index at exactly 0.7. The leftovers point in opposite directions, so . That is the picture from Fig. 1 written out as a recipe. Simulated over four million days and measured back out of the numbers as if nobody had seen how they were made, the three correlations come back at 0.7, 0.7 and −0.02 with a maximum error of , and the cosine of the angle between the centred sample vectors agrees with the Pearson coefficient to . Somebody could hand you that risk report and every number on it would be honest.
What the simulation does not do is certify the fraction. At four million draws the standard error on a measured correlation is around , so a construction aiming at −0.021 would have sailed through the same check. The exactness of rests on the rational arithmetic in (3) and nowhere else. Simulation is how you confirm a value is reachable, not how you learn what it is.
Standing on the floor costs something, and this is the part worth saying out loud in the room. Add the two stocks in (10) and the noise cancels: , so . The second stock is not a third thing at all. It is a deterministic combination of the other two, the matrix is singular, and its rank has dropped from 3 to 2. The clean way to see this is to price the portfolio that is long both stocks and short 1.4 units of the index, which is in standardised units:
That portfolio has zero variance at , and negative variance below it. One single portfolio is enough to prove the floor, and it is the same portfolio that vanishes when you get there. Ask the recipe for −0.0201 and it has nowhere to go: the leftovers are already perfectly opposed and there is no more opposition left to spend. The determinant is and the smallest eigenvalue is , small enough that a risk system might round it away and carry on.
Positive definite gives the open interval, positive semi-definite the closed one. The endpoints −1/50 and 1 are genuinely attainable, and the price of attaining them is that one variable stops being independent of the others. Any risk model whose estimated correlations land on the boundary of the feasible set has silently deleted a factor.
Everything cannot hedge everything
Three arrows was the small case. The version that matters on a desk is what happens with a lot of them. Suppose you want a book where every position pushes against every other one by the same amount, so all pairwise correlations equal a single . How negative is that allowed to be?
No determinant needed. Add all standardised positions together and demand that the total has non-negative variance:
The spectrum confirms it and adds detail: an equicorrelation matrix has eigenvalue once, along the all-ones direction, and with multiplicity , so the determinant is and the first eigenvalue is the one that runs out. With three positions the floor is , which is three arrows in a plane at 120° to each other. With ten it is . With a hundred it is , about one percent.
Mutual hedging does not scale, and that is a fact about geometry rather than about markets. You can arrange a handful of things to genuinely oppose one another, but there is not enough room in any number of dimensions for a hundred arrows all pointing away from each other. The bigger the book, the closer the average pair is forced towards zero from below, which is one of the reasons diversification stops paying at some point instead of improving forever.
The bound is attained when the distributions are unconstrained. Put one red marble and green ones in an urn and draw the lot without replacement; the indicator that position holds the red marble has and mean , which gives a pairwise correlation of exactly . Fix the marginals instead and the floor lifts. Take three symmetric coin flips written as , all pairs at . Their sum is an odd number, so on every outcome, and therefore , which gives . Not . Parity got there before positive semi-definiteness did.
The interval assumes the distributions are free
Everything above answers one precise question: which correlation matrices exist, over all possible joint distributions. That is the right question when nobody has told you what the variables are. Fix the marginals and the answer changes, sometimes a lot, and this is the part of the problem that separates a candidate who has the formula from one who knows what it is a formula about.
Take the same setup with indicators instead of returns: three events, each happening half the time, the first two correlated 0.7 with the third. For two symmetric binary variables the correlation has a plain reading. Writing , the covariance is and each standard deviation is , so
A correlation of 0.7 means the two indicators disagree 15% of the time, no more and no less. And disagreement obeys a triangle inequality for the cheapest of reasons: if then or , so the union bound gives , and (13) turns that into . The bound is reached: let and with two disjoint flip events of probability 0.15 each, independent of . Both stay symmetric, both sit at 0.7 with the index, and they disagree with each other exactly 30% of the time.
With free distributions, two correlations of 0.7 leave the third anywhere in . With three Bernoulli(0.5) indicators, the same two numbers confine it to . The floor moves by 0.42 and changes sign. Nothing was wrong with the first calculation; the second problem is a different problem.
The ceiling can go missing too, which is the version that shows up in a real stress test. Take two events, one happening half the time and the other three times in ten. The joint law of two binary variables has exactly one free parameter, again , and the correlation is an increasing affine function of it, so it is maximised at the largest feasible . You cannot have both events more often than the rarer one occurs, so — the upper Fréchet–Hoeffding bound, realised by the comonotone coupling in which the rarer event always arrives inside the commoner one. For a rarer event and a commoner one :
Line those two events up as tightly as anything can be lined up and they still are not in lockstep, because the commoner one turns up alone two days in ten. So a model that stresses a portfolio by turning every correlation up to 1 may be asking for a scenario that does not exist, and quietly returning a number for it anyway. The dial runs from −1 to +1. What actually lives on the dial is decided by everything else in the table.
Four things the interval does not say
Everything here is about population correlations, the true ones. A 0.7 that arrives in an interview is a number somebody typed; a 0.7 that arrives on a desk is an estimate with a standard error attached, and the bound says nothing about how far the estimate might be from the truth.
That gap has consequences you can see in production. A matrix assembled cell by cell, with each pair estimated on whatever history both series happen to share, or over windows of different lengths, routinely comes out with a negative eigenvalue. It is not a rounding artefact, it is three numbers that no world produces, sitting in the same table. Repairing that is a genuine computational problem with a literature of its own, which is what Higham was writing about.
The interval is Pearson’s. Spearman’s rank correlation inherits it unchanged, being a Pearson correlation computed on ranks, so equation (2) applies verbatim. Kendall’s tau does not. Its natural constraint is linear rather than quadratic: is proportional to a metric on orderings, so , and two taus of 0.7 put the floor at or above. Positive, where the cosine bound was negative. Asking which coefficient the interviewer means is not a stalling tactic; it changes the sign of the answer.
And the interval describes what is possible, not what is likely. Nothing above says a third correlation near −0.02 is common, or that a pair of equity names behaves that way. It says that if somebody claims one, you cannot refute them with the two numbers you were given, and that if somebody claims −0.03 you can.
What the question was actually for
The interviewer is not collecting the number. He wants to know whether you treat three correlations as three independent facts, or notice that they are three angles in one room and cannot be chosen separately. That instinct outlives the question, because every risk table you will ever be handed is a claim about geometry, and the bad ones are usually bad because somebody typed a value into a cell that no world could produce.
Which is why the good answer out loud is not “minus two percent”. It is: the answer is a range, here is the range, here is the one line that produces it, and here is a world sitting on each end of it.
Sources and further reading
- E. Langford, N. Schwertman, M. Owens, “Is the Property of Being Positively Correlated Transitive?”, The American Statistician 55(4) (2001), 322–325 — the feasible interval for a third correlation, stated and proved
- A. E. Castro Sotos, S. Vanhoof, W. Van den Noortgate, P. Onghena, “The Transitivity Misconception of Pearson's Correlation Coefficient”, Statistics Education Research Journal 8(2) (2009), 33–55 — works the 0.7 / 0.7 case in print, and measures how often the wrong answer is given
- D. Castano, V. E. Paksoy, F. Zhang, “Angles, triangle inequalities, correlation matrices and metric-preserving and subadditive functions”, Linear Algebra and its Applications 491 (2016), 15–29 — where the endpoints are identified as cos(μ ∓ ν), which is equation (5)
- M. Lin, “Remarks on Kreĭn's Inequality”, The Mathematical Intelligencer 34(1) (2012), 3–4 — the triangle inequality for angles in a Hilbert space, and its lineage
- N. J. Higham, “Computing the nearest correlation matrix — a problem from finance”, IMA Journal of Numerical Analysis 22(3) (2002), 329–343 — positive semi-definiteness as the definition, and what to do with a matrix that fails it
- Correlation — the coefficient itself, and what it does and does not measure
- Definite matrix — the principal-minor test used in the first section
- Partial correlation — the free parameter in equation (7)
- Fréchet–Hoeffding copula bounds — the ceiling in equation (14), in its general form
- Kendall rank correlation coefficient — the coefficient that obeys a different constraint
Comments · 0
Be the first to comment.