Sample Bias – When the chosen historical data sample is not representative of the true market. For example, backtesting only during strong bull markets or on a narrow set of instruments leads to sample bias. The strategy may look good simply because the sample was unusually favorable. To avoid this, one uses diverse, randomly selected data or stratified sampling so that the sample reflects various market conditions.