A Primer on Probabilistic Forecasting

The Smart Forecaster

 Pursuing best practices in demand planning,

forecasting and inventory optimization

If you keep up with the news about supply chain analytics, you are more frequently encountering the phrase “probabilistic forecasting.” If this phrase is puzzling, read on.

You probably already know what “forecasting” means. And you probably also know that there seem to be lots of different ways to do it. And you’ve probably heard pungent little phrases like “every forecast is wrong.” So you know that some kind of mathemagic might calculate that “the forecast is you will sell 100 units next month”, and then you might sell 110 units, in which case you have a 10% forecast error.

You may not know that what I just described is a particular kind of forecast called a “point forecast.” A point forecast is so named because it consists of just a single number (i.e., one point on the number line, if you recall the number line from your youth).

Point forecasts have one virtue: They are simple. They also have a flaw: They give rise to snarky statements like “every forecast is wrong.” That is, in most realistic cases, it is unlikely that the actual value will exactly equal the forecast. (Which isn’t such a big deal if the forecast is close enough.)

This gets us to “probabilistic forecasting.” This approach is a step up, because instead of producing a single-number (point) forecast, it yields a probability distribution for the forecast. And unlike traditional extrapolative models that rely purely on the historical data, probabilistic forecasts have the ability to simulate future values that aren’t anchored to the past.

“Probability distribution” is a forbidding phrase, evoking some arcane math that you may have heard of but never studied. Luckily, most adults have enough life experience to have an intuitive grasp of the concept.  When broken down, it’s quite straightforward to understand.

Imagine the simple act of flipping two coins. You might call this harmless fun, but I call it a “probabilistic experiment.” The total number of heads that turn up on the two coins will be either zero, one or two. Flipping two coins is a “random experiment.” The resulting number of heads is a “random variable.” It has a “probability distribution”, which is nothing more than a table of how likely it is that the random variable will turn out to have any of its possible values. The probability of getting two heads when the coins are fair works out to be ¼, as is the probability of no heads. The chance of one head is ½.

The same approach can describe a more interesting random variable, like the daily demand for a spare part.  Figure 2 shows such a probability distribution. It was computed by compiling three years of daily demand data on a certain part used in a scientific instrument sold to hospitals.

 

Probabilistic demand forecast 1

Figure 1: The probability distribution of daily demand for a certain spare part

 

The distribution in Figure 1 can be thought of as a probabilistic forecast of demand in a single day. For this particular part, we see that the forecast is very likely to be zero (97% chance), but sometimes will be for a handful of units, and once in three years will be twenty units. Even though the most likely forecast is zero, you would want to keep a few on hand if this part were critical (“…for want of a nail…”)

Now let’s use this information to make a more complicated probabilistic forecast. Suppose you have three units on hand. How many days will it take for you to have none? There are many possible answers, ranging from a single day (if you immediately get a demand for three or more) up to a very large number (since 97% of days see no demand).  The analysis of this question is a bit complicated because of all the many ways this situation can play out, but the final answer that is most informative will be a probability distribution. It turns out that the number of days until there are no units left in stock has the distribution shown in Figure 2.

Probabilistic demand forecast 2

Figure 2: Distribution of the number of days until all three units are gone

 

The average number of days is 74, which would be a point forecast, but there is a lot of variation around the average. From the perspective of inventory management, it is notable that there is a 25% chance that all the units will be gone after 32 days. So if you decided to order more when you were down to only three on the shelf, it would be good to have the supplier get them to you before a month has passed. If they couldn’t, you’d have a 75% chance of stocking out – not good for a critical part.

The analysis behind Figure 2 involved making some assumptions that were convenient but not necessary if they were not true. The results came from a method called “Monte Carlo simulation”, in which we start with three units, pick a random demand from the distribution in Figure 1, subtract it from the current stock, and continue until the stock is gone, recording how many days went by before you ran out. Repeating this process 100,000 times produced Figure 2.

Applications of Monte Carlo simulation extend to problems of even larger scope than the “when do we run out” example above. Especially important are Monte Carlo forecasts of future demand. While the usual forecasting result is a set of point forecasts (e.g., expected unit demand over the next twelve months), we know that there are any number of ways that the actual demand could play out. Simulation could be used to produce, say, one thousand possible sets of 365 daily demand demands.

This set of demand scenarios would more fully expose the range of possible situations with which an inventory system would have to cope. This use of simulation is called “stress testing”, because it exposes a system to a range of varied but realistic scenarios, including some nasty ones. Those scenarios are then input to mathematical models of the system to see how well it will cope, as reflected in key performance indicators (KPI’s). For instance, in those thousand simulated years of operation, how many stockouts are there in the worst year? the average year? the best year? In fact, what is the full probability distribution of the number of stockouts in a year, and what is the distribution of their size?

Figures 3 and 4 illustrate probabilistic modeling of an inventory control system that converts stockouts to backorders. The system simulated uses a Min/Max control policy with Min = 10 units and Max = 20 units.

Figure 3 shows one simulated year of daily operations in four plots. The first plot shows a particular pattern of random daily demand in which average demand increases steadily from Monday to Friday but disappears on weekends. The second plot shows the number of units on hand each day. Note that there are a dozen times during this simulated year when inventory goes negative, indicating stockouts. The third plot shows the size and timing of replenishment orders. The fourth plot shows the size and timing of backorders.  The information in these plots can be translated into estimates of inventory investment, average units on hand, holding costs, ordering costs and shortage costs.

Probabilistic demand forecast 3

Figure 3: One simulated year of inventory system operation

 

Figure 3 shows one of one thousand simulated years. Each year will have different daily demands, resulting in different values of metrics like units on hand and the various components of operating cost. Figure 4 plots the distribution of 1,000 simulated values of four KPI’s. Simulating 1,000 years of imagined operation exposes the range of possible results so that planners can account not just for average results but also see best-case and worst-case values.

Probabilistic demand forecast 4

Figure 4: Distributions of four KPI’s based on 1,000 simulations

 

Monte Carlo simulation is a low-math/high-results approach to probabilistic forecasting: very practical and easy to explain. Advanced probabilistic forecasting methods employed by Smart Software expand upon standard Monte Carlo simulation, yielding extremely accurate estimates of required inventory levels.

 

Leave a Comment

Related Posts

Constructive Play with Digital Twins

Constructive Play with Digital Twins

Those of you who track hot topics will be familiar with the term “digital twin.” Those who have been too busy with work may want to read on and catch up. While there are several definitions of digital twin, here’s one that works well: A digital twin is a dynamic virtual copy of a physical asset, process, system, or environment that looks like and behaves identically to its real-world counterpart. A digital twin ingests data and replicates processes so you can predict possible performance outcomes and issues that the real-world product might undergo.

Direct to the Brain of the Boss – Inventory Analytics and Reporting

Direct to the Brain of the Boss – Inventory Analytics and Reporting

In this blog, the spotlight is cast on the software that creates reports for management, the silent hero that translates the beauty of furious calculations into actionable reports. Watch as the calculations, intricately guided by planners utilizing our software, seamlessly converge into Smart Operational Analytics (SOA) reports, dividing five key areas: inventory analysis, inventory performance, inventory trending, supplier performance, and demand anomalies.

How Are We Doing? KPI’s and KPP’s

How Are We Doing? KPI’s and KPP’s

Dealing with the day-to-day of inventory management can keep you busy. But you know you have to get your head up now and then to see where you’re heading. For that, your inventory software should show you metrics – and not just one, but a full set of metrics or KPI’s – Key Performance Indicators.

Recent Posts

  • Finding Your Spot on the Inventory Tradeoff CurveFinding Your Spot on the Inventory Tradeoff Curve
    This video blog holds essential insights for those working with the complexities of inventory management. The session focuses on striking the right balance within the inventory tradeoff curve, inviting viewers to understand the deep-seated importance of this equilibrium. […]
  • Why MRO Businesses Need Add-on Service Parts Planning & Inventory SoftwareWhy MRO Businesses Need Add-on Service Parts Planning & Inventory Software
    MRO organizations exist in a wide range of industries, including public transit, electrical utilities, wastewater, hydro power, aviation, and mining. To get their work done, MRO professionals use Enterprise Asset Management (EAM) and Enterprise Resource Planning (ERP) systems. These systems are designed to do a lot of jobs. Given their features, cost, and extensive implementation requirements, there is an assumption that EAM and ERP systems can do it all. In this post, we summarize the need for add-on software that addresses specialized analytics for inventory optimization, forecasting, and service parts planning. […]
  • Descriptive, Predictive, and Prescriptive AnalyticsThe Three Types of Supply Chain Analytics
    In this video blog, we explore the critical roles of Descriptive, Predictive, and Prescriptive Analytics in inventory management, highlighting their essential contributions to driving supply chain optimization through strategic foresight and insightful data analysis. […]
  • Warning Signs that You Have a Supply Chain Analytics GapWarning Signs that You Have a Supply Chain Analytics Gap
    “Business is war” may be an overdone metaphor but it’s not without validity. Like the “Bomber Gap” and the “Missile Gap,” worries about falling behind the competition, and the resulting threat of annihilation, always lurk in the minds of business executives, If they don’t, they should, because not all gaps are imaginary (the Bomber Gap and the Missile Gap were shown to not exist between the US and the USSR, but the 1980’s gap between Japanese and American productivity was all too real). The difference between paranoia and justified concern is converting fear into facts. This post is about organizing your attention toward possible gaps in your company’s supply chain analytics. […]
  • The Objectives in ForecastingThe Objectives in Forecasting
    A forecast is a prediction about the value of a time series variable at some time in the future. For instance, one might want to estimate next month’s sales or demand for a product item. A time series is a sequence of numbers recorded at equally spaced time intervals; for example, unit sales recorded every month. The objectives you pursue when you forecast depend on the nature of your job and your business. Every forecast is uncertain; in fact, there is a range of possible values for any variable you forecast. Values near the middle of this range have a higher likelihood of actually occurring, while values at the extremes of the range are less likely to occur. […]

    Inventory Optimization for Manufacturers, Distributors, and MRO

    • Why MRO Businesses Need Add-on Service Parts Planning & Inventory SoftwareWhy MRO Businesses Need Add-on Service Parts Planning & Inventory Software
      MRO organizations exist in a wide range of industries, including public transit, electrical utilities, wastewater, hydro power, aviation, and mining. To get their work done, MRO professionals use Enterprise Asset Management (EAM) and Enterprise Resource Planning (ERP) systems. These systems are designed to do a lot of jobs. Given their features, cost, and extensive implementation requirements, there is an assumption that EAM and ERP systems can do it all. In this post, we summarize the need for add-on software that addresses specialized analytics for inventory optimization, forecasting, and service parts planning. […]
    • Spare-parts-demand-forecasting-a-different-perspective-for-planning-service-partsThe Forecast Matters, but Maybe Not the Way You Think
      True or false: The forecast doesn't matter to spare parts inventory management. At first glance, this statement seems obviously false. After all, forecasts are crucial for planning stock levels, right? It depends on what you mean by a “forecast”. If you mean an old-school single-number forecast (“demand for item CX218b will be 3 units next week and 6 units the week after”), then no. If you broaden the meaning of forecast to include a probability distribution taking account of uncertainties in both demand and supply, then yes. […]
    • Whyt MRO Businesses Should Care about Excess InventoryWhy MRO Businesses Should Care About Excess Inventory
      Do MRO companies genuinely prioritize reducing excess spare parts inventory? From an organizational standpoint, our experience suggests not necessarily. Boardroom discussions typically revolve around expanding fleets, acquiring new customers, meeting service level agreements (SLAs), modernizing infrastructure, and maximizing uptime. In industries where assets supported by spare parts cost hundreds of millions or generate significant revenue (e.g., mining or oil & gas), the value of the inventory just doesn’t raise any eyebrows, and organizations tend to overlook massive amounts of excessive inventory. […]
    • Top Differences between Inventory Planning for Finished Goods and for MRO and Spare PartsTop Differences Between Inventory Planning for Finished Goods and for MRO and Spare Parts
      In today’s competitive business landscape, companies are constantly seeking ways to improve their operational efficiency and drive increased revenue. Optimizing service parts management is an often-overlooked aspect that can have a significant financial impact. Companies can improve overall efficiency and generate significant financial returns by effectively managing spare parts inventory. This article will explore the economic implications of optimized service parts management and how investing in Inventory Optimization and Demand Planning Software can provide a competitive advantage. […]

      Probabilistic vs. Deterministic Order Planning

      The Smart Forecaster

      Man with a computer in a warehouse best practices in demand planning, forecasting and inventory optimization

      Consider the problem of replenishing inventory. To be specific, suppose the inventory item in question is a spare part. Both you and your supplier will want some sense of how much you will be ordering and when. And your ERP system may be insisting that you let it in on the secret too.

      Deterministic Model of Replenishment

      The simplest way to get a decent answer to this question is to assume the world is, well, simple. In this case, simple means “not random” or, in geek speak, “deterministic.” In particular, you pretend that the random size and timing of demand is really a continuous drip-drip-drip of a fixed size coming at a fixed interval, e.g., 2, 2, 2, 2, 2, 2… If this seems unrealistic, it is. Real demand might look more like this: 0, 1, 10, 0, 1, 0, 0, 0 with lots of zeros, occasional but random spikes.

      But simplicity has its virtues. If you pretend that the average demand occurs every day like clockwork, it is easy to work out when you will need to place your next order, and how many units you will need.  For instance, suppose your inventory policy is of the (Q,R) type, where Q is a fixed order quantity and R is a fixed reorder point. When stock drops to or below the reorder point R, you order Q units more. To round out the fantasy, assume that the replenishment lead time is also fixed: after L days, those Q new units will be on the shelf ready to satisfy demand.

      All you need now to answer your questions is the average demand per day D for the item. The logic goes like this:

      1. You start each replenishment cycle with Q units on hand.
      2. You deplete that stock by D units per day.
      3. So, you hit the reorder point R after (Q-R)/D days.
      4. So, you order every (Q-R)/D days.
      5. Each replenishment cycle lasts (Q-R)/D + L days, so you make a total of 365D/(Q-R+LD) orders per year.
      6. As long as lead time L < R/D, you will never stock out and your inventory will be as small as possible.

      Figure 1 shows the plot of on-hand inventory vs time for the deterministic model. Around Smart Software, we refer to this plot as the “Deterministic Sawtooth.” The stock starts at the level of the last order quantity Q. After steadily decreasing over the drop time (Q-R)/D, the level hits the reorder point R and triggers an order for another Q units. Over the lead time L, the stock drops to exactly zero, then the reorder magically arrives and the next cycle begins.

      Figure 1 Deterministic model of on-hand inventory

      Figure 1: Deterministic model of on-hand inventory

       

      This model has two things going for it. It requires no more than high school algebra, and it combines (almost) all the relevant factors to answer the two related questions: When will we have to place the next order? How many orders will we place in a year?

      Probabilistic Model of Replenishment

      Not surprisingly, if we strip away some of the fantasy from the deterministic model, we get more useful information. The probabilistic model incorporates all the messy randomness in the real-world problem: the uncertainty in both the timing and size of demand, the variation in replenishment lead time, and the consequences of those two factors: the chance of stock on hand undershooting the reorder point, the chance that there will be a stockout, the variability in the time until the next order, and the variable number of orders executed in a year.

      The probabilistic model works by simulating the consequences of uncertain demand and variable lead time. By analyzing the item’s historical demand patterns (and excluding any observations that were recorded during a time when demand may have been fundamentally different), advanced statistical methods create an unlimited number of realistic demand scenarios. Similar analysis is applied to records of supplier lead times. Combining these supply and demand scenarios with the operational rules of any given inventory control policy produces scenarios of the number of parts on hand. From these scenarios, we can extract summaries of the varying intervals between orders.

      Figure 2 shows an example of a probabilistic scenario; demand is random, and the item is managed using reorder point R = 10 and order quantity Q=20. Gone is the Deterministic Sawtooth; in its place is something more complex and realistic (the Probabilistic Staircase). During the 90 simulated days of operation, there were 9 orders placed, and the time between orders clearly varied.

      Using the probabilistic model, the answers to the two questions (how long between orders and how many in a year) get expressed as probability distributions reflecting the relative likelihoods of various scenarios. Figure 3 shows the distribution of the number of days between orders after ten years of simulated operation. While the average is about 8 days, the actual number varies widely, from 2 to 17.

      Instead of telling your supplier that you will place X orders next year, you can now project X ± Y orders, and your supplier knows better their upside and downside risks. Better yet, you could provide the entire distribution as the richest possible answer.

      Figure 2 A probabilistic scenario of on-hand inventory

      Figure 2 A probabilistic scenario of on-hand inventory

       

      Figure 3 Distribution of days between orders

      Figure 3: Distribution of days between orders

       

      Climbing the Random Staircase to Greater Efficiency

      Moving beyond the deterministic model of  inventory opens up new possibilities for optimizing operations. First, the probabilistic model allows realistic assessment of stockout risk. The simple model in Figure 1 implies there is never a stockout, whereas probabilistic scenarios allow for the possibility (though in Figure 2 there was only one close call around day 70). Once the risk is known, software can optimize by searching  the “design space” (i.e., all possible values of R and Q) to find a design that meets a target level of stockout risk at minimal cost. The value of the deterministic model in this more realistic analysis is that it provides a good starting point for the search through design space.

      Summary

      Modern software provides answers to operational questions with various degrees of detail. Using the example of the time between replenishment orders, we’ve shown that the answer can be calculated approximately but quickly by a simple deterministic model. But it can also be provided in much richer detail with all the variability exposed by a probabilistic model. We think of these alternatives as complementary. The deterministic model bundles all the key variables into an easy-to-understand form. The probabilistic model provides additional realism that professionals expect and supports effective search for optimal choices of reorder point and order quantity.

       

      Leave a Comment
      Related Posts
      Finding Your Spot on the Inventory Tradeoff Curve

      Finding Your Spot on the Inventory Tradeoff Curve

      This video blog holds essential insights for those working with the complexities of inventory management. The session focuses on striking the right balance within the inventory tradeoff curve, inviting viewers to understand the deep-seated importance of this equilibrium.

      Why MRO Businesses Need Add-on Service Parts Planning & Inventory Software

      Why MRO Businesses Need Add-on Service Parts Planning & Inventory Software

      MRO organizations exist in a wide range of industries, including public transit, electrical utilities, wastewater, hydro power, aviation, and mining. To get their work done, MRO professionals use Enterprise Asset Management (EAM) and Enterprise Resource Planning (ERP) systems. These systems are designed to do a lot of jobs. Given their features, cost, and extensive implementation requirements, there is an assumption that EAM and ERP systems can do it all. In this post, we summarize the need for add-on software that addresses specialized analytics for inventory optimization, forecasting, and service parts planning.

      Head to Head: Which Service Parts Inventory Policy is Best?

      Head to Head: Which Service Parts Inventory Policy is Best?

      Our customers have usually settled into one way to manage their service parts inventory. The professor in me would like to think that the chosen inventory policy was a reasoned choice among considered alternatives, but more likely it just sort of happened. Maybe the inventory honcho from long ago had a favorite and that choice stuck. Maybe somebody used an EAM or ERP system that offered only one choice. Perhaps there were some guesses made, based on the conditions at the time.