A Check on Forecast Automation with the Attention Index

The Smart Forecaster

Pursuing best practices in demand planning,

forecasting and inventory optimization

A new metric we call the “Attention Index” will help forecasters identify situations where “data behaving badly” can distort automatic statistical forecasts (see adjacent poem). It quickly identifies those items most likely to require forecast overrides—providing a more efficient way to put business experience and other human intelligence to work maximizing the accuracy of forecasts. How does it work?

Classical forecasting methods, such as the various flavors of exponential smoothing and moving averages, insist on a leap of faith. They require that we trust present conditions to persist into the future. If present conditions do persist, then it is sensible to use these extrapolative methods—methods which quantify the current level, trend, seasonality and “noise” of a time series and project them into the future.

But if they do not persist, extrapolative methods can get us into trouble. What had been going up might suddenly be going down. What used to be centered around one level might suddenly jump to another. Or something really odd might happen that is entirely out of pattern. In these surprising circumstances, forecast accuracy deteriorates, inventory calculations go wrong and general unhappiness ensues.

One way to cope with this problem is to rely on more complex forecasting models that account for external factors that drive the variable being forecasted. For instance, sales promotions attempt to disrupt buying patterns and move them in a positive direction, so including promotion activity in the forecasting process can improve sales forecasting. Sometimes macroeconomic indicators, such as housing starts or inflation rates, can be used to improve forecast accuracy. But more complex models require more data and more expertise, and they may not be useful for some problems—such as managing parts or subsystems, rather than finished goods.

If one is stuck using simple extrapolative methods, it is useful to have a way to flag items that will be difficult to forecast. This is the Attention Index. As the name suggests, items to be forecast with a high Attention Index require special handling—at least a review, and usually some sort of forecast adjustment.

 

 

The Attention Index detects three types of problems:

An outlier in the demand history of an item.
An abrupt change in the level of an item.
An abrupt change in the trend of an item.
Using software like SmartForecasts™, the forecaster can deal with an outlier by replacing it with a more typical value.

An abrupt change in level or trend can be dealt with by omitting, from the forecasting calculations, all data from before the “rupture” in the demand pattern—assuming that the item has switched into a new regime that renders the older data irrelevant.

While no index is perfect, the Attention Index does a good job of focusing attention on the most problematic demand histories. This is demonstrated in the two figures below, which were produced with data from the M3 Competition, well known in the forecasting world. Figure 1 shows the 20 items (out of the contest’s 3,003) with the highest Attention Index scores; all of these have grotesque outliers and ruptures. Figure 2 shows the 20 items with the lowest Attention Index scores; most (but not all) of the items with low scores have relatively benign patterns.

If you have thousands of items to forecast, the new Attention Index will be very useful for focusing your attention on those items most likely to be problematic.

Thomas Willemain, PhD, co-founded Smart Software and currently serves as Senior Vice President for Research. Dr. Willemain also serves as Professor Emeritus of Industrial and Systems Engineering at Rensselaer Polytechnic Institute and as a member of the research staff at the Center for Computing Sciences, Institute for Defense Analyses.

Leave a Comment

Related Posts

Correlation vs Causation: Is This Relevant to Your Job?

Correlation vs Causation: Is This Relevant to Your Job?

Outside of work, you may have heard the famous dictum “Correlation is not causation.” It may sound like a piece of theoretical fluff that, though involved in a recent Noble Prize in economics, isn’t relevant to your work as a demand planner. Is so, you may be only partially correct.

Types of forecasting problems we help solve

Types of forecasting problems we help solve

Generating accurate statistical forecasts isn’t an easy task. Planners need to keep historical data continually up to date, build and manage a database of forecasting models, know which forecast methods to use, keep track of forecast overrides, and report on forecast accuracy. Here are examples of forecasting problems that SmartForecasts can solve, along with the kinds of business data representative of each.

Three Ways to Estimate Forecast Accuracy

Three Ways to Estimate Forecast Accuracy

Forecast accuracy is a key metric by which to judge the quality of your demand planning process. Once you have forecasts, there are several ways to summarize their accuracy, usually designated by obscure three- or four-letter acronyms like MAPE, RMSE, and MAE.

Recent Posts

  • professional technician engineer planning spare parts in industrial manufacturing factory,Prepare your spare parts planning for unexpected shocks
    In today's unpredictable business climate, we do have to worry about supply chain disruptions, long lead times, rising interest rates, and volatile demand. With all these challenges, it's never been more vital for organizations to accurately forecast parts usage, stocking levels, and to optimize replenishment policies such as reorder points, safety stocks, and order quantities. In this blog, we'll explore how companies can leverage innovative solutions like inventory optimization and parts forecasting software that utilize machine learning algorithms, probabilistic forecasting, and analytics to stay ahead of the curve and protect their supply chains from unexpected shocks. […]
  • Uncover data facts and improve inventory performanceUncover data facts and improve inventory performance
    The best inventory planning processes rely on statistical analysis to uncover relevant facts about the data. When you have the facts and add your business knowledge, you can make more informed stocking decisions that will generate significant returns. You'll also set proper expectations with internal and external stakeholders, ensuring there are fewer unwelcome surprises. […]
  • Electricity problems. Repairman is working indoors with Software for spare partsElectric Utilities’ Problems with Spare Parts
    Every organization that runs equipment needs spare parts. All of them must cope with issues that are generic no matter what their business. Some of the problems, however, are industry specific. This post discusses one universal problem that manifested in a nuclear plant and one that is especially acute for any electric utility. […]
  • Correlation vs Causation Relevant to your demand planning businessCorrelation vs Causation: Is This Relevant to Your Job?
    Outside of work, you may have heard the famous dictum “Correlation is not causation.” It may sound like a piece of theoretical fluff that, though involved in a recent Noble Prize in economics, isn’t relevant to your work as a demand planner. Is so, you may be only partially correct. […]
  • Downtown Miami skyline panorama and with software guided lights on at duskSmart Software Customer, Arizona Public Service to Present at USMA 2023
    Smart Software CEO and APS Inventory & Logistics Manager to present USMA 2023 Session on APS supply chain transformation project and the role of inventory optimization technology in their new process. […]

    Inventory Optimization for Manufacturers, Distributors, and MRO

    • professional technician engineer planning spare parts in industrial manufacturing factory,Prepare your spare parts planning for unexpected shocks
      In today's unpredictable business climate, we do have to worry about supply chain disruptions, long lead times, rising interest rates, and volatile demand. With all these challenges, it's never been more vital for organizations to accurately forecast parts usage, stocking levels, and to optimize replenishment policies such as reorder points, safety stocks, and order quantities. In this blog, we'll explore how companies can leverage innovative solutions like inventory optimization and parts forecasting software that utilize machine learning algorithms, probabilistic forecasting, and analytics to stay ahead of the curve and protect their supply chains from unexpected shocks. […]
    • Electricity problems. Repairman is working indoors with Software for spare partsElectric Utilities’ Problems with Spare Parts
      Every organization that runs equipment needs spare parts. All of them must cope with issues that are generic no matter what their business. Some of the problems, however, are industry specific. This post discusses one universal problem that manifested in a nuclear plant and one that is especially acute for any electric utility. […]
    • Worker maintenance industrial machine robotic Forecasting Spare PartsHow to Forecast Spare Parts with Low Usage
      What do you do when you are forecasting an intermittently demanded item, such as a spare part, with an average demand of less than one unit per month? Most of the time, the demand is zero, but the part is significant in a business sense; it can’t be ignored and must be forecasted to be sure you have adequate stock. […]
    • Spare Parts, Replacement Parts, Rotables, and Aftermarket PartsSpare Parts, Replacement Parts, Rotables, and Aftermarket Parts
      Those new to the parts planning game are often confused by the many variations in the names of parts. This blog points out distinctions that do or do not have operational significance for someone managing a fleet of spare parts and how those differences impact inventory planning. […]