Do your statistical forecasts suffer from the wiggle effect?

 What is the wiggle effect? 

It’s when your statistical forecast incorrectly predicts the ups and downs observed in your demand history when there really isn’t a pattern.  It’s important to make sure your forecasts don’t wiggle unless there is a real pattern.

Here is a transcript from a recent customer where this issue was discussed:

Customer: “The forecast isn’t picking up on the patterns I see in the history.  Why not?” 

Smart:  “If you look closely, the ups and downs you see aren’t patterns.  It’s really noise.”  

Customer:  “But if we don’t predict the highs, we’ll stock out.”

Smart: “If the forecast were to ‘wiggle’ it would be much less accurate.  The system will forecast whatever pattern is evident, in this case a very slight uptrend.  We’ll buffer against the noise with safety stocks. The wiggles are used to set the safety stocks.”

Customer: “Ok. Makes sense now.” 

Do your statistical forecasts suffer from the wiggle effect graphic

The wiggle looks reassuring but, in this case, it is resulting in an incorrect demand forecast. The ups and downs aren’t really occurring at the same times each month.  A better statistical forecast is shown in light green.

 

 

How to Handle Statistical Forecasts of Zero

A statistical forecast of zero can cause lots of confusion for forecasters, especially when the historical demand is non-zero.  Sure, it’s obvious that demand is trending downward, but should it trend to zero?  When the older demand is much greater than the more recent demand and the more recent demand is very low volume (i.e., 1,2,3 units demanded), the answer is, statistically speaking, yes.  However, this might not jive with the planner’s business knowledge and expected minimum level of demand.  So, what should a forecaster do to correct this? Here are three suggestions:

 

  1. Limit the historical data fed to the model. In a down trending situation, the older data is often much greater than the recent data.   When the older much higher volume demand is ignored, the down trend won’t be nearly as significant.  You’ll still forecast a down trend, but results are more likely to be line with business expectations.
  1. Try trend dampening. Smart Demand Planner has a feature called “trend hedging” that enables users to define how a trend should phase out over time. The higher the percentage trend hedge (0-100%), the more pronounced the trend dampening.  This means that a forecasted trend will not continue through the whole forecast horizon.  This means the demand forecast will start to flatten before it hits zero on a downtrend.
  1. Change the forecast model. Switch from a trending method like Double Exponential Smoothing or Linear Moving Average to a non-trending method such as Single Exponential Smoothing or Simple Moving Average. You won’t forecast a downtrend, but at least your forecast won’t be zero and thus more likely to be accepted by the business.

 

 

 

Smart Software’s article has won 1st place in the 2022 Supply Chain Brief MVP Awards Forecasting category!

Belmont, Mass., December 2022 –  Smart Software is pleased to announce that Co-Founder Dr. Thomas R. Willemain’s article “Managing Inventory amid Regime Change” has won 1st place in the Forecasting category of the 2022 Supply Chain Brief MVP Awards.

“Regime change” is a statistical term meaning a major change in the character of the demand for an inventory item. An item’s demand history is the fuel that powers demand planners’ forecasting machines. In general, the more fuel the better, giving us a better fix on the average level,  the shape of any seasonality pattern, and the size and direction of any trend. But there is one big exception to the rule that “more data is better data.” If there is a major shift in your business and new demand doesn’t look like old demand, then old data become dangerous.

Read the MVP Award winner article here  https://smartcorp.com/inventory-optimization/managing-inventory-amid-regime-change/

Supply Chain Brief brings together the best content from hundreds of industry thought leaders. This MVP Award recognizes the Most Valuable Post as judged by Supply Chain Brief’s audience, award committee, and social media. Smart Software has been recognized to provide the highest value to industry professionals and useful information that is strategic in nature. https://www.supplychainbrief.com/mvp-awards/2022-SCB-MVP-AWARDS/forecasting

Dr. Thomas R. Willemain is Co-Founder and Senior VP for Research at Smart Software.  He has been a professor at MIT and the Harvard Kennedy School of Government and is now Professor Emeritus of Industrial and Systems Engineering at Rensselaer Polytechnic Institute.  Tom was a Distinguished Visiting Professor at the FAA and supported the Intelligence Community as Expert Statistical Consultant (GS15) in NSA’s Mathematics Research Group and later at IDA’s Center for Computing Sciences.  He holds degrees from Princeton University (BSE, summa cum laude) and Massachusetts Institute of Technology (MS and PhD), all in Electrical Engineering.

About Smart Software, Inc.
Founded in 1981, Smart Software, Inc. is a leader in providing businesses with enterprise-wide demand forecasting, planning and inventory optimization solutions. Smart Software’s demand forecasting and inventory optimization solutions have helped thousands of users worldwide, including customers at mid-market enterprises and Fortune 500 companies, such as Otis Elevator, Hitachi, WeatherTech, and Disney. Smart Inventory Planning & Optimization gives demand planners the tools to handle sales seasonality, promotions, new and aging products, multi-dimensional hierarchies, and intermittently demanded service parts and capital goods items. It also provides inventory managers with accurate estimates of the optimal inventory and safety stock required to meet future orders and achieve desired service levels. Smart Software is headquartered in Belmont, Massachusetts, and can be found online at www.smartcorp.com.

 

 

Smart Software to Present at Community Summit North America

Smart Software’s Channel Sales Director and Enterprise Solution Engineer, to present three sessions at this year’s Community Summit event in Orlando, FL.  

Belmont, MA, – Smart Software, Inc., provider of industry-leading demand forecasting, planning, and inventory optimization solutions, today announced that its Channel Sales Director, Pete Reynolds, and its Enterprise Solution Engineer Erik Subatis, have been selected to present three sessions at the Dynamics Community Summit NA. They will explain how to plan using Collaborative forecasting, how to Maximize Service Levels, and how to Forecast Accurately during the three sessions.

Smart Software will also be exhibiting at the conference showcasing Smart Inventory Planning & Optimization and bi-directional integrations to Microsoft Dynamics NAV, Microsoft Dynamics 365 Business Central, and Microsoft Dynamics AX.

Smart Software Presentations at Community Summit North America 2022

  • Maximize Service Levels and Minimize Inventory Costs
    • Session Date: 10/12/2022   2:00 PM -2:45 PM
    • Room Number: Tampa 2 – Convention Center, Level 2
  • Predict and Plan the Sales Cycle Using Collaborative Forecasting
    •  Session Date: 10/13/2022   9:00 AM -9:45 AM
    • Room Number: Sarasota 1 – Convention Center, Level 2
  • 5 Demand Planning Tips for Calculating Forecast Uncertainty
    • Session Date: 10/13/2022   10:00 AM -11:00 AM
    • Room Number: Osceola B – Convention Center, Level 2

 

Community Summit North America is the largest independent gathering of the Microsoft business applications ecosystem of users, partners, and ISVs on the planet. Come by booth #1122 to learn about probabilistic forecasting and optimization methods that can make a big difference to your bottom line. Whether you are a seasoned Microsoft user looking for new ways to optimize your supply chain or are new to Dynamics Applications and want to understand how a planning platform can help drive revenue increases and inventory reductions, please stop by.

 

About Smart Software, Inc.

Founded in 1981, Smart Software, Inc. is a leader in providing businesses with enterprise-wide demand forecasting, planning, and inventory optimization solutions.  Smart Software’s demand forecasting and inventory optimization solutions have helped thousands of users worldwide, including customers at mid-market enterprises and Fortune 500 companies, such as Otis Elevator, Hitachi, and Disney. Smart Inventory Planning & Optimization gives demand planners the tools to handle sales seasonality, promotions, new and aging products, multi-dimensional hierarchies, and intermittently demanded service parts and capital goods items.  It also provides inventory managers with accurate estimates of the optimal inventory and safety stock required to meet future orders and achieve desired service levels.  Smart Software is headquartered in Belmont, Massachusetts, and can be found on the World Wide Web at www.smartcorp.com.

Community Summit 2021 Smart Software Inventory planning


For more information, please contact Smart Software, Inc., Four Hill Road, Belmont, MA 02478.
Phone: 1-800-SMART-99 (800-762-7899); FAX: 1-617-489-2748; E-mail: info@smartcorp.com

 

 

Smart Software to lead a webinar as part of the WERC Solutions Partner Program

Belmont, MA, – Smart Software, Inc., provider of industry-leading demand forecasting, planning, and inventory optimization solutions, today announced that Greg Hartunian, President and CEO at Smart Software, will lead a 30-minute webinar as part of the WERC Solutions Partner Program 

The presentation will focus on how a leading Electric Utility implemented Smart Inventory Planning and Optimization (Smart IP&O) as part of the company’s strategic supply chain optimization (SCO) initiative. Smart IP&O was implemented in just 90 days, enabling the utility to optimize its reorder points and order quantities for over 250,000 spare parts. During the first phase of the implementation, the platform helped the electric utility reduce inventory by $9,000,000 while maintaining service levels.

Finally, the webinar will conclude by showing Smart IP&O in a Live Demo.

 

Warehousing Education and Research Council (WERC)

WERC is a professional organization focused on logistics management and its role in the supply chain. Since being founded in 1977, WERC has maintained a strategic vision to continuously offer resources that help distribution practitioners and suppliers stay on top in our dynamic, variable field. In an increasingly complex world, distribution logistics professionals make sense of things so that people get their products and services, companies deliver on their commitments, economies grow, and communities thrive.

WERC powers distribution logistics professionals to do their jobs, excel in their careers and make a difference in the world. WERC helps its members and companies succeed by creating unparalleled learning experiences, offering quality networking opportunities, and accessing research-driven industry information.

 

About Smart Software, Inc.
Founded in 1981, Smart Software, Inc. is a leader in providing businesses with enterprise-wide demand forecasting, planning and inventory optimization solutions.  Smart Software’s demand forecasting and inventory optimization solutions have helped thousands of users worldwide, including customers at mid-market enterprises and Fortune 500 companies, such as Otis Elevator, Mitsubishi, Siemens, Disney, FedEx, MARS, and The Home Depot.  Smart Inventory Planning & Optimization gives demand planners the tools to handle sales seasonality, promotions, new and aging products, multi-dimensional hierarchies, and intermittently demanded service parts and capital goods items.  It also provides inventory managers with accurate estimates of the optimal inventory and safety stock required to meet future orders and achieve desired service levels.  Smart Software is headquartered in Belmont,

 


For more information, please contact Smart Software, Inc., Four Hill Road, Belmont, MA 02478.
Phone: 1-800-SMART-99 (800-762-7899); FAX: 1-617-489-2748; E-mail: info@smartcorp.com

 

 

Managing the Inventory of Promoted Items

The Smart Forecaster

 Pursuing best practices in demand planning,

forecasting and inventory optimization

In a previous post, I discussed one of the thornier problems demand planners sometimes face: working with product demand data characterized by what statisticians call skewness — a situation that can necessitate costly inventory investments. This sort of problematic data is found in several different scenarios. In at least one, the combination of intermittent demand and very effective sales promotions, the problem lends itself to an effective solution.

Reviewing terms, recall that “service level” is the probability of not stocking out while waiting for a replenishment order to arrive, while “fill rate” is the percentage of demand that is satisfied immediately from stock. In my previous post, “The Scourge of Skewness”, I pointed out that a certain type of demand distribution, having a “long right tail”, will lead to fill rates that can be much lower than service levels. I also pointed out that sometimes the only way to improve the fill rate is to increase the target service level to an unusually high level, which can be expensive.

In this post, I’ll look at solving the problem in one special case: skewness resulting from effective sales promotions mixed with “intermittent demand”. Intermittent demand has a large proportion of zero values, with nonzero values mixed in at random. Successful sales promotions, obviously positive, have a downside: they can confuse the “demand signal” with spikes in your demand history, and can undermine forecasts and bias safety stock calculations. When intermittent demand and effective sales promotions are the source of your data’s skewness, methods exist to work around the problem to achieve both higher fill rates and more accurate demand forecasts.

How Promotions Increase Skewness

Successful promotions abruptly increase item demand. This creates anomalies, or “outliers”, which contribute to forming a skewed distribution. Knowing when promotions occurred in the past, we can adjust an item’s record of past demand. We produce an alternate demand history as if there had been no promotions, by replacing the outliers with values more representative of the “natural” level of demand. These adjustments reduce demand skewness. Reduced skewness can lead to significant reductions in both expected forecasts and safety stocks, which add together to form reorder points.

Successful promotions are likely to be repeated. When that happens, the promotion effects can be added in to demand forecasts to increase their accuracy. The effect of future promotions on inventory management will be to increase the risk of stockouts, so a sensible response is to work at the operational level to build up temporary supply, in a quantity keyed to the estimated impact of prior promotions on the effected items.

 

Using Event Modeling to Improve Demand Forecasting

It’s possible to model the impact of like events, and apply this to planned events in the future. Doing so can improve your forecast in two big ways: by projecting the demand jolt you expect from a planned event; and rationalizing the spikes in the past that were caused by events, making your baseline activity more visible and more accurately forecastable. We do a lot of this in SmartForecasts, so allow me to use our experience there to show you what I mean.

Event Modeling entails the following steps:
• Automatically estimating the impact of previous promotions (which is a useful result in itself).
• Adjusting historical demand to statistically remove the effect of promotions.
• Creating promotion-free forecasts.
• Revising the forecasts for any future time periods in which promotions are planned.

We call this this type of analysis “Promo forecasting”. We use the word “promotions” to describe what you do yourself to improve your results. We use “events” to describe what the world does to you, usually to your detriment; examples include strikes, power outages, warehouse fires and other unlucky happenings.

To understand how Event Modeling can help you cope with skewness when doing demand forecasting for high-volume items, consider Figures 1-3.

Figure 1 shows that this item’s demand pattern is clearly seasonal, and the forecast is both seasonal and “tight”, meaning that the forecast uncertainty interval (“margin of error”, shown in cyan lines) is very narrow.

Figure 2 shows an alternative history in which a promotion in June 2014 reversed the usual seasonal low associated with June sales. This demand pattern was forecasted using the Automatic forecasting tournament in SmartForecasts, as in Figure 1. This time, the promotion scrambled the seasonal pattern enough to create an inappropriate non-seasonal forecast, and one that has a much larger margin of error.

Finally, Figure 3 shows how Promo forecasting handles the same promoted scenario, retaining a seasonal forecast and building into the forecast an estimate of the effect of a planned repeat promotion in 2015.

The Case of Intermittent Demand

In Figure 1, the item was a high-volume finished good and the task was demand forecasting. Promo modeling is also useful when dealing with the task of setting safety stocks and reorder points for items with intermittent demand, whether the items are finished goods, components or spare parts. Intermittent demand very often has a skewed distribution that makes it difficult to achieve high item availability with a small investment in inventory.

Figure 4 illustrates the problem that a successful promotion can accidentally create for inventory management. If such a spike arises from the natural, un-promoted demand, then the only way to maintain high fill rates is to provide safety stocks large enough to cope with these random surges. In this case, the big spike in demand of 500 units in February 2013 was the result of a one-time promotion.

Taking Account of Promotions to Improve Inventory Management

Unwittingly treating the spike in the example above as part of the natural demand variability results in a poor fill rate. To achieve a target service level of, say, 95% with a lead time of one month would require a reorder point of 38 units, computed as the sum of an expected forecast over the one month replenishment lead time of 21 units supplemented by a safety stock of 17 units. This investment would result in a disappointing fill rate of only 36%.

However, recognizing that the spike is a one-time promotion and replacing the 500 units with 0 obviously would make a big difference. The reorder point would drop from 38 units to 31 (the sum of an expected demand of 7 units and a safety stock of 24 units) and the fill rate would increase to 94%.

Of course, it is not ok to just throw out inconvenient demand spikes whenever they make life uncomfortable; there has to be a valid “business story” behind the adjustment of historical demand. If the spike is the result of a data processing error, then by all means, fix it. If the spike coincides with a promotion, then replacing the spike with, say, the median demand (often zero, as in this example) will result in a much more sustainable inventory investment that still meets aggressive performance targets. Future promotions of the same type on the same item will require some extra effort to prepare for the temporary surge in demand, but the recommended reorder point will be correct in the long run.

Thomas Willemain, PhD, co-founded Smart Software and currently serves as Senior Vice President for Research. Dr. Willemain also serves as Professor Emeritus of Industrial and Systems Engineering at Rensselear Polytechnic Institute and as a member of the research staff at the Center for Computing Sciences, Institute for Defense Analyses.

Leave a Comment

Related Posts

The top 3 reasons why your spreadsheet won’t work for optimizing reorder points on spare parts

The top 3 reasons why your spreadsheet won’t work for optimizing reorder points on spare parts

We often encounter Excel-based reorder point planning methods. In this post, we’ve detailed an approach that a customer used prior to proceeding with Smart. We describe how their spreadsheet worked, the statistical approaches it relied on, the steps planners went through each planning cycle, and their stated motivations for using (and really liking) this internally developed spreadsheet.

Recent Posts

  • Fifteen questions that reveal how forecasts are computed in your companyFifteen questions that reveal how forecasts are computed in your company
    In a recent LinkedIn post, I detailed four questions that, when answered, will reveal how forecasts are being used in your business. In this article, we’ve listed questions you can ask that will reveal how forecasts are created. […]
  • Businessman and businesswoman reading and analysing spreadsheetThe top 3 reasons why your spreadsheet won’t work for optimizing reorder points on spare parts
    We often encounter Excel-based reorder point planning methods. In this post, we’ve detailed an approach that a customer used prior to proceeding with Smart. We describe how their spreadsheet worked, the statistical approaches it relied on, the steps planners went through each planning cycle, and their stated motivations for using (and really liking) this internally developed spreadsheet. […]
  • Style business group in classic business suits with binoculars and telescopes reproduce different forecasting methodsHow to interpret and manipulate forecast results with different forecast methods
    This blog explains how each forecasting model works using time plots of historical and forecast data. It outlines how to go about choosing which model to use. The examples below show the same history, in red, forecasted with each method, in dark green, compared to the Smart-chosen winning method, in light green. […]
  • Factory worker engineer working in factory using tablet computer to check maintenance boiler water pipe in factory.Why Spare Parts Tradeoff Curves are Mission-Critical for Parts Planning
    When managing service parts, you don’t know what will break and when because part failures are random and sudden. As a result, demand patterns are most often extremely intermittent and lack significant trend or seasonal structure. The number of part-by-location combinations is often in the hundreds of thousands, so it’s not feasible to manually review demand for individual parts. Nevertheless, it is much more straightforward to implement a planning and forecasting system to support spare parts planning than you might think. […]
  • What to do when a statistical forecast doesn’t make senseWhat to do when a statistical forecast doesn’t make sense
    Sometimes a statistical forecast just doesn’t make sense. Every forecaster has been there. They may double-check that the data was input correctly or review the model settings but are still left scratching their head over why the forecast looks very unlike the demand history. When the occasional forecast doesn’t make sense, it can erode confidence in the entire statistical forecasting process. […]

    Inventory Optimization for Manufacturers, Distributors, and MRO

    • Businessman and businesswoman reading and analysing spreadsheetThe top 3 reasons why your spreadsheet won’t work for optimizing reorder points on spare parts
      We often encounter Excel-based reorder point planning methods. In this post, we’ve detailed an approach that a customer used prior to proceeding with Smart. We describe how their spreadsheet worked, the statistical approaches it relied on, the steps planners went through each planning cycle, and their stated motivations for using (and really liking) this internally developed spreadsheet. […]
    • Factory worker engineer working in factory using tablet computer to check maintenance boiler water pipe in factory.Why Spare Parts Tradeoff Curves are Mission-Critical for Parts Planning
      When managing service parts, you don’t know what will break and when because part failures are random and sudden. As a result, demand patterns are most often extremely intermittent and lack significant trend or seasonal structure. The number of part-by-location combinations is often in the hundreds of thousands, so it’s not feasible to manually review demand for individual parts. Nevertheless, it is much more straightforward to implement a planning and forecasting system to support spare parts planning than you might think. […]
    • Portrait of factory worker woman with blue hardhat holds tablet and stand in spare parts workplace area. Concept of confident of working with spare parts planning software.Spare Parts Planning Isn’t as Hard as You Think
      When managing service parts, you don’t know what will break and when because part failures are random and sudden. As a result, demand patterns are most often extremely intermittent and lack significant trend or seasonal structure. The number of part-by-location combinations is often in the hundreds of thousands, so it’s not feasible to manually review demand for individual parts. Nevertheless, it is much more straightforward to implement a planning and forecasting system to support spare parts planning than you might think. […]
    • Worker on a automotive spare parts warehouse using inventory planning softwareService-Level-Driven Planning for Service Parts Businesses
      Service-Level-Driven Service Parts Planning is a four-step process that extends beyond simplified forecasting and rule-of-thumb safety stocks. It provides service parts planners with data-driven, risk-adjusted decision support. […]