What is “A Good Forecast”

The Smart Forecaster

Pursuing best practices in demand planning,

forecasting and inventory optimization

Tremendous cost-saving efficiencies can result from optimizing inventory stocking levels using the best predictions of future demand. Familiarity with forecasting basics is an important part of being effective with the software tools designed to exploit this efficiency. This concise introduction (the first in a short series of blog posts) offers the busy professional a primer in the basic ideas you need to bring to bear on forecasting. How do you evaluate your forecasting efforts, and how reliable are the results?

A good forecast is “unbiased.” It correctly captures predictable structure in the demand history, including: trend (a regular increase or decrease in demand); seasonality (cyclical variation); special events (e.g. sales promotions) that could impact demand or have a cannibalization effect on other items; and other, macroeconomic events.

By “unbiased,” we mean that the estimated forecast is not projecting too high or too low; the actual demand is equally likely to be above or below predicted demand. Think of the forecast as your best guess of what could happen in the future. If that forecast is “unbiased,” the overall picture will show that measures of actual future demand will “bracket” the forecasts—distributed in balance above and below predictions by the equal odds.

You can think of this as if you are an artillery officer and your job is to destroy a target with your cannon. You aim your cannon (“the forecast”) and then shoot and watch the shells fall. If you aimed the cannon correctly (producing an “unbiased” forecast), those shells will “bracket” the target; some shells will fall in front and some shells fall behind, but some shells will hit the target. The falling shells can be thought of as the “actual demand” that will occur in the future. If you forecasted well (aimed your cannon well), then those actuals will bracket the forecasts, falling equally above and below the forecast.

Once you have obtained an “unbiased” forecast (in other words, you aimed your cannon correctly), the question is: how accurate was your forecast? Using the artillery example, how wide is the range around the target in which your shells are falling? You want to have as narrow a range as possible. A good forecast will be one with the minimal possible “spread” around the target.

However, just because the actuals are falling widely around the forecast does not mean you have a bad forecast. It may merely indicate that you have very “volatile” demand history. Again, using the artillery example, if you are starting to shoot in a hurricane, you should expect the shells to fall around the target with a wide error.

Your goal is to obtain as accurate a forecast as is possible with the data you have. If that data is very volatile (you’re shooting in a hurricane), then you should expect a large error. If your data is stable, then you should expect a small error and your actuals will fall close to the forecast—you’re shooting on a clear day!

So that you can understand both the usefulness of your forecasts and the degree of caution appropriate when applying them, you need to be able to review and measure how well your forecast is doing. How well is it estimating what actually occurs? SmartForecasts does this automatically by running its “sliding simulation” through the history. It simulates “forecasts” that could have occurred in the past. An older part of the history, without the most recent numbers, is isolated and used to build forecasts. Because these forecasts then “predict” what might happen in the more recent past—a period for which you already have actual demand data—the forecasts can be compared to the real recent history.

In this manner, SmartForecasts can empirically compute the actual forecast error—and those errors are needed to properly estimate safety stock. Safety stock is the amount of extra stock you need to carry in order to account for the anticipated error in your forecasts. In a subsequent essay, I’ll discuss how we use our estimated forecasts error (via the SmartForecasts sliding simulation) to correctly estimate safety stocks.

Nelson Hartunian, PhD, co-founded Smart Software, formerly served as President, and currently oversees it as Chairman of the Board. He has, at various times, headed software development, sales and customer service.

Leave a Comment

Related Posts

You Need to Team up with the Algorithms

You Need to Team up with the Algorithms

This article is about the real power that comes from the collaboration between you and our software that happens at your fingertips. We often write about the software itself and what goes on “under the hood”. This time, the subject is how you should best team up with the software.

Rethinking forecast accuracy: A shift from accuracy to error metrics

Rethinking forecast accuracy: A shift from accuracy to error metrics

Measuring the accuracy of forecasts is an undeniably important part of the demand planning process. This forecasting scorecard could be built based on one of two contrasting viewpoints for computing metrics. The error viewpoint asks, “how far was the forecast from the actual?” The accuracy viewpoint asks, “how close was the forecast to the actual?” Both are valid, but error metrics provide more information.

Every Forecasting Model is Good for What it is Designed for

Every Forecasting Model is Good for What it is Designed for

With so much hype around new Machine Learning (ML) and probabilistic forecasting methods, the traditional “extrapolative” or “time series” statistical forecasting methods seem to be getting the cold shoulder. However, it is worth remembering that these traditional techniques (such as single and double exponential smoothing, linear and simple moving averaging, and Winters models for seasonal items) often work quite well for higher volume data. Every method is good for what it was designed to do. Just apply each appropriately, as in don’t bring a knife to a gunfight and don’t use a jackhammer when a simple hand hammer will do.

Recent Posts

  • Managing Spare Parts Inventory: Best PracticesManaging Spare Parts Inventory: Best Practices
    In this blog, we’ll explore several effective strategies for managing spare parts inventory, emphasizing the importance of optimizing stock levels, maintaining service levels, and using smart tools to aid in decision-making. Managing spare parts inventory is a critical component for businesses that depend on equipment uptime and service reliability. Unlike regular inventory items, spare parts often have unpredictable demand patterns, making them more challenging to manage effectively. An efficient spare parts inventory management system helps prevent stockouts that can lead to operational downtime and costly delays while also avoiding overstocking that unnecessarily ties up capital and increases holding costs. […]
  • 5 Ways to Improve Supply Chain Decision Speed5 Ways to Improve Supply Chain Decision Speed
    The promise of a digital supply chain has transformed how businesses operate. At its core, it can make rapid, data-driven decisions while ensuring quality and efficiency throughout operations. However, it's not just about having access to more data. Organizations need the right tools and platforms to turn that data into actionable insights. This is where decision-making becomes critical, especially in a landscape where new digital supply chain solutions and AI-driven platforms can support you in streamlining many processes within the decision matrix. […]
  • Two employees checking inventory in temporary storage in a distribution warehouse.12 Causes of Overstocking and Practical Solutions
    Managing inventory effectively is critical for maintaining a healthy balance sheet and ensuring that resources are optimally allocated. Here is an in-depth exploration of the main causes of overstocking, their implications, and possible solutions. […]
  • FAQ Mastering Smart IP&O for Better Inventory ManagementFAQ: Mastering Smart IP&O for Better Inventory Management.
    Effective supply chain and inventory management are essential for achieving operational efficiency and customer satisfaction. This blog provides clear and concise answers to some basic and other common questions from our Smart IP&O customers, offering practical insights to overcome typical challenges and enhance your inventory management practices. Focusing on these key areas, we help you transform complex inventory issues into strategic, manageable actions that reduce costs and improve overall performance with Smart IP&O. […]
  • 7 Key Demand Planning Trends Shaping the Future7 Key Demand Planning Trends Shaping the Future
    Demand planning goes beyond simply forecasting product needs; it's about ensuring your business meets customer demands with precision, efficiency, and cost-effectiveness. Latest demand planning technology addresses key challenges like forecast accuracy, inventory management, and market responsiveness. In this blog, we will introduce critical demand planning trends, including data-driven insights, probabilistic forecasting, consensus planning, predictive analytics, scenario modeling, real-time visibility, and multilevel forecasting. These trends will help you stay ahead of the curve, optimize your supply chain, reduce costs, and enhance customer satisfaction, positioning your business for long-term success. […]

    Inventory Optimization for Manufacturers, Distributors, and MRO

    • Managing Spare Parts Inventory: Best PracticesManaging Spare Parts Inventory: Best Practices
      In this blog, we’ll explore several effective strategies for managing spare parts inventory, emphasizing the importance of optimizing stock levels, maintaining service levels, and using smart tools to aid in decision-making. Managing spare parts inventory is a critical component for businesses that depend on equipment uptime and service reliability. Unlike regular inventory items, spare parts often have unpredictable demand patterns, making them more challenging to manage effectively. An efficient spare parts inventory management system helps prevent stockouts that can lead to operational downtime and costly delays while also avoiding overstocking that unnecessarily ties up capital and increases holding costs. […]
    • Innovating the OEM Aftermarket with AI-Driven Inventory Optimization XLInnovating the OEM Aftermarket with AI-Driven Inventory Optimization
      The aftermarket sector provides OEMs with a decisive advantage by offering a steady revenue stream and fostering customer loyalty through the reliable and timely delivery of service parts. However, managing inventory and forecasting demand in the aftermarket is fraught with challenges, including unpredictable demand patterns, vast product ranges, and the necessity for quick turnarounds. Traditional methods often fall short due to the complexity and variability of demand in the aftermarket. The latest technologies can analyze large datasets to predict future demand more accurately and optimize inventory levels, leading to better service and lower costs. […]
    • Future-Proofing Utilities. Advanced Analytics for Supply Chain OptimizationFuture-Proofing Utilities: Advanced Analytics for Supply Chain Optimization
      Utilities in the electrical, natural gas, urban water, and telecommunications fields are all asset-intensive and reliant on physical infrastructure that must be properly maintained, updated, and upgraded over time. Maximizing asset uptime and the reliability of physical infrastructure demands effective inventory management, spare parts forecasting, and supplier management. A utility that executes these processes effectively will outperform its peers, provide better returns for its investors and higher service levels for its customers, while reducing its environmental impact. […]
    • Centering Act Spare Parts Timing Pricing and ReliabilityCentering Act: Spare Parts Timing, Pricing, and Reliability
      In this article, we'll walk you through the process of crafting a spare parts inventory plan that prioritizes availability metrics such as service levels and fill rates while ensuring cost efficiency. We'll focus on an approach to inventory planning called Service Level-Driven Inventory Optimization. Next, we'll discuss how to determine what parts you should include in your inventory and those that might not be necessary. Lastly, we'll explore ways to enhance your service-level-driven inventory plan consistently. […]

      Lessons From Superstorm Sandy

      The Smart Forecaster

      Pursuing best practices in demand planning,

      forecasting and inventory optimization

      The destructive impact of Hurricane Sandy has been both staggering and instructive. Our thoughts and best wishes for rapid recovery go out to all who have suffered personal or economic loss or damage. Now, in Sandy’s aftermath, we find ourselves thinking about accelerating recovery and planning for the next unforeseen event.

      Our work with clients in the heavily hit mass transit sector presented a sobering view of damaged infrastructure, heavy equipment, and losses of essential inventory. Those most affected have seen a crush of work as inventory managers take stock of what they have, what they need and procure a mountain of replacement parts and products. This uniquely massive replenishment cycle presents all sorts of opportunities and considerations. For those who are still in this phase, and to help our collective preparation for the Next Big Event, here are a few thoughts:

      Opportunity to immediately “right size” inventory

      You may be in a position to receive a large, one-time infusion of funding for replacement inventory. It could be insurance money, federal relief or rainy day funds from your own treasury. Use the funding to establish the best possible inventory mix. Do not order to previously established Min/Max levels. Doing so may simply repeat excesses and shortfalls of the past.

      A major event like Sandy presents a rare opportunity to transform your inventory. Start with an accurate demand forecast over the replenishment period, and generate safety stocks and reorder points that would address your critical needs. This can be accomplished in a matter of hours or days. Ordinarily, implementing optimal inventory levels may occur over several years, as excess inventory is gradually depleted. Now, however, you have a one-time opportunity to jump to the right answer. This shift can substantially reduce replenishment spending, freeing hundreds of thousands of dollars for other, more critical recovery uses.

      Prioritize classes to be replenished

      Be clear on what you need for crucial operations, and prioritize your replenishment. Which parts have long lead-times, and which are readily available? Obviously short lead-time items can be acquired in stages—getting just enough now, making funds available for the longer lead-time items.

      Determine how much is “just enough”

      This is where an accurate demand forecast, safety stocks and reorder point calculations come into play. Consider the service level you require—the likelihood that products will be on the shelves when you need them—which is really your tolerance for risk. Do this for each item, or class of items. This will tell you how much safety stock, in addition to your expected lead time forecast, you should have on hand. Iterating on service level-driven requirements will enable you to maximize the value of the replenishment budget at hand.

      Statistical forecasting for intermittent demand vs. ‘rule of thumb’ methods

      Now is the time to shift from ‘the way we’ve done it’ to the most accurate demand forecasting and inventory optimization process available to you. Greater forecast accuracy requires less safety stock—again, making inventory dollars available for other users. The greatest single category for improvement is intermittent demand. Most organizations do not apply solid statistical methods to this, instead resorting to the “heavy hammer rule”—have lots on hand because no one knows. Here is an area where SmartForecasts is especially adept, with a patented solution for forecasting intermittent demand. The resulting safety stock recommendations hit the service level goal nearly 100% of the time. Getting this right will save lots of spending now, and help minimize the potential for excess, obsolete inventory in the future.

      Nelson Hartunian, PhD, co-founded Smart Software, formerly served as President, and currently oversees it as Chairman of the Board. He has, at various times, headed software development, sales and customer service.

      Leave a Comment

      Related Posts

      Why MRO Businesses Should Care About Excess Inventory

      Why MRO Businesses Should Care About Excess Inventory

      Do MRO companies genuinely prioritize reducing excess spare parts inventory? From an organizational standpoint, our experience suggests not necessarily. Boardroom discussions typically revolve around expanding fleets, acquiring new customers, meeting service level agreements (SLAs), modernizing infrastructure, and maximizing uptime. In industries where assets supported by spare parts cost hundreds of millions or generate significant revenue (e.g., mining or oil & gas), the value of the inventory just doesn’t raise any eyebrows, and organizations tend to overlook massive amounts of excessive inventory.

      Constructive Play with Digital Twins

      Constructive Play with Digital Twins

      Those of you who track hot topics will be familiar with the term “digital twin.” Those who have been too busy with work may want to read on and catch up. While there are several definitions of digital twin, here’s one that works well: A digital twin is a dynamic virtual copy of a physical asset, process, system, or environment that looks like and behaves identically to its real-world counterpart. A digital twin ingests data and replicates processes so you can predict possible performance outcomes and issues that the real-world product might undergo.

      Direct to the Brain of the Boss – Inventory Analytics and Reporting

      Direct to the Brain of the Boss – Inventory Analytics and Reporting

      In this blog, the spotlight is cast on the software that creates reports for management, the silent hero that translates the beauty of furious calculations into actionable reports. Watch as the calculations, intricately guided by planners utilizing our software, seamlessly converge into Smart Operational Analytics (SOA) reports, dividing five key areas: inventory analysis, inventory performance, inventory trending, supplier performance, and demand anomalies.

      Recent Posts

      • Managing Spare Parts Inventory: Best PracticesManaging Spare Parts Inventory: Best Practices
        In this blog, we’ll explore several effective strategies for managing spare parts inventory, emphasizing the importance of optimizing stock levels, maintaining service levels, and using smart tools to aid in decision-making. Managing spare parts inventory is a critical component for businesses that depend on equipment uptime and service reliability. Unlike regular inventory items, spare parts often have unpredictable demand patterns, making them more challenging to manage effectively. An efficient spare parts inventory management system helps prevent stockouts that can lead to operational downtime and costly delays while also avoiding overstocking that unnecessarily ties up capital and increases holding costs. […]
      • 5 Ways to Improve Supply Chain Decision Speed5 Ways to Improve Supply Chain Decision Speed
        The promise of a digital supply chain has transformed how businesses operate. At its core, it can make rapid, data-driven decisions while ensuring quality and efficiency throughout operations. However, it's not just about having access to more data. Organizations need the right tools and platforms to turn that data into actionable insights. This is where decision-making becomes critical, especially in a landscape where new digital supply chain solutions and AI-driven platforms can support you in streamlining many processes within the decision matrix. […]
      • Two employees checking inventory in temporary storage in a distribution warehouse.12 Causes of Overstocking and Practical Solutions
        Managing inventory effectively is critical for maintaining a healthy balance sheet and ensuring that resources are optimally allocated. Here is an in-depth exploration of the main causes of overstocking, their implications, and possible solutions. […]
      • FAQ Mastering Smart IP&O for Better Inventory ManagementFAQ: Mastering Smart IP&O for Better Inventory Management.
        Effective supply chain and inventory management are essential for achieving operational efficiency and customer satisfaction. This blog provides clear and concise answers to some basic and other common questions from our Smart IP&O customers, offering practical insights to overcome typical challenges and enhance your inventory management practices. Focusing on these key areas, we help you transform complex inventory issues into strategic, manageable actions that reduce costs and improve overall performance with Smart IP&O. […]
      • 7 Key Demand Planning Trends Shaping the Future7 Key Demand Planning Trends Shaping the Future
        Demand planning goes beyond simply forecasting product needs; it's about ensuring your business meets customer demands with precision, efficiency, and cost-effectiveness. Latest demand planning technology addresses key challenges like forecast accuracy, inventory management, and market responsiveness. In this blog, we will introduce critical demand planning trends, including data-driven insights, probabilistic forecasting, consensus planning, predictive analytics, scenario modeling, real-time visibility, and multilevel forecasting. These trends will help you stay ahead of the curve, optimize your supply chain, reduce costs, and enhance customer satisfaction, positioning your business for long-term success. […]

        Inventory Optimization for Manufacturers, Distributors, and MRO

        • Managing Spare Parts Inventory: Best PracticesManaging Spare Parts Inventory: Best Practices
          In this blog, we’ll explore several effective strategies for managing spare parts inventory, emphasizing the importance of optimizing stock levels, maintaining service levels, and using smart tools to aid in decision-making. Managing spare parts inventory is a critical component for businesses that depend on equipment uptime and service reliability. Unlike regular inventory items, spare parts often have unpredictable demand patterns, making them more challenging to manage effectively. An efficient spare parts inventory management system helps prevent stockouts that can lead to operational downtime and costly delays while also avoiding overstocking that unnecessarily ties up capital and increases holding costs. […]
        • Innovating the OEM Aftermarket with AI-Driven Inventory Optimization XLInnovating the OEM Aftermarket with AI-Driven Inventory Optimization
          The aftermarket sector provides OEMs with a decisive advantage by offering a steady revenue stream and fostering customer loyalty through the reliable and timely delivery of service parts. However, managing inventory and forecasting demand in the aftermarket is fraught with challenges, including unpredictable demand patterns, vast product ranges, and the necessity for quick turnarounds. Traditional methods often fall short due to the complexity and variability of demand in the aftermarket. The latest technologies can analyze large datasets to predict future demand more accurately and optimize inventory levels, leading to better service and lower costs. […]
        • Future-Proofing Utilities. Advanced Analytics for Supply Chain OptimizationFuture-Proofing Utilities: Advanced Analytics for Supply Chain Optimization
          Utilities in the electrical, natural gas, urban water, and telecommunications fields are all asset-intensive and reliant on physical infrastructure that must be properly maintained, updated, and upgraded over time. Maximizing asset uptime and the reliability of physical infrastructure demands effective inventory management, spare parts forecasting, and supplier management. A utility that executes these processes effectively will outperform its peers, provide better returns for its investors and higher service levels for its customers, while reducing its environmental impact. […]
        • Centering Act Spare Parts Timing Pricing and ReliabilityCentering Act: Spare Parts Timing, Pricing, and Reliability
          In this article, we'll walk you through the process of crafting a spare parts inventory plan that prioritizes availability metrics such as service levels and fill rates while ensuring cost efficiency. We'll focus on an approach to inventory planning called Service Level-Driven Inventory Optimization. Next, we'll discuss how to determine what parts you should include in your inventory and those that might not be necessary. Lastly, we'll explore ways to enhance your service-level-driven inventory plan consistently. […]

          Smart Software Executive to Speak on Optimizing Military Spare Parts Inventories

          Tom Willemain to lead session and tutorial at 2012 INFORMS Conference to help military logistics personnel manage $70 Billion worth of parts & supplies

          Belmont, Mass., October 9, 2012 – Smart Software, Inc., provider of industry-leading demand forecasting, planning, and inventory optimization solutions, today announced that Tom Willemain, vice president for research, will have two roles at this year’s INFORMS 2012 Annual Meeting, in Phoenix, Arizona, October 14-17. Dr. Willemain, who is also a professor of Industrial and Systems Engineering at Rensselaer Polytechnic Institute, will present a tutorial on managing spare parts on October 16, 8:00 – 9:30 am. He will also chair a session on “Methods Supporting Military Logistics and Testing” where he will also discuss “Accurate Forecasts of Spare Part Demand,” October 17, 8:00 – 9:30 am.

          Operations and support of military hardware, which includes maintaining, refurbishing and overhauling, can be 60 to 70 percent of the cost of owning a weapon system over its entire lifetime, which can be decades. Improving the management of parts involved in those operations poses a significant challenge for the U.S. military.

          According to a study by Deloitte Consulting LLP, the Department of Defense spends $70 billion a year on parts and supplies. Accurately forecasting spare parts is a major problem for any parts organizations because as much as 70% of spare parts have what’s known as “intermittent demand” which is very difficult to accurately forecast. This typically results in unbalanced inventories with many items overstocked and others under-stocked.

          In a book titled, Transforming U.S. Army Supply Chains: Strategies for Management Innovation, retired Army Col. Greg H. Parlier, who is now a defense logistics consultant, has proposed “mission based forecasting” software tools that will help the military to stop buying things they do not need. Dr. Willemain’s experience has helped numerous companies with similar inventory challenges do just that.

          Dr. Willemain has been at the forefront of research on better ways to forecast intermittent demand. With other colleagues at Smart Software, he holds a patent that provides accurate service level forecasts and estimates of safety stock and inventory stocking level requirements. Commercialized in Smart’s flagship product, SmartForecasts®, the patented technology has helped numerous manufacturing, distribution, and service/spare parts organizations optimize their inventories, save millions of dollars, improve cash flows, and meet corporate cost reduction objectives.

          INFORMS stands for The Institute for Operations Research and the Management Sciences. It is an international scientific society, with 10,000 members, dedicated to applying scientific methods to help improve decision-making, management, and operations. To learn more about INFORMS or its annual research conference, see www.informs.org.

          About Smart Software, Inc.
          Founded in 1981, Smart Software, Inc. is a leader in providing businesses with enterprise-wide demand forecasting, planning and inventory optimization solutions.  Smart Software’s flagship product, SmartForecasts, has thousands of users worldwide, including customers at mid-market enterprises and Fortune 500 companies, such as Abbott Laboratories, Mitsubishi, Siemens, Disney, Nestle, GE and The Coca-Cola Company.  SmartForecasts gives demand planners the tools to handle sales seasonality, promotions, new and aging products, multi-dimensional hierarchies, and intermittently demanded service parts and capital goods items.  It also provides inventory managers with accurate estimates of the optimal inventory and safety stock required to meet future orders and achieve desired service levels.  Smart Software is headquartered in Belmont, Massachusetts and can be found on the World Wide Web at www.smartsoftware.wpengine.com.

          SmartForecasts is a registered trademark of Smart Software, Inc.  All other trademarks are the property of their respective owners.


          For more information, please contact Smart Software, Inc., Four Hill Road, Belmont, MA 02478.
          Phone: 1-800-SMART-99 (800-762-7899); FAX: 1-617-489-2748; E-mail: info@smartsoftware.wpengine.com