De slimme voorspeller

 Het nastreven van best practices op het gebied van vraagplanning,

prognoses en voorraadoptimalisatie

Those who produce forecasts owe it to those who consume forecasts, and to themselves, to be aware of the uncertainty in their forecasts. This note is about how to estimate forecast uncertainty and use the estimates in your demand planning process. We focus on forecasts made in support of demand planning as well as forecasts inherent in optimizing inventory policies involving reorder points, safety stocks, and min/max levels.

Reading this, you will learn about:

-Criteria for assessing forecasts
-Sources of forecast error
-Calculating forecast error
-Converting forecast error into prediction intervals
-The relationship between demand forecasting and inventory optimization.
-Actions you can take to use these concepts to improve your company’s processes.

Criteria for Assessing Forecasts

Forecast error alone is not reason enough to reject forecasting as a management tool. To twist a famous aphorism by George Box, “All forecasts are wrong, but some are useful.” Of course, business professionals will always search for ways to make forecasts more useful. This usually involves work to reduce forecast error. But while forecast accuracy is the most obvious criterion by which to judge forecasts, but it is not the only one. Here’s a list of criteria for evaluating forecasts:

Accuracy: Forecasts of future values should, in retrospect, be very close to the actual values that eventually reveal themselves. But there may be diminishing returns to squeezing another half percent of accuracy out of forecasts otherwise good enough to use in decision making.

Timeliness: Fighter pilots refer to the OODA Loop (Observe, Orient, Decide, and Act) and the “need to get inside the enemy’s OODA loop” so they can shoot first. Businesses too have decision cycles. Delivering a perfectly accurate forecast the day after it was needed is not helpful. Better is a good forecast that arrives in time to be useful.

Cost: Forecasting data, models, processes and people all cost money.  A less expensive forecast might be fueled by data that are readily available; more expensive would be a forecast that runs on data that have to be collected in a special process outside the scope of a firm’s information infrastructure.  A classic, off-the-shelf forecasting technique will be less costly to acquire, feed and exploit than a complex, custom, consultant-supplied method. Forecasts could be mass-produced by software overseen by a single analyst, or they might emerge from a collaborative process requiring time and effort from large groups of people, such as district sales managers, production teams, and others. Technically advanced forecasting techniques often require hiring staff with specialized technical expertise, such as a master’s degree in statistics, who tend to cost more than staff with less advanced training.

Credibility: Ultimately, some executive has to accept and act on each forecast. Executives have a tendency to distrust or ignore recommendations that they can neither understand nor explain to the next person above them in the hierarchy. For many, believing in a “black box” is too severe a test of faith, and they reject the black box’s forecasts in favor of something more transparent.

All that said, we will focus now on forecast accuracy and its evil twin, forecast error.

Sources of Forecast Error

Those seeking to reduce error can look in three places to find trouble:
1. The data that goes into a forecasting model
2. The model itself
3. The context of the forecasting exercise

There are several ways in which data problems can lead to forecast error.

Gross errors: Wrong data produce wrong forecasts. We have seen an instance in which computer records of product demand were wrong by a factor of two! Those involved spotted that problem immediately, but a less egregious situation can easily slip through to poison the forecasting process. In fact, just organizing, acquiring and checking data is often the largest source of delay in the implementation of forecasting software. Many data problems seem to derive from the data having been unimportant until a forecasting project made them important.

Anomalies: Even with perfectly curated forecasting databases, there are often “needle in a haystack” type data problems. In these cases, it is not data errors but demand anomalies that contribute to forecast error. In a set of, say, 50,000 products, some number of items are likely to have odd details that can distort forecasts.

Holdout analysis is a simple but powerful method of analysis. To see how well a method forecasts, use it with older known data to forecast newer data, then see how it would have turned out! For instance, suppose you have 36 months of demand data and need to forecast 3 months ahead. You can simulate the forecasting process by holding out (i.e., hiding) the most recent 3 months of data, forecasting using only data from months 1 to 33, then comparing the forecasts for months 34-36 against the actual values in months 34-36. Sliding simulation merely repeats the holdout analysis, sliding along the demand history. The example above used the first 33 months of data to get 3 estimates of forecast error. Suppose we start the process by using the first 12 months to forecast the next 3. Then we slide forward and use the first 13 months to forecast the next 3. We continue until finally we use the first 35 months to forecast the last month, giving us one more estimate of the error we make when forecasting one month ahead. Summarizing all the 1-step ahead, 2-step ahead and 3-step ahead forecast errors provides a way to calculate prediction intervals.

Calculating Prediction Intervals

The final step in calculating prediction intervals is to convert the estimates of average absolute error into the upper and lower limits of the prediction interval. The prediction interval at any future time is computed as

Prediction interval = Forecast ± Multiplier x Average absolute error.

The final step is the choice of the multiplier. The typical approach is to imagine some probability distribution of error around the forecast, then estimate the ends of the prediction interval using appropriate percentiles of that distribution. Usually, the assumed distribution of error is the Normal distribution, also called the Gaussian distribution or the “bell-shaped curve”.

Use of Prediction Intervals
The most immediate, informal use of prediction intervals is to convey a sense of how “squishy” a forecast is. Prediction intervals that are wide compared to the size of the forecasts indicate high uncertainty.

There are two more formal uses in demand forecasting: Hedging your bets about future demand and guiding forecast adjustment.

Hedging your bets: The forecast values themselves approximate the most likely values of future demand. A more ominous way to say the same thing is that there is about a 50% chance that the actual value will be above (or below) the forecast. If the forecast is being used to plan future production (or raw materials purchase or hiring), you might want to build in a cushion to keep from being caught short if demand spikes (assuming that under-building is worse than over-building). If the forecast is converted from units to dollars for revenue projections, you might want to use a value below the forecast to be conservative in projecting cash flow. In either case, you first have to choose the coverage of the prediction interval. A 90% prediction interval is a range of values that covers 90% of the possibilities. This implies that there is a 5% chance of a value falling above the upper limit of the 90% prediction interval. In other words, the upper limit of a 90% prediction interval marks the 95th percentile of the distribution of predicted demand at that time period. Similarly, there is a 5% chance of falling below the lower limit, which marks the 5th percentile of the demand distribution.

Guiding forecast adjustment: It is quite common for statistical forecasts to be revised by some sort of collaborative process. These adjustments are based on information not recorded in an item’s demand history, such as intelligence about competitor actions. Sometimes they are based on a more vaporous source, such as sales force optimism. When the adjustments are made on-screen for all to see, the prediction intervals provide a useful reference: If someone wants to move the forecasts outside the prediction intervals, they are crossing a fact-based line and should have a good story to justify their argument that things will be really different in the future.

Prediction Intervals and Inventory Optimization

Finally, the concept behind prediction intervals play an essential role in a problem related to demand forecasting: Inventory Optimization.
The core analytic task in setting reorder points (also called Mins) is to forecast total demand over a replenishment lead time. This total is called the lead time demand. When on-hand inventory falls down to or below the reorder point, a replenishment order is triggered. If the reorder point is high enough, there will be an acceptably small risk of a stockout, i.e., of lead time demand driving inventory below zero and creating either lost sales or backorders.

SDP_Screenshot new statistical methods planning

New statistical methods, and we can start planning more effectively.

The forecasting task is to determine all the possible values of cumulative demand over the lead time and their associated probabilities of occurring. In other words, the basic task is to determine a prediction interval for some future random variable. Suppose you have computed a 90% prediction interval for lead time demand. Then the upper end of the interval represents the 95th percentile of the distribution. Setting the reorder point at this level will accommodate 95% of the possible lead time demand values, meaning there will be only a 5% chance of stocking out before replenishment arrives to re-stock the shelves. Thus there is an intimate relationship between prediction intervals in demand forecasting and calculation of reorder points in inventory optimization.


5 Recommendations for Practice

1. Set expectations about error: Sometimes  managers have unreasonable expectations about reducing forecast error to zero. You can point out that error is only one of the dimensions on which a forecasting process must be judged; you may be doing fine on both timeliness and cost. Also point out that zero error is no more realistic a goal than 100% conversion of prospects into customers, perfect supplier performance, or zero stock price volatility.

2. Track down sources of error: Double check the accuracy of demand histories. Use statistical methods to identify outliers in demand histories and react appropriately, replacing verified anomalies with more typical values and omitting data from before major changes in the character of the demand. If you use a collaborative forecasting process, compare its accuracy against a purely statistical approach to identify items for which collaboration does not reduce error.

3. Evaluate the error of alternative statistical methods: There may be off-the-shelf techniques that do better than your current methods, or do better for some subsets of your items. The key is to be empirical, using the idea of holdout analysis. Gather your data and do a “bake off” between different methods to see which work better for you. If you are not already using statistical forecasting methods, compare them against whoever’s “golden gut” is your current standard. Use the naïve forecast as a benchmark in the comparisons.

4. Investigate the use of new data sources: Especially if you have items that are heavily promoted, test out statistical methods that incorporate promotional data into the forecasting process. Also check whether information from outside your company can be exploited; for instance, see whether macroeconomic indicators for your sector can be combined with company data to improve forecast accuracy (this is usually done using a method called multiple regression analysis).

5. Use prediction intervals: Plots of prediction intervals can improve your feel for the uncertainty in your forecasts, helping you select items for additional scrutiny. While it’s true that what you don’t know can hurt you, it’s also true that knowing what you don’t know can help you.

Laat een reactie achter

gerelateerde berichten

Smart Software leidt een webinar als onderdeel van het WERC Solutions Partner Program

Smart Software leidt een webinar als onderdeel van het WERC Solutions Partner Program

Smart Software, zal een webinar van 30 minuten leiden als onderdeel van het WERC Solutions Partner Program. De presentatie zal zich richten op hoe een toonaangevend elektriciteitsbedrijf Smart Inventory Planning and Optimization (Smart IP&O) implementeerde als onderdeel van het strategische supply chain-optimalisatie-initiatief (SCO) van het bedrijf.

Het Supply Chain Blame-spel: Top 3 excuses voor voorraadtekorten en -overschotten

Het Supply Chain Blame-spel: Top 3 excuses voor voorraadtekorten en -overschotten

De toeleveringsketen is de schuld geworden van bijna elk industrieel of kleinhandelsprobleem. Tekorten aan doorlooptijdvariabiliteit, slechte prognoses en problemen met slechte gegevens zijn levensfeiten, maar voorraadhoudende organisaties worden vaak verrast wanneer een van deze problemen zich voordoet. Dus nogmaals, wie is verantwoordelijk voor de chaos in de toeleveringsketen? Blijf deze blog lezen en we zullen proberen u te laten zien hoe u producttekorten en overstocking kunt voorkomen.

recente berichten

  • Supply Chain Math large-scale decision-making analyticsSupply Chain Math: Don’t Bring a Knife to a Gunfight
    Math and the supply chain go hand and hand. As supply chains grow, increasing complexity will drive companies to look for ways to manage large-scale decision-making. Math is a fact of life for anyone in inventory management and demand forecasting who is hoping to remain competitive in the modern world. Read our article to learn more. […]
  • Rijpe bebaarde monteur in uniform onderzoekt de machine en repareert deze in de fabriekPlanning voor verbruiksgoederen vs. herstelbare onderdelen
    Bij het bepalen van de juiste opslagparameters voor reserve- en vervangingsonderdelen, is het belangrijk om onderscheid te maken tussen verbruiks- en repareerbare onderdelen. Deze verschillen worden vaak over het hoofd gezien door software voor voorraadplanning en kunnen resulteren in onjuiste schattingen van wat er op voorraad moet worden gehouden. Er zijn verschillende benaderingen vereist bij het plannen van verbruiksartikelen versus herstelbare artikelen. […]
  • Vier veelgemaakte fouten bij het plannen van aanvullingsdoelenVier veelgemaakte fouten bij het plannen van aanvullingsdoelen
    Hoe vaak herkalibreert u uw voorraadbeleid? Waarom? Leer hoe u belangrijke fouten kunt vermijden bij het plannen van aanvullingsdoelen door het proces te automatiseren, onderdelen opnieuw te kalibreren, targeting-prognosemethoden te gebruiken en uitzonderingen te bekijken. […]
  • Smart Software introduceert met genoegen onze serie webinars, exclusief aangeboden voor Epicor-gebruikers.Breid de prognoses en min/max-planning van Epicor Kinetic uit met Smart IP&O
    Epicor Kinetic kan de aanvulling beheren door te suggereren wat te bestellen en wanneer via op bestelpunten gebaseerd voorraadbeleid. Het probleem is dat het ERP-systeem vereist dat de gebruiker deze bestelpunten handmatig specificeert, of een rudimentaire "vuistregel"-aanpak gebruikt op basis van dagelijkse gemiddelden. In dit artikel zullen we de functionaliteit voor het bestellen van voorraad in Epicor Kinetic bespreken, de beperkingen ervan uitleggen en samenvatten hoe de voorraad kan worden verminderd en de voorraad kan worden geminimaliseerd door de robuuste voorspellende functionaliteit te bieden die ontbreekt in Epicor. […]
  • Op scenario's gebaseerde prognoses versus vergelijkingenOp scenario's gebaseerde prognoses versus vergelijkingen
    Van oudsher heeft software gediend als een leveringsvehikel voor vergelijkingen. Dit is prima, voor zover het gaat. Maar wij bij Smart Software denken dat u er beter aan doet door uw vergelijkingen in te ruilen voor scenario's. Ontdek waarom op scenario's gebaseerde planning planners helpt om risico's beter te beheren en betere resultaten te behalen. […]

    Voorraadoptimalisatie voor fabrikanten, distributeurs en MRO

    • Algemene bestellingen Slimme softwarevraag en voorraadplanning HDAlgemene bestellingen
      Onze klanten zijn geweldige docenten die ons altijd hebben geholpen de kloof tussen leerboektheorie en praktische toepassing te overbruggen. Een goed voorbeeld gebeurde meer dan twintig jaar geleden, toen we kennismaakten met het fenomeen van intermitterende vraag, dat veel voorkomt bij reserveonderdelen, maar zeldzaam is bij de afgewerkte producten die worden beheerd door onze oorspronkelijke klanten die werkzaam zijn in verkoop en marketing. Deze onthulling leidde al snel tot onze vooraanstaande positie als leveranciers van software voor het beheren van voorraden reserveonderdelen. Ons laatste stukje scholing betreft 'algemene bestellingen'. […]
    • Plaats stukken met de hand om een pijl te bouwenProbabilistische prognoses voor intermitterende vraag
      De nieuwe prognosetechnologie is afgeleid van probabilistische prognoses, een statistische methode die zowel de gemiddelde productvraag per periode als de voorraadbehoeften op het niveau van de klantenservice nauwkeurig voorspelt. […]
    • Engineering op bestelling bij Kratos Space - beschikbaarheid van onderdelen een strategisch voordeel maken
      De Kratos Space-groep binnen National Security-technologie-innovator Kratos Defense & Security Solutions, Inc., produceert COTS-software en componentproducten voor ruimtecommunicatie - waardoor de beschikbaarheid van onderdelen een strategisch voordeel wordt […]
    • houten-figuren-van-mensen-en-een-magneet-team-management-magazijninventarisBeheer van de inventaris van gepromote artikelen
      In een eerder bericht besprak ik een van de neteligere problemen waarmee vraagplanners soms worden geconfronteerd: het werken met gegevens over productvraag die worden gekenmerkt door wat statistici scheefheid noemen - een situatie die kostbare voorraadinvesteringen kan vergen. Dit soort problematische gegevens is te vinden in verschillende scenario's. In ten minste één geval, de combinatie van intermitterende vraag en zeer effectieve verkoopacties, leent het probleem zich voor een effectieve oplossing. […]

        Cloud computing companies with unique server and hardware parts, e-commerce, online retailers, home and office supply companies, onsite furniture, power utilities, intensive assets maintenance or warehousing for water supply companies have increased their activity during the pandemic. Garages selling car parts and truck parts, pharmaceuticals, healthcare or medical supply manufacturers and safety product suppliers are dealing with increasing demand. Delivery service companies, cleaning services, liquor stores and canned or jarred goods warehouses, home improvement stores, gardening suppliers, yard care companies, hardware, kitchen and baking supplies stores, home furniture suppliers with high demand are facing stockouts, long lead times, inventory shortage costs, higher operating costs and ordering costs.