How much time should it take to compute statistical forecasts?
The top factors that impact the speed of your forecast engine 

How long should it take for a demand forecast to be computed using statistical methods?  This question is often asked by customers and prospects.  The answer truly depends.  Forecast results for a single item can be computed in the blink of an eye, in as little as a few hundredths of a second, but sometimes they may require as much as five seconds.  To understand the differences, it’s important to understand that there is more involved than grinding through the forecast arithmetic itself.   Here are six factors that influence the speed of your forecast engine.

1) Forecasting method.  Traditional time-series extrapolative techniques (such as exponential smoothing and moving average methods), when cleverly coded, are lighting fast.  For example, the Smart Forecast automatic forecasting engine that leverages these techniques and powers our demand planning and inventory optimization software can crank out statistical forecasts on 1,000 items in 1 second!  Extrapolative methods produce an expected forecast and a summary measure of forecast uncertainty. However, more complex models in our platform that generate probabilistic demand scenarios take much longer given the same computing resources.  This is partly because they create a much larger volume of output, usually thousands of plausible future demand sequences. More time, yes, but not time wasted, since these results are much more complete and form the basis for downstream optimization of inventory control parameters.

2) Computing resources.  The more resources you throw at the computation, the faster it will be.  However, resources cost money and it may not be economical to invest in these resources.  For example, to make certain types of machine learning-based forecasts work, the system will need to multi-thread computations across multiple servers to deliver results quickly.  So, make sure you understand the assumed compute resources and associated costs. Our computations happen on the Amazon Web Services cloud, so it is possible to pay for a great deal of parallel computation if desired.

3) Number of time-series.  Do you have to forecast only a few hundred items in a single location or many thousands of items across dozens of locations?  The greater the number of SKU x Location combinations, the greater the time required.  However, it is possible to trim the time to get demand forecasts by better demand classification.  For example, it is not important to forecast every single SKU x Location combination. Modern Demand Planning Software can first subset the data based on volume/frequency classifications before running the forecast engine.  We’ve observed situations where over one million SKU x Location combinations existed, but only ten percent had demand in the preceding twelve months.

4) Historical Bucketing.  Are you forecasting using daily, weekly, or monthly time buckets?  The more granular the bucketing, the more time it is going to take to compute statistical forecasts.  Many companies will wonder, “Why would anyone want to forecast on a daily basis?” However, state-of-the-art demand forecasting software can leverage daily data to detect simultaneous day-of-week and week-of-month patterns that would otherwise be obscured with traditional monthly demand buckets. And the speed of business continues to accelerate, threatening the competitive viability of the traditional monthly planning tempo.

5) Amount of History.  Are you limiting the model by only feeding it the most recent demand history, or are you feeding all available history to the demand forecasting software? The more history you feed the model, the more data must be analyzed and the longer it is going to take.

6) Additional analytical processing.  So far, we’ve imagined feeding items’ demand history in and getting forecasts out. But the process can also involve additional analytical steps that can improve results. Examples include:

a) Outlier detection and removal to minimize the distortion caused by one-off events like storm damage.

b) Machine learning that decides how much history should be used for each item by detecting regime change.

c) Causal modeling that identifies how changes in demand drivers (such as price, interest rate, customer sentiment, etc.) impact future demand.

d) Exception reporting that uses data analytics to identify unusual situations that merit further management review.

 

The Rest of the Story. It’s also critical to understand that the time to get an answer involves more than the speed of forecasting computations per se.  Data must be loaded into memory before computing can begin. Once the forecasts are computed, your browser must load the results so that they may be rendered on screen for you to interact with.  If you re-forecast a product, you may choose to save the results.  If you are working with product hierarchies (aggregating item forecasts up to product families, families up to product lines, etc.), the new forecast is going to impact the hierarchy, and everything must be reconciled.   All of this takes time.

Fast Enough for You? When you are evaluating software to see whether your need for speed will be satisfied, all of this can be tested as part of a proof of concept or trial offered by demand planning software solution providers.  Test it out, and make sure that the compute, load, and save times are acceptable given the volume of data and forecasting methods you want to use to support your process.

 

 

 

Do your statistical forecasts suffer from the wiggle effect?

 What is the wiggle effect? 

It’s when your statistical forecast incorrectly predicts the ups and downs observed in your demand history when there really isn’t a pattern.  It’s important to make sure your forecasts don’t wiggle unless there is a real pattern.

Here is a transcript from a recent customer where this issue was discussed:

Customer: “The forecast isn’t picking up on the patterns I see in the history.  Why not?” 

Smart:  “If you look closely, the ups and downs you see aren’t patterns.  It’s really noise.”  

Customer:  “But if we don’t predict the highs, we’ll stock out.”

Smart: “If the forecast were to ‘wiggle’ it would be much less accurate.  The system will forecast whatever pattern is evident, in this case a very slight uptrend.  We’ll buffer against the noise with safety stocks. The wiggles are used to set the safety stocks.”

Customer: “Ok. Makes sense now.” 

Do your statistical forecasts suffer from the wiggle effect graphic

The wiggle looks reassuring but, in this case, it is resulting in an incorrect demand forecast. The ups and downs aren’t really occurring at the same times each month.  A better statistical forecast is shown in light green.

 

 

Extend Microsoft 365 F&SC and AX with Smart IP&O

Microsoft Dynamics 365 F&SC and AX can manage replenishment by suggesting what to order and when via reorder point-based inventory policies.  A challenge that customers face is that efforts to maintain these levels are very detailed oriented and that the ERP system requires that the user manually specify these reorder points and/or forecasts.  As an alternative, many organizations end up generating inventory policies by hand using Excel spreadsheets or using other ad hoc approaches.

These methods are time-consuming and both likely result in some level of inaccuracy.  As a result, the organization will end up with excess inventory, unnecessary shortages, and a general mistrust of their software systems. In this article, we will review the inventory ordering functionality in AX / D365 F&SC, explain its limitations, and summarize how Smart Inventory Planning & Optimization can help improve a company’s cash position.   This is accomplished by reduced inventory, minimized and controlled stockouts.   Use of Smart Software delivers predictive functionality that is missing in Dynamics 365.

Microsoft Dynamics 365 F&SC and AX Replenishment Policies

In the inventory management module of AX and F&SC, users can manually enter planning parameters for every stock item. These parameters include reorder points, safety stock lead times, safety stock quantities, reorder cycles, and order modifiers such as supplier imposed minimum and maximum order quantities and order multiples. Once entered, the ERP system will reconcile incoming supply, current on hand, outgoing demand, and the user defined forecasts and stocking policies to net out the supply plan or order schedule (i.e., what to order and when).

There are 4 replenishment policy choices in F&SC and AX:  Fixed Reorder Quantity, Maximum Quantity, Lot-For-Lot and Customer Order Driven.

  • Fixed Reorder Quantity and Max are reorder point-based replenishment methods. Both suggest orders when on hand inventory hits the reorder point. With fixed ROQ, the order size is specified and will not vary until changed. With Max, order sizes will vary based on stock position at time of order with orders being placed up to the Max.
  • Lot-for Lot is a forecasted based replenishment method that pools total demand forecasted over a user defined time frame (the “lot accumulation period”) and generates an order suggestion totaling the forecasted quantity. So, if your total forecasted demand is 100 units per month and the lot accumulation period is 3 months, then your order suggestion would equal 300 units.
  • Order Driven is a make to order based replenishment method. It doesn’t utilize reorder points or forecasts. Think of it as a “sell one, buy one” logic that only places orders after demand is entered.

 

Limitations

Every one of F&SC / AX replenishment settings must be entered manually or imported through custom uploads created by customers.  There simply isn’t any way for users to natively generate any inputs (especially not optimal ones). The lack of credible functionality for unit level forecasting and inventory optimization within the ERP system is why so many AX and F&SC users are forced to rely on spreadsheets for planning and then manually set the parameters the ERP needs.  In reality, most planners end up manually set demand forecasts and reordering.

And when they can use spread sheets, they often rely on wide rule of thumb methods that results in using simplified statistical models.  Once calculated in the spread sheet these must be loaded into F&SC/AX.  They are often either loaded via cumbersome file imports or manually entered.   Because of the time and effort, it takes to build these, companies do not frequently update these numbers.

Once these are set in place, organizations tend to employ a reactive approach to changes.  The only time a buyer/planner reviews inventory policy is annually or at the time of purchases or manufacturing.   Some firms will also react after encountering problems with inventory levels being short (or too high).  Managing this in AX and F&AS requires manual interrogation to review history, calculate forecasts, assess buffer positions, and to recalibrate.

Microsoft recognizes these constraints in their core ERPs and understands the significant challenges to customers.  In response Microsoft has positioned forecasting under their AI Azure stack.  This method is outside of the core ERPs.  It is offered as a tool set for Data Scientists to use in defining custom complex statistics and calculations as a company wishes.  This is in addition to some basic simple calculations as a starting point are currently in their start up phases of development.  While this may hold long term gains, currently this method means customers start from near scratch and define what Microsoft currently called ‘experiments’ to gauge demand planning.

The bottom line is that customers face large challenges in getting the Dynamics stack itself to help solve these problems.  The result is for CFOs to have less cash available for what they need and for Sales Execs to have sales opportunities unfilled and a potential loss of sales because the firm can’t ship the goods the customer wants.

 

Get Smarter

Wouldn’t it be better to simply leverage a best of breed add-on for demand planning; and a best of breed inventory optimization solution to manage and balance costs and fulfilment levels?  Wouldn’t it be better to be able to do this on a daily or weekly basis to make your decisions closest to the need, preserving cash while meeting sales demand?

Imagine having a bidirectional integration with AX and F&AS so this all operates easily and quickly.   One where:

  • you could automatically recalibrate policies in frequent planning cycles using field proven, cutting-edge statistical models,
  • you would be able to calculate demand forecasts that account for seasonality, trend, and cyclical patterns,
  • You would automatically leverage optimization methods that prescribe the most profitable stocking policies and service levels that consider the real costs of carrying inventory and stock outages, giving you a full economic picture,
  • You could free up cash for use within the company and manage your inventory levels to improve order fulfillment at the same time as you free this cash.
  • you would have safety stocks and inventory levels that would account for demand and supply variability, business conditions, and priorities,
  • you’d be able to target specific service levels by groups of products, customers, warehouses, or any other dimension you selected,
  • you increase overall company profit and balance sheet health.

 

Extend Microsoft 365 F&SC and AX with Smart IP&O

To see a recording of the Microsoft Dynamics Communities Webinar showcasing Smart IP&O, register here:

https://smartcorp.com/inventory-planning-with-microsoft-365-fsc-and-ax/

 

 

 

 

Extend Microsoft 365 BC and NAV with Smart IP&O

Microsoft Dynamics 365 BC and NAV can manage replenishment by suggesting what to order and when via reorder point-based inventory policies. The problem is that the ERP system requires that the user manually specify these reorder points and/or forecasts. As a result, most organizations end up forecasting and generating inventory policies by hand in Excel spreadsheets or using other ad hoc approaches. Given poor inputs, automatic order suggestions will be inaccurate, and in turn the organization will end up with excess inventory, unnecessary shortages, and a general mistrust of their software systems.  In this article, we will review the inventory ordering functionality in BC & NAV, explain its limitations, and summarize how Smart Inventory Planning & Optimization can help reduce inventory, minimize stockouts and restore your organization’s trust in your ERP by providing the robust predictive functionality that is missing in Dynamics 365.

 

Microsoft Dynamics 365 BC and NAV Replenishment Policies

In the inventory management module of NAV and BC, users can manually enter planning parameters for every stock item. These parameters include reorder points, safety stock lead times, safety stock quantities, reorder cycles, and order modifiers such as supplier imposed minimum and maximum order quantities and order multiples.  Once entered, the ERP system will reconcile incoming supply, current on hand, outgoing demand, and the user defined forecasts and stocking policies to net out the supply plan or order schedule (i.e., what to order and when).

 

There are 4 replenishment policy choices in NAV & BC:  Fixed Reorder Quantity, Maximum Quantity, Lot-For-Lot and Order.

  • Fixed Reorder Quantity and Max are reorder point-based replenishment methods. Both suggest orders when on hand inventory hits the reorder point.  With fixed ROQ, the order size is specified and will not vary until changed.  With Max, order sizes will vary based on stock position at time of order with orders being placed up to the Max.
  • Lot-for Lot is a forecasted based replenishment method that pools total demand forecasted over a user defined time frame (the “lot accumulation period”) and generates an order suggestion totaling the forecasted quantity. So, if your total forecasted demand is 100 units per month and the lot accumulation period is 3 months, then your order suggestion would equal 300 units.
  • Order is a make to order based replenishment method. It doesn’t utilize reorder points or forecasts. Think of it as a “sell one, buy one” logic that only places orders after demand is entered.

 

Limitations

Every one of BC and NAVs replenishment settings must be entered manually or imported from external sources.  There simply isn’t any way for users to natively generate any inputs (especially not optimal ones). The lack of credible functionality for forecasting and inventory optimization within the ERP system is why so many NAV and BC users are forced to rely on spreadsheets.  Planners must manually set demand forecasts and reordering parameters.  They often rely on user defined rule of thumb methods or outdated and overly simplified statistical models.  Once calculated, they must input the information back into their system, often via cumbersome file imports or even manual entry.  Companies infrequently compute their policies because it is time consuming and error prone. We have even encountered situations where the reorder points haven’t been updated in years. Many organizations also tend to employ a reactive “set it and forget it” approach, where the only time a buyer/planner reviews inventory policy is at the time of order–after the order point is already breached.

 

If the order point is deemed too high, it requires manual interrogation to review history, calculate forecasts, assess buffer positions, and to recalibrate.  Most of the time, the sheer magnitude of orders means that buyers will just release it creating significant excess stock.  And if the reorder point is too low, well, it’s already too late. An expedite is required to avoid a stockout and if you can’t expedite, you’ll lose sales.

 

Get Smarter

Wouldn’t it be better to simply leverage a best of breed add-on for demand planning and inventory optimization that has an API based bidirectional integration? This way, you could automatically recalibrate policies every single planning cycle using field proven, cutting edge statistical models.  You would be able to calculate demand forecasts that account for seasonality, trend, and cyclical patterns.  Safety stocks would account for demand and supply variability, business conditions, and priorities.  You’d be able to target specific service levels so you have just enough stock.  You could even leverage optimization methods that prescribe the most profitable stocking policies and service levels that consider the real costs of carrying inventory. With a few mouse-clicks you could update NAV and BC’s replenishment policies on-demand. This means better order execution in NAV and BC, maximizing your existing investment in your ERP system.

 

Smart IP&O customers routinely helps customers realize 7 figure annual returns from reduced expedites, increased sales, and less excess stock, all the while gaining a competitive edge by differentiating themselves on improved customer service.

 

To see a recording of the Dynamics Communities Webinar showcasing Smart IP&O, register here:

https://smartcorp.com/inventory-planning-with-microsoft-dynamics-nav/

 

 

 

Extend Epicor Kinetic’s Forecasting & Min/Max Planning with Smart IP&O

Extend Epicor Kinetic’s Forecasting & Min/Max Planning with Smart IP&O  
Epicor Kinetic can manage replenishment by suggesting what to order and when via reorder point-based inventory policies. Users can either manually specify these reorder points or use a daily average of demand to dynamically compute the policies.  If the policies aren’t correct then the automatic order suggestions will be inaccurate, and in turn the organization will end up with excess inventory, unnecessary shortages, and a general mistrust of their software systems.  In this article, we will review the inventory ordering functionality in Epicor Kinetic, explain its limitations, and summarize how Smart Inventory Planning & Optimization (Smart IP&O) can help reduce inventory, minimize stockouts and restore your organization’s trust in your ERP by providing the robust predictive functionality that is missing from ERP systems.

Epicor Kinetic (and Epicor ERP 10) Replenishment Policies
In the item maintenance screen of Epicor Kinetic, users can enter planning parameters for every stock item. These include Min On-Hand, Max On-Hand, Safety Stock lead times, and order modifiers such as supplier imposed minimum and maximum order quantities and order multiples.  Kinetic will reconcile incoming supply, current on hand, outgoing demand, stocking policies, and demand forecasts (that must be imported) to net out the supply plan.   Epicor’s time-phased replenishment inquiry details what is up for order and when while the Buyers Workbench enables users to assemble purchase orders.

Epicor’s Min/Max/Safety logic and forecasts that are entered into the “forecast entry” screen drives replenishment.  Here is how it works:

  • The reorder point is equal to Min + Safety. This means whenever on hand inventory drops below the reorder point an order suggestion will be created. If demand forecasts are imported via Epicor’s “forecast entry” screen the reorder point will account for the forecasted demand over the lead time and is equal to Min + Safety + Lead time forecast
  • If “reorder to Max” is selected, Epicor will generate an order quantity up to the Max. If not selected, Epicor will order the “Min Order Qty” if MOQ is less than the forecasted quantity over the time fence. Otherwise, it will order the forecasted demand over the time-period specified.  In the buyer’s workbench, the buyer can modify the actual order quantity if desired.

 

Limitations
Epicor’s Min/Max/Safety relies on an average of daily demand. It is easy to set up and understand.  It can also be effective when you don’t have lots of demand history. However, you’ll have to create forecasts and adjust for seasonality, trend, and other patterns externally.  Finally, multiples of averages also ignore the important role of demand or supply variability and this can result in misallocated stock as illustrated in the graphic below: 

 

Epicor same average demand and safety stock is determined

In this example, two equally important items have the same average demand (2,000 per month) and safety stock is determined by doubling the lead time demand resulting in a reorder point of 4,000. Because the multiple ignores the role of demand variability, Item A results in a significant overstock and Item B results in significant stockouts.

As designed, Min should hold expected demand over lead time and Safety should hold a buffer. However, these fields are often used very differently across items without a uniform policy; sometimes users even enter a Min and Safety Stock even though the item is being forecasted, effectively over estimating demand! This will generate order suggestions before it is needed, resulting in overstocks.  

Spreadsheet Planning
Many companies turn to spreadsheets when they face challenges setting policies in their ERP system.  These spreadsheets often rely on user defined rule of thumb methods that often do more harm than good.  Once calculated, they must input the information back into Epicor,  via manual file imports or even manual entry.  The time consuming nature of the process leads companies to infrequently compute their inventory policies – Many months of even years go by in between mass updates leading to a “set it and forget it” reactive approach, where the only time a buyer/planner reviews inventory policy is at the time of order.  When policies are reviewed after the order point is already breached it is too late.  When the order point is deemed too high, manual interrogation is required to review history, calculate forecasts, assess buffer positions, and to recalibrate.  The sheer volume of orders means that buyers will just release orders rather than take the painstaking time to review everything leading to significant excess stock.  If the reorder point is too low, it’s already too late.  An expedite is now required driving up costs and even then you’ll still lose sales if the customer goes elsewhere.

Epicor is Smarter
Epicor has partnered with Smart Software and offers Smart IP&O as a cross platform add-on to Epicor Kinetic and Prophet 21 with API based integrations.  This enables Epicor customers to leverage built for purpose best of breed forecasting and inventory optimization applications.  With Epicor Smart IP&O you can automatically recalibrate policies every planning cycle using field proven, cutting-edge statistical and probabilistic models.  You can calculate demand forecasts that account for seasonality, trend, and cyclical patterns.  Safety stocks will account for demand and supply variability, business conditions, and priorities.  You can leverage service level driven planning so you have just enough stock or turn on optimization methods that prescribe the most profitable stocking policies and service levels that consider the real cost of carrying inventory. You can build consensus demand forecasts that blend business knowledge with statistics, better assess customer and sales forecasts, and confidently upload forecasts and stocking policies to Epicor within a few mouse-clicks.

Smart IP&O customers routinely realize 7 figure annual returns from reduced expedites, increased sales, and less excess stock, all the while gaining a competitive edge by differentiating themselves on improved customer service. To see a recorded webinar hosted by the Epicor Users Group that profiles Smart’s Demand Planning and Inventory Optimization platform, please register here: https://smartcorp.com/epicor-smart-inventory-planning-optimization/