In this Videoblog, we will explain how time series forecasting has emerged as a pivotal tool, particularly at the daily level, which Smart Software has been pioneering since its inception over forty years ago. The evolution of business practices from annual to more refined temporal increments like monthly and now daily data analysis illustrates a significant shift in operational strategies.

Initially, during the 1980s, the usual practice of using annual data for forecasting and the introduction of monthly data was considered innovative. This period marked the beginning of a trend toward increasing the resolution of data analysis, enabling businesses to capture and react to faster shifts in market dynamics. As we progressed into the 2000s, the norm of monthly data analysis was well-established, but the ‘cool kids’—innovators at the edge of business analytics—began experimenting with weekly data. This shift was driven by the need to synchronize business operations with increasingly volatile market conditions and consumer behaviors that demanded more rapid responses than monthly cycles could provide. Today, in the 2020s, while monthly data analysis remains common, the frontier has shifted again, this time towards daily data analysis, with some pioneers even venturing into hourly analytics.

The real power of daily data analysis lies in its ability to provide a detailed view of business operations, capturing daily fluctuations that might be overlooked by monthly or weekly data.  However, the complexities of daily data necessitate advanced analytical approaches to extract meaningful insights. At this level, understanding demand requires grappling with concepts like intermittency, seasonality, trend, and volatility. Intermittency, or the occurrence of zero-demand days, becomes more pronounced at a daily granularity and demands specialized forecasting techniques like Croston’s method for accurate predictions. Seasonality at a daily level can reveal multiple patterns—such as increased sales on weekends or holidays—that monthly data would mask. Trends can be observed as short-term increases or decreases in demand, demanding agile adjustment strategies. Finally, volatility at the daily level is accentuated, showing more significant swings in demand than seen in monthly or weekly analyses, which can affect inventory management strategies and the need for buffer stock. This level of complexity underscores the need for sophisticated analytical tools and expertise in daily data analysis.

In conclusion, the evolution from less frequent to daily time series forecasting marks a substantial shift in how businesses approach data analysis. This transition not only reflects the accelerating pace of business but also highlights the requirement for tools that can handle increased data granularity. Smart Software’s dedication to refining its analytical capabilities to manage daily data highlights the industry’s broader move towards more dynamic, responsive, and data-driven decision-making. This shift is not merely about keeping pace with time but about leveraging detailed insights to forge competitive advantages in an ever-changing business environment.

​

Feynman’s perspective illuminates our journey:  “In its efforts to learn as much as possible about nature, modern physics has found that certain things can never be “known” with certainty. Much of our knowledge must always remain uncertain. The most we can know is in terms of probabilities.” ― Richard Feynman, The Feynman Lectures on Physics.

When we try to understand the complex world of logistics, randomness plays a pivotal role. This introduces an interesting paradox: In a reality where precision and certainty are prized, could the unpredictable nature of supply and demand actually serve as a strategic ally?

The quest for accurate forecasts is not just an academic exercise; it’s a critical component of operational success across numerous industries. For demand planners who must anticipate product demand, the ramifications of getting it right—or wrong—are critical. Hence, recognizing and harnessing the power of randomness isn’t merely a theoretical exercise; it’s a necessity for resilience and adaptability in an ever-changing environment.

Embracing Uncertainty: Dynamic, Stochastic, and Monte Carlo Methods

Dynamic Modeling: The quest for absolute precision in forecasts ignores the intrinsic unpredictability of the world. Traditional forecasting methods, with their rigid frameworks, fall short in accommodating the dynamism of real-world phenomena. By embracing uncertainty, we can pivot towards more agile and dynamic models that incorporate randomness as a fundamental component. Unlike their rigid predecessors, these models are designed to evolve in response to new data, ensuring resilience and adaptability. This paradigm shift from a deterministic to a probabilistic approach enables organizations to navigate uncertainty with greater confidence, making informed decisions even in volatile environments.

Stochastic modeling guides forecasters through the fog of unpredictability with the principles of probability. Far from attempting to eliminate randomness, stochastic models embrace it. These models eschew the notion of a singular, predetermined future, presenting instead an array of possible outcomes, each with its estimated probability. This approach offers a more nuanced and realistic representation of the future, acknowledging the inherent variability of systems and processes. By mapping out a spectrum of potential futures, stochastic modeling equips decision-makers with a comprehensive understanding of uncertainty, enabling strategic planning that is both informed and flexible.

Named after the historical hub of chance and fortune, Monte Carlo simulations harness the power of randomness to explore the vast landscape of possible outcomes. This technique involves the generation of thousands, if not millions, of scenarios through random sampling, each scenario painting a different picture of the future based on the inherent uncertainties of the real world. Decision-makers, armed with insights from Monte Carlo simulations, can gauge the range of possible impacts of their decisions, making it an invaluable tool for risk assessment and strategic planning in uncertain environments.

Real-World Successes: Harnessing Randomness

The strategy of integrating randomness into forecasting has proven invaluable across diverse sectors. For instance, major investment firms and banks constantly rely on stochastic models to cope with the volatile behavior of the stock market. A notable example is how hedge funds employ these models to predict price movements and manage risk, leading to more strategic investment choices.

Similarly, in supply chain management, many companies rely on Monte Carlo simulations to tackle the unpredictability of demand, especially during peak seasons like the holidays. By simulating various scenarios, they can prepare for a range of outcomes, ensuring that they have adequate stock levels without overcommitting resources. This approach minimizes the risk of both stockouts and excess inventory.

These real-world successes highlight the value of integrating randomness into forecasting endeavors. Far from being the adversary it’s often perceived to be, randomness emerges as an indispensable ally in the intricate ballet of forecasting. By adopting methods that honor the inherent uncertainty of the future—bolstered by advanced tools like Smart IP&O—organizations can navigate the unpredictable with confidence and agility. Thus, in the grand scheme of forecasting, it may be wise to embrace the notion that while we cannot control the roll of the dice, we can certainly strategize around it.

“Business is war” may be an overdone metaphor but it’s not without validity. Like the “Bomber Gap” and the “Missile Gap,” worries about falling behind the competition, and the resulting threat of annihilation, always lurk in the minds of business executives, If they don’t, they should, because not all gaps are imaginary (the Bomber Gap and the Missile Gap were shown to not exist between the US and the USSR, but the 1980’s gap between Japanese and American productivity was all too real). The difference between paranoia and justified concern is converting fear into facts. This post is about organizing your attention toward possible gaps in your company’s supply chain analytics.

Surveillance Gaps

The US Army has a saying: “Time spent on reconnaissance is never wasted.” Now and then, our Smart Forecaster blog has a post that helps you get your head on a swivel to see what’s going on around you. An example is our post on digital twins, which is a hot topic throughout the engineering world.  To recap: using demand and supply simulations to probe for weaknesses in your inventory plan is a form of supply chain reconnaissance.  Closing this surveillance gap enables businesses to take corrective action before an actual problem emerges.

Situational Awareness Gaps

A military commander needs to keep track of what is available for use and how well it is being used. The reports available in Smart Operational Analytics keep you current on your inventory counts, your forecasting accuracy, your suppliers’ responsiveness, and trends in these and other operational areas.  You’ll know exactly where you stand on a variety of supply chain KPIs such as service level, fill rates, and inventory turns.  You’ll know whether actual performance is aligned with planned performance and whether the inventory plan (i.e., what to order, when, from whom, and why) is being adhered to or ignored.

Agility Gaps

The business environment can change rapidly. All it takes is a tanker stuck sideways in the Suez Canal, a few anti-ship ballistic missiles in the Red Sea, or a region-wide weather event. These catastrophes may fall as much on your competitors’ heads as on yours, but which of you is agile enough to react first? Exception reporting in Demand Planner and Smart Operational Analytics can detect major changes in the character of demand so you can quickly filter out obsolete demand data before they poison all your calculations for demand forecasts or inventory optimization. Smart Demand Planner can give advance warning of a pending increase or decrease in demand. Smart Inventory Optimization can help you adjust your inventory replenishment tactics to reflect these shifts in demand.

Innovation Gaps

Whether you refer to your competition as “The Other Guys” or “Everybody Else” or something unprintable, the ones you have to worry about are the ones always looking for an edge. When you choose Smart as your partner, we’ll give you that edge with innovative but field proven predictive solutions.  Smart Software has been innovating predictive modeling since birth over 40 years ago.

• Our first products introduced multiple technical innovations: assessment of forecast quality by looking into the future not the past; automatic selection of the best among a set of competing methodologies, exploiting the graphics in the first PCs to allow easy management overrides of statistical forecasts.

• Later we invented and patented a radically different approach to forecasting the intermittent demand that is characteristic of both spare parts and big-ticket durable goods. Our technology was patented, received multiple awards for dramatically improving the management of inventory.  The solution is now a field proven approach used by many leading businesses in service parts, MRO, aftermarket parts, and field service.

• More recently, Smart’s cloud platform for demand forecasting, predictive modeling, inventory optimization, and analytics, takes all relevant data otherwise locked in your ERP or EAM systems, external files, and other disparate data sources, organizes it in the Smart Data Pipeline, structures it into our common data model, and processes it in our AWS cloud.  Smart uses the power of our patented probabilistic demand simulations in Smart Inventory Optimization to stress test and optimize the rules you use to manage each of your inventory items.

It’s my job, along with my cofounder Dr. Nelson Hartunian, our data science team, and academic consultants, to continue to push the envelope of supply chain analytics and bring the benefits back to you by continuously rolling out new versions of our products so you don’t get stuck in an innovation gap – or any of the others.

Those of you who track hot topics will be familiar with the term “digital twin.” Those who have been too busy with work may want to read on and catch up.

What is a digital twin?

While there are several definitions of digital twin, here’s one that works well:

A digital twin is a dynamic virtual copy of a physical asset, process, system, or environment that looks like and behaves identically to its real-world counterpart. A digital twin ingests data and replicates processes so you can predict possible performance outcomes and issues that the real-world product might undergo. [Source: Unity.com]. For additional background, you might go to Mckinsey.com.

What is the difference between a digital twin (hereafter DT) and a model? Primarily, a DT gets connected to real-time data to maintain the model as an up-to-the-minute representation of the system you are working with.

Our current products might be called “slow-motion DT’s” because they are usually used with non-real-time data (though not stale data, since it is updated overnight) and applied to problems like planning the next quarter’s raw material buys or setting inventory parameters for a month or longer.

Are people using digital twins in my industry?

My impression is that the penetration of DT’s may be highest in the aerospace and nuclear industries. Most of our customers are elsewhere: in manufacturing, distribution, and public utilities such as transportation and power. Soon we’ll be offering new products that come closer to the strict definition of a DT that is connected intimately to the system it represents.

DT Preview

Most users of Smart Inventory Optimization™ (SIO) run the application periodically, typically monthly. SIO analyzes current demand for inventory items and recent supplier lead times, converting these into demand and supply scenarios, respectively. Then users either interactively (for individual items) or automatically (at scale) set inventory control parameters that will provide the long-term average performance they want, balancing the competing goals of minimizing inventory while guaranteeing a sufficient level of item availability.

Smart Supply Planner (SSP) operates in a more immediate way to react to contingencies. Any day could bring an anomalous order that spikes up demand, such as when a new customer places a surprising initial stocking order. Or a key supplier could experience a problem at its factory and be forced to delay shipment of your planned replenishment orders. In the long run, these contingencies average out and justify the recommendations coming out of SIO. However, SSP will give you a way to react in the short run to seize opportunities or dodge bullets.

At its core, SSP operates like SIO in that it is scenario driven. The differences are that it uses short planning horizons and uses real-time initial conditions as the basis for its simulations of inventory system performance. Then it will provide real-time recommendations for interventions that offset the disruption caused by the contingencies. These would include cancelling or expediting replenishment orders.

Summary

Digital twins let you try out plans “in silico” before you implement them in the factory or warehouse. At their core are mathematical models of your operation but connected to real-time data. They provide a “digital sandbox” in which you can try out ideas and get immediate predictions of how well they will work. Much more than a spreadsheet, DT’s will soon be the key tool in your inventory planning toolbox.

Some companies invest in software to help them manage their inventory, whether it’s spare parts or finished goods. But a surprising number of others play the Inventory Guessing Game every day, trusting to an imagined “Golden Gut” or to plain luck to set their inventory control parameters. But what kind of results do you expect with that approach?

How good are you at intuiting the right values? This blog post challenges you to guess the best Min and Max values for a notional inventory item. We’ll show you its demand history, give you a few relevant facts, then you can pick Min and Max values and see how well they would work. Ready?

The Challenge

Figure 1 shows the daily demand history of the item. The average demand is 2 units per day. Replenishment lead time is a constant 10 days (which is unrealistic but works in your favor). Orders that cannot be filled immediately from stock cannot be backordered and are lost. You want to achieve at least an 80% fill rate, but not at any cost. You also want to minimize the average number of units on hand while still achieving at least an 80% fill rate. What Min and Max values would produce an 80% fill rate with the lowest average number of units on hand? [Record your answers for checking later. The solution appears below at the end of the article.]

Computing the Best Min and Max Values

The way to determine the best values is to use a digital twin, also known as a Monte Carlo simulation. The analysis creates a multitude of demand scenarios and passes them through the mathematical logic of the inventory control system to see what values will be taken on by key performance indicators (KPI’s).

We built a digital twin for this problem and systematically exercised it with 1,085 pairs of Min and Max values. For each pair, we simulated 365 days of operation a total of 100 times. Then we averaged the results to assess the performance of the Min/Max pair in terms of two KPI’s: fill rate and average on hand inventory.

Figure 2 shows the results. The inherent tradeoff between inventory size and fill rate is clear in the figure: if you want a higher fill rate, you have to accept a larger inventory. However, at each level of inventory there is a range of fill rates, so the game is to find the Min/Max pair that yields the highest fill rate for any given size inventory.

A different way to interpret Figure 2 is to focus on the dashed green line marking the target 80% fill rate. There are many Min/Max pairs that can hit near the 80% target, but they differ in inventory size from about 6 to about 8 units. Figure 3 zooms in on that region of Figure 2 to show  quite a number of Min/Max pairs that are competitive.

We sorted the results of all 1,085 simulations to identify what economists call the efficient frontier. The efficient frontier is the set of most efficient Min/Max pairs to exploit the tradeoff between fill rate and units on hand. That is, it is a list of Min/Max pairs that provide the least cost way to achieve any desired fill rate, not just 80%. Figure 4 shows the efficient frontier for this problem. Moving from left to right, you can read off the lowest price you would have to pay (as measured by average inventory size) to achieve any target fill rate. For example, to achieve a 90% fill rate, you would have to carry an average inventory of about 10 units.

Figures 2, 3, and 4 show results for various Min/Max pairs but do not display the values of Min and Max behind each point. Table 1 displays all the simulation data: the values of Min, Max, average units on hand and fill rate. The answer to the guessing game is highlighted in the first line of the table: Min=7 and Max=13¹. Did you get the right answer, or something close²? Did you maybe get onto the efficient frontier?

Conclusions

Maybe you got lucky, or maybe you do indeed have a Golden Gut, but it’s more likely you didn’t get the right answer, and it’s even more likely you didn’t even try. Figuring out the right answer is extremely difficult without using the digital twin. Guessing is unprofessional.

One step up from guessing is “guess and see”, in which you implement your guess and then wait a while (months?) to see if you like the results. That tactic is at least “scientific”, but it is inefficient.

Now consider the effort to work out the best (Min,Max) pairs for thousands of items. At that scale, there is even less justification for playing the Inventory Guessing Game. The right answer is to play it… Smart³.

¹ This answer has a bonus, in that it achieves a bit more than 80% fill rate at a lower average inventory size than the Min/Max combination that hit exactly 80%. In other words, (7,13) is on the efficient frontier.

² Because these results come from a simulation instead of an exact mathematical equation, there is a certain margin of error associated with each estimated fill rate and inventory level. However, because the average results were based on 100 simulations each 365 days long, the margins of error are small. Across all experiments, the average standard errors in fill rate and mean inventory were, respectively, only 0.009% and 0.129 units.

³ In case you didn’t know this, one of the founders of Smart Software was … Charlie Smart.