The Smart Forecaster

 Pursuing best practices in demand planning,

forecasting and inventory optimization

“Trillions of records of millions of people…Finding the useful and right information, understanding its quality and producing reliable analyzed data in a timely and cost-effective manner are all critical issues.”

Smart Software Senior Vice President for Research Tom Willemain recently had the opportunity to talk with Dr. Mohsen Hamoudia, President of the International Institute of Forecasters (IIF), to discuss current issues with, and opportunities for, big data analytics. The IIF informs practitioners on trends and research developments in forecasting via print and online publications and the hosting of professional conferences.

Dr. Hamoudia begins, by way of introduction:

In all industries, data availability is exploding in volume, variety and velocity. Big data analytics is playing an important role in identifying the data that is most important to the business.

Let me take the example of the Information and Communication Technology (ICT) sector. We are seeing literally exponential growth in the amount of data available to telecoms, Over-the-top (OTT) independent content distributors, government, regulators and other organizations.

Around the world, we are witnessing petabytes of data: trillions of records of millions of people—all coming from multiple sources. Among these sources: internet connections, sales, customer contact centers, social media, mobile and land lines data. Finding the useful and right information, understanding its quality and producing reliable analyzed data in a timely and cost-effective manner are all critical issues. ICT companies are increasingly looking to find actionable insights in their data. How they can increase their customer base and loyalty programs? How can they improve the quality of service (QoS) and reduce customer turnover? With the right big data analytics platforms in place, they can be more competitive and efficient, improving operations, customer service and risk management. Forecasting and predicting customer trends and directions are key for telecoms.

Forecasting skills, including mathematics, statistics and econometrics, form one of the most important “blocks” of required skills in managing Big Data. Some forecasting activities naturally form part of the big data debate.

In retail industries, forecasting addresses daily demand across thousands of products. Financial forecasting, whether considering customer behavior or financial data series, generates massive on-line data sets. As pointed out by Robert Fildes, Distinguished Professor at Lancaster University, as yet the academic forecasting community is not thoroughly engaged—with only a few exceptions. Hal Varian of Google has looked at some of the work that David Hendry and Jennifer Castle, at Oxford University, have undertaken on searching large data sets for data congruent meaningful models. Stock and Watson have also developed their own approaches to large macro data sets. But despite the attempt, at last year’s symposium on forecasting in Seoul, to explore the theme of big data and its forecasting applications, there remain few convincing applications of using on-line data on real forecasting problems.

Q. One hears a great deal about “predictive analytics” these days, yet the phrase rarely is linked with forecasting. Do you agree that forecasting lies at the heart of predictive analytics? Have you an explanation for why the link has been broken? Have you ideas about how to re-inject forecasting into the conversation?

The results of forecasting (the “what”) are perhaps now perceived as less important than the “how”. Consequently, the trust that users give to traditional forecasting has declined. Who indeed is challenging the accuracy or relevance of forecasting by comparing, a posteriori, the reality vs. forecast—making a case for metholodiges’ effectiveness and therefor building credibility?

With the current perception of “predictive analytics”, there is probably more space in the public imagination allocated to the “how” side of things, and therefor a more credible story to tell to partners, investors or customers.

Q. It appears that there is almost no link between traditional forecasting and mobile technology (smart phones, tablet computers). Is this true, or are some companies migrating forecasting to mobile devices? Do you see a path forward in which traditional forecasting algorithms would routinely reside on mobile devices?

First of all, I am really delighted to invite your readers to have a look at our latest issue of Foresight. An excellent paper on the subject, “Forecasting In the Pocket: Mobile Devices Can Improve Collaboration”, explains that “the increasing popularity of PDAs, smartphones, tablet computers and other mobile devices opens up new opportunities for communication and collaboration on business forecasts.” The authors tell us “mobile forecasting (m-forecasting) applications may streamline approaches to collaboration between retailers and suppliers, thus contributing to the provision and exchange of product information, especially since forecasts are strongly tied to local context knowledge.”

For example, on the ICT & OTT side, a large number of predictive projects, such as those of Google+ and Facebook, are happening thanks to the inclusion of the “user location” data in the OTT IT systems. In my opinion, and what I see in some sectors like retail and logistics, is that traditional forecasting and mobile forecasting (m-forecasting) are complementary. This latter could be seen as a bottom-up forecasting approach that will or will not confirm the top-down forecasting results.

Q. Some people argue that big data will facilitate the replacement of forecasting with “sense and react” systems. Practically speaking, how would you explain “sense and react”, and are there application areas where you think it is or is not likely to take hold?

It seems to me that “sense and react” is fully oriented to the short-term perspective. Forecasting extends this by addressing needs for a variable horizon: short-term and medium-term.

As a side effect of ATAWAD (Anytime, Anywhere, Any Device), the decision-making criteria are, more than ever, “short term”. Big data is a “weak signals” sensing system, which enable the near-real-time detection of business opportunities that would go unnoticed with traditional IT systems. There are not really preferred or non-priority applications for this, the question is more on the “when” side.

Big data is relevant when looking below the surface in difficult economic times, but I am less sure whether it is worth the effort in “normal” economic period. To conclude on this point: I will be happy to see an example on how accurate are forecasts which are based on “sense and react” versus forecast based on traditional models.

Q. I’m asking some big questions. To what extent do you see the IIF community shaping these discussions and outcomes? How can readers join in the dialogue?

We are expecting an increasing availability, and increasing usage, of huge amount of data in many industries—such as energy, transportation, health care, finance, telecommunications and tourism.

Many of the IIF’s members are engaged in different aspects of the big data “movement.” The IIF is doing some work in the forecasting activities that naturally form part of the big data debate. More generally, the IIF is actively participating in, and providing a forum for, the discussion of forecasting in the wider world.

The theme of our last International Symposium on Forecasting (ISF) held in Seoul was “Forecasting with Big Data” and a few presentations were related to health care and telecommunications. A relevant workshop has just been run by the European Central Bank (ECB). If these models are capitalized on, they have the potential to impact the economic policy of Europe quite quickly.

Readers can join in the dialogue by contributing papers to the IIF’s publications (The International Journal of Forecasting, Foresight and The Oracle). Foresight, for one, is an invaluable voice in bringing academics and practitioners together in an ongoing discussion.

Readers also can present papers at the annual conference (the aforementioned ISF). They also can suggest and organize specific workshops for specific applications of big data, like the one that was just organized by the ECB in Frankfurt. Another opportunity is to invite IIF’s members to attend any meeting related to forecasting with big data. All these opportunities form good platforms for networking and working together.

Mohsen Hamoudia, PhD, is the President of the International Institute of Forecasters. He also serves as Head of Strategy for Large Projects (Paris) for Orange Business Services (the former France Telecom).

Thomas Willemain, PhD, co-founded Smart Software and currently serves as Senior Vice President for Research. Dr. Willemain also serves as Professor Emeritus of Industrial and Systems Engineering at Rensselear Polytechnic Institute, and as a member of the research staff at the Center for Computing Sciences, Institute for Defense Analyses.

Leave a Comment

Related Posts

Leveraging Epicor Kinetic Planning BOMs with Smart IP&O to Forecast Accurately

Leveraging Epicor Kinetic Planning BOMs with Smart IP&O to Forecast Accurately

In this blog, we explore how leveraging Epicor Kinetic Planning BOMs with Smart IP&O can transform your approach to forecasting in a highly configurable manufacturing environment. Discover how Smart, a cutting-edge AI-driven demand planning and inventory optimization solution, can simplify the complexities of predicting finished goods demand, especially when dealing with interchangeable components. Learn how Planning BOMs and advanced forecasting techniques enable businesses to anticipate customer needs more accurately, ensuring operational efficiency and staying ahead in a competitive market.

Daily Demand Scenarios

Daily Demand Scenarios

In this Videoblog, we will explain how time series forecasting has emerged as a pivotal tool, particularly at the daily level, which Smart Software has been pioneering since its inception over forty years ago. The evolution of business practices from annual to more refined temporal increments like monthly and now daily data analysis illustrates a significant shift in operational strategies.

The Methods of Forecasting

The Methods of Forecasting

Demand planning and statistical forecasting software play a pivotal role in effective business management by incorporating features that significantly enhance forecasting accuracy. One key aspect involves the utilization of smoothing-based or extrapolative models, enabling businesses to quickly make predictions based solely on historical data. This foundation rooted in past performance is crucial for understanding trends and patterns, especially in variables like sales or product demand. Forecasting software goes beyond mere data analysis by allowing the blending of professional judgment with statistical forecasts, recognizing that forecasting is not a one-size-fits-all process. This flexibility enables businesses to incorporate human insights and industry knowledge into the forecasting model, ensuring a more nuanced and accurate prediction.

Recent Posts

  • Simple Inventory Optimization is Good Except When It Isn’t FHDSimple is Good, Except When It Isn’t
    In this blog, we are steering the conversation towards the transformative potential of technology in inventory management. The discussion centers around the limitations of simple thinking in managing inventory control processes and the necessity of adopting systematic software solutions. […]
  • Leveraging Epicor Kinetic Planning BOMs with Smart IP&O to Forecast Accurately HDLeveraging Epicor Kinetic Planning BOMs with Smart IP&O to Forecast Accurately
    In this blog, we explore how leveraging Epicor Kinetic Planning BOMs with Smart IP&O can transform your approach to forecasting in a highly configurable manufacturing environment. Discover how Smart, a cutting-edge AI-driven demand planning and inventory optimization solution, can simplify the complexities of predicting finished goods demand, especially when dealing with interchangeable components. Learn how Planning BOMs and advanced forecasting techniques enable businesses to anticipate customer needs more accurately, ensuring operational efficiency and staying ahead in a competitive market. […]
  • Two Multiechelon Inventory Optimization Neural Network AIThe Next Frontier in Supply Chain Analytics
    We believe the leading edge of supply chain analytics to be the development of digital twins of inventory systems. These twins take the form of discrete event models that use Monte Carlo simulation to generate and optimize over the full range of operational risks. We also assert that we and our colleagues at Smart Software have played an outsized role in forging that leading edge. […]
  • SMART JOINS EPICOREpicor Acquires Smart Software for AI-Powered Inventory Planning & Optimization Technologies
    The acquisition brings together two companies tightly aligned in helping organizations get to the right insights at the right time and take action to maximize business performance. . […]
  • Overcoming Uncertainty with Service and Inventory Optimization TechnologyOvercoming Uncertainty with Service and Inventory Optimization Technology
    In this blog, we will discuss today's fast-paced and unpredictable market and the constant challenges businesses face in managing their inventory and service levels efficiently. The main subject of this discussion, rooted in the concept of "Probabilistic Inventory Optimization," focuses on how modern technology can be leveraged to achieve optimal service and inventory targets amidst uncertainty. This approach not only addresses traditional inventory management issues but also offers a strategic edge in navigating the complexities of demand fluctuations and supply chain disruptions. […]

    Inventory Optimization for Manufacturers, Distributors, and MRO

    • Why MRO Businesses Need Add-on Service Parts Planning & Inventory SoftwareWhy MRO Businesses Need Add-on Service Parts Planning & Inventory Software
      MRO organizations exist in a wide range of industries, including public transit, electrical utilities, wastewater, hydro power, aviation, and mining. To get their work done, MRO professionals use Enterprise Asset Management (EAM) and Enterprise Resource Planning (ERP) systems. These systems are designed to do a lot of jobs. Given their features, cost, and extensive implementation requirements, there is an assumption that EAM and ERP systems can do it all. In this post, we summarize the need for add-on software that addresses specialized analytics for inventory optimization, forecasting, and service parts planning. […]
    • Spare-parts-demand-forecasting-a-different-perspective-for-planning-service-partsThe Forecast Matters, but Maybe Not the Way You Think
      True or false: The forecast doesn't matter to spare parts inventory management. At first glance, this statement seems obviously false. After all, forecasts are crucial for planning stock levels, right? It depends on what you mean by a “forecast”. If you mean an old-school single-number forecast (“demand for item CX218b will be 3 units next week and 6 units the week after”), then no. If you broaden the meaning of forecast to include a probability distribution taking account of uncertainties in both demand and supply, then yes. […]
    • Whyt MRO Businesses Should Care about Excess InventoryWhy MRO Businesses Should Care About Excess Inventory
      Do MRO companies genuinely prioritize reducing excess spare parts inventory? From an organizational standpoint, our experience suggests not necessarily. Boardroom discussions typically revolve around expanding fleets, acquiring new customers, meeting service level agreements (SLAs), modernizing infrastructure, and maximizing uptime. In industries where assets supported by spare parts cost hundreds of millions or generate significant revenue (e.g., mining or oil & gas), the value of the inventory just doesn’t raise any eyebrows, and organizations tend to overlook massive amounts of excessive inventory. […]
    • Top Differences between Inventory Planning for Finished Goods and for MRO and Spare PartsTop Differences Between Inventory Planning for Finished Goods and for MRO and Spare Parts
      In today’s competitive business landscape, companies are constantly seeking ways to improve their operational efficiency and drive increased revenue. Optimizing service parts management is an often-overlooked aspect that can have a significant financial impact. Companies can improve overall efficiency and generate significant financial returns by effectively managing spare parts inventory. This article will explore the economic implications of optimized service parts management and how investing in Inventory Optimization and Demand Planning Software can provide a competitive advantage. […]