Abstract:

With the rapid pace of innovation and market evolution, change has become an ever-present feature of organizational life, reshaping organizations, business processes, and supporting information systems (IS). While organizations invest heavily in IS changes, they lack a quantifiable way to measure the change success and the impact of those changes on the strategy, Key Performance Indicators (KPIs), validity, and adequacy of change plan vis-à-vis of the organization’s strategy. This paper presents the IS Change Impact Assessment Framework (IS-CIAF), a quantitative framework addressing the gap for IS change impact assessment through three integrated components: (1) An Ishikawa-based hierarchical decomposition for strategic objectives, (2) A theoretically grounded master taxonomy combining Delone & McLean IS Success Model, and McKinsey 7S extended with Integration Quality dimension, and (3) A three-level KPI Hierarchy structure. The lowest-level objectives extracted from the decomposition are statically linked to the KPIs using PLS-SEM and regression analysis, creating a KPI-Objective Impact Matrix as the primary output of the framework. The resulting KPI–Objective Impact Matrix is expected to function as a decision-support tool, enabling organizations to quantitatively prioritize IS-level factors based on their measured impact on strategic KPI outcomes. The proposed IS-CIAF is grounded in design science research methodology and applied to an Oracle ERP procurement module as an illustration.