Zaleski S., Michalski R. (2021). Success factors in sustainable management of IT service projects: exploratory factor analysis. Sustainability, 13(8), 4457.
Cited (JCR): 0, Other Cites: 0
Management of successful IT projects in a sustainable manner is influenced by numerous factors. Organizational awareness of the necessity of engaging all project stakeholders is an important issue that helps in meeting project sustainable development goals. While there are many studies on the success factors of IT software projects, there is still little coherent research on the success factors of IT service projects. The purpose of this article is to contribute in filling this gap by attempting to identify success factors of the IT services project involving both traditional and agile approaches and considering sustainable development, specifically in terms of the stakeholders’ role in project management. We conducted questionnaire-based research involving 155 IT service project managers. The results of the study were subjected to exploratory factor analysis. As a result, we presented and thoroughly formally examined the factorial model of success components in the IT service industry. We distinguished four factors: (1) agile techniques and change management, (2) organization and people, (3) stakeholders and risk analysis, and (4) work environment. The results were compared with analogous studies found in the literature. The research showed that both traditional and agile management approaches coexist, meet sustainable development goals, and are significant for the successful management in IT service projects where all stakeholders play an important role.
success factors; IT services; project management; sustainable development; project stakeholders;
Sustainability can be summarised as taking care of people and the world, without forgetting economic criteria with a wide participation of stakeholders and with a profound consideration of stakeholder values, opinions, feelings and needs . Successful management of IT projects in a sustainable manner is influenced by numerous factors. Even though a considerable amount of research was focused on these aspects, it is still a challenge for companies to apply appropriate measures for ensuring high quality and timeliness of services while taking into account the stakeholders and all their diversified expectations and attitudes.
Despite the rapid development of the IT industry and increasing experience in sustainable project management, many ventures are not fully successful. Failures concern delays, deviations from original assumptions and requirements, changes in scope and functionality, and, finally, project interruption [2,3]. All these negative outcomes, naturally, decrease the effectiveness and efficiency of the project management process, adversely affect the internal and external stakeholders, and may have destructive impact on the possibility of achieving project goals. On the other hand, they may be a consequence of insufficient emphasis attached to project stakeholders.
Nowadays, more and more large and complex organizations transform their IT services by means of multiple different techniques and methods aligning their activities with sustainability goals. They try to maintain specific resources at an appropriate level in the global ecosystem  and are increasingly more aware of the importance of engaging all project stakeholders in meeting sustainable development goals .
Although there are many studies on the success factors of IT software projects, there is still little coherent and comprehensive research on the success factors in projects involving specifically IT services. Thus, the purpose of this article is to identify success factors of the IT service projects by taking into account both traditional and agile approaches. We performed exploratory factor analysis based on a questionnaire filled in by IT service project managers. The analysis was conducted in the context of sustainable development goals and managerial aspects related to project stakeholders.
The rest of the paper is organized as follows. First, we extensively review the literature on sustainable management in IT projects with a specific focus on the role of stakeholders. Section 2 includes also background works concerned with success factors in IT systems, software, and services. The next section presents information on the questionnaire development and administration, sample characteristics and statistical tools applied. In Section 4, we demonstrate the initial six-factor model involving all 45 questions extracted from the literature review. The model is then refined and reduced to the four-factor solution with 16 variables. The final proposal is thoroughly examined in terms of its statistical quality with a strong emphasis on reliability and validity. We proposed the names for the identified factors and interpreted. Discussion and comparisons with other models obtained in this area were provided in Section 6. Finally, the conclusion section finishes the paper.
2. Literature review
2.1. Successful sustainable management of IT projects – the role of stakeholders
At the end of the 20th century organizational awareness of homeostasis with the surrounding world began to increase. Many authors presented and analyzed the concepts related to: sustainability (e.g., ) sustainable development (e.g., ), sustainable project management in general , and focused specifically on project stakeholders (e.g., [9,10]). The Oxford English Dictionary defines sustainability as the ability to continue over time . The other definition says that sustainability is the „capability of being maintained at a certain rate or level” . The World Commission on Environment and Development defined sustainable development from the perspective of present needs, technology, and social organization limitations  with a special focus on a balance between social, environment and economic goals, known as three pillars . Lately, another pillar was included. It concerns human being aspects .
Allen and Hoekstra  consider sustainability as an evolutionary process involving collaboration between its components and nature. The sustainability notion evolved to the sustainable development which is seen as a strategy of managing all assets . In such a context, the project management impacts social, environment and economy goals. In consequence, the sustainability aspect of project management started being adapted to business organizations. As a response to current market challenges and changing environment, organizations such as Project Management Institute (PMI) and International Project Management Association (IPMA) also incorporated sustainability into the project management process, linking it with agile principles . Both principles work directly to achieve positive economic, human, socio and environmental capital leading to successful projects. What is more, one of the Agile Manifesto principles is directly related to sustainable development, namely, “Agile processes promote sustainable development” . The studies on sustainability in proactive stakeholder management have been provided, for example, by . The research in this regard, generally suggest that it is desired to engage stakeholders with all their interests in project management activities (compare specifically ). It is beneficial to all stakeholders to mutually cooperate in building and managing solutions to create a coherent and well-functioning system.
Usually, the project definition is clear-cut. We consider a project as a temporary enterprise with start and completion dates specified, which is undertaken to deliver a unique product or service . When it comes to the project success term, the literature is more ambiguous. The concept of success in IT projects may relate the project success and the project management success. The project success refers to project objectives that constitute the most appropriate success criteria. For example, in the research of Cooke-Davies , which included the analysis of mainly European projects, the success factors involved the project management success, individual project success and consistently successful projects. Another approach was proposed by de Wit , who considered the project as successful if it met the following conditions: technical performance criteria, mission, and satisfaction of key stakeholders including both the provider and customer. In this context, the project is considered successful when the long-term perspective is taken into account – even 10 to 15 years after the project completion. The project management success, in turn, has a short-term nature  and concerns traditional performance measures such as time, cost and quality . These are also called objective measures. They can be supplemented by subjective ones regarding the satisfaction of all project stakeholders [24–26].
Until 2015, large-scale studies on factors influencing the project success performed regularly by the Standish Group did not consider subjective measures of stakeholders. However, in later investigations, the satisfaction criteria was already included . This change was probably caused by results showing that the success of project management based only on the costs and time does not guarantee the overall project success [2,27]. Some research even suggests to change the primary success measures (time, cost and quality) into the success perception criteria . In this paper, we adopted the project success perspective including both approaches, that is, project scope, quality, time, cost, and stakeholders’ satisfaction.
While analyzing the elements having a potential impact on the project success, we can distinguish critical success factors (CSF) . They represent key areas, where “things must go right” to achieve objectives and goals by individuals or organizations . For the purpose of this study, it was assumed that project success components include all management system input data which may directly or indirectly lead to the project success . The potential variables impacting project success can be found in multiple studies and were subject to analysis in diverse industries. The number of success elements varies not only across industries but also within them. We can find both categorized and ungrouped lists of success components depending on the context of research. For instance, Pinto and Slevin  asked managers to provide a list of improvements in successful project implementation. The responses were grouped into ten success factors and classified as strategic and tactical.
The following subsections contain a brief review of research on project success factors related with the IT sector. We present and discuss separately studies related to IT services, IT software manufacturing enterprises, and IT system industry which is not dedicated specifically to IT software development or IT services.
The IT system is understood here in a broad sense (e.g., ) and includes all communication and computer components within an organization. More specifically, the IT system comprises all software, hardware, and various other components that connect these individual pieces together into a functional and operating structure in an organization. IT software development regards creation, changing or maintaining computer applications that involves their designing, programming, testing, as well as installation and training (e.g., ). IT services, in turn, are related to the use of knowledge from management and computer technology to support organizations in creating, maintaining, and improving business processes along with managing information resources. They may be focused on business processes, or IT infrastructure (e.g., ).
The three areas have some common aspects and differences. All of them pertain to computer science technology and information processing. Although these spheres are mutually related to each other, there are also significant discrepancies among them. For instance, IT services may cover, extend, make use of, or create IT system components in some situations, but they do not fully overlap as some IT services may not involve the IT system existing in a given organization. Providing IT services may require using some software components, but not creating the software, which is the part of the IT software development. IT software development itself may be focused on computer applications that are not part of the IT system in an organization, e.g., computer games or some mobile phone software.
2.2.Success factors in IT systems
In this section we focus on research in the IT system industry which is not dedicated specifically to IT software development or IT services. Besner and Hobbs [35,36] focused on exploring the value of project management practices in improving project performance. They concentrated on tools and techniques used by projects managers. The investigation involved a large number of 753 global project management practitioners. They were asked about a list of 70 tools and techniques taken from the Project Management Book of Knowledge (PMBoK) that could have positive impact on the project success. Similar tools and techniques are used regardless of the origin of the projects. However, nearly 60% of the respondents were IT and telecommunication practitioners. The findings show that only about a third of the examined tools and techniques are regularly used by project managers.
Doherty  applied the Q methodology mixed design to analyze subjective insights about the important project success factors. The author surveyed 60 IT project managers and identified two critical success factors: a sustained commitment of the upper management to the given project and clear and measurable project goals and objectives. He additionally distinguished the importance of people-project interactions, stakeholders’ involvement, and traditional project management activities. However, Doherty did not identify the agile management and principles of organizational or coordination theories as significant components of the project success.
Baker  based on the literature review distinguished twenty-three critical success factors. Subsequently, he used the factor analysis and the multiple linear regression analysis, based on 113 surveys, to examine relationships between the computer technology project success and selected critical success factors. As a result of these analysis, all variables were grouped into three factors: process and methods (including such variables as architecture and design, quality and risk management, product development life-cycle), relationship management (represented by variables like organization culture, management support, stakeholders’ involvement), and project management (with schedule, plan, scope and requirements management elements).
Within Enterprise Resource Planning (ERP) systems, Nah et al.  identified initial success factors using the literature review and then submitted the survey to Chief Information Officers (CIOs) of Fortune 1000 companies. They received 54 responses and using descriptive statistical analysis provided the success factors ranking. The most important factors involved management support, project champion, and teamwork and composition.
White and Fortune  submitted their questionnaire to 995 active project managers (with approximately 24% response rate). They discovered critical practices of project managers, mainly in information technology. The tool included both closed (one choice, multiple choice, scale) and open questions. The authors applied descriptive statistics and recognized twenty-two success components including, among others, clear goals and objectives, management support, adequate funds and resources.
2.3.Success factors in IT software development
In this subsection, exemplary studies focused directly on success factors in software development projects are characterized. For instance, Berntsson-Svensson and Aurum  asked software practitioners and managers from Swedish and Australian companies to participate in the survey which consisted with 33 questions. They randomly chose software producing companies that received the survey. The participants were developing software for three different industries – financial, consulting, and telecommunications. Authors received a total of 27 survey responses and provided only descriptive statistics. The common success components for studied industries are concerned with complete and accurate requirements and enough time for gathering the requirements.
Chow and Cao  based on the literature review compiled a list of potential success factors and studied the critical success factors in agile software projects by means of factor and regression analyses. Overall, 109 participants from 25 countries completed the survey. They identified possible twelve critical success factors that were transformed into 12 main hypotheses. Using the multiple regression analysis, they determined that 6 success factors out of those 12 can be considered as important enough. The list of significant factors contained: delivery strategy, agile software engineering techniques, team capability, project management process, team environment, and customer involvement.
A similar study was conducted by Stankovic et al. . It involved 23 respondents from former Yugoslavia IT companies. They aimed at classifying the critical success factors by using the same survey tool as Chow and Cao , however the new results did not confirm the exploratory factor analysis structure provided by Chow and Cao . Despite that, Stankovic et al.  did also the corresponding regression analysis with all 12 factors received by Chow and Ciao . They received three more significant factors that could potentially be considered as critical success factors in terms of timeliness and cost. Authors confirmed that strong executive support and project type has no influence on the success of agile project which was in line with the previous study. They found that the organization environment factor does not strong influence the success of agile projects, which is consistent with the former research as well.
Another study based on Chow’s and Cao’s  research has been conducted by Brown  who performed multiple regression analysis to check how various factors are related to the four success dimensions (quality, scope, timeliness and cost) and how they contribute to the agile project success. The agile project members were chosen randomly from companies located in the United States of America. Brown  found that 6 out of the 12 factors were significant: project type, project schedule, project nature, management commitment, project definition process and delivery strategy.
Stanberry  also based her research on the results of Chow and Cao . She surveyed 132 practitioners from U.S.A.-based global companies, who used scrum methodology. The respondents acted in such roles as the scrum master, product owner, software developer, business analyst, and tester. The purpose of the research was to examine relations between 12 success factors using regression techniques. She found that all 12 success factors had a meaningful impact on the success of agile software development projects where the scrum methodology was applied.
Large-scale studies regarding the IT software sector are performed by the Standish Group [2,46,47]. This organization explores the state of IT application development sector on a yearly basis. Among other things, the organization provides a summary report including the top 10 project success factors known as the CHAOS summary report . Executives included in the survey represent large, medium, and small project sizes from all major industry sectors with a heavier concentration on the United States and. The respondents are IT executives not project managers which can lead to the lack of more detailed potential success variables. In CHAOS report 2015, the new attribute criteria have been added. Instead of traditional success criteria (on time, on budget and on target) the modern six individual attributes of success (on time, on budget, on target, on goal, value and satisfaction) have been implemented.
Williams  conducted analysis on managers’ software development approach and its relation to the project success. He surveyed 281 IT project managers. Based on the obtained results he recommends that agile and hybrid methods should be the preferred in software development for most projects and that more experienced IT managers should be sought.
Furthermore, Aldahmash et al.  researched the critical success factors of agile software development projects. Based on the literature review, they initially selected eight potential success factors. Next, they designed a web-based questionnaire in which they ask agile practitioners about factors that help to successfully complete the project. Authors used the principal component analysis to identify a structure with two components: (1) organizational and people aspects involving organizational culture, customer involvement, top management support, team capability and training, and communication, and (2) technical and project management components related to project management process, delivery strategy, and agile software techniques.
2.4.Success factors in IT service
Finally, this section refers to the research on project success factor referring directly to IT services. It seems that the in this specific area, the number of studies is considerably the smallest in relation to the IT sector fields described in previous subsections. Among a few studies that focus on success components concerned specifically with IT services there are works of Hochstein et al. [51,52] who conducted several studies of European companies specializing in IT services. They indicated the following significant elements of success: management process, acceptance and attention in organization, high quality project management, process understanding, and success verification.
The studies on Information Technology Infrastructure Library (ITIL) implementations as a transformation IT service management in Australian companies has been conducted by Cater-Steel et al. . Their qualitative approach findings showed key success factors related to the engagement of the personnel, support from the top management, communication of results, marketing campaigns in terms of acceptance and understanding, training and personnel development paths.
Critical success factors in this area were identified also for Lean IT implementations . The research was based on the series of interviews with experts who determined which factors may be critical or non-critical. Authors started from the set of 30 components and ended up with sixteen factors. The five highest ranked items are as follow: management leadership, measuring operational performance of the IT outsourcing relationship, financial compensation mechanism that stimulates improvement, utilization of Lean tools or techniques, and rewarding performance on a team-level basis.
3.1. Exploratory factor analysis
Since project success determinants in IT services received comparatively small scientific attention, we decided to employ the exploratory factor analysis (EFA) for examining this issue and try to provide a consistent framework for future studies. All EFA procedures aimed at obtaining the factor loading structure used PCA extraction and that was followed by the orthogonal Varimax rotation with Kaiser normalization. This type of statistical procedure aims at identifying and associating the examined set of variables to more general factors or categories. Technically, it allows to reduce the matrix of correlations between variables whereas practically, it facilitates better understanding of the investigated subject by revealing the hidden structure of relations between these variables.
In this study a web-based questionnaire was developed. The scope and selection of questions in the questionnaire considers both traditional and agile approaches, and is based on the literature review analysis. In the face of sparse works dealing directly with IT services, we extended our search by studies from other fields focused on project success factors. Specifically, we searched Scopus and Web of Science Core Collection databases for publications using expressions: “project success”, “project management success”, “project success factors”, “project management success factors” along with additional keywords “IT”, “IT service”, “IT systems”, and “software”. Some additional references were obtained by examining references from publications identified in searched databases. As a result, we analyzed 169 articles involving project success factors. The extensive and detailed list of research sources from all the areas that were used to collect possible candidates for critical success components and included in the exploratory factor analysis, are put together in Appendix A, Table A1. It should be mentioned that some of the potential success factors examined in the literature and taken advantage of in this study were based either on a small sample of respondents or provided only descriptive arguments that were not backed up by quantitative justifications involving statistical methods.
While choosing variables for our questionnaire we focused on such components that were the most common and the most relevant to the IT service area. As a result, an initial list of potential questions was methodically evaluated by 15 experts. They were psychologists and sociologists skilled in creating questionnaires and analyzing this type of data, as well as project management scientists, IT project managers and heads of project management departments. The grammatical, stylistic and semantic correctness, question types, scales, detail, structure and logical consistency were verified.
During the preparation phase the questionnaire tool was tested and reviewed in a preliminary study . Fifteen IT project managers answered all questions of the survey. After reviews and discussions with subject matter experts and results of preliminary survey received from respondents, the series of improvements has been implemented. To improve readability and firstly to focus on the success factors area, the sections sequences was changed, new (success perception) section was added, and accordingly updated names of the sections. Within the success factors section, the two changes regarding noncompliance with Likert scale was conducted – (question related risk management was extended to the three questions on risk subject, and question related to the tools used was moved to the project profile section). In consequence, the total number of potential success factors was extended from 44 to 45. In term of grammatical and stylistic the minor correctness of 18 questions were performed.
3.3.Sample and data collection
The survey was anonymous and was carried out in 2019 from February to June in an international company operating worldwide in the IT service area. Overall, 155 fully completed web-based questionnaires were collected. The tool included questions about project success rated on the 7 – point Likert scale (1 – strongly disagree, 2 – disagree, 3 – somewhat disagree, 4 – neither agree nor disagree, 5 – somewhat agree, 6 – agree, 7 – strongly agree). The survey was filled in by project managers, who were asked about project critical success factors. They were instructed to refer to the project finished recently (either successful or not) which was the most relevant or most telling with regard to critical success factors. The research tool consisted of five sections. The first part contained elements potentially influencing the project success. The second section included questions on respondents’ perception of the project success. Next, the criteria for success in the project were included. The fourth part regarded information about the project and the project manager. In the last section subjects had the possibility to provide additional comments. Taking into account the specifics of the IT sector, the sample can be regarded as balanced in relation to the gender. Among the project managers involved in the study, there were as much as 43% of females. The overall experience of the respondents in the IT sector was significant with an average of over 10 years and standard deviation of S = 8.1. Almost 60% of them had at least six years of such experience. Their mean experience as project managers in the IT sector equaled over seven years (S = 6.2) with nearly 70% having more than four years of experience in project management. The details are provided in Table 1.
Table 1. Respondents characteristics.
Variable Category Count Percent
Gender Female 67 43.2
Male 88 56.8
Experience in IT 1 – 3 33 21.3
(years; M1 = 10.4, S2 = 8.1) 4 – 6 34 21.9
7 – 10 29 18.7
11 – 15 22 14.2
> 15 37 23.9
Experience in IT project management 1 – 3 50 32.3
(years; M = 7.3, S = 6.2) 4 – 6 45 29.0
7 – 10 29 18.7
11 – 15 15 9.7
> 15 16 10.3
1 Mean value, 2 standard deviation.
Table 2. Characteristics of projects managed by respondents.
Variable Category Count Percent
Project length 1 – 6 48 31.0
(months; 7 – 9 17 11.0
M1 = 15, S2 = 18.2) 10 – 12 40 25.8
13 – 24 31 20.0
> 24 19 12.3
Project scope type Construction of a new system / service 75 48.4
Extension of the existing system / service 42 27.1
Maintenance of the existing system / service 38 24.5
Project customer type External 136 87.7
Internal 19 12.3
Project delivery type Request for contribution / service 71 45.8
Transition (compliance) 6 3.9
Transition and transformation 55 35.5
Other (i.e., automation, migration, software ...) 23 14.8
1 Mean value, 2 standard deviation.
The respondents took part in projects from multiple countries mostly located in Europe. There were more than 20 projects from Germany, France, United Kingdom, more than 10 from Italy, Benelux and Nordic countries. There were also some projects from Switzerland, Japan, and the USA. The respondents participated in projects that lasted on average 15 months (S = 18.2). The vast majority of projects (88%) were carried out for external clients, and only 12% for internal recipients. Approximately half of the projects were focused on developing new service or system, the rest involved either extension or maintenance of the existing IT solutions. More information about projects’ characteristics is given in Table 2.
The gathered data were, generally, analyzed in IBM Statistical Package for the Social Sciences (SPSS Statistics, version 26). Specifically, the following procedures from this software were employed: exploratory factor analysis, Cronbach’s alphas in the reliability analysis, variance inflation factors from the collinearity diagnostics, descriptive analysis (means, standard deviations, skewness, kurtosis). Parallel analysis was conducted by means of eigenvalues produced by SPSS for our model and random eigenvalues generated by web software available at . Average variance extracted along with composite reliability were computed in Microsoft Excel.
4. Initial Factor Model
The input data to the statistical model are represented by 45 variables resulting from the literature review. Each of the components along with their literature origin are described in Table A1 placed in Appendix A. As it was presented in the literature review, in previous studies on project management success components, the identified number of factors in exploratory analysis varied considerably from 2  to even 12 . Based on the extensive and detailed analysis of these studies, it was difficult to propose the most suitable number of factors. The investigations were very different in terms of the specific scope, participants’ characteristics, comprehensiveness of the literature review, and formal criteria used in the exploratory factor analysis. Therefore, we decided to start the analysis with 6 factors that were obtained in our preliminary study. Overall, they explained 52.8% of the total variance. Eigenvalues above 1 and variance explained for such a factor analysis are provided in Table B2 of Appendix B. The factor loading results of this initial step involving all 45 questions are presented in Table B1 in Appendix B. The resulting structure is far from being of good quality, especially in terms of convergent and discriminant validity. Although there is a substantial number of factor loadings above 0.35 (bolded) which should not be neglected, in many cases significant, and multiple cross loadings exist, e.g., Q05, Q11, Q12, Q14, Q37, Q43 (underlined). Moreover, for some variables, none of the factor loadings exceeded the value of 0.4, e.g., Q17, Q22, Q27, Q33 (in italics). It may also be noted that factors 5 and 6 have relatively small number of high-valued correlations with variables. On the other hand, the first factor has as many as 16 factor loadings above 0.35. Given these problems, we adopted some criteria facilitating the selection of the appropriate number of factors and performed a series of simulations with various configurations of variables. Finally, we managed to specify a more parsimonious model with four factors and 16 variables, which is presented and comprehensively analyzed in Section 5 of this paper.
5. Final Factor Model
The initial 6-factor model involving all 45 variables has been subjected to a series of modifications to improve its quality. Generally, we confined it to only four factors. Variables that weakly correlated with all factors or highly correlated with two or more factors were eliminated. Variables were excluded from the model one by one taking also into account their substantive suitability. The exploratory factor analysis was repeated after each such activity using the same approach. In total, more than 30 iterations were performed. As a result of this gradual elimination and taking into consideration of other model quality measures, the final factor structure consists of four factors and 16 variables. The refined model accounts for as much as 61% of the total variance, which is meaningfully higher than our initial proposal of 6 factors (52.8%). In next subsections, details on the whole procedure are presented, the variables included in the model are grouped according to the distinguished factors which are then interpreted.
5.1. Common method bias
Taking advantage of the Harman's single factor test , we verified to which extent a single factor may be sufficient to explain the whole variance related to all variables in our model. The biggest unrotated factor associated with the largest eigenvalue (5.2) amounted to barely 32.5% (see Table 3), which is considerably smaller than the recommended threshold of less than 50%. It means that common method bias does not affect meaningfully the present research model.
The Harman's approach showed that one factor is definitely not enough to account for all the variance, therefore various criteria were utilized to determine the appropriate number of factors in the final model. According to the Kaiser’s criterion one should include in the model all factors with the eigenvalues greater than one . For 16 variables left in the model, this approach suggests retaining four factors. Their eigenvalues are put together in Table 3. All 16 eigenvalues are given in Table C1 of Appendix C and graphically illustrated in Figure 1. This scree plot can be used for determining the number of factors . The curve bending also indicates four factors to be incorporated in the model which is consistent with the Kaiser’s criterion.
Table 3. Eigenvalues and variance explained for final exploratory model including four factors.
(PCA, before and after Varimax rotation with Kaiser normalization)
Factor Before rotation After Varimax rotation
variance Eigen-value Variance
F1 5.206 32.5% 32.5% 2.696 16.8% 16.8%
F2 1.708 10.7% 43.2% 2.652 16.6% 33.4%
F3 1.525 9.5% 52.7% 2.593 16.2% 49.6%
F4 1.305 8.2% 60.9% 1.803 11.3% 60.9%
Figure 1. Scree plot for PCA based exploratory factor analysis, Varimax rotation with Kaiser normalization for 16 variables.
The Horn's parallel analysis  is a more formal tool for specifying the number of factors. The idea is based on calculating eigenvalues from a randomly generated correlation matrices for the specific number of variables and subjects and then compare the results with eigenvalues from the given factor analysis. For our study, according to the software available at , there were four eigenvalues bigger than the corresponding random values (software parameters: number of variables = 16, sample size = 155, type of analysis = PCA, number of random correlation matrices to generate = 100). Thus, the procedure recommends taking into account 4 factors, which is in full concordance with two other methods described above. These four extracted factors account for 60.9% of the whole variance. After Varimax orthogonal rotation with Kaiser’s normalization, the first three factors explain similar proportion of the variance (between 16% and 17%) whereas the last factor slightly less – about 11% (see Table 3). In general, the value of total variance explained should be 50% or higher . Thus, the obtained proportion is fully acceptable.
5.3.Basic statistics of the final four - factors model
Basic statistics of final exploratory model with four factors are provided in Table 4. Mean scores for variables, measured on a seven-point Likert scale, range from 2.74 to 5.45. Standard deviations were similar for these items with the minimum equaled 1.25 and maximum of 1.93. Skewness parameters varied from –1.23 to 0.67 while kurtoses were between –1.41 and 1.35. These values are far below the threshold proposed by Lei and Lomax  which, in absolute values, should not be bigger than 2.3. The statistics do not preclude the collected data to come from normal distributions.
The Kaiser-Meyer-Olkin measure of sampling adequacy for our four-factorial final exploratory model amounts to 0.832, which is considered meritorious [63,64]. The parameter ranges from 0 to 1 and values below 0.5 indicate that data are not suitable for the factor analysis. Additionally, Bartlett’s test of sphericity  meant for checking if the correlation matrix is significantly different from an identity matrix, was statistically meaningful (χ2 = 862, df = 120, p <) 0.0001). This shows that the data are suitable for the factorial structure search. The correlation matrix determinant value being very close to zero may cause computational problems or even prevent from finding the inverse matrix and, as a consequence, factor loadings . Moreover, very small values of the determinant may indicate the existence of considerable intercorrelations between groups of variables. In the present study the determinant equal 0.003 which is much bigger than recommended value of 0.00001 [67,68]. When the data is based on a sample smaller than 300, which is the case in the present research, it is advised to check the mean communality. The communality shows to what extent the specific variable correlates with all other variables. In our four-factor model, the average value for communalities is equal 0.609 which is above the recommended minimum for sample sizes range from 100 to 200 . The communalities for individual variables are given in the seventh column of Table 4. In the final model, they vary from 0.42 to 0.78. Thus, all values are well above the minimum of 0.2 score, below which the given item should be removed . The measures of sampling adequacy for all variables from the final four-factor model are presented in the eighth column of Table 4. The data demonstrate high values for these parameters (min=0.68, max=0.93) confirming the correctness of the model. They can be further compared with the anti-image correlations between all variables which are put together in Table C2 in Appendix C along with measures of sampling adequacy placed on the diagonal. The anti-image correlations outside the main diagonal are generally low with the mean of their absolute values amounting to 0.196. That signifies that there is no need for excluding any variable from the revised four-factor model. The last column of Table 4 contains values of variance inflation factors (VIF). High values of this parameter may suggest excessive multicollinearity between variables. Usually, VIFs below 10 are considered acceptable . More restrictive recommendations imply values lower than 5 or even 3. In our study even the most severe limits are not exceeded by any variable. The VIFs range from 1.33 to 2.48 with a mean of 1.81.
Table 4. Basic statistics of final exploratory model with four factors
(PCA, Varimax rotation with Kaiser normalization)
Factor Variable Mean SD1 Skewness Kurtosis Communalities MSA2 VIF3
F1 Q24 5.07 1.368 -0.870 0.580 0.551 0.814 1.482
Q25 4.25 1.355 -0.297 -0.439 0.545 0.913 1.809
Q30 4.90 1.410 -0.659 0.060 0.489 0.850 1.570
Q31 5.45 1.249 -1.119 1.349 0.496 0.864 1.634
Q32 5.15 1.320 -1.234 1.124 0.683 0.856 2.042
F2 Q01 4.74 1.574 -0.576 -0.494 0.704 0.831 1.730
Q03 4.84 1.501 -0.736 -0.164 0.610 0.832 1.863
Q08 5.29 1.446 -0.978 0.365 0.662 0.850 2.238
Q09 4.98 1.626 -0.602 -0.387 0.747 0.841 2.480
F3 Q34 5.03 1.346 -0.400 -0.200 0.463 0.931 1.493
Q41 5.12 1.266 -0.896 0.609 0.663 0.774 1.980
Q42 4.92 1.272 -0.621 0.133 0.778 0.803 2.311
Q44 4.99 1.329 -0.834 0.327 0.607 0.827 1.880
F4 Q06 2.74 1.721 0.666 -1.006 0.729 0.675 1.550
Q07 3.68 1.934 -0.020 -1.414 0.599 0.743 1.505
Q38 3.89 1.618 -0.044 -0.975 0.418 0.790 1.328
1 Standard deviation, 2 measures of sampling adequacy, 3 variance inflation factor.
5.4.Factor loading structure
The factor loading structure of the final model after the exploratory analysis is presented in Table 5. The model consists of four factors that include 16 variables. The factors were labeled and described as F1 – Agile techniques & change management (5 questions: Q24, Q25, Q30, Q31, Q32), F2 – Organization & people (4 questions: Q01, Q03, Q08, Q09), F3 – Stakeholders & risk analysis (4 questions: Q34 Q41 Q42 Q44), and F4 – Work environment (questions: Q06, Q07, Q38). The full texts of questions used in the questionnaire are also provided in Table 5. In our analyses, we applied the principal component (PCA) as the factor extraction method followed by Varimax orthogonal rotation with Kaiser normalization. The model converged in five iterations.
5.5.Model structure quality
The final full factor loading table is given in Table C3 of Appendix C. According to , factor loading bigger than 0.4 may be deemed stable. We have suppressed all values smaller than 0.35, and variables with all factor loading smaller than this threshold were excluded in the process of developing the model . Hair et al.  suggest that the remaining factor loadings should be at least 0.45 for sample sizes between 150 and 200. This recommendation is met in our model since the smallest factor loading amounts to 0.572 for F1, Q25. The mean loadings for variables grouped in factors equal MF1 = 0.669, MF2 = 0.763, MF3 = 0.747, MF4 = 0.723, with the overall mean of 0.722.
Table 5. Final, four-factors exploratory model with reliability and validity measures
(PCA as the extraction method, Varimax rotation with Kaiser normalization, converged in 5 iterations)
Factors and measurement variables FL4
F1. Agile techniques & change management (CA1 = 0.776, CR2 = 0.795, AVE3 = 0.493)
Q24 The project manager underwent training in agile methodology 0.728
Q25 The work in progress was limited and bottlenecks removed for faster throughput 0.572
Q30 The project focused on the work which has been delivered (outcomes)
instead of the how busy people were (utilization) to increase the throughput and flow 0.633
Q31 The change request process was used in the project (recording, planning, documenting,
testing, accepting, categorizing, assessing, authorizing, implementing and reviewing in
a controlled manner). 0.631
Q32 Throughout the project, a right amount of documentation was maintained, not too focused
on producing elaborate documentation as milestones but not ignoring documentation
altogether either 0.783
F2. Organization & people (CA = 0.824, CR = 0.849, AVE = 0.584)
Q01 The project received strong executive support (by the Board of Directors or CEO, CFO, CIO, etc.)
that was influenced the decision making 0.798
Q03 In the project, a hierarchal culture which has clear divisions of responsibility
and authority was employed 0.729
Q08 The selected project team members had high technical competence and expertise
(problem solving, subject matter) 0.724
Q09 Project team members had great motivation and were committed to executing the project
in best possible way 0.802
F3. Stakeholders & risk analysis (CA = 0.793, CR = 0.838, AVE = 0.568)
Q34 From the customer point of view, the most important features/outcomes were delivered
first in the project 0.581
Q41 In the project, risk analysis was evaluated at each change 0.801
Q42 In the project, risk analysis was evaluated at control points 0.862
Q44 The impact of stakeholders on the project was analyzed 0.743
F4. Work environment (CA = 0.614, CR = 0.770, AVE = 0.532)
Q06 All team members worked in the same location for ease of communication and casual,
constant contact 0.828
Q07 The project team worked in a facility with a work environment like one of these: an open space,
communal area, ample wall spaces for postings, etc. 0.746
Q38 In the project, no multiple, independent teams were working together 0.595
1 Cronbach’s alpha, 2 average variance extracted, 3 composite reliability, 4 factor loadings.
To formally verify the convergence validity, we employed the value of the average variance extracted (AVE) . The AVEs are provided in Table 5 near factor descriptions, and they range from 0.493 to 0.584 with the mean of 0.544. It is recommended for AVE to be larger than 0.5 , because it means that the measurement error-related variance is smaller than the variance explained by the given factor . In the present model, only for one factor the value is slightly smaller (by 0.07) than this limit. Furthermore, if AVE is smaller than 0.5, but composite reliability is higher than 0.6, which is the case here (CR = 0.795), the factor’s convergent validity is satisfactory . Thus, all the above-mentioned results are acceptable and indicate adequate level of convergent validity. Values from Table C3 (Appendix 3) do not present any considerable cross-loadings between factors and there are at least three variables loading on each extracted factor. This indicates decent discriminant validity. Generally, the model presents a clean structure with good both convergent and discriminant validity.
The variable reliability refers to the consistency of the items loading on the given factor. To verify this concept, we used Cronbach’s alpha (CA)  and composite reliability (CR) [78,79] measures. Values of CA and CR are placed next to the factor labels and descriptions in Table 5. The CA measures vary from 0.614 (for F4) to 0.824 (for F2) with the mean of 0.752. According to  CAs should be bigger than 0.7, however values between 0.6 and 0.7 are also acceptable [74,81]. In turn, CR values are between 0.770 and 0.849 with the average of 0.813 and also conform to the recommendation of being higher than 0.6  or 0.7 . In light of these measures, the reliability of the variables used to construct the identified factors are sufficiently reliable.
5.6.Factors’ names proposal and interpretation
As a result of the analysis, we extracted four main factors. The individual groups of variables names proposals are as follows:
F1.Agile techniques and change management. Details of the first factor are related to the agile documentation which should not be too much focused on producing elaborate documentation as milestones, agile training for project managers, reduction of work in progress, focus on the results, but not simple utilization of them, and change management process. This factor is strongly described by agile variables which proves the validity of our approach.
F2.Organization and people. This second factor involves executive support and team motivation, high competencies, knowledge and expertise, hierarchy and responsibilities regarding organization culture with clear divisions. This component shows significant relation to the human sustainability pillar. Highly motivated and skilled teams, supported by senior management are very valuable stakeholders’ assets in successful projects.
F3.Stakeholders and risk analysis. The third factor includes the risk analysis and stakeholders in the project along with the delivery strategy. A stakeholder in the project is either an individual or an entire organization that can influence or can be influenced by activities related to the project. In particular, taking into account the IT service projects, we can distinguish the following stakeholders: project manager, program manager, executive, project sponsor, delivery manager, functional manager, architect, (business, system, delivery) analyst, technical teams, project management office, resource manager, user, and corresponding roles from the customer side. This factor shows that there exists an important relation between stakeholders and risk management that may influence the project success. Thus, conducting the risk analysis, every stakeholder should be involved in each change and in all control points of the project.
F4.Work environment. The fourth factor is associated with the location and dependency of the teams, as well as with the agile facility of the work environment like an open space, communal area, ample wall spaces for postings, etc. A friendly work environment, both physical and virtual, is another potential factor increasing the effectiveness of projects and constitutes the environmental sustainability pillar.
Based on the series of exploratory factor analyses, we finally proposed a model that includes four main success factors of IT service projects that are defined by sixteen specific variables. A comparison of our findings with the outcomes of similar research conducted worldwide by means of the factor analysis shows considerable differences both quantitative and qualitative. As far as the factor structure is concerned, there are huge discrepancies in the literature. For instance, in work  as many as 12 factors were extracted from overall 39 variables. The same research framework and questionnaire used by authors of  in different environment yielded only seven factors. In investigation  barely two factors were identified for eight variables, whereas the study  presents three factors for 23 items. In other than IT sectors, the number of factors and variables also differed substantially. For example, in the field of banking  five factors covering 41 items were identified, and in the construction area the work  presents six factors and 26 variables, and authors of the study  revealed six factors for 29 items. In comparisons with all these studies, our model is rather parsimonious. It utilizes four clearly identified factors with 16 items distributed more or less evenly with the smallest number of variables equal three and the biggest one amounting to five variables. Also, the formal and statistical quality of the model appears, generally, to be among the highest obtained in the project management area. Furthermore, the proposed factor loading structure exhibits a very good validity and reliability, which is not very common in this type of exploratory studies.
Comparing our factors from the substantive point of view with other investigations, we found a number of similarities. For example, our organization and people factor is coherent with the management commitment and the team capability factors identified by . Likewise, the work environment factor from this study is consistent with the team and organizational environment factors identified by those authors. Works [43–45], that employed the same survey as  showed the significance of the team capability factor  and management commitment factor  which corresponds to our organization and people factor. Twenty variables of the first factor distinguished in  are, in general, coherent with three of our factors represented by the following variables: team motivation (Q09), project manager trained in agile methodology (Q24), agile documentation (Q32), agile facility (Q07), and team location (Q06).
Our organization and people factor was consistent with the people and organization component in terms of management commitment, competence and knowledge, and team motivation examined by . Regarding the research carried out by , our organization and people factor corresponded partially with the relationship management factor that included management support, organizational culture, competencies and knowledge variables. The risk analysis variables from this study occurred to be consistent with our stakeholder and risk analysis factor. We found similar consistency with the same factor in . In the study of , their team power and skill, and organization capacity factors were in line with our organization and people factor described by competencies and knowledge, team motivation, and management commitment elements. Likewise, the competencies and knowledge showed the same consistency with the research presented in . In our preliminary study  we extracted six factors. Naturally, we found a number of similarities. For instance, the organization and people factor correlated with team engagement and project management support factors. Overall, as many as 14 out of 16 variables extracted by the current exploratory factor analysis are substantially consistent with the results of the initial study.
The above analysis shows similarities and differences between our factorial structure obtained for IT service projects and results presented by various researchers in other IT areas. The discrepancies concern both the number of factors and the number and range of variables that define these factors. In general, our organization and people and work environment factors were, to some degree, similar to the results from the software development area however, the risk analysis and stakeholders factor was inconsistent. In comparison to IT systems project success factors, our organization and people component exhibited the biggest coherence whereas the other three factors were considerably different.
The abovementioned inconsistencies may also result from the variety of project types in which the interviewed managers participated. The size and characteristics of the research sample may also be important. Effects such as experience, age, knowledge and proficiency in using various project management methodologies could have had a significant impact on the obtained results. Presumably, the environment in which project managers functioned, for example, the existing organizational culture or internal procedures, may have had an impact on the final factorial structure. Future studies may focus on testing if the presented model can be verified by the confirmatory factor analysis and search for relations between the project success factors and other characteristics related to project management using, e.g., structural equation modeling.
From the agile approach point of view, we identified significant success components, which are in line with sustainable development goals. Within the agile techniques and change management factor, there is project manager’s agile training, effectiveness, outcomes, and agile documentation variables. In the organization and people factor, we extracted competencies and knowledge, and team’s motivation elements. Our stakeholders and risk analysis factor is consistent with risk management issues strongly linked with the idea of sustainability . Within the sustainable development framework, the risk management is used to limit the harming within 4 sustainability pillars. Similarly, in our case, the risk analysis at each change (Q41) and control points (Q42) allow to systematically monitor the IT service project process and correct it when necessary to successfully achieve project and sustainability goals. Furthermore, the stakeholders and risk analysis factor drives the attention towards the significant role of stakeholders in achieving success in project management. Additionally, the work environment factor included the agile facility variable.
All four factors show strong relation to the sustainability approach which is especially focused on human and world issues. In particular, the organization and people factor is associated with the human sustainability pillar, whereas the work environment factor corresponds to the environmental sustainability pillar. The following variables included in the factor loading structure: access to knowledge through training, balanced participation in the projects among men and women, reducing work in progress, removing bottlenecks, creating facilities to work, which are friendly to interpersonal contacts are good examples of embedding sustainable development concepts into the framework of components deciding about the project success. Human sustainable development in IT project management concerns any stakeholders that have an impact on the project and its products. The abovementioned components confirm that agility and sustainability concepts are interrelated and complementary one to another.
The presented study is among few that deals specifically with IT service project success factors. It is based on a substantial sample of as many as 155 projects managers working in this field within one international company and being involved in various types of projects for customers from many countries. The paper presents the exploratory factor analysis, which was thoroughly formally examined and the resulting factor loading structure exhibits a high level of validity and reliability.
The conducted research and presented in this study outcomes of the exploratory factor analysis distinguished four main factors influencing the IT service project success. They involved (1) agile techniques and change management, (2) organization and people, (3) stakeholders and risk analysis, and (4) work environment. The results have been compared with analogous studies found in the international literature. The detailed analysis provided evidence that our IT service project success factors model is not fully coherent with approaches proposed for other IT areas. Despite some similarities, the differences are considerable and pertain to the number and characteristic features of factors as well as factor components.
The research showed that both traditional and agile management approaches coexist, meet sustainable development goals, and are significant for the successful management in IT service projects where all stakeholders play an important role. It will be beneficial to all stakeholders to engage in developing and managing project solutions that do not harm natural resources and sustain in homeostasis with the surrounding world. Taking into account that any project is temporary in nature, it is important to take sustainable development decisions on an organizational strategic level and to ensure they are transmitted through portfolios, and programs to all projects.
This paper findings fits well into a new trend of thought in project management where sustainability plays a substantial role and project stakeholder interests are taken into account. It occurs that our IT service project success factors and their components cover and overlap with multiple sustainability aspects associated with removing bottlenecks, creating friendly work environments, limiting gender barriers and extending training opportunities or risk management. Details of this connection has been presented in the discussion section. On a more general level, the identified here organization and people factor can be directly connected with the social dimension whereas the stakeholders and risk analysis factor refers to participation, transparency, risk reduction, and political sustainability dimensions.
Silvius, G. Sustainability as a New School of Thought in Project Management. J. Clean. Prod. 2017, 166, 1479–1493, doi:10.1016/j.jclepro.2017.08.121.
2. Standish CHAOS Report 2015; The Standish Group International, Inc.2015, 2015;
3. Varajão, J.; Magalhães, L.; Freitas, L.; Ribeiro, P.; Ramos, J. Implementing Success Management in an IT Project. Procedia Comput. Sci. 2018, 138, 891–898, doi:10.1016/j.procs.2018.10.116.
4. Gruen, R.L.; Elliott, J.H.; Nolan, M.L.; Lawton, P.D.; Parkhill, A.; McLaren, C.J.; Lavis, J.N. Sustainability Science: An Integrated Approach for Health-Programme Planning. The Lancet 2008, 372, 1579–1589, doi:10.1016/S0140-6736(08)61659-1.
5. Silvius, A.J.G.; Schipper, R.P.J. Sustainability in Project Management: A Literature Review and Impact Analysis. Soc. Bus. 2014, 4, 63–96, doi:10.1362/204440814X13948909253866.
6. Allen, T.F.H.; Hoekstra, T.W. Toward a Definition of Sustainability.; United States Department of Agriculture: Flagstaff, Arizona, June 12 1993; p. 10.
7. Gareis, R.; Huemann, M.; Martinuzzi, A. Project Management & Sustainable Development Principles. Proj. Manag. Inst. Newton Sq. PA 2013.
8. Martens, M.L.; Carvalho, M.M. Sustainability and Success Variables in the Project Management Context: An Expert Panel. Proj. Manag. J. 2016, 47, 24–43, doi:10.1177/875697281604700603.
9. Lock, I.; Seele, P. Theorizing Stakeholders of Sustainability in the Digital Age. Sustain. Sci. 2017, 12, 235–245, doi:10.1007/s11625-016-0404-2.
10. Eskerod, P.; Huemann, M. Sustainable Development and Project Stakeholder Management: What Standards Say. Int. J. Manag. Proj. Bus. 2013, 6, 36–50, doi:10.1108/17538371311291017.
11. Oxford English Dictionary 2002.
12. WCED Report of the World Commission on Environment and Development: Our Common Future; World Commission on Environment and Development: Oslo, 1987;
13. Aarseth, W.; Ahola, T.; Aaltonen, K.; Økland, A.; Andersen, B. Project Sustainability Strategies: A Systematic Literature Review. Int. J. Proj. Manag. 2017, 35, 1071–1083, doi:10.1016/j.ijproman.2016.11.006.
14. Goodland, R. Sustainability: Human, Social, Economic and Environmental. Soc. Sci. 2002, 6, 220–225.
15. The Global Possible. Resources, Development, and the New Century; Repetto, R., Ed.; Yale University Press: New Haven, Connecticut, USA, 1985; ISBN 978-0-300-03505-6.
16. Obradovic, V.; Todorovic, M.; Bushuyev, S. Sustainability and Agility in Project Management: Contradictory or Complementary?; IEEE, 2018; Vol. 2, pp. 1–5.
17. Beck, K.; Beedle, M.; van Bennekum, A.; Cockburn, A.; Fowler, M.; Grenning, J.; Highsmith, J.; Hunt, A.; Jeffries, R.; Kern, J.; et al. Manifesto for Agile Software Development Available online: http://agilemanifesto.org/ (accessed on 30 December 2020).
18. Keeys, L.A.; Huemann, M. Project Benefits Co-Creation: Shaping Sustainable Development Benefits. Int. J. Proj. Manag. 2017, 35, 1196–1212, doi:10.1016/j.ijproman.2017.02.008.
19. PMI PMBOK® Guide; Sixth Edition.; Project Management Institute: Newtown Square, PA, 2017;
20. Cooke-Davies, T. The “Real” Success Factors on Projects. Int. J. Proj. Manag. 2002, 20, doi:10.1016/S0263-7863(01)00067-9.
21. de Wit, A. Measurement of Project Success. Int. J. Proj. Manag. 1988, 6, 164–170, doi:10.1016/0263-7863(88)90043-9.
22. Munns, A.; Bjeirmi, B. The Role of Project Management in Achieving Project Success. Int. J. Proj. Manag. 1996, 14, 81–87, doi:10.1016/0263-7863(95)00057-7.
23. Ika, L.A. Project Success as a Topic in Project Management Journals. Proj. Manag. J. 2009, 40, 6–19, doi:10.1002/pmj.20137.
24. Davis, K. An Empirical Investigation into Different Stakeholder Groups Perception of Project Success. Int. J. Proj. Manag. 2017, 35, 604–617, doi:10.1016/j.ijproman.2017.02.004.
25. Gładysz, B.; Kuchta, D. Stakeholder Communication Impact on the Success of IT Project – Fuzzy Approach. In Proceedings of the Intelligent and Fuzzy Techniques in Big Data Analytics and Decision Making; Kahraman, C., Cebi, S., Cevik Onar, S., Oztaysi, B., Tolga, A.C., Sari, I.U., Eds.; Springer International Publishing: Cham, 2020; pp. 583–588.
26. Gładysz, B.; Kuchta, D. Dependency Beetween IT Project Success and the Communication with Project Stakeholders - Intuitionistic Fuzzy Sets Approach. J. Intell. Fuzzy Syst. 2020, 39, 6377–6389, doi:10.3233/JIFS-189104.
27. Skalik, J.; Strzelczyk, A. Key success factors in the management of IT project (in Polish: Kluczowe czynniki sukcesu w zarządzaniu projektami informatycznymi). Zarządzanie Finanse 2013, 11, 265–276.
28. Baker, B.N.; Murphy, D.C.; Fisher, D. Factors Affecting Project Success. In Project Management Handbook; Cleland, D.I., King, W., Eds.; Van Nostrand Reinhold: New York, 1974; pp. 902–919.
29. Rockart, J.F. Chief Executives Define Their Own Data Needs. Harv. Bus. Rev. 1979, 57, 81–93.
30. Bullen, C.V.; Rockart, J.F. A Primer on the Critical Success Factors. CISR Camb. MA 1981, 75.
31. Pinto, J.K.; Slevin, D.P. Critical Factors in Successful Project Implementation. IEEE Trans. Eng. Manag. 1987, EM-34, 22–27, doi:10.1109/TEM.1987.6498856.
32. Definition of IT System - Law Insider Available online: https://www.lawinsider.com/dictionary/it-system (accessed on 3 April 2021).
33. Definition of Software Development - Gartner Information Technology Glossary Available online: https://www.gartner.com/en/information-technology/glossary/software-development (accessed on 3 April 2021).
34. Definition of IT Services - Gartner Information Technology Glossary Available online: https://www.gartner.com/en/information-technology/glossary/it-services (accessed on 3 April 2021).
35. Besner, C.; Hobbs, J.B. An Empirical Investigation of Project Management Practice: In Reality, Which Tools Do Practitioners Use? Paper Presented at PMI® Research Conference: Innovations.; Newtown Square, PA: Project Management Institute: London, England, July 14 2004.
36. Besner, C.; Hobbs, B. The Perceived Value and Potential Contribution of Project Management Practices to Project Success.(Author Abstract). Proj. Manag. J. 2006, 37, 37–48, doi:10.1177/875697280603700305.
37. Doherty, M. Using Organizational, Coordination, and Contingency Theories to Examine Project Manager Insights on Agile and Traditional Success Factors for Information Technology Projects, ProQuest Dissertations Publishing, 2011.
38. Baker, R. A Synthesis and Survey of Critical Success Factors for Computer Technology Projects, ProQuest Dissertations Publishing, 2012.
39. Nah, F.F.-H.; Zuckweiler, K.M.; Lee-Shang Lau, J. ERP Implementation: Chief Information Officers’ Perceptions of Critical Success Factors. Int. J. Hum.-Comput. Interact. 2003, 16, 5–22, doi:10.1207/S15327590IJHC1601_2.
40. White, D.; Fortune, J. Current Practice in Project Management — an Empirical Study. Int. J. Proj. Manag. 2002, 20, 1–11, doi:10.1016/S0263-7863(00)00029-6.
41. Berntsson-Svensson, R.; Aurum, A. Successful Software Project and Products: An Empirical Investigation.; ACM, 2006; Vol. 2006, pp. 144–153.
42. Chow, T.; Cao, D.-B. A Survey Study of Critical Success Factors in Agile Software Projects. J. Syst. Softw. 2008, 81, 961–971, doi:10.1016/j.jss.2007.08.020.
43. Stankovic, D.; Nikolic, V.; Djordjevic, M.; Cao, D.-B. A Survey Study of Critical Success Factors in Agile Software Projects in Former Yugoslavia IT Companies. J. Syst. Softw. 2013, 86, 1663–1678, doi:10.1016/j.jss.2013.02.027.
44. Brown, G. An Examination of Critical Success Factors of an Agile Project, ProQuest Dissertations Publishing, 2015.
45. Stanberry, L. Critical Success Factors for Large and Distributed Agile Software Development Projects Using Scrum in U.S.-Based Global Companies, ProQuest Dissertations Publishing, 2018.
46. Carroll, C.F. IT Success and Failure — the Standish Group CHAOS Report Success Factors – Chris F Carroll 2013.
47. Standish CHAOS Report 1994; The Standish Group International, Inc.1995, 1995;
48. Standish CHAOS Summary 2009. The 10 Laws of CHAOS; The Standish Group International, Inc.2009, 2009;
49. Williams, C.; Ness, L.; Lind, M.; Dutfield, S. A Quantitative Comparative and Correlational Study of Critical Success Factors for Information Technology Projects; ProQuest Dissertations Publishing, 2013;
50. Aldahmash, A.; Gravell, A.; Howard, Y. Using Factor Analysis to Study the Critical Success Factors of Agile Software Development. J. Softw. 2017, 12, 957–963, doi:10.17706/jsw.12.12.957-963.
51. Hochstein, A.; Brenner, W. Implementation of Service-Oriented IT Management: An Empirical Study on Swiss IT Organizations.; 2006; Vol. 1, pp. 91–97.
52. Hochstein, A.; Tamm, G.; Brenner, W. Service Oriented IT Management: Benefit, Cost and Success Factors. 2005, 12.
53. Cater-Steel, A.; Toleman, M.; Tan, W.G. Transforming IT Service Management- The ITIL Impact. In Proceedings of the ACIS 2006 Proceedings - 17th Australasian Conference on Information Systems; 2006.
54. Blijleven, V.; Gong, Y.; Mehrsai, A.; Koelemeijer, K. Critical Success Factors for Lean Implementation in IT Outsourcing Relationships: A Multiple Case Study. Inf. Technol. People 2019, 32, 715–730, doi:10.1108/ITP-01-2016-0002.
55. Zaleski, S.; Michalski, R. Success factors of managing IT services projects (in Polish: Czynniki sukcesu zarządzania projektami usług IT). Przegląd Organ. 2020, 8, 29–36, doi:10.33141/po.2020.08.04.
56. Patil, V.H.; Singh, S.N.; Mishra, S.; Donavan, D.T. Parallel Analysis Engine to Aid in Determining Number of Factors to Retain Using R; 2007;
57. Podsakoff, P.; MacKenzie, S.; Lee, J.-Y.; Podsakoff, N. Common Method Biases in Behavioral Research: A Critical Review of the Literature and Recommended Remedies. J. Appl. Psychol. 2003, 88, 879–903, doi:10.1037/0021-9010.88.5.879.
58. Kaiser, H.F. The Application of Electronic Computers to Factor Analysis. Educ. Psychol. Meas. 1960, 20, 141–151, doi:10.1177/001316446002000116.
59. Cattell, R.B. The Scree Test For The Number Of Factors. Multivar. Behav. Res. 1966, 1, 245–276, doi:10.1207/s15327906mbr0102_10.
60. Horn, J.L. A Rationale and Test for the Number of Factors in Factor Analysis. Psychometrika 1965, 30, 179–185, doi:10.1007/BF02289447.
61. Streiner, D.L. Figuring Out Factors: The Use and Misuse of Factor Analysis. Can. J. Psychiatry 1994, 39, 135–140, doi:10.1177/070674379403900303.
62. Lei, M.; Lomax, R.G. The Effect of Varying Degrees of Nonnormality in Structural Equation Modeling. Struct. Equ. Model. Multidiscip. J. 2005, 12, 1–27, doi:10.1207/s15328007sem1201_1.
63. Kaiser, H.F. A Second Generation Little Jiffy. Psychometrika 1970, 35, 401–415, doi:10.1007/BF02291817.
64. Kaiser, H.F.; Rice, J. Little Jiffy, Mark Iv. Educ. Psychol. Meas. 1974, 34, 111–117, doi:10.1177/001316447403400115.
65. Bartlett, M.S. The Effect of Standardization on a Χ2 Approximation in Factor Analysis. Biometrika 1951, 38, 337–344, doi:10.1093/biomet/38.3-4.337.
66. Tabachnick, B.G.; Fidell, L.S. Using Multivariate Statistics; Fourth edition.; Allyn & Bacon: Boston, MA, 2000; ISBN 978-0-321-05677-1.
67. Field, A. Discovering Statistics Using IBM SPSS Statistics, 4th Edition; 4th edition.; SAGE Publications Ltd, 2013; ISBN 978-93-5150-082-7.
68. Field, A. Discovering Statistics Using IBM SPSS Statistics: North American Edition; 5th edition.; SAGE Publications Ltd: Thousand Oaks, California, 2017; ISBN 978-1-5264-3656-6.
69. MacCallum, R.C.; Widaman, K.F.; Zhang, S.; Hong, S. Sample Size in Factor Analysis. Psychol. Methods 1999, 4, 84–99, doi:10.1037/1082-989X.4.1.84.
70. Child, D. The Essentials of Factor Analysis; A&C Black, 2006; ISBN 978-0-8264-8000-2.
71. Hair, J.F.; Tatham, R.L.; Anderson, R.E.; Black, W. Multivariate Data Analysis; Fifth edition.; Prentice Hall: Upper Saddle River, N.J, 1998; ISBN 978-0-13-894858-0.
72. Guadagnoli, E.; Velicer, W.F. Relation of Sample Size to the Stability of Component Patterns. Psychol. Bull. 1988, 103, 265–275, doi:10.1037/0033-2909.103.2.265.
73. Hair, J.; Black, W.; Babin, B.; Anderson, R. Multivariate Data Analysis. Prentice Hall. London 2009.
74. Hair, J.F.; Anderson, R.E.; Tatham, R.L.; Black, W.C. Multivariate Data Analysis: With Readings; 4th edition.; Pearson College Div: Englewood Cliffs, N.J., 1995; ISBN 978-0-13-913310-7.
75. Yoo, Y.; Alavi, M. Media and Group Cohesion: Relative Influences on Social Presence, Task Participation, and Group Consensus. MIS Q. 2001, 25, 371–390, doi:10.2307/3250922.
76. Fornell, C.; Larcker, D.F. Evaluating Structural Equation Models with Unobservable Variables and Measurement Error. J. Mark. Res. 1981, 18, 39–50, doi:10.2307/3151312.
77. Cronbach, L.J. Coefficient Alpha and the Internal Structure of Tests. Psychometrika 1951, 16, 297–334, doi:10.1007/BF02310555.
78. Jöreskog, K.G. Statistical Analysis of Sets of Congeneric Tests. Psychometrika 1971, 36, 109–133, doi:10.1007/BF02291393.
79. Werts, C.E.; Linn, R.L.; Jöreskog, K.G. Intraclass Reliability Estimates: Testing Structural Assumptions. Educ. Psychol. Meas. 1974, 34, 25–33, doi:10.1177/001316447403400104.
80. Chin, W.W. The partial least squares approach for structural equation modeling. In Modern methods for business research; Methodology for business and management; Lawrence Erlbaum Associates Publishers: Mahwah, NJ, US, 1998; pp. 295–336 ISBN 978-0-8058-2677-7.
81. Kline, P. A Handbook of Test Construction: Introduction to Psychometric Design; Methuen: London, 1986; ISBN 978-0-416-39430-6.
82. Ika, L.A.; Diallo, A.; Thuillier, D. Critical Success Factors for World Bank Projects: An Empirical Investigation. Int. J. Proj. Manag. 2012, 30, 105–116, doi:10.1016/j.ijproman.2011.03.005.
83. Alashwal, A.M.; Fareed, N.F.; Al-Obaidi, K.M. Determining Success Criteria and Success Factors for International Construction Projects for Malaysian Contractors. Constr. Econ. Build. 2017, 17, 62–80, doi:10.5130/AJCEB.v17i2.5319.
84. Xu, P.; Chan, E.H.-W.; Qian, Q.K. Success Factors of Energy Performance Contracting (EPC) for Sustainable Building Energy Efficiency Retrofit (BEER) of Hotel Buildings in China. Energy Policy 2011, 39, 7389–7398, doi:10.1016/j.enpol.2011.09.001.
85. Schulte, J.; Hallstedt, S.I. Company Risk Management in Light of the Sustainability Transition. Sustainability 2018, 10, 4137, doi:10.3390/su10114137.
86. Andersen, E.S.; Dyrhaug, Q.X.; Jessen, S.A. Evaluation of Chinese Projects and Comparison with Norwegian Projects. Int. J. Proj. Manag. 2002, 20, doi:10.1016/S0263-7863(02)00011-X.
87. Appelbaum, S.H.; Steed, A.J. The Critical Success Factors in the Client-Consulting Relationship. J. Manag. Dev. 2005, 24, 68–93, doi:10.1108/02621710510572362.
88. Avots, I. Why Does Project Management Fail? Calif. Manage. Rev. 1969, 12, 77–82, doi:10.2307/41164208.
89. Belassi, W.; Tukel, O.I. A New Framework for Determining Critical Success/Failure Factors in Projects. Int. J. Proj. Manag. 1996, 14, doi:10.1016/0263-7863(95)00064-X.
90. Boadle, M. Project Management 1 Assignment One Project Failure and Success Factors Available online: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.199.5692&rep=rep1&type=pdf (accessed on 28 October 2020).
91. Caldeira, M.M.; Ward, J.M. Understanding the Successful Adoption and Use of IS/IT in SMEs: An Explanation from Portuguese Manufacturing Industries. Inf. Syst. J. 2002, 12, 121–152, doi:10.1046/j.1365-2575.2002.00119.x.
92. Cleland, D.I.; Cleland, D.L.; King, W.R. Systems Analysis and Project Management; McGraw-Hill, 1983;
93. Couillard, J. The Role of Project Risk in Determining Project Management Approach. Proj. Manag. J. 1995, 26, 3–15.
94. Dvir, D.; Lipovetsky, S.; Shenhar, A.; Tishler, A. In Search of Project Classification: A Non-Universal Approach to Project Success Factors. Res. Policy 1998, 27, 915–935, doi:10.1016/S0048-7333(98)00085-7.
95. Frese, R.; Sauter, V. Project Success and Failure: What Is Success, What Is Failure, and How Can You Improve Your Odds for Success? Available online: http://www.umsl.edu/~sauterv/analysis/6840_f03_papers/frese/ (accessed on 30 December 2020).
96. Jang, Y.; Lee, J. Factors Influencing the Success of Management Consulting Projects. Int. J. Proj. Manag. 1998, 16, 67–72, doi:10.1016/S0263-7863(97)00005-7.
97. Kasser, J.E.; Williams, V.R. What Do You Mean You Can’t Tell Me If My Project Is in Trouble? In Proceedings of the First European Conference on …; 1998.
98. Magal, S.R.; Carr, H.H.; Watson, H.J. Critical Success Factors for Information Center Managers. MIS Q. Manag. Inf. Syst. 1988, 12, 413–425, doi:10.2307/249208.
99. Martin, C.C. Project Management: How to Make It Work: By Charles C. Martin AMACOM, 1976. Bus. Horiz. 1977, 20, 93–95, doi:10.1016/0007-6813(77)90092-1.
100. Martinez, E.V. Avoiding Large-Scale Information Systems Project Failure: The Importance of Fundamentals. Proj. Manag. J. 1994, 25.
101. McComb, D.; Smith, J.Y. System Project Failure: The Heuristics of Risk. J. Inf. Syst. Manag. 1991, 8, 25–34, doi:10.1080/07399019108964967.
102. McCormack, S. The Lemon Factor. The Engineer 1997, 22–24.
103. McGolpin, P.; Ward, J. Factors Influencing the Success of Strategic Information Systems. In: Mingers J, Stowell F, Editors. Information Systems: An Emerging Discipline? Lond. McGraw-Hill1997 1997, 287–327.
104. Mengesha, W. Performances for Public Construction Projects in Developing Countries : Federal Road & Educational Building Projects in Ethiopia; Norwegian University of Science and Technology, 2004;
105. Morris, P. Preconditions of Success and Failure in Major Projects; Templeton College Oxford Centre for Management Studies, 1986; ISBN 978-0-9503569-3-8.
106. Morris, P.W.G.; Hough, G.H. The Anatomy of Major Projects: A Study of the Reality of Project Management. 1987 1987.
107. Pinto, J.K.; Kharbanda, O.P. How to Fail in Project Management (without Really Trying). Bus. Horiz. 1996, 39, 45–53, doi:10.1016/S0007-6813(96)90051-8.
108. Pinto, J.K.; Mantel, S.J. The Causes of Project Failure. IEEE Trans. Eng. Manag. 1990, 37, 269–276, doi:10.1109/17.62322.
109. Pollalis, Y.A.; Frieze, I.H. A New Look at Critical Success Factors in IT. (Information Technology). Inf. Strategy Exec. J. 1993, 10, 24.
110. Poon, P.; Wagner, C. Critical Success Factors Revisited: Success and Failure Cases of Information Systems for Senior Executives. Decis. Support Syst. 2001, 30, 393–418, doi:10.1016/S0167-9236(00)00069-5.
111. Selin, G.; Selin, M. Reasons for Project Management Success and Failure in Multiproject Environment: In: Proceedings of the INTERNET World Congress. Oslo Nor. 1994, 513–9.
112. Stoddart-Stones, R. Development of Project Management Systems for Major Projects. Int. J. Proj. Manag. 1988, 6, 34–38, doi:10.1016/0263-7863(88)90056-7.
113. Sturdivant, J. The CNSI Requirement Analysis Process. 2004.
114. Tan, R.R. Success Criteria and Success Factors for External Technology Transfer Projects. Proj. Manag. J. 1996, 27.
115. Tennant, D., V. Avoiding Failure in Project Management, Advances in Instrumentation and Control.; 1993; pp. 675–86.
116. Thite, M. Leadership Styles in Information Technology Projects. Int. J. Proj. Manag. 2000, 18, 235–241, doi:10.1016/S0263-7863(99)00021-6.
117. Tukel, O.I.; Rom, W.O. Analysis of the Characteristics of Projects in Diverse Industries. J. Oper. Manag. 1998, 16, 43–61, doi:10.1016/S0272-6963(97)00016-8.
118. Turner, R. Handbook of Project-Based Management, Fourth Edition; 2nd edition.; McGraw-Hill Education, 1999;
119. Wastell, D.; Newman, M. Information System Design, Stress and Organisational Change in the Ambulance Services: A Tale of Two Cities. Account. Manag. Inf. Technol. 1996, 6, 283–300, doi:10.1016/S0959-8022(96)90017-X.
120. Westerveld, E. The Project Excellence Model®: Linking Success Criteria and Critical Success Factors. Int. J. Proj. Manag. 2003, 21, 411–418, doi:10.1016/S0263-7863(02)00112-6.
121. Cash, C.; Fox, R. Elements of Successful Project Management. J. Syst. Manag. 1992, 43, 10.
122. Gingnell, L.; Franke, U.; Lagerström, R.; Ericsson, E.; Lilliesköld, J. Quantifying Success Factors for IT Projects-An Expert-Based Bayesian Model. Inf. Syst. Manag. 2014, 31, 21–36, doi:10.1080/10580530.2014.854033.
123. Pecherskaya, E.P.; Kamaletdinov, Y.A.; Zhabin, A.P.; Grishina, P.Y. Key Success Factors Analysis in the Context of Enterprise Resourcesplanning Systems Projects Implementation. Mod. Appl. Sci. 2015, 9, p133, doi:10.5539/mas.v9n5p133.
124. Taylor, A. IT Projects: Sink or Swim. Comput. Bull. 2000, 42, doi:10.1093/combul/42.1.24.
125. Yap, C.; Soh, C.; Raman, K. Information Systems Success Factors in Small Business. Omega 1992, 20, 597–609, doi:10.1016/0305-0483(92)90005-R.
126. Yeo, K.T. Critical Failure Factors in Information System Projects. Int. J. Proj. Manag. 2002, 20, 241–246, doi:10.1016/S0263-7863(01)00075-8.
127. Chiyangwa, T.B.; Mnkandla, E. Modelling the Critical Success Factors of Agile Software Development Projects in South Africa. SA J. Inf. Manag. 2017, 19, doi:10.4102/sajim.v19i1.838.
128. Turner, J.R. Managing Web Projects: The Management of Large Projects and Programmes for Web-Space Delivery; Gower Pub Co: Aldershot, England ; Burlington, VT, 2004; ISBN 978-0-566-08567-3.
129. Whittaker, B. What Went Wrong? Unsuccessful Information Technology Projects. Inf. Manag. Comput. Secur. 1999, 7, 23–30, doi:10.1108/09685229910255160.
130. Williams, B.R. Why Do Software Projects Fail? GEC J. Res. 1995, 12.
131. Diirr, T.; Santos, G. Improvement of IT Service Processes: A Study of Critical Success Factors. J. Softw. Eng. Res. Dev. 2014, 2, 1–21, doi:10.1186/2195-1721-2-4.
132. Fjermestad, J.; Saitta, J.A. A Strategic Management Framework for IT Outsourcing: A Review of the Literature and the Development of a Success Factors Model. J. Inf. Technol. Cases Appl. 2005, 7, 42–60, doi:10.1080/15228053.2005.10856070.
133. Huang, S.-J.; Wu, M.-S.; Chen, L.-W. Critical Success Factors in Aligning IT and Business Objectives: A Delphi Study. Total Qual. Manag. Bus. Excell. 2013, 24, 1219–1240, doi:10.1080/14783363.2011.637785.
134. Iden, J.; Eikebrokk, T.R. Implementing IT Service Management: A Systematic Literature Review. Int. J. Inf. Manag. 2013, 33, 512–523, doi:10.1016/j.ijinfomgt.2013.01.004.
135. Mohammadi, M.M.; Ravasan, A.Z.; Hamidi, H. Investigating Critical Success Factors in Implementing ITIL Framework: The Case of a Developing Country. Int. J. Stand. Res. 2015, 13, 74–91, doi:10.4018/IJSR.2015010104.
136. Pollard, C.; Cater-Steel, A. Justifications, Strategies, and Critical Success Factors in Successful ITIL Implementations in U.S. and Australian Companies: An Exploratory Study. Inf. Syst. Manag. 2009, 26, 164–175, doi:10.1080/10580530902797540.
137. Tan, W.-G.; Cater-Steel, A.; Toleman, M. Implementing It Service Management: A Case Study Focussing on Critical Success Factors. J. Comput. Inf. Syst. 2009, 50.
138. Zhang, Y.; Zhang, J.; Chen, J. Critical Success Factors in IT Service Management Implementation: People, Process, and Technology Perspectives. In Proceedings of the 2013 International Conference on Service Sciences (ICSS); April 2013; pp. 64–68.
139. Drobietz, M.; Poth, A. A New Approach: Not Agile vs. Traditional QM but Applying the Best of Both [in:] Systems, Software and Services Process Improvement: 24th European Conference, EuroSPI 2017, Ostrava, Czech Republic, September 6–8, 2017, Proceedings.; Stolfa, J., Stolfa, S., O’Connor, R.V., Messnarz, R., Eds.; Springer International Publishing: Cham, 2017; Vol. 748, pp. 486–494.
140. Gowan, J.A.; Mathieu, R.G. Critical Factors in Information System Development for a Flexible Manufacturing System. Comput. Ind. 1996, 28, 173–183, doi:10.1016/0166-3615(95)00082-8.
141. Hougham, M. London Ambulance Service Computer-Aided Despatch System. Int. J. Proj. Manag. 1996, 14, 103–110, doi:10.1016/0263-7863(95)00067-4.
142. Agile Service Development: Combining Adaptive Methods and Flexible Solutions; Lankhorst, M., Ed.; The Enterprise Engineering Series; Springer Berlin Heidelberg: Berlin, Heidelberg, 2012; ISBN 978-3-642-28187-7.
143. Cannon, J.A. Why IT Applications Succeed or Fail: The Interaction of Technical and Organizational Factors. Ind. Commer. Train. 1994, 26, 10–15, doi:10.1108/00197859410051226.
144. Willcocks, L.; Griffiths, C. Predicting Risk of Failure in Large-Scale Information Technology Projects. Technol. Forecast. Soc. Change 1994, 47, 205–228, doi:10.1016/0040-1625(94)90029-9.
145. PMI Agile, P.M.I. Agile Practice Guide; Sixst Edition.; Project Management Institute: Newtown Square, PA, 2017;
146. Davis, B. Agile Practices for Waterfall Projects: Shifting Processes for Competitive Advantage; JRoss Publishing, 2012; ISBN 978-1-60427-083-9.
147. SAFe Scaled Agile Framework 5.0 Available online: https://www.scaledagileframework.com/ (accessed on 30 December 2020).
148. Scrum of Scrums Scrum of Scrums | Agile Alliance 2015.
149. Schwaber, K.; Sutherland, J. Scrum Guide the Definitive Guide to Scrum: The Rules of the Game 2020.
150. Baker, B.N.; Murphy, D.C.; Fisher, D. Factors Affecting Project Success. In Project Management Handbook; John Wiley & Sons, Ltd, 1997; pp. 902–919 ISBN 978-0-470-17235-3.
151. CERF Independent Research Assessment of Project Management Factors Affecting Department of Energy Project Success: Final Report.; Office of Engineering and Construction Management, U.S. Department of Energy, 2004;
152. Procaccino, J.D.; Verner, J.M.; Shelfer, K.M.; Gefen, D. What Do Software Practitioners Really Think about Project Success: An Exploratory Study. J. Syst. Softw. 2005, 78, 194–203, doi:10.1016/j.jss.2004.12.011.
153. Curtis, B.; Krasner, H.; Iscoe, N. A Field Study of the Software Design Process for Large Systems. Commun. ACM 1988, 31, doi:10.1145/50087.50089.
154. Glass, R.L. Software Runaways: Lessons Learned from Massive Software Project Failures; Prentice Hall PTR: Upper Saddle River, NJ, 1998; ISBN 978-0-13-673443-7.
155. Managing Large Systems: Organization for the Future; Sayles, L.R., Chandler, M.K., Eds.; Harper&Row: New York, NY, 1971;
156. Iden, J. Implementing IT Service Management. Lessons from a University IT Department. In; 2009 ISBN 978-1-60566-008-0.
157. Wan, J.; Zhu, S.; Wang, Y. Empirical Analysis on Risk Factors of IT Service Management Project Implementation.; IEEE, 2008; pp. 1–4.
158. Kanter, J.; Walsh, J.J. Toward More Successful Project Management. Inf. Syst. Manag. 2004, 21, 16–21, doi:10.1201/1078/44188.8.131.5240301/80417.3.
159. Bear, D. Risk Management in Information Systems Development-a Case Study. Eng. Manag. J. 1995, 5, 63–65.
160. Cicmil, S.J. Critical Factors of Effective Project Management. TQM Mag. 1997, 9, 390–396, doi:10.1108/09544789710186902.
161. Clarke, A. A Practical Use of Key Success Factors to Improve the Effectiveness of Project Management. Int. J. Proj. Manag. 1999, 17, 139–145, doi:10.1016/S0263-7863(98)00031-3.
162. Harding, J.S. Crash Course in Project Engineering. Chem. Eng. N. Y. 1995, 102.
163. Hughes, M.W. Why Projects Fail: The Effects of Ignoring Obvious Management Principles. Ind. Eng. 1986, 14–8.
164. Loo, R. Working towards Best Practices in Project Management: A Canadian Study. Int. J. Proj. Manag. 2002, 6.
165. Loo, R. A Multi-Level Causal Model for Best Practices in Project Management. Benchmarking Int. J. 2003, 10, 29–36, doi:10.1108/14635770310457520.
166. Spinelli, D. Keys to Success in Management Projects. Netw. World 1997.
167. Wateridge, J. IT Projects: A Basis for Success. Int. J. Proj. Manag. 1995, 13, 169–172, doi:10.1016/0263-7863(95)00020-Q.
168. Hildebrand, C. Loud and Clear. CIO 1996, 56.
169. Kanter, J.; Walsh, J.J. Toward More Successful Project Management. Inf. Syst. Manag. 2004, 21, 16–21, doi:10.1201/1078/44184.108.40.20640301/80417.3.
170. Bairi, J.; Murali Manohar, B. Critical Success Factors in Gaining User Customer Satisfaction in Outsourced IT Services. J. Enterp. Inf. Manag. 2011, 24, 475–493, doi:10.1108/17410391111166530.
171. Deutsch, M.S. An Exploratory Analysis Relating the Software Project Management Process to Project Success. IEEE Trans. Eng. Manag. 1991, 38, 365–375, doi:10.1109/17.97444.
172. Charron, R.; Harrington, H.J.; Voehl, F.; Wiggin, H. The Lean Management Systems Handbook; CRC Press, 2014; ISBN 978-1-4665-6435-0.
173. Martinez-Jurado, P.J.; Moyano-Fuentes, J. Lean Management, Supply Chain Management and Sustainability: A Literature Review. J. Clean. Prod. 2014, 85, 134–150, doi:10.1016/j.jclepro.2013.09.042.
174. Senapathi, M.; Drury-Grogan, M.L. Systems Thinking Approach to Implementing Kanban: A Case Study. J. Softw. Evol. Process 2020.
175. Sunden, J.; Hammarberg, M. Kanban; Helion, 2015; ISBN 978-83-283-6966-5.
176. Charvat, J. How to Identify a Failing Project Available online: https://www.techrepublic.com/article/how-to-identify-a-failing-project/ (accessed on 2 January 2021).
177. McChrystal, S. Team of Teams: New Rules of Engagement for a Complex World - McChrystal Stanley A.; Penguin Books Ltd, 2015; ISBN 978-0-241-25083-9.
178. Baldry, D. The Evaluation of Risk Management in Public Sector Capital Projects. Int. J. Proj. Manag. 1998, 16, 35–41, doi:10.1016/S0263-7863(97)00015-X.
179. Davis, K. Different Stakeholder Groups and Their Perceptions of Project Success. Int. J. Proj. Manag. 2014, 32, 189–201, doi:10.1016/j.ijproman.2013.02.006.
180. Egorova, E.; Torchiano, M.; Morisio, M.; Wohlin, C.; Aurum, A.; Svensson, R.B. Stakeholders’ Perception of Success: An Empirical Investigation. In Proceedings of the 2009 35th Euromicro Conference on Software Engineering and Advanced Applications; August 2009; pp. 210–216.
181. Pinto, J.K.; Slevin, D.P.; English, B. Trust in Projects: An Empirical Assessment of Owner/Contractor Relationships. Int. J. Proj. Manag. 2009, 27, 638–648, doi:10.1016/j.ijproman.2008.09.010.
182. Atkinson, R. Project Management: Cost, Time and Quality, Two Best Guesses and a Phenomenon, Its Time to Accept Other Success Criteria. Int. J. Proj. Manag. 1999, 17, 337–342, doi:10.1016/S0263-7863(98)00069-6.