Interactive assessment of simulated service qualities by business stakeholders: principles and research issues

V.A. Shekhovtsov

Abstract


We present the principles of an approach supporting the stakeholder involvement in a software process for service-oriented systems in a form of assessing the perceived quality of the software under development in its usage context. This method relies on interactive simulation of service performance and reliability; simulation models are parameterized by the factors influencing service execution; business stakeholders experience simulated service qualities in simulated usage contexts and assess this experience; the obtained assessments can be later used throughout the system lifecycle as a means of control for the quality of the software under development.

Problems in programming 2010; 2-3: 288-298


Full Text:

PDF

References


Amyot, D., Eberlein, A. An Evaluation of Scenario Notations and Construction Approaches for Telecommunication Systems Development // Telecommunication Systems. – 2003. – Vol. 24. – N 1. – P. 61-94.

Barbacci, M., Ellison, R., Lattanze, A., et al. Quality Attribute Workshops (QAWs), Third Edition. – Carnegie Mellon University. – 2003.

Bause, F., Buchholz, P., Kriege, J., Vastag, S. A Framework for Simulation Models of Service-Oriented Architectures // In SIPEW 2008. – LNCS, Vol. 5119. – 2008. – P. 208–227.

Bellin, D., Suchman-Simone, S. The CRC Card Book. – Addison-Wesley. – 1997.

Benjamin, P., Patki, M., Mayer, R. Using ontologies for simulation modeling // In WSC'06. – 2006. – P. 1151-1159.

Bertolino, A., De Angelis, G., Polini, A. A QoS Test-Bed Generator for Web Services // In ICWE'07. – LNCS, Vol. 4607. – Springer. – 2007.

– P. 17-31.

Bosch, J. Design and Use of Software Architectures. – Reading: Addison-Wesley. – 2000.

Business Process Model and Notation (BPMN) Version 1.2. –. OMG. – 2009.

Carroll, J.M. (ed.). Scenario-Based Design. – Wiley. – 1995.

Cooper, A. The Inmates are Running the Asylum. – Sams. – 2004.

Cortellessa, V., Grassi, V. Reliability Modeling and Analysis of Service-Oriented Architectures // In Baresi, L., Nitto, E.D. (eds.): Test and Analysis of Web Services. – Springer. – 2007. – P. 339-362.

Cortellessa, V., Pierini, P., Spalazzese, R., Vianale, A. MOSES: MOdeling Software and platform architEcture in UML 2 for Simulation-based performance analysis // In QoSA 2008. – LNCS, Vol. 5281. – Springer. – 2008. – P. 86-102.

DeVellis, R.F. Scale Development: Theory and Applications. – Sage Pubs. – 2003.

Diehl, S. Software visualization: visualizing the structure, behaviour, and evolution of software. – Springer. – 2007.

Drew, P., Raymond, G., Weinberg, D. Talk and Interaction in Social Research Methods. – Sage Pubs. – 2006.

Driss, M., Jamoussi, Y., Jezequel, J.-M., et al. A Discrete-Events Simulation Approach for Evaluation of Service-Based Applications // In Proc. ECOWS’08. – IEEE. – 2008. – P. 73-78.

Dumas, M., Van der Aalst, W., ter Hofstede, A. (eds.). Process-Aware Information Systems. – Wiley-IEEE. – 2005.

Egyed, A. Dynamic Deployment of Executing and Simulating Software Components // In Component Deployment. – LNCS, Vol. 3083. – Springer. – 2004. – P. 113-128.

Floyd, C. A Systematic Look at Prototyping // In Approaches to Prototyping. – Springer. – 1984. – P. 1-17.

Fritzsche, M., Gilani, W., Fritzsche, C., et al. Towards utilizing model-driven engineering of composite applications for business performance analysis // In ECMDA-FA'08. – 2008. – P. 369-380.

Fritzsche, M., Picht, M., Gilani, W., et al. Extending BPM environments of your choice with performance related decision support // In BPM 2009. – LNCS, Vol. 5701. – 2009. – P. 97-112.

Galle, D., Kop, C., Mayr, H.C. A Uniform Web Service Description Representation for Different Readers // In Proc. ICDS'08. – IEEE CS Press. – 2008. – P. 123-128.

Garcia-Banuelos, L., Dumas, M. Towards an Open and Extensible Business Process Simulation Engine // In Proc. CPN'09. – 2009.

Gokhale, S.S., Lyu, M.R., Trivedi, K.S. Reliability Simulation of Component-Based Software Systems // In Proc. ISSRE’98. – 1998. – P. 192-201.

Graham, I. Requirements Modelling and Specification for Service Oriented Architecture. – Wiley. – 2009.

Grassi, V., Mirandola, R., Sabetta, A. Filling the gap between design and performance/reliability models of component-based systems: A model-driven approach // The Journal of Systems and Software. – 2007. – Vol. 80. – P. 528–558.

Gregoriades, A., Sutcliffe, A. Scenario-Based Assessment of Nonfunctional Requirements // IEEE Trans. Software Eng. – 2005. – Vol. 31. – N 5. – P.392-409.

Grishikashvili Pereira, E., Pereira, R. Simulation of fault monitoring and detection of distributed services // Simulation Modelling Practice and Theory. – 2007. – Vol. 15. – P. 492–502.

Harel, D., Politi, M. Modeling Reactive Systems with Statecharts. – McGraw-Hill. – 1998.

Haumer, P., Heymans, P., Jarke, M., Pohl, K. Bridging the Gap Between Past and Future in RE: A Scenario-Based Approach // In Proc. RE'99. – IEEE CS Press. – 1999. – P. 66-73.

Hennig, A., Hentschel, A., Tyack, J. Performance Prototyping - Generating and Simulating a Distributed IT-System from UML Models // In Proc. ESM’2003. – IEEE. – 2003.

Hesse, W. Ontologies in the Software Engineering process // In Proc. EAI'05. – Ceur-WS.org, Vol. 141. – 2005.

Hesse, W., Mayr, H.C. Modellierung in der Softwaretechnik: eine Bestandsaufnahme // Informatik Spektrum. – 2008. – Vol. 31. – N 5. – P. 377-393.

Ionescu, T.B., Piater, A., Scheuermann, W., et al. An Aspect-Oriented Approach for Disaster Prevention Simulation Workflows on Supercomputers, Clusters, and Grids // In Proc.DS-RT 2009. – 2009. – P. 21-33.

ISO. ISO/IEC 12207:2008, Information technology – Software life cycle processes. –. – 2008.

Jansen-Vullers, M., Netjes, M. Business process simulation – a tool survey // In CPN Tools Workshop. – 2006.

Jensen, K., Kristensen, L.M. Coloured Petri Nets. – Springer. – 2009.

Jureta, I.J., Herssens, C., Faulkner, S. A Comprehensive Quality Model for Service-Oriented Systems // Software Quality Journal. – 2009. – Vol. 17. – N 1. – P. 65-98.

Jwoa, J.-S., Cheng, Y.C. Pseudo software: A mediating instrument for modeling software requirements // Journal of Systems and Software. – 2009, in press.

Kaschek, R., Kop, C., Shekhovtsov, V.A., Mayr, H.C. Towards Simulation-Based Quality Requirements Elicitation: A Position Paper // In REFSQ 2008. – LNCS, Vol. 5025. – Springer. – 2008. – P. 135-140.

Kazman, R., Barbacci, M., Klein, M., Carriere, S.J. Experience with Performing Architecture Tradeoff Analysis // In Proc. ICSE'99. – ACM. – 1999.

Kelton, W.D., Sadowski, R.P., Sadowski, D.A. Simulation with Arena. – McGraw-Hill. – 2004.

Kounev, S. Performance Modeling and Evaluation of Distributed Component-Based Systems using Queueing Petri Nets // IEEE Trans Soft Eng. – 2006. – Vol. 32. – N 7. – P. 486-502.

Lassing, N., Bengtsson, P., Bosch, J., Vliet, H.V. Experience with ALMA: Architecture-Level Modifiability Analysis // Journal of Systems and Software. – 2002. – Vol. 61. – N 1. – P. 47-57.

Lauesen, S. Software requirements: Styles and techniques. – Addison-Wesley. – 2002.

Lera, I., Sancho, P.P., Juiz, C., et al. Performance assessment of intelligent distributed systems through software performance ontology engineering (SPOE) // Software Qual J. – 2007. – Vol. 15. – P. 53-67.

Looker, N., Gwynne, B., Xu, J., Munro, M. An Ontology-Based Approach for Determining the Dependability of Service-Oriented Architectures // In WORDS’05. – 2005. – P. 171- 178.

Looker, N., Xu, J., Munro, M. Determining the dependability of Service-Oriented Architectures // Intl J of Simulation and Process Modelling. – 2007. – Vol. 3. – N 1-2. – P. 88 - 97.

Mårtensson, F., Jönsson, P., Bengtsson, P., et al. A Case Against Continuous Simulation for Software Architecture Evaluation // In Proc. ASM'03. – 2003. – P. 97-105.

Marzolla, M., Balsamo, S. UML-PSI: the UML Performance SImulator // In Proc. QEST’04. – IEEE. – 2004.

Mayr, H.C., Bever, M., Lockemann, P.C. Prototyping Interactive Application Systems // In Budde, R., Kuhlenkamp, K., Mathiassen, L. (eds.): Approaches to Prototyping. – Berlin: Springer-Verlag. – 1984. – P. 105-121.

Mayr, H.C., Kop, C. Conceptual Predesign - Bridging the Gap between Requirements and Conceptual Design // In Proc. ICRE '98. – IEEE CS Press. – 1998. – P. 90-100.

McManus, J. Managing Stakeholders in Software Development Projects. – Butterworth-Heinemann. – 2004.

Memmel, T., Gundelsweiler, F., Reiterer, H. Prototyping Corporate User Interfaces - Towards a Visual Specification of Interactive Systems // In Proc. IASTED-HCI 2007. – 2007.

Miller, M.J., Pulgar-Vidal, F., Ferrin, D.M. Achieving Higher Levels of CMMI Maturity Using Simulation // In Proc. WSC'02. – IEEE. – 2002.

– P. 1473-1478.

Moreira, A., Araújo, J., Brito, I. Crosscutting quality attributes for requirements engineering // In SEKE'02. – 2002. – P. 167-174.

North, M.J., Macal, C.M. Managing Business Complexity: Discovering Strategic Solutions with Agent-Based Modeling and Simulation. – Oxford Univ. Press. – 2007.

Pastor, O., Molina, J.C. Model-Driven Architecture in Practice. – Springer. – 2007.

Paternò, F. Model-based Design and Evaluation of Interactive Applications. – Springer. – 2000.

Popic, P., Desovski, D., Abdelmoez, W., Cukic, B. Error Propagation in the Reliability Analysis of Component based Systems // In Proc. ISSRE’05. – IEEE. – 2005.

Robertson, S., Robertson, J. Mastering the Requirements Process, 2nd ed. – Addison-Wesley. – 2006.

Robinson, S. Conceptual modelling for simulation // J Operational Research Society. – 2008. – Vol. 59. – N 3. – P. 278-290.

Rosa, M.L., Reijers, H.A., van der Aalst, W., et al. APROMORE: An Advanced Process Model Repository. – QUT Reprints. – 2009.

Rozinat, A., Wynn, M., van der Aalst, W., et al. Workflow simulation for operational decision support // Data & Knowl Eng. – 2009. – Vol. 68. – P. 834–850.

Rücker, B. Building an Open Source Business Process Simulation Tool with JBoss jBPM. – Stuttgart UAS. – 2008.

Sargent, R.G. Verification and Validation of Simulation Models // In Proc. WSC'08. – 2008. – P. 157-169.

Schauerhuber, A., Schwinger, W., Kapsammer, E., et al. Towards a Common Reference Architecture for Aspect-Oriented Modeling // In Proc. 8th Intl.Workshop on AO Modeling. – 2006.

Seffah, A., Gulliksen, J., Desmarais, M.C. (eds.). Human-Centered Software Engineering. – Springer. – 2005.

Shekhovtsov, V., Kaschek, R., Zlatkin, S. Constructing POSE: a Tool for Eliciting Quality Requirements // In Proc. ISTA 2007. – LNI, Vol. P-107. – GI. – 2007. – P. 187–199.

Shekhovtsov, V.A., Kaschek, R., Kop, C., Mayr, H.C. Relational service quality modeling // In J.Suzuki (ed.) Developing Effective Service Oriented Architectures: Concepts and Applications in Service Level Agreements, Quality of Service and Reliability. – IGI Global. – 2010, in press.

Sindre, G., Opdahl, A.L. Eliciting security requirements with misuse cases // Req. Eng. – 2005. – Vol. 10. – N 1. – P. 34-44.

Sutcliffe, A., Ryan, M. Experience with SCRAM: a scenario requirements analysis method // In Proc. ICRE'98. – IEEE CS Press. – 1998. – P. 164-171.

Tewoldeberhan, T., Janssen, M. Simulation-based experimentation for designing reliable and efficient Web service orchestrations in supply chains // El.Commerce Res. and Apps. – 2008. – Vol. 7. – P. 82–92.

Thanheiser, S., Liu, L., Schmeck, H. SimSOA: an approach for agent-based simulation and design-time assessment of SOC-based IT systems // In Proc.ACM Symp. on Applied Computing. – ACM. – 2009. – P. 2162-2169.

Tolstedt, J.L. Prototyping as a means of requirements elicitation // In Proc. SAE International Off-Highway Congress. – SAE Technical Paper Series, Vol. 2002-01-1466. – 2002.

Trætteberg, H., Krogstie, J. Enhancing the Usability of BPM-Solutions by Combining Process and User-Interface Modelling // In Proc. POeM'08. – LNBIP, Vol. 15. – Springer. – 2008. – P. 86-97.

Tsai, W.T., Cao, Z., Wie, X., et al. Modeling and Simulation in Service-Oriented Software Development // Simulation. – 2007. – Vol. 83. – N 1. – P. 7-32.

Tullis, T., Albert, W. Measuring the User Experience. – Morgan Kaufmann. – 2008.

Um, I.-S., Lee, H.-C., Cheon, H.-J. Determination of Buffer Sizes in Flexible Manufacturing System by using the Aspect-oriented Simulation // In Proc. ICCAS'07. – IEEE. – 2007. – P. 1729-1733.

van der Aalst, W. Formalization and verification of event-driven process chains // Inf Soft Tech. – 1999. – Vol. 41. – N 10. – P. 639-650.

van der Aalst, W., Nakatumba, J., Rozinat, A., Russell, N. Business process simulation: how to get it right? – TU Eindhoven. – 2008.

Waller, A., Clark, M., Enstone, L. L-SIM : Simulating BPMN Diagrams With A Purpose Built Engine // In Proc. WSC'06. – 2006. – P. 591-597.

Ware, C. Information Visualization: Perception for Design. – Morgan Kaufmann. – 2004.

Web Services Business Process Execution Language (WS-BPEL) Version 2.0. –. OASIS. – 2007.

Wells, L. Performance analysis using coloured Petri nets // In MASCOTS’02. – 2002. – P. 217–221.

Williams, L.G., Smith, C.U. PASA: A Method for the Performance Assessment of Software Architecture // In Proc. 3rd Workshop on Software Performance. – 2002.

Глушков, В.М. О системной оптимизации // Кибернетика. – 1980. – № 5. – С. 89–91.

Згуровский, М.З., Панкратова, Н.Д. Системный анализ: Проблемы, методология, приложения. – К: Наук. думка. – 2005. – 743 с.

Менаске, Д., Алмейда, В. Производительность Web-служб. Анализ, оценка и планирование. – К: Диасофт. – 2003.


Refbacks

  • There are currently no refbacks.