Home | Issues | Profile | History | Submission | Review
Vol: 57(71) No: 1 / March 2012      

Using Qualitative Research to Explore Automation Level of Software Change Request Process: A Study on Very Small Software Companies
Zeljko Stojanov
University of Novi Sad, Technical Faculty “Mihajlo Pupin”, Djure Djakovica BB, 23000 Zrenjanin, Serbia, e-mail: zeljko.stojanov@tfzr.rs


Keywords: software changer request, process automation level, very small software companies, qualitative research

Abstract
Software change request process is an essential sub-process in software maintenance that deals with modifications of software systems. This paper present an empirical study that uses qualitative research methods for investigating automation level of software change request process in local very small software companies. Findings of qualitative research provide a grounded understanding of the practice that is based on opinions of software experts. In research participated fifteen software experts from local very small software companies with various level of experience. Software experts were interviewed individually in their companies or participated in organized focus groups. Constructivist grounded theory methods were used as a suitable choice for discovering common practice and for creating explanations that are grounded in empirical data. Better understanding of the study is achieved through description of the research context and procedures. Research findings are presented with the focus on inductive analysis that led to identification of automation level as a property of software change request process. Analysis of empirical data reveals that very small software companies do not have automated software change request process, or have automated only parts of the process. In the paper are also considered validation and constraints of the study. Despite identified constraints, this study helps in building deeper understanding of current practice in very small software companies, helps in identifying problems in the practice as potential staring points for further improvements, and contribute to the body of empirical knowledge in software engineering.

References
[1] A. Finkelstein and J. Kramer, “Software engineering: a roadmap”, In Proceedings of the Conference on The Future of Software Engineering (ICSE \'00), ACM, New York, NY, USA, 3-22, 2000, DOI: 10.1145/336512.336519.
[2] R. L. Glass, \"Guest Editor\'s Introduction: The State of the Practice of Software Engineering,\" IEEE Software, Vol. 20, No. 6, pp. 20-21, 2003, DOI: 10.1109/MS.2003.1241361.
[3] J. Singer, T. Lethbridge, N. Vinson and N. Anquetil, “An examination of software engineering work practices”. In CASCON First Decade High Impact Papers (CASCON \'10). ACM, New York, NY, USA, 174-188. DOI=10.1145/1925805.1925815.
[4] D. E. Perry, A. A. Porter, and L. G. Votta, “Empirical studies of software engineering: a roadmap”, In Proceedings of the Conference on The Future of Software Engineering (ICSE \'00), ACM, New York, NY, USA, 345-355, 2000, DOI: 10.1145/336512.336586.
[5] D. J. Reifer, \"Is the Software Engineering State of the Practice Getting Closer to the State of the Art?,\" IEEE Software, Vol. 20, No. 6, pp. 78-83, 2003, DOI: 10.1109/MS.2003.1241370.
[6] A. Rainer, “The value of empirical evidence for practitioners and researchers”, In: Basili, V., Rombach, D., Schneider, K., Kitchenham, B., Pfahl, D., Selby, R. (Eds.), Empirical Software Engineering Issues. Critical Assessment and Future Directions, Vol. 4336 of Lecture Notes in Computer Science, Springer Berlin / Heidelberg, pp. 24–24, 2007, DOI: 10.1007/978-3-540-71301-2_8.
[7] D. I. K. Sjoberg, T. Dyba, and M. Jorgensen, “The Future of Empirical Methods in Software Engineering Research”, In 2007 Future of Software Engineering (FOSE \'07), IEEE Computer Society, Washington, DC, USA, 358-378, 2007, DOI: 10.1109/FOSE.2007.30.
[8] I. Richardson and C. G. von Wangenheim, \"Guest Editors\' Introduction: Why are Small Software Organizations Different?,\" IEEE Software, Vol. 24, No. 1, 2007, pp. 18-22, DOI: 10.1109/MS.2007.12.
[9] J. Bell, D. Crick and S. Young, “Small Firm Internationalization and Business Strategy: An Exploratory Study of \'Knowledge-Intensive\' and \'Traditional\' Manufacturing Firms in the UK”, International Small Business Journal, Vol. 22, No. 1, February 2004, pp. 23-56, doi:10.1177/0266242604039479
[10] M. E. Fayad, M. Laitinen and R. P. Ward. “Thinking objectively: software engineering in the small”, Communications of the ACM, Vol. 43, Issue 3, pp. 115-118, 2000, DOI=10.1145/330534.330555.
[11] G. Coleman and R. O\'Connor, “Investigating software process in practice: A grounded theory perspective”, Journal of Systems and Software, Volume 81, Issue 5, Software Process and Product Measurement, pp. 772-784, May 2008, DOI: 10.1016/j.jss.2007.07.027.
[12] C. Y. Laporte, A. Renault, S. Alexandre, T. Uthayanaka, “The Application of ISO/IEC JTC 1/SC7 Software Engineering Standards in Very Small Enterprises”, ISO Focus, International Organisation for Standardisation, pp. 36-38, September 2006.
[13] N. Habra, S. Alexandre, J-M. Desharnais, C. Y. Laporte, A. Renault, “Initiating software process improvement in very small enterprises: Experience with a light assessment tool”, Information and Software Technology, Vol. 50, Issues 7-8, pp. 763-771, June 2008, DOI: 10.1016/j.infsof.2007.08.004.
[14] V. Ribaud, P. Saliou, R. V. O’Connor and C. Y. Laporte, “Software Engineering Support Activities for Very Small Entities”, Systems, Software and Services Process Improvement, Communications in Computer and Information Science, 2010, Vol. 99, pp. 165-176, Springer-Verlag Berlin Heidelberg, 2010, DOI: 10.1007/978-3-642-15666-3_1.
[15] S. Basri and R. V. O’Connor, “Understanding the Perception of Very Small Software Companies towards the Adoption of Process Standards”, Systems, Software and Services Process Improvement, Communications in Computer and Information Science, CCIS Vol. 99, Springer-Verlag, 153-164, 2010, DOI: 10.1007/978-3-642-15666-3_14.
[16] J. Segal, “The Nature of Evidence in Empirical Software Engineering”, In Proceedings of the Eleventh Annual International Workshop on Software Technology and Engineering Practice (STEP \'03), IEEE Computer Society, Washington, DC, USA, 40-47, 2003, DOI: 10.1109/STEP.2003.33.
[17] T. C. Lethbridge, S. E. Sim and J. Singer, “Studying Software Engineers: Data Collection Techniques for Software Field Studies”, Empirical Software Engineering, Vol. 10, Issue 3, 311-341, 2005, DOI=10.1007/s10664-005-1290-x.
[18] C. Y. Laporte, “Process Improvement and the Management of Change”, Proceedings - 4th IEEE Computer Society Workshop on Software Engineering Technology Transfer, pp. 213-216, 1994.
[19] F. J. Pino, F. Ruiz, F. García and M. Piattini, “A software maintenance methodology for small organizations: Agile_MANTEMA”, Journal of Software Maintenance and Evolution: Research and Practice, doi: 10.1002/smr.541
[20] A. April, A. Abran, “A Software Maintenance Maturity Model (S3M): Measurement Practices at Maturity Levels 3 and 4”, Electronic Notes in Theoretical Computer Science, Volume 233, Proceedings of the International Workshop on Software Quality and Maintainability (SQM 2008), 27 March 2009, pp. 73-87, DOI: 10.1016/j.entcs.2009.02.062.
[21] A. Abran, P. Bourque, R. Dupuis, J. W. Moore, L. L. Tripp, Guide to the Software Engineering Body of Knowledge - SWEBOK, 2004th Edition, IEEE Press, Piscataway, NJ, USA, 2004.
[22] C. B. Seaman, “Qualitative methods in empirical studies of software engineering”, IEEE Transactions on Software Engineering, Vol. 25, No. 4, pp.557-572, Jul/Aug 1999, DOI: 10.1109/32.799955.
[23] Y. Dittrich, M. John, J. Singer, B. Tessem, “For the Special issue on Qualitative Software Engineering Research”, Information and Software Technology, Vol. 49, Issue 6, Qualitative Software Engineering Research, Pages 531-539, June 2007, DOI: 10.1016/j.infsof.2007.02.009.
[24] D. Silverman, “Qualitative research: meanings or practices?”, Information Systems Journal, Vol. 8, Issue 1, Pages 3 - 20, 1998, DOI: 10.1046/j.1365-2575.1998.00002.x.
[25] L. M. Given, The SAGE Encyclopedia of Qualitative Research Methods, Sage Publications, Thousand Oaks, 2008.
[26] K. Charmaz, Constructing grounded theory: A practical guide through qualitative analysis, 1st edition, Sage Publications, London, UK, 2006.
[27] J. Mills, A. Bonner and K. Francis, “The development of constructivist grounded theory”, International Journal of Qualitative Methods, Vol. 5, No 1, pp. 25-35, 2006.
[28] J, M. Morse, “Qualitative Methods: The State of the Art”, Qualitative Health Research, Vol. 9, No. 3, 393-406, 1999, doi:10.1177/104973299129121938.
[29] N. K. Denzin and Y. S. Lincoln, “Introduction: The discipline and practice of qualitative research”. In N. K. Denzin and Y. S. Lincoln (Eds.), The Sage Handbook of Qualitative Research (3rd ed.), pp. 1-32, Sage Publications, Thousand Oaks, CA, USA, 2005.
[30] J. W. Creswell, Qualitative inquiry & research design: Choosing among five approaches, Second Edition, Sage Publications, Thousand Oaks, California, USA, 2007.
[31] B.B. Glaser and A.L. Strauss, The Discovery of Grounded Theory, Aldine Publishing Company, Chicago, USA, 1967.
[32] J. Corbin and A. Strauss, Basics of qualitative research: Techniques and procedures for developing grounded theory, 3rd edition, Sage Publications, Thousand Oaks, USA, 2008.
[33] A. L. Strauss, Qualitative Analysis for Social Scientists, Cambridge University Press, Cambridge, UK, 1987.
[34] A. Bryant, \"Re-grounding Grounded Theory\", The Journal of Information Technology Theory and Application (JITTA), Vol. 4, Issue 1, 25-42, 2002.
[35] J. Carver, “The Impact of Background and Experience on Software Inspections”, Empirical Software Engineering, Volume 9, Number 3, pp. 259-262, 2004, DOI: 10.1023/B:EMSE.0000027786.04555.97.
[36] R. Razali, C. Snook, M. Poppleton and P. Garratt, “Usability Assessment of a UML-Based Formal Modeling Method Using a Cognitive Dimensions Framework”, Human Technology: An Interdisciplinary Journal on Humans in ICT Environments, Volume 4, Number 1, 26-46, May 2008.
[37] G. Arcs, R. Razali, “Cognitive dimensions and grounded theory in learning software modeling”, Procedia - Social and Behavioral Sciences, Volume 1, Issue 1, World Conference on Educational Sciences, Nicosia, North Cyprus, 4-7 February 2009 - New Trends and Issues in Educational Sciences, pp. 1884-1888, 2009, DOI: 10.1016/j.sbspro.2009.01.331.
[38] G. Coleman, R. O\'Connor, “Using grounded theory to understand software process improvement: A study of Irish software product companies”, Information and Software Technology, Volume 49, Issue 6, Qualitative Software Engineering Research, pp. 654-667, June 2007, DOI: 10.1016/j.infsof.2007.02.011.
[39] L. Scott, L. Carvalho, R. Jeffery, J. D\'Ambra, U. Becker-Kornstaedt, “Understanding the use of an electronic process guide”, Information and Software Technology, Volume 44, Issue 10, pp. 601-616, 2002, DOI: 10.1016/S0950-5849(02)00080-0.
[40] L. Carvalho, L. Scott, R. Jeffery, “An exploratory study into the use of qualitative research methods in descriptive process modeling”, Information and Software Technology, Volume 47, Issue 2, pp. 113-127, 2005, DOI: 10.1016/j.infsof.2004.06.005.
[41] S. Adolph, W. Hall and P. Kruchten, “Using grounded theory to study the experience of software development”, Empirical Software Engineering, Volume 16, Number 4, 487-513, DOI: 10.1007/s10664-010-9152-6.
[42] Z. Hussain, W. Slany and A. Holzinger, “Investigating Agile User-Centered Design in Practice: A Grounded Theory Perspective”, HCI and Usability for e-Inclusion, Lecture Notes in Computer Science, Volume 5889/2009, 279-289, 2009, DOI: 10.1007/978-3-642-10308-7_19.
[43] J. Sillito, K. De Voider, B. Fisher, G. Murphy, \"Managing software change tasks: an exploratory study,\" isese, 2005 International Symposium on Empirical Software Engineering, 2005.
[44] R. Hoda, J. Noble and S. Marshall, “Organizing self-organizing teams”. In Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 (ICSE \'10), Vol. 1, pp. 285-294, 2010, DOI=10.1145/1806799.1806843.
[45] R. Hoda, J. Noble and S. Marshall, “The impact of inadequate customer collaboration on self-organizing Agile teams”, Information and Software Technology, Volume 53, Issue 5, Special Section on Best Papers from XP2010, May 2011, pp. 521-534, DOI: 10.1016/j.infsof.2010.10.009.
[46] K. Smolander and T. Paivarinta, “Describing and Communicating Software Architecture in Practice: Observations on Stakeholders and Rationale”, Advanced Information Systems Engineering, Lecture Notes in Computer Science, 2006, Volume 2348/2006, pp. 117-133, DOI: 10.1007/3-540-47961-9_11.
[47] S. Dorairaj, J. Noble, and P. Malik, “Bridging cultural differences: a grounded theory perspective”, In Proceedings of the 4th India Software Engineering Conference (ISEC \'11), 3-10, 2011, DOI=10.1145/1953355.1953357.
[48] P. Xu and R. Balasubramaniam, “Software Process Tailoring: An Empirical Investigation”, Journal of Management Information Systems, Volume 24, Issue 2, pp. 293-328, 2007, DOI: 10.2753/MIS0742-1222240211.
[49] S. Salinger, L. Plonka and L. Prechelt, “A Coding Scheme Development Methodology Using Grounded Theory for Qualitative Analysis of Pair Programming”, Human Technology: An Interdisciplinary Journal on Humans in ICT Environments, Volume 4, Number 1, 9-25, May 2008.
[50] D. W. Stewart, P. N. Shamdasani and D. W. Rook, Focus Groups: Theory and Practice, Second Edition, SAGE Publications, London, UK, 2007.
[51] R. A. Krueger and M. A. Casey, Focus Groups: A Practical Guide for Applied Research, Fourth Edition, SAGE Publications, London, UK, 2009.
[52] O. T. Massey, “A proposed model for the analysis and interpretation of focus groups in evaluation research”, Evaluation and Program Planning, Vol. 34, Issue 1, pp. 21-28, February 2011, DOI: 10.1016/j.evalprogplan.2010.06.003.
[53] M. Q. Patton, Qualitative research and evaluation methods, 3rd edition, Sage Publications, Thousand Oaks, USA, 2001.
[54] P. Yuhas Byers and J. R. Wilcox, “Focus Groups: A Qualitative Opportunity for Researchers”, Journal of Business Communication, Vol. 28, No. 1, pp. 63-78, January 1991, doi:10.1177/002194369102800105.
[55] J. A. Maxwell, “Using Numbers in Qualitative Research”, Qualitative Inquiry, Vol. 16, No 6, pp. 475-482, 2010, doi: 10.1177/1077800410364740.
[56] M. Jorgensen, D. I. K. Sjoberg, “Impact of experience on maintenance skills”, Journal of Software Maintenance and Evolution: Research and Practice, Vol. 14, Issue 2, pp. 123-146, March/April 2002, DOI: 10.1002/smr.248.
[57] D. Walker and F. Myrick, “Grounded Theory: An Exploration of Process and Procedure”, Qualitative Health Research, 2006, Vol. 16, No. 4, pp. 547-559, DOI: 10.1177/1049732305285972.
[58] ...