Hostname: page-component-848d4c4894-x5gtn Total loading time: 0 Render date: 2024-06-12T08:18:28.838Z Has data issue: false hasContentIssue false
  • English
  • Français

Stochastic orders in partition and random testing of software

Part of: Distribution theory - Probability Computer system organization Circuits, networks

Published online by Cambridge University Press:  14 July 2016

Philip J. Boland ,
Harshinder Singh  and
Bojan Cukic
Philip J. Boland*
Affiliation:
National University of Ireland, Dublin
Harshinder Singh*
Affiliation:
West Virginia University and Panjab University
Bojan Cukic*
Affiliation:
West Virginia University
*
∗ Postal address: Department of Statistics, National University of Ireland, Dublin, Belfield, Dublin 4, Ireland. Email address: philip.j.boland@ucd.ie
∗∗ Postal address: Department of Statistics, West Virginia University, Morgantown, WV 26506-6330, USA.
∗∗∗ Postal address: Department of Computer Science and Electrical Engineering, West Virginia University, Morgantown, WV 26506-6330, USA.
Get access Rights & Permissions [Opens in a new window]

Abstract

Testing in order to produce software of high reliability is an area of major concern in software engineering. In an effort to find efficient methods of testing, the comparison of partition and random sampling testing methods has received considerable attention in the literature. A standard criterion for comparisons between random and partition testing, based on their expected efficacy in program debugging, is the probability of detecting at least one failure causing input in the program's domain. However, the goal in software testing is usually to find as many faults as possible in a reasonable period of time, and therefore stochastic comparisons of the number of faults obtained in partition and random testing may provide more valuable information on which testing procedures to use. We establish various conditions which guarantee that the number of faults discovered in partition testing is stochastically greater than the number discovered in random testing (using a fixed total sample size) for many of the well-established stochastic orders (including the usual stochastic order, the hazard rate order, the likelihood ratio order, and the variability order). The results established also allow us to obtain both upper and lower bounds with these stochastic orders for the sum of n independent Bernoulli random trials (with varying probability of success) in terms of the binomial distribution with parameters n and p.

Keywords

Partition testingrandom testingsoftware reliabilitysoftware debuggingusual stochastic ordermean orderhazard rate orderlikelihood ratio ordervariability ordermajorizationarithmetic meangeometric meanharmonic mean

MSC classification

Primary: 60E15: Inequalities; stochastic orderings
Secondary: 68M15: Reliability, testing and fault tolerance 94C12: Fault detection; testing
Type
Research Papers
Information
Journal of Applied Probability , Volume 39 , Issue 3 , September 2002 , pp. 555 - 565
Copyright
Copyright © Applied Probability Trust 2002 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1]. Boland, P. J., El-Neweihi, E., and Proschan, F. (1994). Schur properties of convolutions of exponential and geometric random variables. J. Multivariate Anal. 48, 157–167.CrossRefGoogle Scholar
[2]. Boland, P. J., Shaked, M., and Shanthikumar, J. G. (1998). Stochastic ordering of order statistics. In Handbook of Statistics, Vol. 16, Order Statistics: Theory and Methods, eds Balakrishnan, N. and Rao, C. R., Academic Press, San Diego, CA, pp. 89–103.Google Scholar
[3]. Boland, P. J., Singh, H., and Cukic, B. (2002). Comparing partition and random testing via majorization and Schur functions. To appear in IEEE Trans. Software Eng.Google Scholar
[4]. Bon, J.-L. and Păltănea, E. (1999). Ordering properties of convolutions of exponential random variables. Lifetime Data Anal. 5, 185–192.CrossRefGoogle ScholarPubMed
[5]. Chen, T. Y., and Yu, Y. T. (1994). On the relationship between partition and random testing. IEEE Trans. Software Eng. 20, 977–980.CrossRefGoogle Scholar
[6]. Chen, T. Y., and Yu, Y. T. (1996). On the expected number of failures detected by subdomain testing and random testing. IEEE Trans. Software Eng. 22, 109–119.CrossRefGoogle Scholar
[7]. Dharmadhikari, S., and Joag-Dev, K. (1988). Unimodality, Convexity and Applications. Academic Press, New York.Google Scholar
[8]. Duran, J., and Ntafos, S. (1984). An evaluation of random testing. IEEE Trans. Software Eng. 10, 438–444.CrossRefGoogle Scholar
[9]. Frankl, P. G., and Weyuker, E. L. (1993). A formal analysis of the fault-detecting ability of testing methods. IEEE Trans. Software Eng. 19, 202–213.CrossRefGoogle Scholar
[10]. Gutjahr, W. J. (1999). Partition testing vs random testing. IEEE Trans. Software Eng. 25, 661–674.CrossRefGoogle Scholar
[11]. Hamlet, R., and Taylor, R. (1990). Partition testing does not inspire confidence. IEEE Trans. Software Eng. 16, 1402–1411.CrossRefGoogle Scholar
[12]. Heirons, R. M., and Wiper, M. P. (1997). Estimation of failure rate using random and partition testing. Software Testing Verification Reliab. 7, 153–164.3.0.CO;2-4>CrossRefGoogle Scholar
[13]. Jeng, B., and Weyuker, E. J. (1989). Some observations on partition testing. In Proc. ACM SIGSOFT 3rd Symp. Software Testing, Anal. Verification (Key West, FL, 13–15 December 1989), ACM Press, New York, pp. 38–47.Google Scholar
[14]. Kochar, S., and Ma, C. (1999). Dispersive ordering of convolutions of exponential random variables. Statist. Prob. Lett. 43, 321–324. (Erratum: 45 (1999), 283.)CrossRefGoogle Scholar
[15]. Marshall, A. W., and Olkin, I. (1979). Inequalities: Theory of Majorization and Its Applications. Academic Press, New York.Google Scholar
[16]. Pledger, G., and Proschan, F. (1971). Comparisons of order statistics and of spacings from heterogeneous distributions. In Optimizing Methods in Statistics, ed. Rustagi, J. S., Academic Press, New York, pp. 89–113.Google Scholar
[17]. Ross, S. (1996). Stochastic Processes, 2nd edn. John Wiley, New York.Google Scholar
[18]. Shaked, M., and Shanthikumar, J. G. (1994). Stochastic Orders and Their Applications. Academic Press, San Diego, CA.Google Scholar
[19]. Singpurwalla, N. D., and Wilson, S. P. (1999). Statistical Methods in Software Engineering. Springer, New York.CrossRefGoogle Scholar
[20]. Weyuker, E. J., and Jeng, B. (1991). Analyzing partition testing strategies. IEEE Trans. Software Eng. 17, 703–711.CrossRefGoogle Scholar