- Marshall, P., Christie, J., Ladkin, P.B., Littlewood, B., Mason, S., Newby, M. … Thomas CBE, M. (2021). Recommendations for the probity of computer evidence. Digital Evidence and Electronic Signature Law Review pp. 18–26. doi:10.14296/deeslr.v18i0.5240.
- Littlewood, B., Salako, K., Strigini, L. and Zhao, X. (2020). On reliability assessment when a software-based system is replaced by a thought-to-be-better one. Reliability Engineering & System Safety, 197, pp. 106752–106752. doi:10.1016/j.ress.2019.106752.
- Littlewood, B., Ladkin, P.B., Thimbleby, H. and Thomas, M. (2020). The Law Commission presumption concerning the dependability of computer evidence. Digital Evidence and Electronic Signature Law Review, 17, pp. 1–14.
- Zhao, X., Littlewood, B., Povyakalo, A., Strigini, L. and Wright, D. (2018). Conservative claims for the probability of perfection of a software-based system using operational experience of previous similar systems. Reliability Engineering & System Safety, 175, pp. 265–282. doi:10.1016/j.ress.2018.03.032.
- Zhao, X., Littlewood, B., Povyakalo, A., Strigini, L. and Wright, D. (2017). Modeling the probability of failure on demand (pfd) of a 1-out-of-2 system in which one channel is “quasi-perfect”. Reliability Engineering & System Safety, 158, pp. 230–245. doi:10.1016/j.ress.2016.09.002.
- Bishop, P., Bloomfield, R., Littlewood, B., Popov, P., Povyakalo, A. and Strigini, L. (2014). A conservative bound for the probability of failure of a 1-out-of-2 protection system with one hardware-only and one software-based protection train. Reliability Engineering & System Safety, 130, pp. 61–68. doi:10.1016/j.ress.2014.04.002.
- Littlewood, B. and Povyakalo, A. (2013). Conservative Reasoning about the Probability of Failure on Demand of a 1-out-of-2 Software-Based System in Which One Channel Is "Possibly Perfect". IEEE Transactions on Software Engineering, 39(11), pp. 1521–1530. doi:10.1109/tse.2013.35.
- Littlewood, B. and Povyakalo, A. (2013). Conservative reasoning about epistemic uncertainty for the probability of failure on demand of a 1-out-of-2 software-based system in which one channel is “possibly perfect”. IEEE Transactions on Software Engineering.
- Littlewood, B. and Povyakalo, A. (2013). Conservative bounds for the pfd of a 1-out-of-2 software-based system based on an assessor’s subjective probability of “not worse than independence”. IEEE Transactions on Software Engineering.
- Littlewood, B., Bishop, P., Bloomfield, R., Povyakalo, A. and Wright, D. (2011). Towards a formalism for conservative claims about the dependability of software-based systems. IEEE Transactions on Software Engineering. doi:10.1109/TSE.2010.67.
- Littlewood, B. and Rushby, J. (2011). Reasoning about the Reliability of Diverse Two-Channel Systems in which One Channel is "Possibly Perfect". IEEE Transactions on Software Engineering, 38(5), pp. 1178–1194. doi:10.1109/TSE.2011.80.
- Littlewood, B. and Strigini, L. (2011). “Validation of ultra-high dependability…” – 20 years on. Safety Systems - The Safety-Critical Systems Club Newsletter, 30(3).
- Littlewood, B. (2008). Comments on "Multi-objective genetic algorithm for solving N-version program design problem". RELIABILITY ENGINEERING & SYSTEM SAFETY, 93(8), pp. 1287–1287. doi:10.1016/j.ress.2007.06.005.
- Littlewood, B. and Wright, D. (2007). The use of multilegged arguments to increase confidence in safety claims for software-based systems: A study based on a BBN analysis of an idealized example. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 33(5), pp. 347–365. doi:10.1109/TSE.2007.1002.
- Littlewood, B. (2006). Comments on 'Reliability and performance analysis for fault-tolerant programs consisting of versions with different characteristics' by Gregory Levitin [Reliability Engineering and System Safety 86 (2004) 75-81]. RELIABILITY ENGINEERING & SYSTEM SAFETY, 91(1), pp. 119–120. doi:10.1016/j.ress.2004.11.005.
- Littlewood, B. (2005). Dependability evaluation: a question of confidence. Safety Systems: the Safety-Critical Systems Club Newsletter, 15(1), pp. 1–4.
- Littlewood, B., Popov, P. and Strigini, L. (2002). Assessing the reliability of diverse fault-tolerant software-based systems. SAFETY SCIENCE, 40(9), pp. 781–796.
- Bloomfield, R., Courtois, P.J., Littlewood, B., Strigini, L., Yih, S. and Fan, C.F. (2002). Letter to the editor [1] (multiple letters). Nuclear Engineering International, 47(570), p. 11.
- Bloomfield, R., Courtois, P.J., Littlewood, B. and Strigini, L. (2002). Search for the Unnecessary. NUCL ENG INT, 47(570), pp. 11–11.
- Littlewood, B., Popov, P.T., Strigini, L. and Shryane, N. (2000). Modeling the effects of combining diverse software fault detection techniques. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 26(12), pp. 1157–1167. doi:10.1109/32.888629.
- Littlewood, B. (2000). The use of proofs in diversity arguments. IEEE Trans Software Engineering, 26(10), pp. 1022–1023.
- Frankl, P., Hamlet, D., Littlewood, B. and Strigini, L. (1999). Evaluating testing methods by delivered reliability (vol 24, pg 586, 1998). IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 25(2), pp. 286–286. doi:10.1109/TSE.1999.761452.
- Littlewood, B., Popov, P. and Strigini, L. (1999). Note on reliability estimation of functionally diverse systems. Reliability Engineering and System Safety, 66(1), pp. 93–95. doi:10.1016/S0951-8320(99)00014-9.
- Frankl, P.G., Hamlet, R.G., Littlewood, B. and Strigini, L. (1998). Evaluating Testing Methods by Delivered Reliability. IEEE Trans. Software Eng., 24, pp. 586–601. doi:10.1109/32.707695.
- Fenton, N., Littlewood, B., Neil, M., Strigini, L., Sutcliffe, A. and Wright, D. (1998). Assessing dependability of safety critical systems using diverse evidence. IEE Proceedings - Software, 145(1), pp. 35–35. doi:10.1049/ip-sen:19984895.
- Littlewood, B., Fenton, N., Neil, M., Strigini, L., Sutcliffe, A. and Wright, D. (1998). Assessing dependability of safety-critical systems using diverse evidence. IEE Proceedings - Software Engineering, 145(1), pp. 35–39.
- Littlewood, B., Barghout, M. and Abdel-Ghaly, A.A. (1998). A non-parametric order statistics software reliability model. Software Testing, Verification and Reliability, 8, pp. 113–132.
- Littlewood, B. and Wright, D. (1997). Some conservative stopping rules for the operational testing of safety-critical software. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 23(11), pp. 673–683. doi:10.1109/32.637384.
- Littlewood, B. (1996). The impact of diversity upon common mode failures. RELIABILITY ENGINEERING & SYSTEM SAFETY, 51(1), pp. 101–113. doi:10.1016/0951-8320(95)00120-4.
- LITTLEWOOD, B., NEIL, M. and OSTROLENK, G. (1995). THE ROLE OF MODELS IN MANAGING THE UNCERTAINTY OF SOFTWARE-INTENSIVE SYSTEMS. RELIABILITY ENGINEERING & SYSTEM SAFETY, 50(1), pp. 87–95. doi:10.1016/0951-8320(95)00073-B.
- Littlewood, B., Neil, M. and Ostrolenk, G. (1995). Uncertainty in software-intensive systems. High Integrity Systems Journal, 1(5).
- KNIGHT, J. and LITTLEWOOD, B. (1994). CRITICAL TASK OF WRITING DEPENDABLE SOFTWARE - INTRODUCTION. IEEE SOFTWARE, 11(1), pp. 16–20. doi:10.1109/52.251196.
- ANDERSON, T., BLOOMFIELD, R., LITTLEWOOD, B. and MALCOLM, B. (1994). SPECIAL ISSUE ON SOFTWARE SAFETY. RELIABILITY ENGINEERING & SYSTEM SAFETY, 43(2), pp. 101–102. doi:10.1016/0951-8320(94)90055-8.
- BROCKLEHURST, S., LITTLEWOOD, B., OLOVSSON, T. and JONSSON, E. (1994). ON MEASUREMENT OF OPERATIONAL SECURITY. IEEE AEROSPACE AND ELECTRONIC SYSTEMS MAGAZINE, 9(10), pp. 7–16. doi:10.1109/62.318876.
- Littlewood, B. and Strigini, L. (1993). Validation of Ultrahigh Dependability for Software-Based Systems. Commun. ACM, 36, pp. 69–80.
- Littlewood, B., Lu, M. and Brocklehurst, S. (1993). Combination of predictions obtained from different software reliability growth models. Journal of Computer and Software Engineering, 1(4), pp. 303–324.
- Littlewood, B., Brocklehurst, S., Fenton, N., Mellor, P., Page, S., Wright, D. … Gollmann, D. (1993). Towards operational measures of computer security. Journal of Computer Security, 2(3), pp. 211–229.
- LITTLEWOOD, B. and STRIGINI, L. (1992). THE RISKS OF SOFTWARE. SCI AM, 267(5), pp. 38–43.
- LAPRIE, J.C. and LITTLEWOOD, B. (1992). PROBABILISTIC ASSESSMENT OF SAFETY-CRITICAL SOFTWARE - WHY AND HOW. COMMUNICATIONS OF THE ACM, 35(2), p. 13. doi:10.1145/129630.376087.
- BROCKLEHURST, S. and LITTLEWOOD, B. (1992). NEW WAYS TO GET ACCURATE RELIABILITY-MEASURES. IEEE SOFTWARE, 9(4), pp. 34–42. doi:10.1109/52.143100.
- LITTLEWOOD, B. and MILLER, D. (1991). SPECIAL ISSUE ON SOFTWARE-RELIABILITY AND SAFETY - PREFACE. RELIABILITY ENGINEERING & SYSTEM SAFETY, 32(1-2). doi:10.1016/S0951-8320(12)80001-9.
- BROCKLEHURST, S., CHAN, P.Y., LITTLEWOOD, B. and SNELL, J. (1990). RECALIBRATING SOFTWARE-RELIABILITY MODELS. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 16(4), pp. 458–470. doi:10.1109/32.54297.
- Littlewood, B. and Miller, D.R. (1989). Conceptual Modeling of Coincident Failures in Multiversion Software. IEEE Transactions on Software Engineering, 15(12), pp. 1596–1614. doi:10.1109/32.58771.
- LITTLEWOOD, B. (1989). PREDICTING SOFTWARE-RELIABILITY. PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 327(1596), pp. 513–527. doi:10.1098/rsta.1989.0007.
- LITTLEWOOD, B. (1988). FORECASTING SOFTWARE-RELIABILITY. LECTURE NOTES IN COMPUTER SCIENCE, 341, pp. 141–209.
- LITTLEWOOD, B. and SOFER, A. (1987). A BAYESIAN MODIFICATION TO THE JELINSKI-MORANDA SOFTWARE-RELIABILITY GROWTH-MODEL. SOFTWARE ENGINEERING JOURNAL, 2(2), pp. 30–41. doi:10.1049/sej.1987.0005.
- Littlewood, B. and Miller, D.R. (1987). CONCEPTUAL MODEL OF MULTI-VERSION SOFTWARE. Digest of Papers - FTCS (Fault-Tolerant Computing Symposium) pp. 150–155.
- ABDELGHALY, A.A., CHAN, P.Y. and LITTLEWOOD, B. (1986). EVALUATION OF COMPETING SOFTWARE-RELIABILITY PREDICTIONS. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 12(9), pp. 950–967. doi:10.1109/TSE.1986.6313050.
- IANNINO, A., MUSA, J.D., OKUMOTO, K. and LITTLEWOOD, B. (1984). CRITERIA FOR SOFTWARE-RELIABILITY MODEL COMPARISONS. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 10(6), pp. 687–691. doi:10.1109/TSE.1984.5010297.
- LITTLEWOOD, B. (1984). RATIONALE FOR A MODIFIED DUANE MODEL. IEEE TRANSACTIONS ON RELIABILITY, 33(2), pp. 157–159. doi:10.1109/TR.1984.5221762.
- LITTLEWOOD, B. (1984). SUBJECTIVE-PROBABILITY AND THE DFR-MIXTURE CLOSURE THEOREM. COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 13(7), pp. 859–863.
- LITTLEWOOD, B. and VERRALL, J.L. (1981). LIKELIHOOD FUNCTION OF A DEBUGGING MODEL FOR COMPUTER SOFTWARE-RELIABILITY. IEEE TRANSACTIONS ON RELIABILITY, 30(2), pp. 145–148. doi:10.1109/TR.1981.5221009.
- LITTLEWOOD, B. (1981). STOCHASTIC RELIABILITY-GROWTH - A MODEL FOR FAULT-REMOVAL IN COMPUTER-PROGRAMS AND HARDWARE-DESIGNS. IEEE TRANSACTIONS ON RELIABILITY, 30(4), pp. 313–320. doi:10.1109/TR.1981.5221099.
- LITTLEWOOD, B. (1980). THEORIES OF SOFTWARE-RELIABILITY - HOW GOOD ARE THEY AND HOW CAN THEY BE IMPROVED. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 6(5), pp. 489–500. doi:10.1109/TSE.1980.230790.
- Littlewood, B. (1980). The Littlewood-Verall model for software reliability compared with some rivals. Systems and Software, 1(3), pp. 252–258.
- Littlewood, B. (1980). The Littlewood-Verrall model for software reliability compared with some rivals. Journal of Systems and Software, 1, pp. 251–258.
- LITTLEWOOD, B. (1979). SOFTWARE RELIABILITY MODEL FOR MODULAR PROGRAM STRUCTURE. IEEE TRANSACTIONS ON RELIABILITY, 28(3), pp. 241–246. doi:10.1109/TR.1979.5220576.
- LITTLEWOOD, B. (1979). HOW TO MEASURE SOFTWARE RELIABILITY AND HOW NOT TO. IEEE TRANSACTIONS ON RELIABILITY, 28(2), pp. 103–110. doi:10.1109/TR.1979.5220510.
- LITTLEWOOD, B. (1975). RELIABILITY MODEL FOR SYSTEMS WITH MARKOV STRUCTURE. THE ROYAL STATISTICAL SOCIETY SERIES C-APPLIED STATISTICS, 24(2), pp. 172–177.
- LITTLEWOOD, B. (1975). MTBF IS MEANINGLESS IN SOFTWARE RELIABILITY. IEEE TRANSACTIONS ON RELIABILITY, R 24(1), pp. 82–82. doi:10.1109/TR.1975.5215342.
- LITTLEWOOD, B. and VERRALL, J.L. (1974). BAYESIAN RELIABILITY MODEL WITH A STOCHASTICALLY MONOTONE FAILURE RATE. IEEE TRANSACTIONS ON RELIABILITY, R 23(2), pp. 108–114. doi:10.1109/TR.1974.5215217.
- LITTLEWO, B. and VERRALL, J.L. (1973). RANDOM SEQUENTIAL ADDITION OF HARD ATOMS TO ONE-DIMENSIONAL INTEGER LATTICE. JOURNAL OF CHEMICAL PHYSICS, 59(4), pp. 1613–1615. doi:10.1063/1.1680240.
- Littlewood, B. and Verrall, J.L. (1973). A Bayesian reliability growth model for computer software. Royal Statistical Society Series C (Applied Statistics), 22(3), pp. 332–346.
- Littlewood, B. and Verrall, L.J. (1972). Equilibrium distributions of polymers on sites which are linearly arrayed. Journal of Applied Probability, 9(1), pp. 54–64.
- Littlewood, B. and Verrall, J.L. (1970). Equilibrium distribution of dimers in irradiated RNA molecules. Journal of the Physical Society of Japan, 28(5), pp. 1308–1310.
- Littlewood, B. and Verrall, J.L. (1970). Limiting proportion of hydrations in irradiated RNA molecules. Journal of the Physical Society of Japan, 29(2), pp. 283–287.
- Littlewood, B. and Rushby, J. Reasoning About The Reliability Of Diverse Two-Channel Systems In Which One Channel Is “Possibly Perfect”. IEEE Transactions on Software Engineering.
Contact details
Address
Northampton Square
London EC1V 0HB
United Kingdom
About
Overview
Bev Littlewood has degrees in mathematics and statistics, and a PhD in statistics and computer science; he is a Chartered Engineer, and a Chartered Statistician. He has worked for more than 30 years on problems associated with the dependability of software-based systems, and has published many papers in international journals and conference proceedings and has edited several books.
In 1983 he founded the Centre for Software Reliability (CSR) at City University, London, and was its Director from then until his semi-retirement in 2003. During this period CSR attracted many millions of pounds of research funding from various European and UK national agencies such as EPSRC, and industry, and gained an international reputation for the quality of its research. He has successfully managed almost 40 research projects as Principal Investigator. He is currently Professor of Software Engineering at City University.
His technical contributions have largely focused on the application of probabilistic and statistical techniques in software systems engineering. He has published over a hundred scientific papers on topics that include:
- Software reliability growth modeling
- Modelling of software design diversity for fault tolerance
- Exploring the limits of what can be claimed rigorously for system dependability
- Application of Bayesian probability and statistics to systems dependability
- Software testing
- Combining reliability and correctness claims in safety arguments
He has a long term interest in the question of how far these approaches can take us in providing assurance that systems are fit for purpose - in particular, whether certain critical systems are sufficiently safe to be allowed to operate. He has encouraged - and taken part in - debate about such issues in both technical and non-technical forums. This has involved several TV and radio appearances in documentary and news programmes discussing general issues of software reliability and safety. For example, he presented, and was co-author, of an edition of the BBC2 TV programme, 'Antenna', on safety-critical software.
From 1990 to 2005 he was a member of the UK Nuclear Safety Advisory Committee (NuSAC), in which role he played a part in the extensive discussions, and controversy, concerning the first use of a software-based protection system for a UK power reactor. He chaired the NuSAC Working Group on the use of software in critical applications, which reported to the Health and Safety Commission in 1998. Its report was published as 'The Use of Computers in Safety-critical Applications' (www.hse.gov.uk/nuclear/computers.pdf).
His professional activities related to his scientific work are numerous. He is a member of the UK Computing Research Committee (UKCRC), and is a past member of the EPSRC College for Computing. He is currently serving his third term as an Associate Editor of IEEE Trans on Software Engineering, the premier journal in SE. He is on the editorial boards of several other international journals. He is a member of IFIP Working Group 10.4 on Reliable Computing and Fault Tolerance. He was a member of the British Computer Society's Safety Critical Systems Task Force until its recent untimely demise. He was the only non-US member of the Panel on Statistical Methods in Software Engineering (1992-4), convened by the US National Research Council. He was a member of the HSC Working Group that wrote the influential 'Tolerability of Risk from Nuclear Power Stations', being responsible for the section on the contribution of critical computing systems to risk. From 2007 until 2009 he was a member of the IEEE John von Neumann Award Committee. He is currently a member of the IEEE Computer Society's Harlan D Mills Award Committee.
He has been a consultant to many organizations and companies in Europe and the US. As consultant to Harlan Mills' IBM Fellow Department in the 1980s, BL gave advice on the statistical underpinnings of the well-known Cleanroom approach to software development and evaluation.
BL has been a member of the programme committees of many international conferences, including several ICSEs. He has given keynote addresses and invited talks at numerous conferences.
In 2007 he was the recipient of the IEEE Computer Society's prestigious Harlan D Mills Award, the citation of which reads: "For leading research on the application of rigorous probabilistic and statistical techniques in software engineering, particularly in systems dependability".
Qualifications
- CITP (Chartered IT Professional) IT, British Computer Society, Jan 2008
- CE (Chartered Engineer) Computing, British Computer Society, 1994
- CS (Chartered Statistician) Statistics, Royal Statistical Society, 1993
- PhD Statistics & Computer Science, City, University of London, United Kingdom, Jan 1978
- MSc Statistics, University of London, United Kingdom, 1966
- ARCS (Associate of the Royal College of Science) Mathematics, Imperial College London, 1963
- BSc Mathematics, Imperial College London, United Kingdom, Jan 1963
Employment
- Emeritus Professor of Software Engineering, City, University of London, 2018 – present
- Professor of Software Engineering (50% research-only appointment), City, University of London, 2011 – 2018
- Visiting Associate Professor, George Washington University, 1980 – 1981
- Professor of Software Engineering since 1985, City, University of London, Jan 1966 – Jan 2011
Memberships of professional organisations
- Member, UK Computing Research Committee, 2003 – present
- Member, Conference of Professors & Heads of Computing, 2000 – present
- Member, British Computer Society, 1985 – present
- Member, IEEE Computer Society, 1984 – present
- Fellow, Royal Statistical Society, 1966 – present
Research
Research interests
- Reliability and safety modeling of software-based systems
- Software fault tolerance
- Software testing
- Dependability cases for software-based systems
Publications
Publications by category
Books (2)
- Commission, G.B.H.A.S., Staff, H.A.S.E. and Littlewood, B. (1998). Use of Computers in Safety-Critical Applications, Final Report to Nuclear Safety Advisory Committee (NuSAC) of the Study Group on the Safety of Operational Computer Systems. ISBN 978-0-7176-1620-6.
- Fenton, N.E. and Littlewood, B. (1991). Software reliability and metrics. Garmisch-Partenkirchen: Kluwer Academic Pub. ISBN 978-1-85166-675-1.
Chapters (11)
- Littlewood, B. and Strigini, L. (2000). Software reliability and dependability: a roadmap. In Finkelstein, A. (Ed.), 22nd International Conference on on Software Engineering, Future of Software Engineering Track, ICSE 2000, Limerick Ireland, June 4-11, 2000. (pp. 175–188). ACM. ISBN 1-58113-253-0.
- Littlewood, B. and Wright, D. (1997). Mathematics of dependable systems 2. In Stavridou, V. and Applications, I.F.M.A.I. (Eds.), Mathematics of dependable systems 2 (pp. 243–258). Oxford University Press, USA.
- Littlewood, B. (1996). Evaluation of software dependability. In Wand, I.C. and Milner, R. (Eds.), Computing Tomorrow: Future Research Directions in Computer Science Cambridge Univ Pr. ISBN 978-0-521-46085-9.
- Littlewood, B. and Brocklehurst, S. (1996). Techniques for prediction analysis and recalibration. In Lyu, M.R. (Ed.), Handbook of software reliability engineering (pp. 119–166). New York: McGraw-Hill. ISBN 978-0-07-039400-1.
- Strigini, L. and Littlewood, B. (1995). Validation of Ultra-High Dependability for Software-Based Systems. In Randell, B., Laprie, J.C., Kopetz, H. and Littlewood, B. (Eds.), Predictably Dependable Computing Systems (ESPRIT Basic Research Series) (pp. 473–493). Springer. ISBN 978-3-540-59334-8.
- Littlewood, B. (1994). Software Reliability Modelling. In McDermid, J. (Ed.), Software engineer's reference book Butterworth-Heinemann Ltd. ISBN 978-0-7506-0813-8.
- Littlewood, B. (1991). Limits to evaluation of software dependability. In Fenton, N.E. and Littlewood, B. (Eds.), Software reliability and metrics (pp. 81–110). Elsevier. ISBN 978-1-85166-675-1.
- Littlewood, B. (1991). Reliability. In Fenton, N.E. (Ed.), Software Metrics: A Rigorous Approach (pp. 230–249). London: Chapman and Hall. ISBN 978-0-412-40440-5.
- Littlewood, B. (1990). Modelling growth in software reliability. In Rook, P. (Ed.), Software Reliability Handbook Elsevier. ISBN 978-1-85166-400-9.
- Littlewood, B., Chan, P.Y. and Abdel Ghaly, A.A. (1986). Tools for the analysis of the accuracy of software reliability predictions. In Skwirzynski, J.K. (Ed.), NATO advanced Study Institute, Software System Design Methods (pp. 229–336). Springer-Verlag.
- Littlewood, B. (1985). Software Reliability Prediction. In Anderson, T. (Ed.), Resilient computing systems (pp. 144–162). Wiley-Interscience.
Conference papers and proceedings (73)
- Zhao, X., Littlewood, B., Povyakalo, A. and Wright, D. (2015). Conservative claims about the probability of perfection of software-based systems. 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE) 2-5 November. doi:10.1109/issre.2015.7381807
- Rushby, J., Littlewood, B. and Strigini, L. (2014). Evaluating the Assessment of Software Fault-Freeness. AESSCS 2014 Workshop, "Planning the Unplanned Experiment: Assessing the Efficacy of Standards for Safety Critical Software At the European Dependable Computing Conference (EDCC) 13 May, Newcastle upon Tyne.
- Littlewood, B. and Burns, A. (2010). Reasoning About the Reliability of Multi-version, Diverse Real-Time Systems. Real Time Systems Symposium 30 Nov 2010 – 3 Dec 2010, San Diego, CA.
- Littlewood, B. and Burns, A. (2010). Reasoning About the Reliability of Multi-version, Diverse Real-Time Systems. 31st IEEE Real-Time Systems Symposium 30 Nov 2010 – 3 Dec 2010, San Diego. doi:10.1109/RTSS.2010.43
- Littlewood, B., Popov, P.T., Strigini, L. and Shryane, N. (2008). Modelling the Effects of Combining Diverse Software Fault Detection Techniques.
- Bloomfield, R.E., Littlewood, B. and Wright, D. (2007). Confidence: Its role in dependability cases for risk assessment. doi:10.1109/DSN.2007.29
- Bishop, P., Gashi, I., Littlewood, B. and Wright, D. (2007). Reliability modeling of a 1-out-of-2 system: Research with diverse Off-the-shelf SQL database servers.
- Bryans, J.W., Littlewood, B., Ryan, P.Y.A. and Strigini, L. (2006). E-voting: Dependability requirements and design for dependability. 1st International Conference on Availability, Reliability and Security 20-22 April, Vienna Univ Technol, Vienna, AUSTRIA.
- Littlewood, B. (2005). Dependability assessment of software-based systems: state of the art.
- Popov, P.T. and Littlewood, B. (2004). The Effect of Testing on Reliability of Fault-Tolerant Software. doi:10.1109/DSN.2004.1311896
- Littlewood, B. and Strigini, L. (2004). Redundancy and Diversity in Security.
- Littlewood, B., Bloomfield, R., Popov, P., Povyakalo, A. and Strigini, L. (2004). The impact of ‘difficulty’ variation on the probability of coincident failure of diverse systems. International Conference on Control and Instrumentation in Nuclear Installations Liverpool.
- Littlewood, B. and Bloomfield, R. (2004). On the use of diverse arguments to increase confidence in dependability claims. International Conference on Control and Instrumentation in Nuclear Installations.
- Littlewood, B. (2003). Editor SAFECOMP2003. International Conference on Computer Safety, Reliability and Security September, Edinburgh.
- Bloomfield, R. and Littlewood, B. (2003). Multi-legged arguments: the impact of diversity upon confidence in dependability arguments. doi:10.1109/DSN.2003.1209913
- (2003). Computer Safety, Reliability, and Security, 22nd International Conference, SAFECOMP 2003, Edinburgh, UK, September 23-26, 2003, Proceedings.
- Strigini, L., Bosio, D., Littlewood, B. and Newby, M.J. (2002). Advantages of open source processes for reliability: clarifying the issues. 25-26 February, Newcastle upon Tyne.
- Littlewood, B. (2002). Complexity is the enemy of dependability - Can diversity provide a defence? doi:10.1109/ICECCS.2002.1181492
- Littlewood, B. (2002). On Diversity, and the Elusiveness of Independence.
- Oussalah, M., Littlewood, B., Strigini, L. and Newby, M. (2001). Combination of qualitative and quantitative sources of knowledge for risk assessment.
- Littlewood, B., Popov, P. and Strigini, L. (2001). Design diversity: an update from research on reliability modelling.
- Littlewood, B., Popov, P. and Strigini, L. (2001). Modeling software design diversity - A review. doi:10.1145/384192.384195
- Littlewood, B. and Strigini, L. (2000). Software reliability and dependability: a roadmap. 22nd International Conference on Software Engineering 4-11 June, Limerick, Ireland.
- Littlewood, B. and Strigini, L. (2000). Fault tolerance via diversity against design faults (tutorial session): design principles and reliability assessment.
- Littlewood, B. and Strigini, L. (2000). Software reliability (tutorial session): basic concepts and assessment methods.
- Littlewood, B. (2000). The Problems of Assessing Software Reliability .... when you really need to depend on it.
- Popov, P.T., Strigini, L. and Littlewood, B. (2000). Choosing Between Fault-Tolerance and Increased V&V for Improving Reliability.
- Littlewood, B., Popov, P.T. and Strigini, L. (2000). Assessment of the Reliability of Fault-Tolerant Software: A Bayesian Approach.
- Littlewood, B., Strigini, L., Wright, D., Fenton, N., Neil, M. and Courtois, P.-.J. (2000). Bayesian Belief Networks for safety assessment of computer-based systems.
- Littlewood, B., Popov, P. and Strigini, L. (2000). N-version design versus one good version. Proc International Conference on Dependable Systems and Networks (Fast Abstracts) New York.
- Littlewood, B. (1999). Two Heads Are Better Than One: Using Diversity to Make Software Dependable.
- Frankl, P., Hamlet, D., Littlewood, B. and Strigini, L. (1997). Choosing a testing method to deliver reliability. 19th International Conference on Software Engineering (ICSE 97) - Pulling Together 17-23 May, BOSTON, MA.
- Barghout, M., Littlewood, B. and AbdelGhaly, A. (1997). A non-parametric approach to software reliability prediction. doi:10.1109/ISSRE.1997.630885
- Littlewood, B., Combelles, A. and Sorel, V. (1996). Difficulties in evaluating the dependability of safety-critical systems: investigation on the combination of evidence. International Conference on Probabilistic Safety Assessment and Management, (ESREL ’96 - PSAM III) 24-26 June, Crete.
- Littlewood, B., Neil, M. and Fenton, N. (1996). Applying Bayesian belief networks in systems dependability assessment. Safety Critical Systems Symposium February, Leeds.
- Littlewood, B., Wright, D. and Meyer, F. (1995). Dependability of modular software in a multiuser operational environment. International Symposium on Software Reliability Engineering (ISSRE ’95) November, Toulouse.
- LITTLEWOOD, B. and WRIGHT, D. (1995). Stopping rules for the operational testing of safety-critical software. doi:10.1109/FTCS.1995.466955
- Littlewood, B. and Wright, D. (1995). A Bayesian model that combines disparate evidence for the quantitative assessment of system dependability. 14th International Conference on Computer Safety (SafeComp’95).
- Littlewood, B. (1994). Learning to live with uncertainty in our software. 2nd Intl Software Metrics Symposium 24-26 October, London.
- LITTLEWOOD, B. (1994). WHY WE SHOULD LEARN NOT TO DEPEND TOO MUCH UPON SOFTWARE.
- BROCKLEHURST, S., OLOVSSON, T., LITTLEWOOD, B. and JONSSON, E. (1994). ON MEASUREMENT OF OPERATIONAL SECURITY.
- Littlewood, B. (1994). Measurement of operational security. IFIP Conference on Distributed Computing for Critical Applications (DCCA-4) January, San Diego.
- Littlewood, B. (1993). The need for evidence from disparate sources to evaluate software safety. Directions in Safety-Critical Computing 9-11 February, Bristol.
- Littlewood, B. (1992). Measurement-based modelling issues - the problem of ultra-high dependability. Experimental Software Engineering Issues: Critical Assessment and Future Directions International Workshop September, Dagstuhl Castle, Germany.
- Littlewood, B., Brocklehurst, S., Kanoun, K., Laprie, J.C., Metge, S., Mellor, P. … Tanner, A. (1991). Reliability analyses of workstation failure data. ESPRIT ‘91 25-29 November, Brussels.
- Littlewood, B. (1991). Software reliability modelling: achievements and limitations. IEEE CompEuro 91 13-16 May, Bologna.
- Littlewood, B. and Fenton, N. (1991). Evaluating software engineering standards and methods. Eurometrics 91 March, Issy-les-Molinieaux.
- Littlewood, B. and Thomas, M. (1991). Reasons why safety-critical avionics software cannot be adequately validated. Safety and Reliability Society Spring Conference,.
- Littlewood, B. (1990). Software reliability modelling: some achievements and limitations. ICL/Newcastle University International Seminar on the Teaching of Computer Science September, University of Newcastle-upon-Tyne.
- Littlewood, B. (1989). Hardware and software dependability evaluation: software dependability. 11th Information Processing World Congress (IFIP) 28 Aug 1989 – 1 Sep 1989, San Francisco.
- Littlewood, B., Brocklehurst, S., Chan, P.Y. and Snell, J. (1988). A general adaptive approach to software reliability prediction. UK IT '88.
- Littlewood, B. and Miller, D.R. (1988). A conceptual model for software diversity. UK IT '88.
- Littlewood, B. and Miller, D.R. (1987). A conceptual model of the effect of diverse methodologies on coincident failures in multi-version software. 3rd International Fault-Tolerant Computing Systems (IFTCS) September, Bremerhaven.
- Littlewood, B. and Miller, D.R. (1987). Modelling multi-version software. 4th CSR Conference: Measurement for Software Control and Assurance September, Bristol.
- Littlewood, B., Brocklehurst, S., Chan, P.Y. and Snell, J. (1987). Adaptive software reliability modelling. 4th CSR Conference: Measurement for Software Control and Assurance September, Bristol.
- Littlewood, B. (1987). Proceedings of 2nd CSR Workshop, Software Reliability: Achievement and Assessment. 2nd CSR Workshop, Software Reliability: Achievement and Assessment September.
- Littlewood, B. (1987). Proceedings of 4th CSR Conference: Measurement for Software Control and Assurance. 4th CSR Conference: Measurement for Software Control and Assurance September, Bristol.
- Littlewood, B. (1987). How good are software reliability predictions? 2nd CSR Workshop, Software Reliability: Achievement and Assessment.
- Littlewood, B. and Keiller, P.A. (1984). Adaptive software reliability modelling. IEEE 14th Annual International Symposium Fault-Tolerant Computing (FTCS 1984) Orlando.
- Littlewood, B., Keiller, P.A. and Sofer, A. (1984). Predictive quality of software reliability models. 4th Jerusalem Conference on Information Technology (JCIT).
- Littlewood, B., Keiller, P.A., Miller, D.R. and Sofer, A. (1983). On the quality of software reliability prediction. 1982 NATO Advanced Study Institute on Electronic Systems Effectiveness and Life Cycle Costing.
- Littlewood, B., Keiller, P.A., Miller, D.R. and Sofer, A. (1983). Comparison of software reliability predictions. IEEE 13th Annual International Symposium Fault-Tolerant Computing (1983 FTCS) Milan.
- Littlewood, B. (1981). A critique of the Jelinski-Moranda model for software reliability. Annual Reliability and Maintainability Symposium 27-29 June, Philadephia.
- Littlewood, B. (1980). A Bayesian differential debugging model for software reliability. COMPSAC 80 27-31 October, Chicago, IL.
- Littlewood, B. (1980). What makes a reliable program - few bugs, or a small failure rate. 1980 National Computer Conference (NCC 80) 19-22 May, Arlington, VA.
- Littlewood, B. (1979). A Bayesian differential debugging model for software reliability. Workshop on Quantitative Software Models 9-11 October, Kiamesha Lake, New York.
- Littlewood, B. (1978). Validation of a software reliability model. 2nd Software Life Cycle Management Workshop 20-22 August, Atlanta, GA.
- Littlewood, B. (1978). How to measure software reliability, and how not to ... 3rd International Conference on Software Engineering 10-12 May, Atlanta, GA.
- Littlewood, B. (1978). Computer software reliability measurement. Thirteenth Annual Conference in Statistics, Computer Science, and Operations Research, ISSR March, Cairo University, Egypt.
- Littlewood, B. (1977). Software reliability measurement: some criticisms and suggestions. Conference on Software Life Cycle Management 22-23 August, Airlie, VA.
- Littlewood, B. (1976). A semi-Markov model for software reliability with failure costs. MRI Symposium on Computer Software Engineering 20-22 April, New York.
- Littlewood, B. (1975). A reliability model for Markov structured software. International Conference on Reliable Software 21-23 April, Los Angeles, California.
- Littlewood, B. and Verrall, J.L. (1973). A Bayesian reliability growth model for computer software. 1973 IEEE Symposium on Computer Software Reliability 30 Apr 1973 – 2 May 1973, New York.
Exhibition
- Littlewood, B. and Haines, T. (1990). Computer Safety. 24 October, BBC Television, Channel 2 (Edition of Antenna).
Journal articles (67)
Reports (7)
- Littlewood, B. and Povyakalo, A. (2012). Conservative bounds for the pfd of a 1-out-of-2 software-based system based on an assessor’s subjective probability of 'not worse than independence'. London: Centre for Software Reliability, City University London.
- Littlewood, B. and Povyakalo, A. (2012). Conservative reasoning about epistemic uncertainty for the probability of failure on demand of a 1-out-of-2 software-based system in which one channel is “possibly perfect”. London: Centre for Software Reliability, City University London.
- Littlewood, B., Bainbridge, I., Bloomfield, R.E. and et al, (1998). The use of computers in safety-critical applications. London, UK: Health and Safety Commission. ISBN 0-7176-1620-7.
- Fenton, N.E., Littlewood, B., Neil, M., Strigini, L., Wright, D.R. and Courtois, P.J. (1997). Bayesian belief network model for the safety
assessment of nuclear computer-based Systems. Brussels: DeVa ESPRIT Long Term Research Project. - Littlewood, B. and Wright, D. (1996). Some conservative stopping rules for the operational testing of saftey-critical software. Brussels: DeVa ESPRIT Long Term Research Project.
- Littlewood, B. and Wright, D. (1996). Reliability prediction of a software product using testing data from other products or execution environment. Brussels: DeVa Project.
- Littlewood, B. (1984). Predictive ability of software reliability models..
Other
- Littlewood, B. and CSR, (1970). Software Reliability and Metrics Program.