TY - JOUR T1 - COTS-based systems top 10 list JF - Computer Y1 - 2001 A1 - Basili, Victor R. A1 - Boehm,B. KW - activity;hypotheses;independently KW - capability;personnel KW - challenges;software KW - code KW - COTS-based KW - defect KW - delivery;glue KW - developed KW - development KW - development;high-risk KW - effort;products KW - effort;software KW - efforts;unused KW - experience;post-deployment KW - features;software KW - instructions;costs;development KW - integration;schedule KW - management;software KW - off-the KW - overruns;software KW - packages;software KW - productivity;early KW - products;personnel KW - quality; KW - reduction;software KW - releases;system KW - shelf KW - support;commercial KW - systems;active KW - systems;computer KW - vendor AB - Presents a COTS-based system (CBS) software defect-reduction list as hypotheses, rather than results, that also serve as software challenges for enhancing our empirical understanding of CBSs. The hypotheses are: (1) more than 99% of all executing computer instructions come from COTS products (each instruction passed a market test for value); (2) more than half the features in large COTS software products go unused; (3) the average COTS software product undergoes a new release every 8-9 months, with active vendor support for only its latest three releases; (4) CBS development and post-deployment efforts can scale as high as the square of the number of independently developed COTS products targeted for integration; (5) CBS post-deployment costs exceed CBS development costs; (6) although glue-code development usually accounts for less than half the total CBS software development effort, the effort per line of glue code averages about three times the effort per line of developed applications code; (7) non-development costs, such as licensing fees, are significant, and projects must plan for and optimize them; (8) CBS assessment and tailoring efforts vary significantly by COTS product class (operating system, database management system, user interface, device driver, etc.); (9) personnel capability and experience remain the dominant factors influencing CBS development productivity; and (10) CBS is currently a high-risk activity, with effort and schedule overruns exceeding non-CBS software overruns, yet many systems have used COTS successfully for cost reduction and early delivery VL - 34 SN - 0018-9162 CP - 5 M3 - 10.1109/2.920618 ER -