Learn how to innovate at startup speed in a software-driven world.
The Built to Adapt Benchmark is a quantitative framework of indicators that gauges how well an organization builds, deploys, and operates software. Pivotal collaborated with Longitude Research and Ovum to assess the world’s top organizations with more than 1,600 respondents across six countries and five industries. The research explores how organizations align their product development and IT operations with business goals to build software that delivers desirable outcomes.
Measure your organization's performance by filling out the online Benchmark questionnaire.
Overall Key Findings
Leading organizations use a modern approach to deploy software more frequently.
On average, 39% of organizations polled globally deploy code on a continuous, hourly, or daily basis. In contrast, 40% only deploy code on a monthly, quarterly, or annual basis.
Cloud applications perform better—and are easier to manage.
Building for the cloud allows applications to scale easily. Of the organizations polled globally, 37% reported their apps were built, or have been refactored, to run in the cloud.
Security disruptions delay application release.
In the last year, 33% of US organizations surveyed (compared with 21% globally) delayed application releases more than 11 times due to security concerns.
The Overall Rankings
Researchers surveyed 1,659 IT executives, managers, and developers across five industries about their software development practices. Responses were scored from 1 to 10 on each indicator, with 10 representing best software development practices, and 1 representing inefficient practices. These rankings present a focused rather than comprehensive view of software development capabilities, which is reflected in the relatively close total scores.
Explore the Overall Data
Which of these statements best describes your organization's annual IT budget?
Approximately what percentage of the annual IT budget is set aside for ad-hoc software development projects?
Designing the Built to Adapt Benchmark
Built on Pivotal's extensive experience working with world-leading disruptors and established organizations, the Built to Adapt Benchmark aims to provide a framework for assessing and discussing the performance of organizations, markets, or industries. This framework is based on widely accepted standards of best practice.
Performed in collaboration with Longitude and Ovum, the research assessed organizations in six markets: the United States, the United Kingdom, Germany, Australia, Japan, and Singapore, and across five industries—automotive, banking, insurance, retail, and telecoms.
Assessments were based on interviews with 1,659 IT executives, managers, and developers working at organizations with more than 90% reporting an annual revenue exceeding $100 million USD, conducted between September 2017 and June 2018. Job titles were limited to: CIO, CTO, CISO, Chief Digital Officer, Head of Software Development and IT Director, as well as IT Manager and IT Engineer.
Responses were scored from 1 to 10 on each indicator, with 10 representing best software development practices, and 1 representing inefficient practices.
To derive the final index ranking, each survey question in each indicator was weighted to ensure equal representation and validity.
Samples and Margins of Error
The sampling frame has been designed so that results are comparable by industry or by country. The margin of error for all industries is 5.4% at the 95% confidence level—except for automotive, which has a margin of error of 6.2%, due to a lack of automotive organizations in Australia and Singapore that reduced the overall sample. The margin of error by country ranges from 5.2% in the United States to 7.3% in Australia and 7.3% in Singapore at the 95% confidence level.