Articles
6/27/2022
10 minutes

Copado’s Third Annual State of Salesforce DevOps Report Finds Teams Recovered from Last Year’s Dip in Quality but Struggle to Maintain Speed

Written by
Team Copado
Table of contents

The longest running Salesforce DevOps report shows teams rebounding to pre-pandemic levels for change fail rate and time to recover

Research shows how high-performing teams use commercial low-code DevOps tools to release more often, recover faster and achieve business value

Chicago – June 28, 2022Copado, the global leader in low-code DevOps, today released the findings from its third annual “State of Salesforce DevOps” report, which collects data and insights on the key trends in low-code software delivery. Based on thousands of data points collected from over 450 global Salesforce customers using DevOps to accelerate and improve the speed and quality of their implementations, the report highlights the improvement in quality, examines the possible causes of the decline in velocity, identifies the qualities of the teams that are thriving, and makes recommendations on how teams can maximize their development resources.

Adopting key principles from DORA, the report analyzed performance across Salesforce teams in terms of the dual goals of innovation velocity and release quality and security. Using the four metrics of lead time for change, deployment frequency, change failure rate and mean time to recovery, the report categorized respondents into four performance profiles that can be used to identify and measure the characteristics of both high and low performance. Key takeaways from the Copado 2022 State of Salesforce DevOps report include:

Quality-first DevOps is increasing

The 2021 report found a significant reduction in quality and stability as evidenced by increased change failure rate and mean time to recover. Copado attributed that to the 2020 COVID pandemic and the ensuing disruption to team workflows. In 2022, that trend seems to have reversed, with stability returning to the 2019 levels. Teams showed 8x shorter time to restore (96 hours in 2021 compared to 12 hours in 2022) and reported 50% lower change fail rate (38% in 2021 compared to 20% in 2022). In 2022, the change failure rates and recovery times were roughly the same as in 2019.

Salesforce teams tapped the brakes in 2022

Teams may have overcompensated for stability over the last year by reducing their velocity. This year’s report shows a reduction in deployment frequency which dropped by half compared to the two previous years, from 475 per year to 230 per year on average. Elite performers continue to release faster with an average lead time of 8 days, compared to 50 days for low performers. Since 2019 the percentage of teams with lead times less than a week has declined from 69% to 49% and the number of users able to deploy on demand has shrunk from 23% to 10%. 

Overall, compared to low performers, elite performers have:

  • 4x shorter lead times
  • 46x more deployments, 94% of elite performers release at least weekly vs. only 13% of low performers
  • 5x fewer production failures
  • 8x faster time to recover, less than four hours for elite performers and more than 18 days for low performers

“The last three years of research has taught us a lot about the challenges that Salesforce teams face and where they excel,” said Andrew Davis, senior director of research and innovation at Copado. “Last year, the report showed the impact of a global pandemic and shift to remote work on the ability to ensure quality and stability. This year we’ve seen quality and stability trends bounce back. This points to the resilience and commitment of the community of Salesforce developers, admins, and business users who find a way. We’ve reached a point in time where the level of customization that can be built into the Salesforce platform makes it necessary to adopt DevOps tools and practices to manage software delivery well.”

Salesforce teams continue to grow in size and complexity

For the second year in a row, Copado found that Salesforce teams are growing. This year, 46% of respondents report that their teams have grown, 41% have remained steady and just 13% report their team decreased in size. The continued growth in the size of development teams means a continued increase in the complexity of the Salesforce orgs they are building. For the third year in a row, Copado found a strong correlation between team size and lead time. This year, there was also a correlation between team size and change failure rate and time to recover. All of these metrics worsened as teams grew in size. Traditional use cases for low-code application development have been largely for internal business applications with limited business impact. In 2022, 72% of respondents use Salesforce for building internal applications, but now 60% are using the platform to build business-critical apps, and 66% are using the platform to build customer-facing apps, while 37% are building all three types. A much more rigorous release process should be applied to customer-facing and business-critical applications than needs to be applied to internal business apps. It should also be noted that these types of apps are usually much more sophisticated than internal apps.

Performance improves with commercial low-code DevOps tools

Low-code application development on Salesforce is the fastest way to translate ideas into innovation, but without enterprise software delivery capabilities in place, the power of low-code is undone by quality issues, manual processes and orchestration challenges. The report found that teams using DevOps tools designed specifically for Salesforce release 50% more frequently than teams using build-your-own platforms like Jenkins. Copado also found that those who are highly involved in Enterprise Agile Planning (74% of respondents) and also use a commercial Salesforce tool for DevOps are 39% more likely to work at a company that is exceeding its goals. Given the current economic environment and growing importance of proving ROI and value realization for technology investments, teams that are investing in process improvements are better able to ensure that they’re getting the greatest benefit.

Change failure rates can be reduced with automated testing

Teams need to shift to faster, more automated ways of ensuring quality. Automated testing of Salesforce applications is an opportunity area now that the Salesforce platform is used more often for external customer-facing and business-critical applications. Yet if there is any testing in the development process, manual testing is the most common method. One-third of Salesforce development teams use manual testing, 29% have minimal to no testing and 21% automate critical tests, while only 19% are practicing test-driven development. 

“In combination with the power, scalability, and robustness of enterprise cloud platforms like Salesforce, DevOps gives organizations a competitive edge in delivering compelling capability, safely, while still achieving and maintaining winning speed,” said Peter Coffee, of Salesforce. “Building software without the aids, and the practices, of DevOps will be like trying to compete in a Grand Prix while rebuilding the transmission for every shift of gears. Additionally, the expectations of software safety and reliability have hugely grown since the time when ‘computer error’ was a routine and tolerated excuse. There is growing demand for making consistent and thorough testing of software as automatic and effortless as it can possibly be.”

The full report can be found here

Methodology

Copado surveyed over 450 executives, managers, and members of Salesforce delivery teams to learn about their development lifecycles. Conducted in April 2022, the survey included companies ranging in size from one employee to more than 1 million employees. Sixty percent of these companies have more than 500 Salesforce users. The goal was to better understand the challenges of innovating on the Salesforce platform. The analysis was done on the Tableau Analytics platform including data visualization, cross tab analysis, and core BI. 

Follow Copado

LinkedIn: https://www.linkedin.com/company/copado-solutions-s.l/

Twitter: https://twitter.com/CopadoSolutions

Blog: https://www.copado.com/learning/blog/

About Copado

Copado is the leading DevOps and testing solution for low-code SaaS platforms that run the world’s largest digital transformations. Backed by Insight Partners, Salesforce Ventures and SoftBank Vision Fund, Copado accelerates multi-cloud, enterprise deployments by automating the end-to-end software delivery process to maximize customers' return on their cloud investment. More than 1,000 companies rely on Copado to drive digital transformation with speed, quality and value including Boston Scientific, Coca-Cola, Fair Trade, Linde, MassMutual, Schneider Electric and Shell. Copado DevOps 360™ processes over 50 million DevOps transactions per month and is rated with a 100% score on the Salesforce AppExchange. More information can be found at: http://www.copado.com.

 

Book a demo

About The Author

#1 DevOps Platform for Salesforce

We build unstoppable teams by equipping DevOps professionals with the platform, tools and training they need to make release days obsolete. Work smarter, not longer.

Making DevOps Easier and Faster with AI
Chapter 5: Automated Testing
Reimagining Salesforce Development with Copado's AI-Powered Platform
Planning User Acceptance Testing (UAT): Tips and Tricks for a Smooth and Enjoyable UAT
What is DevOps for Business Applications
Copado Integrates Powerful AI Solutions into Its Community as It Surpasses the 100,000 Member Milestone
Testing End-to-End Salesforce Flows: Web and Mobile Applications
How to get non-technical users onboard with Salesforce UAT testing
DevOps Excellence within Salesforce Ecosystem
Best Practices for AI in Salesforce Testing
6 testing metrics that’ll speed up your Salesforce release velocity (and how to track them)
Chapter 4: Manual Testing Overview
AI Driven Testing for Salesforce
AI-powered Planning for Salesforce Development
Chapter 3: Testing Fun-damentals
Salesforce Deployment: Avoid Common Pitfalls with AI-Powered Release Management
Exploring DevOps for Different Types of Salesforce Clouds
Copado Launches Suite of AI Agents to Transform Business Application Delivery
What’s Special About Testing Salesforce? - Chapter 2
Why Test Salesforce? - Chapter 1
Continuous Integration for Salesforce Development
Comparing Top AI Testing Tools for Salesforce
Avoid Deployment Conflicts with Copado’s Selective Commit Feature: A New Way to Handle Overlapping Changes
From Learner to Leader: Journey to Copado Champion of the Year
Enhancing Salesforce Security with AppOmni and Copado Integration: Insights, Uses and Best Practices
The Future of Salesforce DevOps: Leveraging AI for Efficient Conflict Management
A Guide to Using AI for Salesforce Development Issues
How to Sync Salesforce Environments with Back Promotions
Copado and Wipro Team Up to Transform Salesforce DevOps
DevOps Needs for Operations in China: Salesforce on Alibaba Cloud
What is Salesforce Deployment Automation? How to Use Salesforce Automation Tools
Maximizing Copado's Cooperation with Essential Salesforce Instruments
Future Trends in Salesforce DevOps: What Architects Need to Know
From Chaos to Clarity: Managing Salesforce Environment Merges and Consolidations
Enhancing Customer Service with CopadoGPT Technology
What is Efficient Low Code Deployment?
Copado Launches Test Copilot to Deliver AI-powered Rapid Test Creation
Cloud-Native Testing Automation: A Comprehensive Guide
A Guide to Effective Change Management in Salesforce for DevOps Teams
Building a Scalable Governance Framework for Sustainable Value
Copado Launches Copado Explorer to Simplify and Streamline Testing on Salesforce
Exploring Top Cloud Automation Testing Tools
Master Salesforce DevOps with Copado Robotic Testing
Exploratory Testing vs. Automated Testing: Finding the Right Balance
A Guide to Salesforce Source Control
A Guide to DevOps Branching Strategies
Family Time vs. Mobile App Release Days: Can Test Automation Help Us Have Both?
How to Resolve Salesforce Merge Conflicts: A Guide
Copado Expands Beta Access to CopadoGPT for All Customers, Revolutionizing SaaS DevOps with AI
Is Mobile Test Automation Unnecessarily Hard? A Guide to Simplify Mobile Test Automation
From Silos to Streamlined Development: Tarun’s Tale of DevOps Success
Simplified Scaling: 10 Ways to Grow Your Salesforce Development Practice
What is Salesforce Incident Management?
What Is Automated Salesforce Testing? Choosing the Right Automation Tool for Salesforce
Copado Appoints Seasoned Sales Executive Bob Grewal to Chief Revenue Officer
Business Benefits of DevOps: A Guide
Copado Brings Generative AI to Its DevOps Platform to Improve Software Development for Enterprise SaaS
Celebrating 10 Years of Copado: A Decade of DevOps Evolution and Growth
Copado Celebrates 10 Years of DevOps for Enterprise SaaS Solutions
5 Reasons Why Copado = Less Divorces for Developers
What is DevOps? Build a Successful DevOps Ecosystem with Copado’s Best Practices
Scaling App Development While Meeting Security Standards
5 Data Deploy Features You Don’t Want to Miss
Top 5 Reasons I Choose Copado for Salesforce Development
How to Elevate Customer Experiences with Automated Testing
Getting Started With Value Stream Maps
Copado and nCino Partner to Provide Proven DevOps Tools for Financial Institutions
Unlocking Success with Copado: Mission-Critical Tools for Developers
How Automated Testing Enables DevOps Efficiency
How to Keep Salesforce Sandboxes in Sync
How to Switch from Manual to Automated Testing with Robotic Testing
Best Practices to Prevent Merge Conflicts with Copado 1 Platform
Software Bugs: The Three Causes of Programming Errors
How Does Copado Solve Release Readiness Roadblocks?
Why I Choose Copado Robotic Testing for my Test Automation
How to schedule a Function and Job Template in DevOps: A Step-by-Step Guide
Delivering Quality nCino Experiences with Automated Deployments and Testing
Best Practices Matter for Accelerated Salesforce Release Management
Maximize Your Code Quality, Security and performance with Copado Salesforce Code Analyzer
Upgrade Your Test Automation Game: The Benefits of Switching from Selenium to a More Advanced Platform
Three Takeaways From Copa Community Day
Cloud Native Applications: 5 Characteristics to Look for in the Right Tools
Using Salesforce nCino Architecture for Best Testing Results
How To Develop A Salesforce Testing Strategy For Your Enterprise
What Is Multi Cloud: Key Use Cases and Benefits for Enterprise Settings
5 Steps to Building a Salesforce Center of Excellence for Government Agencies
Salesforce UI testing: Benefits to Staying on Top of Updates
Benefits of UI Test Automation and Why You Should Care
Types of Salesforce Testing and When To Use Them
Copado + DataColada: Enabling CI/CD for Developers Across APAC
What is Salesforce API Testing and It Why Should Be Automated
Machine Learning Models: Adapting Data Patterns With Copado For AI Test Automation
Automated Testing Benefits: The Case For As Little Manual Testing As Possible
Beyond Selenium: Low Code Testing To Maximize Speed and Quality
UI Testing Best Practices: From Implementation to Automation
How Agile Test Automation Helps You Develop Better and Faster
Salesforce Test Cases: Knowing When to Test
DevOps Quality Assurance: Major Pitfalls and Challenges
11 Characteristics of Advanced Persistent Threats (APTs) That Set Them Apart
7 Key Compliance Regulations Relating to Data Storage
Go back to resources
There is no previous posts
Go back to resources
There is no next posts

Explore more about

No items found.
Articles
December 6, 2024
Making DevOps Easier and Faster with AI
Articles
November 19, 2024
Chapter 5: Automated Testing
Articles
November 18, 2024
Reimagining Salesforce Development with Copado's AI-Powered Platform
Articles
November 8, 2024
Planning User Acceptance Testing (UAT): Tips and Tricks for a Smooth and Enjoyable UAT

Activate AI — Accelerate DevOps

Release Faster, Eliminate Risk, and Enjoy Your Work.
Try Copado Devops.

Resources

Level up your Salesforce DevOps skills with our resource library.

Upcoming Events & Webinars

Learn More

E-Books and Whitepapers

Learn More

Support and Documentation

Learn More

Demo Library

Learn More