While artificial intelligence (AI) is seen as the ultimate productivity tool for software development, the impact of AI development tools on teams is still in its infancy.
These are takeaways from a recent report on DevOps trends, which is published by Google Cloud's DevOps Research and Assessment (DORA) team, and based on data from 36,000 technology professionals worldwide.
Also: Implementing AI into software engineering? Here's everything you need to know
It's common for experts to suggest these days that AI will deliver significant boosts to software development and deployment productivity, along with developer job satisfaction.
"So far our survey evidence doesn't support this," the report's authors, Derek DeBellis and Nathen Harvey, both with Google, state.
Also: Is AI in software engineering reaching an 'Oppenheimer moment'?
"Our evidence suggests that AI slightly improves individual well-being measures -- such as burnout and job satisfaction -- but has a neutral or perhaps negative effect on group-level outcomes such as team performance and software delivery performance."
These flat findings are likely due to the fact that we're still at the early stages of AI adoption, they surmise: "There is a lot of enthusiasm about the potential of AI development tools, as demonstrated by the majority of people incorporating at least some AI into the tasks we asked about. But we anticipate that it will take some time for AI-powered tools to come into widespread and coordinated use in the industry."
Also: Six skills you need to become an AI prompt engineer
Despite the limited impact of AI so far, the survey does identify the factors that are moving development shops forward. In their research, DeBellis and Harvey isolated a segment of "elite" professionals who are on top of their game. These professionals only require lead times of one day to make changes in applications, versus a week to a month at low-preforming shops. They can deploy software multiple times a day. They also report change-failure rates for buggy software of 5% or less. By contrast, those in low-preforming software shops have rates exceeding 60%.
While AI may help IT professionals in the future, there are best practices that the elite group is pursuing that are making a difference today. The co-authors identify those practices:
Contrary to widespread and deeply ingrained impressions, software developers do not work in isolation. Instead, they work in teams, and strive to focus on their business. The survey helps shed light on what's important for top-performing developers -- and AI is still more of a shiny object than a differentiator.