KPMG LLP is the US firm of the KPMG global organization of independent professional services firms providing advisory, tax, and audit services. KPMG firms operate in 143 countries and territories serving some of the top Fortune 500 companies around the world. KPMG IT Services has deployed GitHub Copilot, an AI programmer tool that helps application developers write code faster with higher-quality results. KPMG Advisory Services also helps clients adopt GitHub Copilot to improve developer experiences, reduce costs, and improve code resiliency. KPMG and its clients have lacked visibility into the adoption of GitHub Copilot across development teams and do not have access to productivity measures that highlight the effectiveness of GitHub Copilot usage.

The creation of a GitHub Copilot adoption insights dashboard enables KPMG and its clients to have real-time access to the current number of GitHub Copilot users by persona, highlighting the benefits of GitHub Copilot adoption with detailed usage information that includes the programming languages most frequently used by developers when leveraging GitHub Copilot. KPMG can bring services, experience and accelerators to help our clients configure a GitHub Copilot adoption insights dashboard reducing the time required to visualize GitHub Copilot adoption metrics and associated benefits. The dashboard accelerators are built to work with survey-based data and data that is extracted from GitHub Copilot.

As organizations adopt GitHub Copilot to improve developer experiences and increase productivity and code quality, it is essential to monitor GitHub Copilot usage and adjust as developers become more proficient in their use of GitHub Copilot. The insights provided in this dashboard help GitHub Copilot communities of practice to prioritize the creation of GitHub Copilot documentation and training material in a way that further increases the potential benefits of GitHub Copilot adoption.

As organizations adopt GitHub Copilot, it is important to get feedback from users to understand what is working well and where improvements can be made. This feedback from GitHub Copilot users can be used by the GitHub Copilot community of practice to update training material and documentation to improve developer experiences.

In addition to insights related to use case popularity, the dashboard highlights the time saved by different personas who use GitHub Copilot to complete activities across the software development lifecycle.

GitHub has published an API that provides a daily breakdown of aggregated usage metrics for GitHub Copilot code completions and GitHub Copilot Chat usage across integrated development environments (IDEs) for all users within an enterprise, with a further breakdown of suggestions, acceptances, and number of active users by editor and language for each day. KPMG accelerators and services use data from the GitHub Copilot API to generate insights related to GitHub Copilot usage by developers based on the application development languages that are used across the organization. The GitHub Copilot usage by application development language allows organizations to customize training programs to help developers become more proficient. The dashboard also includes data from GitHub that is used to compare application development languages used within an organization with the most common application development languages across GitHub clients.

GitHub Copilot chat is an interface that enables developers and other resources to interact with GitHub Copilot by asking and receiving answers to coding-related questions within supported IDEs. The chat interface provides access to coding information and support without requiring developers to navigate documentation or search online forums. The KPMG GitHub Copilot adoption insights dashboard provides a view of the programming languages that are used most frequently by users of GitHub Copilot chat. In addition to the programming languages, the dashboard also shows the IDEs that developers are using when leveraging GitHub Copilot chat capabilities. GitHub Copilot chat acceptance rates and chat turns are measured to allow organizations to monitor the effectiveness of GitHub Copilot chat.

KPMG has identified additional metrics that can be used to measure the benefits of GitHub Copilot. Each metric is connected to common activities performed across the software development lifecycle, and KPMG has estimated the benefits related to each metric (high, medium, or low).