Detecting Agile BS: Lessons from the US Department of Defense

Published on
6 minute read

The concept of Agile has taken the business world by storm, with organizations everywhere claiming to have adopted Agile methodologies. But are they truly practicing Agile, or is it just Agile in name only? One of the most eye-opening resources on this topic comes from an unexpected source—the US Department of Defense (DoD). Their guide, titled “Detecting Agile BS,” was created to help procurement officers determine whether vendors were genuinely Agile or merely paying lip service to the methodology. This guide raises important questions that every organization claiming to be Agile should ask itself.

The Rise of Agile in Procurement

In 2013, the US Department of Defense made a significant shift in their procurement terms, requiring iterative and incremental delivery of products and systems. This was a bold move, intended to align their processes with Agile principles. However, this shift led to an immediate response from vendors: suddenly, everyone was “Agile.” The problem? Many of these vendors were far from practicing true Agile. They declared themselves Agile overnight, without making the necessary changes to their processes, culture, or mindset.

Are Organizations Really Agile?

This phenomenon isn’t limited to defense contractors. As someone who has worked with various organizations over the years, I’ve seen this pattern repeated time and again. Many organizations claim to be Agile, but in reality, they are not. It’s a harsh truth, but one that needs to be addressed if we are to improve and truly embrace the Agile way of working.

The Six Questions to Detect Agile BS

The DoD’s guide provides six crucial questions that serve as a litmus test to determine whether an organization is genuinely Agile. These questions are designed to cut through the noise and get to the heart of whether an organization is delivering on the promises of Agile. Let’s dive into each of these questions and why they matter.

Question 1: Are Teams Delivering Working Software to Real Users Every Iteration?

This is the first and arguably most important question. Are your teams delivering working software to at least some subset of users every iteration, including the first? And are they gathering feedback from those users?

  • Continuous Delivery: True Agile teams deliver working software frequently—every iteration. This means no User Acceptance Testing (UAT) or test environments—real, live production users.

  • User Feedback: Gathering feedback from these users is critical. Without it, you’re flying blind, unable to adapt to user needs and preferences.

Challenges and Benefits of Continuous Delivery

Achieving this level of agility is not easy. Many teams struggle to create working products in every iteration, let alone deliver them to production. However, the benefits are undeniable. Organizations that adopt continuous delivery see significant improvements in product quality and customer engagement.

Why it’s worth it:

  • Higher product quality.

  • Greater customer engagement.

  • Once you achieve continuous delivery, no organization has ever chosen to go back.

However, reaching this stage requires significant investment in both technical skills and leadership commitment.

Question 2: Are Teams Regularly Releasing to Production?

This question complements the first. It’s not enough to deliver working software to users; you must also release it to production regularly. The Agile Manifesto emphasizes the importance of delivering frequently, with a preference for shorter timeframes.

  • Scrum Guidelines: The Scrum Guide recommends releasing to production at least every 30 days. If your organization isn’t doing this, you’re not fully embracing Agile.

  • Investment Required: Achieving this requires changes to your business practices and a commitment to continuous improvement.

Question 3: Are Teams Adapting Based on Feedback?

Agile is all about adaptability. Are your teams regularly adjusting their approach based on the feedback they receive? This requires a culture of openness, where feedback is valued and acted upon.

Question 4: Is There a Clear Product Vision?

Without a clear product vision, it’s impossible to prioritize effectively. Agile teams need to have a shared understanding of what they are trying to achieve and why. This vision guides their work and helps them make decisions that align with the organization’s goals.

Question 5: Are Teams Empowered to Make Decisions?

Empowerment is a core principle of Agile. Are your teams empowered to make decisions about their work? Or are they constantly seeking approval from higher-ups? True Agile teams have the autonomy to make decisions that impact their work, allowing them to move quickly and respond to changes.

Question 6: Is There a Culture of Continuous Improvement?

Finally, Agile is about continuous improvement. Is your organization committed to regularly reviewing and improving its processes? This requires a mindset of experimentation and learning, where teams are encouraged to try new things and learn from their experiences.

Why Honesty About Your Agile Maturity Matters

If your organization can’t honestly answer “yes” to each of these six questions, then it’s time for some serious self-reflection. Claiming to be Agile without truly practicing it does more harm than good. It creates a false sense of security and prevents real change from happening.

Self-Reflection as a Path to Growth

It’s important to approach this process with humility and a genuine desire to improve. No organization is perfect, and Agile is a journey, not a destination. Use these questions as a tool for self-assessment, and don’t be afraid to acknowledge where you fall short. Only by being honest about your current state can you begin to make meaningful progress.

Practical Steps to Improve Your Agility

  • Start small: Don’t try to change everything at once. Focus on one or two areas where you can make a real impact.

  • Invest in training: Equip your teams with the skills they need to succeed in an Agile environment.

  • Foster a culture of feedback: Encourage open communication and make it safe for team members to share their thoughts and ideas.

Conclusion: Embrace the Challenge

Adopting true Agile practices is challenging, but the rewards are well worth the effort. The US Department of Defense’s guide to detecting Agile BS is a powerful tool for any organization looking to assess and improve its Agile maturity. By asking the right questions and being honest about where you stand, you can begin to make the changes necessary to truly embrace Agile.

Remember, Agile is not just a set of practices—it’s a mindset. It requires a commitment to continuous improvement, a willingness to adapt, and the courage to be honest about where you are on your Agile journey. So, take the time to reflect on these questions, and use them as a guide to help your organization grow and thrive in the world of Agile.

  • 🎯 Pro tip: Regularly revisit these questions as your organization evolves. Agile is a journey, and these questions can help you stay on the right path.

  • 🚀 Take action: Start by focusing on one area where you can improve, and build momentum from there.

Agile isn’t easy, but with the right mindset and approach, it’s achievable. And once you get there, you’ll never want to go back.

Increment Working Software Business Agility People and Process Agile Product Management Agile Leadership Product Delivery Agile Product Operating Model Agile Values and Principles Value Delivery

Connect with Martin Hinshelwood

If you've made it this far, it's worth connecting with our principal consultant and coach, Martin Hinshelwood, for a 30-minute 'ask me anything' call.

Our Happy Clients​

We partner with businesses across diverse industries, including finance, insurance, healthcare, pharmaceuticals, technology, engineering, transportation, hospitality, entertainment, legal, government, and military sectors.​

Lean SA Logo
Flowmaster (a Mentor Graphics Company) Logo
DFDS Logo
Illumina Logo
Workday Logo
Bistech Logo
YearUp.org Logo
Alignment Healthcare Logo
Milliman Logo
Akaditi Logo
Jack Links Logo
Qualco Logo
Schlumberger Logo
Slicedbread Logo
Big Data for Humans Logo
Lockheed Martin Logo
MacDonald Humfrey (Automation) Ltd. Logo
Higher Education Statistics Agency Logo
Royal Air Force Logo
Ghana Police Service Logo
Nottingham County Council Logo
Washington Department of Transport Logo
Department of Work and Pensions (UK) Logo
Washington Department of Enterprise Services Logo
Boeing Logo
DFDS Logo
Schlumberger Logo
Alignment Healthcare Logo
Brandes Investment Partners L.P. Logo
ProgramUtvikling Logo