The Nokia Test is in two parts.
First, are you doing Iterative Development?
- Iterations must be timeboxed to less than 4 weeks
- Software features must be tested and working at the end of each iteration
- The Iteration must start before specification is complete
The next part of the test checks whether you are doing Scrum (in Nokia's opinion):
- •You know who the product owner is
- •There is a product backlog prioritized by business value
- •The product backlog has estimates created by the team
- •The team generates burndown charts and knows their velocity
- •There are no project managers (or anyone else) disrupting the work of the team
I think this is an excellent way to deal with Cowboy Agile or Agilefall.
Let me say this loud and clear: a firm can't in good faith say "we tried Scrum" and then move away from it if they never had any teams that could pass the Nokia test. And pass for a reasonable period of time. Of course they could say "we tried Scrum", but they did not.
The Nokia Test is demanding. That is clear. But a test of this nature is a necessary (if not sufficient) condition to doing professional agile software development. (Or did we expect to get out of Fred Brooks' tar pit by doing unprofessional software development?)
There are some forces in a firm that want to do Cowboy Agile or Agilefall or want Agile to fail ("it's moving my cheese"). This is true in every firm that I have worked in, I believe. So, if you use the Nokia Test, expect to get some resistance.
The Nokia Test is arguably too minimal. There are many other important parts of Agile or Scrum that it does not cover. Are the things in the test the most important parts? My thought is that this collection of principles and practices provides a good core of Agile/Scrum that will defend you from the most common dysfunctions. Not all. Is there a better test? Probably we could define one, but let's pass the Nokia Test now.
Should the test be significantly more detailed? I think not. First, to work with any test, we need the test to be simple enough to be comprehended easily by most of the people involved. In this way, it becomes self-policing. Second, Agile/Scrum needs to be adaptive, so having a lengthy test that puts all teams in the same straight-jacket would noticeably limit that adaptability.
What are your thoughts? Are you aware of similar tests? How does your firm limit Cowboy Agile?
18 comments:
I would see one valuable addition to the second part of the test:
The team must hold retrospectives at the end of each iteration and the resulting "try" items must have an impact on the next iteration(s).
Feedback is a very important aspect of all agile methods and Scrum in particular, IMHO.
Hi Wolfgang,
I have appreciated your posts elsewhere. And agree with your post.
As a minor quibble...When I see the word "try" I always think of that Star Wars film where Yoda says, "There is no try; there is only do or not do." So I would call them "action items" or perhaps "experiments".
Having said that, I think there is a big advantage to coaches to say "this is someone else's test". (Yes, I am an Agile Coach.) So I hesitate to modify the Nokia Test for that reason alone. Unless it became in truth the "Google Test" or something similar.
Thanks, Joe
Joe, in your last comment is "Google Test" as defined in Urban Dictionary or ...? Sorry for being ignorant!
Aha! Yes, I do that "google test" all the time, but I was not referring to that. What I meant was...if Google itself came up with a different (maybe slightly more comprehensive test for Agile/Scrum, that might be better (more useful) than the Nokia Test. If Joe Little came up with an Agile/Scrum test, I don't think it would have the same power to influence others.
On the thought about a more detailed assessment and not to muddy the waters, but Mike Cohn and Kenny Rubin developed an Agile assessment survey that teams/projects/individuals could take. I thought that part of the attraction was some kind of assessment after you completed the survey. I do not have the URL sorry.
Hi,
Good thought. I have worked with a similar assessment (at least I guess it is similar), where we asked a team a bunch of questions. Good feedback for the team, and a good learning experience for them. Perhaps I will post that assessment form shortly.
But I view the Nokia Test differently. One of its chief values is that it is not a test "I" created. It comes from a well-known and successful company. So, it has a kind of influence "my" assessment (or even Mike's and Kenny's) could never have. (Mind you, Mike would have a lot of influence on me, but others might say he is an Agile "insider" and "not in touch with our real-world". Not that I would agree with those comments, but they would indicate that Mike's influence is limited with those people.)
Thanks, Joe
I totally understand about providing something that provides an independent, recognized way for the assessment. In my company, we have been developing our own detailed assessment, and also reviewing independent measures for the same reasons. :)
Cheers,
-Lyndon-
Hi Lyndon,
Aha! I for one would be very interested to hear what you all are thinking. And doing. Please share when you can.
And perhaps you are with a firm that is well-known in its industry. But, as you say, that is not required by every audience.
Thanks, Joe
who told you that nokia uses this test :-)
Bas Vodde. Bas also commented recently that the Test is not used as much, since everyone is already compliant. However, Nokia is a big firm, and "everyone" is probably too much to say. In my experience, people don't conform to any standard with consistency over time. But this all does not, in my opinion, affect the rightness of the Nokia Test.
Well, there is always the Joel Test, 12 steps to better code: http://www.joelonsoftware.com/articles/fog0000000043.html
Hi Martin,
Well, not sure about the Joel Test. I can see someone having his pet peeves, but it strikes me as that, not a well-considered, consistent or proven set of considerations to quickly judge if a team is on track.
Not sure that the Nokia Test is fully proven either. (Although Scrum is, in my book.) But it does seem coherent (the pieces stick together). And the core of iterative/scrum. And Scrum is proven, so indirectly the Nokia Test is proven. Also, the Nokia Test has "passed muster" at a great firm (or five). Not sure if the Joel Test has.
My opinion so far. Or give me more facts or reasons to view things differently.
Thanks.
Hi, you’ve got an interesting blog. I like it and I like Nokia. I had several cell phones and Nokia turned out to be the best of them. Although they say it is one of the most harmful phones in terms of human health but still it is great. On this great site www.pissedconsumer.co I read a lot about the company and its products feedbacks.
Well said.
Thanks for the compliment. And kudos are passed on to Bas Vodde and Jeff Sutherland, who have done lots of work on the Nokia Test.
Regards, Joe
Hi, I'm writing my bachelor essay about Scrum and is wondering if there is any references from studies or journals about the test. I'm having problems finding any... Please email me.
Hi JP,
You ask a good question...although as a scientist (amateur) I need to clarify your hypothesis.
As to the Nokia Test itself, I think there have been a few unscientific (although probably still reasonably accurate) test of it. In the form of asking people how well do they comply with it. The answers seems to be low, on average. And, according to Jeff Sutherland, me and others, the lowest are probably getting minimal benefit; low to medium, some benefit from Scrum; high, often getting great benefits from Scrum.
In other words: we knew this, the Nokia Test is helping a bit, but we really need a truly scientific (albeit modest) test of the Nokia Test.
If your hypothesis is more about Scrum itself, then I can tell you that the overwhelming anecdotal evidence is that it works. Much as I said above. Here, we have many documented case studies, but we need many many more. And we need more truly scientific studies that "prove" that Scrum works.
Go to the Yahoo group scrumdevelopment and ask your question. Also, send me an email and I can help a bit more.
Regards, Joe
You were asking at some point if this test should be more detailed. I think not because it doesn't test HOW is Scrum doing, but rather if it IS Scrum or NOT.
Post a Comment