Project Management Blogs

From the Sponsor’s Desk - Avoiding New Technology Risks

In my last post, Collaboration in a Command and Control World, we looked at one project manager’s experience trying to guide a technology upgrade where the sponsor focused exclusively on time and costs.

In this post, we’ll look at the steps one project manager took to leverage a promising new technology while avoiding the pitfalls often encountered with new technology introductions. Thanks to reader A.R. for the details on this case.

The Situation

This U.S based financial services organization managed 401(k) plans for employees of small to medium size businesses. A 401(k) retirement savings plan allows a worker to save for retirement and have the savings invested while deferring current income taxes on the saved money and earnings until withdrawal.

The company’s product offerings allowed participating client employees to invest in a wide variety of popular mutual fund products. The client employees would call the company’s service staff to get quotes on funds and to place orders for new investments or changes to existing ones. The company had a web site that offered similar services but found that the volume of phone calls continued to increase with the growth in their business. It was posing an ever increasing cost burden on the organization.

While interactive voice response (IVR) technology is common today, in the early 21st century it was an emerging technology. However, because it held such promise to address their challenge, the company decided to take the plunge.

The Goal

The VP, Customer Service, the sponsor of the initiative, after discussions with the CIO and senior technical staff, decided to wade into the then largely uncharted IVR waters. She launched a project to leverage the new technology to reduce the current and growing costs of their phone services.

Her goal was to deliver an IVR system that would support the quote and trading functions for client employees across the country and have it fully operational in one year. She was looking for a 50% rate of conversion to IVR.

The Project

The IT organization appointed a seasoned project manager. Because the company had no experience in the IVR arena, he knew trying to estimate the costs of the project would have been a fool’s errand. They talked to a number of vendors and early users to know that an effective solution was possible. But the costs quoted varied widely. So he worked with the VP to figure out what she could afford by looking at the expected reduction in current costs and slowing the cost growth rate while offering the same or improved service levels. Her target - $1.2 million with a 70% IVR usage rate. That would give her a 2 year payback.

The project manager, working with an assigned business manager, the $1.2 million cost target and two of the most likely technology vendors, developed a plan of attack that included the following key elements:

  • Identify and engage key stakeholders
  • Get stakeholder agreement on the dimensions of the change. That included clarifying the opportunity for the company beyond this particular application, the specific goals, requirements, benefits, locations affected, desired or required target dates, anticipated volumes and phasing and staging opportunities from a business perspective.
  • Get stakeholder agreement on the quality expectations, including factors like security, authorization, ease of use, continuity, scalability, localization and audit trail.
  • Also, with the stakeholders, firm up the economic justification including the overall economic impact (business, IT, clients, others), competitive advantage, strategic fit, competitive risk and project risk.

With a fully developed picture of the project, its impact on the organization, and buy-in from the stakeholders, the PM assembled a small team including an experienced and respected staff member from the Customer Service organization, a business analyst, a programmer analyst and a senior technical analyst from the IT Operations group. Together they developed an RFP that went out to the two IVR vendors who had helped in the planning plus two additional vendors that showed promise based on feedback on the systems they had delivered.

When the RFP responses came back, the content was vetted, rated, ranked and their proposals assessed against the $1.2 million cost target. One company stood out (one of the two involved in the planning effort) and was approached to deliver the required solution. During the contract negotiations that followed, it was also decided to rely on the vendor to do the application development and maintenance rather than train up internal resources to develop the applications and maintain them after implementation. This would avoid the risks involved in having a critical technology service being supported by a too small internal talent pool.

Once the vendor was selected and on side, the project proceeded with a five stage plan:

  1. Develop an initial prototype focusing on the quotation function to test the integration of the technology into the company’s infrastructure and the required application interfaces and get stakeholder reaction to the speech recognition structure and sound.
  2. Implement the full quote capability in one region of the country to ensure the system’s ability to support the local accents, assess the willingness of their clients to use the new service and refine as needed to address any issues. In this first implementation, clients would be given a choice of using IVR or speaking to a Customer Service consultant as before.
  3. Roll out the quote capability across the country, region by region, assessing support for local accents and degree of use in each region and refine as necessary. The choice to use IVR or speak to a person would continue to be offered.
  4. Develop and implement the full IVR trading capability and implement in one selected region as before to gauge effectiveness and appeal and revise as necessary.
  5. Roll out the full trading solution across the country, one region at a time, refining as necessary.

The Results

The project was a terrific success. It was fully deployed across the country in 11 months at a cost of $1.1 million with IVR utilization at 75% and rising. Customer feedback was very positive, especially because of the extended 24 hour phone service window using IVR versus the old 12 hour service period.

The staged rollout allowed the vendor to tweak the application to be more sensitive to local accents and adapt the structure and content of the menus and messages to improve responsiveness, based on feedback. It also allowed the organization to target clients and employees in the region being implemented to introduce the new IVR service, encourage client employees to use it and explain how to address problems and provide feedback.

The staged rollout gave the business the ability to redeploy the Customer Service staff gradually over the 6 month rollout period, reducing the anxiety that is a normal part of business and technology change. Also, it gave the IT organization the time needed to integrate the new IVR technology into their infrastructure and operations and refine the application interfaces to improve IVR responsiveness. And, all of the stakeholders were thrilled with the outcome. It was a project well done!

How a Great PM Succeeded

This project manager did a number of things right:

  • He leveraged Project Pre-Check’s three building blocks (even though he had never heard of Project Pre-Check).
    • He identified and engaged the key stakeholders, including the vendor and the clients.
    • He took them through a structured process that enabled them to stay interested and involved, allowed them to provide their expertise to the project from inception through completion and confirmed their agreement with decisions made at each stage of the project.
    • Finally, he leveraged best practices (the equivalent of Project Pre-Check’s Decision Framework) to ensure the factors that should be addressed to ensure success were, in fact, addressed.
  • The staged, iterative approach he took to implementation effectively avoided the risks of a big bang approach and allowed the vendor and project team to adjust the applications, the environment and the internal practices based on real world experience.
  • His work with the sponsor to help her figure out how much she could afford to spend on the project to achieve her financial and service goals (it’s call ‘Worth’ in Project Pre-Check’s Decision Framework) was a key success factor. It was a meaningful figure that drove all the project decision making from scoping, RFP and vendor selection, through implementation. It enabled the other stakeholders and project team members to make calls against a meaningful number they all understood.
  • He managed to avoid the usual potholes and pitfalls usually associated with trying to leverage new technologies to deliver business value.

If you find yourself in a similar situation, remember to consider Project Pre-Check’s three building blocks right up front and put these points on your checklist of things to do so you too can be a Great PM, and your sponsor’s best friend.

In the interim, if you have a project experience, either good or bad, past or present, that you’d like to have examined through the Project Pre-Check lens and published in this blog, send me the details and we’ll have a go.

Don't forget to leave your comments below.

How Much Project Management is Enough?

FEATURENOV23rdRecent resistance to implementing PM practices in an organization raises the questions, "How much pm is enough?"  "Do we need any of it at all?"

Does every project need a plan?  Yes!    

Does every project need to be controlled?  Again, yes. 

"How?" is another question. The nature of the plan, control reporting period, type of reports, etc. depend on a number of factors. 

Clearly, small projects performed by dedicated resources from the same organization unit who regularly work on projects together need a far less formal planning and control than larger projects being worked on by virtual teams from multiple organizations.

In addition, the prior success experience of the organization on projects should be considered to determine if past failures or successes are linked to project management.

When there is resistance to PM where it generally stems from fear of accountability and loss of autonomy and fear that there will be an administrative burden that will take time away from work on the project’s content. Scaling PM is a means for addressing this resistance.

Accountability

Project management is all about accountability.  Fear of accountability is tough to address. Few will readily admit to being afraid of accountability. Fear of accountability is often based on the experience or belief that they will be held to schedules and budgets that are not within their power to control.

For example if my task is to complete on Thursday and I rely on an input that is provided by someone else, then I might have a late delivery I could not control effect my performance evaluation.

Of course well educated project managers might say that schedule performance metrics must be qualified by the reasons for shortfalls.

True. But, how many clients and managers have the skill, data and desire to take a look at causes when they have hard facts in front of them.  It is more often the case that they say "You were late and I don't want any more excuses" as opposed to "I understand that you were late because your input was delivered to you late and the deadline we gave you was overly aggressive."

So we need to educate and remind everyone that a rational approach is needed. But, we should not eliminate planning and control because people do not want to be held accountable for their commitments.

Administrative Burden – How much is enough?

As for administrative burden, it is undeniable.  Project planning and control take time and effort. The amounts of time and effort vary depending on the level of formality, the tools and techniques being used and the skill of the PM.

How much is enough? A project charter with a description of the project, clearly stated measurable objectives and identification of the stakeholders and their roles and responsibilities is a must.  It could be a page or two and even be in the form of an email.  What you call it and its media and format are secondary.

An agreement regarding how the stakeholders will communicate and control the project should be in place.  In an informal setting it can be tacit and unwritten.  However, if there are disagreements about how the project is being controlled, then a more formal plan or process definition is needed.

There should be a comprehensive structured list of activities and their deliverables (a work breakdown structure) with a level of granularity that makes sense for the situation.  One week to two week task durations are a guideline for short term (one – two months out) but an initial plan with monthly milestones may be enough.  Some attention to risk is necessary.  Maybe it is not in the form of a formal risk register, but there should be some written statement of risks and their potential impact and responses. 

Target dates for at least the major activities (say about a month long) are needed.  A budget may or may not be necessary.

Regular status meetings and a report of progress against the expected target dates with a projection to the end of the project is a bare minimum for control.

Finally, some post project review with a report of its findings and recommendations is needed, whether for a single project, phase of an large project or a group of small projects.

There is no definitive answer to “How much PM is enough?”  To decide on what is needed in your situation, evaluate whether the benefits are worth the cost and risk.  When PM is applied skillfully, in a situationally appropriate way, it generally improves the probability of project success and pays for itself. When we let fear and adherence to inappropriate rigid standards drive decision making, everyone loses.

Don't forget to leave your comments below.

To Escalate or Not to Escalate? That is the Question!

A review of troubled projects reveals that the inability of the project manager or team to appropriately escalate decisions or issues is a common contributor to failure.

In some instances, the challenge is insufficient escalation.  This either results from the "superhero complex" that some project managers or teams develop (e.g. I can fix the world's problems by myself) or a lack of appropriate judgment (e.g. I can see the light approaching at the end of the tunnel, but I'm sure it's just the exit and NOT the train).

In other cases, excessive escalation can cause stakeholders and sponsors to get numb - this is the classic "Cry Wolf" effect.  When a concern emerges that truly requires attention, no one pays attention.

Like many of the soft skills necessary to be a successful project manager, there's no silver bullet that will guarantee effective escalation but here are some tips that might help:

1. As part of your stakeholder analysis, find out what their escalation requirements are.  Similar to risk bias, stakeholders are likely to have differing views on what kinds of decisions or issues need to be escalated to them for resolution and while you may not be able to tailor your approach to exactly meet these expectations for individual stakeholders this up front requirements gathering can reduce the likelihood of your being far off the mark.

2. Document escalation criteria and processes within your project's communication management plan.  Such criteria should be objective or at least be supported by examples of the types of events that merit escalation.

3. Leverage an external observer who can provide you with unbiased feedback on a situation.  Obviously you should not abuse this resource with each and every decision or issue that emerges on your projects unless a formal mentor-mentee agreement exists, but having the support of an external advisor can reduce the likelihood that your own intuition is invalid.

4. Make sure you've done some analysis.  For example, when faced with a decision or issue you can ask your team to perform a quick expected impact calculation (combining maximum impact and probability of occurrence) based on the question "What's the worst that could happen if we choose to deal with this without escalating?".

5. "Once is happenstance, twice is coincidence, three times is enemy action".  If repeated attempts to resolve an issue or make a decision within the team have failed, escalation can at least reduce the likelihood of further project impacts.

Communication is the most important project management knowledge area, and the ability to effectively escalate is a critical competency for any project manager.

Don't forget to leave your comments below!

The Agile PM—What’s the Big Deal about Commitment?

FEATURENov9thAs I discussed in my last post, I’m a bit of an “odd bird” when it comes to certain aspects of coaching agile teams. For example, I like the notion of calling sprints either a success or a failure based on how the team swarmed around and delivered on their Sprint Goal(s). Many agilist’s struggle with using the word failure to connote team performance and delivery—some prefer avoiding it entirely.

Another term that causes angst within agile circles is the word commitment. Again, I personally like the word commitment. After finishing sprint planning, I like to ask a team to “commit” to their sprint goal. I like the visualization of going “hands-in” as a team—in formalizing their commitment. Sometimes teams even physically do it, which always makes me smile. I see commitment as being a bond within the team to deliver on a realistic goal that they determine as part of sprint planning. It’s a bond extended to the business and generates meaning and focus for the team. But again, I may just be odd and miss the true nature of commitment.

So, what does it mean to be committed?

Let’s start with a definition of the term.  From wordreference.com I found the following definition:

  1. the state or quality of being committed to a cause, policy, or person.
  1.  a pledge or undertaking
  1. an engagement or obligation that restricts freedom of action.

Given that definition, project leadership is always looking for a team to commit to a project—to its target date/schedule, scope, and cost. They’re looking for guarantees from the team to meet the projects’ inception views towards completion targets.

On the surface that doesn’t sound bad—does it? Bringing it back to software development methods, there’s a perceived difference in how “committed” teams are in Waterfall variants vs. Agile variants (Scrum, Extreme Programming, Lean, Kanban, etc.).

Waterfall (is) Committed?

The thought goes that since teams plan their execution thoroughly in Waterfall, to a set of documented requirements, that when the project begins they’re in a clear position to fully commit to the project.

They’re committed to the date, to the scope, and to the costs they’ve estimated. And if there is any “negative discovery” along the way, the team will somehow figure out how to “suck it up”, working harder and longer to meet their “commitment”.  No matter what happens along the way!

You’ll often hear management driving this behavior—reminding the team of their commitment and to work smarter and not harder. There might even be veiled and not so veiled threats, as to what might happen if they fail to…meet their commitment.

Agile (is not) Committed?

Conversely there’s a feeling that agile teams lack commitment. You hear this coming from nearly every executive, technology leader, and project manager who are adopting agile and struggling with forecasting project outcomes.

This comes from the basic tenet that teams commit to projects incrementally—as they gain more understanding of the work by implementing it in small chunks. That teams narrow in on their delivery target as they gain more understanding and collaborate with their customer. That teams can commit when they’ve made some progress and understand their delivery velocity.

In lieu of simply committing without knowing, agile teams focus on incremental delivery and incremental commitment; needing some time to truly understand the project complexity and their own capacity. Many misconstrue this prudence and transparency for a lack of commitment. But there’s also a truth to agilist’s struggling with the term.

nov9bob2

A quick diversion to the Scrum Guide

Ken Schwaber and Scrum.org publish something called the Scrum Guide. They recently (2011) published an update to the Scrum Guide changing the language used to reflect the team posture at the conclusion of Sprint Planning. Previous language had used “commit”, as in the team would “commit” to the work they identified and planned as part of their sprint.

The updated language changed the word “commit” to the word “forecast”—here’s a copy of the language change that I copied from the FAQ on the Scrum.org site –

Development Teams do not commit to completing the work planned during a Sprint Planning Meeting. The Development Team creates a forecast of work it believes will be done, but that forecast will change as more becomes known throughout the Sprint.

This was one of six changes or adjustments that were made within the guide. I bring it up because it amplifies a common reaction in the agile community to the word commitment. At my core, I don’t understand the issue. It’s just a word.

 nov9bob1

Back to Waterfall vs. Agile Commitment

So are Waterfall teams more committed than their Agile counterparts? In the use of language around project targets and scope, it certainly appears so. But let’s get real. Waterfall projects rarely meet their commitments. I rarely do this, but I’ll bring out some statistics to make the point…

According to the 2009 Chaos Report examining the success rate of IT projects found that – 32% of projects succeeded, 44% were challenged or failed to meet some project goals, and 24% failed completely.

The key point here is the assumption that these were committed teams, yet literally 2/3 of the projects failed in some capacity. So I contend that commitment is simply a word. Not let’s look at commitment from a different angle—probably the right angle.

The Real Nature of Commitment

I don’t think team commitment comes from a methodology or a planning process—particularly for highly complex, technology-driven projects, with tremendous up-side risk because your teams are creating novel solutions to your problems.

Commitment is created by many factors and I don’t pretend to be an expert on it. However, it seems to me that some of the following are crucial to support an environment of commitment—

  • Teams commit to work that they have planned and estimated themselves; factoring in their true capacity and not influenced by unrealistic or artificial targets from their managers or corporate leaders
  • Teams commit to a compelling leadership vision, which leads to understanding project goals, determines strategies, and ultimately measures success
  • Teams commit to each other; so fostering an environment of teamwork, mutual accountability, trust, and professionalism
  • Teams commit to exciting and meaningful work; so communicate the ‘why’ and ‘impact’ of their work to inspire them
  • Teams commit to solid leaders—leaders who trust them to do their jobs and who provide sufficient support for them to succeed
  • Teams commit to doing good work. Work that balances competitive delivery against solid designs, creativity, work-life balance, and high quality
  •  Teams commit to providing total honesty and real-time transparency so that their leaders can make congruent adjustments; to leaders that can “handle the truth”.

Wrapping Up

So I still like to instill in agile teams that Sprints can either “Pass or Fail” depending on their efforts and behaviors and results relative to their sprint goal. And yes, I do expect a team to “Commit To” their plan to meet a sprint goal that they’ve established with their Product Owner.

I feel it’s not the word that is the problem. Instead, the question is—does the environment support the team in the areas I mention above in meeting their commitments? Point being—I don’t see commitment as a team only condition. I think the organization needs to establish a culture and an environment where commitment is supported. Where discovery and adjustment is supported, where honesty and transparency is honored, and where failure is tolerated.

If you have an environment that isn’t supportive, then yes, I can see changing the term and not using it. In that environment, then “forecast” would be a better term…as would dysfunctional. But I’m tremendously disappointed in the organization that can’t make congruent commitments across their teams and then deliver on those commitments.

So call me committed to An Environment of Commitment

Till next time,

Bob

Don't forget to leave your comments below.


References

  1. Top 10 Agile Phobias - http://www.slideshare.net/visuri/agile-phobias
  2. Chaos Report reference – http://www.few.vu.nl/~x/chaos/chaos.pdf
  3. Scrum Guide reference – http://www.scrum.org/storage/Scrum%20Update%202011.pdf
  4. Wonderful article on Estimation, Prediction, and Commitment – http://tynerblain.com/blog/2011/08/09/agile-estimation/

What’s New in Agile Project Management Certifications?

There’s lots of buzz in both the project management and agile communities recently with the announcement from PMI that they are launching a new agile certification. Questions abound:  what are the PMI agile certification requirements, how does this compare to the Certified ScrumMaster (CSM) or Certified Agile Project Manager (Cert.APM) qualifications, when can I apply, and many more.

PMI has provided some guidance on the process and requirements, but much is still currently unannounced as they are finalizing the details.  A pilot certification round is starting imminently with a full rollout this summer – the exam should be fully available through Prometric Testing Centres in September 2011 with the application process starting in May or June.  In the mean time, Internet discussion boards and chat rooms are filled with speculation.

What we do know for sure is that to become certified, you’ll need to pass a 3-hour multiple-choice exam on agile management with 120 questions, of which only 100 will count towards your score – the other 20 are experimental questions being considered for future exams.  The exams will be available via computer or paper at Prometric Testing Centres, the same as the PMP or other PMI exams. 

For educational requirements, you’ll need to complete a minimum of 21 hours of agile-specific training in addition to having a basic high-school diploma (at a minimum).  So, if you are CSM who has just completed the basic 2-day Certified Scrum Master course, you’ll need to go out and get an additional day of training.  This is probably a wise thing to do anyway, as the exam will cover a lot more than just Scrum practices.  For example, the sample questions that PMI has on their web site includes questions from Extreme Programming (XP) and Scrum, plus many questions that are outside the scope of pure Scrum, such as the construction of release plans.

There are also experiential requirements.  A candidate must demonstrate 2,000 hours of working on project teams in the last five years (not necessarily as the project manager – just working in a project environment), plus 1,500 hours of working on agile projects in the past two years.  PMPs will skip the 2,000 hour requirement, but must still meet the 1,500 hour requirement.  This agile experience presents a significant hurdle that will prevent many people (including new CSMs) from earning the PMI certification.  It is not just a test of agile knowledge, but rather you’ll need to demonstrate experience as well.

How does this stack up against the other agile certifications?  Take a look at the table below:

Agile Certifications

Certified ScrumMaster (CSM) Certified Agile Project Manager (Cert.APM) PMI Agile Certification (name still to be finalized)
Minimum Education None None High School
Mandatory Minimum Agile Training 2-day CSM course 3-day PMAC-accredited agile PM course 21 hours of agile training
Minimum Project Experience None 1 year as project manager 2,000 hours in last 5 years as project team member
Minimum Agile Experience None None 1,500 hours in last 2 years as agile project team member
Exam Length 25 multiple-choice questions in 1 hour 40 multiple-choice questions in 2 hours 120 multiple-choice questions in 3 hours
Passing Mark Not applicable – everyone who writes the exam earns their CSM regardless of score 70% Has not been announced
Certification Fee $50 (usually included in mandatory course cost) $100 (usually included in mandatory course cost) $495 (computer-based test) or $445 (paper-based test) $60 discount for PMI members
Certification Validity Period 1 year For as long as holder is a member of PMAC. 3 years
Recertification Cost $75 Not applicable (Membership varies from $25 to $100 per year) $130 plus 30 additional hours (PDUs) of agile-specific training

Initial observations show that the Certified ScrumMaster credential is not on par with the other two certifications.  Not only does it have low-to-nonexistent educational and experiential requirements, but its exam is not credible if everyone who attempts the exam gets their Certified ScrumMaster designation even if they don’t pass the exam.  The CSM credential is offered by the Scrum Alliance.  They state right on their own web site:  “Once you have completed the evaluation you will be granted Certified ScrumMaster status regardless of your score. If you score poorly, however, you will receive feedback detailing where you are deficient and what resources you should study to improve.”  The CSM certification was criticized in the past for not having an exam at all – this new approach does not make much of a difference if you get the certification even if you fail.  On the strength of this last point alone, those interested in agile certification should focus on the other two options.

Overall, the new PMI agile certification compares favourably with PMAC’s Certified Agile Project Manager.  Both require 3 days of agile-specific training, both require about a year of project experience, and both have a multiple choice exam (though PMI’s is longer).  The key differences:  PMI’s exam requires agile project experience (which may exclude many potential candidates) and it is much more costly to obtain (almost five times more expensive) and more costly to maintain.  Still, with the marketing might of PMI behind the exam, it should quickly catch on. 

Those interested in obtaining agile project management certification should put acquiring the new PMI agile credential on their long-term career development plan.  In the short term, the Certified Agile Project Manager credential from PMAC is a great interim step.

One should not forget the Certified Senior Agile Project Manager (Sr.APM) credential from the Project Management Association of Canada that was launched this year.  It takes an even more rigorous assessment approach than any of the three certifications mentioned above.  For this more advanced certification, candidates need to prove that they have competently managed agile projects in the past.  To assess the competence of the candidates, the PMAC looks for:

  • understanding of agile practices as evidenced by obtaining the Cert.APM qualification
  • feedback from team members to see if the candidate can effectively lead a team
  • feedback from sponsors to see if the candidate can manage stakeholder relationships effectively
  • evidence of sound agile practice through the presentation of agile project artifacts (release plans, backlogs, burndown charts, etc.)
  • a detailed project report describing how specific agile practices were applied on a sample project, and
  • demonstration of the necessary soft skills through a face-to-face interview.

With all of these elements, it is clear that this last certification is more costly and time-consuming to achieve.  However, it is clear that the Certified Senior Agile Project Manager credential is the gold standard of agile project management certifications.

Don't forget to leave your comments below.

Should PMP Recertification be Modified?

Let me begin by saying that personally I would not want to have to take the PMP exam again – but as an instructor of certification courses, the changes that have been made to the PMBOK between version 3 and version 4 are extensive.  I wonder how many, if any, of the PMPs who were certified 6 or more years ago are aware of these changes.  If we were referring to professionals in the real estate, legal or accounting professions, would we want them to continue to provide their service to us if they only had to attend meetings to maintain their “certification?”

Read more...

Page 1 of 11

  • «
  •  Start 
  •  Prev 
  •  1 
  •  2 
  •  3 
  •  4 
  •  5 
  •  6 
  •  7 
  •  8 
  •  9 
  •  10 
  •  Next 
  •  End 
  • »