Looking Beyond Skill Sets and Competencies
The objective of this article is to illustrate methods that can be used to validate a Return on Investment (ROI), looking beyond skill sets and competencies.
Generally, organizations that engage in a formal Project Management Training Program will look to validate their investment by initially assessing a marked improvement in individual participant skill set and competency advancement. This is, however, only an initial benchmark of effective project management training and the integration of raised personal attributes and cognizance.
The real test of the validity of a program lies in the participants’ ability to return to the project management environment and make a day-to-day difference in their actual project assignments. This can be measured, stratified and sold by utilizing two different mindsets/methods.
The first mindset/method, best used by an organization that is employing a definitive and mature methodology (defined as a methodology in operation and successfully in use for more than two years), would be to target the areas that comprise their key process indicators (KPIs). These areas would be determined by tracking actual project data over the methodology maturity life cycle, i.e., bolstering the skill and competencies that would make the most positive difference in day-to-day implementation of the definitive methodology.
The second mindset/method would be to utilize the training program content (driven by pre-training interviews) to highlight areas in which the organization is currently taking the most hits on projects. This would include the full range of time, cost, human resource and management issues. The training, in this case Advanced Training, should target specific solutions to these hot spots and, in effect, create the initial benchmark or key
process indicator (KPI) targets against which to track. In doing so, the training would go beyond advanced general topic training to customized course(s) for implementation of the required process steps espoused by the organization.
This would serve as the beginning of a continuous improvement mechanism (the methodology) that can be owned by the project management resources.
Typically, organizations categorized as Level 1 or 2 in a PM-Capability Maturity Model (CMM) schema (either formal or informal), usually have not been tracking projects to a sufficient depth to create any form of accurate and meaningful benchmark/baseline data. The training program development schema, as designed above, would help to establish the initial target baseline that should be monitored at intervals determined prior to the training.
A few scenarios may arise from this approach:
- Minimal improvement is detected at the first few milestone/review intervals across a wide range of pilot projects, and the participants are at a loss to explain the situation (no increase in cognizance). This would require an examination of the program goals developed