Gartner BPM: Dynamic BPM

Daryl Plummer’s thing is SOA and dynamic applications, and he presented this afternoon on Dynamic BPM: the ability to support process change by any role, at any time, with very low latency. In other words, (m)any process participant can make changes to the process in order to suit their specific needs, just as Trefler was telling us at lunch. A big part of making this happen is splitting out monolithic systems into more agile components: orchestration engine, portal, rules engine and databases.

Considering the mostly business composition of the audience, he did a pretty deep technical dive into concepts such as dynamic recompilation, showing how the dynamic nature of lower level technical components help to create dynamic processes on the surface.

He went through a well-used diagram showing BPM adoption over the years and where SOA comes into the picture, and the inherent dynamism in models, which is the whole premise behind model-driven design. SOA is used to automate what machines do best, while BPM and the associated process models are used to empower what people do best. More automation actually means more capabilities for the human steps in the process.

He summarized the event capture-analysis-response chain (covered by Roy Schulte in a session this morning that I just couldn’t make myself write about): events triggering business processes, and also monitoring those processes, in order to provide better decision quality, faster response, reduce information overload and reduce cost.

Inevitably, we move on to Web 2.0 and the implications for collaborative, ad hoc and social processes, community evolution of a process, and adding presence and other types of social context to processes.

One of the keys to making processes dynamic is business rules management, since being able to change rules without changing the structure of the process gives us most of the agility that’s required in business while allowing those changes to be made by business users.

Gartner BPM: Customers say the darnedest things

At the lunch presentation today, Alan Trefler (CEO of Pegasystems) discussed how it’s necessary — and possible — to put BPM right in the hands of the business users, and let them do it themselves. There will be some IT architectural oversight and support, of course, but you just have to convince the users, Tom Sawyer-like, that they really want to paint this fence.

I was sitting beside the BPM architect from one of Pega’s customers, and at the end of the talk I turned to him and asked “Do your business users do this?” His response: “Oh, hell, no!”

We still have a ways to go on this issue…

Gartner BPM: Opening Keynote

I arrived a bit late, transferring from the Ritz out in Tysons Corner down to the Gaylord in National Harbor (which Google Maps still thinks is a construction site), but caught the last half of the opening keynote with Janelle Hill and Michelle Cantera.

They started with some of the forces affecting business, both business and technology. Technology forces of change include having to balance enterprise-class and global-class computing, by which it appears that they mean custom, heavy-duty, special-purpose applications versus mass consumer applications: she makes the analogy between a custom, craftsman-made desk for the Oval Office versus an Ikea desk for the rest of us. Business forces of change include globalization, regulatory oversight, the evolution of the workforce (this is sort of a rerun of Connie Moore’s message of yesterday), and the complex value chains created by collaborative enterprises.

Since we’re here to talk about BPM, the next part was on how BPM helps us to cope with these forces of change. Their current BPM definition includes management practices, a structured approach using the management practices and software tools, and a cultural transformation (this last one is new in their definition, and long overdue). Overall, BPM is a set of disciplines plus technologies; it both encourages and enables continuous change in response to external forces, with a focus on optimizing end-to-end processes rather than specific functions. A key part of the approach is iterative (not phased), time-boxed, agile delivery, which I agree is critical but rarely see in practice.

BPM is being used heavily by companies that need to cope with frequent process change, usually in their customer-facing processes: from changes several times a year down to weekly or even daily frequency, plus ad hoc changes to executing process instances. What you need to think about, then, is how BPM changes your planning practices: Gartner suggests planning on shorter cycles and making plans dynamic and more transparent, with explicit guidelines for business outcomes rather than an explicit path by which those outcomes are reached. BPM also changes your organization and leadership by empowering employees (that’s a bit of a tired expression) and encouraging more fluid, virtual teams. It’s not clear that BPM is the real contributor here, however: I have the sense that they could take this same slide and present it at a number of different technology conferences (e.g., Enterprise 2.0) without changing anything but the title.

To use BPM effectively, you have to take advantage of monitoring and optimization, which is hopefully built into your BPM solution. This allows for better alignment of goals, metrics and results.

They finished up with a discussion of the skills and competencies required to build a BPM center of excellence (or as Gartner calls it, a center of competence), and a flying tour of their business process adoption and maturity model. Surprisingly, this tag-team presentation went way over time, not a good start for the day.

Not much new and exciting here — pretty much what you expect from a keynote — but a good overview of BPM in the context of business for the newbies in the crowd.

This week in BPM conferences

Last week and this week saw some very difficult choices for conference attending: I went to the International BPM conference in Milan last week, but missed Office 2.0; this week, I’m attending Appian’s user conference and Gartner’s BPM summit in Washington DC, but missing SAP’s TechEd and all my Enterprise Irregulars peeps (although I won’t at all miss going to Las Vegas).

Watch for my coverage of the Appian user conference tomorrow, then Gartner starting on Wednesday.

Upcoming conferences

I’ve been sticking close to home for the summer, but my fall lineup is about to begin. So far, I’m definitely attending the following:

  • Business Objects Influencer Summit and SAP SME Day, August 12-13, Boston. This is an analyst/press event, not a public conference, but I’ll be blogging from there.
  • International Conference on BPM, September 1-4, Milan. I’m very excited to be attending this conference since it represents a lot of the academic research going on in BPM, not just what the vendors and analysts have to show. There are some great workshops lined up, such as BPM and social software; interesting sessions; and demos from some of the universities and research labs. You can find last year’s proceedings here.
  • The Appian user conference, September 8-10, Washington DC. This is the first time that I’ve attended an Appian conference, and I’m looking forward to seeing what all those new marketing dollars are buying.
  • The Gartner BPM summit, September 10-12, Washington DC. I’ve been to enough of these lately that I don’t need to attend the whole summit, but since I’m in DC that week for Appian’s conference, I’m adding one more day for Gartner. I think that it’s pretty clever for Appian to schedule like this: it should drive up attendance at their conference, since Appian customers/partners flying in for Gartner will figure that it’s only a couple of extra days to do both.
  • OMG BPM Think Tank, October 6-7, Chicago. I’m on the program committee, and will be leading a roundtable on achieving collaboration between business and IT in BPM on the first day.
  • Business Rules Forum, October 26-30, Orlando. I’ll be giving a presentation on mixing rules and process.
  • SAP BPM, November 17-19, Las Vegas. I’m giving a Jumpstart pre-conference session, an introduction to BPM, on the 16th.

Given that I fly everywhere on Star Alliance, this will bump me over the 35,000 miles for the year that gives me Aeroplan Elite status for 2009, without which I really don’t want to fly.

From a disclosure standpoint, my expenses are being paid for the Appian conference, the Business Rules Forum, and two SAP events; for the latter SAP event, I’m also being paid to deliver the half-day training session.

Gartner BPM: Open Research Meeting

I feel like I’m on the last mile of a marathon: it’s the closing keynote of the conference, and it seems like it’s been going on a long time. Gartner may have jumped the shark by moving to two North American BPM summits per year; a lot of the material is heavily recycled, making it much less valuable to repeat attendees (although still very good for first-timers), and I’m sure that the vendors are completely fatigued — both in terms of time and money — from attending two of these each year, plus the one in London. Attendance feels lower than last spring, although more than last fall’s dismal attendance, and at some point the vendors will find that it’s just not worth their time and money to attend both North American BPM summits each year; that in turn will impact the quality of the experience for the end-customer attendees since they’ll see less of the vendors’ customer presentations, and less vendors at the trade show.

I’m hearing Daryl Plummer for the first time this week — not sure how I missed him earlier — as he moderates the open research meeting, joined by Janelle Hill, Matt Hotle, Elise Olding and Jeff Woods. I’ve never managed to attend one of these before, since I always seem to have been heading out of town during the last session. The format is that they put forward a series of strategic planning assumptions, then they are debated by the analysts on the stage and anyone from the audience who wants to participate.

The first strategic planning assumption is that business application vendors that do not deliver model-driven applications by 2012 will be marginalized as application providers. The dominant players — SAP, Microsoft and Oracle — are already moving in the direction of model-driven architecture, but there are still a lot of other ERP applications out there that are not heading that way, and there seems to be a strong argument that four years is just too aggressive of a timeline, especially in vertical industries where there might only be one dominant layer for a vertical-specific application. When it does come, it will likely be driven by the business, since model-driven architecture provides a world of difference to business (although it still has significant benefit to IT).

The second strategic planning assumption is that by 2012, more than half of new mission-critical business functions will be delivered by teams outside of IT through model-driven and agile techniques. Related to the previous SPA, this means that not only will the vendors be providing the model-driven applications, but that the business area will be delivering the functionality based on them, and on inherently model-driven platforms such as BPMS. This, of course, presupposes that the business even wants to lead these initiatives, which isn’t at all obvious since it isn’t happening in a majority of companies now. An interesting debate rose out of this that resulted in one of the analysts stating that “it might happen, but it might not work”, and pointing out that if their strategic planning assumptions don’t have some risk of being wrong, then they’re just tactical planning points.

The third strategic planning assumption is that enterprises that modernize their applications portfolio without a model-driven application focus will spend an equivalent amount of money by 2012 on a second round of modernization to get to model-driven applications. This highlights that not only will it be necessary to move to model-driven applications, but that it’s expensive; there was also discussion that if it’s not model-driven, then it’s not modernization, which seems to be a bit of a stretch.

All in all, I found this session interesting and am glad that I stuck around for it. I think that Gartner is very bullish on model-driven applications, and are overly optimistic about the timelines for how this technology will roll out. I don’t think that there’s any question that these things will occur, but 2012 is only four years away.

Gartner BPM: The BPM Scenario: A Change from Business as Usual, Janelle Hill

Janelle Hill addressed the issues of what’s really new in BPM and how it can change how you do business. She starts off by discussing how BPM is different from older business process reengineering techniques:

  • Process orientation complements functional organization, along the lines of what Rummler was discussing yesterday: processes overlay functional silos, which drives matrix management so that processes can be managed end to end.
  • Processes must be effective and transparent, not just efficient.
  • Processes must be adjustable (sometimes by process participants), not perfect, in order to adjust to changing customer requirements.
  • Small incremental improvements must be harmonized with larger transformative change.

Gartner defines an explicit process as one that it visible and independent from its implementation; namely, the process has been modeled separate from context manual or automated context. This type of modeling and the management of the explicit processes is essential for effectiveness and innovation; it allows for the establishment of process KPIs and allows you to model potential changes to the process. These process models provide a view of work in progress; as these models are implemented in BPMS, they become the visual metaphor for the work for monitoring and management purposes. They also provide a method of communicating about the process, both between business team members as well as between business and IT.

This also leads to new management techniques. Management becomes more real-time as the process monitoring tools allow for view of what’s happening right now in the business process, instead of managing through the rear-view mirror via historical reports. Typically, a process-centric view encourages collaboration among team members, and also encourages participation by the process workers. Both business and IT workers have different roles: the business user may be assembling their own solutions, while the IT person is designing and building components to be assembled.

She looks at a number of key factors for determining when a BPMS might be used:

  • Strong focus on coordinating multiple resources to create successful work outcomes, including people, systems, information and policies.
  • The process crosses a large number of boundaries.
  • The process is poorly understood.
  • The process is customer-facing or partner-facing.
  • The process is more susceptible to external or internal disruption.
  • Business will be responsible for change management, not IT.

If these factors aren’t present, then a more traditional coding approach might be used.

Hill went through some of the process design patterns — I saw this at the previous summit and really liked it, since I use something quite similar with customers — in order to map process characteristics onto different styles of processes, and therefore onto a subset of the BPMS products that might best suit those needs. The three most common patterns that they see with BPMS are case management, form-driven workflow, and participant-driven workflow.

She finished up with the BPMS magic quadrant, and explained that there are so many vendors in the leaders quadrant because they’ve changed the definition of what’s included in BPMS; I see that as a reason why there’s more vendors in the magic quadrant overall, but not why it’s so heavily weighted to the upper-right quadrant. She believes that consolidation for the purposes of acquiring technology functionality has already mostly occurred. She also sees that the larger platform vendors such as Microsoft are focused on software development as the primary method for BPMS rather than model-driven approaches that limit the amount of code.

She believes that this is not the time (yet) to pick the enterprise-standard composition platform, because no one tool handles all of the six process styles that she showed earlier. This is still not a mature market, in spite of the purchasing activity going on.

Gartner BPM: Weaving BPM into the Fiber of the Enterprise

Elise Olding moderated a panel on weaving BPM into the enterprise, with Eric Abecassis, Architecture and Integration Manager with Schlumberger, Jim Boots, Enterprise Architect at Chevron, and Kevin Morgan, Program Manager at Dolby.

Abecassis started with the process-related problems that they had at Schlumberger: processes had to be standardized in order to effectively manage growth and improve execution, reduce the administrative burden on the field people, and improve alignment between business and IT. Their approach was to focus on three main types of activities:

  • Doing the right things (business)
  • Understand the right things (business/IT)
  • Doing things right (IT)

It appears that their BPM projects are primarily driven by IT (although with heavy involvement by the business), in contrast to Chevron, where grassroots business actions drove the BPM efforts. In their case, a business unit had some amount of success, then a few individuals worked at selling the ideas across the company until it was accepted as a broader platform that can be used elsewhere. They’re still somewhat in stealth mode inside their own organization

At Chevron, they learned how to use the tool, then started to play around with how it could be used: looking for emergent applications of the technology. They showed off BPM to anyone who would listen, particularly trying to link it to existing initiatives, and continued to develop their BPM approach as it become popular in other areas. Overall, the grassroots efforts within the business delivered a proof of concept and a core set of advocates, but eventually key management endorsements and dedicated resources were required to make the transition to an enterprise-wide effort.

Dolby is a sort of 40-year-old startup that just went public two years ago, and is going through some major cultural changes to adapt to the changing world of entertainment technology. A management consulting firm provided them with recommendations for reorganization, then when they started to implement that internally, they discovered that this reorganization — a common issue — actually broke a lot of their business processes. He found an interesting effect: internal audit people have great insight into where problems might exist in business processes, and typically have the attention of management to a greater degree than a BPM team, so he worked closely with them.

It’s good to hear some success stories about how organizations are starting to become more process-centric: these stories aren’t just about how a specific implementation worked, but how the organization started to embrace the benefits that BPM could bring.

It’s a bit distracting that the panel members have obviously been told not to mention their BPM vendor by name; they dance around it by describing the tool, how they selected it and how they use it, but never say what it is.

Gartner BPM: The New Agile BPM Method, David Norton

This morning, I attended with David Norton’s session on integrating BPM and Agile software development methods. In BPM, we always talk about how BPM brings agility to business processes, but what facilitates that agility? Although a lot of this talk is about Agile, it’s definitely valid to look at how to apply Agile methods to BPM projects, since there’s still some amount of software development in almost every BPM project.

He started with a review of software development methods: architected model-driven (including BPM, where you draw an executable process model rather than writing code to handle work routing), architected RAD, and Agile. He then drilled in on Gartner’s 10 principles of NeoRAD (an example of Agile), such as close involvement of the customer, peer review and an iterative approach.

BPM needs to be a mix of agility and discipline, but not a waterfall methodology that we so often see used by old-style development teams when they take on a BPM project; BPM is predominantly architected model-driven because of the executable process models, but also uses some aspects of architected RAD and Agile since there are integration and UI components that require development beyond just the process modeling stage.

He described the principles of Extreme Programming as a coding methodology, and Scrum as a way to manage agile development projects; Scrum, in particular, has a lot of useful concepts that could be applied to BPM projects. He also covered Dynamic Systems Development Method, a type of RAD framework that includes the concept of turning an operational prototype into the end product to reduce waste and time in the development cycle, and Lean Software Development, focused on reducing waste and defects in the same sort of way as Lean works in the manufacturing sector.

He then looked at how BPM release cycles — continuous cycle of design and optimization, iterations of under six weeks, new policies and rules in a day — and how they are much more aligned with Agile methodologies than the traditional waterfall approach, which typically sees the first release in 4-6 months (in the best possible case). Unfortunately, most development teams inside organizations are still stuck in waterfall methodologies, and third-party professional services firms are more motivated to suggest long development cycles with large development teams. That means that even though the process model might be done as zero-code architected model-driven, the (often excessive) customization that happens in the component/service layer and the user interface drags down the project schedule.

This presentation was really much more about Agile than BPM — sometimes Gartner makes a bit of a stretch when bringing in their analysts from other areas and trying to make them BPM-ish — but if you’re not already looking at Agile development for any BPM-related project, you definitely should be.

Gartner BPM: Geary Rummler closing keynote

Today’s sessions closed with a presentation by Dr. Geary Rummler of the Performance Design Lab on the nature of process and the value of shifting an organization to process centricity. I saw him speak at the 2006 Proforma user conference, and enjoyed it; how can you not like listening to the guy who invented swimlanes?

He started with a historical perspective on process, starting in the 1982-92 timeframe with his highly-successful process-related work at Motorola that resulted a lot of useful process management/improvement tools, followed by the somewhat disastrous 1992-97 re-engineering phase that resulted in the split between business management and process management. When re-engineering became a prominent feature in Dilbert cartoons, Rummler decided to retire.

It didn’t take, and four years later (in 2001), he came out of retirement to find a confusing landscape of acronyms, an unnatural focus on technology, low-level process improvement techniques masquerading as methodologies, and subprocesses being implemented in silos. A majority of process activities was in the weeds, and had little linkage to business results. All of this brought him to today, where he asks the questions “why are we doing this ‘process’ stuff anyway?”

He moved on to a business perspective on process, where we’ve perverted the order of things such that budgets are allocated along the lines of the organizational chart, and therefore the work systems — including applications, data and networks — to which those resources are applied end up (naturally) siloed. Making improvements within a silo, as we all know, can only have limited impact on end-to-end process improvement and particularly in the interfaces to customers. The work system becomes invisible, and it’s managed only indirectly through management of resources: reorganizations and down-sizing as action items instead of considering how the underlying work systems themselves need fixing.

What we need to do is change our focus on work and resources, and focus on the business as a system for creating value, manifested in the products and services delivered to the customers. The value creation system — effectively, the customer-facing business processes — and the resources must both be managed directly and in concert. BPM, therefore, isn’t just about modeling, improvement and management, it’s about creating the value creation dimension of the business.

He then looked at a future perspective, with the Performance Design Labs’ framework for value creation, which provides a model of a business, its customers and external impacts. Inside the business in the first level of the model, we see the value creation system, enabling processes and management systems; driving down to the second level shows the three primary process systems in any value creation system (product/service launched, sold, deliverer); then the third level of detail shows the high-level business processing systems; the fourth level is the processes and subprocesses; and the fifth level is the tasks and subtasks that actually connect to the (human or system) performers of the tasks. This five-level hierarchy maps to a set of business architectures: supersystem maps, cross-functional maps, business process architecture, then down to the process and task maps, all of which become a management-friendly schematic of the business.

Within the hierarchy, the first three levels represent the strategic application of process work, and the lower parts of the third level through all of levels four and five represent the tactical side. Unfortunately, much of BPM is focused on levels four and five, which is disconnected from the value that’s outlined in the first level and from business leadership.

The implication of all this is that businesses need to be managed on two dimensions: the functional silos (buckets of resources), and the business processes that cut orthogonally across them (the value creation). And, just as there are problems in things disappearing into the vertical white spaces between functional silos, they can also get lost in the horizontal white space between business processes.

BPM must drive the articulation of the value dimension, thereby making it possible to link from level one down through to level four of the value creation hierarchy.

Rummler is a delightfully funny and informative speaker, and I enjoyed this even more than the last time that I saw him speak.