Gartner Day 2: Bill Gassman

The next session was on measuring processes in real time, namely business activity monitoring (BAM), and how it needs to be considered up front as processes are being design and implemented.

Gassman started off with a few definitions — BAM, real-time BI, operational BI, and process-driven BI — with some pretty fuzzy distinctions between some of these, especially in these days of converging functionality in the BI products. He then defined the goals of BAM: to monitor key objectives, anticipate operational risks, and reduce latency between events and actions. From an implementation standpoint, BAM is typically a real-time dashboard that’s integrated with BPM in some way and provides alerts in the context of the processes within the BPMS, but also links to more traditional BI functionality such as predictive and historical reporting. He also makes a distinction between more passive data displays that require someone to be looking at a dashboard in order to detect the condition, and sending an alert when a specific threshold condition is reached.

He talked about a number of different real-time analytic techniques, including process monitoring, logistics optimization, situational awareness, complex event processing, track and trace, and anticipate and react. Of all of these, CEP is the up-and-coming new technique (to be covered in the Event Processing summit that follows on after this BPM summit for the remainder of this week) that uses pattern recognition and matching, whereas the others are based on pre-defined metrics. Looking at it along another dimension, anticipate and react is a predictive technique that uses past and current data to predict the future state, whereas the others primarily display data or events that have already occurred.

Without monitoring, it’s difficult to detect when something has gone wrong in a business process; with BAM, not only can specific business questions be answered based on measurements, but analytical techniques can be applied to detect correlations, report on impacts, detect root causes, and make some predictions. This, in turn, feeds into the broader scope of corporate performance management.

He went on to discuss the synergy between BAM and BPM, and how BI (which he considers to be a different type of functionality) can be tossed into the mix to provide operational decision-making and even trigger new processes, on top of the “awareness” that comes from BAM. Although BAM and BPM are a natural fit, BAM doesn’t just come from the BPM vendors and isn’t just for BPM: some BAM tools are focussed on or part of business/enterprise software and BI suites. Having BAM integrated into the BPMS has some advantages however; the monitoring can be modelled right along side the processes, and drill-downs from the dashboards can go directly back to executing processes. However, many of the BAM products that are part of a BPMS are less functional than their general-purpose counterparts, and may be limited to monitoring just the business processes and not the larger business context. Because of that, Gassman’s final recommendation is to look for a BAM product that can be integrated with a BPMS but can also run standalone.

Gartner Day 2: Yvonne Genovese

Yvonne Genovese opened the day with a discussion on business applications through 2010 and the major changes impacting process environments. Her main focus is on enterprise applications, not BPM, but these applications have a huge impact on process management in any organization.

Her first strategic planning assumption: “By 2009, all leading application platforms will support design and deployment of events, complex events and services in a common, integrated context enabling users to create their own BPP [business process platform].” She followed this up later in the session to discuss how the enterprise application vendors will tend to try to increase the footprint of their application with customer organizations by expanding out to use their own middleware and other platform pieces.

No surprise, she also sees enabling process innovation and agility plus incorporating information into the processes will be a key for success: this is the intersection of BI and BPM that’s starting to occur more often today.

She discussed the problems today with fulfilling the dream of using services to build business applications: in reality, many of the services don’t match up all the well, and it’s not just plug and play as the application vendors might have you believe but still requires some amount of integration. However, by 2010, she sees the application environment becoming more service oriented such that services can be more universally used with less concern about the specific architecture of the services. That allows some parts of packaged applications to be more easily replaced by composite applications or outsourcing with much less custom integration work than is now required. For a process environment, this means more flexibility in sourcing processes or portions of processes, and the packaging and pricing will reorient towards operational processes.

As this happens, control will start to shift from vendors — from the environment of a primary vendor ecosystem — to the customers, who create their own ecosystem by selecting middleware, process components, SaaS, outsourcing and other building blocks. Many of these decisions also shift the control from IT to business within an organization, but it’s very necessary to distinguish between the processes that provide an organization with their competitive differentiation when selecting what to outsource or even move to SaaS. For example, SAP is announcing this week that they’ll have an entire SaaS platform for customers to use, but it’s not as functional as the full on-premise suite that you would buy from them directly, nor will it be integrated or customized for your environment to the same degree.

Getting back to the recurring theme of people within the process that I’m seeing this week, she also stated that the focus will move from process efficiency to arming the information worker. In fact, she states that by 2010, more than 50% of collaboration and user productivity interactions will be integrated with process technologies such as BPM — this addresses not just the transactional human interactions that occur in many automated processes now, but also all those messy, event-driven, less structured human interactions that are almost purely manual now.

Genovese went through three different process governance models — safe and steady control, cautiously dynamic, and aggressively predictive — and discussed the pros and cons of each as well as their basic characteristics.

We then arrived at this week’s first explicit definition of what Gartner means by a business process platform:

The business process platform is a combined IT and business model that enables enterprises to accommodate rapid but controlled business process change through the use of integrated process composition technologies and the delivery of reusable business process components and their management.

Whereas at the conference in February, they were saying that the large vendors would be creating BPPs and organizations would be buying them, it now sounds like they think that customers will be rolling their own BPP from best-of-breed components that best fit their environment and business needs, and assembling a virtual business services repository. In this context, it’s especially important to build or buy services with reuse in mind.

Genovese finished with a review of some of the large vendor’s BPP architectures, including a view of their BPP stack, and a summary of their strategies, strengths and challenges: Oracle, SAP, Microsoft and IBM. Her final recommendation for end-user organizations brought home why it’s important to understand what these vendors offer:

This era of change will require many users to re-platform all or some of their process environments; therefore, understand how the current business applications changes affect your environment now.

Good advice.

Gartner Day 1: Daryl Plummer

I can’t believe how quickly today has passed: it’s already time for the closing keynote of the day with Daryl Plummer. First, however, he showed us six predictions and asked us to vote to see which will be covered in the research session on Wednesday:

  • By 2013, your executives will no longer have control over more than 40% of the people they depend on.
  • Business people will become adept more quickly at business-IT alignment than will IT professionals, causing many It professionals to be shut out of BPM leadership.
  • By 2010, job opportunities for IT professionals lacking business expertise will shrink by 30%.
  • Packaged business applications vendors with implicit process models in their solutions will be relegates to commodity status by 2010.
  • Through 2010, SOA, SaaS, BPO, open source, business application implementation projects that don’t make process integrity an integral part of the implementation will fail. (The SOA SaaS, BPO, open sources on the front end of this sentence didn’t make much sense)
  • By 2009, less than 10% of BPM project revenue will flow to offshore services vendors.

The real focus of his keynote, however was on how BPM tames the SOA beast and the related keys to success. Plummer, who’ve I’ve always seen as an SOA guy in the past, has really come around to the BPM party line, stating that SOA is “one mechanism that makes BPM easier to do consistently well” rather than “the foundation of all life as we know it”. Maybe it’s due to the survey that they did finding that CIOs’ #1 priority is now improving business processes.

He started out with a wonderfully amusing description of SOA and web services in business terms; I’d be surprised if there was anyone in the room, no matter how non-technical, who didn’t understand it when he was finished. He then moved on to the three primary issues of the session: the relationship between BPM and SOA, how BPM can be used to govern and evolve an SOA, and what technologies, vendors and practices are most effective for building SOA success. My favourite quote from his presentation: “SOA can have an unexpected impact on people; BPM can have an unexpected impact on systems” — what an understatement!

In covering the evolution from distributed computing to SOA, Plummer pointed out that we’ve moved from integration technologies (RPC, CORBA, etc.) to the interoperability enabled by web services; on the BPM side, we’ve evolved from automation to process centricity. Interestingly, in the evolution of SOA we see where the need for BPM arises, and in the evolution of BPM we see where the needs for SOA arises. He brings it all together under the umbrella of enterprise architecture, where BPM provides the business viewpoint and SOA provides the technology viewpoint, all within the context of business strategy and supported by the underlying technology infrastructure.

He moved on to discuss critical end-to-end processes: “processes that provide a unified function but depend heavily on multiple subprocesses, none of which is intended solely for the purpose of satisfying the E2E process.” The subprocesses on which they rely are the siloed functional processes, but it’s the end-to-end process that makes a difference in the organization’s success.

Of course, when you start talking about SOA and service assembly into processes, the natural progression is to look at compositions instead of monolithic applications, and from there to what Gartner refers to as service-oriented development of applications (SODA): designing and developing components for reuse and dynamic binding. This, in turn, requires the right kind of process-centric people to bridge between the worlds of BPM and SOA using tools such as a BPMS for iterative process implementation and improvement.

Gartner Day 1: Jesper Joergensen, BEA

Another of the vendor sessions, and I’m sitting in on the BEA session, at least for Jesper’s half of the talk (I’m still torn on whether to stick around for the second half or scoot over to the Savvion user panel).

BEA is really realigning their message to put equal weight on their Enterprise 2.0 platform (which I covered extensively at their conference earlier this year) along with BPM and SOA.

Jesper started with a bit of a BPM market review, somewhat unnecessary given the information from Gartner that we’ve seen so far today, but quickly moved on to the most common challenges that they’ve determined based on a recent survey with their customers: inflated expectations (which relates directly to the position of BPMS as shown on the BPM hype cycle that Janelle Hill showed in the previous talk), organizational barriers, deployment complexity, user acceptance, and lack of skilled business analysts (to which Hill also referred).

He covered some best practices such as building a centre of excellence and using an iterative/agile methods, and discussed a matrix for prioritizing BPM implementation projects based on the cross product of their complexity and their process impact: start with the simplest process that has the least impact, then move along the direction of increasing process impact, then return to low-impact, high-complexity processes before finishing with high complexity and process impact. He showed a sample of a prioritization matrix with various processes for an organization plotted out by complexity and impact, which would offer a good guideline for planning the implementation of BPM projects.

In their lifecycle assessment survey (I believe that this is the one that they have online on their website), they’ve seen that there’s a measurable impact of SOA on the success and speed of BPM projects. This isn’t surprising, but it’s good to see some empirical data to back it up.

As a follow-on from some of the earlier comments from today, Jesper also sees that the future of BPM will move beyond the standard type of transactional flows that are common today and into more collaborative interactions and decision-making that involve ambiguity and require tacit knowledge, often as part of the same processes. That goes back to the same message that the people in the process are becoming more of the focus for BPM; it’s my opinion that we’ve done so much in automating tasks and streamlining transactional processes that a lot of the heavy lifting has been done here, and the new and interesting stuff is going to be turning back to look at the messy human-facing processes that haven’t been touched by BPM yet.

I did drop over for the Savvion panel in the second half of this session, but it was fairly unstructured questions from the audience so difficult to blog although interesting to attend.

Gartner Day 1: Janelle Hill

My third time today for hearing Janelle Hill speak, but I usually find her to be pretty interesting. This time, her topic is “BPM: A Change from Business as Usual”, taking a look at what’s really new in BPM, how BPM can change the way a company operates, and some BPM use cases.

She started out with a great chart showing what’s new and the implications of each of these points; for example, the fact that processes must be effective and transparent, not just efficient, implies that processes must be explicit and not embedded within applications. In discussing the harmonization of incremental improvement and transformative change, she comes back to the phrase “design for change”, which I’ve heard several times today already; interestingly enough, the subtitle of the Forrester IT Leadership Forum where I’m speaking next week is “Design for People, Build for Change”, indicating that the analysts are really setting the focus on this concept. This is, of course, the heart of business agility: if something isn’t designed and built with the intention that it would be changed frequently, then you’re not going to be changing it much.

Similar to her earlier comments in the opening keynote, the focus is really coming back to the people in the process: the goal of BPM is no longer to automate everything and eliminate people, but also to orchestrate what people are doing. Okay, that’s not really different than the view that those of us dealing with a lot of human-facing processes have had for some time, but it’s a wake-up call for the SOA vendors and IT departments that are focussed on straight-through processing that they have to start looking at the human side.

There’s a lot that has to change with the addition of BPM to a business environment: management based on real-time events, not just transactions; collaboration amongst team members and the team performance rewards that can drive that; and using tools such as simulation and optimization for modeling process improvements.

One important point that she makes about the current state of BPM technology is the explicit process models and their direct link to the executing systems. Although she doesn’t insist on a single shared model, the requirement for real-time round-tripping between the modelling and execution environments is implied in what she says about real-time synchronization between the model and the executing process. In order to make all this work, there are new roles for both business and IT people: the business needs to get involved in some of the analysis and modelling, and IT has to consider how to create reusable components to better enable this.

Hill then moves on to some real-life use cases covering six basic styles of business processes: case management, form-driven/STP workflow, content creation, transactional, guided navigation, and network organization. For each of these, she maps out eight different characteristics of the processes, e.g., what triggers the work to start, and talked about how you can use the combinations of these characteristics to help determine what type of BPMS product that you need. She pointed out that there is no single vendor here at the show (or likely anywhere) that does all six of these types equally well.

She then highlighted the three most common types — case management, STP and guided navigation — and listed common use cases for each of them as well as the expected benefits for each of these patterns. I really liked this section of the talk; it’s a more expansive view than the simpler set of BPM design patterns that I’ve talked about in some of my courses and webinars.

She finished up with a new BPM hype cycle, showing that the technologies are much more mature than the management and methodologies, and some good closing recommendations:

  • Start introducing process modelling, analysis and simulation to business leaders to get them ready for what’s coming in BPM.
  • Start hiring business process analysts and architects with process skills and experience.
  • Look at the characteristics of your process, based on the type of chart that she showed in the presentation, to determine what BPM functionality is required.

Gartner Day 1: Alan Trefler, Pegasystems

The lunchtime address is always a tough one: the speaker has to talk over the sound of clashing cutlery, and half of the audience has to twist around in their chairs to see the speaker and slides, but Gartner tends to keep these short and painless, and features entertaining speakers such as Alan Trefler of Pegasystems.

I was chatting with the others at my lunch table before the talk began, and the person beside me asked my views on some of the vendors. We talked about the pros and cons of product convergence, and I used business rules as an example of something that is sometimes baked right into a BPM product — as with Pega, which is based on a rules engine — but may be more versatile if available as a separate platform. I made a comment along the lines of “just wait, Trefler will tell us why it’s necessary to have rules as part of your BPM”.

Trefler’s focus was on the rhythm of business, the things that can kill that rhythm, and how to fix them:

  • Rhythm killer #1: the specification gap, where there’s a huge gap in time and understanding between the business developing requirements, IT developing specifications, then the business signing off on these specifications with the full knowledge that any changes are going to require an equally arduous change order process. The solution: directly capture objectives in the execution environment, that is, use tools that allow the business to create their own models, and have those translate directly to execution.
  • Rhythm killer #2: exporting models, which causes the models to be ripped out of the hands of the business and tossed over to IT to import into the execution environment, with no round-tripping. The solution: automate the programming, that is, use a zero-code environment that generates the executable model from that created by the business, either in a shared model environment or in a fully round-trippable environment.
  • Rhythm killer #3: no reuse of components or models. The solution: think about enterprise sharing and reuse upfront and design it into the system from the start. Trefler considers the secret of this to be using a declarative rules-based paradigm, of course, proving my earlier comment in his final sentence.

Gartner Day 1: Sandy Carter, IBM

The usual Gartner format is to allocate some sessions for vendors (read: sponsors) and their customers to make short presentations, and I sat in on Sandy Carter talking about IBM’s view of SOA and BPM.

She started with some thoughts on what’s driving business today and the changing business landscape in the global economy, from new technology and business models to new customers and global integration, and how this is driving companies to both innovation and optimization. She talked about some interesting examples of this: McDonald’s is handling their drive-through orders by routing them to operators in the Philippines who interact verbally with the customer to take the order, then key the order into a system that results your burger popping out of the window when you drive up; a perfect example of outsourcing a specific task in a process as opposed to the entire process.

Carter comes from the SOA side and stated up front that BPM must be implemented with SOA; while I certainly agree that SOA makes the implementation of BPM much more efficient, there are plenty of successful BPM implementations that don’t rely on SOA. She showed an enterprise architecture type of view of BPM (although she didn’t call it that), calling out the business view, the process view and the IT view as independent yet interconnected layers.

In looking at their strategy, she covered enhancements to the WebSphere Business Modeler, including improved integration with FileNet and Workplace eForms (by which I assume that she means the FileNet eForms product), which is good news: ever since the acquisition of FileNet by IBM was announced over a year ago, I’ve been wondering how they’re going to properly integrate the FileNet functionality into the WebSphere suite. As an aside, I’ve always felt that the BPM part of the FileNet line should have been moved over to the WebSphere suite from at least a product marketing/product management standpoint, although there would have been technical challenges due to the integrated nature of the FileNet platform: there’s a huge gaping hole where there should be human-facing BPM in the WebSphere line, and FileNet’s BPM would fill that gap.

She also discussed the WebSphere Business Monitor; I’m not sure if this BAM dashboard is the same as the Celequest (now Cognos) BAM capability that’s OEM’d into FileNet’s product line, or if they have a separate BAM offering.

Since IBM is really in the services business these days rather than the software business, she also talked about their new BPM methodology services offering. She showed a video of a very Second Life-ish “interactive management game” in which you run around the game and optimize a business process using BPM and SOA: a “first person shooter” game for business. This is supposed to appeal to the new generation of management that is coming through the universities now; I’d really like to hear the reactions of the students to this and whether they see it as a valid learning mode or just a lame attempt by a large corporation to jump on the Gen-Y bandwagon.

Gartner BPM Day 1: Creating a Process-Rich Strategy

This analyst panel was moderated by Daryl Plummer, and included Shafqat Azim, Eric Deitert, Janelle Hill and Michael Smith. Azim is with the consulting arm of Gartner and focusses on IT process improvement, whereas the other three are from the research side, and Plummer asked them about three key issues:

  • What is the value of a process-rich strategy?
  • How hard is it to align a vision for process with a business strategy?
  • What are the important topics one needs to master when creating a process-rich strategy?

The first issue was defining “process-rich strategy” as the operationalization of a business strategy, such that the causes and effects of individual parts of the process are well-understood by the process participants. As the discussion continued, it became clear that “process-rich strategy” is just the current relabeling of having a process-centric view of your organization, with a strong focus on dissolving some of the boundaries between functional silos in order to perform end-to-end process optimization.

One value of a process-rich strategy is to put individual business users in the context of the overall business strategy so that, for example, a call centre operator understands his position as a key customer touchpoint and how his actions impact the end-to-end business process; this, in turn, encourages the individual workers to look for ways to improve the overall process. By putting individual functions in the larger context, and providing visibility into the end-to-end process, improvements tend to address the entire process rather than focus on local optimization. Hill pointed out that team sports are a great analogy for business process visibility: everyone on the playing field can see what everyone else is doing, and understand exactly how their actions contribute to the overall team success. Athletes are motivated by their own personal success, but are also strongly motivated by their team’s performance since it’s great from a career standpoint to be on the winning team and to be seen as team players, not just to score all the points themselves. In some sports, team play is rewarded explicitly, such as tracking assists for hockey players as well as goals, since the game just doesn’t work without it. Similarly, the key to motivating business users to look for ways to improve the overall business process is to provide some reward for them. Sometimes, that’s financial (bonuses and overall corporate profitability resulting in increased wages); sometimes, it’s merely public recognition of the contribution; sometimes, it’s recognition of an individual’s ability that improves their overall career path.

There was a big focus on agility in this panel, and how both management and technology agility must be embedded within the business strategy. Management agility is the facility to think about new ways to do something or even a completely new business function, whereas technology agility provides the ability to make those thoughts a reality. Cause and effect within processes must be well understood in order to remain agile.

Process metrics and how they contribute to visibility was also a major area of discussion: if you don’t identify specific metrics for your business processes and start capturing that data, then you can’t analyze that into the higher-level process measurements that are required to see how well the business processes are performing and therefore optimize the processes. Smith will be doing a session tomorrow on how performance metrics help to align business processes with strategy for more detail in this area.

At the end of it, it comes down to the ability to execute business strategy: a process-rich strategy combined with the appropriate technology are more likely to see success in making business strategy a reality.

Gartner BPM Day 1: Welcome and opening keynote

Scrambling down to the conference this morning — I arrived late last night and didn’t get enough sleep, much less a chance to register — I struck up a conversation in the elevator with someone who was already wearing a Gartner conference badge and asked him where the registration area was. He pointed me in the right direction, and said that he hoped that the process was faster than last night, saying that he didn’t know what they were running on their systems but that it was very slow. I tossed off my usual comment about systems that don’t work well — “probably Windows” — then turned to him and saw the Microsoft logo on his shirt. Great, I’m not even at the conference yet, and I’ve made my first enemy. 🙂

The conference kicked off with an welcome from Daryl Plummer, Bill Rosser and Pascal Winckel [all speakers that I reference at this conference are with Gartner unless otherwise noted]. Plummer started off with an audience vote that showed that there are way more business than technical people here, a great (and fairly unusual) thing for a BPM conference. Like most business-focussed conferences, however, the logistics are not blogging-friendly: there’s no wifi, only an internet area where I can plug into a physical cable, and there’s no power at the tables to keep my laptop juiced. In fact, when I ran into Jesper Joergensen from BEA at the break, the first thing that he said to me was “uh oh, no wifi — the conference is going to get a bad review!”

Plummer did tell the best BPM joke of the day so far (not a lot of competition there): What’s the lifecycle of a BPM project? About 2.5 CIOs.

After the preamble and logistics, the opening keynote was given by Janelle Hill. She started out with a great slide on the evolution of process improvement: from scientific management through computerized process flow to our current focus on flexible and adaptive BPM and the start of a focus on SOA (service oriented architecture), BAM (business activity monitoring) and EDA (event driven architecture).

She showed the results of some of their recent research showing that increasing BPM discipline as the second most important business trend affecting the ability to compete during the next five years, second only to better project/portfolio management.

She went on to talk about how software can contribute to business value, and I had to laugh at one of the conclusions that they draw: “The focus of software must shift to enabling business process innovation rather than hindering it.” In theory, that’s what the software is for; what she’s pointing out is that in reality, software — especially large ERP systems — actually hinders business agility and therefore process improvement because of the difficulties in changing the software to meet the current business needs. BPM software provides the opportunity to actually enable process innovation by allowing the business side to make frequent changes to the process to accommodate changing business processes and regulations. This is based on two fundamental bits of functionality that are part of any BPMS: first, the decoupling of the process flow, represented as a graphical process map, from the underlying technology; with a direct link from the process map to an executable flow, the business can now make changes in that graphical environment that can move into production with a minimum of IT involvement. Second, tools to provide a detailed visibility into processes in near real time so that the business can determine where changes need to be made in order to improve processes.

Interestingly, Gartner is bringing the focus back to the people in processes: putting the person-to-process interaction back at centre stage in terms of both process analysis and execution, rather than just seeing people as bots that execute granular tasks in a process. In other words, the SOA view of human-interrupted processes isn’t what’s going to drive the new wave of process improvement; the people in processes are. Maybe that’s an admission that much of the SOA level of improvement is well-understood, so that there’s unlikely to be quantum leaps in process improvement in that area that haven’t already been identified; on the other hand, we’re just starting to discover how some of the human-facing functionality such as collaboration will result in process improvements that we can’t even envision today as the emergent applications of the future. This is exactly what I’m seeing in the Enterprise 2.0 space, namely, that the new generation of technologies provides the tools that allow the business users and analysts to have more control over how their systems work and therefore the effectiveness of their business processes.

Hill discussed the three types of vendors in the BPM market today: traditional packaged application vendors, middleware vendors, and BPM specialists. The market trend, as she points out, is that the BPM pure-play vendors are increasingly being acquired by the first two types of vendors. In spite of the acquisitions, however, she points out that this is not a consolidating market, since the number of companies who claim to have something to do with process management is still increasing.

She finished up with some of the standard Gartner material on what it means to be a process-driven organization and some of the organizational and management issues that need to be addressed in order to enable this; this is very similar to what I’ve seen at previous Gartner conferences and in webinars. With the last BPM conference being only 7 months ago, it’s certainly expected that we’ll see some degree of reused material, but based on this first session, it looks like there will be enough new information to keep everyone happy.

Gartner BPM and Event Processing summits

I’m headed off to Orlando tomorrow for the Gartner BPM summit that’s happening during the first half of the week, so watch for my blogging from there under the Gartner BPM category, which also holds my coverage from their February event. They’re also running the Event Processing summit at the same location for the rest of the week; I’ll likely catch a few of the sessions before I leave on Wednesday.

I have interviews set up with many of the BPM vendors while I’m there to get their latest updates, and thought that it would be a good idea to add a disclosure page on this site rather than having to remember to note which of them are my customers each time that I mention them in a post.