TUCON: BPM, The Open Source Debate

Ryan Herd, who heads the BPM centre of competence within RBM Private Bank, was up next to talk about the analysis that they did on open source BPM alternatives. Funny that the South Africans, like we understated Canadians, use the term “centre of competence” as opposed to the very American “center of excellence”. 🙂

Don’t tell Ismael Ghalimi, but Herd thinks that jBoss’ jBPM is the only open source BPM alternative; it was the only one that they evaluated, along with a number of proprietary solutions including TIBCO. Given that he’s here speaking at this conference, you can guess which one they picked.

Their BPM project started with some strategic business objectives:

  • operational efficiency
  • improved client service
  • greater business process agility

and some technology requirements:

  • a platform to define, improve and automate business processes
  • real-time and historical process instance statistics
  • single view of a client and their related activities

They found that then needed to focus on three things:

  • Process: dynamic quality verification, exception handling that can step outside the defined process, and a focus on the end-to-end process.
  • People: have their people be obsessed with the client, develop an end-to-end process culture in order to address SLAs, and create full-function teams rather than an assembly-line process.
  • Systems: a single processing front-end, a reusable business object layer and centralized work management.

Next, they started looking at vendors, and for whatever reasons, open source was considering the mix: quite forward-thinking for a bank. In addition to TIBCO and jBPM, they considered DST‘s AWD, IBM‘s BPM, eiStream (now Global 360) and K2: a month and a half to review all of the products, then another month and a half doing a more focussed comparison of TIBCO and jBPM.

For process design, jBPM has only a non-visual programmer-centric environment, and has support for BPEL but not (obviously, since it’s not visual) BPMN. It does allow modelling freedom, but that can be a problem with enforcing internal standards. It also has no process simulation. TIBCO, on the other hand, has a visual process modelling environment that supports BPMN, has a near zero-code process design and provides simulation. Point: TIBCO.

On the integration side, jBPM has no graphical application integration environment, although it has useful integration objects and methods and has excellent component-based design. The adapters are available but not easily reused, and has no out-of-the box communication or integration facilities. TIBCO has a graphical front-end for application integration, and a lots of adapters and integration facilities. Point: TIBCO.

On the UI side, jBPM has only a rudimentary web-based end user environment, whereas TIBCO has the full GI arsenal at their disposal. Point: TIBCO.

Reporting and analytics: jBPM has nothing, TIBCO has iProcess Analytics and (now) iProcess Insight.

Support: don’t even go there, although jBoss wins on price. 🙂

Overall, they found that the costs would be about the same (because of the greater jBPM customization requirement), but a much longer time to deploy with jBPM, which had them choose TIBCO.

Given what they found, I find it amazing that they spent three months looking at jBPM, since jBPM is, in its raw form, a developer tool whereas TIBCO spans a broader range of analyst and developer functionality. The results as presented are so biased in favour of TIBCO that it should have been obvious long before any formal evaluation was done that jBPM wasn’t suited for their particular purposes and should not have made their short list; likely, open source was someone’s pet idea so was thrown into the mix on a lark. Possibly an open source BPM solution like Intalio, which wasn’t available as open source at the time of their evaluation, would have made a much better fit for their needs if they were really dedicated to open source ideals. I’m pretty sure that anyone in the room that had not considered open source in the past would run screaming away from it in the future.

Getting past the blatant TIBCO plug masquerading as a product comparison, Herd went on to show the architecture of their solution, which uses a large number of underlying services managed by a messaging layer to interface with the BPM layer — a fairly standard configuration. They expect to go live later this year.

TUCON: BPM Evolution and Roadmap

At this point, it makes more sense to start labelling the posts by session title rather than presenter, since we’re getting into some pretty detailed breakout topics. This one was presented by Roger King, Director of BPM Product Strategy & Management at TIBCO, and Justin Brunt, product manager for iProcess.

Most of the technical people working TIBCO’s BPM group seem to be vestiges of the Staffware acquisition; many of them are still based in the UK, where the development is still done.

They started out with a review of what’s happened in the products in the past 12 months:

  • Business Studio 1.x, a standalone modelling and simulation product aimed at business analysts; the free downloadable version released in November already has more than 10,000 downloads. Modelling is done in BPMN, and XPDL is supported for import and export — necessary for even getting the models into the iProcess Suite for execution, since there is no shared model with the process execution environment. It also supports imports from Visio and ARIS. There’s some more advanced features as well: a hierarchical organization of business processes and associated assets; and process simulation with SLA indicators and reports.
  • iProcess Suite 10.5, with improved work queue performance and scalability to support more concurrent users, better performance for sorting and filtering (always slow with most BPM products) and faster startup time. It also included an enhanced web client based on General Interface, with GI or custom forms support and a number of other new functions.
  • iProcess Insight 2.0, the BAM product, which I reviewed in a post yesterday.

What’s coming in the near future:

  • Business Studio 2.0, with support for the full BPMN 1.0 specification and XPDL 2.0. I keep meaning to download Business Studio and do some comparative analysis with some of the other downloadable modelling products, but I may wait until version 2.0. I wrote about a few of the new features from Tim Stephenson talk yesterday, but here’s a recap. In the process analyst perspective: design patterns/fragments to speed design, refactoring, concept modelling with UML support, import/export of EPC/FAD from ARIS, and custom XSLT translations to XPDL. In the process architect perspective: service registry, native services such as email and database connectors, direct server deployment and version control
  • iProcess Suite core component support for some new platforms, including 64-bit Windows Server and Red Hat Linux; direct deployment from Studio to Engine (although it’s not clear if this is via a shared model or just automates the import/export process); and new audit trail entries. They’ve also simplified installation.
  • Web services capability, with support for WS security at the transport and SOAP layer, and support for withdraw actions and delayed release.

They went on to discuss a number of key themes in product development for this year and beyond.

They’re gradually migrating to a single modelling/design environment — Business Studio — although they’re still not quite there yet; this will provide a more consistent experience for both business and IT users of the design tools. This supports the move to full model-driven development by allowing for the easy integration of forms design into the Eclipse-based environment, which can in turn generate GI, JSP or other runtime forms for the updated iProcess web client. Business rules definition will be in the Eclipse-based design environment, although it’s not clear if they’re using a third-party BRE or have their own rules technology. The old modelling environment, Business Modeler, isn’t going away any time soon, but new feature development will focus on Business Studio so will encourage migration. Like most vendors using this tactic to get existing customers off an old product, I expect that they’ll hear grumbling about this for years.

The out-of-the-box web client will be simplified and made to look more like the familiar Outlook client, with improved performance. The UI will also be exposed as components and services to allow them to be included in custom applications or portals, and they’ll ship an out-of-the-box BPM portal using TIBCO’s portal platform to show how this can be used. There will be better MS-Office integration and an Eclipse-based desktop application.

They’re also going to provide a project collaboration portal for BPM projects, to allow people developing TIBCO BPM applications to collaborate. They’re also adding in some governance capabilities to help handle the lifecycle of BPM projects and assets.

King mentioned my presentation from yesterday directly, and commented that they’re going to be supporting more of the BPA tools for import soon, including Proforma. They’ve obviously identified that it’s important to be extremely open from both a standards and BPA support standpoint.

Next on the list is goal-driven BPM, or virtual processes, where there may be too many process alternatives to model explicitly and the optimal runtime process has to be generated based on process parameters and environmental factors. This sounds like fuzzy future stuff, but would be great if they can pull it off.

They’re also developing workforce management and more complex resource modelling for the purposes of business optimization.

There was a brief point at the end about preparing for the next generation of SOA, although no time to talk about what this means; I would have loved if this session had been a bit longer.

TUCON: Me and Tim Stephenson

In the last session of the day, hence the only thing standing between the attendees and the bar, Tim and I gave a talk on business process modelling. My portion of the talk, which was not at all TIBCO-specific, talked about modelling for the masses; I’ll publish it here when I get a chance. Tim followed on with information about the new release of Business Studio, and how it’s used for process modelling. Tim and I met via email about a month ago when we were getting this all set up, and on Sunday we finally had a chance to meet face-to-face. In spite of our short time together, we’re pretty aligned on most of the issues, so had some pretty good synergy in our talk.

I feel sorry for Tim, as I do for anyone who presents after me, since I tend to get really carried away with what I’m talking about, and I went over my 20-minute allotment of our 40-minute presentation. 10 minutes over. I had a great time, however. 🙂

Tim went into many of the details of process modelling in the TIBCO Business Studio environment, and showed some particular BPMN examples that can be tricky to understand, such as gateways and events. It looks like they’ve done some nice work of creating process fragments — design patterns for portions of a process — that can be easily inserted in at any point in a process to save time. He also discussed their concept modeller for business domain modelling, allowing you to create an enterprise common object model using formal UML notation. He also had to shore up the damage that I did by slamming the lack of round-tripping by most BPA and BPM vendors.

That’s it for today; we’re all off for drinks at the evening reception, then I have dinner with some of the product marketing team which will give me a chance to pump them for information about what’s coming up.

Tomorrow promises to be interesting — the BPM track is packed with winners, so I’ll be stuck in this same room with the crappy wifi all day, but promise to emerge occasionally and publish what I’ve written.

TUCON: Simon Hayward

I’m in my first breakout session of the day, State of BPM – Trends and Drivers for Success: A Leading Analyst Perspective by Gartner, and although the schedule shifted slightly to accommodate overtime speakers in the breakout session, the speaker decided to just go ahead and start anyway so I have no idea who I’m listening to. He’s certainly familiar, I’m sure that I’ve seen him at a Gartner event before, but with the recent departure of Jim Sinur (and, I have heard, Michael Melenovsky), I’m not sure who’s pushing BPM at Gartner these days besides Janelle Hill, and this guy at the front of the room is definitely not her. If I can get some wifi in here, I’ll look up my coverage of the Gartner events and that will likely jog my memory. Oh, wait, I think it’s Simon Hayward, who I referred to previously as the Energizer Bunny of BPM for his high-energy flying tour of BPM at Gartner. Given that Hayward usually does high-profile keynotes, it’s interesting that he’s here doing one of five simultaneous breakout sessions — Gartner’s obviously a little thin on BPM resources these days.

Unfortunately, I’ve seen so many Gartner presentations now that this sort of state of the union address looks pretty rehashed to me. Gartner’s business process maturity model takes a starring role, as it has for the last several months; I first saw it in a webinar that I hosted with Appian and Jim Sinur last October, when it was still labelled “the road to BPM” instead of BPMM. He went on to talk about the value of BPM to enterprises, and moving from a functionally-driven to a process-driven organization, also seen in that October webinar and many other places.

His six critical success factors for a BPM project (or for that matter, any IT project):

  • Strategic alignment
  • Culture and leadership
  • People
  • Governance
  • Methods
  • Information Technology

In moving from implicit processes within applications to explicit processes in a cloud above the infrastructure, he sees three paths: BPM suites, process-aware middleware (he puts TIBCO in this category), and process orchestration in composite applications.

Then, the now-ubiquitous gear diagram of BPMS, with the process orchestration engine and business services repository in the middle, surrounded by the 10 necessary features and functions required to play in this market. He moved quickly through a number of other subjects, such as how BPM and SOA are orthogonal dimensions when implementing processes (nice characterization), and the complementary relationship between BPM, BI and BAM. He finished up with a slide that I’ve seen many times about assigning responsibilities between IT and business, still valid although I think that some of the responsibilities are shifting more than is indicated here.

I realize that Gartner is a draw at a conference like this, but I’m hoping to see a little more innovative material out of them soon.

TUCON: Tom Laffey and Matt Quinn

Last in the morning’s general session was Tom Laffey, TIBCO’s EVP of products and technologies, and Matt Quinn, VP of product management and strategy. Like Ranadivé’s talk earlier, they’re talking about enterprise virtualization: positioning messaging, for example, as virtualizing the network layer, and BPM as enterprise process virtualization. I’m not completely clear if virtualization is just the current analyst-created buzzword in this context.

Laffey and Quinn tag-teamed quite a bit during the talk, so I won’t attribute specific comments to either. TIBCO products cover a much broader spectrum that I do, so I’ll focus just on the comments about BPM and SOA.

TIBCO’s been doing messaging and ESB for a long time, and some amount of the SOA talk is about incremental feature improvements such as easier use of adapters. Apparently, Quinn made a prediction some months ago that SOA would grow so fast that it would swallow up BPM, so that BPM would just be a subset of SOA. Now, he believes (and most of us from the BPM side agree 🙂 ) that BPM and SOA are separate but extremely synergistic practices/technologies, and both need to developed to a position of strength. To quote Ismael Ghalimi, BPM is SOA’s killer application, and SOA is BPM’s enabling infrastructure, a phrase that I’ve included in my presentation later today; like Ismael, I see BPM as a key consumer of what’s produced via SOA, but they’re not the same thing.

They touched on the new release of Business Studio, with its support for BPMN, XPDL and BPEL as well as UML for some types of data modelling. There’s some new intelligent workforce management features, and some advanced user interface creation functionality using intelligent forms, which I think ties in with their General Interface AJAX toolkit.

Laffey just defined “mashup” as a browser-based event bus, which is an interesting viewpoint, and likely one that resonates better with this audience than the trendier descriptions.

They discussed other functionality, including business rules management, dynamic virtual information spaces (the ability to tap into a real-time event message stream and extract just what you want), and the analytics that will be added with the acquisition of Spotfire. By the way, we now appear to be calling analytics “business insight”, which lets us keep the old BI acronym without the stigma of the business intelligence latency legacy. 🙂

They finished up with a 2-year roadmap of product releases, which I won’t reproduce here because I’d hate to have to embarrass them later, and some discussion of changes to their engineering and product development processes.

ProVision 6.0 release

I finally made it home from Chicago around 1:30 this morning: United Airlines wimped out and cancelled all their flights, but Air Canada came through in the crunch.

I’m now on a Proforma webinar about their new V6.0 release of ProVision, of which I had a brief preview at their user conference last fall. Some highlights:

  • Browser-based access for collaboration, although I suspect that this does not include full modelling capabilities based on the comments that I heard at the user conference.
  • Web services access to Knowledge Exchange — this is pretty exciting, and I’d like to hear about more of this. For example, if ProVision exposed process models via a web service, could a BPMS consume that model directly?
  • Embedded Crystal Report functionality, which I recall was a big deal for the user conference attendees.
  • Updated UI in their desktop application, which was looking a bit dated.
  • The concept of dimensions in models, which allows for alternative versions to be created based on specific dimensions, where a dimension may be, for example, geography, or as-is versus to-be. In one model, then, you can compare North American as-is models with European to-be models, or whatever else you want to define based on your dimensions. Pretty powerful stuff.

I’m not familiar enough with ProVision to tell exactly what’s new and what was there before, but it does look like some significant improvements in this version.

ProVision 6.0 is being released over the next two weeks. A replay of the webinar will be available on their website.

BrainStorm BPM Day 2: Pat Dowdle

I was wrong, the last one wasn’t my last session, I had time for one more: Pat Dowdle on a Roadmap to Implementing Process-Based Management, based on CAM-I’s emerging Process-Based Management (PBM) assessment and framework. There’s a number of pieces to this:

  • Mindset/culture (how things are done; values, rules, practices)
  • End-to-end processes (classification; portfolio; structure)
  • Process-based measures (process performance; incentives/compensation)
  • Initiative integration: (ABC/M; ISO/quality standards; Six Sigma)
  • All centred around customer expectations

He went through a management model for process ownership, from a process council to process owners to team leaders and the team, and talked about a roadmap to PBM through the seven key milestones: awareness, commitment, engagement, managing processes, integration, embed and optimization. In this, he talks about moving from process metrics to transformation metrics once processes start to integrate across the organization: critical for moving from local optimized processes to global optimization, which seems to be my personal theme for the day. He also names the transitions between the seven milestones: discovery, foundation, transition, transformation (moving from managing processes to integration), institutionalization and realization.

There’s a presentation on the CAM-I website that goes into more detail about PBM including much of this, and quite a bit of material of theirs on BPMInstitute.org (just search for CAM-I). Check out slide 13 on the CAM-I presentation for a great chart that maps different quality programs (such as Six Sigma) against their seven milestones.

My flight home just cancelled, so I may hang around a bit longer…

BrainStorm BPM Day 2: Dan Madison

Last session of the day for me: I’m headed off to the airport following this, although I realize that the probability of a flight in or out of Chicago being on time when it’s snowing is near zero. With some luck, I’ll make it home tonight. The only thing that I’m missing is some sessions where the vendors get to show off their products, and a final wrapup keynote.

This session by Dan Madison is on Creating the “To Be” Process, something that I often do with customers, and I’m always looking to learn new tips and techniques from others who do the same thing. This session is part of the Organizational Performance symposium, the first of those that I’ve attended these two days.

He suggests a number of “lenses of analysis” to look at processes and derive the “to be” processes from the problems seen in that process.

First, create a customer report card, which for each ranked criteria, shows the current process performance (usually around quality and timeliness), what the best possible performance in that process would look like, and the two main competitors or outsourcers.

Second, look at the things that frustrate the people who are currently participating in the process, since there’s a high correlation between frustration and quality problems: frustration has the ability to act as a lens focussed on problem areas. Once frustrations are identified, the process participants tend to generate a ton of ideas on how to fix the problems, and there’s a huge amount of buy-in for changing the process from the grassroots level. I’ve definitely seen this with my customers. There was an audience question about how to keep this from becoming a bitch session, and Dan said that he uses some basic rules if things start to go that way: only process problems are discussed, not people problems; and each person can only bring forward their three main frustrations.

Third, look at the time required for each type of work in the process: processing, waiting, rework, moving, inspecting and setup. He finds that processing — the actual work — is typically only 2-20% of the time, which indicates that there’s a huge amount of inefficiency in the process. Of that small percentage, even all of that may not be time that adds value to the process. If you’ve automated your process with BPM, then you can gather this information with your system, but if your processes are still manual, then figuring out how your process breaks down will be manual, too.

Fourth, a cost lens such as activity-based costing; ABC calculates what it really costs to deliver a specific product or service by looking at the labour, overhead and material costs of each step in a process.

Fifth, a quality lens such as Six Sigma for measuring defect rates or some other relevant quality measure.

Last, take a look at benchmarks and best practices, by looking at your direct competitors and what they’re doing; and by looking at companies that have a process similar to your problem process and are considered to be world class, regardless of their industry.

He then moved on to design principles for the to-be process:

  • Design the process around value-adding activities.
  • Provide a single point of contact for customers and suppliers.
  • If the inputs coming in to the process naturally cluster, create a separate process for each cluster.
  • Ensure a continuous flow of the “main sequence.”
  • Bring downstream information needs upstream.
  • Involve as few people as possible in performing a process [our old adage of reducing handoffs lives!].
  • Ensure 100% quality at the beginning of the process.
  • Use co-located or networked teams for complex issues.
  • Redesign the process first, and then automate it.

Putting it all together, creating the to-be is the synthesis of:

  • Customer feedback
  • Worker frustrations
  • Time analysis
  • Cost analysis
  • Quality analysis
  • Benchmarking and best practices
  • Design principles
  • Information technology

Dan’s obviously experienced at this: he does it as a consultant, he teaches process mapping and improvement at the local university, and he has a couple of books that he’s written on it. I haven’t read his books, but I’ll be checking them out soon.

BrainStorm BPM Day 2: Ken Orr

For the first breakout session of the day, I attended Ken Orr’s talk on Business Process Driven Enterprise Architecture. He started out with some observations: improving business processes is essential for enterprises; business architecture is critical; modelling is critical; and business processes are hard to manage in the real world and especially in big organizations. Nothing earth-shattering here, but excellent points.

He made a great analogy by talking about IT levees — fragile yet critical applications and systems where you know that they’re a weak point but just never find the time or money to fix them — and understanding when they’re going to break. Apparently, a year before Hurricane Katrina, there was an exercise that modelled exactly what would happen if a force 4 or 5 hurricane hit New Orleans, but nothing was done; when Katrina hit, the levees failed exactly as modelled. Orr talked about mission critical spreadsheets as being one class of IT levees that are all set up to fail at the wrong time.

He talked about how enterprise architecture is like city planning, where your deliverables are things like a city plan, a zoning plan, a building code and an approved building-materials list. Sticking with the disaster analogies, he talked about how building codes are the result of disasters, and the obvious analogy with software and system disasters is pretty clear.

He covered off their enterprise architecture framework briefly, but used it mostly to discuss how the different layers in a framework interact: in short, technology changes enable business changes, and business changes drive the need for technology changes. He also talked about determining what type of business that you’re in, that is, what business processes are you really doing, so that you can figure out whether or not you should be in those businesses as well as how to improve them. Funnily enough, he really answered part of the question that I asked in the panel in the previous session with respect to getting an end-to-end business process view, but that’s sort of expected from an enterprise architecture person since EA can be a key tool in doing just that. In his terminology, what I’m talking about is a value stream, defined by James Martin in The Great Transition as “…an end-to-end set of activities which collectively create value for a customer.”

Update: I forgot to add “Orr’s rules of modelling”, which he gave after I had shut down my laptop, so were just scribbled on a piece of paper:

  1. It’s more important to be clear than correct. If you’re clearly wrong, someone will correct you. If you’re obscurely correct, you may never know.
  2. It’s not important that your first model is correct, only that your last model is correct.

BrainStorm BPM Day 2: Andrew Spanyi keynote

I didn’t come to Chicago specifically for the snow, but it didn’t disappoint me nonetheless: big wet snow dripping down, just enough to get me wet crossing the road from my hotel to the Drake.

We started the day with a keynote by Andrew Spanyi, who I didn’t give a great review earlier this year for his talk at ProcessWorld, and it seems to be a very similar talk that he gave there about business process governance although he’s promising some new research data. Also, this time it’s at the beginning of the day rather than the end, so I likely have a better attention span. Besides, he’s a fellow Canadian (although transplanted to the US), so he knows how to pronounce “process” 🙂

He starts out with his 2003 and current definitions of BPM, the latter of which adds (no surprise) the words “management practice”, before putting in a plug for his two books.

The study that he did through Babson College was a “mindset” study, which explored the role of executive mindsets in enabling a BPM focus, with the hypotheses that if a firm has embraced business process thinking, then they’d have an enterprise-level business process relationship map, they’d measure things from a customer’s point of view, they’d have assigned process owners with accountability for cross-functional processes, and they’d have a plan for business processes within the organization.

Only a third of the 18 respondents (five, by the sounds of it), however, reported that they actually had all of these things (I have a question as to whether 18 data points is a statistically sufficient sample size, but then I never was all that good at stats). There were some common characteristics in these five companies: a supportive and vocal CEO, passion about performing for their customers, some sort of competitive or environmental threat, and a receptive culture within the organization.

The companies often used a framework to help them bootstrap their efforts, which allowed them to develop their process management models and plan in a relatively short period of time, and they were enjoyed a fair degree of success as corporations.

He went back to a subset of the original sample set for a follow-up survey — nine companies, four of which were in that earlier “leaders” category — and found that they still identified the same challenges. Some lessons learned emerged from this:

  • Change management is key and takes longer than you think.
  • IT enablement is critical to make all this happen, often by taking away the old tools and replacing them with newer tools.
  • Build an organization-agnostic view of the process.

The outcome from all of this is that the organizations are seeing more cross-departmental collaboration (and less finger-pointing) due to the end-to-end view of the business processes, and that there’s a much bigger focus on the processes rather than departments — ultimately, this process-centric view is what’s going to drive success.

In the Q&A, he made the statement that BPM and BI must converge, and that companies that he talked to in the survey said that they wouldn’t buy software unless it had both — and intriguing statement that I would have loved to hear more about.

I still found that Spanyi covers too much ground in a short period of time, and flips through his slides too quickly to absorb a lot of the information: there was one five-point slide with some pretty critical summary information, maybe 20 words in total on the slide, and I could only jot down the first three points before he flipped to a rather meaningless graphic where he stayed for two minutes. However, he’s obviously knowledgeable about this stuff and I liked his talk this time around.